Seeing History through a Clear Lens: Lessons from Vision

In many fields, including perception, cognition, and information processing, researchers refer to "bottom-up" and "top-down" processes. These terms refer to the direction in which information flows during processing.

Bottom-up processing refers to an approach that starts with the most basic, low-level information and builds up to more complex high-level representations. It is driven by the data itself, with no influence from higher-level knowledge.

In vision, bottom-up processing starts with raw sensory input from receptors in the eyes. This visual data is built up into increasingly complex representations, detecting simple features like edges, combining these to identify shapes and objects, and incrementally constructing a full perceptual interpretation. Bottom-up vision is data-driven and does not utilise top-down guidance.

In contrast, top-down processing refers to an approach that starts with higher-level knowledge, expectations, or context and uses this to guide lower-level processing. Top-down information flows from complex to simple representations.

In vision, top-down processing utilises prior knowledge, memories, and schemas to interpret sensory data. For example, recognizing that a particular constellation of features represents a dog involves matching the visual input to a stored mental representation of what a dog looks like. Top-down vision is concept-driven and shaped by pre-existing knowledge.

In summary, bottom-up processing builds up complexity from basic building blocks while top-down processing contextualises lower levels using higher-level knowledge and guidance. Real-world perception and cognition typically involve an interplay between both types of processing.

In vision science and historiography alike, distorted sources or limited perspectives lead to mistaken views, correct understanding requires upping the resolution or integrating patchy details with contextual knowledge. Bottom-up and top-down information processing are both important for understanding.

Consider the classic image of a Dalmatian dog effectively hidden in the background of a high contrast photo. It has sometimes been used as an example of how people will create meaning even if there is none there. Wishful thinking projected onto a picture of random dots. However, in this instance, it is indeed from a genuine photo and, with a bit of further manipulation of the image, it can be shown that there are important bottom-up details encoded in the picture that give our visual systems clues about the original scene.

This paper argues for the importance of bottom-up cues when processing the meaning of an image. 

Bottom–Up Clues in Target Finding: Why a Dalmatian May Be Mistaken for an Elephant

The paper found that manipulating the image by rotating texture elements reduced subjects' ability to locate a body, indicating bottom-up surface interpolation features are important. In a survey, most naive subjects could quickly locate a bulging shape overlapping the dog's body, suggesting bottom-up processing guides attention. However, as shown below, they then assigned incorrect heads/limbs, indicating top-down identification failed.

The authors computed two bottom-up features that overlap with the dog's body - texture compression and affine distortion of texture elements (the rotated blobs in Fig 1b). Small distortions in the image lead to mistaken interpretations when using bottom-up clues alone. People construct an incorrect bigger picture, like seeing a lion cub instead of a dog.

The results suggest bottom-up processing plays a bigger role than traditionally thought in locating targets like the Dalmatian, guiding top-down identification mechanisms to target regions. The paper argues the role of top-down processing in target detection is overstated in classical examples like the Dalmatian image.

However, the paper’s ‘correct’ interpretation (above) can interestingly be used as a counter example. We can demonstrate the importance of top down processing if we go the other way with the image and remove as much distortion as possible by getting as close to the original image as possible. As far as I can tell the first appearance of the image was in Life Magazine in 1965:

We can get a much clearer top-down understanding of the scene and then on looking back at the bottom-up paper’s ‘correct’ image we can clearly see where they have made some incorrect inferences - particularly with the Dalmation’s back and the placement of its hind left leg. Other interesting details also emerge; the dappled background was caused by melting spots in the snow, the dog was called Woody and the park was in East Lansing, Michigan!

We have just demonstrated that top-down features are still important! Or, as another paper puts it “Prior object-knowledge sharpens properties of early visual feature-detectors”.

This visual perception study found what we have just demonstrated here, that prior knowledge of an object's form helps people more accurately detect features consistent with that object. Top-down knowledge guides low-level perception.

Summary of the key points from "Prior object-knowledge" paper

The paper investigates whether high-level knowledge about objects interacts with and influences basic visual feature processing in the human brain. It utilises two-tone images, which initially look like random black and white patches. However, after a person gains prior knowledge about what object is hidden in the image, they suddenly perceive it as a coherent, meaningful object.

The researchers embedded faint line elements in these two-tone images. They then measured people's ability to detect the contrast and orientation of these lines before and after giving them object knowledge about what the image represents.

In two experiments, they found that people's sensitivity to the embedded lines improved specifically for lines aligned with invisible object contours, after the researchers provided object knowledge about what was in the image. This suggests that high-level knowledge about object form serves to sharpen and enhance early visual feature detectors that are tuned to detect features consistent with that object.

Importantly, this top-down influence of learned object representations on early vision occurred independently of any effects of visual attention. The results provide clear behavioural evidence that early visual processing is shaped by dynamic interactions with high-level object knowledge stored in the brain. This context-dependent top-down tuning optimises low-level vision to suit the current perceptual interpretation.

In summary, the study demonstrates that prior conceptual knowledge about objects interacts with and adaptively adjusts basic visual feature processing to support perception of that object.

Integrating Visual Cognition and Historical Analysis

In both visual cognition and historical analysis, optimal interpretation requires integrating bottom-up signals from limited sources with top-down frameworks to perceive reality accurately. A complete picture emerges from the interplay between clues and context. Integrating limited clues with contextual knowledge parallels optimal visual processing. The brain combines patchy sensory data with learned schemas to build meaningful perceptions. Historians need all available signals, from granular sources to big pictures, for coherent understanding. For example those familiar with the context of the 17th century and Catholic theology can more accurately interpret fragmentary details about Galileo's trial. Their prior conceptual knowledge shapes perception of the fine-grained evidence.

The Galileo affair remains a classic example of distorted historical vision. Persistent myths cast Galileo as a martyr opposing church dogma, propagating a narrative of inherent conflict between science and religion. But this perspective often derives more from modern biases than 17th century realities. The way Galileo has been perceived historically reveals issues similar to those of visual and cognitive perception, much like interpreting the famous image of the hidden Dalmatian dog. How we perceive history mirrors how we visually interpret images.

Misconstruing history resembles visual illusions. We fill in gaps with assumptions that seem reasonable but actually derive from habitual biases. Testing interpretations against multiple perspectives provides a reality check. In vision science and historiography alike, limited bottom-up signals without contextual framing propagate distortion and falsehood. But weaving together disparate clues within matured generative conceptual frameworks enables clearer-sighted understanding. 

Of course, no historical account will ever be perfect. But carefully gathering clues, accessing earlier sources, and leveraging conceptual knowledge sharpens vision. Gaining a clear, accurate understanding of history is similar to achieving accurate visual perception - it requires being open to diverse clues and contextual frameworks. Our default tendency is to cling to established historical narratives, distorting how we interpret the past to match our pre-existing beliefs and assumptions. However, if we can move beyond defensively dismissing or downplaying evidence that contradicts our entrenched perspectives, a more integrative insight can emerge from synthesising multiple clues and viewpoints.

When studying history, we need to be willing to challenge the assumptions and biases inherent in our own perspective. This means not just seeking out evidence that fits our existing narrative, but actively looking for contradictory clues that disconfirm our current understanding. By carefully integrating these divergent clues within broader contextual frameworks, we can achieve a clearer, more objective historical vision without forcing the evidence to match ingrained beliefs. Just as accurate visual perception requires integrating ambiguous sensory data, clear-eyed history requires flexibility to incorporate diverse clues into expansive contextual understanding, even if they clash with our default view.

Attributed to Galileo:

“All truths are easy to understand once they are discovered; the point is to discover them.”

Choose your own adventure:

Paradigm Shift        or        ?

Physics and human meaning - is there a conflict?

 

"If there is anything that can bind the heavenly mind of man to this dreary exile of our earthly home and can reconcile us with our fate so that one can enjoy living, -then it is verily the enjoyment of the mathematical sciences and astronomy." - Johannes Kepler

“The more the universe seems comprehensible, the more it also seems pointless”

- Steven Weinberg

As I explored in my previous post on metanarratives in physics, stories shape our scientific understanding. In the ancient world, many cosmic narratives have competed, survived, merged or disappeared over the aeons. Worldviews that have emerged to frame the cosmos with meaning or meaninglessness. From our own point in time reading the narratives of history and science it is inevitable that authors (including me obviously!) also have a worldview that frames and colours every paragraph. There is no such thing as a human source of raw, unfiltered truth. 

The story of Galileo Galilei has become a focal point for examining the evolving relationship between science and religion. In our modern world the ascendant narratives have been of progress in our scientific understanding since the Enlightenment. There can be a tendency among some modern writers to use selective depictions of Galileo's trial and punishment to propagate myths of inherent conflict between science and faith. Examining accounts of Galileo provides an illuminating window into the stories we tell about the past and how those stories in turn shape our present-day perspectives. How an author frames the famous Galileo controversy reveals their own metanarrative biases as much as shedding light on the more distant past. The legend reveals as much about constellations of meaning in our time as in the 17th century.

In his 1992 Allocution on Galileo the Pope optimistically declared that misunderstandings surrounding the affair could finally be laid to rest:

“From the beginning of the Age of Enlightenment down to our own day, the Galileo case has been a sort of "myth", in which the image fabricated out of the events was quite far removed from reality. In this perspective, the Galileo case was the symbol of the Church's supposed rejection of scientific progress, or of "dogmatic" obscurantism opposed to the free search for truth. This myth has played a considerable cultural role. It has helped to anchor a number of scientists of good faith in the idea that there was an incompatibility between the spirit of science and its rules of research on the one hand and the Christian faith on the other. A tragic mutual incomprehension has been interpreted as the reflection of a fundamental opposition between science and faith. The clarifications furnished by recent historical studies enable us to state that this sad misunderstanding now belongs to the past.”

Historical studies may have clarified many of the complexities around the Galileo affair (it is certainly the case that extreme claims of Galileo being tortured seem to have now been put to rest).

However, it now seems that the Pope’s hope that misunderstanding has been relegated to the past was over optimistic. The tendency to cast Galileo as a martyr for science opposing church dogma persists in popular accounts. Even statements aimed at reconciliation have been misconstrued through the lens of entrenched narratives. For example, Simon Singh when talking about the Pope’s speech in his 2004 book “Big Bang” claimed that “the Vatican even admitted that it had been wrong to persecute Galileo” (pg 485). 

Reading the Pope’s speech closely it is clear that there is no admission of “persecution”. The careful address resists oversimplifications, aiming to move beyond seeing the case as mere emblematic conflict. The main reason that there is no “admission” is simple - Galileo was not persecuted: To say Galileo was persecuted seems to imply he was a victim of the Inquisition. As devout Catholic, he himself believed that the Church had jurisdiction over him in moral or religious matters. After persistent disobedience and ill-advised impudence he was finally sanctioned. Even then his house arrest was quite unusual; it was really a paid retirement during which he wrote his most important physics work, "The Two New Sciences" (1638).

quote from a lecture by Ronald L. Numbers, May 2006

(author of “Galileo Goes to Jail and Other Myths about Science and Religion”):

"In contrast to the frequently repeated stories about the torture and imprisonment of Galileo,

we now know that he was apparently never physically tortured – he may have experienced a fair amount of mental anguish, but never physically tortured. He left Florence for Rome in 1633. When he arrived in Rome – this was for his trial – he stayed initially at the Tuscan Embassy, rather than in prison or at the offices of the Inquisition. The few days that he spent inside the Vatican during his trial were not passed in a cell but in a special three-room apartment made available for him as an honoured guest by one of the priests there with the Inquisition, and to make life as comfortable as possible they allowed him to get his meals prepared by the chef at the Italian Embassy and brought over to this “non-cell”. After his condemnation he was not incarcerated but placed under house arrest, first at the Villa Medici in Rome, then at the Palace of the Archbishop in Sienna where he stayed for quite a while, and then finally in his own villa outside of Florence. I don’t think any one of us would love to be under house arrest for any period of time, although that was far from the fate that befell him according to so many popular studies of Galileo."

If you're interested in delving into the myths surrounding the Copernican Revolution and the complex relationship between science and religion, I highly recommend reading the article titled "The Copernican Myths" by Mano Singham. This well-researched and thought-provoking piece dispels common misconceptions about Copernicus's heliocentric model and its reception by the Church. Singham's writing is both accessible and scholarly, providing valuable insights into the historical context and the nuanced interactions between scientific ideas and religious beliefs. Whether you're a historian, a scientist, or simply curious about the intersection of science and faith, this article offers a compelling and enlightening perspective. You can find the article here: The real story of how the scientific and religious establishments greeted the Copernican revolution is quite different from the folklore. And it's a lot more interesting. Mano Singham Physics Today 60 (12), 48–52 (2007); https://doi.org/10.1063/1.2825071 The persistent myths around Galileo reveal our propensity to craft history into parables that reflect current concerns. They illuminate modern divides more than past truths. Rather than exemplars of conflict, figures like Galileo were enmeshed in nuanced human dynamics between emerging science, theology, philosophy, and politics. If science and religion are both pursuits of truth, their relationship will be complex, just as truth itself is complex. No single narrative encapsulates that richness. By acknowledging diverse perspectives, we gain insight into the stories science and faith tell about our place in the cosmos. Their interplay continues, but irreducible to simple tropes of progress. Ultimately, our shared journey towards truth matters more than ideologies. Like Galileo, we struggle to reconcile new understandings with received traditions under the same heavens. Discerning truth through open and humble inquiry remains the common ground.

Choose your own adventure:

Seeing History through a Clear Lens        or        Syzygy

Metanarratives of Physics

 

"Sai Weng Shi Ma" is a phrase from a well-known Chinese fable, in English "Sai Weng lost his horse". This fable speaks about how a seemingly bad situation can turn out to be good, and vice versa. 

The story begins with Sai, an elderly man, who was the proud owner of a magnificent stallion. However, the horse, in a twist of fate, escapes and ventures into the wilderness of Barbarian territory. The villagers, empathising with Sai's loss, offer their condolences, but he simply responds, "Who can discern whether this is a stroke of misfortune or a blessing in disguise?"

In an unexpected turn of events, the stallion returns the following week, leading a herd of wild horses from the Barbarian lands. Sai's stable multiplies, and he finds himself in a position of wealth. The villagers, astounded by his sudden prosperity, congratulate him on his good fortune. Yet, the old man simply responded, "Who knows if it's good luck or bad luck?" 

The narrative continues in this vein, Sai's son suffers a broken leg while riding one of the new horses, and again, Sai's response remains the same. Following this, the Barbarians wage war and every able-bodied man is conscripted. Sai's son, unable to fight due to his injury, survives the war, and Sai escapes the heart-wrenching fate of losing his son. 

Each twist and turn in the story, each layer of complexity, alters the perception of what constitutes good or bad luck, and yet each time Old man Sai’s reply to the congratulations or commiserations of the villagers remains unchanged.

The saying lends itself to several interpretations, especially concerning the themes of fate and luck. The tale's finale hints at the idea that every setback might harbour a hidden advantage, akin to the English concept of a blessing in disguise or there being "a silver lining in every cloud". However, the story also subtly implies that what initially seems like a stroke of good luck may lead to unforeseen misfortune. 

Ecclesiastes 9:11-12 (KJV)
I returned, and saw under the sun, that the race is not to the swift, nor the battle to the strong, neither yet bread to the wise, nor yet riches to men of understanding, nor yet favour to men of skill; but time and chance happeneth to them all.

What is true here about interpreting the meaning of the ebb and flow of life's challenges and triumphs is also true for the ultimate framing of human meaning in the Cosmos. The Cosmic story has a framing, or rather we often have it framed for us by others. To find an ultimate frame we would be wise to learn from Old man Sai and step back from the immediate story we find ourselves in and practice flipping the narrative.

Metanarratives of Physics

The story of physics is embedded within our broader human narrative. As physics evolves, it experiences revolutionary shifts at various stages, each influenced by and influencing the grander narratives of society. This iterative process is akin to the layers of Sai's story, each adding a new dimension to our understanding. The crux of the matter is that no single narrative can encapsulate the entirety of human experience, let alone the physics and cosmology of the universe.

As we delve deeper into the story of physics, we'll examine some of the concepts as they emerged in history, exploring how these ideas were framed in their time and how we can perceive them today. We'll question whether our perspectives are too narrow or if our framing is too limited. Just as Sai's experiences could not be wholly captured by the labels of 'good luck' or 'bad luck', our understanding of the universe cannot be confined to a single interpretation or perspective. 

Everyone is part of a larger story, whether they realise it or not. Becoming aware of this is akin to awakening and learning from each other the wisdom hidden in each of those stories is enlightenment.

In addition to examining the framing of the story, I want to go beyond the "how" questions and get back to exploring the "why?" questions of a two year old. Each of us has a personal narrative that drives us to ask this question. We are not merely humans conducting experiments in a lab; we are driven by a purpose. So let's embark on this journey of exploration together, shall we?

Choose your own adventure:

Physics and human meaning        or        

 Cosmic Perspective