Listeners:

Top listeners:

00:00 00:00

Go to album

Paul Verschure on consciousness and distributed adaptive control CSN Podcasts
Edvard Moser on grid cells and entorhinal cortex CSN Podcasts
Giacomo Rizzolatti on mirror neurons and action understanding CSN Podcasts
Robert Axelrod on game theory and prisoner's dilemma CSN Podcasts
Adrian Owen on disorders of consciousness and vegetative state CSN Podcasts
Jonathan Whitlock on markerless motion capture and posterior parietal cortex CSN Podcasts
Luis Puelles on neuroanatomy and prosomeric model CSN Podcasts
Zoltan Molnar on subplate neurons and cortical development CSN Podcasts

Semir Zeki on visual brain and parallel processing

Episode 1 15.03.2018

PLAY EPISODE

Season 2018

0 Followers 10 Episodes

Description

What if the visual brain does not process information through a single hierarchy but runs multiple parallel systems that complete their tasks at different times? Neuroscientist Semir Zeki challenges the textbook model of visual processing, arguing that asynchronous operations across parallel pathways, not sequential stages through V1, are the fundamental organizing principle of visual perception. Subscribe for more from the Convergent Science Network podcast series. Semir Zeki joins Paul Verschure and Tony Prescott at the BCBT summer school to present an alternative architecture for the visual brain built on four key findings that the standard model fails to accommodate. First, V1 is not the sole gateway to visual cortex , direct projections from the LGN and pulvinar reach specialized visual areas independently. Second, conscious visual experience can occur without V1, either as preprocessor or postprocessor. Third, different visual attributes are perceived at different times: color is seen before form, and form before motion, with gaps of up to 80 milliseconds. Fourth, the brain operates asynchronously, and no current computational theory adequately accounts for this. The discussion examines what determines which of the multiple anatomical hierarchies takes precedence at any given moment. Zeki proposes that the answer is task- and stimulus-dependent: the same physical substrate supports many possible functional hierarchies, dynamically configured according to what the brain needs to process. He presents evidence that signals from simple geometric elements reach both V1 and high-level face and house areas at identical latencies, challenging the assumption that complex object recognition is built exclusively from oriented line detectors in V1. The conversation also addresses the Gestalt principle , that a face may be recognized as a whole before its component features are analyzed , and why this demands rethinking the building-block model of visual processing. Key topics include the role of the pulvinar in attentional modulation, why perceptual latency hierarchies do not match physiological latency hierarchies, the relationship between fiber diameter and processing speed, Zeki’s advocacy for genuine interdisciplinarity between neuroscience and philosophy, and what neuroaesthetics reveals about the brain’s knowledge-acquisition function. Part of the Convergent Science Network podcast series from the BCBT Summer School.

Tagged as:
Hierarchies Model Visual parallel processing visual brain Visual Processing

About the author

CSN Podcasts

Both the triumphs of humanity and its most evil deeds have resulted from collaboration. In a time where humanity is required to aspire to the former and minimize the latter, the question arises of how collaboration arises and why it fails. Surprisingly, this phenomenon, so central to who we are, is not well understood. Hence, a collaborative effort is required to understand collaboration in its full biological, psychological, sociological, cultural, and economic complexity and to translate this understanding into operational impact. This series of podcasts is one step toward achieving these complementary goals. The Collaboration Podcast presents interviews with people who are central orchestrators of collaboration in various domains including business, government, science, art, health, sustainability, and the military. The discussions were conducted by Prof. Dr. Paul F.M.J. Verschure and members of the Program Advisory Committee of the Ernst Strungmann Forum on Collaboration (https://www.esforum.de/forums/ESF32_Collaboration.html) during 2021 and had the goal to sketch a map of opportunities, challenges, and obstacles in human collaboration. The forum took place in May 2022, and now we would like to share this series of interviews with a broader audience. The full report of the Forum will be published in 2023 by MIT Press. The podcast was produced by the Convergent Science Network (https://www.convergentsciencenetwork.org/). Context: The stability of social systems depends critically on realizing sustainable methods of “collaboration,” yet how and by which means collaboration is achieved is not clearly understood; neither are the conditions or processes that lead to its breakdown or failure. Collaboration can be understood as cooperation between agents toward mutually constructed goals. Part of the reason for our lack of understanding is that the phenomenon of collaboration is, by nature, a highly multidisciplinary problem, and effective research into its complexities has been difficult to achieve across the broad range of scientific and technical disciplines involved. The need for a fundamental understanding of collaboration, however, has become increasingly important. Not only does humankind demand answers as it attempts to address critical challenges at multiple scales (e.g., climate change, migration, enhanced automation, social and economic inequality), but ever-increasing technological and economic means of interconnecting people and societies are disrupting long-established, familiar patterns of how we interact. Radical technological changes that are ongoing have the potential to reshape collaboration in ways that are currently hard to predict or influence (e.g., by altering configurations in interaction, information creation, and modes of communication). On one hand, such changes could disrupt hitherto stable forms of collaboration by affecting critical communication channels and traditional roles, as can be observed in the rapidly changing patterns in governance, commerce, and social interaction. Conversely, technology could lead to the emergence of novel, successful forms of collaboration that deviate from traditional “hierarchical” architectures. Evidence of this can be seen in areas as diverse as highly automated manufacturing plants, the open science movement, collaborative software repositories, user-centered services, and the sharing of economy-based modes of organization. Without a fundamental understanding of the mechanisms, processes, and boundary conditions of collaboration, it is not possible to evaluate or predict which of these possible scenarios are sustainable or even plausible. The Forum “How Collaboration Arises and Why it Fails” (May 8–13, 2022, Location: Frankfurt am Main, Germany) Chairs: Andreas Roepstorff and Paul Verschure Program Advisory Committee: Jenna Bednar, Julia R. Lupp, Bhavani R. Rao , Andreas Roepstorff, Ferdinand von Siemens, and Paul Verschure

Timestamp

00:00:03 - This is the Convergent Science Network podcast. Leading researchers in the domain
00:00:10 - of neuroscience, brain theory and technology are interviewed by Paul Verschure and Tony Prescott.
00:00:23 - All right, this is Paul Verschure with the Convergent Science Network podcast
00:00:27 - and I'm here with the first speaker of our Barcelona Computer,
00:00:32 - Brain and Technology Summer School, Samir Zeki.
00:00:36 - So Samir, it was really great to hear you speak this morning about the work
00:00:42 - you've done over the last decades on the visual brain.
00:00:45 - Thank you. But before you delved into the science of it, you made some remarks
00:00:54 - on multidisciplinarity and your views on that.
00:00:58 - So why was it important to you to sort of highlight your perspective on multidisciplinarity
00:01:06 - before you went into the science of the visual brain?
00:01:08 - Well, it was important for me because you introduced the session today by talking
00:01:14 - about how your institute here, your university,
00:01:16 - is interested in engaging in the arts and in the sciences and is not a unimodal subject.
00:01:26 - Now, the idea of being interdisciplinary is very fashionable at the moment and
00:01:34 - they keep telling us how we should be interdisciplinary. disciplinary.
00:01:37 - But the reality is very different. The reality is that people are extremely hostile.
00:01:42 - Now, let me just explain to you why I think this does not work so well.
00:01:46 - Because when you go to research councils, you have to choose panels.
00:01:55 - Panels that judge, say, neurobiology will have no knowledge of art or physics or philosophy.
00:02:03 - And therefore, they say, well, we don't think this is sort of philosophical
00:02:07 - enough or artistic enough, and the others do the same.
00:02:10 - So doubts are raised, plus the university structures, with one honorable exception,
00:02:18 - I have to say, which is my college, University College London.
00:02:21 - The structure of universities also is not conducive.
00:02:25 - So in most universities now, you don't find a department of anatomy anymore,
00:02:30 - but you find a department of cell and developmental biology.
00:02:34 - So it includes things which are allied.
00:02:36 - But you would never get a department of, say, neurobiology and philosophy.
00:02:43 - They won't do it.
00:02:45 - And I think it's a great pity, because I think that the problems asked by philosophy.
00:02:51 - Well, let me put it this way.
00:02:52 - One of the functions of the brain, of the main function of the brain,
00:02:57 - is to acquire knowledge.
00:02:59 - To take action, for sure, but to try to acquire knowledge for it.
00:03:03 - And one of the main problems of philosophy as a discipline is the problem of
00:03:07 - knowledge, of how we acquire it, and how certain we are of what we know.
00:03:11 - Now, what could be more natural than to ally these things?
00:03:14 - But you try to get some money for that, and you will not get it,
00:03:16 - because the whole structure of universities is not conducive, and research councils.
00:03:22 - I just want to just end up by one thing which I said earlier on,
00:03:27 - which is that I am appalled by the advice given by one academy to young people
00:03:34 - who are interdisciplinary in tendency,
00:03:37 - that don't declare it.
00:03:42 - Go and master a field and then come out of the closet.
00:03:47 - Come out of the closet and declare yourself as you're interdisciplinary. disciplinarian.
00:03:50 - I think it's one of the most shocking bits of advice to give to a young aspirant
00:03:55 - researcher, when you should be asking them, settle on your problem and then
00:03:59 - use whatever approach you need to use and learn it.
00:04:03 - And young people are very enthusiastic and they're very inspired and they're very able to do that.
00:04:07 - But if you channel a person to spend 20 years to, or whatever they want to have
00:04:13 - in mind, to learn certain techniques and become masters before you will reach
00:04:16 - some interdisciplinarity, I think it's very poor advice.
00:04:21 - Well, then something might lead to a self-fulfilling prophecy of a unidisciplinary
00:04:25 - person. It will. It will. A highly specialized person.
00:04:29 - Absolutely. So in that context.
00:04:35 - You have linked your study of the visual brain also to the arts and to aesthetics,
00:04:40 - and we'll come to that later.
00:04:44 - Also, given your current position as professor of neuro-aesthetics,
00:04:47 - but the foundation on which you made that jump was your understanding of the visual brain.
00:04:54 - So now in your talk, you emphasized very much that you were advocating an alternative
00:05:00 - view on this visual brain. Yes.
00:05:02 - And this alternative view was very much going away from this rather sequential,
00:05:09 - linear processing structure that would go from retina to the left, to the right, to V1, etc.
00:05:17 - So what are the main outstanding differences between this traditional view and
00:05:22 - this new view that you now advocate?
00:05:25 - So there are three or four main differences, much of them rooted in new knowledge
00:05:31 - or not so new knowledge, which has been around for between 40 and 20 years,
00:05:37 - and some of it is accruing.
00:05:39 - One is that the common view that the sole input, visual input to the visual
00:05:46 - brain or to the rest of the brain is through the primary visible cortex is simply not true.
00:05:52 - There's a lot of anatomy to show this, and it's been there for 50 years.
00:05:57 - The second point is that the systems that feed directly into visual areas outside
00:06:05 - V1 are capable of eliciting a conscious visual experience.
00:06:12 - So, to experience a visual stimulus consciously, you don't need V1,
00:06:17 - either as a pre-processor or a post-processor, as so many people assume.
00:06:22 - Thirdly, the fact is that you do not see all the different attributes of the
00:06:30 - visual world at the same time in the micro-perceptual world,
00:06:33 - let's say below 150 milliseconds.
00:06:36 - We all assume that you did, but in fact you see color before you see form,
00:06:41 - before you see motion, with differences which are quite significant,
00:06:44 - say 80 millisecond between color and motion, color coming first.
00:06:49 - And finally, the principle which has been universally ignored,
00:06:56 - And I think it's a pity, really, which is the principle of asynchrony,
00:07:00 - that the brain undertakes asynchronous operations all the time.
00:07:03 - Now, if you factor the asynchronous operations all the time,
00:07:08 - then I would think that one would have to modify quite considerably the computational
00:07:15 - theories of how the visible brain functions.
00:07:18 - And in a way I'm a bit surprised maybe not a question of interdisciplinarity but the extreme of.
00:07:32 - Specialization I'm a bit surprised that there's no computational theory for
00:07:37 - example today that takes into account the fact that the operations of the visual
00:07:42 - brain are highly asynchronous because lots of things follow from that,
00:07:47 - so So I'm not advocating at all throwing out previous findings,
00:07:52 - which are very good and robust and solid, and there have been many, many exciting ones.
00:07:56 - I'm simply saying that these have got to be all integrated together.
00:08:00 - And if you do that, you get a different notion of how the visual brain functions
00:08:04 - than the one we currently have.
00:08:06 - But the examples that you provide are sort of questioning this notion of a single hierarchy. Yes.
00:08:16 - But does that imply that you believe that there are multiple hierarchies, and if so, how many?
00:08:21 - Yes, it certainly implies there are multiple hierarchies, and there are at least
00:08:25 - three with subdivisions within each.
00:08:28 - But I cannot tell you how many. I think there may be quite a few.
00:08:32 - In fact, there may be quite a few which use the same systems,
00:08:36 - the same hierarchical systems.
00:08:39 - The important thing is, one, is that the single hierarchy is an idea first put
00:08:43 - forward by Hewlin is not true, even for the form system.
00:08:48 - They base their whole theory on the form system, but even in the form system,
00:08:52 - that's not entirely true.
00:08:55 - And the notion that the hierarchies.
00:09:02 - Temporarily involve always activation of V1 first in the other areas is not true.
00:09:07 - And thirdly, that the perceptual hierarchies would obey the latency hierarchy is not true.
00:09:13 - So you've got to find a common denominator. What can that be?
00:09:18 - That denominator is that hierarchies, which of the systems, with our several
00:09:24 - hierarchical systems operating in parallel, Which of these has precedence and
00:09:29 - priority depends upon the task and the stimulus.
00:09:33 - To my knowledge, that explains it all as of the present time.
00:09:38 - But of course, you may have to change it if new facts come into light.
00:09:42 - But now, we could argue that there might be three perspectives on hierarchy, right?
00:09:48 - We might have anatomical hierarchies, physiological hierarchies,
00:09:51 - and functional hierarchies. Yes. And they're not necessarily identical.
00:09:55 - Well, exactly they're not. Right. But in terms of the anatomical hierarchy,
00:09:59 - what would you see as the key pathways when we talk about the visual brain?
00:10:05 - Right. See, there are two different kinds of anatomical hierarchies.
00:10:08 - One is the hierarchy through V1, retinal lateral geniculate nucleus V1 to other visual areas.
00:10:15 - Another hierarchy is, of course, retinal lateral geniculate to the specialized areas and to V1. on.
00:10:22 - But there are other hierarchies.
00:10:27 - I mean, within the anatomical system, people have defined hierarchical systems.
00:10:39 - This is started with Pandya and his colleagues.
00:10:44 - They defined find it as an area that projects to a higher cortical area,
00:10:50 - projects to layer 4 of that cortical area, and a area that recedes from a higher
00:10:55 - cortical area, recedes and puts it into the upper and lower layers.
00:10:59 - So you've got some kind of arrangement like that, which seems to be true everywhere.
00:11:04 - So you can classify areas into a hierarchy with respect to each other.
00:11:11 - But now look at it. Area V1.
00:11:15 - Projects to the lower four of area V5. Hence, you'd say that area V5 is a higher
00:11:22 - area compared to area V1.
00:11:27 - But actually, if you look at the arrival of signals in these areas with fast
00:11:33 - motion, you find that V5 receives them first.
00:11:37 - So that latency hierarchy does not obey the anatomical hierarchy.
00:11:42 - Now if you look at perceptual mechanisms, you find that if it is.
00:11:51 - The latency of arrival of signals into V5 with fast-moving stimuli is 28 to 32 milliseconds,
00:11:59 - it happens to be quite close to the latency of arrival of color signals into
00:12:05 - V4, which is in the sort of 30 to 40 millisecond range.
00:12:09 - Now you would assume that you see color and motion roughly about the same time,
00:12:13 - or if anything, you would see fast motion before you see color.
00:12:17 - Not true. You see color before you see motion by 80 milliseconds.
00:12:22 - So the perceptual hierarchy does not obey the physiological latency hierarchy.
00:12:27 - That is why I have sought to find a system that would that would explain all these hierarchies.
00:12:37 - And the only one I can find is a task and stimulus-dependent one.
00:12:41 - But automatically, what you've advanced was an idea that's actually a parallel
00:12:46 - feed-forward pathway that is not running over the LGN into V1,
00:12:53 - but it runs over the pulvinar directly to higher visual area,
00:12:58 - higher cortical visual area. Yes.
00:13:00 - So would that be then the foundation for the anatomical hierarchy?
00:13:05 - Well, they're all hierarchical. I mean, there are three, at least three.
00:13:09 - One is retina, LGN, V1, and then visual areas.
00:13:13 - One is retina, LGN, directly to the visual areas. One is retina,
00:13:17 - pulvinar, directly to all of these visual areas.
00:13:20 - I suspect that the pulvinar one, and I don't know much about it.
00:13:24 - I know that the anatomy exists. That's well known, it's been known for 50 years almost.
00:13:29 - But I suspect that the pulvinar system may be much more concerned with attentional
00:13:34 - mechanisms, which of course every area has them.
00:13:38 - I mean, attentional mechanisms are involved in every area. So I suspect it is partly that.
00:13:43 - I think there is reasonable evidence to show
00:13:46 - that the capacity of V5 to register consciously the direction of fast-moving
00:13:58 - stimuli is more dependent—in the absence of V1—is more dependent upon the LGN than the pulvinar.
00:14:05 - But now, if we go back to this anatomy and the notion of hierarchy.
00:14:12 - And we take also into account that anatomically, thalamus and cortex are strongly
00:14:19 - and recurrently coupled. Yes.
00:14:21 - This might make the notion of a hierarchy also more complicated,
00:14:26 - because it's not just that thalamus is the driving cortex, cortex in the journeys.
00:14:31 - Absolutely. It's obvious. Absolutely, absolutely.
00:14:34 - But you see, when you look at these, there are massive, massive connections
00:14:40 - from the cortex to the thalamus.
00:14:43 - When you do that, then you have to ask the same questions you asked about arrival
00:14:50 - of signals in the visual area.
00:14:51 - Do all the inputs to the thalamus from the visual areas arrive at the same time?
00:14:57 - And probably not, because these different visual areas complete their perceptual
00:15:02 - tasks at different times.
00:15:04 - So you're right, and this pushes things further still, but it can still be accommodated
00:15:11 - within in the context of what I was saying.
00:15:12 - Okay. So now Murray Sherwood, for instance, in how he describes these cortical-thalamic interactions.
00:15:19 - He's also talking about a very specific bias in how the recurrence between cortex
00:15:25 - and thalamus is defined,
00:15:27 - where lower, what they would call lower cortical areas, would already have collaterals
00:15:33 - projecting into the thalamic nuclei that serve higher-level cortical areas.
00:15:37 - So that might imply that there's an anatomical preference hierarchy,
00:15:43 - if you want, in terms of how signals are propagated through that system.
00:15:47 - Would that still fit your picture or would that be more problematic?
00:15:50 - Well, let me say that I haven't actually really thought about that,
00:15:54 - so I think I'd better not speculate on that. That's good. Okay.
00:15:59 - So here we have an anatomical picture, but in some sense we're not considering
00:16:07 - other subcortical visual areas like the superior colliculus.
00:16:12 - Can you really be sure that the superior colliculus is not another hub in this
00:16:17 - kind an anatomical arrangement. No, it is a hub. It is a hub.
00:16:21 - I mean, every single visible area projects the superior colliculus.
00:16:25 - Now, what it does is not so clear.
00:16:28 - It's a bit... Part of the input to the pulvinar probably comes from the superior
00:16:34 - colliculus, but the projections from the cortex of the superior colliculus may
00:16:40 - be very important guiding eye movements.
00:16:42 - They work one way or another. But you see, there you raise a question which
00:16:48 - was raised this morning up to a point.
00:16:52 - Given that each visible area projects to the superior calculus and projects
00:16:59 - to the LGN and projects to other areas, there must be some selective basis on what's being relayed.
00:17:06 - So how does that work is anyone's guess, but it's a general problem of great
00:17:12 - interest for all cortical things.
00:17:14 - What is the selective process that dictates if indeed there is one?
00:17:19 - Because an alternative would be that an area sends out signals to all the areas
00:17:27 - with which it's connected, and it's up to the receiving areas to sort it out. That's an alternative.
00:17:32 - Both may be working, but it's a major problem.
00:17:38 - Anatomically, imagine you wouldn't know anything about the physiology of this
00:17:41 - system If you would just follow the wires, you would be hard-pressed,
00:17:45 - I think, to identify unambiguously a hierarchical relation.
00:17:50 - Because in some sense, all these structures communicate with each other one way or the other.
00:17:56 - Yes, indeed you're right. And the reason why they did identify a hierarchy,
00:18:03 - this is one thing which has remained from the 1876 discoveries of Salman Hentron.
00:18:08 - The reason why they did come up with a hierarchical doctrine is that the retina
00:18:16 - projected to LGN projects to V1, and they couldn't trace it beyond V1.
00:18:20 - And so they said that this is the hierarchy. And it was entirely out of the picture.
00:18:26 - However, let me just say that when I described that there were multiple projections
00:18:32 - from each point in V1 to visual association cortex.
00:18:36 - I think almost nobody read into it that there must be a function of specialization.
00:18:44 - It's only when I did the physiological experiment.
00:18:47 - But then people may not have thought about it very much.
00:18:50 - But in some sense, so your proposal now was to say, well.
00:18:56 - There are multiple, but with a finite set of path, hierarchically organized
00:19:02 - pathways that structure the visual brain.
00:19:05 - And that would, two of them run over LGM and one run over Povilar.
00:19:09 - Yes, that's your proposal.
00:19:11 - But if you just look at the anatomy as we now discuss it, couldn't you argue
00:19:15 - that from an anatomical perspective, it's actually a non-hierarchical system,
00:19:19 - but it's a physical substrate that could accommodate many possible functional hierarchies?
00:19:25 - That's exactly what I am arguing.
00:19:27 - I mean, it's hierarchical formally in the sense that it includes sequential stages.
00:19:35 - So for all three systems, you've got retina, LGN cortex, or retina-povnar cortex.
00:19:41 - So it's formally that way.
00:19:44 - But functionally, it is as you described it.
00:19:47 - That's what I'm saying. Okay, good. Then I got it.
00:19:52 - So dynamically, okay, we have this idea now.
00:19:55 - We have this rather omnipotent substrate that can, dependent on task,
00:20:01 - as also I call it, configure itself dynamically for certain hierarchical process simulations.
00:20:08 - This is also confirmed by the very specific latencies that you observe,
00:20:13 - as you already described.
00:20:15 - Yes, yes. Like color before motion. Yes, yes, yes.
00:20:18 - But now you can argue, well, some of these latencies might be imposed dynamically
00:20:24 - and others might be really fixed given your substrate.
00:20:27 - I mean, if you have to cross more synapses, it will slow the signal down more
00:20:30 - if you cross less synapses.
00:20:32 - So of these latencies that you look at, which of these are indicating really
00:20:40 - physical limitations of that system?
00:20:42 - And which of those do you believe are more dynamically configured dependable tasks?
00:20:48 - Well, I mean, you have to assume that the latency, the physiological latency now,
00:20:55 - that when an impulse activates an area sufficiently for it to be detected,
00:21:01 - then that it is somehow inducing an activity in that area which does something.
00:21:07 - Now, what it does is not clear, of course not.
00:21:10 - But that's very different, of course, from the perceptual latency,
00:21:13 - and you cannot predict the two. I mean, you can't pick one from the other.
00:21:21 - So you have to factor in another issue here, which is,
00:21:26 - what are the computational requirements within an area, or what are the procedures
00:21:31 - or algorithms or programs or concepts within the area, which it has to go through
00:21:36 - to generate its construct?
00:21:40 - I mean, for generating colors, the brain has got to compare the wavelength composition
00:21:46 - of light coming from many different areas.
00:21:49 - All right? To generate motion, you've got to look at the signals coming from
00:21:54 - two successive points in time.
00:21:59 - And so you've got a variety of different tasks which have different computational
00:22:03 - requirements, which also must dictate.
00:22:06 - Now, there is another factor which compensates up to a point, which is,
00:22:12 - so you talk about the number of cells interposed between the stimulus and the area in the cortex.
00:22:22 - We know that it's quite limited in the retina. You know exactly what they are.
00:22:28 - They must all go through the rods and cones, then the bipolars,
00:22:32 - and then the ganglion with the amacrins in between.
00:22:35 - And the same is true of the LGN. But then you've got another factor,
00:22:39 - which is the diameter of the fibers, the speed with which they deliver their signals.
00:22:43 - And in a way, I would have thought that the fact that the motion system has
00:22:53 - got large diameter fibers, which deliver signals rapidly,
00:22:56 - is possibly, I'm not speculating, is possibly a compensation for the fact that
00:23:01 - the working out of motion is slower than that of color.
00:23:05 - So you've got to factor in that physiology and anatomy as well.
00:23:10 - If you talk about a dynamically defined hierarchical relation,
00:23:16 - let's say from feet forward and top down, you would expect that this would modulate
00:23:22 - the physiological latencies in that system.
00:23:24 - If I expect the stimulus, you would expect that also the physiological processing
00:23:28 - is more efficient, more rapid.
00:23:32 - So how big do you expect that modulation to be in let's say your standard visual detection tasks.
00:23:39 - Well, speculatively, it's got to be inferior to 40 milliseconds.
00:23:47 - Because that's really, below 30 milliseconds, one is very hesitant to talk about
00:23:52 - these odd things, but above 40 milliseconds.
00:23:57 - Because beyond 150 milliseconds, you see everything in good registration. It's finished.
00:24:02 - You're now in the macro-perceptual world. It's that world between 0 and 150
00:24:06 - milliseconds seconds, whereas there is interesting action.
00:24:09 - And so I think it falls somewhere in that range. Okay.
00:24:14 - But now in terms of these hierarchical relations, in some sense, what we're.
00:24:21 - Tacitly including in this description is that, and this also goes back to Hubel
00:24:26 - and Wiesel, is that hierarchy also implies that we integrate towards the visual
00:24:33 - object by combining its components.
00:24:37 - As long as we go from the details to the gestalt, to the overall person.
00:24:43 - Do you believe that that still is a guiding principle? No.
00:24:46 - Okay. I would say that that is only half true and therefore not true.
00:24:54 - So the gestalt people said that a complex object is other than the sum of its parts.
00:25:02 - So, a line is considered to be a building block of forms.
00:25:09 - It is as if lines cannot have an independent existence of their own as forms.
00:25:15 - It's as if a line is always going to be used to get somewhere, and that's not the case.
00:25:20 - As the artists will tell you, many artists, from Barnett Newman,
00:25:25 - Olga Ratanova, Kazimir and so many others, used the line as a principal element
00:25:30 - in their paintings, and these stood in their own right as forms.
00:25:35 - Secondly, I think that it is the assumption that it's a building block system
00:25:41 - does not take account of the fact that there may be other—a building block system starting in V1,
00:25:49 - which is what the assumption mainly is—that there may be other inputs which
00:25:52 - do not go through the orientational system at all.
00:25:58 - That maybe a face is not built up from oriented lines, although oriented lines may contribute to it.
00:26:05 - And thirdly, I think that if you look at orientation selective cells,
00:26:10 - you find them in V1, you find them in V2, you find them in V3, you find them in V3a.
00:26:16 - And if you look at V3 and V2 and V3a, apart from change in receptive field between
00:26:21 - V2 and V3 and V3a, their properties are fairly similar.
00:26:26 - You might find differences, but they're fairly similar to at least casual observation.
00:26:31 - Now, is it conceivable that the brain just keeps on repeating this?
00:26:36 - Is it conceivable that the input from the LGN may not contribute to the properties
00:26:41 - of these orientation-collective cells?
00:26:43 - See, it's not a question that we are getting the wrong answers.
00:26:48 - It's a question that we're not taking account of other inputs which may modulate things.
00:26:54 - I mean, there must be a reason for having a big input from the LGN to these areas.
00:27:00 - And it is possible that they build up orientation selectivity. In fact, they do.
00:27:07 - Because Nikos Logosites and his colleagues in Germany showed that if you ablate
00:27:12 - V1 completely in the macaque monkey, you still get very good orientation selective cells in V2 and V3.
00:27:19 - Now, they are more sluggish in their response, but they are very respectable.
00:27:25 - So it's a question of then asking, well, what role do these inputs play either in building up,
00:27:34 - differences in the orientation profiles, or in building up different shapes completely.
00:27:40 - But then you described one experiment where you looked explicitly,
00:27:43 - where you used its primitive shapes to either build a house as a stimulus or a face. Yes, yes.
00:27:50 - Right? You then compared the connection between these two classes of stimulus. Yes, yes.
00:27:54 - And that showed that you get the input into V1,
00:28:01 - an area specialized for faces and houses, such as the fusiform face area and
00:28:05 - the hippocampal place area, the latencies are identical.
00:28:10 - And the deflection in terms of strength around 50 femto-Teslas is also identical.
00:28:17 - So now unless you posit the notion that these are supernumerary ineffectual
00:28:24 - inputs, you have got to take into account what they do.
00:28:27 - And there are interesting things. For example, you can get patients who are
00:28:32 - able to recognize line drawings,
00:28:38 - but cannot recognize the combination that these line drawings produce.
00:28:43 - By the same time, you get patients who can recognize the photograph of a building
00:28:49 - or something, but can't recognize the line drawing.
00:28:52 - So, to me, the question is wide open at the moment.
00:28:59 - But now, let's speculate a bit on that, right?
00:29:02 - Because what's interesting here is that in this experiment where we do house
00:29:07 - versus face detection, we actually do a tiny manipulation of the elements in
00:29:13 - this indroid that makes a stimulus.
00:29:15 - If you now say, okay, this is a fusiform face area, we do see a significant
00:29:21 - response in fMRI, right? This is in humans.
00:29:25 - How many transformations have taken place if the detection of house or face
00:29:30 - or that distinction would happen in that area?
00:29:32 - How many transformations, as you mentioned, have been taking place if you go
00:29:35 - from the retina to this specific area? Okay.
00:29:39 - The minimum number of transformations in the system that goes directly from
00:29:45 - the LGN to these areas must be the retina plus the LGN plus one synapse.
00:29:53 - The minimum, if you take it as being routed through V1, is of course a lot more,
00:29:59 - because you go to V1 and V2 and V3 and then to the fusiform.
00:30:04 - By the way, I don't think anybody has actually seen a direct input from V1 or
00:30:09 - V2 to the fusiform face area, but I'm not so sure.
00:30:13 - So you've got a different number of synapses.
00:30:18 - And the typical signal for seeing faces is a negativity at 170 milliseconds
00:30:26 - after stimulus presentation.
00:30:29 - But this does not mean to say that you ignore the stimulus that comes at 100,
00:30:35 - the deflection that comes at 30 to 40 milliseconds.
00:30:39 - I mean, let us suppose that there is a certain configuration which primes the
00:30:44 - fusiform face area, saying that this is a face, right?
00:30:48 - Without working out the details, well, that's a very significant contribution.
00:30:52 - What I'm objecting to is that I have not read a single paper,
00:30:55 - I don't think, not a single paper on face physiology which does not assume that
00:31:02 - it all starts with the orientation selective cells of V1.
00:31:05 - Now, there's even more simple than that.
00:31:10 - People have supposed that cells in V4, There are cells in V4 which care about curvature.
00:31:18 - They also care about color, and they are separate from cells which are uninterested in color.
00:31:23 - Now, nobody has shown physiologically how you transform orientation-selective
00:31:31 - cells into curvature-detecting cells.
00:31:33 - They have shown it computationally, which is a different matter.
00:31:37 - But you see, so they call V4 a curvature detector.
00:31:44 - Is this justified? I would wonder. I mean, the acceptance angles of orientation
00:31:50 - selective cells in V4, I've measured them, and others have also done,
00:31:53 - is much wider than the acceptance angles of orientation selective cells in V1.
00:31:59 - And therefore, you can see that they could probably respond better to curvatures.
00:32:06 - Ultimately, I mean, you have to, if you are going to say that,
00:32:10 - look, it all depends upon the orientation selective cells of V1,
00:32:13 - you must be able to demonstrate convincingly, physiologically and functionally.
00:32:18 - And that is missing. All the rest, it's all an assumption.
00:32:21 - Right. So would you in some sense say that the visual brain.
00:32:28 - It's highly tuned to first respond to the gestalt of the stimulus as opposed to its detail.
00:32:35 - I think with faces it is, yes.
00:32:37 - And also with facial expressions. I mean, if you consider a medulla to be part
00:32:42 - of the visible brain, which in a sense it is, I mean, it responds very rapidly to fear on a face.
00:32:50 - And by all accounts, before you get any responses from view one.
00:32:54 - So yes, I would say that that is the correct way probably of putting it to the
00:32:59 - gestalt, but the gestalt being understood as being other than the sum of the parts.
00:33:05 - Absolutely. Yes. But then the encoding of that is still a mystery.
00:33:09 - The encoding of that is a big, big mystery, and what the further input from
00:33:15 - V1, V2 plays in building up the final profile is also a mystery.
00:33:20 - And no one's saying they do not contribute. but they do, but how is not known. Right.
00:33:25 - Well, we think we have a solution to that. It's called the temporal population code.
00:33:31 - But I can describe it to you outside of this interview, but the basic idea is
00:33:35 - basically that if you look at volumes of cortical cells,
00:33:40 - they perform space-to-time transformations, like you drive the cells locally,
00:33:46 - but they're all laterally coupled. It's like throwing a stone.
00:33:50 - No, we'll create these waves rippling through the pond. If you just take the
00:33:54 - spatial average of those waves, you get a temporal trace.
00:33:56 - And we have shown in this temporal trace can give you high quality,
00:34:00 - high resolution detection of complex stimuli including phases. I see.
00:34:04 - Okay, we can talk about this in more detail later. This is done in computational
00:34:09 - media? Yes, in computational.
00:34:12 - We need to look for physiological validation. But there are some hints coming
00:34:16 - now from the optical image literature that gives us the kind of dynamic signatures
00:34:21 - in these cortical maps that is consistent with the full concept.
00:34:25 - So this idea of gestalt encoding, I think, is key. Nationally,
00:34:29 - I think there are some roots into that.
00:34:32 - But are we agreed that the Gestalt encoding is not synonymous with bringing
00:34:43 - various bits of stimulus together?
00:34:46 - We're agreed on that, okay. Absolutely. So we may have to jump out of standard
00:34:50 - sequential hierarchical thinking and go back to the perceptron in the… Yes, yes.
00:34:55 - Or the pandemonium model of self-reference, right? Yes.
00:34:59 - So, okay, so we have an idea now of physical hierarchy.
00:35:03 - We have a view on how this supports a plurality of functional hierarchies in
00:35:10 - which latencies of the signal transduction feedforward or popdown can be actively regulated.
00:35:18 - Indeed, the important consequence, as you already pointed out,
00:35:21 - is now we have an asynchronous system that has also a highly variable expression. expression, right?
00:35:28 - So is the asynchrony a feature or a bug?
00:35:33 - No, it's a feature. It's a fundamental feature.
00:35:36 - How does it help the processing? How does it help in, let's say,
00:35:40 - the detection of a face or the emotional expression of a face or linking a name to that face?
00:35:46 - Well, I mean, I'm not sure that asynchrony itself helps the detection of a face,
00:35:52 - But the asynchronous perception of faces and facial expressions and colors and
00:35:57 - motion has got an advantage to it.
00:36:03 - You see, what is the current theory of how the visual brain works?
00:36:11 - The visual brain used to be thought to be hierarchical, and then they're accepted.
00:36:16 - Grudgingly at first that it was parallel, and now I think everything is combined
00:36:21 - together and then you get a recognition.
00:36:24 - No allowance has been made for the fact that maybe you recognize individual
00:36:27 - attributes separately.
00:36:29 - So the systems do not, if they're operating asynchronously, they do not wait
00:36:35 - for each other to finish their task.
00:36:36 - And what are the advantages of that? There are probabilistic advantages.
00:36:39 - If you can identify an object, which let's just take three attributes,
00:36:44 - with form, color, and motion.
00:36:46 - If I put a gun to your head and say, identify this for me as quickly as you
00:36:51 - can, you are at a great advantage if you can identify it by using one of the
00:36:57 - three attributes alone without waiting for them to be combined.
00:37:00 - If I compare you to another person also with a gun to his head,
00:37:04 - but who has to combine all three to identify it, then he's going to be the loser.
00:37:10 - So it is, And I suspect that this is why evolution tolerated an asynchronous
00:37:18 - system in which one system of the brain does not wait for the other.
00:37:23 - However, in the end, it has to come together in direction, in recognizing the face.
00:37:28 - In the end, it all has to come together.
00:37:32 - But in the end, what are we talking about? We're talking about the difference
00:37:35 - between, as I say, a micro world and a macro world.
00:37:37 - We're talking in the sub-second level.
00:37:41 - All right so um it has
00:37:45 - to come together and this is one of the big mysteries of how
00:37:48 - i've compared it today to the
00:37:51 - difference between the world of quantum mechanics and gravitational physics
00:37:54 - these two are separate worlds how do you bring them together and i don't know
00:38:03 - the answer to it okay but then so the one that we have these as you call these
00:38:08 - micro perceptual domains or work,
00:38:10 - let's talk about micro-conscious domains, right?
00:38:15 - These will all have their intrinsic time constants, which might be modulated in some way.
00:38:20 - And then this leads to their asynchronous
00:38:22 - operation. How many of these micro-domains would you distinguish?
00:38:28 - I think if you were to press me, I would say that there's almost an infinite number.
00:38:34 - I mean, certainly ones for color, for motion, for depths, and for faces and
00:38:43 - facial expressions, a number of different things.
00:38:46 - I think that the, by the way, if you have two percepts which you perceive at different times.
00:38:58 - You then are quite safe in concluding that they are processed by different groups of cells.
00:39:06 - But the converse is not true. If you perceive two different attributes at the
00:39:10 - same time, you cannot say they are processed by the same cell,
00:39:13 - because they could be the same, but two groups finish their processing at a different time.
00:39:17 - So I don't know the answer, but the answer is it could be many.
00:39:21 - Infinite is perhaps pushing it, but it could be quite few. This has an implication, right?
00:39:25 - Because that means that this conditional segmentation of the visual brain in,
00:39:30 - let's say, orientation, shape, motion, color, disparity,
00:39:35 - might be a bit of an optimistic fragmentation in just a few core domains,
00:39:42 - while below that you might have many micro segmentations of a visual stimulus.
00:39:50 - Yes, yes, yes, you can have, yes. Yes, I mean, if you, so you want to,
00:39:57 - one of the functions of the brain is to gain knowledge about the world in order
00:40:00 - to take action. Knowledge comes first.
00:40:03 - You would grasp at any item that gives you information, so you could,
00:40:08 - indeed, exactly as you say, you could, below that level, have a segmentation.
00:40:14 - But a segmentation must have a functional rationale. or rationale and the functional
00:40:20 - rationale is the identification of something,
00:40:24 - Right. But now, would you also allow that a microdomain could combine,
00:40:30 - let's say, color and motion?
00:40:31 - Could that also be a microdomain, a microprocessor domain? No, that would go macro.
00:40:36 - Okay. That would be macro for me. So it was within one of these?
00:40:39 - Yes, yes, yes. All right.
00:40:42 - But now, would you… But by the way, I think that there is something which is
00:40:47 - worth saying here, which if I may just divert into art for a second.
00:40:51 - And I don't know the solution to it, but you see, if you look at a work of art,
00:40:57 - let us take a very complicated work of art.
00:41:00 - Let us take the music lesson by Vermeer, something which I want to go with the
00:41:04 - pearl earring. Everybody's familiar with that.
00:41:06 - Now, there are certain, what you might call segments or details in that.
00:41:12 - There's the earring, there's the mouth, there's the eyes. There are very expressive
00:41:16 - eyes, very expressive lips and so on and so forth.
00:41:18 - And then the earring and the forehead head and the way she looks.
00:41:21 - But then there's the entire picture.
00:41:23 - And the entire picture is again, in Gestalt's sense, the entire picture is other
00:41:28 - than the sum of the parts.
00:41:29 - And so that's what I'm trying to say.
00:41:33 - Somebody asked me the other day in London last week.
00:41:39 - He said, well, you know, I see no ambiguity in the music lesson.
00:41:45 - I've painted it and I've studied it very carefully. I said, well, are you an artist?
00:41:49 - He said, yes. And what have you studied? He studied the tablecloth, you see.
00:41:54 - He's forgotten about the painting, which is something else. So there it is in
00:41:59 - another example for an artistic world in which you've got segmentation and subsegmentation.
00:42:04 - But now, to question this issue of asynchrony.
00:42:10 - Which, of course, from a computational perspective, is massively challenging,
00:42:14 - because we're not used to think in terms of asynchronous systems.
00:42:17 - Yes. As you also mentioned.
00:42:18 - Yes. So computers are strongly synchronized, and they're clocked,
00:42:22 - and we tightly control these things.
00:42:24 - Yes, yes. Now, you could argue that in the brain, you can,
00:42:27 - we have some sort of a hybrid synchronous asynchronous system because we have
00:42:31 - a lot of oscillatory patterns that seem to regulate the overall fiber rate of
00:42:35 - neurons right typical example would be let's say this data gamma coding you
00:42:39 - might see where tata gives you like a slow,
00:42:41 - oscillatory response that supports some sort of selection that not everything
00:42:46 - responds all the time but only your subset of cells that have the strongest
00:42:50 - drive right so would would that satisfy
00:42:55 - also your requirements of how am I going to integrate over these asynchronous.
00:43:01 - Microproceptual... Yes.
00:43:02 - Now, that is the most obvious way that I see at the moment. And actually,
00:43:07 - I don't see an alternative.
00:43:08 - Look, the fact is the binding problem has been studied for 35 years,
00:43:12 - and nobody today, and please contradict me if I'm wrong, nobody today can tell us how binding occurs.
00:43:19 - We don't know. so I think one
00:43:22 - possibility is exactly as you put it that two so let's say the hippocampus and
00:43:27 - the seter rhythms or gamma rhythms acts as a coincidence detector saying two
00:43:31 - events occur at the same time and it's extremely interesting from this point
00:43:34 - of view to realize that visual signals can reach the hippocampus as quickly
00:43:38 - as they reach the visual cortex now I did not know that until quite recently,
00:43:42 - so let us suppose that the color and the direction of motion occur within the
00:43:49 - same theta cycle, then the brain might accept it as being highly probable that they are linked.
00:43:56 - So that's the sort of way I'm thinking about it, but I'm not sure I've solved
00:44:00 - it or I've demonstrated it. Of course not.
00:44:03 - So are you in that sense suggesting that being with hippocampus is the top-level
00:44:07 - processing structure in the visual brain?
00:44:10 - No, I wouldn't call it top-level processing structure, but a top-level structure
00:44:15 - which aids in processing and perception of things coming together.
00:44:19 - At least in terms of generating, let's say, a memory-dependent painting, in this case.
00:44:28 - Okay, so now we have a view on the visual brain, which in some sense is also
00:44:34 - a very challenging view.
00:44:36 - Because you have now questioned a lot of these things we thought were set in
00:44:40 - stone almost, right? Yes, yes.
00:44:42 - This is definitely that. It's not been easy for me either. Right, exactly.
00:44:48 - But you came to this via the study of color.
00:44:52 - Yes. And now color in itself is also actually way more confusing and challenging
00:44:58 - than you might naively think it is,
00:45:01 - because color is actually one of the first elements of perceptual processing
00:45:07 - that really tells you where he constructs the percept. It's not given.
00:45:12 - Is that also why you went for the study of color? Was that the main consideration?
00:45:16 - If you want to know the history of that, it's not an uninteresting history.
00:45:20 - I was completely dazzled by the work and the papers of Huber and Wiesel.
00:45:27 - And they were studying primary visual cortex, as were most people.
00:45:32 - And I liked the space to myself, so I thought I'd look at the visual association cortex.
00:45:38 - And I thought that I would end up doing physiology to prove them right in this
00:45:43 - endless hierarchical process.
00:45:45 - But everything I did showed that it was a parallel processing system that looked
00:45:48 - at different attributes.
00:45:50 - Now, I had no idea at all that I would find something in an area which is specialized
00:45:58 - for color. Indeed, this was heartily contested at the beginning.
00:46:01 - But I nevertheless used stimuli of color, of motion, and form as being the three
00:46:07 - sort of attributes I could think about, and which showed up the specialization for color.
00:46:14 - Now, as I say, it was disputed at the beginning, but it's now confirmed.
00:46:17 - Confirmed, but the color you see takes you into a totally different world.
00:46:22 - First of all, the color does not exist in the world outside.
00:46:29 - Light electromagnetic radiation has got no color. It's constructed by the brain.
00:46:34 - But much of the study of color and color psychophysics in particular was in
00:46:40 - fact based on the Newtonian system, that there's a relationship between between
00:46:44 - the wavelength and composition of the light, a direct relationship,
00:46:47 - and the color perceived.
00:46:49 - Edwin Land came to me and convinced me that this was not the case.
00:46:52 - And the whole system of obtaining information about the color system and the
00:47:00 - whole way of studying it that I used since then changed.
00:47:03 - It was no longer just reduction streams, small spots of light,
00:47:06 - but complex natural scenes. And...
00:47:13 - I mean, when I first described the color specialization at Oxford in 1972,
00:47:19 - David Hubel came up to me and said, you discover the philosopher's stone.
00:47:23 - And in a way, that is what opened up, not that comment, but the study of color
00:47:28 - opened up for me the rest of my career in terms of my interest in philosophy
00:47:35 - and art and things like that.
00:47:37 - Because philosophy is the world of knowledge. I mean, many philosophers have
00:47:42 - actually concentrated on color and of how you get information about the world in color.
00:47:48 - And, of course, Schopenhauer wrote a book about it, you know.
00:47:52 - And then you, it is not a big jump from that to the world of art thing.
00:47:57 - What kind of knowledge do you get from the world of art?
00:47:59 - So it was, it had, for me in my career, a significance beyond its demonstration
00:48:06 - as a specialized system.
00:48:08 - And from the point of view of physiology, I think it convinced me,
00:48:14 - and it's convinced some, but I don't think enough people yet,
00:48:17 - that the operations used by the brain to construct colors are vastly different
00:48:24 - from what you would predict from the retinal mechanism. Vastly different.
00:48:27 - That you've got huge surrounds, you've got to work out ratios,
00:48:30 - that working out ratios is an inherited concept, that there's no appeal against it.
00:48:34 - That cognitively, you see, I mean, if you go to Hyde Park in London at dawn
00:48:40 - or at dusk and look at the leaves, they look green.
00:48:44 - Although I know, because I've measured it, they reflect more red light.
00:48:48 - Now, this knowledge does not make me see the leaves as green.
00:48:53 - So it introduces a host of interesting issues and opens up a vast new world,
00:48:57 - which is of enormous interest.
00:48:59 - In your opinion, this problem of color perception is solved.
00:49:04 - Can you say, look, we can really explain how color perception and the invariance
00:49:10 - of color perception works?
00:49:11 - I think we can explain it perceptually, but I don't think we can explain it physiologically.
00:49:17 - What can we say about it physiologically? We can say that it must involve at
00:49:24 - least two receptors which have got different spectral sensitivities,
00:49:29 - It certainly involves the projection from the retina to the LGN to the primary
00:49:34 - visceral cortex to V2 to V4.
00:49:37 - That some operation takes place in V4, which compares the wavelength composition
00:49:42 - of light coming from one area and that coming from surrounding areas to build up ratios.
00:49:47 - That if you damage V4, you end up with a patient who's got cerebral achromatopsia,
00:49:54 - in other words, cannot see the world in colors.
00:49:56 - But some of these patients can actually discriminate between objects on the
00:50:02 - basis of wavelength reflected.
00:50:05 - Therefore, they get a completely wrong impression about the world.
00:50:08 - That is the full stop.
00:50:11 - How the brain implements that, how the different cells collaborate to take ratios,
00:50:18 - etc., is not at all clear.
00:50:20 - There's one other thing you can say about this kind of system is that hues,
00:50:24 - as opposed to colors, the shades of color are almost strictly a function of V4.
00:50:31 - But to do that, you require quite an elaborate system, which I don't think anyone
00:50:37 - is yet competent enough to do.
00:50:39 - You require to record from a multitude of cells simultaneously, single cells.
00:50:43 - And I don't think ABT is up to the task yet. But that area is not known.
00:50:47 - Okay. But do you think you can understand color perception reception.
00:50:53 - Decoupled from form. Yes. Okay. Yes.
00:50:58 - I can understand it formally in the sense that color requires a comparison.
00:51:07 - Color is actually much simpler than form. People think form is the simplest,
00:51:10 - but color is the simplest. In fact, people think the motion is the simplest,
00:51:13 - but color is the simplest.
00:51:14 - You have got four degrees of
00:51:16 - freedom, three wave bands, but you could have two, 2, and the luminosity.
00:51:23 - So what you do, you simply look at the wavelength composition of light coming
00:51:28 - from one surface, or that coming from surrounding surfaces, and you work out a ratio.
00:51:33 - That ratio never changes given a certain situation.
00:51:36 - In other words, if I'm looking at a given scene from a given spot in Hyde Park in London,
00:51:44 - and I'm looking at a given leaf, which is stationary,
00:51:48 - so it's pushing it a bit, you work out, your brain works out the amount of long,
00:51:55 - middle, and short wave light reflected from that green leaf in relation to the
00:52:00 - amount of long, middle, and short wave light reflected from the surround.
00:52:04 - And you can carry on looking at that at dawn and at dusk and at noon when the
00:52:09 - wavelength composition changes all the time, but that ratio will never change.
00:52:13 - So color is one of the prime examples of how the brain stabilizes the world
00:52:18 - to obtain information about it.
00:52:21 - Of course, the hue changes, the shade of color changes, but the color category does not change.
00:52:29 - So that, I think, is fairly well evident.
00:52:33 - So what does this mean? It means that the brain has got to compare,
00:52:36 - simultaneously Simultaneously in time, characteristics in terms of wavelength
00:52:41 - composition deflected from two surfaces. Memory changes.
00:52:45 - Form is slightly different. Form, it has got to work out the relationship of
00:52:51 - individual parts to one another,
00:52:53 - which and then has got to work out how, if you view it from different angles
00:53:00 - and different distances,
00:53:02 - that maintains its constancy, which is, in fact, also the question that the
00:53:07 - cubists, early Antical cubists, were asking.
00:53:10 - So that becomes a much, much more difficult system. Now people have shown, actually,
00:53:15 - that there are sometimes situations in which objects can be viewed from different
00:53:20 - angles and lead to activity in the same part of the brain.
00:53:26 - I think some people in America have done that. But the detailed mechanisms are still not clear.
00:53:31 - So, here we have it, right? We have a picture of the visual brain.
00:53:35 - It's more complex than initially thought.
00:53:37 - But now, with that picture in mind, you then turn it all into art.
00:53:41 - Yes. Why did you make that step?
00:53:45 - Well, I made that step partly because I was always interested in going to art
00:53:51 - museums and looking at things which raised questions in my mind,
00:53:54 - partly because I also thought to myself, look, I've been paid a lot of money in grants.
00:54:00 - And what can I say about what happens in our brains when we look at some of
00:54:07 - the most prized things in our culture, namely works of art, which all societies have produced?
00:54:13 - And then when I looked more into this question, I began to discover that these people are my friends.
00:54:20 - I mean, the artists, they have been pursuing the same questions as me.
00:54:24 - They've looked at Joseph Albers. He got it all wrong, but he asked questions
00:54:27 - about color. as is Plato.
00:54:30 - And the Cubists ask about form, the kinetic artists ask questions about motion,
00:54:36 - and they reach conclusions, which we reach many years after them.
00:54:40 - And the question of modulation of form by color, which Cézanne asked.
00:54:46 - But then there are other things. I mean, my view is, I know that there's a definitional problem,
00:54:56 - but my view is that all art is an abstraction, because what you do is,
00:54:59 - for example, you take a face and you abstract an expression which then applies to all faces.
00:55:05 - So the question is, how does an artist obtain knowledge and how does he impart it?
00:55:12 - And it's a tremendous, tremendous talent. And, you know, there's one painting,
00:55:19 - the One de Perea by Velazquez, when it was first exhibited in Rome in the 17th century.
00:55:26 - Some art critics said, I have seen many paintings in this exhibition, but this alone is the.
00:55:35 - So it spoke to him something about—it was abstract in that sense.
00:55:39 - So if you look at the process of abstraction, the process of maintaining consciences,
00:55:49 - these are physiological problems.
00:55:51 - The process of modulation, the process of reduction.
00:55:56 - When you want to represent pure movement,
00:55:59 - as they called it—I wouldn't call it that, but that's what they called it— you
00:56:03 - then what they did is they removed forms and they removed color and precisely
00:56:11 - this is precisely what happens in V5 cells,
00:56:13 - they respond to motion but are indifferent to form and to color so you know
00:56:18 - it's profitable to the physiologist to inquire into these the artist.
00:56:25 - Intuit if you want principles of perception what kind of principles that you
00:56:30 - think stand out here as really having been discovered by the artists and maybe
00:56:36 - later on being further interpreted by science?
00:56:39 - Well, I think that there are several. One of them is the question of form constancy.
00:56:46 - Now, the analytic cubists did not solve the problem, but nor have the physiologists,
00:56:53 - who have taken up this problem much later.
00:56:56 - I mean, I'm talking physiologists, not gestaltists.
00:56:59 - The question of the modulation of form by color never occurred to us until it
00:57:04 - was demonstrated that form and color are separately mapped in the brain.
00:57:08 - The question of, again, the characteristics of a kinetic system never occurred.
00:57:12 - But then there are other things. For example, it is well known,
00:57:17 - apparently, in the artistic world that to convey the,
00:57:21 - regardless on whose face it is, to convey a degree of haughtiness and snobbery
00:57:25 - and indifference in 16th century Venice.
00:57:31 - What you did was to have someone whose head is turned away, but he's looking
00:57:35 - at you with his eyes alone.
00:57:37 - You see, they captured this very, very well. This is a physiological fact. out.
00:57:44 - The fact that so many people agree that this is a sign of aloofness is quite interesting.
00:57:57 - If I may pursue this, there is another question that comes to this,
00:58:03 - and this has now changed my life quite significantly, and that is the relationship of art and beauty.
00:58:12 - We are often attacked because people say, well, who are you to address beauty?
00:58:23 - What is beauty? Well, the question is we don't address what is beauty.
00:58:28 - We address the question of what are the neural mechanisms that are engaged when
00:58:32 - you experience beauty, which is actually a legitimate and a simple scientific
00:58:36 - question is asking what are the neural mechanisms that are engaged when you
00:58:40 - perceive faces or colours.
00:58:42 - But the.
00:58:46 - The question of beauty, I mean, it's an interesting thing,
00:58:49 - but when you address it and you find that the experience of visual beauty and
00:58:56 - musical beauty and moral beauty and mathematical beauty above all correlate
00:59:00 - with activity in the same part of the brain,
00:59:03 - then you begin, you are shaken quite a lot.
00:59:07 - And then you put down mathematical beauty into, because mathematical beauty
00:59:12 - was considered by Plato to be the highest form of beauty.
00:59:16 - And he said so because he thought it gave you something about the structure
00:59:19 - of the universe. It gave you information about the structure of the universe
00:59:22 - because something makes sense.
00:59:24 - Now, I put mathematical beauty in the biological category.
00:59:29 - Now, why do I do that? Because mathematical beauty is, in a sense,
00:59:34 - the most extreme example of the experience of beauty derived from knowledge
00:59:37 - and learning. because only someone who is a proficient mathematician can appreciate
00:59:42 - the beauty of a mathematical formula.
00:59:45 - However, if you take an Indian or a Japanese or an English or a German or a
00:59:50 - Latin American mathematician and they know the language of mathematics,
00:59:53 - they can appreciate the beauty of a mathematical formula.
00:59:56 - So what does it consist of? It consists of the fact that it makes sense. Oh, that makes sense.
01:00:03 - How would it be different from the experience of beauty that a car mechanic
01:00:08 - might have anywhere in the world when he opens an engine.
01:00:12 - Allow me. It makes sense to the logical deductive system of the brain, all right?
01:00:19 - Logical deductive system of the brain, and that is the same in people of different culture.
01:00:26 - And hence it was Paul Dirac who said that when you want to judge the truthfulness
01:00:30 - of a mathematical formula,
01:00:32 - Don't go by its simplicity first, but go by its beauty.
01:00:36 - And he says, and many others have told me that, I'm not a mathematician or a
01:00:40 - physicist myself, that the theory of relativity was first accepted because of
01:00:43 - the beauty of the mathematical formulations.
01:00:45 - Now, you ask me how does this differ with...
01:00:49 - With China or in Japan or UK. Well,
01:00:53 - it differs in this sense in that the car mechanic probably has not worked out
01:01:02 - how you design a car. He may know how it works.
01:01:07 - But let us be clear that a car mechanic whom you confront with a problem,
01:01:12 - which he is mystified by, but then finally solves it and is excited by,
01:01:17 - I am sure that he also will get activation in the media over the front of the
01:01:21 - cortex. So why do I say that?
01:01:23 - Because what is the experience of beauty? Well, there are lots of things you
01:01:28 - can say about it, but it certainly involves reward.
01:01:32 - And I think the sudden illumination in looking at a car gasket also is a rewarding
01:01:43 - experience. So I shouldn't be at all surprised.
01:01:45 - And there come interesting questions of what is beauty?
01:01:50 - Now you see, biologically speaking, please, because the art historians and philosophers
01:01:57 - are terribly excited if You address the question of beauty.
01:02:01 - But you see, moral beauty,
01:02:04 - by which I mean that, for example, if you were to be asked, you're hungry and
01:02:10 - you're in a scanner, you're to be asked, well, I can give you a very nice succulent steak,
01:02:17 - but you can give it up to a hungry child. It's up to you.
01:02:22 - If you take it to yourself, you are satisfied.
01:02:28 - If you give it up, you are morally satisfied.
01:02:32 - The moral satisfaction seems to connect with activity in the medial frontal cortex.
01:02:42 - Now if you look at sorrowful beauty, which I've just done, which is by the way
01:02:47 - a category that's not often talked about, but much of the beauty that we experience is sorrowful.
01:02:54 - I mean, the Mass in D minor of Bach is sorrowful, the Requiem of Mozart is sorrowful,
01:03:00 - much of Wagner is sorrowful, and many paintings of Titian, the Taking of Christ
01:03:04 - of Caravaggio, these are all sorrowful things. You don't smile and laugh in front of them.
01:03:08 - And that also correlates with activity in the medial orbital frontal cortex. So that, I mean, that.
01:03:14 - Brings you back to the question raised by Plato in Timaeus.
01:03:21 - What is beauty of the subject, of the object, length of the object,
01:03:27 - or is it none of these, but something detached from all of them?
01:03:31 - There's a question in philosophies of aesthetics. It's also a question for neurobiology,
01:03:36 - but in a different way, because we want to study it neurobiologically.
01:03:38 - They want to study it more philosophically. The other thing I want to add to
01:03:42 - you with the farm mechanic is that, like in the domain of musical aesthetics,
01:03:47 - first we talked about the epistemic emotion, right? It's an emotional state.
01:03:51 - It's a feeling. Absolutely. It relates to our knowledge structure.
01:03:54 - Yes. Yes, yes, yes. That's what we're talking about.
01:03:57 - Now, here on the domain of music, we'd say, well, aesthetic experience in music
01:04:02 - has everything to do with anticipation, right?
01:04:05 - So it is, to what extent does the music I'm perceiving match or mismatch with my anticipation?
01:04:14 - And then there you want to find some sort of balance between confirmation and surprise.
01:04:19 - So in some sense, you could argue then that independent of the domain,
01:04:24 - whether it's mathematics or cars, this is the commonality. The expectation.
01:04:29 - Balancing of confirmation and surprise.
01:04:32 - Would you go along with that? They want to define, let's say,
01:04:35 - a static experience as an epistemic emotion that actually reflects that specific
01:04:39 - balance between the two issues. Yes.
01:04:43 - Confirmation, but confirmation of what? Of your prediction, of expectations.
01:04:47 - Well, I'd like to go beyond that. I'd say that when I undertake a mathematical equation,
01:04:54 - let me assure you I do not, but when mathematicians do, and they hit a solution
01:04:58 - which satisfies them, they say, that's it, I've got the right solution.
01:05:04 - So what is that? It is an expectation which is satisfied. It satisfies the brain's
01:05:09 - logical deductive system.
01:05:12 - Does the brain have a logical deductive system? Absolutely it does.
01:05:16 - I mean, there's no logic in the world outside.
01:05:21 - The whole idea about the Godel's, you see people talk about Godel's incompleteness
01:05:25 - theorem, which is a study in mathematics.
01:05:28 - It's nothing of the sort. It's a study of the brain's logical system and the limits.
01:05:33 - Now, with phrases, if you, here in Barcelona, we love football,
01:05:36 - we love ideas like Messi, who do real-time problem-solving of the highest complexity and artfulness.
01:05:45 - And in some sense, you could also argue, well, he has to solve dynamical problems as well.
01:05:51 - And they have their intrinsic beauty the same way as the mathematician that solves his equation.
01:05:57 - Yes, yes, yes, yes, yes. So that means that that experience is not necessarily
01:06:01 - a specialized logically deductive system, but a more generic problem-solving
01:06:06 - system that defeats also action systems or perceptual systems.
01:06:10 - Yes, but I mean, I perhaps mis-explained myself.
01:06:16 - I'm not saying that the beauty is… we were talking about expectation.
01:06:21 - Now, just giving you a mathematical system, it is satisfying the expectations
01:06:27 - of a logical deductive system that will only be satisfied with this answer answer, because that is true.
01:06:32 - But there is also, you're quite right, if you want to call it logical system,
01:06:38 - that's fine, but the progression of action in motor activity,
01:06:43 - which can be extremely beautiful.
01:06:45 - I was watching with amazement the other day a replay of the goal that Pele achieved
01:06:52 - in 1905. What a remarkable thing.
01:06:55 - And of course, it was absolutely right in terms of logic of action.
01:07:01 - In terms of logic of time, in terms of logic of distance, where he positions
01:07:06 - himself, and it satisfies the viewer.
01:07:12 - You say, my God, he's got absolutely right, and it is beautiful.
01:07:15 - So I do not mean to say that, I mean, I think that the logical deductive system of the brain.
01:07:21 - Is a biological system, which I think mathematicians have not understood.
01:07:27 - It is a biological system, and there are limits to it, and Gödel demonstrated that.
01:07:34 - But it's not the only system. Now, let me give you another example of expectation.
01:07:39 - Expectation, I mean, when I look at a beautiful face, that also satisfies certain expectations.
01:07:46 - And what are the expectations that I can talk about? I can say that it satisfies
01:07:50 - the fact that the eyes and the nose and the mouth are in the correct disposition
01:07:56 - with respect to each other,
01:07:57 - that they are the correct proportions, that there is nothing violently against my expectation.
01:08:06 - And then I get a man like Francis Bacon, who says, I want to give people a visible
01:08:10 - shock. That's what he said.
01:08:12 - My aim is to give a visible shock. What did he do? he subverted the brain's
01:08:17 - representation of the brain and therefore the expectation.
01:08:20 - So when you look at a Francis Bacon, you say, my God, this may have all sorts
01:08:24 - of pain to be quoted, but that's not what the face looked like,
01:08:27 - not mutilated like that.
01:08:29 - So there are all these different expectations. In some of this,
01:08:33 - this is what I was challenging you on, that I think that in the domain of aesthetics,
01:08:37 - Aesthetics, there's always this risk to sort of disconnect it from the biology,
01:08:42 - from real-world action.
01:08:45 - Absolutely. In everyday life. So I was just trying to see whether you subscribe
01:08:50 - to that or whether you see also that aesthetics as an everyday common phenomenon.
01:08:55 - I see it as an everyday common brain phenomenon, in my view, if it is.
01:09:01 - But don't tell that to the philosophers of aesthetics. They'll get very angry.
01:09:05 - We will not distribute this podcast.
01:09:09 - But then the other thing is, so if you look at art and the progression of art
01:09:14 - and their discovery of, let's say, principles of perception and principles of experience,
01:09:18 - if you want, way beyond where we are with our science, in which period in art
01:09:25 - history do you think that art history has changed?
01:09:26 - Do you think most of these discoveries were made?
01:09:31 - Well, I think they were made at various periods. But, I mean,
01:09:34 - let me give you one example which I'm especially interested in.
01:09:41 - And that is the period of Michelangelo.
01:09:46 - Now, you might say that Michelangelo made no discoveries at all.
01:09:49 - Michelangelo did make a huge discovery, which was to represent the human body.
01:09:56 - All right, as it should be. If you look at the drawings and paintings before
01:10:02 - him, they don't have this power, they don't have the sensuousness,
01:10:05 - and he did that, and he did that, by the way.
01:10:08 - I must say this because there was an article in London two days ago saying that
01:10:13 - people thought that Michelangelo used the golden ratio. Michelangelo never did anything of the kind.
01:10:18 - Michelangelo said, I don't need measuring instruments because all my measuring
01:10:22 - instruments are in my brain.
01:10:23 - The fact is that when you come to do a great representation of the human face
01:10:29 - or human body, the golden ratio is implicit in that.
01:10:33 - So that is one of the great new stages.
01:10:40 - I would say that the Cubism—well, before that, Cézanne, and now Cézanne and
01:10:48 - the Cubists who were inspired by Suzanne, were two of the great stages.
01:10:55 - There may be many, many others.
01:10:59 - I think I myself, there's one of small few periods,
01:11:07 - what he called my mature poesie, Titian, when he started drawing with his fingers,
01:11:15 - got rid of the brush and was trying to represent motion.
01:11:19 - It was very successful and very, very good.
01:11:21 - But there must be many others. But now, do you feel that contemporary art,
01:11:27 - in that sense, is more deconstructing these principles than necessarily discovering them?
01:11:34 - I have got a very unhealthy relationship with contemporary art because,
01:11:38 - you know, they tell me… So, I go to the Ludwig Museum in Cologne,
01:11:45 - and I see a filing cabinet in front of me.
01:11:49 - Now, this filing cabinet is not the filing cabinet of Bismarck.
01:11:53 - It's not the filing cabinet of Angela Merkel.
01:11:57 - It's a filing cabinet which could have been purchased possibly from IKEA.
01:12:02 - And I'm supposed to be sitting there to contemplate myself in relationship to
01:12:07 - this filing cabinet. This is not of great interest.
01:12:10 - Whatever knowledge I may get out of it, it's not of great interest because there
01:12:13 - are so many other things that I can do.
01:12:14 - So I go to a room in the same museum and I see an empty white room.
01:12:19 - So I ask the attendant, what's going on here? They don't know this is the exhibit.
01:12:24 - So I'm supposed to be contemplating that white room.
01:12:27 - It's not of great interest. And I really think that we should tell museum curators
01:12:32 - that the time has come to stop.
01:12:35 - But there are other things which I think I'm very interested in.
01:12:38 - For example, a famous installation art, contemporary art, Tracy Emin's The Bed.
01:12:47 - It is a depiction of a bed set.
01:12:52 - Unmade bed, cigarettes on the floor, a bottle of gin somewhere, whatnot.
01:12:57 - Now, I don't say this is beautiful, but it is representative of thousands of
01:13:02 - bedsits in London and elsewhere. So, in a sense, that gives you knowledge.
01:13:08 - And that's why I think that that is not, for me, in the same category as lots
01:13:13 - of things which I don't admire so much.
01:13:16 - I'll tell you an interesting story. At the Tate Gallery in London,
01:13:18 - some German artist had an installation. And,
01:13:23 - Part of this installation was a waste paper basket with lots of rubbish in it.
01:13:29 - Well, the day after the thing was installed, the cleaning woman next morning
01:13:33 - came to clean, so she emptied the waste paper basket.
01:13:36 - She had to be told never to touch it again because of this part.
01:13:39 - But in a sense, her action was logical.
01:13:42 - But you are using two definitions of the impact of art.
01:13:47 - One is an epistemic emotion or an emotional state. Another is to acquire knowledge.
01:13:53 - But to acquire knowledge seems to be a rather weak definition,
01:13:56 - right? Because reading a book or going to, let's say, read the manual of how
01:14:01 - to use my telephone is also a way
01:14:03 - to acquire knowledge, but it might not necessarily qualify as an artistic,
01:14:07 - form of doing that. No, no, no, no.
01:14:10 - Well, let me be more specific.
01:14:14 - I think the function of the brain is to acquire knowledge, and art is one means,
01:14:19 - but it's not the only means.
01:14:20 - Let me say it's one means of acquiring knowledge. If you speak to artists,
01:14:23 - they would say to you, yes, I acquire a great deal of knowledge about tables,
01:14:27 - about chairs, whatever I'm doing.
01:14:28 - And we also acquire a great deal of knowledge.
01:14:31 - I mean, one of the, for example, the Taking of Christ by Caravaggio,
01:14:36 - which is the National Gallery in Dublin.
01:14:39 - It gives you a great deal of knowledge about the state of a man who knows he's
01:14:45 - being betrayed, who accepts his betrayal, and who is in agony.
01:14:48 - You know, it's a remarkable piece of work.
01:14:52 - But what I was really trying, or maybe I did not say it, I don't think that
01:14:58 - suddenly during our evolution a part of the brain developed in some people to do art.
01:15:04 - I think art is a byproduct of the brain's knowledge-acquiring system.
01:15:10 - You have emphasized this now several times throughout the interview, this notion of.
01:15:17 - The acquisition of knowledge as being the key function of the brain.
01:15:20 - And in some sense, this is a very platonic notion that was also criticized by
01:15:25 - Dewey, for instance, who was saying, well, why for the Greek philosophers,
01:15:31 - knowledge was actually the core objective of their philosophy,
01:15:36 - it didn't talk about the brain necessarily, is that labor was so far removed
01:15:40 - from their everyday existence because labor was left to the slaves.
01:15:45 - Labor, physical activity in the work was something that was unfamiliar to them.
01:15:49 - So therefore, for them, the highest value in life could just be to contemplate and learn.
01:15:56 - While, and of course, Dewey was also a pragmatist, right? Well,
01:15:59 - actually, knowledge is anchored in action.
01:16:01 - So from that perspective, you could argue, well, isn't it fair to say that the
01:16:06 - main purpose and function of the brain is to generate action,
01:16:09 - but in order to do that, it needs knowledge?
01:16:11 - Yes, I think I would go along with that. Absolutely, yes. I don't think that
01:16:14 - knowledge is an end point in itself. I think you obtain knowledge to undertake action.
01:16:20 - But then sometimes you cannot undertake action. But you see,
01:16:23 - the important thing about obtaining knowledge, really, is that to obtain knowledge,
01:16:28 - you have to stabilize the world. You cannot do it without that.
01:16:32 - And to stabilize the world is a big, big problem. I mean, in color vision,
01:16:36 - you can see it's a major issue. you.
01:16:39 - But also, in a way, in these articles or work on black holes and dark matter
01:16:48 - and dark energy and quantum gravitation,
01:16:50 - these are all attempts to stabilize the world in order to be able to obtain knowledge about it.
01:16:57 - Because otherwise, there are
01:16:58 - too many signals reaching us, which I don't know what sense to make of it.
01:17:02 - Now, I'm a platonicist or a platonic in my approach because,
01:17:10 - in a sense, I think that Plato was right in saying that you can only obtain
01:17:20 - knowledge about things through a thought process.
01:17:23 - You cannot obtain this knowledge by simply looking at something.
01:17:26 - There you obtain an opinion.
01:17:28 - Or manipulating or experimenting with things physically. Yes,
01:17:32 - but if you're experimenting with it, you're employing a thought process.
01:17:37 - I don't think he thought… In fact, one of the weaknesses of Plato,
01:17:42 - I think, is that when he talked about forms, his theory of forms,
01:17:46 - was things like love and beauty and justice,
01:17:48 - and he only vaguely came to the idea that a house may constitute a form.
01:17:52 - But he did in the Republic say that if you want to obtain noise about a couch,
01:17:58 - you cannot obtain it from a single couch. You've got to think about it.
01:18:03 - And in a way, I think this is true. So you build up a concept unconsciously.
01:18:08 - So I think people have dismissed Plato perhaps unnecessarily for saying that
01:18:14 - you cannot obtain knowledge by just looking at something.
01:18:17 - So what do you see today as the main achievements of this field of neuroaesthetics?
01:18:24 - The field of neuroaesthetics has done quite a few things. It's only 15 years old.
01:18:29 - So let me summarize Fourier's achievements. First of all, it has shown that
01:18:34 - there are subjective mental states which you can study scientifically in the
01:18:40 - sense that you can localize the activity that relate to these.
01:18:44 - And secondly, and most importantly, you can quantify that activity and that
01:18:49 - activity is parametrically related to the intensity of the declared experience.
01:18:54 - But that in itself is generic. Eric, that's not specific to neuroaesthetics.
01:18:58 - This might be also, in general, it's a perceptual task.
01:19:02 - Well, yes, but I mean, just to have a neuroaesthetics attack these problems
01:19:06 - first, attack the question of beauty first.
01:19:11 - Secondly, neuroaesthetics has shown that in terms of not only of beauty,
01:19:14 - but allied experiences, such as those of desire and love,
01:19:20 - have the identical systems of localizable, possible, studyable, quantifiable things.
01:19:29 - Thirdly, it has answered the question which has eluded philosophers of aesthetics
01:19:36 - for centuries and the question was actually very well framed by Clive Bell, who was an art critic.
01:19:44 - He said, what do all things which we experience as beautiful have in common?
01:19:49 - Because unless they have something in common, we are gibbering.
01:19:52 - They have never been able to ask this question, but we can ask this question,
01:19:56 - which is that all things which we experience as beautiful have one thing in
01:20:02 - common, though only in the neurobiological world, we cannot speak about the world outside,
01:20:06 - which is that they correlate with activity in the same parts of the brain,
01:20:09 - and they correlate with activity there parametrically.
01:20:13 - Fourthly, or fifthly, it has attacked.
01:20:18 - One of the most extraordinary problems
01:20:21 - in philosophy and in knowledge which is the experience of mathematical beauty
01:20:29 - and opened up a whole Pandora's box about what the experience of mathematical
01:20:34 - beauty is and I think this is something which is going to develop more and more.
01:20:39 - Now there are a lot of these I'm giving you the main achievement there are lots
01:20:43 - of other things I mean it is inquiring into the role of experience in the generation of of beauty,
01:20:48 - which is a topic that interests me less personally, because I'm interested in
01:20:52 - what is the skeleton of the brain that is able to experience beauty, regardless of source.
01:20:58 - It is beginning to address questions about literary beauty and beauty in dance and movement.
01:21:03 - So they're doing quite a lot of things. But these seem to me to be the important issues.
01:21:08 - Can you couple that from questions around consciousness? Because beauty as such must be experienced.
01:21:16 - Absolutely. So how do you see that leak then between these epistemic static
01:21:22 - emotions and conscious experience?
01:21:24 - Well, I don't think you can uncouple it. I think you must address the question of consciousness.
01:21:31 - But you see, here you go again to the sort of….
01:21:38 - A dichotomy between quantum mechanics and gravitational physics.
01:21:43 - The knowledge that the two are contradictory does not stop you from pursuing
01:21:47 - good experiments in quantum mechanics, making huge advances in it,
01:21:51 - or in gravitational physics.
01:21:53 - Now, the knowledge that we do not have an answer to the problem of consciousness
01:21:58 - will not inhibit us from studying the brain's esthetic system.
01:22:05 - We just assume, we make the assumption, which is a fair assumption,
01:22:09 - and in fact you can't proceed without making that assumption,
01:22:12 - but you don't factor it into your experiment because it is there.
01:22:16 - You just assume that you are experiencing something because you're conscious.
01:22:23 - Now look at the opposite picture.
01:22:25 - Supposing we said, oh, I cannot study esthetics, I can't study the brain system
01:22:34 - for experiencing beauty unless I have a system of consciousness,
01:22:39 - then you'll probably end up not solving the problem for years.
01:22:41 - After all, what have the people who are studying consciousness,
01:22:43 - what have they really told us about consciousness?
01:22:45 - I think I perhaps go, I think that the important thing about consciousness is
01:22:50 - the studies which I sort of adhere to are the ones which have shown us the minimal
01:22:55 - conditions required for consciousness.
01:22:57 - But I also adhere to what Stuart Sutherland once said that not a single sentence
01:23:03 - written about consciousness is worth reading because we don't know really.
01:23:11 - It's fashionable I know but we don't know even at what level to address it we
01:23:16 - don't know whether it's localizable nothing I just wrote many sentences on it
01:23:21 - actually so maybe I shouldn't have done that,
01:23:25 - as long as you give credibility to what I've said exactly so,
01:23:35 - How many years before you think we will have a full-fledged neurobiological
01:23:39 - understanding of beauty?
01:23:43 - I think I'm not really able to tell.
01:23:49 - A full-fledged biological understanding of beauty requires, above all,
01:23:55 - to understand something extremely, extremely difficult,
01:23:58 - which is, is beauty a quality that's slapped onto situations,
01:24:03 - slapped onto objects, or is it a part of these situations, intrinsically part of them?
01:24:08 - Just as you say, is consciousness something which is slapped on the experience
01:24:15 - of beauty, or is it part and parcel of the same thing?
01:24:17 - So I'd be very reluctant to tell you how long it would take.
01:24:21 - That's a question that has been with us for 2,500 years.
01:24:25 - And probably more. And probably more. And probably more.
01:24:29 - I documented 2,500 years ago. So take the cave paintings, right? Absolutely.
01:24:34 - These are definitely experiments in a static experience, right? Without question.
01:24:38 - 10,000 years old. Yes, without question. So I'd be very reluctant to decipher that.
01:24:44 - So we made quite a grand tour here. Yes. It's absolutely fantastic.
01:24:50 - So you also have, let's say,
01:24:54 - targeted visit touched on many issues using many different methodologies,
01:24:59 - many different preparations to understand the brain from the sort of multi-scale perspective,
01:25:06 - linking the quantum and the gravitational effect, if you want.
01:25:10 - So if we would follow in an approach that you have developed,
01:25:14 - the lines that you have set out for yourself, and now make progress on neuroaesthetics,
01:25:19 - what would be the law, Semyon's law, that we have to adhere to?
01:25:23 - The law? Yeah.
01:25:29 - Well, I mean...
01:25:32 - Such as the law of functional specialization, transported to… Would you just
01:25:38 - get a handle on how beauty is processed by the brain, for instance?
01:25:43 - I would say the law that I would like to be associated with me,
01:25:49 - but actually it's associated with Edmund Burke… I derive it from… The Zeki's Law is…,
01:26:00 - Okay, I'll tell you, Ezequiel's law is, and I'll tell you something which is
01:26:04 - generally original to Ezequiel,
01:26:06 - it's not found in Immanuel Kant either, that beauty can be firmly divided into
01:26:12 - two parts, biological beauty and artifactual beauty.
01:26:17 - That biological beauty is dependent upon inherited brain concepts,
01:26:20 - and artifactual beauty is dependent upon acquired brain concepts.
01:26:25 - That biological beauty being dependent upon inherited brain concepts is not easily modifiable.
01:26:32 - In other words, you can't have somebody with one eye here and one eye here being beautiful.
01:26:37 - Whereas, artifactual beauty is synthetic changes with time and with experience.
01:26:43 - These are the prerequisites for studying beauty.
01:26:49 - I think that all beauty, this is different from what Kant is saying,
01:26:57 - all beauty must be interfaced through a brain concept,
01:27:01 - either inherited brain concept or acquired brain concept.
01:27:05 - The one thing which I am not really… And finally,
01:27:09 - I can say that all experience of everything beautiful comes with activity in
01:27:14 - one same part of the brain,
01:27:15 - in addition to other parts but they differ between but the one big question
01:27:21 - which I would be prepared to spend a lot of time is to address the question
01:27:25 - of whether beauty is a separate,
01:27:28 - faculty and entity which is slapped onto things or not,
01:27:33 - So I've given you five laws now. Now, wait. If I want to print Zeki's law on
01:27:37 - a T-shirt, I'm in trouble.
01:27:39 - I need to see a big T-shirt.
01:27:41 - So how do we compress that down into a law? Because a law has to be normative, right?
01:27:46 - This is important now. It's a normative statement.
01:27:50 - Something that others will have to do or will have to follow in order to make progress. is.
01:27:56 - Beauty is a brain-generated concept which depends either on inherited or acquired concepts.
01:28:04 - Okay, there you go. That fits on a t-shirt. That fits on a t-shirt.
01:28:08 - The other thing is, despite Brexit, I think we will still visit this sort of
01:28:16 - deteriorating fire across the channel. It might get better.
01:28:21 - You never know. So three years from now, I'm going to visit your site,
01:28:27 - step into the lab and say, okay, Samir, three years ago you gave me a prediction
01:28:31 - and now I want to see whether you confirm it or not.
01:28:33 - So what's the main prediction you would like to share with me today that you
01:28:38 - will see confirmed and manifested three years from now?
01:28:45 - You are making it very difficult. I would say that the main prediction I would
01:28:49 - like to confirm in three years'
01:28:55 - time is that the system of physical and mathematical beauty is entirely biological
01:29:06 - and entirely dependent upon the brain's logical system. That's what I'd like to prove.
01:29:12 - Okay, good. I actually would retire if I did that.
01:29:15 - Common check. So, Samir Zeki, thank you very much for this conversation.
01:29:19 - Thank you. Thank you very much. The CSN Podcast was produced by the Convergent
01:29:29 - Science Network of Biometrics and Biohybrid Systems,
01:29:33 - a project funded by the European 7th Research Framework Program.
01:29:39 - For more interviews, recorded lectures, or upcoming conferences in the field
01:29:45 - of biometrics and biohybrid systems, go to csnnetwork.com.
01:29:52 - Music.

CSN Podcasts

Semir Zeki on visual brain and parallel processing

Season 2018

Description

CSN Podcasts

Episodes

Ton Coolen on immune networks and neural networks

Paul Verschure & Tony Prescott on synthetic psychology and robot models

Neil Burgess on boundary vector cells and place cells

Giacomo Rizzolatti on mirror neurons and action understanding

Francesca Cacucci on hippocampus development and grid cells

Timestamp

Be the first to leave a comment

Leave a commentCancel

Legal

Follow us on

Semir Zeki on visual brain and parallel processing

Description

Episodes

Timestamp

Be the first to leave a comment

Leave a commentCancel

Tags

Legal

Follow us on

Login to enjoy full advantages

Please login or subscribe to continue.

Go Premium!

Enjoy the full advantage of the premium access.

Stop following

Cancel subscription