cover hillel chiel

Hillel Chiel on biomechanics and neural control

  • cover play_arrow

    PLAY EPISODE


cover hillel chiel
Season 2012
Season 2012
Description arrow_drop_down

Description

Why does understanding the body matter as much as understanding the brain , and how do soft, squishy biomechanics simplify the control problems that nervous systems must solve? Hillel Chiel extracts general principles from tongues, worms, and sea slugs. Subscribe for more from the Convergent Science Network podcast series. Hillel Chiel’s research program rests on a foundational claim: evolution selects not for brains or bodies in isolation, but for the coupled dynamical system of brain, body, and environment. This means that understanding neural control without understanding biomechanics is like studying software without knowing the hardware it runs on. His work systematically demonstrates how mechanical properties of soft tissues constrain and simplify the control problems that nervous systems face , often dramatically. The tongue provides a vivid entry point. Modeled as a muscular hydrostat (a “hot dog in a bun” of longitudinal and circumferential muscles), the tongue’s geometry creates a massive mechanical advantage for the longitudinal muscle when the tongue is extended. A simple pulse of neural activation produces rapid shortening that the circumferential muscle cannot resist until the tongue is already retracted. The control implication is striking: for a single lapping motion, the nervous system can effectively ignore one of the two muscle groups. This simplification is invisible without biomechanical analysis and would never be predicted from neural recordings alone. Chiel then scales up to peristaltic locomotion, challenging the standard view that it is slow and energetically wasteful. His mathematical analysis of continuous (rather than segmental) peristaltic waves shows that, properly configured, the center of mass can maintain constant velocity without depending on external friction , meaning the energy costs come from internal tissue properties rather than ground contact losses. A one-meter robot built on this principle moves fast enough that you have to walk briskly to keep up. The Aplysia feeding system illustrates the principle that what a muscle does depends on its mechanical context. As the geometry of the feeding apparatus changes during a bite, swallow, or rejection, the same muscle can switch from protraction to retraction. This means that multifunctional behavior arises not from dedicated muscles for each action but from changing coalitions of muscles recruited according to the current biomechanical state. Chiel frames this as a general principle: the nervous system exploits context-dependent mechanics to achieve behavioral flexibility with minimal rewiring, ganging degrees of freedom together for simple movements and fractionating them when precision is needed.

Tagged as:

About the author call_made

CSN Podcasts

Both the triumphs of humanity and its most evil deeds have resulted from collaboration. In a time where humanity is required to aspire to the former and minimize the latter, the question arises of how collaboration arises and why it fails. Surprisingly, this phenomenon, so central to who we are, is not well understood. Hence, a collaborative effort is required to understand collaboration in its full biological, psychological, sociological, cultural, and economic complexity and to translate this understanding into operational impact. This series of podcasts is one step toward achieving these complementary goals. The Collaboration Podcast presents interviews with people who are central orchestrators of collaboration in various domains including business, government, science, art, health, sustainability, and the military. The discussions were conducted by Prof. Dr. Paul F.M.J. Verschure and members of the Program Advisory Committee of the Ernst Strungmann Forum on Collaboration (https://www.esforum.de/forums/ESF32_Collaboration.html) during 2021 and had the goal to sketch a map of opportunities, challenges, and obstacles in human collaboration. The forum took place in May 2022, and now we would like to share this series of interviews with a broader audience. The full report of the Forum will be published in 2023 by MIT Press. The podcast was produced by the Convergent Science Network (https://www.convergentsciencenetwork.org/). Context: The stability of social systems depends critically on realizing sustainable methods of “collaboration,” yet how and by which means collaboration is achieved is not clearly understood; neither are the conditions or processes that lead to its breakdown or failure. Collaboration can be understood as cooperation between agents toward mutually constructed goals. Part of the reason for our lack of understanding is that the phenomenon of collaboration is, by nature, a highly multidisciplinary problem, and effective research into its complexities has been difficult to achieve across the broad range of scientific and technical disciplines involved. The need for a fundamental understanding of collaboration, however, has become increasingly important. Not only does humankind demand answers as it attempts to address critical challenges at multiple scales (e.g., climate change, migration, enhanced automation, social and economic inequality), but ever-increasing technological and economic means of interconnecting people and societies are disrupting long-established, familiar patterns of how we interact. Radical technological changes that are ongoing have the potential to reshape collaboration in ways that are currently hard to predict or influence (e.g., by altering configurations in interaction, information creation, and modes of communication). On one hand, such changes could disrupt hitherto stable forms of collaboration by affecting critical communication channels and traditional roles, as can be observed in the rapidly changing patterns in governance, commerce, and social interaction. Conversely, technology could lead to the emergence of novel, successful forms of collaboration that deviate from traditional “hierarchical” architectures. Evidence of this can be seen in areas as diverse as highly automated manufacturing plants, the open science movement, collaborative software repositories, user-centered services, and the sharing of economy-based modes of organization. Without a fundamental understanding of the mechanisms, processes, and boundary conditions of collaboration, it is not possible to evaluate or predict which of these possible scenarios are sustainable or even plausible. The Forum “How Collaboration Arises and Why it Fails” (May 8–13, 2022, Location: Frankfurt am Main, Germany) Chairs: Andreas Roepstorff and Paul Verschure Program Advisory Committee: Jenna Bednar, Julia R. Lupp, Bhavani R. Rao , Andreas Roepstorff, Ferdinand von Siemens, and Paul Verschure

More posts

Timestamp

  • fast_forward00:00:03 - This is the Convergent Science Network podcast. Leading researchers in the domain
  • fast_forward00:00:10 - of neuroscience, brain theory and technology are interviewed by Paul Verschoor and Tony Prescott.
  • fast_forward00:00:19 - Okay, so I'm Paul Verschure with our Barcelona Brain Cognition Technology Summer
  • fast_forward00:00:26 - School here with Hillel Kiel from Case Western University, a reserve university, sorry.
  • fast_forward00:00:32 - Well, I pronounce it Hillel Kiel and I'm at Case Western Reserve University.
  • fast_forward00:00:36 - Almost right. It's an amalgam between Case Institute and Western Reserve University
  • fast_forward00:00:40 - and everybody gets confused by the name, so no problem.
  • fast_forward00:00:43 - I'm not the only one. No, you're not the only one. Welcome to the Conversion
  • fast_forward00:00:48 - Science Network podcast.
  • fast_forward00:00:50 - And so you were speaking in our summer school.
  • fast_forward00:00:55 - And for us, it was a great opportunity because you have been active in this
  • fast_forward00:00:58 - whole domain of trying to understand biology at sort of a system level.
  • fast_forward00:01:04 - And to also bring this together with a very much technology-oriented view and
  • fast_forward00:01:09 - using robots as a way to test theory and so on.
  • fast_forward00:01:12 - That's exactly where we want to be. and you are really one of the leading characters
  • fast_forward00:01:17 - in this field but now so what I saw was really interesting,
  • fast_forward00:01:25 - very, very impressive in your talk and very useful is you really try to bring
  • fast_forward00:01:29 - us to this list of principles.
  • fast_forward00:01:30 - So where you say, look, I look at these systems and here I'm really going to
  • fast_forward00:01:33 - give you principles. Of course, we can argue then about these principles.
  • fast_forward00:01:35 - And we did. That's probably what we will do again.
  • fast_forward00:01:38 - But I think this is really where we want to go, right? So we want to extract these principles.
  • fast_forward00:01:41 - And you started fairly simple with, well, of course, simple can still be complicated,
  • fast_forward00:01:46 - but rather low scale, let's say, the small scale neuromuscular systems.
  • fast_forward00:01:52 - That's right. So maybe we can start a discussion there that you can try to describe
  • fast_forward00:01:57 - a little bit what are these key principles are that you found at that level
  • fast_forward00:02:02 - of system organization.
  • fast_forward00:02:03 - So let me step back and say something about the general principles thing.
  • fast_forward00:02:06 - I didn't show this slide, but this is one that actually it's in one of the reviews
  • fast_forward00:02:09 - I wrote in 1997 with my colleague Randy Beer called The Brain Has a Body.
  • fast_forward00:02:15 - And that's a particularly influential reference. That's probably one of my few
  • fast_forward00:02:19 - citation classics. If you go to Google Scholar, it's got, I don't know, over 400 citations.
  • fast_forward00:02:23 - For a neurobiologist, that's pretty impressive.
  • fast_forward00:02:27 - Unless, of course, you invented a new technique that everybody's using.
  • fast_forward00:02:30 - And in that, what we presented was the idea that what evolution selects for
  • fast_forward00:02:37 - are not bare brains or particular bodies.
  • fast_forward00:02:40 - It's a coupled system of the brain, the body, and the environment.
  • fast_forward00:02:44 - So brains are embedded and they are embodied within a particular body with a certain biomechanics.
  • fast_forward00:02:50 - And then the agent as a whole, brain-body dynamic, has to work in an environment
  • fast_forward00:02:55 - and has to function in that environment.
  • fast_forward00:02:58 - So what I was essentially doing, sort of you keyed in correctly,
  • fast_forward00:03:02 - we're looking for general principles.
  • fast_forward00:03:03 - But in many cases, what's informing our search is that larger framework,
  • fast_forward00:03:09 - this idea of the couple dynamical systems framework.
  • fast_forward00:03:12 - And one way to look at it is to say, okay, many neurobiologists are,
  • fast_forward00:03:17 - you'll excuse the expression, they're neurocentrists.
  • fast_forward00:03:21 - For them, if it's not the nervous system, they're not interested. it.
  • fast_forward00:03:24 - And they think that the most important thing might be discovering a new channel
  • fast_forward00:03:27 - or a particular molecule and stuff like that.
  • fast_forward00:03:29 - And again, I have a lot of respect for the reductionist approach.
  • fast_forward00:03:33 - From the point of view of this larger framework, what evolution selects for is the entire package.
  • fast_forward00:03:38 - And so a particular channel, well, if it's dysregulated, affects behavior,
  • fast_forward00:03:43 - and then the animal dies, yes.
  • fast_forward00:03:45 - But otherwise, it may just do, it may be one voice in the crowd.
  • fast_forward00:03:49 - Biomechanics is something that many neurobiologists don't focus on,
  • fast_forward00:03:52 - because what they find is if they can throw the body away and just get the brain
  • fast_forward00:03:56 - in the dish, they can do all their experiments very quickly.
  • fast_forward00:03:59 - So the question was, what is the role of the biomechanics?
  • fast_forward00:04:03 - And in a sense, that was one of the themes that ran through several of the other
  • fast_forward00:04:07 - issues in the talk, though I started with that and focused simply on an unusual
  • fast_forward00:04:12 - biomechanical periphery.
  • fast_forward00:04:14 - And that sort of helps sharpen people's focus.
  • fast_forward00:04:18 - We're used to, if you're a roboticist, you're certainly used to thinking about
  • fast_forward00:04:21 - actuators, you're thinking about joint torques, you're thinking about kinematics,
  • fast_forward00:04:26 - you know about the problem of how ill-posed it is if you have excess degrees of freedom.
  • fast_forward00:04:31 - But what happens if you're confronted with a completely different body plan?
  • fast_forward00:04:35 - It's all soft, and it has potentially, you know, it can wrap itself in knots.
  • fast_forward00:04:40 - So one of the things that makes that, I think, a nice place to start is it disorients
  • fast_forward00:04:45 - people enough to get them thinking about why might this be, you know,
  • fast_forward00:04:49 - how would you do this? How would you control this?
  • fast_forward00:04:51 - I know Frank Grass is going to be talking about cephalopod control and the kinds
  • fast_forward00:04:55 - of things that octopi can do.
  • fast_forward00:04:56 - But even our tongues, or especially our tongues, are incredibly flexible devices.
  • fast_forward00:05:01 - Our conversations being, we're using, I use the term muscular hydrostats,
  • fast_forward00:05:06 - that was originated by Kieran Smith.
  • fast_forward00:05:09 - And this is, this challenges your whole idea of how control works.
  • fast_forward00:05:14 - And the interesting thing was, we initially thought, well, this is going to
  • fast_forward00:05:17 - be incredibly complicated.
  • fast_forward00:05:18 - What we discovered is you actually
  • fast_forward00:05:20 - analyze the mechanics, there are some simplifications that emerge.
  • fast_forward00:05:24 - And then that seemed to me a useful principle to enunciate. That, and again.
  • fast_forward00:05:29 - I take your points very well, that that principle is a typical biology principle.
  • fast_forward00:05:35 - It's not the same as a standard, say, physics principle.
  • fast_forward00:05:38 - In a given context, when you talk about a specific behavior,
  • fast_forward00:05:42 - if you define what the biomechanics does in that context and in that behavior,
  • fast_forward00:05:47 - then that will simplify enormously the control questions.
  • fast_forward00:05:50 - Right. So can you give some examples of this kind of simplification that you
  • fast_forward00:05:54 - get through through to biomechanics.
  • fast_forward00:05:56 - So one of the things I talked about in the particular model we did of a tongue.
  • fast_forward00:06:01 - So you have this longitudinal muscle that runs down the center of the tongue,
  • fast_forward00:06:04 - and you have a circumferential muscle that wraps around it.
  • fast_forward00:06:07 - You could think of it like, if our listeners are trying to form an image,
  • fast_forward00:06:10 - it might be helpful to think of a hot dog in a bun.
  • fast_forward00:06:13 - Okay? So you have the central muscle, the longitudinal muscle is the hot dog,
  • fast_forward00:06:17 - and the bun is the circumferential muscle.
  • fast_forward00:06:19 - So if the central muscle contracts, what happens is the whole thing gets short
  • fast_forward00:06:24 - and fat because the volume can't change.
  • fast_forward00:06:27 - Now, what's fascinating is this. Again, I'm not going to go through this in
  • fast_forward00:06:30 - any detail, but I showed a little bit of the math in my talk.
  • fast_forward00:06:33 - When the tongue is long, it turns out it has a huge mechanical advantage relative
  • fast_forward00:06:38 - to the circumferential muscle.
  • fast_forward00:06:39 - What that means is for neural control, if I put just a pulse of activation in
  • fast_forward00:06:44 - to the longitudinal muscle, it's going to shorten immediately.
  • fast_forward00:06:47 - And the circumferential muscle, even if it's working very, very hard,
  • fast_forward00:06:51 - will not be able to overcome those forces until the whole tongue has gotten pretty short.
  • fast_forward00:06:56 - So it almost drops out of the control picture. In fact, if you didn't activate
  • fast_forward00:07:01 - at all, there are passive forces that would stop it.
  • fast_forward00:07:04 - So the real key issue is you might want to activate it because you want to extend
  • fast_forward00:07:08 - the tongue again and get it going again.
  • fast_forward00:07:10 - But if you didn't, if you just wanted a single lap, You could ignore the circumferential muscle.
  • fast_forward00:07:14 - So this is something that would not be obvious to somebody unless they'd sat
  • fast_forward00:07:18 - down and looked at the mechanics.
  • fast_forward00:07:20 - Once you look at the mechanics, it becomes very obvious. And then you can look
  • fast_forward00:07:23 - at the neural control that is actually used, that has evolved for it,
  • fast_forward00:07:26 - and say, oh, that's why these features are there.
  • fast_forward00:07:28 - But you could also argue that maybe this is, let's say, just a happy coincidence
  • fast_forward00:07:33 - because this tongue has to fit in your mouth, for instance. Okay.
  • fast_forward00:07:37 - So if this is really where building robots becomes the crucial thing,
  • fast_forward00:07:42 - because it's from an evolutionary standpoint, there may be any number of possible
  • fast_forward00:07:47 - historical accidents that led you to have the tongue in the particular shape it is.
  • fast_forward00:07:51 - By building the robotic device, you can actually say, well, at least is it physically
  • fast_forward00:07:56 - realistic to say that this phenomena happens in this way?
  • fast_forward00:07:59 - And when you do that and you see that it does, as I emphasized in my talk,
  • fast_forward00:08:03 - and I have to always emphasize this to anyone who's listening,
  • fast_forward00:08:06 - it doesn't prove that it works that way in biology.
  • fast_forward00:08:08 - You're raising the key question. There may be other contingencies, historical accidents.
  • fast_forward00:08:13 - It provides a physical argument that at least it's possible.
  • fast_forward00:08:17 - And then there are ways of testing that. Now, we can't run evolution over again,
  • fast_forward00:08:22 - unless you deal with like bacteria, which have very, very short generation times.
  • fast_forward00:08:26 - They don't have tongues, so it'd be hard to do it with them.
  • fast_forward00:08:29 - But you can try to create devices like robots, and then you can,
  • fast_forward00:08:34 - either in simulation or in the actual device, you can play with the properties.
  • fast_forward00:08:40 - So you can change where the key point of trade-off will be, change the relative
  • fast_forward00:08:46 - mechanical advantage, depending on how you set up the materials and the actuation.
  • fast_forward00:08:50 - And then you can see whether the control ideas continue to be relevant.
  • fast_forward00:08:54 - And again, when we've done those kinds of things, usually in simulation,
  • fast_forward00:08:57 - but also sometimes in robots, that has paid off very nicely. Right.
  • fast_forward00:09:01 - But now, what was interesting with the tongue control is you showed us that
  • fast_forward00:09:06 - when you try to, let's say, generalize the trivial interpretation of the control
  • fast_forward00:09:12 - of the two muscles, you would run into difficulties.
  • fast_forward00:09:15 - So one of the things the animal has to do, of course, is if it's lapping up
  • fast_forward00:09:19 - like what it does insides of eggs, most animals have to worry.
  • fast_forward00:09:24 - First of all, if they're hungry, they want to eat quickly. But there's also
  • fast_forward00:09:27 - an evolutionary issue, which is during the time that they're feeding,
  • fast_forward00:09:30 - they may be very good prey items and become someone else's lunch.
  • fast_forward00:09:34 - So often you want to eat on the run and then literally get out of there.
  • fast_forward00:09:38 - Or another animal may come and grab it away.
  • fast_forward00:09:42 - So they need speed. And the problem is, what we found was if we simply tried
  • fast_forward00:09:46 - to do a scale version, a faster scaled version of the inputs that had worked
  • fast_forward00:09:51 - for the tongue lapping that we started with, they did not work properly.
  • fast_forward00:09:55 - They were filtered by both the mechanics and by the low-pass filtering of the muscle.
  • fast_forward00:10:00 - And so we had to jigger them in order to get the same frequency behavior at a faster time scale.
  • fast_forward00:10:06 - What's interesting is when we then went and looked at some other data where
  • fast_forward00:10:10 - people have looked not just at lapping, but other behaviors in,
  • fast_forward00:10:14 - for example, locomotion, you will find if you look at the EMGs,
  • fast_forward00:10:18 - they are simply not scaled versions of one another.
  • fast_forward00:10:20 - You can't get away with doing that. Part of that, probably a large part of that,
  • fast_forward00:10:24 - is the low-pass filtering. But the other part is the mechanics.
  • fast_forward00:10:27 - And so it was very nice to realize that, oh, this is not just a problem for
  • fast_forward00:10:32 - getting this model to work. This might be a general principle for where mechanics
  • fast_forward00:10:37 - and neural control have to be kept in mind together.
  • fast_forward00:10:40 - Right, exactly. And that also led you to one of your, if you want,
  • fast_forward00:10:44 - principles, maybe more behavioral one in terms of timing is everything.
  • fast_forward00:10:49 - Timing is everything, absolutely.
  • fast_forward00:10:50 - And so there was a very interesting paper, I was actually asked to comment on
  • fast_forward00:10:56 - it, that came out in Science about, I think, six months to nine months ago, about cat lappings.
  • fast_forward00:11:02 - I don't know if you saw it, but it was actually on the cover of Science.
  • fast_forward00:11:05 - And I guess because of the paper I published, they were interested in my comments
  • fast_forward00:11:09 - on it. It was a very nice paper.
  • fast_forward00:11:10 - And it turns out most people think about lapping as you immerse the tongue into
  • fast_forward00:11:15 - the fluid, and then you essentially use it as a cup and withdraw.
  • fast_forward00:11:19 - And that's probably how tupinambis does it. It coats its tongue with the fluid
  • fast_forward00:11:23 - and then withdraws it and then scrapes it off.
  • fast_forward00:11:26 - Cats don't do that. It turns out they do the very fast lapping,
  • fast_forward00:11:29 - but the fluid doesn't go on top of their tongue. It's on the bottom.
  • fast_forward00:11:33 - What they do is they rapidly create a column of fluid, which they then withdraw in.
  • fast_forward00:11:40 - And so what happened was these were guys at MIT. It was fascinating.
  • fast_forward00:11:44 - The guy in mechanical engineering, I guess, had his pet cat,
  • fast_forward00:11:46 - noticed something interesting, took movies.
  • fast_forward00:11:49 - They created this very interesting robot that created this fluid column.
  • fast_forward00:11:53 - And they then did analysis on how fast you had to move and what the areas would
  • fast_forward00:11:58 - have to be so that you could maintain the fluid column.
  • fast_forward00:12:01 - And then they went and looked at the speed of lapping in a whole variety of
  • fast_forward00:12:05 - different basically cat animals, animals from the cat species,
  • fast_forward00:12:10 - lions and tigers and cats and things like that.
  • fast_forward00:12:13 - And they found that if you looked at the scales, there were some very nice scaling
  • fast_forward00:12:17 - laws that fit with their model of how you actually did lapping. Very, very beautiful.
  • fast_forward00:12:23 - Again, I very much like the paper because here, once again, people think about
  • fast_forward00:12:27 - the principles in terms of the mechanics and the physics.
  • fast_forward00:12:30 - And then they realize that that's going to create constraints on what the nervous
  • fast_forward00:12:33 - system has to do to solve the problem that way.
  • fast_forward00:12:36 - Right. So then after that, you sort of now start to move to,
  • fast_forward00:12:41 - if you want, a complexification of tongues, which is like peristaltic movements
  • fast_forward00:12:46 - across multiple segments.
  • fast_forward00:12:49 - This could be sort of multiple tongues glued together in some funky way.
  • fast_forward00:12:54 - And from there, you moved on to the aplysia. Right. Right.
  • fast_forward00:13:00 - So what are the key insights that you gained looking at these peristaltic movements?
  • fast_forward00:13:06 - That you see in different kinds of animal species. So what you see is the thing
  • fast_forward00:13:10 - that we had initially focused on, and the literature emphasizes that peristaltic
  • fast_forward00:13:14 - involves segmental movement.
  • fast_forward00:13:16 - And as I mentioned, Arne McNeil Alexander has this lovely book on animal locomotion.
  • fast_forward00:13:21 - That's the name, and I highly recommend it.
  • fast_forward00:13:24 - I'm not related to him in any way, but I highly recommend it.
  • fast_forward00:13:27 - It's a great book. It's very accessible.
  • fast_forward00:13:29 - And he has a whole beautiful chapter on some of the issues in the mechanics
  • fast_forward00:13:34 - of locomotion, and he talks about peristaltic locomotion.
  • fast_forward00:13:37 - And one of the things he emphasizes is that you have to get the mass moving
  • fast_forward00:13:40 - and then you have to slow it down and decelerate it.
  • fast_forward00:13:43 - And this is really the classic way that people think about it.
  • fast_forward00:13:46 - And if you have segmental locomotion, that's how it works.
  • fast_forward00:13:50 - But if you actually spend time staring at earthworms, so after the rain in Cleveland,
  • fast_forward00:13:57 - and we get lots and lots of rain,
  • fast_forward00:13:58 - the earthworms, which will otherwise drown because they need the oxygen,
  • fast_forward00:14:05 - will come out and walk across the sidewalks.
  • fast_forward00:14:08 - So you get an opportunity, if you care, to look at worms on a fairly regular basis.
  • fast_forward00:14:13 - Now, I think most people either squish them or ignore them, but if you saw me,
  • fast_forward00:14:17 - I would be bending down and actually staring at the worm for an extended period of time.
  • fast_forward00:14:21 - And what you see is there are different regions in the body.
  • fast_forward00:14:24 - It's not a simple movement, actually, but the animal does have this wave of
  • fast_forward00:14:28 - contraction that goes from one end to the other. So on the one hand,
  • fast_forward00:14:31 - there are clearly segments.
  • fast_forward00:14:32 - You can see them, but you see this wave that's moving, and the wave is very smooth.
  • fast_forward00:14:37 - It's not confined to one segment at
  • fast_forward00:14:40 - a time so this led us to think about what would
  • fast_forward00:14:42 - happen if we did this analysis at the
  • fast_forward00:14:45 - differential level what if you took segments and
  • fast_forward00:14:48 - took them down to the level of very very tiny elements and that analysis which
  • fast_forward00:14:53 - again i hope will be coming out within the next few months ordinarily when people
  • fast_forward00:14:57 - talk about peristaltic motion they think of it as rather energetically inefficient
  • fast_forward00:15:01 - and very slow and this analysis showed that actually that's neither of those are necessarily true.
  • fast_forward00:15:09 - If you set it up properly, you can actually keep the center of mass at a constant velocity.
  • fast_forward00:15:15 - And of course, there are going to be frictional forces within the body.
  • fast_forward00:15:18 - You don't have to depend on external friction to keep moving,
  • fast_forward00:15:22 - which means that the energies are not due to losses due to frictional contact.
  • fast_forward00:15:28 - And that means that you could probably sustain these movements if you could
  • fast_forward00:15:31 - minimize internal friction for quite a long period of time.
  • fast_forward00:15:35 - That was very interesting. And the robot I showed that is built on that principle
  • fast_forward00:15:39 - moves quite, quite fast, as you saw in the video.
  • fast_forward00:15:42 - Those earlier videos, at least one of the underwater one, we had to speed up
  • fast_forward00:15:46 - because it was quite slow and it was boring to watch.
  • fast_forward00:15:48 - Whereas this one, you had to actually walk fast to keep up with it.
  • fast_forward00:15:51 - But this system, what we want to know, of course, what are then these biomechanical
  • fast_forward00:15:57 - properties that actually make this an effective locomotion device?
  • fast_forward00:16:03 - That's right. So what are the
  • fast_forward00:16:05 - key biomechanics that make this task actually doable if you are a worm?
  • fast_forward00:16:11 - So this would require, and this is not an area I have pursued,
  • fast_forward00:16:14 - but I'll say a few things from what I've read.
  • fast_forward00:16:16 - And if someone was going to be inspired by this to follow up,
  • fast_forward00:16:19 - what I'd recommend doing is spending some time studying the details of the cross
  • fast_forward00:16:25 - bridges and the actual mechanical arrangements within the musculature of the body wall of the worm.
  • fast_forward00:16:30 - Because what people have shown in a variety of different settings,
  • fast_forward00:16:33 - so I have a colleague, Kishin Nishikawa, who works on ballistic movements in frog tongues.
  • fast_forward00:16:40 - They can actually, there are three different classes. In one class,
  • fast_forward00:16:43 - the animal essentially throws the tongue out. That's a ballistic movement.
  • fast_forward00:16:46 - And there's another class, for example, where they use a muscular hydrostatic
  • fast_forward00:16:49 - property and they slowly protrude it.
  • fast_forward00:16:52 - So here you have a tongue. You have species that are similar,
  • fast_forward00:16:56 - but one is feeding on termites that are relatively slow and that are in crevices,
  • fast_forward00:17:00 - and they use a muscular hydrostatic property, and one is going after insects
  • fast_forward00:17:04 - that can fly away fast, and they use a ballistic inertial tongue.
  • fast_forward00:17:07 - She's looked very carefully at the cross bridges and come up with some very
  • fast_forward00:17:11 - interesting models for how there may be very important nonlinear ways in which
  • fast_forward00:17:16 - you can extend muscles much further and also contract them much further,
  • fast_forward00:17:20 - depending on how the cross bridges work.
  • fast_forward00:17:22 - So I would spend time looking at the material properties and understanding that.
  • fast_forward00:17:26 - And then if that was, as I would expect, was true,
  • fast_forward00:17:30 - I would then talk to people who are doing biomimetics and see if I could build
  • fast_forward00:17:33 - devices like that, perhaps initially macroscopic, but ultimately with advances
  • fast_forward00:17:38 - in nanomaterials, it would be very exciting to try to get someone interested in that.
  • fast_forward00:17:42 - And that would be the way I think you could, again, not prove that the biology
  • fast_forward00:17:46 - works that way, but strongly suggest that that's the key physical property.
  • fast_forward00:17:50 - But for instance, in the system you showed, which is this larger device that
  • fast_forward00:17:56 - uses parasitic movements to move, I don't know exactly the dimension,
  • fast_forward00:17:59 - it looked about like a meter long or something like that. So pretty, pretty big.
  • fast_forward00:18:04 - Also there, you must have identified biomechanical contributions to its ability
  • fast_forward00:18:08 - to actually generate these waves.
  • fast_forward00:18:10 - The student who did this work, Alex Boxerbaum,
  • fast_forward00:18:14 - spent some time mainly focused on the questions of how would you get,
  • fast_forward00:18:18 - what material could he put together that would give him the kinds of changes
  • fast_forward00:18:25 - in strain that were crucial for the movements that he was looking at.
  • fast_forward00:18:31 - And he came up with the idea of essentially and
  • fast_forward00:18:34 - again partially inspired by what you see in the physical arrangements in muscles
  • fast_forward00:18:38 - in animals but this idea of actually weaving the um the cable in a helical fashion
  • fast_forward00:18:44 - one in one direction and then another in another direction and then basically
  • fast_forward00:18:49 - pinning the cables together so that they formed a whole series of rhomboids.
  • fast_forward00:18:54 - And now by using these cables within them again this is his idea you could shorten
  • fast_forward00:18:59 - or lengthen different regions of the cable and because it was now pinned,
  • fast_forward00:19:03 - instead of just shortening, it would pull together and force the others apart,
  • fast_forward00:19:08 - causing that expansion in that particular region. Very ingenious on his part.
  • fast_forward00:19:12 - Right. Very ingenious. But the step to understanding how this relates to the
  • fast_forward00:19:17 - neural control of such a biomechanical system. Yeah, so that's what we're working on right now.
  • fast_forward00:19:22 - And actually one of the things we're doing, I talked a little bit about these
  • fast_forward00:19:25 - stable hetero channels, which we'll come to next.
  • fast_forward00:19:28 - And we actually just got funding from the National Science Foundation,
  • fast_forward00:19:31 - myself and my colleague, Roger Quinn,
  • fast_forward00:19:32 - to look at this, actually trying to put together more of the degrees of freedom
  • fast_forward00:19:39 - of this device with this stable heteroclinic channel network idea to see if
  • fast_forward00:19:44 - we can independently control different degrees of freedom,
  • fast_forward00:19:48 - actuate and independently control them. I don't know if it's going to work.
  • fast_forward00:19:52 - I have a history of saying, I think this is true, and then it does actually show itself true.
  • fast_forward00:19:57 - And I have a history of encountering lots of skepticism when I make these claims.
  • fast_forward00:20:01 - But I'm also, more often than not, I'm also wrong.
  • fast_forward00:20:05 - But we can actuate individual parts of the mesh.
  • fast_forward00:20:10 - And we can thus separately control and activate them. And I think we can get
  • fast_forward00:20:15 - the thing to bend and lift up and actually form curves and possibly also negotiate
  • fast_forward00:20:20 - fairly tortuous terrain.
  • fast_forward00:20:21 - It may take us several years, but I think that's all within our grasp.
  • fast_forward00:20:25 - Okay. But then do you see the controller that's behind that or the neural control
  • fast_forward00:20:31 - as still reducing this complexity or roughly mapping one-to-one on the complexity
  • fast_forward00:20:38 - of this morphology? Yeah, yeah, yeah. So I think the issue is this.
  • fast_forward00:20:41 - If I'm trying to create peristaltic waves, unified waves, I actually,
  • fast_forward00:20:47 - and again, in the robot we showed, that's a one degree of freedom device in terms of control.
  • fast_forward00:20:52 - Because the cam basically allows you to pull on the different cables and change
  • fast_forward00:20:57 - their length as it circles, and that's all you need to get the peristaltic waves.
  • fast_forward00:21:02 - So what that suggests is that under certain circumstances, if you're creating
  • fast_forward00:21:06 - waves, a collective contraction of specific elements in sequence will be all
  • fast_forward00:21:12 - you need, and the whole thing will do what you want.
  • fast_forward00:21:14 - Now, if you want precise, careful movements where you're exploring your way
  • fast_forward00:21:19 - through obstacles and then you're curling around and perhaps pulling something,
  • fast_forward00:21:24 - you're not going to be able to create this nice unified, let's actuate everything
  • fast_forward00:21:29 - in a simple way. You're going to have to do much more complex things.
  • fast_forward00:21:32 - I think the way I think about it is this, that when you don't need all the excess
  • fast_forward00:21:36 - degrees of freedom, what much of the neural control does is to try to simplify
  • fast_forward00:21:40 - down those degrees of freedom by appropriate collective activation.
  • fast_forward00:21:44 - And when you do need them, they're there. And again, I think the nervous system
  • fast_forward00:21:48 - may use some of the principles I was talking about to fractionate them out and
  • fast_forward00:21:52 - pull out the things that it needs.
  • fast_forward00:21:54 - So the answer, once again, is it will depend on the context in which the thing is being used.
  • fast_forward00:21:59 - And what we're You're going to move towards a situation where,
  • fast_forward00:22:02 - and again, this is very nice in terms of the controllers I was talking about,
  • fast_forward00:22:05 - you can gang them together so that they do one thing all at once,
  • fast_forward00:22:09 - but you can fractionate them if necessary so they can map onto much finer detail. Right.
  • fast_forward00:22:16 - So it's something you were structuring also in this presentation from,
  • fast_forward00:22:21 - let's say, fairly simple sensor motor systems or cellular motor systems to more complex ones.
  • fast_forward00:22:27 - And so after the peristaltic movement, and then this nice proof of concept,
  • fast_forward00:22:32 - if you want, which is a one meter long worm,
  • fast_forward00:22:35 - you then brought it to the point that you say, look, but the use of these muscles,
  • fast_forward00:22:41 - we should think about in terms of context. And this is an important principle.
  • fast_forward00:22:44 - And to illustrate that principle, you used also a plesia grasping. Yes. Right?
  • fast_forward00:22:49 - So what do you really mean when you say, okay, muscles are used in context?
  • fast_forward00:22:54 - Okay. So the example I gave in the talk, let me talk about it a little bit.
  • fast_forward00:22:59 - So it turns out that in our hip, there are certain muscles that act for either,
  • fast_forward00:23:05 - I think it's moving forward or moving back, depending on where the rest of the hip is.
  • fast_forward00:23:10 - In the arm, the brachioradialis is used for, if your palm is up,
  • fast_forward00:23:18 - this crosses the joint and it's crucial for turning your palm down.
  • fast_forward00:23:22 - Now, so if you think about the direction of forces, it's going to rotate in one direction.
  • fast_forward00:23:28 - Now, once you have the arm down, the hand down, that same muscle plays a role
  • fast_forward00:23:33 - in rotating the arm back in the opposite direction.
  • fast_forward00:23:36 - So if you look in terms of the torque arm, it actually switches direction,
  • fast_forward00:23:39 - and it can do so in part because of the new position it finds itself in.
  • fast_forward00:23:46 - And several people, and this was some years ago, using cadaver studies and pulling
  • fast_forward00:23:52 - on different muscles in the context of limbs, showed that as you move the limb through the workspace,
  • fast_forward00:23:59 - what the muscles did was not a simple relationship and was very complex. flex.
  • fast_forward00:24:04 - And this is actually, if you go back and look at some work that people had done
  • fast_forward00:24:08 - back even in the 19th and very early 20th century, people did very careful work
  • fast_forward00:24:13 - on, say, frog musculature.
  • fast_forward00:24:15 - They showed that as you move through the workspace, what the muscles did changed.
  • fast_forward00:24:20 - So this idea of a protractor, retractor, pronation, supination,
  • fast_forward00:24:24 - these are all fine. You teach medical students that.
  • fast_forward00:24:26 - It's very helpful. And in standard configurations, that's how it works.
  • fast_forward00:24:30 - We found in the aplysius system, and I'm emphasizing the vertebrate examples
  • fast_forward00:24:34 - to begin with to show that I think this is much more general,
  • fast_forward00:24:37 - that as one part of the structure moved relative to other parts of the structure,
  • fast_forward00:24:41 - the actual functional role of the muscle changed.
  • fast_forward00:24:44 - So a muscle that was thought to push a grasper back could actually move it towards
  • fast_forward00:24:49 - the jaws in the appropriate context.
  • fast_forward00:24:52 - And the two points then that I made, which I thought were very crucial,
  • fast_forward00:24:55 - was that what a muscle does is a function of its mechanical context.
  • fast_forward00:24:59 - And the second one, which I didn't illustrate but could go on at great length
  • fast_forward00:25:02 - because we've shown this, because muscles do that, when you are trying to do
  • fast_forward00:25:07 - different behaviors or behavioral variants,
  • fast_forward00:25:10 - what you do is you call upon a coalition of the relevant muscles in that particular
  • fast_forward00:25:15 - mechanical context to make that happen.
  • fast_forward00:25:17 - And some muscles can't be used in a particular context, and other muscles must
  • fast_forward00:25:23 - be used, and other muscles can variably be used.
  • fast_forward00:25:26 - So the general principle I stated, which I think is a broad truth,
  • fast_forward00:25:31 - is that it's actual coalitions, changing coalitions of muscles are what give
  • fast_forward00:25:36 - rise to multifunctionality.
  • fast_forward00:25:37 - And I think that that's a general principle.
  • fast_forward00:25:40 - Right, but it's interesting, right? Because now we went from this worm to the
  • fast_forward00:25:46 - idea to test it on this grasping response of a plesia.
  • fast_forward00:25:50 - Right. And in some sense, we get the complexification of the whole system. That's correct.
  • fast_forward00:25:54 - Because the strength of your, let's say, your C.
  • fast_forward00:25:57 - Elegans model was like, well, it's one degree of freedom that they can control
  • fast_forward00:26:01 - with very minimal control. That's right. Same for your tongue.
  • fast_forward00:26:03 - Right. But remember, let's talk about the a plesia grasper.
  • fast_forward00:26:07 - If I showed it to you in all its glory, and if you come to Cleveland,
  • fast_forward00:26:11 - I'll be happy to do so. Or if you invite me and bring me slugs,
  • fast_forward00:26:14 - I'll dissect them out and show them.
  • fast_forward00:26:16 - Very complicated. And what you will see is it's a soft tissue structure.
  • fast_forward00:26:20 - And if I poke it or excite it, you'll see all this complex shimmying around
  • fast_forward00:26:24 - that it's capable of doing.
  • fast_forward00:26:26 - So even though there are constraints because of its physical nature,
  • fast_forward00:26:30 - and it's not jello, but it is very flexible.
  • fast_forward00:26:35 - And there are all sorts of different things that the musculature can do.
  • fast_forward00:26:39 - In the analysis that I'm doing, we're really simplifying down to talk about
  • fast_forward00:26:43 - essentially two degrees of freedom, which is opening and closing and protraction and retraction.
  • fast_forward00:26:49 - So again, I didn't give a lecture on aplysia feeding. If you asked me to do
  • fast_forward00:26:53 - that, I would have happily done so.
  • fast_forward00:26:54 - So we've taken this whole complicated structure that has all sorts of different
  • fast_forward00:26:58 - potential degrees of freedoms and maybe 15 or 20 muscles.
  • fast_forward00:27:02 - And we actually think about it and we can show that in terms of the behavior,
  • fast_forward00:27:06 - if you just focus on opening and closing and protraction and retraction,
  • fast_forward00:27:10 - you can create all of the different functions I talk about, biting,
  • fast_forward00:27:13 - swallowing, and rejection.
  • fast_forward00:27:14 - By changing the timing, the duration, and the phasing of those key two components,
  • fast_forward00:27:20 - you can get all the different behaviors.
  • fast_forward00:27:21 - So in fact, we see that as an enormous simplification. In addition,
  • fast_forward00:27:26 - and again, I didn't have time to talk about this,
  • fast_forward00:27:30 - Because the musculature is fairly slow, we can actually have done some analysis
  • fast_forward00:27:35 - of the mechanics in detail.
  • fast_forward00:27:37 - We can define what we call neuromechanical equilibrium points.
  • fast_forward00:27:41 - So for a given pattern of activation in the neural outputs, we can actually
  • fast_forward00:27:47 - predict the trajectory that the musculature will take over the next several
  • fast_forward00:27:51 - hundreds of milliseconds.
  • fast_forward00:27:55 - And we can talk about that as the target the animal is aiming towards.
  • fast_forward00:27:58 - You're dealing with very low
  • fast_forward00:28:00 - mass, a fairly viscous system, so inertial forces are not in the picture.
  • fast_forward00:28:05 - So it's elastic and viscous forces.
  • fast_forward00:28:10 - So velocity-dependent forces, as well as position-dependent forces.
  • fast_forward00:28:14 - So not so much mass-dependent forces. So what you're dealing with is a system
  • fast_forward00:28:20 - where you can actually see smooth trajectories and you can talk about these
  • fast_forward00:28:24 - equilibrium points defined by the neural control as well as by the mechanics.
  • fast_forward00:28:29 - And that it provides also a huge simplification for thinking about where is
  • fast_forward00:28:33 - the nervous system trying to push the whole, the properties of the system from one set to another.
  • fast_forward00:28:39 - So even though it's a much higher dimensional system, this idea of understanding
  • fast_forward00:28:44 - the mechanics properly and analyzing it properly and taking the muscular hydrostatic
  • fast_forward00:28:49 - properties and using that to see where is the system going,
  • fast_forward00:28:53 - how to analyze it, has led to simplification.
  • fast_forward00:28:55 - But it is a more complicated system, so it doesn't simplify down quite as much
  • fast_forward00:29:00 - as the original one I started with.
  • fast_forward00:29:02 - Right. But the question that this raises is that, okay, but now what are the
  • fast_forward00:29:07 - implications of neural control, right?
  • fast_forward00:29:09 - And how does the biomechanics actually constrain that and make it solvable?
  • fast_forward00:29:13 - Because in some sense, isn't this sort of a restatement of the Bernstein problem in some sense?
  • fast_forward00:29:19 - Because you say, look, I have many different ways to perform a movement,
  • fast_forward00:29:22 - so in that sense- Yeah, exactly. Well, he pointed out two different things.
  • fast_forward00:29:25 - First of all, he talked about the invariance of the motor field.
  • fast_forward00:29:28 - And I think this is still something we do not understand. I can learn to sign
  • fast_forward00:29:33 - my name under a microscope or with a paintbrush against the side of a barn.
  • fast_forward00:29:39 - And I'm going to be, in one case, using a very, very tiny set of muscles.
  • fast_forward00:29:43 - In the other case, I'm going to be running with my entire body,
  • fast_forward00:29:45 - and the signature will look the same. So he identified early on this notion
  • fast_forward00:29:49 - of motor invariance that I think is still a very deep question that has not
  • fast_forward00:29:55 - really been properly addressed.
  • fast_forward00:29:56 - Part of the reason I'm so excited about the neuromechanical equilibrium points
  • fast_forward00:30:00 - in the slow system, I know about equilibrium points, the fast system,
  • fast_forward00:30:04 - and all the debates in that area.
  • fast_forward00:30:05 - I am agnostic about that, and I've seen the debates pro and con.
  • fast_forward00:30:09 - But in my system, which is much slower, where I think we can much more easily
  • fast_forward00:30:14 - make the argument and then show
  • fast_forward00:30:15 - data for it, I think this is an incredibly powerful organizing principle.
  • fast_forward00:30:21 - The point that Bernstein was making, though, was he doesn't ever use the term
  • fast_forward00:30:26 - cursive dimensionality.
  • fast_forward00:30:27 - And he doesn't ever, in his book, at least as I've read it, say excess degrees
  • fast_forward00:30:31 - of freedom are a problem.
  • fast_forward00:30:33 - What he talks about is how they are sculpted into these biodynamic waves that
  • fast_forward00:30:38 - give you this patterning And that when individuals go through the lifespan.
  • fast_forward00:30:44 - You see these pattern movements that change over age, or if someone has a wooden
  • fast_forward00:30:50 - leg that they have to use as a prosthetic, how they incorporate it into the biodynamic waves.
  • fast_forward00:30:54 - He had this vision of an internal dynamics that was mapped onto those degrees
  • fast_forward00:31:01 - of freedom and that provided some kind of unification and simplification of their control. crawl.
  • fast_forward00:31:06 - So I've been very influenced by that, I think. And so if I'm restating something
  • fast_forward00:31:10 - that Bernstein said, you've just complimented it.
  • fast_forward00:31:12 - No, no, look, this is what it sounds like a little bit. But what I'm looking
  • fast_forward00:31:16 - for is then, okay, we have all these possible combinations or different,
  • fast_forward00:31:21 - if you want, now skeletal motor contexts in which a muscle can act.
  • fast_forward00:31:24 - On the one end, you have your biomechanical constraints that will limit this in some sense.
  • fast_forward00:31:28 - But now the question is, how does your neural control now tune itself to then
  • fast_forward00:31:33 - these, let's say, valid combinations, right?
  • fast_forward00:31:35 - This valid set of muscle combinations. So you're asking a very interesting question.
  • fast_forward00:31:40 - So this actually would jump me to the end of the talk and the question of initial conditions.
  • fast_forward00:31:45 - So let me spell this out. So I have a colleague at Case.
  • fast_forward00:31:48 - Her name is Lynn Landmesser, and she's been studying the early development of
  • fast_forward00:31:51 - the nervous system, especially the spinal cord, for many, many years.
  • fast_forward00:31:54 - One of the things that she has discovered is that well before birth,
  • fast_forward00:31:57 - there are spontaneous simultaneous patterns that start in the nervous system, in the spinal cord.
  • fast_forward00:32:03 - And so prior to having wired up, this is before motor neurons make contact with the periphery.
  • fast_forward00:32:12 - Regular dynamic patterns are established.
  • fast_forward00:32:16 - Once contact is made, there are trophic factors that allow the size of the musculature
  • fast_forward00:32:22 - to map back onto the nervous system and increase, for example, proliferation.
  • fast_forward00:32:27 - So a larger periphery will generate more motor neurons.
  • fast_forward00:32:31 - But also, not just in terms of numbers, in terms of the dynamics, once there is contact.
  • fast_forward00:32:38 - Contact. Another investigator who's studied chicks before hatching,
  • fast_forward00:32:44 - Anne Becky, has shown that there are spontaneous movements that,
  • fast_forward00:32:48 - and so again, any mother will tell you about the fetal kicking and stuff like that.
  • fast_forward00:32:52 - There is an ongoing coupling that's happening prior to birth,
  • fast_forward00:32:56 - whereby the periphery is providing feedback, sensory inputs,
  • fast_forward00:33:00 - and the nervous system is generating these spontaneous dynamic patterns,
  • fast_forward00:33:06 - and they're shaping each other.
  • fast_forward00:33:09 - And that's what you have to start with when you're born.
  • fast_forward00:33:12 - So you're not starting with a tabula rasa. And an infant doesn't lie,
  • fast_forward00:33:16 - they're passive and immobile. It's already moving things around.
  • fast_forward00:33:19 - And then, I mean, this is like a major, major breakthrough for my kids,
  • fast_forward00:33:22 - when you can finally get the thumb into the mouth reliably and keep it there. That's like amazing.
  • fast_forward00:33:28 - So there are some built-ins like suckling, and then there's these more complex
  • fast_forward00:33:34 - things that are built in and there's this dynamic continuous reshaping between the periphery,
  • fast_forward00:33:41 - its experiences in the world and the nervous system. That's what's going on there.
  • fast_forward00:33:45 - So what happens is this kind of jittering around, this play,
  • fast_forward00:33:49 - this activation, this is the dynamic way you tune that system so the nervous
  • fast_forward00:33:54 - system knows about the degrees of freedom that are out there and it takes advantage
  • fast_forward00:33:58 - of as many of them as it needs to.
  • fast_forward00:34:00 - The other thing you raised in part of your question to my talk,
  • fast_forward00:34:03 - which I just have to talk about again, because I thought it was a very important
  • fast_forward00:34:07 - issue, especially in higher organisms like ourselves,
  • fast_forward00:34:10 - useful repetitive patterns are speeded up and they become part of our repertoire.
  • fast_forward00:34:17 - They are like reflexes. And that's not something you see in all animals.
  • fast_forward00:34:21 - Many, as I said, in the lower organisms, you have these fixed action patterns
  • fast_forward00:34:24 - and those are pre-wired and they can't be changed.
  • fast_forward00:34:28 - I didn't talk about this in detail, but a wasp that's going through nest building,
  • fast_forward00:34:31 - if you interrupt it and then let it continue, it's just like a machine.
  • fast_forward00:34:35 - It just goes back and continues doing exactly what it was doing.
  • fast_forward00:34:37 - You would not see that in a primate. You would certainly not see that in a human.
  • fast_forward00:34:42 - And yet, if there's something like our tennis swing or piano playing,
  • fast_forward00:34:46 - that becomes an automatic behavior.
  • fast_forward00:34:48 - So again, very important. So this tuning, shaping, and this dynamic view that
  • fast_forward00:34:53 - I'm trying to argue is how the nervous system does it.
  • fast_forward00:34:57 - I don't see that as necessarily working through some kind of internal representation.
  • fast_forward00:35:00 - I see this as this trial and error playing around, very good initial dynamics,
  • fast_forward00:35:06 - feedback from the environment shaping the connectivity, the local connectivity,
  • fast_forward00:35:11 - and generating an effective dynamic model.
  • fast_forward00:35:16 - That's what's exploited subsequently. So as if the nervous system is freezing
  • fast_forward00:35:20 - its degrees of freedom to control the periphery. When it needs to,
  • fast_forward00:35:23 - and then unfreezing them when it doesn't. And that's, I think,
  • fast_forward00:35:26 - a really critical insight.
  • fast_forward00:35:28 - So that sometimes things look absolutely seamless and incredibly easy,
  • fast_forward00:35:32 - but anyone, you say you do sports, so you can remember the difference.
  • fast_forward00:35:36 - I mean, this is something that was very striking to me. Watching someone do the crawl.
  • fast_forward00:35:40 - When you watch someone who's learning how to do the crawl, you see all the effort
  • fast_forward00:35:44 - and you can see all these inefficiencies and the person is doing the movements.
  • fast_forward00:35:50 - Then you look at someone who's a trained swimmer and it's this seamless,
  • fast_forward00:35:54 - beautiful motion. I mean, it's just gorgeous.
  • fast_forward00:35:57 - And there's one motion after another follows in this absolutely seamless way.
  • fast_forward00:36:02 - There's a real beauty to it. That coordination,
  • fast_forward00:36:05 - that choreography is something that reduces the unnecessary degrees of freedom
  • fast_forward00:36:12 - and allows the person to do it incredibly effectively and efficiently.
  • fast_forward00:36:15 - Again, I think it's a tuning of dynamics.
  • fast_forward00:36:18 - But then we should try to understand a little bit what these key organizing principles are.
  • fast_forward00:36:25 - Exactly. And for that, you start to look, this is of control,
  • fast_forward00:36:30 - you tied very much to also ideas about, let's say, attractor dynamics and how
  • fast_forward00:36:35 - attractor dynamics are regulated.
  • fast_forward00:36:36 - So how is that giving us insight in organizational principles?
  • fast_forward00:36:40 - Okay, so again, the notion of attractor dynamics and why I'm attracted to attractor
  • fast_forward00:36:44 - dynamics is the following.
  • fast_forward00:36:46 - First of all, although these are qualitative dynamics in many cases,
  • fast_forward00:36:51 - there are both, in lower dimensions, there are very, very rigorous mathematical
  • fast_forward00:36:55 - things you can do, and in higher dimensions, very interesting numerical things you can do.
  • fast_forward00:36:59 - And what's, again, interesting is that you don't need to have representations
  • fast_forward00:37:02 - internally to get very complex behavior, and you get smoothness and robustness
  • fast_forward00:37:08 - and the ability to handle noise and perturbations essentially for free.
  • fast_forward00:37:12 - You don't have to put in all of that. You don't have to plan for the combinational
  • fast_forward00:37:18 - complexity explosion that's going to happen if you have to deal with all the
  • fast_forward00:37:22 - possible different cases.
  • fast_forward00:37:23 - That comes for free. So attractor dynamics is inherently robust to perturbation.
  • fast_forward00:37:29 - That's why we call it an attractor.
  • fast_forward00:37:31 - And it has a lot of architecture and it has a lot of tools that allow you to
  • fast_forward00:37:37 - set things up and to try to map them onto things like nervous systems.
  • fast_forward00:37:42 - So I didn't have time to talk about this in my talk, but Rabinovich has shown,
  • fast_forward00:37:46 - and we're starting to do some of this, that some of the ideas that I talked
  • fast_forward00:37:49 - about from attractor dynamics can be mapped very naturally onto known neural architectures.
  • fast_forward00:37:55 - And what that means then is that doesn't guarantee that you'll know that neuron
  • fast_forward00:37:59 - A makes this connection to neuron B.
  • fast_forward00:38:02 - But it will say that if this hypothesis is correct, this class of neurons should
  • fast_forward00:38:08 - be tightly coupled to one another, and they should be activated together.
  • fast_forward00:38:12 - They should inhibit these other groups in such a way that they can't take over
  • fast_forward00:38:17 - while this one is activated.
  • fast_forward00:38:19 - And then there There should be appropriate, you'll excuse the term,
  • fast_forward00:38:23 - recurrent loops such that you can destabilize that pattern of activity and allow
  • fast_forward00:38:28 - another one now to generate a burst, be active,
  • fast_forward00:38:32 - also have its own internal coupling and keep the other parts silent for that period of time.
  • fast_forward00:38:37 - So what's very nice is as I see these descriptions and I look at the models,
  • fast_forward00:38:42 - and again, the math is something I can follow so I can actually understand what
  • fast_forward00:38:45 - they're talking about. I immediately
  • fast_forward00:38:46 - start thinking in terms of the neural circuitry that we're studying.
  • fast_forward00:38:49 - And I have some ideas for experiments that I would like to try,
  • fast_forward00:38:52 - which would test whether these ideas are of any value.
  • fast_forward00:38:55 - And again, as I stressed in my talk, when it comes to theory,
  • fast_forward00:38:58 - I'm an absolute agnostic.
  • fast_forward00:39:00 - I'm, I do not, I'm not a believer in the sense that, you know,
  • fast_forward00:39:03 - this theory is right. That theory is wrong.
  • fast_forward00:39:04 - If a piece of a theory will work, I'm great. That's great. Let me take it and
  • fast_forward00:39:08 - I'll use it. If it doesn't work. Okay.
  • fast_forward00:39:10 - So we'll come up with a better theory or use a different theory.
  • fast_forward00:39:13 - But there are two things about the attractor networks.
  • fast_forward00:39:16 - So on the one hand, it could also possibly mislead you because maybe in a tractor
  • fast_forward00:39:21 - that, that you observe at some, at some level of the state space of this organism,
  • fast_forward00:39:27 - because it's up to you on what level you describe it. Right, right.
  • fast_forward00:39:30 - Right. These attractors might be some mixture of neural states and biomechanics. That's right.
  • fast_forward00:39:34 - And in some sense, you want to tease these factors apart.
  • fast_forward00:39:40 - Well, that's the question. But now it's starting to become, because as you said
  • fast_forward00:39:42 - yourself, you then interpret your attractor in terms of some recurrent neural structure.
  • fast_forward00:39:46 - Okay. So the interesting point that you're raising is this, and this is something
  • fast_forward00:39:49 - that came up in the second talk, which we may get to or not.
  • fast_forward00:39:53 - I just found that really inspiring. But the issue is that when we look and do
  • fast_forward00:39:58 - folk psychology or folk philosophy or anything like that, we tend to carve nature up in certain ways.
  • fast_forward00:40:04 - So the elements are earth, air, fire, and water, right?
  • fast_forward00:40:09 - Because that's what we see. but then as science progresses we begin to discover
  • fast_forward00:40:13 - that that's actually not how nature is carved up at all but we that doesn't
  • fast_forward00:40:16 - lead us to abandon the notion that there might be elements.
  • fast_forward00:40:20 - It just requires us to rigorously refine what we mean by that and then come
  • fast_forward00:40:26 - up with good operational definitions for what is an element what's a molecule
  • fast_forward00:40:29 - and what's what's not similarly it seems to me that the formulation of the neuromechanical
  • fast_forward00:40:34 - equilibrium point hypothesis orthosis that, again, I didn't talk about in my talk,
  • fast_forward00:40:38 - but it's something we're actively working with, may or may not carve nature
  • fast_forward00:40:42 - at its joints. We don't know.
  • fast_forward00:40:44 - But it's an organizing principle that allows us to look at the bursts of activity
  • fast_forward00:40:48 - that come out of the nervous system and the musculature that's active at a particular
  • fast_forward00:40:51 - time and say, ah, we can make a good prediction as to where this is going to go next.
  • fast_forward00:40:56 - Now, one thing that illustrates the likelihood that this is going to work is the following.
  • fast_forward00:41:01 - And again, this is very qualitative, and I immediately admit that.
  • fast_forward00:41:06 - But my students set up the animals and they have them instrumented so that they're
  • fast_forward00:41:11 - recording from that key muscle I talked about that pushes the grasper forward
  • fast_forward00:41:14 - in these three motor neurons.
  • fast_forward00:41:15 - I walk in and I don't look at the animal. I look at the recordings. I say, oh, it's biting.
  • fast_forward00:41:20 - And my student says, yeah, you're right.
  • fast_forward00:41:23 - Now, again, I'm using my visual cortex as a stand-in for some other analyzer.
  • fast_forward00:41:31 - But what I'm suggesting is that if we can begin,
  • fast_forward00:41:34 - as I and my students have begun, to recognize certain motor patterns as they're
  • fast_forward00:41:39 - starting to unfold and make a prediction as to what's going to happen,
  • fast_forward00:41:43 - that suggests that these ways of thinking about it and conceptualizing what's
  • fast_forward00:41:48 - going on may be very powerful for understanding the organization of the system.
  • fast_forward00:41:53 - They may be artificial impositions that we've created that have nothing to do with nature.
  • fast_forward00:41:58 - At least being aware of that is the basis for going in and probing the system
  • fast_forward00:42:02 - to try to show that you're wrong.
  • fast_forward00:42:04 - And so that's one of the things that we make a lot of effort to do.
  • fast_forward00:42:07 - So if the systems actually do have a mix of the neural and mechanical,
  • fast_forward00:42:13 - and that is actually what's going on, then if we find in the nervous system
  • fast_forward00:42:17 - a tractor dynamics which mix those those two appropriately.
  • fast_forward00:42:21 - Again, it's not a proof. It's very suggestive. The key point that you're getting
  • fast_forward00:42:25 - at, which I take very strongly and is, again, I'm hoping to press this forward,
  • fast_forward00:42:29 - depends on resources and depends on students, would be to disrupt the system
  • fast_forward00:42:34 - in predictive ways and show that if I take out a particular key interneuron
  • fast_forward00:42:41 - that is supposed to instantiate what I'm arguing is one of these attractors,
  • fast_forward00:42:44 - and I prematurely turn it off,
  • fast_forward00:42:47 - or I turn on another, other, which ordinarily would be inhibited.
  • fast_forward00:42:50 - I can predict what that perturbation is likely to do based on the attractor
  • fast_forward00:42:53 - dynamics and show that the behavioral changes are similar.
  • fast_forward00:42:56 - Now, that's still not a complete proof, but it's a much stronger sense that,
  • fast_forward00:43:03 - yes, the way I manipulate the system and modify it is reflecting what's going on.
  • fast_forward00:43:08 - It's not just a useful summary for the way I think about it.
  • fast_forward00:43:11 - It might actually be how the system itself is built. Right.
  • fast_forward00:43:14 - But this is also an important point here because in
  • fast_forward00:43:17 - your in your modeling in the end uh
  • fast_forward00:43:20 - of these of these tracker dynamics um what we look at in the end was some sort
  • fast_forward00:43:25 - of recurrently coupled network where you both had sort of self-excitation and
  • fast_forward00:43:29 - then full lateral excitation right in the network and then the obvious question
  • fast_forward00:43:34 - that then i also pose is of course well but but why would i believe that that
  • fast_forward00:43:40 - reflects, let's say, the nervous system of a plesia.
  • fast_forward00:43:42 - And for that, don't we need to impose a few more constraints that relate to
  • fast_forward00:43:48 - the sociology of the anatomy?
  • fast_forward00:43:49 - And again, again, I didn't have time to talk about this. There's been,
  • fast_forward00:43:51 - as I mentioned, now about...
  • fast_forward00:43:56 - Nearly it's three and a half decades of work i
  • fast_forward00:43:59 - mean irving started focusing on implicit feeding his first
  • fast_forward00:44:01 - publication is 1974 but he'd started
  • fast_forward00:44:04 - doing that a year or two beforehand so it may be nearly um four decades actually
  • fast_forward00:44:10 - and as i said we have about 200 or so of the elements now each of the in the
  • fast_forward00:44:19 - controller for the um feeding apparatus is what's called the buckle ganglia
  • fast_forward00:44:22 - it's an an organization.
  • fast_forward00:44:23 - It's a collection of nerve cells. They're two paired ganglia.
  • fast_forward00:44:28 - And in those, there are about 1,000 nerve cells each.
  • fast_forward00:44:31 - About 150 of them are motor neurons.
  • fast_forward00:44:34 - Some tens of them are key interneurons, and the rest of them are sensory neurons.
  • fast_forward00:44:38 - We know many of the motor neurons. We know some of the interneurons.
  • fast_forward00:44:41 - We know relatively few, but at least a few of the sensory neurons.
  • fast_forward00:44:45 - And we've mapped a lot of the connections. So when I talk about recurrent neural networks, works.
  • fast_forward00:44:49 - We can show that this neuron actually not only inhibits this,
  • fast_forward00:44:53 - it excites that, and that one comes back and after a delay can inhibit that one or excite that one.
  • fast_forward00:44:58 - So we see huge numbers of loops that are based on binary recordings from the nerve cells.
  • fast_forward00:45:05 - But still, in these loops, you would have very characteristic transduction delays
  • fast_forward00:45:09 - that you might not capture in these models because these models in that sense are more uniform.
  • fast_forward00:45:14 - Well, the interesting issue though is remember that for the real nervous system,
  • fast_forward00:45:19 - it still has to deal with the low-pass filtering of the musculature, the real musculature.
  • fast_forward00:45:23 - So what's going to happen is some of the fast phenomena,
  • fast_forward00:45:26 - which are important for the dynamics of the nervous system unfolding in detail,
  • fast_forward00:45:31 - are going to be lost when you push them through the periphery because the periphery
  • fast_forward00:45:36 - is only going to be getting a low-pass filtered version of that.
  • fast_forward00:45:40 - So if our models capture the low-pass filtering properties reasonably well,
  • fast_forward00:45:44 - Well, even if not all of the details of the dynamics at higher,
  • fast_forward00:45:49 - at faster time scales are captured, we may nevertheless capture some aspects
  • fast_forward00:45:54 - of the dynamics of the nervous system that matter for the periphery.
  • fast_forward00:45:57 - Sure, but then you still have to show that in terms of the time constants within
  • fast_forward00:46:01 - that system, they sort of match that low pass shielded version of the periphery.
  • fast_forward00:46:04 - And in fact, what we do see, for example, the B31, B32 interneurons,
  • fast_forward00:46:08 - which I very briefly mentioned and have been characterized. So back in 96,
  • fast_forward00:46:12 - this was a collaboration between my lab and Avi Susswein.
  • fast_forward00:46:15 - This was published in Journal of Neurophysiology, two companion papers.
  • fast_forward00:46:18 - These neurons generate plateau-like potentials. So when they get turned on,
  • fast_forward00:46:24 - they actually fire for an extended period of time.
  • fast_forward00:46:27 - And their axons go out to the periphery, and they activate the grasper's protractor
  • fast_forward00:46:32 - muscle, the I2 muscle. Awesome.
  • fast_forward00:46:34 - So the time course of their activation is very well tuned to the muscle.
  • fast_forward00:46:40 - And in fact, we did a paper in 1999.
  • fast_forward00:46:42 - This was a collaboration with Pat Crago.
  • fast_forward00:46:45 - And a student that he and I shared, we actually did a detailed biomechanical
  • fast_forward00:46:49 - study with a servomotor to look at what happens as you stimulate the nerve and
  • fast_forward00:46:54 - looked at the force frequency, length, tension, and force velocity properties of the muscle.
  • fast_forward00:46:58 - And we actually built a model of it based on the neural inputs.
  • fast_forward00:47:02 - And we show that if you took EMG recordings, you could actually get movements
  • fast_forward00:47:05 - out of that model that look very similar to the ones that you actually measured.
  • fast_forward00:47:09 - So again, when I talk about that kind of transduction stuff,
  • fast_forward00:47:13 - it's not based on just, well, I think it's okay.
  • fast_forward00:47:15 - We actually have done a lot of that hard work. Not as much as,
  • fast_forward00:47:18 - I mean, it's a sensitive point for me, for any biologist, because there's always more that I can do.
  • fast_forward00:47:23 - And so immediately you're going to get me on the defensive correctly,
  • fast_forward00:47:26 - because talking to my fellow biologists, they're going to demand even more,
  • fast_forward00:47:30 - and I demand that of myself.
  • fast_forward00:47:32 - But we have gone quite a far ways to argue that the things that we're seeing are right.
  • fast_forward00:47:38 - So for example, one of the things we found, which is quite interesting,
  • fast_forward00:47:41 - if you look at the force-frequency relationship, if the neuron fires at 6 hertz
  • fast_forward00:47:48 - or 5 hertz, very little happens in the muscle.
  • fast_forward00:47:51 - If it goes above 10 hertz for a period of about 200 or 300 milliseconds,
  • fast_forward00:47:57 - force begins to develop.
  • fast_forward00:47:58 - And that was just something we found from actually doing the stimulation.
  • fast_forward00:48:02 - Now you look in the animal or you look on the muscle and you look at its activation
  • fast_forward00:48:06 - pattern, and lo and behold, When protraction is occurring, it goes on very intensely
  • fast_forward00:48:12 - above that frequency for that period of time at least.
  • fast_forward00:48:15 - And what we also showed was that if you increase the duration of the activation,
  • fast_forward00:48:20 - you can increase the force the muscle generates.
  • fast_forward00:48:22 - It's very sensitive to that. So yeah, we are very sensitive to those issues
  • fast_forward00:48:27 - and our system is sensitive to those issues.
  • fast_forward00:48:29 - Right, but you do agree that that's sort of right now in the future, right?
  • fast_forward00:48:33 - To match these ideas about… Well, what I'm saying is that for this one particular
  • fast_forward00:48:36 - example, this one muscle and this particular set of interneurons,
  • fast_forward00:48:39 - we actually have done the matching and it matches well.
  • fast_forward00:48:41 - Right. So does that tell me that the rest of it matches? Of course not.
  • fast_forward00:48:45 - I take your point very strongly.
  • fast_forward00:48:46 - But what it does is it encourages me to say, hmm, we might really be on the right track.
  • fast_forward00:48:51 - Right. So would you claim that the plesia brain is also like a liquid state machine now?
  • fast_forward00:48:56 - No, I don't think I would.
  • fast_forward00:48:59 - Okay. Nor would I claim that it's a quantum computer. All right. Good. That's progress.
  • fast_forward00:49:08 - The last type of experiments that you were describing were these simulations
  • fast_forward00:49:12 - of, let's say, sort of a very hybrid kind of model.
  • fast_forward00:49:17 - Yes, the artificial insect. Exactly, yeah, different bits and pieces.
  • fast_forward00:49:20 - How many insects did you, or different species did you combine there?
  • fast_forward00:49:24 - We used probably five or six different stories that people had developed over
  • fast_forward00:49:28 - the years and put them together.
  • fast_forward00:49:30 - I mean, one of the things that was amusing to me, people had warned me about
  • fast_forward00:49:33 - this, but you can have 30 or 40 years of hard neurobiological work,
  • fast_forward00:49:37 - And one model can eat all that up in about a month or two. It's amazing.
  • fast_forward00:49:41 - It's so scary. And then the person's coming back to you and say,
  • fast_forward00:49:44 - well, what should we do here?
  • fast_forward00:49:45 - I said, well, they haven't done the measurements yet. So what am I supposed to do?
  • fast_forward00:49:49 - Now, Randy wasn't like that. He actually mastered the literature and he had good ideas himself.
  • fast_forward00:49:55 - But the parts of this that we were the least satisfied with were ones where
  • fast_forward00:49:59 - we had to actually make things up.
  • fast_forward00:50:03 - And to the extent that we could use dynamics and connectivity,
  • fast_forward00:50:07 - that actually emerged from the literature but had never been looked at this
  • fast_forward00:50:11 - way we were both much happier and it was very interesting because no one had
  • fast_forward00:50:15 - to at the time we did this try to actually number one take all these different
  • fast_forward00:50:20 - things and put them into a model but number two try to create an entire functioning.
  • fast_forward00:50:26 - Agent that could actually get around and do stuff I mean this is quite some
  • fast_forward00:50:31 - time back already Yeah, we did this in the late 80s, and that review article
  • fast_forward00:50:35 - that came out in American Scientist was in 1990.
  • fast_forward00:50:38 - Right. So this was quite a while. So Rodney Brooks was at that time just starting
  • fast_forward00:50:43 - to do some of his interesting work.
  • fast_forward00:50:44 - And it was very interesting to me because I think he was reasonably successful
  • fast_forward00:50:48 - when he was down to the level of doing these, you know, Genghis and these other robotic insects.
  • fast_forward00:50:55 - When he went up to cog and things like that, the progress slowed down very substantially.
  • fast_forward00:50:59 - Absolutely. No, this is clear.
  • fast_forward00:51:03 - But then, so also there, so earlier we discussed the issue of validation and
  • fast_forward00:51:08 - let's say the neuronal level.
  • fast_forward00:51:09 - And then with these experiments, we had to make this issue of validation of the behavioral level.
  • fast_forward00:51:13 - Yes. Because at what point, when can you really say, look, behaviorally this is valid, right?
  • fast_forward00:51:17 - Is it all about, okay, as long as it survives my simulated environment,
  • fast_forward00:51:21 - or should we look at very, let's say, as long as it displays the same behavioral
  • fast_forward00:51:25 - patterns I would observe in the animal on these conditions?
  • fast_forward00:51:27 - This goes back, and again, at the beginning, very beginning of my talk,
  • fast_forward00:51:30 - I talked a little bit about the role that modeling plays.
  • fast_forward00:51:33 - And I didn't specify this, but let me sort of clarify this because it's something
  • fast_forward00:51:37 - I've given a lot of thought to, and I like that question very, very much.
  • fast_forward00:51:40 - There are two really different ways of thinking about what a model or a theory can do.
  • fast_forward00:51:46 - One is a quantitative predictor of what an actual system will do next.
  • fast_forward00:51:52 - And the other is almost a kind of applied philosophical exploration of the space of possibilities.
  • fast_forward00:51:59 - Those are often much less respected, but they can be very important because
  • fast_forward00:52:04 - they can say, look, we didn't even realize that you could create from these
  • fast_forward00:52:09 - various ideas that are out in the literature,
  • fast_forward00:52:11 - a device that could actually survive in this very simplified environment for
  • fast_forward00:52:15 - an extended period of time, that already changes how people couple with the process of modeling.
  • fast_forward00:52:22 - That gets people who would ordinarily scoff and say, models,
  • fast_forward00:52:25 - waste of time, to say, wow, you could really do that?
  • fast_forward00:52:30 - I would love to do something like that. And then my immediate response when
  • fast_forward00:52:34 - someone comes to me and does that is your question.
  • fast_forward00:52:37 - What is your question? What do you want to do with it?
  • fast_forward00:52:40 - Are you interested in trying to capture a behavioral phenomenon here?
  • fast_forward00:52:44 - Are you interested in a level crossing model? You want to test that some underlying
  • fast_forward00:52:48 - mechanism actually generates the macroscopic thing you're seeing?
  • fast_forward00:52:52 - Or are you actually trying to make a very quantitative prediction?
  • fast_forward00:52:54 - Or are you just an engineer who would like to take some key ideas from biology
  • fast_forward00:52:58 - and run with them and make it into a methodology that may no longer have made
  • fast_forward00:53:02 - contact with the biology, but could be used in a general way? What's your interest?
  • fast_forward00:53:07 - That's the next question. And then the validation, and I gave you a little bit
  • fast_forward00:53:11 - of this, comes from how useful is it for those particular very different applications?
  • fast_forward00:53:16 - So for an engineer, to the extent that, I mean, as a neuroscientist,
  • fast_forward00:53:21 - I think that feed forward neural networks with backprop is a pathetic caricature
  • fast_forward00:53:25 - of the complexity and the richness of the dynamics of real nervous systems,
  • fast_forward00:53:29 - but as a way of generating interesting mappings,
  • fast_forward00:53:32 - it's fascinating.
  • fast_forward00:53:34 - If, on the other hand, vector array machines can do just as good a job or faster,
  • fast_forward00:53:38 - then they're going to take over. And I have no problems with that.
  • fast_forward00:53:41 - But then if I say, well, understanding the nervous system isn't that useful,
  • fast_forward00:53:44 - see what happened with neural networks.
  • fast_forward00:53:46 - I say, well, that was because the engineers took the part that they could actually
  • fast_forward00:53:51 - controllably work with and claim that that was the whole thing.
  • fast_forward00:53:55 - And if it wasn't, then maybe they missed some of the parts that matter, like the dynamic.
  • fast_forward00:54:00 - Right. But the two issues you highlighted here is on the one hand to be able
  • fast_forward00:54:06 - to predict for the system itself what it would do next in a certain situation. Right.
  • fast_forward00:54:11 - But what you seem to exclude in that summary is to predict back into the empirical domain.
  • fast_forward00:54:17 - So are you excluding this? No, not at all. Not at all. Because again,
  • fast_forward00:54:20 - I talked a little bit about level crossing models before you came,
  • fast_forward00:54:23 - and I want to emphasize this.
  • fast_forward00:54:25 - And I showed that again when I showed in the Eplizy example.
  • fast_forward00:54:29 - We had this hypothesis about how this muscle could do essentially two different
  • fast_forward00:54:34 - things, push the grasper forward or backwards.
  • fast_forward00:54:36 - And building a physical instantiation said, yes, it could.
  • fast_forward00:54:39 - It didn't prove it, but it said, yes, it could. Moreover, it said,
  • fast_forward00:54:43 - if that's true, it might have to be activated.
  • fast_forward00:54:46 - Again, there was this sequence of activations that we had to use.
  • fast_forward00:54:50 - That suggested something for what you might see in the animal,
  • fast_forward00:54:54 - which could be tested. it.
  • fast_forward00:54:55 - And in fact, we've been spending time looking at the different domains.
  • fast_forward00:54:59 - It turns out that jaw muscle actually has different domains,
  • fast_forward00:55:01 - and there are different motor neurons addressed to the different domains,
  • fast_forward00:55:04 - anterior and posterior, and their activation patterns change in time depending
  • fast_forward00:55:09 - on what behavior the animal's doing.
  • fast_forward00:55:11 - So some of the things that the robot was doing was actually suggesting something
  • fast_forward00:55:15 - about what you might see at this broad level if you actually look carefully
  • fast_forward00:55:19 - at the biological system.
  • fast_forward00:55:23 - So I love when that happens, and I'm very much aware that that has to happen
  • fast_forward00:55:27 - for it to validate it as useful for the biology.
  • fast_forward00:55:30 - Okay. But then for the different models you described, which of these comes
  • fast_forward00:55:35 - the closest to actually satisfying all these different levels of constraints?
  • fast_forward00:55:39 - Well, I think the argument I was making about stable heteroclinic channels and
  • fast_forward00:55:43 - the possibility of mapping that onto neural architectures.
  • fast_forward00:55:47 - The reason I'm so excited about that, of course, is we haven't done all the
  • fast_forward00:55:50 - hard tests. So I can pretend in my mind that it all works.
  • fast_forward00:55:54 - But my sense is that that could actually be a way of breaking open these problems,
  • fast_forward00:55:59 - and especially in systems where you are trying to generate a stable pattern
  • fast_forward00:56:04 - of activation of some number of elements.
  • fast_forward00:56:07 - Because, again, the low-pass filtering of the periphery is an enormous opportunity to simplify.
  • fast_forward00:56:13 - Amplify, because what it means is that really, really fast transition changes
  • fast_forward00:56:17 - are going to all be filtered out, so that you're going to have to maintain state
  • fast_forward00:56:21 - in the nervous system for long enough for that message to get out and have an
  • fast_forward00:56:25 - impact on the periphery.
  • fast_forward00:56:27 - And that means that some neurons are going to go into saturation,
  • fast_forward00:56:29 - others are going to be off, and that's going to happen for hundreds of milliseconds.
  • fast_forward00:56:34 - So that then means that you can define, it's a little artificial,
  • fast_forward00:56:38 - but you can define stable patterns
  • fast_forward00:56:39 - in the nervous system and look for the mechanisms that generate them.
  • fast_forward00:56:43 - And that's the thing that we would then be looking for. And that would be corresponding
  • fast_forward00:56:46 - to these various attractors that we've talked about.
  • fast_forward00:56:49 - So that's, I think, kind of exciting. Yes, absolutely.
  • fast_forward00:56:52 - So in the end, when you also try to make this step towards engineering,
  • fast_forward00:56:59 - you highlighted four principles that you felt, look, if you want to talk about biomimetic,
  • fast_forward00:57:04 - engineering or biologically based engineering, then what you have to think about
  • fast_forward00:57:09 - is evolution, learning, development, and initial condition. Yes.
  • fast_forward00:57:12 - Right. So why are these now the four key principles you would like to generalize into engineering?
  • fast_forward00:57:17 - All right. So let me go through them. And that's a wonderful question.
  • fast_forward00:57:23 - Engineering, design.
  • fast_forward00:57:25 - Um, and then there's manufacturing, then there's control, and then there's history.
  • fast_forward00:57:33 - I think those are the four things. So if we look at, uh, cars,
  • fast_forward00:57:38 - so there's a, in Cleveland, there's the auto aviation, uh, museum because Cleveland
  • fast_forward00:57:43 - was actually, people forget this, one of the birthplaces of various different
  • fast_forward00:57:46 - kinds of automobile companies. journeys.
  • fast_forward00:57:49 - And the initial version of cars is really a horseless buggy.
  • fast_forward00:57:56 - They look exactly like buggies did in the late 19th century,
  • fast_forward00:57:59 - and there's a motor in front. And that's what they look like.
  • fast_forward00:58:02 - They don't look at all like what we think of as cars.
  • fast_forward00:58:04 - It took some time for people to free themselves from that.
  • fast_forward00:58:08 - Now, to some extent, engineers, because of the desire to create disruptive technologies
  • fast_forward00:58:14 - are very into this idea of coming up with something completely new.
  • fast_forward00:58:18 - So one of the things you're doing to take notes is an iPad, which I think is
  • fast_forward00:58:23 - a beautiful example of disruptive technology.
  • fast_forward00:58:25 - People had come up with various tablet architectures and none of them had this
  • fast_forward00:58:29 - sort of seamless integration and this way of doing media and this way of really
  • fast_forward00:58:34 - just beautifully, elegantly putting all the different things together.
  • fast_forward00:58:37 - And so this is displacing and it's defining a whole new market.
  • fast_forward00:58:41 - So there's an enormous press for that in engineering.
  • fast_forward00:58:44 - In biological systems, history matters a great deal, because as I said,
  • fast_forward00:58:49 - when an organism is born, it has to be up and running instantly.
  • fast_forward00:58:53 - And so initial conditions become absolutely crucial.
  • fast_forward00:58:57 - If you start off with an organism that more or less has to be programmed from
  • fast_forward00:59:01 - birth in very complex ways,
  • fast_forward00:59:03 - then you had better build around it a social structure that allows it to be
  • fast_forward00:59:07 - taken care of in its helpless state for years and years until it finally is
  • fast_forward00:59:13 - released into the world.
  • fast_forward00:59:14 - Human infants fall into that category. But if you're an insect,
  • fast_forward00:59:19 - you don't have that luxury. You get up out of the egg and you walk away.
  • fast_forward00:59:23 - And when you molt, you go someplace, you're still for a while,
  • fast_forward00:59:26 - and then you discard your old body and walk away from it and immediately start doing things.
  • fast_forward00:59:31 - You don't have the luxury to relearn how to do various things. It just has to work.
  • fast_forward00:59:37 - Okay? So that's why it's stressed initial conditions. And that initial conditions
  • fast_forward00:59:41 - also, I wanted to, that really dovetails with all the other things.
  • fast_forward00:59:45 - What the tendency among engineers, and I completely understand that having done
  • fast_forward00:59:49 - some engineering myself, you want to come up with this really brilliant idea.
  • fast_forward00:59:52 - And then you want it to be a design principle.
  • fast_forward00:59:54 - And so you have your hammer and everything is going to be a nail, okay?
  • fast_forward00:59:59 - So if you are a control theorist, then everything is going to put in the rubric
  • fast_forward01:00:03 - of control theory. If you're an information theorist, everything can be stated
  • fast_forward01:00:06 - in terms of information theory.
  • fast_forward01:00:07 - If you realize the power of Kalman filters, then everything is going to be done
  • fast_forward01:00:12 - using a Kalman filter, et cetera, et cetera, et cetera.
  • fast_forward01:00:14 - But biological systems, the initial conditions is just an example of how much history matters.
  • fast_forward01:00:22 - Evolution, which is not a design process of the sort that engineers are used
  • fast_forward01:00:26 - to, is one that builds on what already exists.
  • fast_forward01:00:30 - It's canalized by all the things that have happened beforehand.
  • fast_forward01:00:34 - And it basically is a proof of principle system for design.
  • fast_forward01:00:39 - If you leave offspring, you're good.
  • fast_forward01:00:42 - And if you don't, you disappear from the gene pool and you become extinct and that doesn't work.
  • fast_forward01:00:46 - And it doesn't mean that there was anything wrong. Many of the solutions that
  • fast_forward01:00:49 - dinosaurs came up with, if we had a way of recreating a dinosaur,
  • fast_forward01:00:53 - we might find the things that they're actually much better at than organisms
  • fast_forward01:00:56 - that live in our world now.
  • fast_forward01:00:59 - It wasn't a statement that they were somehow inadequate.
  • fast_forward01:01:02 - Changes in their environment at that time were ones they couldn't tolerate,
  • fast_forward01:01:05 - so they went extinct. And that could happen to us just as easily as it happened to the dinosaurs.
  • fast_forward01:01:09 - But engineers might say that actually right now in their practice already,
  • fast_forward01:01:15 - they have included things like learning and initial conditions.
  • fast_forward01:01:18 - Yes, they've started to. But the realities are that the way they do it is very
  • fast_forward01:01:23 - different from the way that biology still does, largely.
  • fast_forward01:01:26 - And again, this goes back to when I talked earlier about the wiring up of the
  • fast_forward01:01:31 - nervous system, the early nervous system.
  • fast_forward01:01:34 - So what happens? So you have, over evolutionary time, you have a genetic code
  • fast_forward01:01:38 - that then gives rise to an exponentially
  • fast_forward01:01:41 - cascading process that takes one fertilized cell into, I mentioned,
  • fast_forward01:01:47 - trillions of cells that are precisely organized.
  • fast_forward01:01:50 - Organized, and the plasticity that allowed the development to unfold because
  • fast_forward01:01:53 - there are all these local rules that allow the system to wire itself up,
  • fast_forward01:01:57 - their gradients, their local cues.
  • fast_forward01:01:59 - And so this whole system is not based on some central organizer that looks from
  • fast_forward01:02:04 - the top and says, you go over here and you go over there.
  • fast_forward01:02:06 - The system is building these cues as it's unfolding and generating new cues
  • fast_forward01:02:12 - that help the next stage of unfold.
  • fast_forward01:02:14 - It's really amazing. And people have really not wrapped their minds around it,
  • fast_forward01:02:18 - either in biology fully or in modeling or in engineering.
  • fast_forward01:02:22 - And I see that as a total frontier that we could do amazing things with.
  • fast_forward01:02:25 - And that's also to which you apply, let's say, your Swiss army knife metaphor, right?
  • fast_forward01:02:30 - Precisely. What we would do, and I have no complaints about this.
  • fast_forward01:02:33 - I write code because I program, and I loved it. I mean, it's enormous fun.
  • fast_forward01:02:37 - You are the god of your own world. You can make anything happen.
  • fast_forward01:02:41 - But if you're a good coder, you are trained or you learn very quickly.
  • fast_forward01:02:45 - You don't want self-modifying code.
  • fast_forward01:02:47 - That's a bad thing. And you don't want to use other people's old code because you can't figure it out.
  • fast_forward01:02:51 - And you want to make it modular and you want to give functions that have well-defined
  • fast_forward01:02:55 - functionalities. You want to have clean interfaces.
  • fast_forward01:02:57 - I mean, the Unix operating system, the pipes, forks, setting up processes,
  • fast_forward01:03:03 - killing the processes, it's beautiful.
  • fast_forward01:03:07 - It's beautiful. So again, I actually, unlike many biologists,
  • fast_forward01:03:11 - I have immersed myself in how
  • fast_forward01:03:13 - engineers do things, and I've built and used those tools, and I love them.
  • fast_forward01:03:17 - But when I look at the biological systems, I don't see anything like that going on inside.
  • fast_forward01:03:21 - And so what that tells me is, wait, if I really want to do this,
  • fast_forward01:03:26 - certainly a digital computer can emulate anything, but the architecture is so
  • fast_forward01:03:31 - different that it's not going to fall naturally on it.
  • fast_forward01:03:33 - And I'm going to be fighting with it, and I'm going to run into all these computational
  • fast_forward01:03:37 - bottlenecks because I don't even have an architecture that's massively parallel,
  • fast_forward01:03:41 - asynchronous, and even though it's much slower, can do all of this stuff just
  • fast_forward01:03:46 - naturally. And that's what I have in the nervous system.
  • fast_forward01:03:48 - So what's been fun for me, but it's also sometimes frustrating working with
  • fast_forward01:03:52 - engineers, is trying to open their eyes to the fact that really there is this
  • fast_forward01:03:58 - other technology and there's another way of thinking about it.
  • fast_forward01:04:01 - So why engineers do what they do is something that completely makes sense to
  • fast_forward01:04:05 - me, and I don't want to encourage them not to do that.
  • fast_forward01:04:07 - I want them to explore, take forays into, be willing to take risks,
  • fast_forward01:04:11 - and try thinking about things really in a different way.
  • fast_forward01:04:15 - And that's where immersing yourself in the biology and spending time with someone
  • fast_forward01:04:19 - who, like myself, really cares about talking to engineers, knows math,
  • fast_forward01:04:24 - actually enjoys these kinds of conversations, is a valuable exercise. size.
  • fast_forward01:04:28 - One of the things I've done in the past with other engineers have approached me.
  • fast_forward01:04:32 - So I will sit down with, for example, molecular biology of the cell and work
  • fast_forward01:04:35 - through the chapter on development with someone who is interested in that.
  • fast_forward01:04:39 - And it blows their mind. But having a guide, it really is like, you know...
  • fast_forward01:04:44 - I think of the Aeneid. You really need to have your Virgil. You need to have
  • fast_forward01:04:47 - someone with a lamp guiding you through all the acronyms and all this sort of stuff.
  • fast_forward01:04:52 - Okay. Excellent. Without that, it becomes almost impossible to understand what's going on.
  • fast_forward01:04:58 - So now to get to the finish line. Yes. Two questions.
  • fast_forward01:05:02 - So if I now want to exercise this sort of Bernstein invariance of motor control,
  • fast_forward01:05:07 - I'm painting the wall of the campus here.
  • fast_forward01:05:10 - There's one law that we should apply to a biometric understanding of biology and technology.
  • fast_forward01:05:18 - So this is the Hillel-Cheels law. Right, right. What's the one law?
  • fast_forward01:05:24 - Must have got it right there. Pay attention to the biology. Okay.
  • fast_forward01:05:28 - Pay attention to biology. And then?
  • fast_forward01:05:31 - But I would say to the biology. That's the law for the engineers.
  • fast_forward01:05:35 - Right. And from the point of view for the biologists, I paint on the other wall. Yeah.
  • fast_forward01:05:40 - Um, focus on the principles because the difficulty you have when you come to
  • fast_forward01:05:47 - most standard biology talks, even I have difficulty with this because I think
  • fast_forward01:05:50 - differently than many biologists. I like math. I like abstraction.
  • fast_forward01:05:54 - I'm not focused about, you know, one detail after another. They just bury you in details.
  • fast_forward01:05:59 - They love the details. They can't get enough of the details.
  • fast_forward01:06:02 - So you're sitting there going, they've got all these names, and they've got
  • fast_forward01:06:05 - all these structures, and they have all these details. What matters, please?
  • fast_forward01:06:10 - And the answer is, part of the reason it's so difficult to answer that is they
  • fast_forward01:06:13 - don't know for sure because it may depend on context.
  • fast_forward01:06:16 - But if you're focused on trying to articulate principles, if you think about
  • fast_forward01:06:21 - the principles as a biologist, and if you pay attention to the biology as an
  • fast_forward01:06:25 - engineer, I think you could make enormous advances in the next decade.
  • fast_forward01:06:29 - Decade or two. Okay, but now if I have less patients in a whole decade and I
  • fast_forward01:06:34 - want to go visit you five years from now.
  • fast_forward01:06:36 - Yes. And I want to say, okay, in 2011, you made this one prediction.
  • fast_forward01:06:41 - Today I'm checking whether it actually came out or not. Right,
  • fast_forward01:06:43 - right, right. What's this one prediction that you're most enthusiastic about today?
  • fast_forward01:06:47 - I would go with the stable heteroclinic channels as something that I hope within
  • fast_forward01:06:51 - five years we have some more evidence that they might be relevant to how the system works.
  • fast_forward01:06:56 - That would be the one I would go for in terms of my personal work.
  • fast_forward01:06:59 - Because that's something I have control over and I see the experiments I would do.
  • fast_forward01:07:03 - In terms of fields as a whole, there I have less, I'm less sanguine.
  • fast_forward01:07:08 - There are rare places where people are trying to get biologists to actually
  • fast_forward01:07:13 - do good biology, to talk to engineers who do good engineering.
  • fast_forward01:07:16 - There are a few places. I would hope in five years a few of them have had some
  • fast_forward01:07:20 - hits and have gotten other groups to say, oh, wait, you mean a collaboration
  • fast_forward01:07:25 - between a biologist and engineer is not just that we get money together,
  • fast_forward01:07:28 - we talk once every six months or a year, and then we get more money together?
  • fast_forward01:07:33 - You mean we actually have to talk to each other on a daily basis?
  • fast_forward01:07:36 - And I would like to see more of that happening, because if we saw more of that
  • fast_forward01:07:39 - happening, some of the things I was pointing to, like focusing on development,
  • fast_forward01:07:43 - like trying to come up with plasticity that affects global dynamics,
  • fast_forward01:07:48 - really, that's going to take an interdisciplinary, cross-disciplinary effort.
  • fast_forward01:07:52 - It's going to take the minds, the best minds of people who really are working.
  • fast_forward01:07:57 - They're in the trenches, in the biological systems, and they're in the trenches
  • fast_forward01:08:01 - building engineered systems, really working together and coming back and forth with each other.
  • fast_forward01:08:07 - And again, I've been doing this for years with different colleagues,
  • fast_forward01:08:09 - and it's been enormous fun. But it's the reason I've accomplished what I've accomplished.
  • fast_forward01:08:14 - That constant willingness to go out of your immediate comfort area and to start
  • fast_forward01:08:18 - to talk someone else's language and to see the world through their eyes and
  • fast_forward01:08:22 - to recognize that that's the way you have to try to take what you're learning
  • fast_forward01:08:26 - and help them see it that way.
  • fast_forward01:08:28 - That's, I think, where the most productive things are going to happen over the
  • fast_forward01:08:31 - next five years. Excellent.
  • fast_forward01:08:32 - So, Lucille, Chiel, thank you very much for this conversation.
  • fast_forward01:08:35 - It's a pleasure. Pleasure. Thank you. Sure.
  • fast_forward01:08:40 - The CSN Podcast was produced by the Convergent Science Network of Biometrics
  • fast_forward01:08:45 - and Biohybrid Systems, a project funded by the European Sevens Research Framework Program.
  • fast_forward01:08:53 - For more interviews, recorded lectures, or upcoming conferences in the field
  • fast_forward01:08:59 - of biometrics and biohybrid systems, go to csnnetwork.eu.
  • fast_forward01:09:06 - And thank you for listening.
  • fast_forward01:09:06 - Music.

Be the first to leave a comment

Leave a comment

Your email address will not be published. Required fields are marked *

Convergent PozitivLinia Logo

Exploring the convergence of neuroscience, robotics, and AI through conversations with leading researchers since 2010.

A project of the Convergent Science Network Foundation.

© CSN Podcasts. Developed by IMCreativeWEBC

0%

Login to enjoy full advantages

Please login or subscribe to continue.

Go Premium!

Enjoy the full advantage of the premium access.

Stop following

Unfollow Cancel

Cancel subscription

Are you sure you want to cancel your subscription? You will lose your Premium access and stored playlists.

Go back Confirm cancellation