Control for multifunctionality: bioinspired control based on feeding in Aplysia californica

Aggarwal S, Chugh N (2019) Signal processing techniques for motor imagery brain computer interface: a review. Array 1–2(January):100003. https://doi.org/10.1016/j.array.2019.100003 Ayers J (1995) A reactive ambulatory robot architecture for operation in current and surge. In: Autonomous vehicles in mine countermeasures symposium, April 1995, pp 1–14. http://www.neurotechnology.neu.edu/nps95mcmmanuscript.html Ayers J (2002) A conservative biomimetic control architecture for autonomous underwater robots. Neurotechnol Biomimetic Robots. https://doi.org/10.7551/mitpress/4962.003.0019 Ayers JL, Davis WJ (1977) Neuronal control of locomotion in the lobster Homarus americanus. J Comp Physiol A 115(1):29–46. https://doi.org/10.1007/bf00667783 Bässler U (1988) Functional principles of pattern generation for walking movements of stick insect forelegs: the role of the femoral chordotonal organ afferences. J Exp Biol 136(1):125–147 Bazenkov NI, Boldyshev BA, Dyakonova V, Kuznetsov OP (2020) Simulating small neural circuits with a discrete computational model. Biol Cybern. https://doi.org/10.1007/s00422-020-00826-w Beck JM, Pouget A (2007) Exact inferences in a neural implementation of a hidden Markov model. Neural Comput 19(5):1344–1361. https://doi.org/10.1162/neco.2007.19.5.1344 Beer RD, Chiel HJ (1999) Gallagher JC Evolution and analysis of model CPGs for walking: II. General principles and individual variability. J Comput Neurosci 7(2):119–147. https://doi.org/10.1023/A:1008920021246 Beer RD, Chiel HJ, Quinn RD, Espenschied KS (1992) A distributed neural network architecture for hexapod robot locomotion. Neural Comput 4(3):356–365 Beer RD, Chiel HJ, Sterling LS (1990) A biological perspective on autonomous agent design. Robot Autonom Syst 6(1):169–186. https://doi.org/10.1016/S0921-8890(05)80034-X Bicanski A, Ryczko D, Knuesel J, Harischandra N, Charrier V, Ekeberg Ö, Cabelguen JM, Ijspeert AJ (2013) Decoding the mechanisms of gait generation in salamanders by combining neurobiology, modeling and robotics. Biol Cybern 107(5):545–564. https://doi.org/10.1007/s00422-012-0543-1 Bidaye SS, Laturney M, Chang AK, Liu Y, Bockemühl T, Büschges A, Scott K (2020) Two brain pathways initiate distinct forward walking programs in drosophila. Neuron. https://doi.org/10.1016/j.neuron.2020.07.032 Blümel M, Guschlbauer C, Daun-Gruhn S, Hooper SL, Büschges A (2012) Hill-type muscle model parameters determined from experiments on single muscles show large animal-to-animal variation. Biol Cybern 106(10):559–571 Blümel M, Guschlbauer C, Hooper SL, Büschges A (2012) Using individual-muscle specific instead of across-muscle mean data halves muscle simulation error. Biol Cybern 106(10):573–585 Blümel M, Hooper SL, Guschlbauerc C, White WE, Büschges A (2012) Determining all parameters necessary to build Hill-type muscle models from experiments on single muscles. Biol Cybern 106(10):543–558 Brosch T, Neumann H (2014) Interaction of feedforward and feedback streams in visual cortex in a firing-rate model of columnar computations. Neural Netw 54:11–16. https://doi.org/10.1016/j.neunet.2014.02.005 Brown JW, Caetano-Anollés D, Catanho M, Gribkova E, Ryckman N, Tian K, Voloshin M, Gillette R (2018) Implementing goal-directed foraging decisions of a simpler nervous system in simulation. eNeuro 5(1):1–10. https://doi.org/10.1523/ENEURO.0400-17.2018 Büschges A (2005) Sensory control and organization of neural networks mediating coordination of multisegmental organs for locomotion. J Neurophysiol 93(3):1127–1135. https://doi.org/10.1152/jn.00615.2004 Büschges A, Akay T, Gabriel JP, Schmidt J (2008) Organizing network action for locomotion: insights from studying insect walking. Brain Res Rev 57(1):162–171 Cappellini G, Ivanenko YP, Poppele RE, Lacquaniti F (2006) Motor patterns in human walking and running. J Neurophysiol 95(6):3426–3437. https://doi.org/10.1152/jn.00081.2006 Cash D, Carew TJ (1989) A quantitative analysis of the development of the central nervous system in juvenile Aplysia californica. J Neurobiol 20(1):25–47. https://doi.org/10.1002/neu.480200104 Cataldo E, Byrne JH, Baxter DA (2006) Computational model of a central pattern generator. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 4210 LNBI, 242–256. https://doi.org/10.1007/11885191_17 Chiel HJ, Beer RD (1997) The brain has a body: adaptive behavior emerges from interactions of nervous system, body and environment. Trends Neurosci 20(12):553–557. https://doi.org/10.1016/S0166-2236(97)01149-1 Chiel HJ, Beer RD, Gallagher JC (1999) Evolution and analysis of model CPGs for walking: I. Dynamical modules. J Comput Neurosci 7(2):99–118. https://doi.org/10.1023/A:1008920021246 Chiel HJ, Crago P, Mansour JM, Hathi K (1992) Biomechanics of a muscular hydrostat: a model of lapping by a reptilian tongue. Biol Cybern 67(5):403–415. https://doi.org/10.1007/BF00200984 Chiel HJ, Kupfermann I, Weiss KR (1988) An identified histaminergic neuron can modulate the outputs of buccal–cerebral interneurons in Aplysia via presynaptic inhibition. J Neurosci 8(January):49–63 Chiel HJ, Ting LH, Ekeberg Ö, Hartmann MJ (2009) The brain in its body: motor control and sensing in a biomechanical context. J Neurosci 29(41):12807–12814. https://doi.org/10.1523/JNEUROSCI.3338-09.2009 Chiel HJ, Weiss KR, Kupfermann I (1986) An identified histaminergic neuron modulates feeding motor circuitry in Aplysia. J Neurosci 6(8):2427–2450. https://doi.org/10.1523/jneurosci.06-08-02427.1986 Church PJ, Lloyd PE (1994) Activity of multiple identified motor neurons recorded intracellularly during evoked feeding-like motor programs in Aplysia. J Neurophysiol 72(4):1794–1809. https://doi.org/10.1152/jn.1994.72.4.1794 Church PJ, Whim MD, Lloyd PE (1993) Modulation of neuromuscular transmission by conventional and peptide transmitters released from excitatory and inhibitory motor neurons in Aplysia. J Neurosci 13(7):2790–2800. https://doi.org/10.1523/jneurosci.13-07-02790.1993 Connor JA, Kretz R, Shapiro E (1986) Calcium levels measured in a presynaptic neurone of Aplysia under conditions that modulate transmitter release. J Physiol 375(1):625–642. https://doi.org/10.1113/jphysiol.1986.sp016137 Costa RM, Baxter DA, Byrne JH (2020) Computational model of the distributed representation of operant reward memory: combinatoric engagement of intrinsic and synaptic plasticity mechanisms. Learn Memory 27:236–249. https://doi.org/10.1101/lm.051367.120 Cropper EC, Jing J, Weiss KR (2019) The feeding network of Aplysia. In: The Oxford handbook of invertebrate neurobiology, December. Oxford University Press, pp 400–422. https://doi.org/10.1093/oxfordhb/9780190456757.013.19 Cullins MJ, Chiel HJ (2010) Electrode fabrication and implantation in Aplysia californica for multi-channel neural and muscular recordings in intact, freely behaving animals. J Vis Exp 40:e1791. https://doi.org/10.3791/1791 Cullins MJ, Gill JP, McManus JM, Lu H, Shaw KM, Chiel HJ (2015) Sensory feedback reduces individuality by increasing variability within subjects. Curr Biol 25(20):2672–2676. https://doi.org/10.1016/j.cub.2015.08.044 Cullins MJ, Shaw KM, Gill JP, Chiel HJ (2015) Motor neuronal activity varies least among individuals when it matters most for behavior. J Neurophysiol 113(3):981–1000. https://doi.org/10.1152/jn.00729.2014 Dallidis SE, Karafyllidis IG (2014) Boolean network model of the Pseudomonas aeruginosa quorum sensing circuits. IEEE Trans Nanobiosci 13(3):343–349. https://doi.org/10.1109/TNB.2014.2345439 Danner SM, Wilshin SD, Shevtsova NA, Rybak IA (2016) Central control of interlimb coordination and speed-dependent gait expression in quadrupeds. J Physiol 594(23):6947–6967. https://doi.org/10.1113/JP272787 De Jong H (2002) Modeling and simulation of genetic regulatory systems: a literature review. J Comput Biol 9(1):67–103. https://doi.org/10.1089/10665270252833208 Destexhe A, Sejnowski TJ (2009) The Wilson–Cowan model, 36 years later. Biol Cybern 101(1):1–2. https://doi.org/10.1007/s00422-009-0328-3 Drushel RF, Neustadter DM, Hurwitz I, Crago PE, Chiel HJ (1998) Kinematic models of the buccal mass of Aplysia californica. J Exp Biol 201(Pt 10):1563–83 Edwards R, Siegelmann HT, Aziza K, Glass L (2001) Symbolic dynamics and computation in model gene networks. Chaos 11(1):160–169. https://doi.org/10.1063/1.1336498 Eisenberg E, Hill TL, Chen Y (1980) Cross-bridge model of muscle contraction. Quantitative analysis. Biophys J 29(2):195–227. https://doi.org/10.1016/S0006-3495(80)85126-5 Ekeberg Ö (1993) A combined neuronal and mechanical model of fish swimming. Biol Cybern 69(5–6):363–374. https://doi.org/10.1007/bf00199436 Ekeberg Ö, Wallén P, Lansner A, Tråvén H, Brodin L, Grillner S (1991) A computer based model for realistic simulations of neural networks. Biol Cybern 65(2):81–90. https://doi.org/10.1007/bf00202382 Ermentrout B (2010) Neural networks as spatio-temporal pattern-forming systems. Rep Prog Phys 61(1998):353–430 Evans CG, Cropper EC (1998) Proprioceptive input to feeding motor programs in Aplysia. J Neurosci 18(19):8016–8031. https://doi.org/10.1523/jneurosci.18-19-08016.1998 Feng K, Sen R, Minegishi R, Dübbert M, Bockemühl T, Büschges A, Dickson BJ (2020)Distributed control of motor circuits for backward walking in drosophila. bioRxiv. https://doi.org/10.1101/2020.07.11.198663. https://www.biorxiv.org/content/early/2020/07/12/2020.07.11.198663 Gardner D (1977) Interconnections of identified multiaction interneurons in buccal ganglia of Aplysia. J Neurophysiol 40(2):349–361. https://doi.org/10.1152/jn.1977.40.2.349 Georgopoulos AP, Ashe J, Smyrnis N, Taira M (1992) The motor cortex and the coding of force. Science 256(5064):1692–1695. https://doi.org/10.1126/science.256.5064.1692 Georgopoulos AP, Kettner RE, Schwartz AB (1988) Primate motor cortex and free arm movements to visual targets in three-dimensional space. II. Coding of the direction of movement by a neuronal population. J Neurosci 8(8):2928–2937. https://doi.org/10.1523/jneurosci.08-08-02928.1988 Giacomantonio CE, Goodhill GJ (2010) A Boolean model of the gene regulatory network underlying mammalian cortical area development. PLoS Comput Biol. https://doi.org/10.1371/journal.pcbi.1000936 Gill JP, Chiel HJ (2020) Rapid adaptation to changing mechanical load by ordered recruitment of identified motor neurons. eNeuro. https://doi.org/10.1523/ENEURO.0016-20.2020 Gill JP, Garcia S, Ting LH, Wu M, Chiel HJ (2020) neurotic: neuroscience tool for interactive characterization. eNeuro. https://doi.org/10.1523/ENEURO.0085-20.2020 Gill JP, Vorster APA, Lyttle DN, Keller TA, Stork SC, Chiel HJ (2018) Neural correlates of adaptive responses to changing load in feeding Aplysia. Poster presented at Society for Neuroscience 48th Annual Meeting, San Diego, CA. https://www.abstractsonline.com/pp8/#!/4649/presentation/17445 Glaser JI, Chowdhury RH, Perich MG, Miller LE, Kording KP (2017) Machine learning for neural decoding. arXiv:1708.00909 Golowasch J, Goldman MS, Abbott LF, Marder E (2002) Failure of averaging in the construction of a conductance-based neuron model. J Neurophysiol 87(2):1129–1131. https://doi.org/10.1152/jn.00412.2001 Harischandra N, Cabelguen JM, Ekeberg Ö (2010) A 3D musculo-mechanical model of the salamander for the study of different gaits and modes of locomotion. Front Neurorobotics 4(DEC):1–10. https://doi.org/10.3389/fnbot.2010.00112 Harris SE, Sawhill BK, Wuensche A, Kauffman S (2002) A model of transcriptional regulatory networks based on biases in the observed regulation rules. Complexity 7(4):23–40. https://doi.org/10.1002/cplx.10022 Haselgrove JC, Huxley HE (1973) X-ray evidence for radial cross-bridge movement and for the sliding filament model in actively contracting skeletal muscle. J Mol Biol. https://doi.org/10.1016/0022-2836(73)90222-2 Hausknecht M, Stone P (2015) Deep recurrent q-learning for partially observable MDPS. AAAI Fall Symposium—Technical Report, FS-15-06, pp 29–37 Heuer H, Schmidt RA, Ghodsian D (1995) Generalized motor programs for rapid bimanual tasks: a two-level multiplicative-rate model. Biol Cybern 73(4):343–356. https://doi.org/10.1007/BF00199470 Hill A (1938) The heat of shortening and the dynamic constants of muscle. Proc R Soc Lond Ser B Biol Sci 126(843):136–195. https://doi.org/10.1098/rspb.1938.0050 Hodgkin A, Huxley A (1952) A quantitative description of membrane current and its application to conduction and excitation in nerve. J Physiol 117(4):500 Hooper SL, Guschlbauer C, von Uckermann G, Büschges A (2006) Natural neural output that produces highly variable locomotory movements. J Neurophysiol 96(4):2072–2088. https://doi.org/10.1152/jn.00366.2006 PMID: 16775206 Hooper SL, Guschlbauer C, von Uckermann G, Büschges A (2007) Different motor neuron spike patterns produce contractions with very similar rises in graded slow muscles. J Neurophysiol 97(2):1428–1444. https://doi.org/10.1152/jn.01014.2006 Horchler AD, Daltorio KA, Chiel HJ, Quinn RD (2015) Designing responsive pattern generators: stable heteroclinic channel cycles for modeling and control. Bioinspir Biomimetics 10(2):026001 Hosman T, Vilela M, Milstein D, Kelemen JN, Brandman DM, Hochberg LR, Simeral JD (2019) BCI decoder performance comparison of an LSTM recurrent neural network and a Kalman filter in retrospective simulation. In: International IEEE/EMBS conference on neural engineering, NER 2019-March, pp 1066–1071. https://doi.org/10.1109/NER.2019.8717140 Huang Z, Satterlie RA (1990) Neuronal mechanisms underlying behavioral switching in a Pteropod mollusc. J Comp Physiol A 166(6):875–887. https://doi.org/10.1007/BF00187335 Hunt A, Schmidt M, Fischer M, Quinn R (2015) A biologically based neural system coordinates the joints and legs of a tetrapod. Bioinspir Biomimetics. https://doi.org/10.1088/1748-3190/10/5/055004 Hunt A, Szczecinski N, Quinn R (2017) Development and training of a neural controller for hind leg walking in a dog robot. Front Neurorobotics 11(APR):1–16. https://doi.org/10.3389/fnbot.2017.00018 Hurwitz I, Goldstein RS, Susswein AJ (1994) Compartmentalization of pattern-initiation and motor functions in the b31 and b32 neurons of the buccal ganglia of Aplysia californica. J Neurophysiol 71(4):1514–27. https://doi.org/10.1152/jn.1994.71.4.1514 Hurwitz I, Susswein AJ (1992) Adaptation of feeding sequences in Aplysia oculifera to changes in the load and width of food. J Exp Biol 166(1):215–235 Hurwitz I, Susswein AJ (1996) B64, a newly identified central pattern generator element producing a phase switch from protraction to retraction in buccal motor programs of Aplysia californica. J Neurophysiol 75(4):1327–1344. https://doi.org/10.1152/jn.1996.75.4.1327 Ivashko DG, Prilutsky BI, Markin SN, Chapin JK, Rybak IA (2003) Modeling the spinal cord neural circuitry controlling cat hindlimb movement during locomotion. Neurocomputing 52:621–629 Izhikevich E (2003) Simple model of spiking neurons. IEEE Trans Neural Netw 14(6):1569–1572. https://doi.org/10.1109/TNN.2003.820440 Izhikevich EM (2000) Neural excitability, spiking and bursting. Int J Bifur Chaos 10(06):1171–1266. https://doi.org/10.1142/S0218127400000840 Jaques N, Gu S, Turner RE, Eck D (2017) Workshop track-ICLR 2017 tuning recurrent neural networks with re-inforcement learning. ICLR 2017:1–13 Jing J, Cropper EC, Hurwitz I, Weiss KR (2004) The construction of movement with behavior-specific and behavior-independent modules. J Neurosci 24(28):6315–6325. https://doi.org/10.1523/JNEUROSCI.0965-04.2004 Jing J, Cropper EC, Weiss KR (2017) Network functions of electrical coupling present in multiple and specific sites in behavior-generating circuits. Elsevier Inc., Amsterdam. https://doi.org/10.1016/B978-0-12-803471-2.00005-9 Jing J, Weiss KR (2001) Neural mechanisms of motor program switching in Aplysia. J Neurosci 21(18):7349–7362. https://doi.org/10.1523/jneurosci.21-18-07349.2001 Jing J, Weiss KR (2002) Interneuronal basis of the generation of related but distinct motor programs in Aplysia: implications for current neuronal models of vertebrate intralimb coordination. J Neurosci 22(14):6228–6238. https://doi.org/10.1523/jneurosci.22-14-06228.2002 Jing J, Weiss KR (2005) Generation of variants of a motor act in a modular and hierarchical motor network. Curr Biol 15(19):1712–1721. https://doi.org/10.1016/j.cub.2005.08.051 Kabotyanski EA, Baxter DA, Byrne JH (1998) Identification and characterization of catecholaminergic neuron B65, which initiates and modifies patterned activity in the buccal ganglia of Aplysia. J Neurophysiol 79(2):605–21. https://doi.org/10.1152/jn.1998.79.2.605 Kamali Sarvestani I, Kozlov A, Harischandra N, Grillner S, Ekeberg Ö (2013) A computational model of visually guided locomotion in lamprey. Biol Cybern 107(5):497–512. https://doi.org/10.1007/s00422-012-0524-4 Kandel E (1976) Cellular basis of behavior: an introduction to behavioral neurobiology. Books in psychology. W. H. Freeman, San Francisco Katzoff A, Ben-Gedalya T, Hurwitz I, Miller N, Susswein YZ, Susswein AJ (2006) Nitric oxide signals that Aplysia have attempted to eat, a necessary component of memory formation after learning that food is inedible. J Neurophysiol 96(3):1247–1257. https://doi.org/10.1152/jn.00056.2006 PMID: 16738221 Kauffman SA (1993) The origins of order: self-organization and selection in evolution. Oxford University Press, Oxford Koch C, Segev I et al (1998) Methods in neuronal modeling: from ions to networks. MIT Press, Cambridge Koehl MA (2006) Wave-swept shore: the rigors of life on a rocky coast. University of California Press, California Kuo AD (2002) The relative roles of feedforward and feedback in the control of rhythmic movements. Mot Control 6(2):129–145 Kupfermann I (1974) Feeding behavior in Aplysia: a simple system for the study of motivation. Behav Biol 10(1):1–26. https://doi.org/10.1016/S0091-6773(74)91644-7 Latash M (1999) Progress in motor control: Bernstein’s traditions in movement studies. J Athletic Training 34(3):1999 Li L, Van Den Bogert EC, Caldwell GE, Van Emmerik RE, Hamill J (1999) Coordination patterns of walking and running at similar speed and stride frequency. Hum Mov Sci 18(1):67–85. https://doi.org/10.1016/S0167-9457(98)00034-7 Lu CW, Patil PG, Chestek CA (2012) Chapter seven—current challenges to the clinical translation of brain machine interface technology. In: Hamani C, Moro E (eds) Emerging horizons in neuromodulation, International Review of Neurobiology, vol 107. Academic Press, New York, pp 137–160. https://doi.org/10.1016/B978-0-12-404706-8.00008-5 Lu H, McManus JM, Chiel HJ (2013) Extracellularly identifying motor neurons for a muscle motor pool in Aplysia californica. J Vis Exp 73:e50189. https://doi.org/10.3791/50189 Lyttle DN, Gill JP, Shaw KM, Thomas PJ, Chiel HJ (2017) Robustness, flexibility, and sensitivity in a multifunctional motor control model. Biol Cybern 111(1):25–47. https://doi.org/10.1007/s00422-016-0704-8 Mann RA, Hagy J (1980) Biomechanics of walking, running, and sprinting. Am J Sports Med 8(5):345–350. https://doi.org/10.1177/036354658000800510 Mantziaris C, Bockemühl T, Büschges A (2020) Central pattern generating networks in insect locomotion. Dev Neurobiol Marder E, Taylor AL (2011) Multiple models to capture the variability in biological neurons and networks. Nat Neurosci 14(2):133–138 Markin SN, Klishko AN, Shevtsova NA, Lemay MA, Prilutsky BI, Rybak IA (2016) A neuromechanical model of spinal control of locomotion. In: Prilutsky, Boris I., Edwards, Donald H. (Eds.) Neuromechanical modeling of posture and locomotion. Springer, Berlin, pp 21–65 McCulloch WS, Pitts W (1943) A logical calculus of the ideas immanent in nervous activity. Bull Math Biophys 5(4):115–133. https://doi.org/10.1007/BF02478259 McManus JM, Lu H, Chiel HJ (2012) An in vitro preparation for eliciting and recording feeding motor programs with physiological movements in Aplysia californica. JoVE J Vis Exp 70:e4320 McManus JM, Lu H, Cullins MJ, Chiel HJ (2014) Differential activation of an identified motor neuron and neuromodulation provide Aplysia’s retractor muscle an additional function. J Neurophysiol 112(4):778–791 Mihalaş S, Niebur E (2009) A generalized linear integrate-and-fire neural model produces diverse spiking behaviors. Neural Comput 21(3):704–718. https://doi.org/10.1162/neco.2008.12-07-680 Molkov YI, Bacak BJ, Talpalar AE, Rybak IA (2015) Mechanisms of left-right coordination in mammalian locomotor pattern generation circuits: a mathematical modeling view. PLoS Comput Biol 11(5):e1004270 Morgan PT, Jing J, Vilim FS, Weiss KR (2002) Interneuronal and peptidergic control of motor pattern switching in Aplysia. J Neurophysiol 87(1):49–61. https://doi.org/10.1152/jn.00438.2001 Moritani T, Oddsson L, Thorstensson A (1991) Phase-dependent preferential activation of the soleus and gastrocnemius muscles during hopping in humans. J Electromyogr Kinesiol 1(1):34–40. https://doi.org/10.1016/1050-6411(91)90024-Y Morton D, Chiel H (1994) Neural architectures for adaptive behavior. Trends Neurosci 17(10):413–420. https://doi.org/10.1016/0166-2236(94)90015-9 Morton DW, Chiel HJ (1993) In vivo buccal nerve activity that distinguishes ingestion from rejection can be used to predict behavioral transitions in Aplysia. J Comp Physiol A Sens Neural Behav Physiol 172(1):17–32. https://doi.org/10.1007/bf00214712 Morton DW, Chiel HJ (1993) The timing of activity in motor neurons that produce radula movements distinguishes ingestion from rejection in Aplysia. J Comp Physiol A 173(5):519–536. https://doi.org/10.1007/BF00197761 Mulgaonkar Y, Araki B, Koh JS, Guerrero-Bonilla L, Aukes DM, Makineni A, Tolley MT, Rus D, Wood RJ, Kumar V (2016) The flying monkey: A mesoscale robot that can run, fly, and grasp. In: Proceedings—IEEE international conference on robotics and automation, 2016-June, pp 4672–4679. https://doi.org/10.1109/ICRA.2016.7487667 Neustadter DM, Drushel RF, Crago PE, Adams BW, Chiel HJ (2002) A kinematic model of swallowing in Aplysia californica based on radula/odontophore kinematics and in vivo magnetic resonance images. J Exp Biol 205(20):3177–3206 Neustadter DM, Herman RL, Drushel RF, Chestek DW, Chiel HJ (2007) The kinematics of multifunctionality: comparisons of biting and swallowing in Aplysia californica. J Exp Biol 210(2):238–260 Nicolelis MA, Lebedev MA (2009) Principles of neural ensemble physiology underlying the operation of brain–machine interfaces. Nat Rev Neurosci 10(7):530–540. https://doi.org/10.1038/nrn2653 Novakovic VA, Sutton GP, Neustadter DM, Beer RD, Chiel HJ (2006) Mechanical reconfiguration mediates swallowing and rejection in Aplysia californica. J Comp Physiol A Neuroethol Sens Neural Behav Physiol 192(8):857–870. https://doi.org/10.1007/s00359-006-0124-7 Oishi K, Klavins E (2014) Framework for engineering finite state machines in gene regulatory networks. ACS Synth Biol 3(9):652–665. https://doi.org/10.1021/sb4001799 Packard N, Wolfram S (1985) Two-dimensional cellular automata. J Stat Phys 38(March):901–946. https://doi.org/10.1201/9780429494093-6 Payne JL, Wagner A (2013) Constraint and contingency in multifunctional gene regulatory circuits. PLoS Comput Biol. https://doi.org/10.1371/journal.pcbi.1003071 Pearson K (1993) Common principles of motor control in vertebrates and invertebrates. Annu Rev Neurosci 16(1):265–297 Pearson KG (1987) Central pattern generation: a concept under scrutiny. Springer, Boston, pp 167–185. https://doi.org/10.1007/978-1-4615-9492-5_10 Piazzesi G, Lombardi V (1995) A cross-bridge model that is able to explain mechanical and energetic properties of shortening muscle. Biophys J 68(5):1966–1979. https://doi.org/10.1016/S0006-3495(95)80374-7 Prescott TJ, Ayers JL, Grasso F, Verschure PFMJ (2016) Chapter 17. Embodied models and neurorobotics. In: Embodied M (ed) From neuron to cognition via computational neuroscience. MIT Press, Cambridge, pp 483–512 Prinz AA, Bucher D, Marder E (2004) Similar network activity from disparate circuit parameters. Nat Neurosci 7(12):1345–1352 Ravn AP, Rischel H, Holdgaard M, Eriksen TJ, Conrad F, Andersen TO (1995) Hybrid control of a robot—a case study. Hybrid Syst II:391–404. https://doi.org/10.1007/3-540-60472-3_20 Rivera Torres PJ, Serrano Mercado EI, Anido Rifón L (2018) Probabilistic Boolean network modeling of an industrial machine. J Intell Manuf 29(4):875–890. https://doi.org/10.1007/s10845-015-1143-4 Röschard J, Roces F (2003) Cutters, carriers and transport chains: distance-dependent foraging strategies in the grass-cutting ant Atta vollenweideri. Insectes Soc 50(3):237–244. https://doi.org/10.1007/s00040-003-0663-7 Rosin DP, Rontani D, Gauthier DJ, Schöll E (2013) Experiments on autonomous boolean networks. Chaos 23:2. https://doi.org/10.1063/1.4807481 Royakkers L, van Est R (2015) A literature review on new robotics: automation from love to war. Int J Soc Robot 7(5):549–570. https://doi.org/10.1007/s12369-015-0295-x Saadatpour A, Albert I, Albert R (2010) Attractor analysis of asynchronous Boolean models of signal transduction networks. J Theor Biol 266(4):641–656. https://doi.org/10.1016/j.jtbi.2010.07.022 Kleene SC (1951) Representation of events in nerve nets and finite automata. Technical report, U.S. Air Force Project RAND Schwartz AB, Kettner RE, Georgopoulos AP (1988) Primate motor cortex and free arm movements to visual targets in three-dimensional space. I. Relations between single cell discharge and direction of movement. J Neurosci 8(8):2913–2927. https://doi.org/10.1523/jneurosci.08-08-02913.1988 Selverston AI (1992) Dynamic biological networks: the stomatogastric nervous system. MIT Press, Cambridge Selverston AI, Russell DF, Miller JP, King DG (1976) The stomatogastric nervous system: structure and function of a small neural network. Prog Neurobiol 7:215–289. https://doi.org/10.1016/0301-0082(76)90008-3 Sewak M (2019) Deep reinforcement learning. In: Deep reinforcement learning, pp 1–9. https://doi.org/10.1007/978-981-13-8285-7 Shadmehr R (1970) A mathematical muscle model. ReCALL Shaw KM, Lyttle DN, Gill JP, Cullins MJ, Mcmanus JM, Lu H, Thomas PJ, Chiel HJ (2015) The significance of dynamical architecture for adaptive responses to mechanical loads during rhythmic behavior. J Comput Neurosci 38:25–51. https://doi.org/10.1007/s10827-014-0519-3 Shea-Brown E, Rinzel J, Rakitin BC, Malapani C (2006) A firing rate model of Parkinsonian deficits in interval timing. Brain Res 1070(1):189–201. https://doi.org/10.1016/j.brainres.2005.10.070 Shev M, Strang G (2016) ”Operator splitting.” Splitting Methods in Communication, Imaging, Science, and Engineering. Springer 95–114 Shoham S, Paninski LM, Fellows MR, Hatsopoulos NG, Donoghue JP, Normann RA (2005) Statistical encoding model for a primary motor cortical brain–machine interface. IEEE Trans Biomed Eng 52(7):1312–1322. https://doi.org/10.1109/TBME.2005.847542 Siegle L, Schwab JD, Kühlwein SD, Lausser L, Tümpel S, Pfister AS, Kühl M, Kestler HA (2018) A boolean network of the crosstalk between IGF and wnt signaling in aging satellite cells. PLoS ONE 13(3):1–24. https://doi.org/10.1371/journal.pone.0195126 Stamhuis E, Aerts P, Nauwelaerts S (2005) Swimming and jumping in a semi-aquatic frog. Animal Biol 55(1):3–15 Stehouwer DJ (1992) Development of anuran locomotion: ethological and neurophysiological considerations. J Neurobiol 23(10):1467–1485. https://doi.org/10.1002/neu.480231008 Stewart HL (2004) Consequences of flexural stiffness and buoyancy for hydrodynamic forces, light interception and dispersal of a tropical alga. University of California, Berkeley Sussillo D, Nuyujukian P, Fan JM, Kao JC, Stavisky SD, Ryu S, Shenoy K (2012) A recurrent neural network for closed-loop intracortical brain-machine interface decoders. J Neural Eng. https://doi.org/10.1088/1741-2560/9/2/026027 Susswein AJ, Byrne JH (1988) Identification and characterization of neurons initiating patterned neural activity in the buccal ganglia of Aplysia. J Neurosci 8(6):2049–2061 Susswein AJ, Chiel HJ (2012) Nitric oxide as a regulator of behavior: new ideas from Aplysia feeding. Prog Neurobiol 97(3):304–317. https://doi.org/10.1016/j.pneurobio.2012.03.004 Sutton GP, Macknin JB, Gartman SS, Sunny GP, Beer RD, Crago PE, Neustadter DM, Chiel HJ (2004) Passive hinge forces in the feeding apparatus of Aplysia aid retraction during biting but not during swallowing. J Comp Physiol A Neuroethol Sens Neural Behav Physiol 190(6):501–514. https://doi.org/10.1007/s00359-004-0517-4 Sutton GP, Mangan EV, Neustadter DM, Beer RD, Crago PE, Chiel HJ (2004) Neural control exploits changing mechanical advantage and context dependence to generate different feeding responses in Aplysia. Biol Cybern 91(5):333–345. https://doi.org/10.1007/s00422-004-0517-z Szczecinski NS, Chrzanowski DM, Cofer DW, Terrasi AS, Moore DR, Martin JP, Ritzmann RE, Quinn RD (2015) Introducing mantisbot: Hexapod robot controlled by a high-fidelity, real-time neural simulation. In: IEEE international conference on intelligent robots and systems, 2015-December (September), pp 3875–3881. https://doi.org/10.1109/IROS.2015.7353922 Szczecinski NS, Hunt AJ, Quinn RD (2017) A functional subnetwork approach to designing synthetic nervous systems that control legged robot locomotion. Front Neurorobotics. https://doi.org/10.3389/fnbot.2017.00037 Szczecinski NS, Quinn RD (2018) Leg-local neural mechanisms for searching and learning enhance robotic locomotion. Biol Cybern 112(1–2):99–112. https://doi.org/10.1007/s00422-017-0726-x Tal D, Schwartz EL (1997) Computing with the leaky integrate-and-fire neuron: logarithmic computation and multiplication. Neural Comput 9(2):305–318 Teyke T, Weiss KR, Kupfermann I (1991) Activity of identified cerebral neuron correlates with food-induced arousal in Aplysia. Neurosci Lett 133(2):307–310. https://doi.org/10.1016/0304-3940(91)90595-K Verstappen M, Aerts P, Van Damme R (2000) Terrestrial locomotion in the black-billed magpie: kinematic analysis of walking, running and out-of-phase hopping. J Exp Biol 203(14):2159–2170 Wang Y, Truccolo W, Borton DA (2018) Decoding hindlimb kinematics from primate motor cortex using long short-term memory recurrent neural networks. In: Proceedings of the annual international conference of the IEEE Engineering in Medicine and Biology Society, EMBS 2018-July, 1944–1947. https://doi.org/10.1109/EMBC.2018.8512609 Warman EN, Chiel HJ (1995) A new technique for chronic single-unit extracellular recording in freely behaving animals using pipette electrodes. J Neurosci Methods 57(2):161–169. https://doi.org/10.1016/0165-0270(94)00144-6 Webster VA, Lonsberry AJ, Horchler AD, Shaw KM, Chiel HJ, Quinn RD (2013) A segmental mobile robot with active tensegrity bending and noise-driven oscillators. In: 2013 IEEE/ASME international conference on advanced intelligent mechatronics: mechatronics for human wellbeing, AIM 2013. Wollongong, Australia, pp 1373–1380. https://doi.org/10.1109/AIM.2013.6584286 Weiss KR, Chiel HJ, Koch U, Kupfermann I (1986) Activity of an identified histaminergic neuron, and its possible role in arousal of feeding behavior in semi-intact Aplysia. J Neurosci 6(August):2403–2415 Wilson HR, Cowan JD (1972) Excitatory and inhibitory interactions in localized populations of model neurons. Biophys J 12(1):1–24. https://doi.org/10.1016/S0006-3495(72)86068-5 Wilson HR, Cowan JD (1973) A mathematical theory of the functional dynamics of cortical and thalamic nervous tissue. Kybernetik 13(2):55–80. https://doi.org/10.1007/BF00288786 Wood KC, Blackwell JM, Geffen MN (2017) Cortical inhibitory interneurons control sensory processing. Curr Opin Neurobiol 46:200–207. https://doi.org/10.1016/j.conb.2017.08.018 Xie Z, Schwartz O, Prasad A (2018) Decoding of finger trajectory from ECoG using deep learning. J Neural Eng. https://doi.org/10.1088/1741-2552/aa9dbe Ye H, Morton DW, Chiel HJ (2006) Neuromechanics of coordination during swallowing in Aplysia californica. J Neurosci 26(5):1470–1485. https://doi.org/10.1523/JNEUROSCI.3691-05.2006 Ye H, Morton DW, Chiel HJ (2006) Neuromechanics of multifunctionality during rejection in Aplysia californica. J Neurosci 26(42):10743–10755 Yu SN, Crago P, Chiel H (1997) A nonisometric kinetic model for smooth muscle. Am J Physiol Cell Physiol 272(3):C1025–C1039 Yu SN, Crago PE, Chiel HJ (1999) Biomechanical properties and a kinetic simulation model of the smooth muscle I2 in the buccal mass of Aplysia. Biol Cybern 81:505–513. https://doi.org/10.1007/s004220050579 Zahalak GI, Ma SP (1990) Muscle activation and contraction: constitutive relations based directly on cross-bridge kinetics. J Biomech Eng 112(1):52–62. https://doi.org/10.1115/1.2891126 Zajac FE (1989) Muscle and tendon: properties, models, scaling, and application to biomechanics and motor control. Crit Rev Biomed Eng 17(4):359–411 Ziv I, Baxter DA, Byrne JH (1994) Simulator for neural networks and action potentials: description and application. J Neurophysiol 71(1):294–308