Abstract
This paper presents a personalized contingency feedback adaptation system that aims to encourage infants aged 6 to 8 months to gradually increase the peak acceleration of their leg movements. The ultimate challenge is to determine if a socially assistive humanoid robot can guide infant learning using contingent rewards, where the reward threshold is personalized for each infant using a reinforcement learning algorithm. The model learned from the data captured by wearable inertial sensors measuring infant leg movement accelerations in an earlier study. Each infant generated a unique model that determined the behavior of the robot. The presented results were obtained from the distributions of the participants’ acceleration peaks and demonstrate that the resulting model is sensitive to the degree of differentiation among the participants; each participant (infant) should have his/her own learned policy.
This work was supported by NSF award 1706964 (PI: Smith, Co-PI: Matarić). In addition, this work was developed during an international mobility program at the University of Southern California being also partially funded by the European Union ECHORD++ project (FP7-ICT-601116), the LifeBots project (TIN2015-65686-C5) and THERAPIST project (TIN2012-38079).
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Gibson, E.J., Pick, A.D.: An Ecological Approach to Perceptual Learning and Development. Oxford University Press, Oxford (2000)
Thelen, E., Smith, L.: A Dynamic Systems Approach to the Development of Cognition and Action. The MIT Press, Cambridge (1994)
Smith, B., Vanderbilt, D.L., Applequist, B., Kyvelidou, A.: Sample entropy identifies differences in spontaneous leg movement behavior between infants with typical development and infants at risk of developmental delay 5, 55 (2017)
Kouwaki, M., Yokochi, M., Kamiya, T., Yokochi, K.: Spontaneous movements in the supine position of preterm infants with intellectual disability. Brain Dev. 36(7), 572–577 (2014)
Rademacher, N., Black, D.P., Ulrich, B.D.: Early spontaneous leg movements in infants born with and without myelomeningocele. Pediatric Phys. Ther. 20(2), 137–145 (2008)
Smith, B.A., Teulier, C., Sansom, J., Stergiou, N., Ulrich, B.D.: Approximate entropy values demonstrate impaired neuromotor control of spontaneous leg activity in infants with myelomeningocele. Pediatr. Phys. Ther. 23(3), 241–247 (2008)
McKay, S.M., Angulo-Barroso, R.M.: Longitudinal assessment of leg motor activity and sleep patterns in infants with and without down syndrome. Infant Behav. Dev. 29(2), 153–168 (2006)
Geerdink, J.J., Hopkins, B., Beek, W.J., Heriza, C.B.: The organization of leg movements in preterm and full-term infants after term age. Dev. Psychobiol. 29(4), 335–351 (1996)
Kermoian, R., Campos, J.: Locomotor experience: a facilitor of spatial cognitive development. Child Dev. 59, 908–917 (1998)
Oudgenoeg-Paz, O., Volman, M.: Attainment of sitting and walking predicts development of productive vocabulary between ages 16 and 28 months. Infant Behav. Dev. 35, 733–736 (1998)
Goldfield, E.C., Kay, B.A., Warren, W.H.: Infant bouncing: the assembly and tuning of action systems. Child Dev. 64(4), 1128–1142 (1993)
Rovee-Collier, C.K., Gekoski, M.J.: The economics of infancy: a review of conjugate reinforcement. In: Advances in Child Development and Behavior, vol. 13, pp. 195–255. Elsevier (1979)
Watanabe, H., Taga, G.: General to specific development of movement patterns and memory for contingency between actions and events in young infants. Infant Behav. Dev. 29(3), 402–422 (2006)
Heathcock, J.C., Bhat, A.N., Lobo, M.A., Galloway, J.: The performance of infants born preterm and full-term in the mobile paradigm: learning and memory. Phys. Ther. 84(9), 808–821 (2004)
Lobo, M.A., Galloway, J.C.: Assessment and stability of early learning abilities in preterm and full-term infants across the first two years of life. Res. Dev. Disabil. 34(5), 1721–1730 (2013)
Angulo-Kinzler, R.M., Ulrich, B., Thelen, E.: Three-month-old infants can select specific leg motor solutions. Motor Control 6(1), 52–68 (2002)
Thelen, E.: Three-month-old infants can learn task-specific patterns of interlimb coordination. Psychol. Sci. 5(5), 280–285 (1994)
Angulo-Kinzler, R.M.: Exploration and selection of intralimb coordination patterns in 3-month-old infants. J. Motor Behav. 33(4), 363–376 (2001)
Chen, Y.-P., Fetters, L., Holt, K.G., Saltzman, E.: Making the mobile move: constraining task and environment. Infant Behav. Dev. 25(2), 195–220 (2002)
Sargent, B., Schweighofer, N., Kubo, M., Fetters, L.: Infant exploratory learning: influence on leg joint coordination. PLoS ONE 9(3), e91500 (2014)
Rosenberg, S.A., Robinson, C.C., Shaw, E.F., Ellison, M.C.: Part c early intervention for infants and toddlers: percentage eligible versus served. Pediatrics 131(1), 38–46 (2013)
Roberts, G., Howard, K., Spittle, A.J., Brown, N.C., Anderson, P.J., Doyle, L.W.: Rates of early intervention services in very preterm children with developmental disabilities at age 2 years. J. Paediatr. Child Health 44(5), 276–280 (2008)
Tang, B.G., Feldman, H.M., Huffman, L.C., Kagawa, K.J., Gould, J.B.: Missed opportunities in the referral of high-risk infants to early intervention. In: Pediatrics peds–2011 (2012)
Holt, R.L., Mikati, M.A.: Care for child development: basic science rationale and effects of interventions. Pediatr. Neurol. 44(4), 239–253 (2011)
Bottari, C., Dassa, C., Rainville, C., Dutil, E.: The IADL profile: development, content validity, intra- and interrater agreement. Can. J. Occup. Ther. 77(2), 345–356 (2009)
Feil-Seifer, D., Matarić, M.: A simon-says robot providing autonomous imitation feedback using graded cueing, In: Poster paper in International Meeting for Autism Research (IMFAR) (2012)
Greczek, J., Kaszubski, E., Atrash, A., Matarić, M.: Graded cueing feedback in robot-mediated imitation practice for children with autism spectrum disorders. In: IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN), pp. 561–566 (2014)
APDM Wearable Technologies, Portland, OR, USA, Opals. https://www.apdm.com/wearable-sensors/. Accessed 15 July 2018
Trujillo-Priego, I.A., Smith, B.A.: Kinematic characteristics of infant leg movements produced across a full day. J. Rehabil. Assist. Technol. Eng. 4, 2055668317717461 (2017)
Adolph, K.E., Robinson, S.R.: Sampling development. J. Cogn. Dev. 12(4), 411–423 (2011). https://doi.org/10.1080/15248372.2011.608190
Hartigan, J.A., Wong, M.A.: Algorithm as 136: a k-means clustering algorithm. J. Roy. Stat. Soc. Ser. C (Appl. Stat.) 28(1), 100–108 (1979)
Sutton, R.S., Barto, A.G.: Reinforcement Learning I: Introduction. MIT Press, Cambridge (1998)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Pulido, J.C., Funke, R., García, J., Smith, B.A., Matarić, M. (2019). Adaptation of the Difficulty Level in an Infant-Robot Movement Contingency Study. In: Fuentetaja Pizán, R., García Olaya, Á., Sesmero Lorente, M., Iglesias Martínez, J., Ledezma Espino, A. (eds) Advances in Physical Agents. WAF 2018. Advances in Intelligent Systems and Computing, vol 855. Springer, Cham. https://doi.org/10.1007/978-3-319-99885-5_6
Download citation
DOI: https://doi.org/10.1007/978-3-319-99885-5_6
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-99884-8
Online ISBN: 978-3-319-99885-5
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)