Laboratory for Bionic Integration
In our research, we study the sensory nervous system with a focus on the mechanics of brain organization and neuroplasticity. Our findings allow us to build prosthetic devices with sensory integration, giving amputees a sense of touch through their prosthetic limb.
The lab works with patients who have undergone specific surgeries to reintegrate the nerves that once supplied sensation to the amputated limb back into the skin of the residual limb. This allows us to map sensations from an amputee’s missing limb in their residual limb, and pair these areas with appropriate mechanisms to mimic the sense of touch.
Our work also focuses on establishing an understanding of how sensory channels are organized and integrated to establish a cognitive sense of self, embodiment, and authorship. We use our understanding of these sensory and cognitive pathways to drive cognitive engagement with artificial limbs for amputees.
Neural-Machine Interface and Prosthetics.
A neural-machine-interface is a machine, such as a bionic limb, that has a connection with the wearer’s brain—in this case, the user’s limb nerves. Our prosthetics utilize a neural-machine interface that surgically reconnects amputated nerves to new muscle and skin sites. The nerves of these amputees are not physically connected to the machine; instead, the bionic prosthetic picks up electrical signals from the reinnervated muscles and small robots push and vibrate against the user’s skin containing the reintegrated nerves.
When an amputee thinks about moving their bionic limb, nerve impulses travel from their brain to the reintegrated nerve endings in their muscles. The mechanical components of the muscles generate electricity when they contract which acts like a biological amplifier; intensifying the nerve impulses so that they control the actions of the prosthetic.
The prosthetic is bidirectional, meaning that it also receives information and relays it back to the nerves. Tactors, or touch robots, are integrated into the limb. These robots send pressure and vibrations through the skin to communicate with their reintegrated nerves which provides information about the prosthetic limb to the user’s brain. The information includes the prosthetic’s movement in space, the shape of the hand’s grip, and the feel of objects that the hand is touching.
We study ownership and agency, and use these concepts to engineer prosthetics that cognitively and perceptually integrate with the user.
Ownership is the sense that one occupies their body, and that the parts of one’s body belong to them. In our research, we use physiologically relevant artificial touch to help amputees feel that their prosthetic limb is a naturally integrated part of their body.
Agency is the feeling that you are the author of your actions. We use perceptual illusions of movement that are coupled to the intended movement of a prosthesis to provide amputees a sense of agency over their devices.
Together the experience of ownership and agency combine to provide a more integrated sense of overall prosthetic embodiment. This provides the amputees with a clear feeling that their prosthetic limb is a natural part of their own body.
Functional Metrics for Humans with Bidirectionally Integrated Prosthetic Limbs: Upper Limb Sensory-Motor Integration Assessments
The Laboratory for Bionic Integration is working closely with Dr. Jacqueline Hebert, MD, FRCPC at the University of Alberta; and Dr. Jon Sensinger, PhD, PEng of the University of New Brunswick to develop a suite of metrics as sophisticated and effective as the devices that they assess. These tests help map system function, so that they may be used as tools to inform technology design, implementation, and translation. The metrics are designed to not have a ceiling effect so that comparisons can be made with able-bodied users. They are rooted in science (psychophysics, cognition/perception, and kinematics) yet they represent functional, real-world tasks that are clinically applicable to users of advanced upper limb sensory-motor integration technologies.For more information on the Functional Metrics Suite, please see the Functional Metrics Development
- Sensory nervous system: The nerves responsible for gathering information from your senses
- Neuroplasticity: The ability of the brain to reorganize
- Embodiment: The feeling that the parts of your body belong to you
- Authorship: The feeling that you are in control of your body’s actions
- Cognitive engagement: Amputees perceive that their prosthetic limb is under their control, and a part of their body
- Functional Metrics for Humans with Bidirectionally Integrated Prosthetic Limbs
- We are working on development and delivery of a suite of validated functional metrics for bi-directionally integrated advanced prosthetic limb systems. The metrics will be adaptable to both advanced and current standard-of-care prosthetics, clinically implementable with a minimum requirement of technological expertise to operate, flexible to account for numerous systems approaches, sensitive to system performance, and reflective of requirements for quantifying different control and feedback strategies.
- Defense Advanced Research Project Agency (DARPA), Department of Defense, Contract # N66001-15-C-4015
For more information, please visit the Functional Metrics Development page of this site
D. T. Beckler, Z. C. Thumser, J. S. Schofield, P. D. Marasco. “Reliability in evaluator-based tests: using simulation-constructed models to determine contextually relevant agreement thresholds.” BMC Med Res Methodol. 2018; 18:141.
P. D. Marasco, J. S. Hebert, J. W. Sensinger, C. E. Shell, J. S. Schofield, Z. C. Thumser, R. Nataraj, D. T. Beckler, M. R. Dawson, D. H. Blustein, S. Gill, B. D. Mensh, R. Granja-Vazquez, M. D. Newcomb, J. P. Carey, B. M. Orzell, Illusory movement perception improves motor control for prosthetic hands. Sci. Transl. Med. 10, eaao6990 (2018). http://stm.sciencemag.org/content/10/432/eaao6990
Full text: http://stm.sciencemag.org/cgi/content/full/10/432/eaao6990?ijkey=GGLz/3mU1ehyY&keytype=ref&siteid=scitransmed
- Blustein, Daniel H., and Jonathon W. Sensinger. "Validation of a constrained-time movement task for use in rehabilitation outcome measures." In Rehabilitation Robotics (ICORR), 2017 International Conference on, pp. 1183-1188. IEEE, 2017.
- Wilson, Adam W., Daniel H. Blustein, and Jon W. Sensinger. "A third arm—Design of a bypass prosthesis enabling incorporation." In Rehabilitation Robotics (ICORR), 2017 International Conference on, pp. 1381-1386. IEEE, 2017.Wilson, Adam W., Daniel H. Blustein, and Jon W. Sensinger. "A third arm—Design of a bypass prosthesis enabling incorporation." In Rehabilitation Robotics (ICORR), 2017 International Conference on, pp. 1381-1386. IEEE, 2017.
- Physiologically Relevant Prosthetic Limb Movement Feedback for Upper and Lower Extremity Amputees
- We are developing a wearable robotic perceptual feedback system to provide vibrational input as part of a prosthetic socket interface. We are using cognitive/perceptual approaches to provide physiologically relevant vibration-induced joint movement feedback in upper and lower limbs for normal amputees without a neural-machine-interface.
- Department of Defense, Congressionally Directed Medical Research Program (CDMRP) Clinical and Rehabilitative Medicine Research Program (CRMRP) Grant #MR140156
- Advanced Materials to Improve Moisture Management for Prosthetic Socket Liners
- We are working to develop a new prosthetic socket liner material to transport and sequester sweat away from an amputee’s skin. The number of amputees, particularly double- and triple-amputees, in our veteran population has steadily increased over the last decade. Meanwhile, advances in prosthesis technology have produced devices with increasing functional potential of which our veteran amputee users want to take full advantage. In contrast, conventional silicone socket liners have advanced relatively little, including an undesirable tendency to accumulate sweat during use, particularly for physically active amputees. A liner material which keeps this moisture away from the user’s skin would not only improve comfort and hygiene, but also the critically-important fit and thus the overall performance of the prosthesis.
- Department of Veterans Affairs, Merit Review, 1 I01 RX001833-01A2
- Pulsed Electromagnetic Frequency (PEMF) Stimulation of Mechanosensory Nerves Affecting Bone
- We are investigating the use of differing fundamental frequency and magnetic field strength characteristics of Pulsed Electromagnetic Field (PEMF) treatment on mechanosensory nerve action potentials in the hind limbs of skeletally mature rats.
- Orthofix, Inc. sponsored research agreement, co-investigator
- Restoring Upper Limb Movement Sense to Amputees; A Move Towards Natural Control of Prosthetic Limbs
- We are using cognitive and perceptual approaches and a direct neural-machine interface to provide prosthetic limbs with a physiologically relevant sense of complex synergistic hand movements.
- National Institutes of Health (NIH) Director’s Transformative R01 Research Award, 1R01NS081710 – 01
- Proprioception in Rat Cortex to Examine Sensory Feedback for Prosthetics
- In this project we used a rat model to investigate how kinesthesia (the sense of limb movement) is organized in the brain.
- VA RR&D Career Development Award, Level-2 No. A7253W
- Resultant publications: Marasco PD, Bourbeau DJ, Shell CE, Granja-Vazquez R, Ina JG (2017) The neural response properties and cortical organization of a rapidly adapting muscle sensory group response that overlaps with the frequencies that elicit the kinesthetic illusion. PLoS ONE 12(11): e0188559. https://doi.org/10.1371/journal.pone.0188559
- A Touch Feedback Tactor Array System for Long-term Implementation of Physiologically Relevant Cutaneous Touch with Prosthetic Limbs
- We have developed and implemented a sensory feedback system for prosthetic limbs that is integrated with the amputee’s nerves to provide physiologically relevant cutaneous feedback. It was designed, built, and packaged for long-term take-home use and is being used to examine the malleability of representational plasticity and cognitive effects of visual-tactile integration with use over one year.
- Defense Advanced Research Project Agency (DARPA), Department of Defense, 61732-LS-DRP, Under P-1108-114403/DARPA-BAA-11-08 Reliable Peripheral Interfaces (RPI)
Functional Metrics for Humans with Bidirectionally Integrated Prosthetic Limbs:
Upper Limb Sensory-Motor Integration Assessments
The Laboratory for Bionic Integration is working closely with Dr. Jacqueline Hebert, MD, FRCPC at the University of Alberta; and Dr. Jon Sensinger, PhD, PEng of the University of New Brunswick to develop a suite of metrics as sophisticated and effective as the devices that they assess. These tests help map system function, so that they may be used as tools to inform technology design, implementation, and translation. The metrics are designed to not have a ceiling effect in comparison with able-bodied users. They are rooted in functional, real-world tasks and are clinically applicable to users of advanced upper limb sensory-motor integration technologies.
The metrics suite includes:
1. GRIP: Grasping Relative Index of Performance
Developed by the Laboratory for Bionic Integration
The principle tasks for upper-limb prosthesis use involve grasping, gripping, or squeezing. The ability to quickly and accurately apply a desired force is critical for appropriate manual manipulation, from handholding to heavy lifting, and is necessary for obtaining fluid, natural use of a prosthetic hand. Fitts’ law is a widely applicable descriptive model relating the time required to achieve a target to movement size and accuracy. By applying this law to grip forces across the dynamic range of a device we can quantify a relative effective accuracy and index of performance irrespective of control scheme or feedback modality.
2. PEP: Prosthesis Efficiency and Profitability
Developed by the Laboratory for Bionic Integration
Humans use their hands to acquire and manipulate objects for a multitude of activities of daily living. This object acquisition and manipulation involves seam-less interaction between motor control, touch and proprioception. Upper limb prosthetic devices are designed to replace this lost functionality and their intrinsic utility is reflected in their relative functional efficiency. Accepted methodologies from evolutionary ecology provide a mathematical model-based framework for assessing efficiency and profitability in complex biological systems. In this metric, optimal foraging theory is used as a platform to objectively assess the searching, reaching, grasping, manipulating and decision-making movements involved with prosthesis use which directly reflect foraging tasks and behaviors.
3. GaMA: Gaze & Movement Assessment
Developed by the Hebert Lab
As our primary source of sensory information, the movement of our eyes to specific locations is intimately tied to the demands of a task and is an excellent correlate of where we are attending. Visual attention is an integral component of motor performance expected to change with accurate sensory feedback from the prosthesis and intuitive motor control. This metric combines motion tracking and eye tracking during simulated real-world tasks, and enables 3D gaze vector rendering by integrating environmental modeling and the representation of real world objects. This metric identifies the motion of the prosthesis, compensatory body movements and simultaneous visual gaze behavior during performance tasks in integrated 3D space, as well as the location and movement of task-critical objects. Metrics output include upper limb and hand kinematic measures as well as standard measures of visual attention.
4. CBI: Control Bottleneck Index
Developed by the Sensinger Lab
Your brain sends efferent signals which are corrupted by noise. It receives afferent signals from many sources. It forms models that help it predict control and interpret feedback. Good performance can be achieved with many combinations of these three factors, and performance may be limited by a bottleneck in any one of them. In that case, improvements in one of the other factors may not lead to significant improvements in performance until the bottleneck is relieved. The purpose of this metric is to identify the bottleneck in that process for a given task, and to evaluate the contribution of a particular control strategy or sensory feedback modality independent of that bottleneck. This task is appropriate to assess control source and feedback fidelity.
5. PIC: Prosthesis Incorporation
Developed by the Sensinger Lab
The goal of this metric is to quantitatively measure how much a prosthesis has been incorporated into the body schema. Device incorporation is a good indication that control and sensory feedback are intuitive, synchronized, and meaningful. This metric uses a cross-modal congruency effect paradigm to evaluate prosthesis incorporation, in which the ability of a person to ignore one form of feedback in favor of another is assessed. The metric provides an index that can be assessed quickly and accurately using a simple standardized setup. This task is appropriate to assess control source and tactile feedback fidelity.
Using the Metrics Suite in Your Research
If you are interested in using the functional metrics suite in your research, please email Dr. Paul Marasco at firstname.lastname@example.org.
To find publications relating to the functional metrics suite, please visit the current projects page of our site.
We are currently seeking postdoctoral research fellows, to work in the Laboratory for Bionic Integration at the Biomedical Engineering Department of the Cleveland Clinic Lerner Research Institute. Successful applicants must be excited to work within a multidisciplinary team of researchers, neuroscientists, engineers, and clinicians. Candidate must have a strong research background as demonstrated through journal publications, and high-level conference participation. Applicants must be independent and highly motivated with a PhD. in Biomedical Engineering, Neuro Sciences, Physiology, Electrical Engineering, Mechanical Engineering or related field.
As a Post-doctoral fellow you will be expected to lead exciting research contributing to the fields of neural-machine interfaces, limb prosthesis, or the mechanistic understandings of sensory processes. Previous experience with human or animal trials is preferred. Qualified applicants should submit a 1-page research statement and a CV to Dr. Paul Marasco, email@example.com.
- Undergraduate and Graduate Student Internships
The Laboratory for Bionic Integration welcomes applications for internships from interested undergraduate and graduate students. Internships are available during the academic semester, and over the summer.
Students seeking internships are required to send a letter of intent, CV or resume, and transcript (unofficial is acceptable) to Dr. Paul Marasco at firstname.lastname@example.org for consideration. Internship applications are accepted and interviews scheduled on a rolling basis.
An intern’s individual research interests and experience will shape the course of their internship project.
Please note that due to departmental restrictions, we are unable to accept high school student interns.
- The Laboratory for Bionic Integration Immersion in Science Art Internship
Information and Application Guidelines
The Laboratory for Bionic Integration is accepting applications for the 2018 Immersion in Science Art Internship. This internship is an opportunity for current undergraduate and graduate students interested in cross-disciplinary careers in the arts and science.
The Immersion in Science Art Intern will contribute creative input to the Laboratory of Integration’s research, while strengthening their own scientific and artistic practices. They will have the opportunity to contribute to other summer interns’ research, and the Laboratory for Bionic Integration’s current projects. The course of the Immersion in Science Art Internship will be guided by the appointed intern’s scientific and artistic pursuits.
Undergraduate Immersion in Science Art Internship candidates must have completed a minimum of four semesters of undergraduate studies by the end of the spring 2018 semester. They must be seeking an art (fine art, music, or literature) major with a minor in the sciences (biology, chemistry, engineering, etc.), or a science major with a minor in the arts. Applicants may also be dual-majors in the arts and sciences. Medical illustration and scientific writing students are eligible and encouraged to apply.
Graduate and professional student candidates must be pursuing an advanced degree in the arts (fine art, music, or literature) or sciences (physiology, neuroscience, engineering, etc.), with formal training in the other discipline in the form of an undergraduate major or minor. Medical illustration students and scientific writing students are eligible and encouraged to apply.
The internship application consists of:
- Letter of Intent
- Applicants must include a letter of intent that outlines their interest in the Laboratory for Bionic Integration Immersion in Science Art Internship. This document must be submitted as a PDF.
- Resume or CV
- Include a current resume or CV. The document must include a valid email address that is checked regularly, as all communications regarding the internship will be made via email. The resume or CV must be submitted as a PDF.
- Letter of Recommendation
- Include a letter of recommendation from an instructor or PI who can write in support your cross-disciplinary career interests. The letter must be submitted as a PDF.
- A transcript from your current studies is required. Transcripts must include course names, date taken, and grade earned. You may submit an unofficial transcript provided it meets these criteria. If you are an undergraduate senior from the Cleveland Institute of Art, your transcript must include letter grades from science courses taken at Case Western Reserve University or elsewhere. Transcripts must be submitted as PDFs.
- Portfolio requirements vary depending on your artistic pursuits. For specific requirements, please see below:
Fine Arts Portfolio
Submit your portfolio as a slideshow saved as a PDF. A single work may not fulfill two or more criteria. All subjects must be referenced from life whenever possible. For medical and scientific illustration majors submitting topics such as microbiology and chemistry, work must be referenced from the most current accepted crystallography, spectra, or microscopy available.
Your portfolio must include the following:
- One work that depicts a procedure or has a narrative
- One work demonstrating ability to follow strict guidelines (i.e., a journal’s figure guidelines, or matching a magazine’s style)
- One work demonstrating ability to communicate a complex concept in metaphor
- Include a separate table of contents as a separate PDF. Contents must list title of work, year completed, media, intended audience, and a brief description of the work and how it relates to artist’s scientific pursuits. If submitting a medical illustration, instead of relating the work to your scientific studies, describe the scientific concept depicted and how you researched and referenced it.
Submit your portfolio as a single PDF. A single work may not fulfill two or more criteria.
Your portfolio must include the following:
- One critical analysis
- Two pieces most representative of your genera of writing (e.g., fiction, nonfiction, scientific communication, poetry, etc.)
- Include a table of contents. Contents must list title of each work, year completed, writing prompt (if any), intended audience, and a brief explanation of how each work relates to your scientific pursuits. If submitting a piece of scientific communications writing, instead of relating the work to your scientific studies, describe the scientific concept written about and how it was researched.
Submit your portfolio as .mp3 or .mp4 files. A single work may not fulfill two or more criteria.
Your portfolio must include the following:
- Three audio or audiovisual recordings of musical performances, not to exceed thirty minutes of playback time
- Include a table of contents submitted as a PDF. Contents must list title of each performance, year performed, instrument(s), and a brief explanation of how each work relates to your scientific pursuits.
To apply, please send your application materials via email. You must use the email subject line “Immersion in Science Art Internship Application.”
Dylan Beckler joined the Laboratory for Bionic Integration in 2016 as a full-time Research Engineer. Dylan earned his Bachelors of Science in Biomedical Engineering from the University of Akron in 2015. His area of research is focused on developing functional tests for advanced prosthetic limbs using Optimal Foraging Theory approaches.
Kaleigh Farrell, BA
Kaleigh Farrell joined the Marasco lab in 2015 as a research coordinator. She is a graduate of Miami University in Oxford, Ohio, with a Bachelor of Arts in Psychology.
Kaleigh’s focus is on the regulatory aspects of research coordination. She functions as our liaison with the IRB and our sponsors’ regulatory agencies.
Paul D. Marasco, PhD
Dr. Marasco is a neuroscientist (sensory neurophysiology) who focuses on applied cognitive/perceptual systems integration within a biomedical engineering context. He is an Associate Staff Scientist in the Lerner Research Institute Department of Biomedical Engineering at Cleveland Clinic and a Principal Investigator in the Advanced Platform Technology Center of Excellence at the Louis Stokes Cleveland Department of Veterans Affairs Medical Center, where he is also the Director of Amputee Research for the Department of Physical Medicine and Rehabilitation. He heads the Laboratory for Bionic Integration where neural-machine-interfaces are used to provide touch and movement sensation to prosthetic limbs so that individuals with amputation feel like the devices are a part of their body. Dr. Marasco leads a number of multi-institution and international projects funded across the National Institutes of Health (NIH), the Defense Advanced Research Projects Administration (DARPA), the Department of Defense’s Congressionally Directed Medical Research Program (CDMRP), and the Veterans Administration (VA).
In addition to investigating how to use perception and cognition to make prosthetics feel, Dr. Marasco and his teams are also working to develop new validated functional tests for advanced prosthetic systems to measure the tangible benefit of improved sensation on the use of prosthetic devices and help communicate the outcomes to clinicians and payers. They are providing joint movement sensations to amputees without neural-machine-interfaces so that they can move and walk better, and also developing advanced composite approaches to make silicone socket liners more comfortable. Through the VA, Dr. Marasco was recently awarded the Presidential Early Career Award for Scientists and Engineers, which is the highest honor bestowed by the U.S. government on outstanding scientists and engineers beginning their independent careers in the Federal Services.
Courtney Shell, PhD
Courtney obtained a B.S. degree in Biomedical Engineering from Texas A&M University in 2010 and M.S. and Ph.D. degrees in Mechanical Engineering from the University of Texas at Austin in 2012 and 2016, respectively. For her doctoral work, she investigated how lower-limb amputee mobility is affected by prosthetic foot properties and how a prosthetic foot could be adjusted during walking to improve stability on an uneven surface. Courtney joined the lab in 2016 as a Postdoctoral Research Fellow and is exploring how restoration of sensory perception in amputees improves performance and overall user experience with prostheses.
Zachary earned his MS in biomedical engineering from the University of Michigan in 2003. While there, his graduate work focused on bioelectronics.
In 2005 he joined Dr. John Stahl's lab at the Cleveland VA Medical Center's Ocular Motility Laboratory studying eye-head coordination and cerebellar gaze control disorders in humans and mice.
In 2013 he joined Dr. Marasco as a research engineer studying sensory feedback and integration in prosthetic limbs, with a focus on developing functional metrics of limb performance, as well as physically implementing the various technologies and approaches used by the lab.