Abstract
Loss of vision alters the day to day life of blind individuals and may impose a significant burden on their family and the economy. Cortical visual prosthetics have been shown to have the potential of restoring a useful degree of vision via stimulation of primary visual cortex. Due to current advances in electrode design and wireless power and data transmission, development of these prosthetics has gained momentum in the past few years and multiple sites around the world are currently developing and testing their designs. In this review, we briefly outline the visual prosthetic approaches and describe the history of cortical visual prosthetics. Next, we focus on the state of the art of cortical visual prosthesis by briefly explaining the design of current devices that are either under development or in the clinical testing phase. Lastly, we shed light on the challenges of each design and provide some potential solutions.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
Introduction
The number of blind individuals has been increasing around the world and the USA. Globally, 32.4 million people were blind in 2010 which has increased by 600,000 since 1990 [1]. In 2015, a total of 1.02 million people were blind in the USA and it is projected to double to approximately 2.01 million people by 2050 [2]. The negative impacts of this condition on individual physical and mental health include a higher risk of chronic health conditions [3], unintentional injuries [4], social withdrawal [5], depression [5, 6], and mortality [7, 8]. From a socioeconomic standpoint, blindness has a negative effect on educational and occupational opportunities as well as medical expenditure. In the USA, the excess medical expenditure (compared to individuals without visual impairments) was $2.5 billion in 2004 which was primarily attributed to homecare [9]. Therefore, any effort leading to improvement in day to day life of these individuals not only improves their quality of life but also relieves a significant economic cost.
Common causes of blindness include cataracts, glaucoma, macular degeneration, infections, vitamin A deficiency, diabetes, and trauma [10]. Although in some of these conditions, blindness can be prevented in earlier stages [11,12,13,14]; many cases lead to irreversible loss of vision. Sensory substitution is an extensively explored approach to channel some degree of information via non-visual senses such as tactile [15, 16] or audible signals [17, 18]. Although sensory substitution is non-invasive and easily available for majority of blind individuals, the quantity and quality of information perception are extremely limited [19]. Hence, a more direct approach may be helpful to generate a visual perception of the surrounding environment.
Visual neural prostheses represent an approach of generating visual perception via direct stimulation of visual pathway. When the light is projected on the retina, optical information is converted to neural spiking activity via photoreceptor cells, transmitted via retinal ganglion cells to the lateral geniculate nucleus of the thalamus, and conveyed to the primary visual cortex via thalamic synapses. The basic principle of visual prostheses is that any segment of the visual pathway can potentially interface with a prosthetic that captures the image of the visual field via a camera, properly maps it into temporally and spatially specific signals, and stimulates the visual pathway accordingly. Stimulation in its simplest form induces perception of a spot of light called a phosphene and it could be used as a building block to construct a representation of the visual scene which conveys helpful information for communication and mobility. The site of stimulation is dependent of the pathology of the blindness and is chosen in a way that bypasses the damages segment of the visual pathway. Current visual prosthesis approaches include stimulation of the retina, optic nerve, lateral geniculate nucleus of the thalamus, optic radiations, and visual cortices. The number of subjects eligible for different types of prostheses remains unclear and requires further characterization, but considering retinal and subretinal prostheses deliver sensory input at earlier parts of the visual pathways than cortical stimulation, it is likely safe to assume that more patients stand to benefit from developing strategies that completely bypass the early visual pathway.
Our focus in this review is to elucidate the current state of cortical prostheses for visual restoration. However, it is important to acknowledge other strategies that target earlier segments of the visual pathway. Retinal prostheses aim to stimulate the surviving population of inner retina, retinal ganglion cells, and/or bipolar cells in individuals with retinis pigmentosa or age-related macular degeneration [20]. In theory, such an approach is the most advantageous as stimulation occurs at the earliest stage of visual perception, prior to any integration or “post-processing” of visual signals in the brain, especially the lateral geniculate nucleus. Argus II (Second Sight Medical Products) is the first commercially approved retinal prosthesis using the epiretinal approach, in which the microelectrode array is implanted on the retinal surface near the nerve fiber directly stimulating the ganglion cells [21]. Argus II improved subjects performance in spatial-motor tasks [22, 23], detection of motion [24], reading [25, 26], and face recognition [27]. Subretinal implants are another approach for retinal prosthesis in which the electrode array sits on the outer surface of the retina relying on normal processing of inner and middle retinal layers [28]; Alpha IMS is a subretinal implant that has been approved for commercial use in Europe [29] and is shown to restore some level of light perception, motion detection, visual acuity, and reading ability [30,31,32]. Retinal implants are currently the only visual prostheses that have approval for commercial use; however, potential candidates for such devices are a small portion of the blind population [33,34,35,36,37,38].
Stimulation of the optic nerve has also been shown to elicit phosphenes [39]. Veraart et al. utilized a spiral cuff electrode with four contacts. Subjects were able to discriminate the orientation of lines without error and recognize simple patterns with a recognition score of 63% [40]. This approach however requires an intact optic nerve and may not be applied to a large population of blind individuals. Deep brain stimulation of thalamus in proximity of lateral geniculate nucleus (LGN) and optic radiations has been resulted in reports of visual sensations [41]. Microstimulation of LGN has been investigated in animal models based on visual saccades [42, 43]. However, phosphene perception in human trials is yet to be explored.
Stimulation of early areas of the visual cortex (V1, V2, and V3) elicits perception of phosphenes and is used to develop cortical visual prosthetics. Our main objective in this review is to extensively address this cortical stimulation approach and provide an insight on the current state as well as current challenges of visual cortical prostheses.
History
Eliciting visual perception via electrical stimulation of the visual cortices was first reported in a case study by Löwenstein and Borchardt in 1918 where wounded soldiers were able to see flickering light perceptions on the opposite half of their visual field after stimulation of occipital lobe [44]. This was then followed by the work of Förster and Krause who were able to expose the human occipital lobe under local anesthesia and reliably induce perception of phosphenes [45, 46]. These studies set the groundwork for the first systematic effort to develop a visual cortical prosthetic by Brindley and Lewin [47]. They implanted a blind subject with an intracranial array of 80 electrodes molded it to fit the calcarine sulcus and neighboring cortex of the right hemisphere. They were able to successfully elicit phosphenes in different areas of the visual field which provided a proof of feasibility for visual cortical prosthetics. This array was physically connected to an extracranial array of radio receivers that allowed for selective activation of intracranial electrodes.
Dobelle reported similar observations on a group of 15 sighted patients who were going under surgery for other clinical reasons and gathered a useful body of data on the proper electrode placement as well as the effects of electrode size and stimulation parameters on the quality of perceptions [48]. Subsequently, they implanted two blind individuals with a 64-electrode array and were able to elicit simultaneous phosphenes representing simple patterns including a square and a reverse letter “L.” [49] In another experiment, they were able create English letters using six electrodes with phosphenes scattered in the visual field [50]. Using a combination of sequential and simultaneous stimulation of these six electrodes, they developed a “cortical braille” that was able to present randomized alphabets and synthetize sentences. One of the subjects performed with up to 85% accuracy on recognizing the alphabets and was able to read short sentences with missing or misreading a few words. Moreover, they developed a portable version of the device that was capable of receiving input from a video camera [51]. They reported that the subjects were able to read a 6 in. square “tumbling E” at 5 ft, as well as Snellen letters, HOTV test, Landolt rings, and Lea figures of similar size.
While Dobelle was making progress on improving the functionality of prosthetics with subdural electrode arrays, the NIH formed the neural prosthesis program that took another approach to decrease the current threshold required for eliciting phosphenes [52]. Based on a previous study on non-human primates [53], they proposed that intracortical stimulation of striate cortex can generate more stable phosphenes with lower current thresholds. They inserted penetrating electrodes into the occipital lobe of three sighted volunteers whom were undergoing occipital craniotomies under local anesthesia. All subjects reported perception of phosphenes elicited by currents (10–300 μA) significantly lower of the threshold amount for subdural electrodes (600–2000 μA). Following their success in sighted individuals, they implanted penetrating microelectrodes into the occipital lobe of a blind individual [54]. The microelectrode leads were assembled into groups of 8 or 10 and connected to the cables that exited the scalp through four separate incisions. Thirty-four out of 38 electrodes were able to elicit phosphenes with threshold currents of 2–77 μA at 200 pulses per second (twice the rate of stimulation used by Bak et al.). They characterized the effects of stimulation parameters on current thresholds and showed that an increase in pulse width and duration of stimulation decreased the current thresholds. Unlike most cases reported by Brindley and Lewin, the phosphenes were not perceived as flickering; they determined the interval between the two consecutive pulses needs to be shorter than 25 ms in order to generate a persistent (non-flickering) perception. Increasing current amplitudes had different effects depending on the site of stimulation, resulting in larger phosphenes in some electrodes, smaller in others, and no change in others. They also reported that phosphenes could be perceived in different colors (blue, red, violet, yellow but never green), with suprathreshold stimulation tending to elicit white or yellow phosphenes. They explanted the device after 4 months and concluded that their experiments demonstrate the feasibility of intracortical visual prosthetics.
Current State
Today, several teams are working towards understanding perceptual effects of visual cortex stimulation and development of safe and reliable visual cortical prostheses. Epilepsy patients with electrodes implanted in the occipital lobe provide a valuable opportunity to study the stimulation effects of visual cortex [55]. Functional mapping of the visual cortex [56,57,58,59,60] and understanding the psychophysical correlates of phosphene perception [61, 62] in these patients have extended our understanding of artificial vision and is providing an extremely valuable insight for development of visual cortical prostheses.
Multiple sites across the world are currently developing and testing visual cortical prosthetics with a general design similar to the most recent design of Dobelle [51]. As depicted in Fig. 1, the visual information is captured by a camera located on a glass or head band [63]. Pixel information is then fed to a video processing unit (VPU) and converted to a continuous sequence of commands that activate a subset of electrodes and determine the stimulation parameters (amplitude and waveform) [63]. The commands are transferred to an implanted system that delivers patterned stimulation. While Dobelle and others achieved promising outcomes with their systems, one of the main disadvantages of their design was the risk of infection and device breakage due to chronically externalized connections [64]. Hence, current designs take advantage of the state of the art Application Specific Integrated Circuits (AISC) and coil fabrication techniques to create a wireless data and power link between internal and external units [65]. Similar to previous works, both intracortical and surface stimulation approach are being investigated. Here, we provide a brief description of multiple projects that are currently in the device development or human experimentation phase.
The ICVP Project
The NIH neural prosthesis program ended in 1996 and reconstituted in 2000 as the Intracortical Visual Prosthesis Project (ICVP) at the Illinois University of Technology. While maintaining the intracortical stimulation approach, they developed a Wireless Floating Microelectrode Array (WFMA) to eliminate the use of wires and chronic incisions [64]. WFMA consists of 16 microelectrodes with different lengths located on a 2 mm by 2 mm ceramic substrate platform (Fig. 2) [63]. An application specific integrated circuit (AISC) along with a micro-coil is embedded in the platform to facilitate wireless power and datalink between the electrodes and an extra-corporal telemetry controller (TC). The TC is able to communicate with multiple implanted WFMAs and control each electrode individually.
Clinical testing of ICVP project has been planned but is not started yet [63]. The available anatomical areas are the occipito-dorso-lateral surface and posterior inferior gyrus while placement of electrodes on the wall of medial occipital lobe will be avoided to minimize the surgical risks. This limits the exposed area for V1 and increases the chance of electrode placement over V2 and V3. For the early recipients of the device, the implantation of the WMFAs would be restricted to one hemisphere and about nine modules (144 electrodes). The anticipated components of experimental trials are phosphene threshold testing and intensity rating, phosphene mapping, and testing the ability to convey basic visual percepts such as simple geometric.
CORTIVIS
Cortical visual neuroprosthesis for the blind (CORTIVIS) is a multi-site project supported by the Commission of the European Communities aiming at developing an intracortical visual cortical prosthesis [66]. CORTIVIS takes advantage of the Utah electrode array (UEA) which has been FDA approved for long-term human studies. UEA consists of 100 narrow silicon microelectrodes protruding 1.0–1.5 mm from a flat rectangular 4 mm by 4 mm base that lays on the surface of the lateral occipital cortex (Fig. 3) [67]. Similar to the ICVP project, an implanted AISC receives the stimulation parameters and power via wireless link from an external RF block connected to a pocket-size processor [68].
Although clinical trials for the CORTIVIS project have not started, preliminary investigations have been conducted on epilepsy patients to establish the safety of the implantation procedure as well as phosphene assessment [69]. All subjects perceived phosphenes and tolerated the procedure without complications. Stimulation of both early visual areas and extrastriate occipital cortex induced phosphenes with retinotopic representation. Phosphenes were described as flashing, colored or uncolored lights and stars and their sizes ranged from a “pinpoint” to occupying almost the whole visual field depending on the location and stimulation parameters.
Gennaris
The Gennaris bionic vision system is an intracortical visual prosthesis developed by Monash Vision Group supported by the Australian Research Council. Similar to the ICVP project, Gennaris uses a number of autonomous implant tiles to cover the visual cortex [70]. Each ceramic tile holds 43 electrodes protruding from its base and contains a receiver coil and an ASIC. A custom-designed “Pocket Processor” extracts the useful features from the image captured by the camera and generates a pattern of electrode activation to create the most helpful information for the user depending on the task at hand [71]. They introduced the concept of transformative reality (TR) that instead of being restricted to the direct visual representation of a scene asks the following question: “What combination of sensors, processing and rendering gives the most usability?” [72]. This could be as a simple as an edge detection algorithm to present the boundaries of the objects or it can integrate additional data from the environment into the image and use more complicated image processing and machine learning algorithms. For example to help patients with navigating cluttered indoor areas, they developed a TR mode that renders the patches of empty ground as phosphenes. The algorithm detects the ground plane using RANSAC plane fitting and real-time accelerometer data by estimating the direction of gravity.
Although the clinical trials for Gennaris have not started yet, safety and efficacy of the system have been verified in multiple ways. Chronic implantations and stimulation of electrodes were performed in rat motor cortex and electrode impedances were measured along with the stimulation thresholds required to evoke motor output [73]. Electrode impedances increased over the first 4 weeks of implantation and stabilized at weeks 5 and 6. Histology of the brain tissue collected after the implantation period demonstrated that healthy neurons were in close proximity to the neurons and there was minimal astrogliosis. Moreover, a sheep model was used to demonstrate the surgical implantation of Gennaris tiles. Preliminary data indicated the minimal damage to the cortex and wireless transmission of power and data between the external coil and implanted tiles were achieved [70]. Similar to the other intracortical electrode arrays, Gennaris tiles will neither be placed on the medial aspect of the hemispheres nor within the calcarine sulcus to prevent the damage to the adjacent cortex and ensure proper wireless communications. The initial plan is to insert up to six tiles (258 electrodes) above and below the calcarine sulcus. Psychophysics and patients training phase of the study will start with phosphene mapping and will followed by the integration of camera input.
Orion
Unlike other devices, the Orion device (Second Sight Medical Products) uses a surface grid for subdural stimulation of the visual cortex. Argus II is a retinal prosthetic device developed by the SecondSight that is commercialized and widely used specially in the USA. Orion inherits many features of Argus II including the external components (camera, VPU, and transmitter coil) and frameware. The implantable components of Orion include a receiver coil and internal circuit that sits on the skull (Fig. 4) and controls the stimulation parameters delivered by the electrodes. The subdural electrode grid consists of 60 surface electrodes placed on the medial occipital lobe spanning a portion of calcarine sulcus.
Orion is the only visual cortical prosthesis that has started the clinical trials. A preliminary study was performed by our group on a blind individual using an off-the-shelf neurostimulator at the University of California Los Angeles. Two 4-contacts subdural electrode strips were implanted over the right medial occipital lobe spanning a portion of the calcarine sulcus. Electrode strips were connected to a Neuropace RNS stimulator (NeuroPace RNS Inc., Mountain View, CA) placed within the crainium coplanar with the skull surface and was covered by the scalp. Phosphene mapping and threshold testing were performed for a period of 18 months and there were no clinical complications during and post implantation. Phosphenes were elicited by stimulation via all contacts and were scattered over the left side of the visual field. After confirming the safety and feasibility of cortical surface stimulation in generating phosphene perception, Orion received FDA approval for clinical trials. The device was implanted in five blind individuals at University of California Los Angeles and Baylor College of Medicine and all subjects reported perception of phosphenes. Psychophysical tests including phosphene mapping and threshold testing are currently being conducted and initial integration of camera with the stimulation is being tested.
Challenges and Potential Solutions
Subject Selection
Although progress in development of visual cortical prosthesis is accelerating in the recent years, more work needs to be done to achieve a practical device. Hence, it is not ethical to expose patients with any potentially functional residual visual to invasive brain surgery as the potential risk of loss of residual vision can have severe functional impacts. Therefore, performing visual function tests is an essential component for recruiting potential subjects as they estimate the subject’s capability of performing real life tasks using his/her residual vision if any. Moreover, these tests can provide a quantified measurement of visual function which can be acquired at various time points during the clinical trials and determine the device performance. For example, square localization, direction of motion, and grading visual acuity are visual function tests that have been sued for potential recipients of retinal prosthetics as well as clinical trials for cortical prostheses [74]. Also subjects who are qualified for retinal implants have a significantly higher chance of benefiting from retinal prostheses and are not proper candidates for cortical implants [74,75,76].
Electrode Array Design
One major dilemma in designing cortical prosthetics is the choice between intracortical or surface electrodes. While both techniques have previously proven to be feasible, each has its own limitations.
Spatial Specificity
Surface electrodes have relatively larger surface area and therefore require higher electrical currents to elicit phosphenes [52]. In theory, when multiple electrodes are stimulated, these large currents can interact in a nonlinear fashion evoking phosphenes with spatial properties different from what each electrode evokes individually [66]. However, Bosking et al. have shown that concurrent surface electrode stimulation of two sites separated by greater than 6–10 mm reliably elicits two phosphenes that are spatially close to where stimulation of each single electrode would elicit [61]. Also configuration of three electrodes appeared to largely follow the same rules and they could stimulate up to 4–6 electrodes and achieve perception of up to five phosphenes. Although these results do not contradict with the problem of spatial distortion, their findings indicate that with certain considerations (such as the distance between stimulated electrodes) evoking concurrent phosphenes with predictable spatial pattern is possible using surface electrodes.
Long-Term Stability
While penetrating microelectrodes provide higher spatial resolution with lower current thresholds, highly invasive nature of this approach undermines their long-term reliability. The electrical, mechanical, and biochemical mismatch between the electrodes and cortical tissue causes unwanted tissue responses including neuronal loss and glial encapsulation which can compromise stimulation capability of the device [77,78,79,80,81,82]. Subdural electrodes on the other hand do not require penetration of the cortex and have greater long-term stability [83, 84]. This allows them to be a reliable candidate for many long-term applications including BCIs [85, 86] and treatment of epilepsy [87, 88].
V1 Accessibility
Retinotopic maps of visual cortex reveal that a large portion of early visual areas (V1, V2, and V3) is located in the medial surface of occipital cortex [89]. So far, none of the microelectrode arrays have been or are planning to be implanted in the medial wall of the occipital lobe for two reasons: a) Risk of damage to the adjacent cortex and b) difficulty in wireless transmission when the receiver and transmitter coils are orthogonal [63, 66, 70]. Therefore, the occipito-dorso-lateral cortex is the preferred implantation site for microelectrode arrays and it might cover higher level visual areas (hMT+/V5 and LOC) where the likelihood of phosphene induction is relatively lower [90]. Moreover, this can potentially limits the eccentricity of the phosphenes as the ventro-medial areas of the occipital cortex is associated with the periphery of the visual field [91, 92].
Psychophysical Testing
Psychophysical testing provides a benchmark for a preliminary evaluation of the device performance and allows for gathering essential data for creating complex percepts [93]. Obtaining threshold levels and phosphene locations for each electrode are the two major components of psychophysical testing and are required for proper integration of camera with the implant.
Threshold Testing
Phosphene threshold is the minimum amount of current or charge required to elicit a phosphene. Thresholds may vary across the electrodes and depend on the stimulation parameters (frequency, pulse width, and burst duration). For instance, Dobelle et al. reported current thresholds for surface electrodes in the range of 1–4 mA for pulsewidth of 0.25 ms and frequency of 50 Hz [92]. He also showed that increasing pulsewidth and frequency tends to decrease the threshold levels while electrode size did not have a significant correlation with current thresholds [48]. Determining thresholds for each electrode allows of optimization of electrical stimulation delivery by minimizing the energy consumption and damage to the underlying tissue [94, 95]. Moreover, small phosphenes are often more desirable as they allow for creating patterns with higher spatial resolution. Phosphene size has been shown to increase for higher current levels [62]; therefore, stimulation at the threshold levels can potentially generate smallest phosphenes for each specific electrode.
Phosphene Mapping
The spatial representation of visual field is preserved and repeated multiple time across visual cortices, especially in the early visual areas [89]. Subject-specific retinotopic mapping of early visual areas can be obtained using functional MRI and projected on the unfolded cortical surface [91]. However, this requires some degree of visual function hence it is not applicable to blind individuals. Therefore, interactive phosphene mapping after implantation of visual cortical prosthesis is a necessary step to generate spatially relevant visual sensation. The most basic paradigm of phosphene mapping involves stimulation of each electrode and recording the location of the phosphene based on subjects feedback.
One of the challenges in collecting phosphene mapping data is the phosphene displacement in response to eye movement [39, 49, 54]. When a phosphene appears in the periphery of the visual field, subjects tend to track the phosphenes with their eyes. This results in the perceived phosphene location following the direction of eye movement using optomotor feedback [96]. To compensate for this effect, subjects are asked to focus on the center of the FoV using a tactile or an audio cue and maintain their gaze during stimulation. This consideration however may need to be maintained during daily usage of the device and subject needs to be trained accordingly. This issue can potentially be addressed by eye tracking and adjusting the phosphene mapping accordingly. This solution may not however be applicable to patients with enucleation or other traumatic causes of blindness which result in an absent globe.
Machine Learning
Measuring threshold levels and phosphene mapping provide essential data for the integration of camera and the neurostimulator to form a brain computer interface (BCI). A visual prosthetic BCI in its simplest form maps the light intensities in the visual field to charge/amplitude levels deposited on the surface of the primary visual cortex. This however may be problematic given the limited number of electrode and nonuniform arrangement of their corresponding phosphenes in the visual field. Incorporation of machine learning into the BCI could potentially improve the device performance in different ways. The TR approach being developed by the Monash group is an example of using machine learning for image processing to produce visual perception optimized for the specific task in hand such as navigation or face detection.
There have been significant advances in decoding intracranial recording of the visual pathway to detect and discriminate the complex visual perceptions using machine learning [97,98,99]. Moreover, stimulation of cortical areas further down the visual processing stream affects higher level and complex visual perceptions [100,101,102]. For instance, stimulation of fusiform gyrus is reported to alter face perception [103, 104] and reading capabilities [105, 106]. Although our understanding of this approach is too limited to produce relevant visual information, given the to-down and recurrent organization of the visual system [107, 108], it could potentially serve as a supplement to earlier visual cortex stimulation to produce a rich and more natural visual experience.
Conclusion
Development of cortical visual prosthetics has gained a great momentum in the recent years and based on current advances in electrode design and wireless communication, it is expected to restore some degree of vision in blind individuals. In this paper, we briefly reviewed the history and described the state of the art theses prostheses aiming to provide a basic understanding of the approach and potential challenges.
References
Stevens GA, White RA, Flaxman SR, Price H, Jonas JB, Keeffe J, et al. Global prevalence of vision impairment and blindness: Magnitude and temporal trends, 1990-2010. Ophthalmology. 2013;120(12):2377–84.
Varma R, Vajaranant TS, Burkemper B, Wu S, Torres M, Hsu C, et al. Visual impairment and blindness in adults in the United States. JAMA Ophthalmol. 2016;134(7):802–9.
Crews JE, Campbell VA. Vision Impairment and Hearing Loss among Community-Dwelling Older Americans: Implications for Health and Functioning. Am J Public Health. 2004;94(5):823–9.
Ivers RQ, Norton R, Cumming RG, Butler M, Campbell a J. Visual impairment and risk of hip fracture. Am J Epidemiol. 2000;152(7):633–9.
Jones GC, Rovner BW, Crews JE, Danielson ML. Effects of Depressive Symptoms on Health Behavior Practices Among Older Adults With Vision Loss. Rehabil Psychol. 2009;54(2):164–72.
Zhang X, Bullard KMK, Cotch MF, Wilson MR, Rovner BW, McGwin G, et al. Association between depression and functional vision loss in persons 20 years of age or older in the United States, NHANES 2005-2008. JAMA Ophthalmol. 2013;131(5):573–81.
Zheng DD, Christ SL, Lam BL, Tannenbaum SL, Bokman CL, Arheart KL, et al. Visual acuity and increased mortality: The role of allostatic load and functional status. Investig Ophthalmol Vis Sci. 2014;55(8):5144–50.
Freeman EE, Egleston BL, West SK, Bandeen-Roche K, Rubin G. Visual acuity change and mortality in older adults. Invest Ophthalmol Vis Sci. 2005;46:4040–5.
Frick KD, Gower EW, Kempen JH, Wolff JL. Economic impact of visual impairment and blinfdness in the United States. Arch Ophthalmol. 2007;125(4):544–50.
Congdon NG, Friedman DS, Lietman T. Important Causes of Visual Impairment in the World Today. Vol. 290, Journal of the American Medical Association. 2003. p. 2057–60.
Oliver JE, Hattenhauer MG, Herman D, Hodge DO, Kennedy R, Fang-Yen M, et al. Blindness and glaucoma: a comparison of patients progressing to blindness from glaucoma with patients maintaining vision. Am J Ophthalmol. 2002;133(6):764–72.
West S, Sommer A. Prevention of blindness and priorities for the future. Bull World Health Organ. 2001;79(3):244–8.
Resnikoff S, Pararajasegaram R. Blindness prevention programmes: past, present, and future. Bull World Health Organ. 2001;79(3):222–6.
Javitt JC, Wang F, West SK. Blindness Due to Cataract: Epidemiology and Prevention. Annu Rev Public Health [Internet]. 1996;17(1):159–77. Available from: https://doi.org/10.1146/annurev.pu.17.050196.001111
Deroy O, Auvray M. Reading the world through the skin and ears: A new perspective on sensory substitution. Front Psychol. 2012;3(NOV).
Bach-y-Rita PW, Kercel S. Sensory substitution and the human-machine interface. Vol. 7, Trends in Cognitive Sciences. 2003. p. 541–6.
Capelle C, Trullemans C, Arno P, Veraart C. A real-time experimental prototype for enhancement of vision rehabilitation using auditory substitution. IEEE Trans Biomed Eng. 1998;45(10):1279–93.
Hanneton S, Auvray M, Durette B. The Vibe: A versatile vision-to-audition sensory substitution device. Appl Bionics Biomech. 2010;7(4):269–76.
Lenay C, Gapenne O, Hanneton S, Marque C, Genouëlle C. Sensory Substitution : Limits and Perspectives. Touching Knowing Cogn Psychol haptic Man Percept [Internet]. 2003;19:275–292. Available from: http://books.google.com/books?hl=fr&lr=&id=GSOhMpdyobAC&pgis=1
Margalit E, Maia M, Weiland JD, Greenberg RJ, Fujii GY, Torres G, et al. Retinal prosthesis for the blind. Survey of Ophthalmology. 2002.
Luo YHL, da Cruz L. The Argus® II Retinal Prosthesis System. Progress in Retinal and Eye Research. 2016.
Ahuja AK, Dorn JD, Caspi A, McMahon MJ, Dagnelie G, DaCruz L, et al. Blind subjects implanted with the Argus II retinal prosthesis are able to improve performance in a spatial-motor task. Br J Ophthalmol. 2011
Luo YHL, Zhong JJ, da Cruz L. The use of Argus® II retinal prosthesis by blind subjects to achieve localisation and prehension of objects in 3-dimensional space. Graefe’s Arch Clin Exp Ophthalmol. 2015
Dorn JD, Ahuja AK, Caspi A, Da Cruz L, Dagnelie G, Sahel JA, et al. The detection of motion by blind subjects with the epiretinal 60-electrode (Argus II) retinal prosthesis. JAMA Ophthalmol. 2013
Da Cruz L, Coley BF, Dorn J, Merlini F, Filley E, Christopher P, et al. The Argus II epiretinal prosthesis system allows letter and word reading and long-term function in patients with profound vision loss. Br J Ophthalmol. 2013
Sahel JA, da Cruz L, Hafezi F, Stanga PE, Merlini F, Coley B, et al. Subjects Blind From Outer Retinal Dystrophies Are Able To Consistently Read Short Sentences Using The ArgusTM Ii Retinal Prosthesis System. ARVO Meet Abstr. 2011
Stanga P, Sahel J, Mohand-Said S, DaCruz L, Caspi A, Merlini F, et al. Face Detection using the Argus® II Retinal Prosthesis System. Invest Ophthalmol Vis Sci. 2013
Weiland JD, Liu W, Humayun MS. Retinal Prosthesis. Annu Rev Biomed Eng. 2005;
Edwards TL, Cottriall CL, Xue K, Simunovic MP, Ramsden JD, Zrenner E, et al. Assessment of the Electronic Retinal Implant Alpha AMS in Restoring Vision to Blind Patients with End-Stage Retinitis Pigmentosa. Ophthalmology. 2018
Stingl K, Bartz-Schmidt KU, Besch D, Braun A, Bruckmann A, Gekeler F, et al. Artificial vision with wirelessly powered subretinal electronic implant alpha-IMS. Proc R Soc B Biol Sci. 2013
Zrenner E, Bruckmann A, Greppmaier U, Hoertdoerfer G, Kernstock C, Sliesoraityte I, et al. Improvement of Visual Orientation and Daily Skills Mediated by Subretinal Electronic Implant Alpha IMS in Previously Blind RP Patients. In: ARVO Meeting Abstracts. 2011.
Stingl K, Bartz-Schmidt KU, Besch D, Gekeler F, Greppmaier U, Hörtdörfer G, et al. What can blind patients see in daily life with the subretinal Alpha IMS implant? Current overview from the clinical trial in Tübingen. Ophthalmologe. 2012
Haim M. Epidemiology of retinitis pigmentosa in Denmark. Acta Ophthalmol. 2002;
Hu DN Prevalence and mode of inheritance of major genetic eye diseases in China. J Med Genet. 1987;
Gröndahl J. Tapeto-retinal degeneration in four Norwegian counties II: Diagnostic evaluation of 407 relatives and genetic evaluation of 87 families. Clin Genet. 1986
Bunker CH, Berson EL, Bromley WC, Hayes RP, Roderick TH. Prevalence of retinitis pigmentosa in maine. Am J Ophthalmol. 1984
Bundey S, Crews SJ. A study of retinitis pigmentosa in the City of Birmingham. II Clinical and genetic heterogeneity. J Med Genet. 1984
Ammann F, Klein D, Franceschetti A. Genetic and epidemiological investigations on pigmentary degeneration of the retina and allied disorders in Switzerland. J Neurol Sci. 1965;
Veraart C, Raftopoulos C, Mortimer JT, Delbeke J, Pins D, Michaux G, et al. Visual sensations produced by optic nerve stimulation using an implanted self-sizing spiral cuff electrode. Brain Res. 1998
Veraart C, Wanet-Defalque MC, Gérard B, Vanlierde A, Delbeke J. Pattern Recognition with the Optic Nerve Visual Prosthesis. Artif Organs. 2003
Marg E, Dierssen G. Reported visual percepts from stimulation of the human brain with microelectrodes during therapeutic surgery. Confinia neurologica. 1965.
Panetsos F, Sanchez-Jimenez A, Cerio ED De Diaz-Guemes I, Sanchez FM. Consistent phosphenes generated by electrical microstimulation of the visual thalamus. An experimental approach for thalamic visual neuroprostheses. Front Neurosci. 2011
Pezaris JS, Reid RC. Demonstration of artificial visual percepts generated through thalamic microstimulation. Proc Natl Acad Sci. 2007
Löwenstein K, Borchardt M. Symptomatologie und elektrische Reizung bei einer Schußverletzung des Hinterhauptlappens. Dtsch Z Nervenheilkd. 1918;58(3–6):264–92.
Krause F. Die Sehbahn in Chirurgischer Beziehung und die Faradische Reizung des Sehzentrums. Klin Wochenschr. 1924;3(28):1260–5.
Foerster O. Beitrage zur Pathophysiologie der Sehbahn und der Sehsphare. J Psychol Neurol, Lpz. 1929;39:463.
Brindley GS, Lewin WS. The sensations produced by electrical stimulation of the visual cortex. J Physiol. 1968;196(2):479–93.
Dobelle WH, Mladejovsky MG. Phosphenes produced by electrical stimulation of human occipital cortex, and their application to the development of a prosthesis for the blind. J Physiol. 1974;243(2):553–76.
Dobelle WH, Mladejovsky MG, Girvin JP. Artificial Vision for the Blind: Electrical Stimulation of Visual Cortex Offers Hope for a Functional Prosthesis. Science (80- ) [Internet]. 1974;183(4123):440–4. Available from: https://doi.org/10.1126/science.183.4123.440
Dobelle WH, Mladejovsky MG, Evans JR, Roberts TS, Girvin JP. Braille reading by a blind volunteer by visual cortex stimulation. Nature. 1976;259(5539):111–2.
Dobelle WH. Artificial vision for the blind by connecting a television camera to the visual cortex. ASAIO J. 2000;46(1):3–9.
Bak M, Girvin JP, Hambrecht FT, Kufta C V., Loeb GE, Schmidt EM. Visual sensations produced by intracortical microstimulation of the human occipital cortex. Med Biol Eng Comput. 1990;28(3):257–9.
Bartlett JR, Doty RW. An exploration of the ability of macaques to detect microstimulation of striate cortex. Acta Neurobiol Exp (Wars). 1980;40(4):713–27.
Schmidt EM, Bak MJ, Hambrecht FT, Kufta C V., O’Rourke DK, Vallabhanath P. Feasibility of a visual prosthesis for the blind based on intracortical microstimulation of the visual cortex. Brain. 1996;119(2):507–22.
Bosking WH, Beauchamp MS, Yoshor D. Electrical Stimulation of Visual Cortex: Relevance for the Development of Visual Cortical Prosthetics. Annu Rev Vis Sci. 2017
Yoshor D, Bosking WH, Lega BC, Sun P, Maunsell JHR. Local cortical function after uncomplicated subdural electrode implantation. J Neurosurg. 2008;
Yoshor D, Bosking WH, Ghose GM, Maunsell JHR. Receptive fields in human visual cortex mapped with surface electrodes. Cereb Cortex. 2007;17(10):2293–302.
Winawer J, Parvizi J. Linking Electrical Stimulation of Human Primary Visual Cortex, Size of Affected Cortical Area, Neuronal Responses, and Subjective Experience. Neuron. 2016;92(6):1213–9.
Richard P, Bosking WH. Mapping of the Human Visual System. Clin Brain Mapp. 2012;219.
Lee HW, Hong SB, Seo DW, Tae WS, Hong SC. Mapping of functional organization in human visual cortex Electrical cortical stimulation. Neurology. 2000;54(4):849–54.
Bosking WH, Foster B, Sun P, Beauchamp MS, Yoshor D. Rules Governing Perception of Multiple Phosphenes by Human Observers. bioRxiv. 2018;302547.
Bosking WH, Sun P, Ozker M, Pei X, Foster BL, Beauchamp MS, et al. Saturation in Phosphene Size with Increasing Current Levels Delivered to Human Visual Cortex. J Neurosci. 2017;
Troyk PR. The Intracortical Visual Prosthesis Project. In: Artificial Vision. Springer; 2017. p. 203–14.
Rush AD, Troyk PR. A power and data link for a wireless-implanted neural recording system. IEEE Trans Biomed Eng. 2012;59(12 PART2):3255–62.
Kim T, Troyk PR, Bak M. Active Floating Micro Electrode Arrays (AFMA). In: Annual International Conference of the IEEE Engineering in Medicine and Biology - Proceedings. 2006.
Fernández E, Normann RA. CORTIVIS Approach for an Intracortical Visual Prostheses. In: Artificial Vision. Springer; 2017. p. 191–201.
Maynard EM, Nordhausen CT, Normann RA. The Utah Intracortical Electrode Array: A recording structure for potential brain-computer interfaces. Electroencephalogr Clin Neurophysiol. 1997;
Romero S, Pelayo FJ, Morillas CA, Martínez A, Fernández E. Reconfigurable Retina-Like Preprocessing Platform for Cortical Visual Neuroprostheses. In: Handbook of Neural Engineering. 2006.
Fernandez E, Alfaro A, Toledano R, Albisua J, García A. Perceptions elicited by electrical stimulation of human visual cortex. Invest Ophthalmol Vis Sci. 2015;56(7):777.
Lowery AJ, Rosenfeld J V, Rosa MGP, Brunton E, Rajan R, Mann C, et al. Monash Vision Group’s Gennaris Cortical Implant for Vision Restoration. In: Artificial Vision. Springer; 2017. p. 215–25.
Lowery AJ, Rosenfeld J V., Lewis PM, Browne D, Mohan A, Brunton E, et al. Restoration of vision using wireless cortical implants: The Monash Vision Group project. In: Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS. 2015.
Li WH, Tang TJJ, Lui WLD. Going beyond vision to improve bionic vision. In: 2013 IEEE International Conference on Image Processing, ICIP 2013 - Proceedings. 2013.
Wang C, Brunton E, Haghgooie S, Cassells K, Lowery A, Rajan R. Characteristics of electrode impedance and stimulation efficacy of a chronic cortical implant using novel annulus electrodes in rat motor cortex. J Neural Eng. 2013
da Cruz L, Dorn JD, Humayun MS, Dagnelie G, Handa J, Barale PO, et al. Five-Year Safety and Performance Results from the Argus II Retinal Prosthesis System Clinical Trial. Ophthalmology. 2016
Merabet LB, Rizzo JF, Pascual-Leone A, Fernandez E. “Who is the ideal candidate?” Decisions and issues relating to visual neuroprosthesis development, patient testing and neuroplasticity. J Neural Eng. 2007
Stingl K, Bartz-Schmidt KU, Besch D, Chee CK, Cottriall CL, Gekeler F, et al. Subretinal Visual Implant Alpha IMS - Clinical trial interim report. Vision Res. 2015
Liu X, McCreery DB, Bullara LA, Agnew WF. Evaluation of the stability of intracortical microelectrode arrays. IEEE Trans Neural Syst Rehabil Eng. 2006
Jorfi M, Skousen JL, Weder C, Capadona JR. Progress towards biocompatible intracortical microelectrodes for neural interfacing applications. Journal of Neural Engineering. 2015.
Schwartz AB, Cui XT, Weber DJJ, Moran DW. Brain-Controlled Interfaces: Movement Restoration with Neural Prosthetics. Neuron. 2006.
Goss-Varley M, Dona KR, McMahon JA, Shoffstall AJ, Ereifej ES, Lindner SC, et al. Microelectrode implantation in motor cortex causes fine motor deficit: Implications on potential considerations to Brain Computer Interfacing and Human Augmentation. Sci Rep. 2017;
Biran R, Martin DC, Tresco PA. Neuronal cell loss accompanies the brain tissue response to chronically implanted silicon microelectrode arrays. Exp Neurol. 2005;
Potter KA, Buck AC, Self WK, Capadona JR. Stab injury and device implantation within the brain results in inversely multiphasic neuroinflammatory and neurodegenerative responses. J Neural Eng. 2012;
Kipke DR, Shain W, Buzsaki G, Fetz E, Henderson JM, Hetke JF, et al. Advanced Neurotechnologies for Chronic Neural Interfaces: New Horizons and Clinical Opportunities. J Neurosci. 2008;
Margalit E, Weiland JD, Clatterbuck RE, Fujii GY, Maia M, Tameesh M, et al. Visual and electrical evoked response recorded from subdural electrodes implanted above the visual cortex in normal dogs under two methods of anesthesia. J Neurosci Methods. 2003;
Thompson MC, Herron JA, Brown T, Ojemann JG, Ko AL, Chizeck HJ. Demonstration of a stable chronic electrocorticography-based brain-computer interface using a deep brain stimulator. In: 2016 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2016 - Conference Proceedings. 2017.
Leuthardt EC, Schalk G, Wolpaw JR, Ojemann JG, Moran DW. A brain-computer interface using electrocorticographic signals in humans. J Neural Eng. 2004;
Nair DR, Burgess R, McIntyre CC, Lüders H. Chronic subdural electrodes in the management of epilepsy. Clinical Neurophysiology. 2008.
Wyler AR, Ojemann GA, Lettich E, Ward AA. Subdural strip electrodes for localizing epileptogenic foci. J Neurosurg. 1984;
Wandell BA, Dumoulin SO, Brewer AA. Visual field maps in human cortex. Neuron. 2007.
Schaeffner LF, Welchman AE. Mapping the visual brain areas susceptible to phosphene induction through brain stimulation. Exp Brain Res. 2017;
Benson NC, Butt OH, Brainard DH, Aguirre GK. Correction of Distortion in Flattened Representations of the Cortical Surface Allows Prediction of V1-V3 Functional Organization from Anatomy. PLoS Comput Biol. 2014;
Dobelle WH, Quest DO, Antunes JL, Roberts TS, Girvin JP. Artificial vision for the blind by electrical stimulation of the visual cortex. Neurosurgery. 1979;5(4):521–7.
Dagnelie G. Psychophysical Evaluation for Visual Prosthesis. Annu Rev Biomed Eng. 2008;
Shannon R V. A Model of Safe Levels for Electrical Stimulation. IEEE Trans Biomed Eng. 1992;39(4):424–6.
Merrill DR, Bikson M, Jefferys JGR. Electrical stimulation of excitable tissue: Design of efficacious and safe protocols. Vol. 141, Journal of Neuroscience Methods. 2005. p. 171–98.
Arathorn DW, Stevenson SB, Yang Q, Tiruveedhula P, Roorda A. How the unstable eye sees a stable and moving world. J Vis. 2013;
Ghuman AS, Brunet NM, Li Y, Konecky RO, Pyles JA, Walls SA, et al. Dynamic encoding of face information in the human fusiform gyrus. Nat Commun. 2014;
Liu H, Agam Y, Madsen JR, Kreiman G. Timing, Timing, Timing: Fast Decoding of Object Information from Intracranial Field Potentials in Human Visual Cortex. Neuron. 2009;
Kapeller C, Ogawa H, Schalk G, Kunii N, Coon WG, Scharinger J, et al. Real-time detection and discrimination of visual perception using electrocorticographic signals. J Neural Eng. 2018;
Aminoff EM, Li Y, Pyles JA, Ward MJ, Richardson RM, Ghuman AS. Associative hallucinations result from stimulating left ventromedial temporal cortex. Cortex. 2016;
Blanke O, Landis T, Seeck M. Electrical cortical stimulation of the human prefrontal cortex evokes complex visual hallucinations. Epilepsy Behav. 2000
Penfield W, Rasmussen T. The Cerebral Cortex of Man. A Clinical Study of Localization of Function.pdf. Academic Medicine. 1950.
Rangarajan V, Hermes D, Foster BL, Weiner KS, Jacques C, Grill-Spector K, et al. Electrical Stimulation of the Left and Right Human Fusiform Gyrus Causes Different Effects in Conscious Face Perception. J Neurosci. 2014;
Parvizi J, Jacques C, Foster BL, Withoft N, Rangarajan V, Weiner KS, et al. Electrical Stimulation of Human Fusiform Face-Selective Regions Distorts Face Perception. J Neurosci. 2012;
Mani J, Diehl B, Piao Z, Schuele SS, Lapresto E, Liu P, et al. Evidence for a basal temporal visual language center: Cortical stimulation producing pure alexia. Neurology. 2008;
Hirshorn EA, Li Y, Ward MJ, Richardson RM, Fiez JA, Ghuman AS. Decoding and disrupting left midfusiform gyrus activity during word reading. Proc Natl Acad Sci. 2016;
Kravitz DJ, Saleem KS, Baker CI, Ungerleider LG, Mishkin M. The ventral visual pathway: An expanded neural framework for the processing of object quality. Trends in Cognitive Sciences. 2013.
Kravitz DJ, Saleem KS, Baker CI, Mishkin M. A new neural framework for visuospatial processing. Nature Reviews Neuroscience. 2011.
Acknowledgments
The authors would like to thank the SecondSight Inc. for providing a platform that allowed us to have hands on experience with their state of the art cortical visual prosthesis (Orion) and understand some of the challenges of design, implantation, and testing of these devices.
Required Author Forms
Disclosure forms provided by the authors are available with the online version of this article.
Author information
Authors and Affiliations
Corresponding author
Electronic supplementary material
ESM 1
(PDF 510 kb)
Rights and permissions
About this article
Cite this article
Niketeghad, S., Pouratian, N. Brain Machine Interfaces for Vision Restoration: The Current State of Cortical Visual Prosthetics. Neurotherapeutics 16, 134–143 (2019). https://doi.org/10.1007/s13311-018-0660-1
Published:
Issue Date:
DOI: https://doi.org/10.1007/s13311-018-0660-1