Abstract
In the absence of vision, visually impaired and blind people rely upon the tactile sense and hearing to obtain information about their surrounding environment. These senses cannot fully compensate for the absence of vision, so visually impaired and blind people experience difficulty with many tasks, including learning. This is particularly true of mathematical learning. Nowadays, technology provides many effective and affordable solutions to help visually impaired and blind people acquire mathematical skills. This paper is based upon a systematic review of technology-based mathematical learning solutions for visually impaired people and discusses the findings and objectives for technological improvements. It analyses the issues, challenges and limitations of existing techniques. We note that audio feedback, tactile displays, a supportive academic environment, digital textbooks and other forms of accessible math applications improve the quality of learning mathematics in visually impaired and blind people. Based on these findings, it is suggested that smartphone-based solutions could be more convenient and affordable than desktop/laptop-based solutions as a means to enhance mathematical learning. Additionally, future research directions are discussed, which may assist researchers to propose further solutions that will improve the quality of life for visually impaired and blind people.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
1 Introduction
People may have various degrees of sight loss, ranging from low vision (usually defined as having a level of visual acuity in the better eye which falls below a certain standard despite correction) through to complete or nearly complete absence of vision. Blindness affects a significant minority of the human population. According to a report (WHO 2019), 2.2 billion people are estimated to be visually impaired worldwide and one billion of these have a vision impairment that is yet to be addressed [1].
Interaction with computers and smartphones is predominantly based on vision, limiting or precluding access for those who are visually impaired or blind. Similarly, in educational institutes, teaching methodologies are heavily dependent upon visual information, i.e., instructor gestures, slide shows, writing and sketching on a board. Visually impaired and blind people can use technology to perform daily routine tasks such as communication with their friends, accessing online information, and e-learning.
Mathematics plays an important role in education, from the primary level through to higher education. Mathematics requires an understanding of a number of concepts, including addition, subtraction, multiplication, division, expressions, formulas, logic, graphs, algebra and algorithms. Ideally, visually impaired students should learn these concepts in the early stages of their education, at the same time as their fully-sighted peers. However, mathematics has rich visual content and information which may present problems for visually impaired students [2]. During mathematical learning, visually impaired students may have difficulty recognizing symbols, identifying equations, understanding graphs, and performing arithmetic operations. Emerson et al. [3] noted that materials used in mathematics education may include visual images supporting related content, making it inaccessible for visually impaired students. Diagrams, figures and graphs are used to express the relationship between data in a way which is helpful for fully-sighted students but may present barriers for visually impaired students [4]. Mathematics students should be able to use the information presented in graphs, etc., and apply it in order to solve problems, but this may not be possible for visually impaired students [5, 6].
Computer-based learning has a positive impact on enhancing mathematical skills[7]. Continual enrichment in digital technologies increases the use of technological tools in mathematics learning [8,9,10]. Technology provides an opportunity for visually impaired students to access mathematical information using audio-based interfaces, tactile devices and Braille [11,12,13,14,15,16,17]. These Assistive Technology (AT) based learning tools can make educational platforms more interactive, engaging and easy to use for visually impaired and blind people, and can also facilitate collaboration. Web-based applications are also very useful because the material—provided it is correctly formatted—can be accessed by everyone regardless of their disability. Smartphone-based solutions are also of interest because, although smartphones may be less accessible and adaptable than other devices, they are also generally less expensive, have a wide range of features, and are widely used throughout the world, including by visually impaired and blind people [18]. These solutions have important features which are very useful for visually impaired and blind people, i.e., Text-to-Speech, Speak Selection, Voice Over/TalkBack, adjustable contrast, zoom and voice command along with several non-speech audio feedback options [19].
The previous surveys provide an overview of the currently available software tools for accessing mathematical documents and content. They also discussed the advantages and disadvantages of several key technologies used to interact with mathematics documents. Additionally, they review the importance of the most common formats and languages behind these tools. In this article, we are dealing with assistive technology-based solutions for learning mathematics for visually-impaired people and exploring the issues, challenges and opportunities in a broader scope. We have reviewed previous studies that explored experimental and commercial applications, running on various platforms (laptop/desktop, smartphones and the web) to illustrate how visually impaired and blind students can learn mathematics by using them. We have considered both general solutions and those designed to support specific tasks in order to obtain information on the accessibility of mathematics learning tools. We have investigated AT-based tools, techniques, algorithms, systems and projects, and provided a comparison of their major functions, the nature of the feedback they provide, input and output mechanisms, and the mathematical operations which they are designed to support. We have also considered the challenges that visually impaired individuals faced when learning mathematics using commercial and experimental smartphone applications and discussed how we can address these challenges in novel ways. In addition, we have extracted the features of these math learning applications and proposed a categorization of these solutions that we hope will prove useful to researchers and developers seeking to develop effective solutions for visually impaired and blind students. Based on the findings, recommendations are made for researchers who are working to enhance learning among visually impaired and blind people. Finally, this article discusses the need for further research to improve the development of mathematical software tools that are designed specifically for visually impaired and blind individuals, taking into account their unique needs and challenges.
The paper is organized as follows: Section 2 describes the methodology used for the review; Section 3 reviews relevant theoretical work, Section 4 provides an overview of experimental solutions proposed to assist blind and visually-impaired people in teaching or learning mathematics, both general solutions and those designed to support specific tasks; Section 5 discusses commercial and research-based applications available for learning mathematics; Section 6 presents a discussion of the findings; Section 7 concludes the current study and Section 8 contains recommendations for future research.
2 Research Methodology
In our systematic literature review, we have followed the guidelines proposed by Kitchenham and Charters [20]. In this section, we have defined the research questions, search strategies, study selection criteria and classification of the research articles.
2.1 Research questions
To assess the significance of technology on the development of mathematical abilities among visually impaired and blind students, we have addressed the following research questions:
-
RQ1. What is the impact of technology on the development of mathematical abilities among visually impaired and blind students?
-
RQ2. What are the challenges/issues facing visually impaired and blind students using commercial and researcher-based applications?
-
RQ3. Can the development of smartphone-based applications be useful in helping visually impaired and blind people to learn mathematics?
2.2 Search strategy
This study involved a systematic search of articles and studies that were published after January 1990. The targeted population of the study is visually impaired and blind people.
-
1)
Identifying Search Terms
For this study, we extracted major terms from the research questions and also explored the synonyms of these terms. We searched relevant research articles and verified the keywords. Additionally, we used Boolean operations, i.e., ‘OR’ for conjunction, ‘AND’ for concatenation.
-
2)
Search Strings
[(“Technology” OR “Assistive Technology” OR “Digital Tools”) AND (“mathematical ability” OR “math skill” OR “Learning mathematics”) AND (“visually impaired” OR “blind” OR “low vision”), AND (“Commercial Applications” OR “researcher-based application” OR “assistive technology”) AND (“visually impaired” OR “blind” OR “low vision”) AND (“challenges” OR “issues” OR “barriers” OR “obstacles”) AND (“mathematics” OR “math learning”), (“Smartphone-based application” OR “mobile application” OR “mobile learning”) AND (“visually impaired” OR “blind” OR “low vision”) AND (“mathematics” OR “math learning”) AND (“assistive technology” OR “accessibility”), (“Blind” OR “Visually Impaired” OR “Low Vision” OR “unsighted” OR “partially sighted”) AND (“Information Technology” OR “Innovative Technology” OR “Computer-Based system” OR “Virtual Reality” OR “Assistive Technology” OR “Smartphones” OR “games”) AND (“Learning mathematics” OR “Math skills” OR “Useful mathematics learning applications” OR “Helpful math learning applications” OR “Development of mathematical abilities”)].
-
3)
Trial Search
We conducted a trial search using the above-mentioned search strings on ResearchGate, Citeseer, Springer Link, Google Scholar, IEEE Xplore, ACM, Science Direct and Scopus digital libraries. Table 1 lists the number of results found on various electronic data sources.
2.3 Study Selection Criteria
We have searched for articles using the above search strategies. Relevant studies, which are in English and have been peer-reviewed (i.e., journal articles and conference papers) were selected for inclusion in this study.
1) Inclusion Criteria
We included studies that met the following criteria:
-
Studies that express the theoretical and evidence-based concept of mathematical learning for visually impaired students.
-
Studies that contain AT-based solutions to help visually impaired or blind people learn mathematics.
-
All related studies that define search terms, answer the research questions and are in the English language were considered for this article.
-
2)
Exclusion Criteria
We have excluded the studies that did not link with learning mathematics, AT and visually impaired or blind people. Studies that were out of scope did not answer the research questions, did not define the search terms or were not written in English were also excluded. Research articles without original data were also excluded.
-
3)
Data Extraction and Assessment of Study Quality
According to our inclusion criteria, all relevant data that fulfilled the requirements and were within the scope were considered for this study. During data extraction and assessment of study quality, we have considered the following points:
-
Proper matching of inclusion and exclusion criteria with the selected studies.
-
Studies included their findings to help answer the main research questions.
-
Literature search has covered all the relevant studies.
-
Duplicate articles and articles without empirical evidence.
-
The quality of included studies has been assessed properly by authors and reviewers.
-
Articles that did not meet the aims and objectives of this study.
-
Articles for which the full text was not available.
-
4)
cross-reference the citations
Cross-referencing is a powerful tool that can be used to quickly find related material and enhance our quality of work. We have performed a cross-reference search of the citations to ensure that all relevant studies are included in the review. It helped us in the identification of some additional studies that were not captured in the initial database search and increased the completeness of the review. We repeated this process until a saturation point was reached at which no new relevant information emerged from the literature search, indicating that the search had been comprehensive.
Using the above criteria, we have identified 72 articles published between January 1990 and May 2023. Figure 1 shows the structure of our research methodology and the total number of articles included in this study.
2.4 Classification of the research articles
This section helps to understand the classification of the research articles that are part of the current study.
-
a)
Theoretical literature review: Studies that help to define, explore, understand and conclude the topic under consideration. It included psychological, physiological, pedagogical and other relevant theories. Studies part of this section do not describe general and targeted solutions.
The papers in this category are considered in Section 3.
-
b)
Papers which describe practical solutions addressing general issues, with user studies: These studies address more general issues (e.g., use of speech, non-speech audio or Braille potentially across a range of applications) and have experimental evaluation through participants' involvement. We have summarised them by listing their objectives, participants involvement during experiments and listed their key findings.
The papers in this category are considered in Section 4.1.
-
c)
Papers which describe practical solutions designed to support specific tasks, without user studies: These papers all describe solutions aimed at specific problems within mathematics (e.g., learning algebra, exploring graphs, etc.), but none of them include user studies. We have summarised their major features, the mathematical operations they address, and the feedback and input/output mechanisms they employ. This data is presented in the form of a table.
The papers in this category are considered in Section 4.2.
-
d)
Commercially available applications: This category covers applications which are available commercially or for free download which have not been described in published research papers, and therefore are not considered under any of the above categories. They include smartphone applications which are available from charitable and educational organisations or through the Google play store or the Apple AStore.
The papers in this category are considered in Section 5.1.
-
e)
Papers which describe practical solutions designed to run on smartphones.
Only articles describing solutions designed to run on smartphones are included in this category. Most are designed to support specific tasks rather than general solutions. Most of these applications have been evaluated through user studies.
The papers in this category are considered in Section 5.2.
3 Background and literature review
In this section, we look at theoretical studies that consider psychological, physiological, pedagogical and other relevant theories, but which do not describe practical solutions, and do not present the results of user studies aimed at assessing how previous research might be applied in the design of solutions. Visually-impaired people face a number of problems during learning mathematics. Several researchers have developed AT-based solutions which may be useful for visually-impaired people in learning mathematics. Mejia et al. surveyed currently available tools that are useful for accessing mathematical content [21]. Armano et al. [22] conducted a study to examine the issues faced by visually impaired students when accessing mathematical content in University Teaching Materials (UTM). They described instruments and software-based learning methods for visually impaired students such as LeanMath, which makes it easier for visually impaired students to use a graphical interface; MathType, which makes graphs more accessible in Word documents with the help of speech synthesis and hotkeys; MathPlayer, which makes formulas more accessible by using MathType; LaTex and BlindMath, which makes TeX easier for visually impaired people to use; LAMBDA, which is used to write math formulas. These solutions empower visually impaired students to write the text along with mathematical content.
Visually impaired students can face trouble in managing structural elements of mathematic formulas.
The Universal Mathematics Accessibility (UMA) [23] system was developed in association with multiple institutes. The main purpose of this system is to make mathematics accessible all over the world. UMA has a translator that converts documents into formats that can easily be accessed by visually impaired people. It provides support for the inter-conversion of different math representations i.e., visual markups and Braille. Visually impaired people can also uniformly access and navigate mathematical expressions independently.
Due to the diverse nature of mathematical notations, it is hard to share documents internationally. LAMBDA [24] was a European project aimed at assisting visually impaired students in accessing mathematics. LAMBDA uses 8 dot Braille code, whereas many countries (e.g., Germany, Italy and France) generally use 6 dot notation. This project had two major components, the first was the LAMBDA code and the second was a mathematical editor. The LAMBDA system offers functional integration of the mathematical code, an editor for writing, and the proper utilization of texts for better understanding [25].
MathPlayer [26] is a free plug-in for Microsoft’s Internet Explorer which offers MathML [27] for visually impaired people. It can also be used with other browsers, e.g., Firefox. It dynamically displays the expression, supports multiple font sizes, provides screen magnification and supports speech generation. It also integrates with different screen readers, e.g., JAWS and Window-Eyes and NVDA.
REMathEx [28] enables visually impaired and blind students to access complex mathematical expressions. The proposed system uses a Braille display and speech synthesis outputs together to offer all necessary information relevant to the mathematical expressions. Users can navigate within the expression easily, and can also modify the expression using REMathEx.
4 General and targeted solutions
In this section, we first look at studies which explore the development of mathematical skills among visually impaired and/or blind students through user studies. We then look at tools which are designed to perform specific tasks (e.g., tools for presenting graphs, learning algebra, etc.) concerning mathematics learning among visually impaired and/or blind people. The papers in the latter group do not include user studies.
4.1 Papers which describe practical solutions addressing general issues, with user studies
In this section, we look at studies concerning mathematics learning among visually impaired and/or blind people which have clearly stated research objectives and which were evaluated in practical studies with members of target groups. Table 2 summarises these studies, listing their objectives, participants involvement during experiments and key findings.
4.2 Papers which describe practical solutions designed to support specific tasks, without user studies
In this section, we have considered only those research-based studies that have important activities, mathematical operations to solve, feedback mechanisms and input/output associated with them. We considered tools, techniques, algorithms, systems and projects for this purpose i.e., Electrostatic haptic touchscreen system, The Haptic Deictic System, Speaking Math, AfL system, MathSpeak, ASTER, Mathtalk, CONGRATS, Mathgrasp, MATHS and MAVIS.
An electrostatic haptic touchscreen system [43] was used to present dynamic, graph-based data to visually-impaired users and device experts. A total of 12 visually impaired users aged between 9–50 years participated in this study. The results demonstrated that users were able to find the haptic points accurately and developed effective patterns of interaction while using the touch screens. Some haptic components were positioned at the corners of the screen, and these were easily explored by users.
The Haptic Deictic System (HDS) [44] enables visually impaired and blind people to understand the instructor's gestures in the classroom with the help of a haptic glove and cameras. The haptic glove fingertip also facilitates the replacement of visual information during reading. The authors conducted an exploratory study with four visually impaired and two sighted students who have teaching experience and acted as their guides. With the help of the experimental system, an instructor could be confident that all students were following the lecture content, able to tell when students were confused and could verbalize the information represented in the graphs. All of the visually impaired students reported that they could easily understand mathematical concepts when using the system and that the system was not annoying for them.
A computer-based VISO (Voice Input, Speech Output) calculator [45] assists visually impaired students in solving computational problems in mathematics. A single-subject design was used for the training, assessment, and intervention of three visually impaired students of ages 18–19 years. The findings suggest that the time and average number of attempts to solve problems significantly decreased when using the VISO calculator. The visually impaired students reported that problem-solving was easier when using this calculator as compared to other typical means of calculation. Lastly, participants reported that they would like to have an accessible graphing calculator.
Adaptive Content with Evidence-based Diagnosis (ACED) [46] allows visually impaired people to explore the usability of the AfL (Assessment for Learning) system to access algebra content using audio-tactile graphics. It was used to support four visually impaired students, aged 17–29 years, in learning algebra. Participants were interviewed before and after the study. The results showed that users felt comfortable with the audio and interactive tactile graphics. All participants gave positive feedback on the accessible features of the AfL system.
Isaacson et al., [47] designed an algorithm for enhancing the synthetic speech used in the MathSpeak application. They performed efficiency testing on a developed algorithm by considering some parameters i.e., quality of synthetic speech, reception accuracy and MathSpeak processing capacity. Six visually impaired and twenty-one sighted students took part in this study. The results demonstrated that the use of the experimental algorithm improved the performance of MathSpeak, and the capabilities of participants to perform mathematical activities to fulfil their needs were enhanced.
ASTER [48] provides visually impaired people with access to technical documents using auditory representations of the content. Various rendering rules are written in AFL (Audio Formatting Language) to produce different views of the information. OCR-based document recognition was used to browse the internal structure of a document which provides appropriate information to the users. ASTER was implemented using Lisp-CLOS along with an Emacs front-end to present several types of content to visually impaired users.
The Mathtalk system [49, 50] enables visually impaired people to read algebraic expressions and provides speech and non-speech-based ways to interact with the user interface. This was developed in three phases: presentation of the information based upon speech; addition of browsing to identify the best control features in the reading process and inclusion of an audio glance to facilitate rapid audio access to information. A variety of interactive features are introduced to facilitate visually impaired people i.e., auditory mode, direct manipulation style interaction and information flow control. With the help of these features, Mathtalk transforms passive listeners into active readers.
CONGRATS [51], proposed by T.V Raman, is designed to provide a wide range of aid to visually impaired people in plotting and scanning curves. Users can build a computer display either by selecting the options or by specifying the equation of the curves. Once the curve is drawn on-screen, users can access it using audio scans. With the help of sound, a large amount of information can easily be accessed by visually impaired people.
Mathgrasp [52] is a nonvisual application that combines spatial sounds and gestures to allow visually impaired students to manipulate algebra notation. Algebraic expressions are divided into parts, and visually impaired students can access them using synthetic speech. Gestures are very important during conversation with others, so gestural interaction was used to investigate the effect of body movement on gestural interfaces. Users have variations in their gestures, so algorithms were developed to recognize them. The authors introduced gesture-based interfaces to manipulate the algebraic equations and displayed them on a (vertical) auditory spatial display.
The MATHS [53] project was an initiative of the Commission of the European Communities TIDE (Technology Initiative for Disabled and Elderly People) programme. It aimed to provide better access to reading and manipulation of mathematics equations for blind and visually impaired students. It could be used for educational, occupational and personal purposes. It was quite complex to achieve the functionalities of each aspect, so a four-layered approach was used: distributed layer, cognitive layer, perceptual layer and mechanical layer. The authors enhanced the mechanism through which the visual representation was assessed using spatial audio. Second and third-level students could easily read and practice mathematics on MATHS workstations according to their educational preferences, making it useful for a wide range of potential users.
MAVIS [54] was developed using logic programming. The main goal was to facilitate visually impaired students in reading and writing complex mathematical notations. The best educational mechanism for visually impaired students requires two-way communication, visual or printed output for sighted instructors and quality tactile materials or audio feedback for visually impaired students. This is a comprehensive approach which facilitates users and provides more convenient access to the information. Table 3 provides a detailed comparison of the tools, techniques, algorithms, systems, and projects discussed in the proceeding text.
5 Commercial and research-based smartphone solution
In this section, we have described commercial and research-based applications. Listed the features and categorization of available solutions. Additionally, discussed a conceptual model of learning mathematics.
5.1 Commercially available applications
The papers discussed above describe research studies, some of which have yielded tools and systems which are available for free download or through charitable and educational organisations. In addition, there are several computer-based, iOS and Android-based commercial applications which are designed to aid visually impaired students in learning mathematics. Most apps use a voice support function which allows the users to have action awareness within the app. These apps are available for all age groups and are generally easy for visually impaired and blind people to use. Table 4 lists various iOS and android based applications along with features, findings, challenges and issues.
5.2 Papers which describe practical solutions designed to run on smartphones
Studies describing smartphone-based applications that have been published in research are part of this section i.e., i-Math, iCETA and AudioMath. The i-Math [55] is an automatic math expression reading system used to facilitate visually impaired students in retrieving mathematics material. It works with a screen reader and provides an auditory output on a computer system. Students can access the information and teachers can prepare their handouts and exercises in audio form. A total of 78 visually impaired students and six teachers participated in an evaluation of the system. The results showed that mathematical material is easily available and accessible for visually impaired students using iMath. The students were able to practice the mathematical task independently and comfortably. The iCETA game [56] provides an interactive learning environment to visually impaired children using haptic and auditory feedback. Visually impaired students can easily understand numbers concepts with the help of various representations i.e., color, Braille, haptic and audio feedback. AudioMath used auditory interfaces to enhance the mathematics skills of blind children. Ten children participated in this study. Results showed that with the help of proposed interfaces mathematical skills were improved [57].
5.3 Features of Commercial and research-based math learning applications
In this section, we listed the features of commercially-available applications discussed in Sect. 5.1, and the smartphone-based applications discussed in Sect. 5.2. We have mentioned ten commercially and research-based available applications, namely Math Robot™, Draw2Measure Protractor, Slapstack Math, Practice2Master Fractions, UAbacus, Math Melodies, TouchMath Counting, i-Math, iCETA Tangible Math and AudioMath and extracted their common features. Table 5 lists the names of the commercial and research-based applications along with their feature.
Figure 2 shows that seven applications have multiple modes, five applications have magnification, ten applications have voice support function, three applications have braille support and nine applications offer an interactive interface (i.e., easy interaction, clear purpose, high usability, better color contrast and sizes of the UI element).
5.4 Categorization of available solutions
We have categorized the available solutions described in the papers as Multimodal, Braille, Desktop and Smartphone-based solutions. Multimodal approaches include two solutions, namely REMathEx and LAMBDA. There were three Braille-based solutions, namely 3D printers, tactile graphics and Braille mapping of geometry diagrams. There are eight desktop-based solutions, namely MathPlayer, MathML, LaTeX-access, Speaking Math calculator, Audio Math, AfL system, Mathtalk and Mathematics for all. Ten smartphone-based solutions formed part of the current study, namely Math Robot™, Draw2Measure Protractor, Slapstack Math, Practice2Master Fractions, UAbacus, Math Melodies, TouchMath Counting, i-Math, iCETA Tangible Math and MathSpeak. Figure. 3 showed the information on available solutions in the current study.
5.5 Conceptual Model of learning mathematics
Mathematics plays an important role in education, and every student should have the opportunity to learn mathematics. Learning is a process whereby anyone can enhance his knowledge by transforming his experience. Visually impaired students normally use the auditory and tactile senses in the absence of a visual channel. So, for visually impaired students, the quality of the learning experience depends upon a good teacher and AT-based solutions. Teachers should design the course content, assignments, handout and other activities by using assistive technologies so that learning becomes easier.
Figure 4 provides a conceptual model of learning mathematical skills using AT. They can communicate with other devices, the learning environment, other people and their teachers by using AT. This model shows that AT empowers visually impaired users to significantly enhance their mathematical skills.
6 Discussion
Previous research has shown that AT provides the opportunity for visually impaired and blind students to enhance their learning process by using accessible mathematical materials. This discussion section has three parts to elaborate on the impact of technology on the development of mathematical abilities among visually impaired and blind students.
-
1.
The first part provides an overview of teaching mathematics to visually impaired people
-
2.
The second part is about the applications and their features for learning Mathematics in AT.
-
3.
The third part presents a categorization of available solutions.
Firstly, a systematic review of previous studies was conducted. Most studies were evaluated on visually impaired and/or blind participants. The findings showed that accessible math materials(material that is in a format which is optimised for accessibility), academic support, haptic feedback, tactile graphics, digital books and audio-based platforms are very useful to address the challenges of visually impaired people. Earlier research also demonstrates that mathematical material can be made easily understandable for visually impaired students, and by using that material their learning process can be enhanced [58, 59]. It is a challenging task for visually impaired students to access information presented in graphic form. This information can be accessed using AT-based solutions where the focus is shifted towards hearing and touch-based techniques. The comparison of tools, techniques, algorithms, systems and projects provides a detailed overview of the current solutions used for enhancing the mathematical skills of blind and visually impaired people. These solutions offer several functionalities such as: converting graphics into sound, syntactic speech rendering, audio-tactile graphics, designing gestural interfaces and introducing audio-based mathematical reading systems (i.e., technical content and mathematical formulas). We have also listed the feedback mechanism, and the input and output mechanisms used by each system used to handle different mathematical operations i.e., visualizing graph-based information and accessing algebra content using audio-tactile graphics. It is also found that users can access math formulas, algebra expressions, complex math equations and geometry shapes using these solutions. Several forms of feedback were used in the designing of these solutions i.e., synthetic speech, non-speech, haptic, sound cues and tones. It is also noticed, that whenever spatial sound, auditory and hepatic feedback is available along with visual and textual information then visually impaired users can easily perceive the information. (RQ1).
Secondly, we have discussed commercial and research-based applications of learning Mathematics in AT. These applications present the graphical information of mathematics to visually impaired students using Braille notation, tactile displays, interactive interfaces, screen readers, voice synthesizers and zooming programs. The voice support function of the applications is quite useful for visually impaired and blind people. They can access mathematical formulas and solve problems using this function. Research shows that applications with the combination of audio and tactile feedback significantly enhance the process of learning mathematics. We have also explored the features of available applications such as voice support function, audio-visual elements, multi-modal feedback, audio icons, self-voicing functions, low vision mode, braille support, multisensory support and math flashcards. These features are available in current applications to facilitate visually impaired and blind students. We have also provided a comparison of some common features of the applications i.e., interactive interface, multiple modes, magnification, voice and braille support. Comparison results showed that every application has a voice support function and with the help of this function, visually impaired students can access the material easily. Visually impaired and blind students faced several challenges during the use of commercial and researcher-based applications. For example, applications are not designed according to the accessibility features and are unable to cater to the needs of visually impaired and blind students i.e., problems with feedback (lack of screen reader). It is noticed that some applications are not designed in a way that blind and visually impaired students can use them easily i.e., have rich visual information and complex navigation mechanism. Some applications have limited functionalities which can make it challenging for these students who are looking for a solution that provides support to them on various topics of mathematics.(RQ2).
Thirdly, the categorization of the available solutions is described as Multimodal, Braille, Desktop and Smartphone-based solutions. These categorizations clearly showed that smartphone-based solutions are more prominent and there is a lack of multimodal approaches to provide support to visually impaired and blind students in learning mathematics. On the other hand, researchers' intentions towards developing smartphone-based solutions are quite high as compared to Braille and computer-based solutions. Mostly visually impaired people can easily afford mobile devices and have satisfactory experiences with them. Also, several useful and free applications are available from astores. With the help of smartphone-based solutions, users educational abilities could enhance and their learning behaviour can be significantly improved. It was also noted that educational material supported by smartphone-based applications gave a positive impact on the learning outcomes of visually impaired students. Smartphones are also equipped with accessibility functions that provide easiness to visually impaired people in accessing information. (RQ3).
7 Conclusion
We have concluded in this article that AT facilitates visually impaired and blind people in learning mathematics and provided a detailed review of some existing tools, techniques, applications and games. Developments in e-learning have proved beneficial for educational enhancement, but also pose challenges for visually impaired students [60,61,62,63]. Research has shown that various challenges and issues were overcome using AT-based solutions, i.e., accessing graphical information, lack of independent learning, high color contrast and large print numbers. We have found that unimodal learning systems are less effective than systems that offer multimodal approaches to access math resources. In multimodal techniques, we can combine different approaches i.e., Braille, synthetic speech, tactile visual display, tangible resources and tangible user interfaces. With the help of innovative technologies, various computer-equipped solutions have been developed, such as a GUI calculator and a virtual learning platform for the web environment [64, 65].
Additionally, mobile devices and app-based interventions are very useful, affordable and have a positive impact on the educational system [66]. The smartphone-based solutions also provide multiple representations of information i.e., audio and tactile feedback, zooming, pictures, video, animation, user control, and repetition of tasks, and can serve to create a personalized learning environment [67,68,69].
Furthermore, the learning environment, technology-based training, student motivation and teacher expertise play an important role in the learning of visually impaired and blind people. It is also recommended to have academic, technological and specialized support for visually impaired and blind people learning mathematics. Visually impaired and blind students prefer applications that allow them to practice mathematical tasks independently and comfortably. We have seen that AT-based solutions can minimize several challenges faced when accessing graphical and visual content in mathematics, and enhance problem-solving skills in visually impaired and blind students.
Moreover, different study designs, data collection and analysis approaches were used in previous research i.e., qualitative research methodologies, UCD, usability studies, exploratory studies, single-subject designs and efficiency testing of algorithm parameters. Previous research studies showed that interviews, questionnaires and participant observation were very useful for the assessment of studies. Pre-study training sessions gradually enhance the skills of visually impaired and blind people and are also helpful for their learning intervention.
The research reviewed here suggests that provided the instructor successfully motivates students regarding the use of digital textbooks, it can be more useful for them to access mathematics material in this way rather than using traditional methods. Finally, earlier studies showed that AT-based solutions have a positive impact on the learning skills of visually impaired and blind people. Assistive and innovative technologies are also very useful for overcoming challenges and issues facing visually impaired and blind people. The development of smartphone-based solutions empowers visually impaired and blind users by providing them with accessible material on mathematics.
Lastly, we have introduced a conceptual model of learning mathematical skills using Assistive Technology (AT). This model shows that AT empowers visually impaired users to significantly enhance their mathematical skills. We have categorized the available solutions described in the papers as Multimodal, Braille, Desktop and Smartphone-based solutions that could be helpful for readers and other researchers. We have discussed the commercially-available and research-based applications. Extract their features i.e., multiple modes, magnification, voice support function, braille support and interactive interface. We have identified the challenges/issues faced by visually impaired and blind students using current solutions and provided this information in the discussion section which is very useful for other readers. We are trying to encourage researchers to get familiar with the unsolved challenges of this topic.
Researchers and adevelopers should keep in mind that every visually impaired and blind student has a different level of knowledge and intellectual abilities, Therefore, newly-designed applications should offer learning modules at various levels, integrated with Artificial Intelligence-based modules that can identify the user's abilities and identify the learning level of the users. In addition, adopting a Universal Design approach may help to meet the needs of all users. Artefacts developed using universal design can be accessed and understood by all kinds of users regardless of their abilities, knowledge or disabilities. Universal design can provide an accessible, usable, suitable and pleasurable environment to everyone.
There are also some issues and limitations in current applications. Due to these limitations visually impaired and blind students feel difficulty in accessing structural information and mathematical formulas. To address these problems, developers should introduce an ‘ask for help’ module which offers additional clues about the specific task and assists visually impaired students when they cannot remember the next steps. Additionally, desktop-based solutions have some drawbacks such as limited portability, lack of touch screens, increased space and cabling requirements, and access to mains power. Smartphone-based solutions offer advantages for visually impaired and blind people because they are more convenient, less expensive and easily available for everyone.
8 Future directions and recommendations
We have provided future directions and recommendations for the development of smartphone-based applications that can be useful in helping visually impaired and blind people in learning mathematics.
Earlier research showed that the focus has shifted from vision to hearing in eyes-free environments [70,71,72]. Recent innovative technologies use hearing, haptic and multimodal combinations of senses to help visually impaired and blind people learn mathematics. Most of them support only the English language, in future, a solution may be developed which has no language dependency. Therefore, people whose first language is not English may have a chance to develop their mathematical skills easily.
In future, researchers can investigate how math teachers effectively teach advanced-level mathematics skills to visually impaired and blind students using AT. For this purpose, haptic feedback is very useful because, in the absence of vision, it can be used with visual input to construct mathematical learning systems. Lastly, in the field of mathematics, there is a need for more adaptive systems. Developers should introduce adaptive systems and applications which automatically change their configuration and behaviour based on the interaction of the user.
References
Tedros AG (2019) World report on vision. World Health Organ 214:180–235
Schleppenbach D (1997) Teaching science to the visually impaired: The VISIONS Lab. The Braille Monitor 40(1). https://nfb.org/images/nfb/publications/bm/bm97/brlm9701.htm#8
Emerson RW, Anderson D (2018) What mathematical images are in a typical mathematics textbook? Implications for students with visual impairments. J Vis Impair Blind 112:20–32. https://doi.org/10.1177/0145482X1811200103
Nazlı AKAR, Övez FTD (2018) An anthropological analysis of the knowledge on graphics within middle school mathematics. Journal of Education and Future (JEF) 13:95–119
Rosenblum LP, Cheng L, Beal CR (2018) Teachers of students with visual impairments share experiences and advice for supporting students in understanding graphics. J Vis Impair Blind 112:475–487
Rosenblum LP, Herzberg TS (2015) Braille and tactile graphics: Youths with visual impairments share their experiences. J Vis Impair Blind 109:173–184
Li Q, Ma X (2010) A meta-analysis of the effects of computer technology on school students’ mathematics learning. Educ Psychol Rev 22:215–243. https://doi.org/10.1007/s10648-010-9125-8
“Mathematics Education in the Digital Age”. Available: https://www.mathedleadership.org/docs/resources/positionpapers/NCSMWhitePaper1.pdf. Accessed 3 Feb 2023
Clark-Wilson A, Donevska-Todorova A, Faggiano E (2021) Mathematics education in the digital age: Learning, practice and theory. https://doi.org/10.4324/9781003137580
Kelly SM (2023) Using Technology to Enhance Learning for Students With Visual Impairments 37:87–103. https://doi.org/10.1108/S0270-401320230000037006
Beal CR, Rosenblum LP (2018) Evaluation of the effectiveness of a tablet computer application (App) in helping students with visual impairments solve mathematics problems. J Vis Impair Blind 112:5–19
Pitchford NJ, Kamchedzera E, Hubber PJ, Chigeda AL (2018) Interactive apps promote learning of basic mathematics in children with special educational needs and disabilities. Front Psychol 9:262
Supalo CA, Hill AA, Larrick CG (2014) Summer enrichment programs to foster interest in STEM education for students with blindness or low vision. J Chem Educ 91:1257–1260
Klingenberg O.,…AH-BJ of, 2020 undefined (2020) Digital learning in mathematics for students with severe visual impairment: A systematic review. journals.sagepub.com 2020: 38–57. https://doi.org/10.1177/0264619619876975
Maguvhe M (2015) Teaching science and mathematics to students with visual impairments: Reflections of a visually impaired technician. Afr J Disabil 4(1): https://doi.org/10.4102/AJOD.V4I1.194
Rule AC, Stefanich GP, Boody RM, Peiffer B (2010) Impact of Adaptive Materials on Teachers and their Students with Visual Impairments in Secondary Science and Mathematics Classes 33:865–887. https://doi.org/10.1080/09500693.2010.506619
Mulloy AM, Gevarter C, Hopkins M, et al (2014) Assistive technology for students with visual impairments and blindness. 113–156. https://doi.org/10.1007/978-1-4899-8029-8_5
Irvine D, Zemke A, Pusateri G et al (2014) Tablet and smartphone accessibility features in the low vision rehabilitation. Neuro-Ophthalmology 38:53–59
Yesilada Y, Harper S (2019) Futurama. In: Yesilada Y, Harper S (eds) Web Accessibility: A Foundation for Research. Springer, London, pp 791–803
Barbara K, Charters S (2007) Guidelines for performing systematic literature reviews in software engineering. EBSE Technical Report 5:1–57
Mejía P, Martini LC, Grijalva F, Larco JC, Rodríguez JC (2021) A survey on mathematical software tools for visually impaired persons: A practical perspective. IEEE Access 9:66929–66947
Armano T, Capietto A, Illengo M et al (2015) An overview on ICT for the accessibility of scientific texts by visually impaired students. SIREM 2014, pp 119–122. http://hdl.handle.net/2318/151291
Karshmer AI, Gupta G, Pontelli E et al (2003) UMA: a system for universal mathematics accessibility. In: Proceedings of the 6th international ACM SIGACCESS Conference on Computers and Accessibility, pp 55–62. https://doi.org/10.1145/1028630.1028642
Schweikhardt W, Bernareggi C, Jessel N et al (2006) LAMBDA: A European system to access mathematics with Braille and audio synthesis. In: Computers helping people with special needs: 10th International Conference, ICCHP 2006, Linz, Austria, July 11–13, 2006. Proceedings 10. Springer, pp 1223–1230
Nicotra G, Bertoni G, Bortolazzi E, Formenti L (2010) Innovative methods for accessing mathematics by visually impaired users. In: Computers helping people with special needs: 12th International Conference, ICCHP 2010, Vienna, Austria, July14– 16, 2010, Proceedings, Part II 12. Springer, pp 423–430. https://doi.org/10.1007/978-3-642-14100-3_63
Soiffer N (2005) MathPlayer: web-based math accessibility. In: Proceedings of the 7th international ACM SIGACCESS conference on computers and accessibility, pp 204–205
Ausbrooks R, Buswell S, Carlisle D et al (2003) Mathematical markup language (MathML) version2.0 W3C recommendation. World wide web consortium 2003. http://www.w3.org/TR/2003/REC-MathML2-20031021/
Gaura P (2002) REMathEx—Reader and editor of the mathematical expressions for blind students. In: Computers helping people with special needs: 8th International Conference, ICCHP 2002 Linz, Austria, July 15–20, 2002 Proceedings 8. Springer, pp 486–493
Maćkowski M, Żabka M, Kempa W et al (2022) Computer aided math learning as a tool to assess and increase motivation in learning math by visually impaired students. Disabil Rehabil Assist Technol 17:559–569
Stevens RD, Edwards ADN, Harling PA (1997) Access to mathematics for visually disabled students through multimodal interaction. Hum Comput Interact 12:47–92
Pires AC, Bakala E, González-Perilli F et al (2022) Learning maths with a tangible user interface: Lessons learned through participatory design with children with visual impairments and their educators. Int J Child Comput Interact 32:100382. https://doi.org/10.1016/J.IJCCI.2021.100382
Ferreira F, Cavaco S (2014) Mathematics for all: a game-based learning environment for visually impaired students. In: 2014 IEEE Frontiers in Education Conference (FIE) Proceedings. IEEE, pp 1–8
Virvou M, Katsionis G, Manos K (2005) Combining software games with education: Evaluation of its educational effectiveness. J Educ Techno Soc 8:54–65
Ketamo H (2003) An adaptive geometry game for handheld devices. J Educ Techno Soc 6:83–95
Maćkowski M, Brzoza P, Żabka M, Spinczyk D (2018) Multimedia platform for mathematics’ interactive learning accessible to blind people. Multimed Tools Appl 77:6191–6208
Crollen V, Mahe R, Collignon O, Seron X (2011) The role of vision in the development of finger–number interactions: Finger-counting and finger-montring in blind children. J Exp Child Psychol 109(4):525–539
Giesen JM, Cavenaugh BS, McDonnall MC (2012) Academic Supports, Cognitive Disability and Mathematics Acheivement for Visually Imparied Youth: A Multilevel Modeling Approach. Int J Spec Educ 27(1):17–26
Klingenberg OG (2012) Conceptual understanding of shape and space by Braille-reading Norwegian students in elementary school. J Vis Impair Blind 106:453–465
Leo F, Cocchi E, Brayda L (2016) The effect of programmable tactile displays on spatial learning skills in children and adolescents of different visual disability. IEEE Trans Neural Syst Rehabil Eng 25:861–872
Bouck EC, Weng P-L, Satsangi R (2016) Digital versus traditional: Secondary students with visual impairments’ perceptions of a digital algebra textbook. J Vis Impair Blind 110:41–52
Huang PH, Chiu MC, Hwang SL, Wangan JL (2015) Investigating e-learning accessibility for visually-impaired students: An experimental study. Int J Eng Educ 31(2):495–504
Mukherjee A, Garain U, Biswas A (2014) Experimenting with automatic text-to-diagram conversion: A novel teaching aid for the blind people. JSTOR, Available: https://www.jstor.org/stable/pdf/jeductechsoci.17.3.40.pdf. Accessed 3 Feb 2023
Bateman A, Zhao OK, Bajcsy AV et al (2018) A user-centered design and analysis of an electrostatic haptic touchscreen system for students with visual impairments. Int J Hum Comput Stud 109:102–111
Oliveira F, Quek F, Cowan H, Fang B (2011) The Haptic Deictic System—HDS: Bringing blind students to mainstream classrooms. IEEE Trans Haptics 5:172–183
Bouck EC, Flanagan S, Joshi GS et al (2011) Speaking math—A voice input, speech output calculator for students with visual impairments. J Spec Educ Technol 26:1–14
Hansen EG, Shute VJ, Landau S (2010) An assessment-for-learning system in mathematics for individuals with visual impairments. J Vis Impair Blind 104:275–286
Isaacson MD, Srinivasan S, Lloyd LL (2010) Development of an algorithm for improving quality and information processing capacity of MathSpeak synthetic speech renderings. Disabil Rehabil Assist Technol 5:83–93
Raman TV (1994) Audio systems for technical reading. PhD Thesis, New York, pp 1–129
Stevens RD (1996) Principles for the design of auditory interfaces to present complex information to blind people. CiteSeer, pp 1–299
Stevens R, Edwards A (1994) Mathtalk: The design of an interface for reading algebra using speech. In: Computers for Handicapped Persons: 4th International Conference, ICCHP’94 Vienna, Austria, September 14–16, 1994 Proceedings 4. Springer, pp 313–320
Raman TV, Krishnamoorthy MS (1992) Congrats: A system for converting graphics to sound. In: Proceedings of IEEE on Johns Hopkins National Search for Computing Applications to Assist Persons with Disabilities, pp 170–172
Harling PA, Stevens R, Edwards A (1995) Mathgrasp: The design of an algebra manipulation tool for visually disabled mathematicians using spatial-sound and manual gestures. University of York, UK, HCI Group
Cahill H, McCarthy J (1994) Ensuring usability in interface design: a workstation to provide usable access to mathematics for visually disabled users. Inf Technol Disabil 1(4):1–10
Karshmer AI, Gupta G, Geiiger S, Weaver C (1998) Reading and writing mathematics: the MAVIS project. In: Proceedings of the third international ACM conference on Assistive technologies, pp 136–143
Wongkia W, Naruedomkul K, Cercone N (2012) i-Math: Automatic math reader for Thai blind and visually impaired students. Elsevier 64(6):2128–2140
Pires AC, Marichal S, Gonzalez-Perilli F, et al (2019) A tangible math game for visually impaired children. dl.acm.org 667–669. https://doi.org/10.1145/3308561.3354596
Sánchez J, Flores H (2005) AudioMath: Blind children learning mathematics through audio. Int J Disabil Human Dev 4:311–316
Marshall L, Swan P (2008) Exploring the use of mathematics manipulative materials: Is it what we think it is?. Available: https://ro.ecu.edu.au/ceducom/33/. Accessed 3 Feb 2023
LaVenture S (2007) A parents’ guide to special education for children with visual impairments. American Foundation for the Blind, pp 1–303
Asebriy Z, Raghay S, Symmetry OB (2018) undefined An assistive technology for braille users to support mathematical learning: a semantic retrieval system. Symmetry 10(11):547. https://doi.org/10.3390/sym10110547
Ashraf MM, Hasan N, Lewis L et al (2016) A systematic literature review of the application of information communication technology for visually impaired people. Int J Disabil Manag 11:e6
Líška M, Sojka P.,…MR the FIW on, 2015 undefined (2015) Combining text and formula queries in math information retrieval: Evaluation of query results merging strategies. dl.acm.org 7–9. https://doi.org/10.1145/2810355.2810359
Morash V, Mckerracher A (2014) The relationship between tactile graphics and mathematics for students with visual impairments. Terra Haptica 4:13–22
Kleanthous I, Meletiou-Mavrotheris M (2018) Early statistical reasoning: an exploratory study of primary school students' use of a dynamic statistics software package for analyzing and interpreting data. In: K-12 STEM education: Breakthroughs in research and practice, pp 359–376
Merchant Z, Goetz ET, Cifuentes L, Keeney-Kennicutt W, Davis TJ (2014) Effectiveness of virtual reality-based instruction on students’ learning outcomes in K-12 and higher education: A meta-analysis. Comput Educ 70:29–40
Kucirkova N, Falloon G (eds) (2016) Apps, technology and younger learners: International evidence for teaching. Taylor & Francis
Rose D, Meyer A, Hitchcock C (2005) The universally designed classroom: Accessible curriculum and digital technologies. Harvard Education Press, Cambridge, p 216. https://eric.ed.gov/?id=ED568861
Martiniello N, Eisenbarth W, Lehane C et al (2022) Exploring the use of smartphones and tablets among people with visual impairments: Are mainstream devices replacing the use of traditional visual aids? Taylor & Francis 34:34–45. https://doi.org/10.1080/10400435.2019.1682084
Karshmer AI, Pontelli E, Gupta G (1999) Helping visually impaired students in the study of mathematics. Proceedings - Frontiers in Education Conference 2:. https://doi.org/10.1109/FIE.1999.841638
Fallah N (2010) AudioNav. ACM SIGACCESS Accessibility and Computing 24–27. https://doi.org/10.1145/1731849.1731853
Ran L, Helal S, Moore S (2004) Drishti: an integrated indoor/outdoor blind navigation system and service. In: Proceedings of the Second IEEE Annual Conference on Pervasive Computing and Communications. IEEE, pp 23–30
Loomis JM, Marston JR, Golledge RG, Klatzky RL (2005) Personal guidance system for people with visual impairment: A comparison of spatial displays for route guidance. J Vis Impair Blind 99:219–232. https://doi.org/10.1177/0145482X0509900404
Funding
This publication has emanated from research conducted with the financial support of Science Foundation Ireland under Grant number 18/CRT/6222. For the purpose of Open Access, the author has applied a CC BY public copyright licence to any Author Accepted Manuscript version arising from this submission.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Ethical approval
All procedures of the study were reviewed and ethically have no issue.
Conflict of Interest
On behalf of all authors, the corresponding author states that there is no conflict of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Shoaib, M., Fitzpatrick, D. & Pitt, I. Assistive technology-based solutions in learning mathematics for visually-impaired people: exploring issues, challenges and opportunities. Multimed Tools Appl 82, 46153–46184 (2023). https://doi.org/10.1007/s11042-023-17409-z
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-023-17409-z