Abstract
There is a lack of reliable and valid clinical assessment tools for individuals with loss of ingestive skills. The McGill Ingestive Skills Assessment (MISA) was developed to facilitate the reliable and valid bedside assessment of elderly persons with feeding difficulties. Items were generated by a literature review and selected with the collaboration of a multidisciplinary team. The first version of the MISA comprised 190 items in 7 scales, covering the domains of medical history, mealtime environment, physical characteristics of the patient, food textures consumed, solid ingestion, liquid ingestion, and behaviors related to self-feeding. The first field test for item selection included 50 individuals, aged 60 years and older, living in the community, supervised housing, and long-term care centers. After field testing, 134 items were eliminated due to poor face validity, redundancy, or poor psychometric performance. The remaining 56 items were provided with 4 response categories and were reorganized into 5 scales. The revised version was field tested to determine its preliminary psychometric properties on 33 individuals, 60 years of age and older, residing in a long-term care center. Six items were eliminated due to redundancy after the second field test. Analyses of the revised version resulted in the elimination of another 6 items that were redundant or that demonstrated poor reliability. Internal consistency of all scales is ≥0.86 and interrater agreement is ≥0.92. These analyses suggest that the psychometric properties of the MISA are adequate for diagnosis and treatment planning. This supports its readiness for clinical use following further reliability and validity testing with a larger sample
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
Dysphagia is a common problem in elderly individuals with chronic health problems. It is estimated that up to 80% of the elderly living in long-term care settings may experience difficulties with self-feeding, chewing, and swallowing [1]. These problems contribute to social isolation [2], malnutrition [3], and respiratory illness aggravated by aspiration [4]. They may also hasten the development of pressure sores and the depression of immune function as a consequence of a poor nutritional state [4]. Death may ensue as a consequence of dysphagia, whether or not aspiration has been documented [5]. Professionals are called upon to assess and treat individuals with these difficulties promptly because of the severe consequences that are associated with functional feeding problems.
Physical examination, neurological assessment, and evaluation of trial swallows are routinely used to identify the deficiencies in anatomy and physiological processes causing the feeding problem [6]. Additionally, an instrumental assessment, videofluoroscopy (VF), is often used. In the last few years, the frequent use of VF has been criticized. Scott et al. [7] and Kuhlemeier et al. [8] found that VF is not reliable within a single judge or between judges. VF may also identify a feeding problem where there is none [9]. The occurrence of false positive findings may be a result of positioning the patient in a significantly different way than usual [10], the unfamiliarity of the radiology suite, and the taste and texture of the barium-impregnated food [11]. Thus, instrumental assessment may not be feasible for many elderly individuals with feeding skill loss [12,13]. As a result, there is an urgent need for a more suitable valid and reliable assessment tool [14,15]. A shift in assessment techniques toward functional, observation-based assessment in the individual's own environment has been advocated, in order to document the individual's feeding abilities in his/her natural mealtime setting [15].
Until recently, reliable and valid bedside (clinical) assessment tools have not been available. Scales have begun to appear in the literature, but the development of standardized instruments is a lengthy process and the interest in these types of assessment batteries is relatively new. As a result, the variety of tools available is still limited [16]. The majority of assessments have been developed for children [17,18,19]. Other assessment tools have been developed for screening [20], for quality of life/quality of care measurement [21,22,23,24], and for the translation of information from an instrumental assessment into a disability score [25,26]. However, no reliable and valid bedside assessment tools exist to evaluate an elderly individual's functional feeding skills.
An assessment for this population would require sufficient psychometric rigor to identify individuals with ingestive skill loss, specify the origin of the disability, and serve as a basis for treatment planning. Accordingly, it should allow the clinician to obtain standardized observational information regarding the actual, day-to-day functioning of the patient and to plan rehabilitation in terms of the patient's functional needs, according to the corresponding classification of impairment, disability, handicap (ICIDH, ICIDH-2) [27,28]. The use of a bedside assessment tool would not preclude the use of instrumental techniques but would provide important complementary information in a standardized format. For individuals with little or no cognitive loss who would benefit from oral-motor exercise, biofeedback, or other interactive therapies, a bedside assessment would serve to identify functional difficulties that would be amenable to conservative management. However, the primary population to be served by a bedside assessment will include individuals with an altered mental state, who could not use compensatory strategies or cooperate with an instrumental assessment; the palliative care patient, for whom nonoral feeding or aggressive treatment is not an option; and the frail elderly, for whom an instrumental assessment would bring unwarranted stress.
Therefore, the goal of this study was to develop a reliable and valid bedside assessment of the functional ingestive skills of elderly persons. The development of the assessment tool was undertaken in three stages: In the first, test items were generated; in the second, the number of items was reduced; and in the third, preliminary psychometric testing on the assessment was performed.
Methods
Conceptualization and Item Development
The development of the assessment began in 1996 with a review of the literature. A MEDLINE search using the keywords deglutition, deglutition disorders, aspiration, swallowing, and feeding from the years 1980 to 1996 was performed. All articles found in the search were reviewed. A list of 208 signs and symptoms of feeding and swallowing problems was compiled from the literature. These signs and symptoms were selected based on repeated clinical reporting or statistical significance of the indicators in clinical studies. These were presented in 14 broad categories (Table 1).
In order to select items from the list, a focus group of clinicians was assembled from the Montreal Regional Multidisciplinary Dysphagia Special Interest Group, a network for professional support and education. An effort was made to maximize the representation of the various institutions within this geographic region. Representatives from both English and French linguistic groups in Montreal were sought because of their differences in training and practice; this was expected to broaden the applicability of the assessment in this cultural milieu. All focus group members had experience in assessing or treating adults or seniors with dysphagia.
The item generation group comprised 4 occupational therapists (including the principal investigator), 2 speech-language pathologists, 2 physicians, 1 registered nurse, and 1 registered dietitian. These professionals work in acute care hospitals (inpatient and outpatient care), chronic care facilities, and rehabilitation centers. All 10 members attended the first meeting and six returned to participate in the second meeting. Four did not attend the second meeting because of scheduling conflicts. Each meeting lasted 3 hours.
During the first meeting, the group discussed the most desirable structure of a clinical tool. Many of the members were skeptical about the feasibility of an assessment where the examiner does not interact with or manipulate the patient. The need for a constant environment to permit optimal performance and the necessity of developing a tool which could assess an individual's functional level were emphasized in response to the group's concerns. It was agreed that the items should fall into specific categories reflecting the various aspects of function that contribute to feeding safety. The categories proposed by the group included medical status, physiological function of head and neck structures, positioning, lighting, noise, behavior, utensil use, oral-motor skills, voice production, and pharyngeal function.
The 208 signs and symptoms from the literature review were presented to the group. One hundred and thirteen items from the list were retained by majority vote by the group members and an additional 90 were added (Table 1). The items generated by the group primarily addressed medical status.
In preparation for the second meeting, the 203 items were phrased as statements and categorical scoring was provided for each item. Twenty more items were added by the authors to ensure face validity of the assessment (Table 1). The 223 items were divided into 7 scales reflecting the domains suggested during the first focus group meeting. The designation of items into scales was done simply by the characteristic in question or the ingestive function to be observed. Items addressing an individual's position were assigned to the Positioning Scale, items to be observed during the consumption of solid textures were assigned to the Solid Ingestion Scale, and so on. Certain items were modified, and some were incorporated into the scoring categories of the evaluation. Hence, the total number of items on the assessment was reduced to 190. At the second meeting, the group voted on each of the new and restored items and all were unanimously accepted. The assignment of the items into their new scales was deemed acceptable. Upon discussion of the scoring mechanism, the group agreed that the number of scoring categories should be tailored to the item and that uniformity across the entire evaluation should be a secondary consideration. The group also felt that scoring the items regarding feeding difficulty by the frequency of their occurrence would be the most desirable means of scoring. The proposed scoring was changed according to the consensus of the group.
At the end of item development (Table 2, A), the assessment was named the McGill Ingestive Skills Assessment (MISA) and had 190 items in 7 scales. The Historical Risk Scale (57 items) included items from the patient's medical history that could contribute to the development of a swallowing disorder. The Mealtime Situation Scale (13 items) documented characteristics of the patient's environment which contribute to safe feeding. The Physical Characteristics Scale (30 items) addressed anatomical and physiological characteristics of the head and neck. The Texture Management Scale (11 items) addressed the foods that the patient is able to eat. Oral-motor and pharyngeal skills were assessed in the Solid and Liquid Ingestion Scales (37 and 16 items, respectively), and self-feeding skills and mealtime behavior were addressed in the Ingestive Ability Scale (26 items). It was decided that the scores from the scales should not be summed to give a composite score, because each scale represented a discrete facet of the construct of “ingestion.” This first version was now ready for field testing.
Item Reduction
The goal of the first field test of the MISA was to examine item performance in order to reduce the number of items in the assessment. This process included a field test of the MISA, two stages of statistical analysis, and two meetings of a group of professionals to select items.
Subjects
Fifty subjects between 60 and 99 years of age were recruited so that the representation of each decade would be approximately equal (mean age 80.0 years, standard deviation 11.3 years). Twelve subjects each from the seventh and eighth decades of life and 13 each from the ninth and tenth decades were evaluated. Twenty-eight individuals resided in skilled nursing care facilities. These subjects were identified by the staff as having difficulty during mealtimes, with biting or chewing, requiring diets with modified food textures, having a history of recurrent pneumonia, choking, and having difficulty with self-feeding. Six subjects were living in supervised apartments affiliated with one of the nursing homes. These individuals were in declining health but had no known ingestive problems. They required minimal supervision and assistance by nursing staff in activities of daily living. Sixteen subjects were living in the community and were recruited through contact lists from a previous study of well elderly persons [29]. These individuals had no ingestive or health problems serious enough to require supervision. Written consent to participate was obtained from all subjects or their legally appointed guardian.
Sixty percent of the subjects had one or more medical conditions that could influence ingestion. Forty-six percent of the sample had dementia; 22% had a history of stroke; 6% had Parkinson's disease; and 6% had nonneurologic diagnoses. Forty percent of subjects had no diagnoses that could contribute to ingestive difficulties. None of the subjects was fed nonorally. Candidates were to be excluded if they had behavior problems related to mealtimes or if there was a congenital or acquired anatomic abnormality. There were no such referrals made to the study.
Data Collection
The principal investigator, two occupational therapists experienced in dysphagia evaluation, and one with no prior training in dysphagia participated in the data collection for this part of the study. The evaluators were trained during a 3-hour session. Each item on the MISA was explained and a videotaped meal was scored. The group discussed the scores chosen by each evaluator and the videotape was reviewed until full agreement was reached on each item. If there was a dispute about the correct scoring of an item, the principal investigator's rating served as the standard. The inexperienced therapist received further training by observing three assessments. She independently scored each subject and her results were compared with those of the principal investigator. During this time, additional explanation of the items was provided as indicated by difficulty with scoring the subject or by poor reliability. The inexperienced therapist began assessing subjects for the study only when she demonstrated an understanding of all test items and their clinical presentation.
All subjects were seen by two evaluators at either lunch or supper. The evaluators arrived before the meal was served and remained until the end of the meal as indicated by the consumption of all food, consistent food refusal, or the removal of the remaining food by the staff of the institution. Subjects requiring assistance were aided by their usual feeder. The evaluators were instructed not to interact with the feeder or the subject during the meal. They were seated so that they had approximately a semiprofile view of the subject. The assessment took no longer than the duration of the meal, which was less than 45 minutes for all subjects. A medical history was obtained for each subject either from the medical chart or by interview.
Analysis
The interrater reliability of each item was calculated using an unweighted kappa statistic between the raters. One of the two evaluations for each subject was selected at random for further analysis. The selected assessments were analyzed to obtain the frequency distribution of scores for each item, as well as means, Pearson product-moment correlations between items, between items and scales, and between the scales. The assessments were then stratified according to whether individuals resided in the community or in a nursing facility (a proxy for health status) and all frequency and correlation analyses were repeated for each stratum. This data is available from the authors upon request. Cronbach's alpha was calculated for each of the scales to allow examination of their internal consistency (Table 3). The number of subjects in the study was insufficient to permit factor analysis to confirm the assignation of items into scales. This type of analysis requires a minimum of 5 subjects for each item [30,31]. Cronbach's alpha was therefore selected as the optimal means of verifying scale assignment [30,31].
Focus Group Meetings
First meeting: A group of professionals was assembled to select items for the revision of the MISA based on the results of the field testing and the data analysis. This panel included the principal investigator; experts in the domains of ingestion (PhD, occupational therapist), test development (PhD, physical therapist), and statistics (PhD, statistician); and a speech-language pathologist experienced in clinical aspects of feeding intervention. At the opening of the meeting, the group discussed what the role of the MISA would be in the arsenal of assessment tools available to the clinician. This was necessary to ensure that each of the members had the same understanding of the purpose of the assessment. The panel then carried out an examination of each item's adherence to the goals of the assessment as well as its psychometric properties. Items that would require extensive training or that could not be observed at the bedside were removed from the assessment. Items that measured impairment rather than disability were also removed from the assessment (Table 2, B.i). This eliminated all items on medical history and physiology. These items performed poorly on two counts. First, they could only be scored as “present” or “absent,” resulting in scales which were simply a listing of the individual's health problems rather than a coherent assessment of health status. Second, these items did not contribute to an assessment of function and so were inappropriate for inclusion. Preliminary decisions were made whether to retain or eliminate the remaining items based on ease of scoring, contribution to feeding difficulties, representation in the population, adherence to the goals of the measurement, and psychometric performance. The score distributions were examined for each item to determine if the distributions were appropriately weighted (i.e., concentration of high scores for well individuals, concentration of low scores for ill individuals). If consensus could not be reached, the item was retained for reconsideration at the second meeting. In all, 63 items were retained at the first meeting. Eighty-seven items were eliminated because they measured impairment and 42 items were eliminated on the basis of poor face validity or poor item performance during the preliminary testing. Items with poor face validity did not test an aspect of functional ingestion. Items with poor performance demonstrated a lack of variability in scoring, were difficult to score on observation, or otherwise performed poorly on psychometric tests.
Second meeting: Each member was given lists of retained and eliminated items, based on the decisions made at the first meeting. Each item's frequency distribution and interrater reliability (kappa) were presented. For retained items, information on the highest correlation with another item within the same scale, the name of the scale with which it had the highest correlation, and a list of items with which it had a correlation coefficient of > 0.8 was also provided. For eliminated items, the reason for elimination was given. The criteria in Table 4 were used to refine choices made at the first meeting using these statistics. The performance of the items in distinguishing between individuals who were well and those in poor health was also examined. The group discussed the choices made at the first meeting, considering in particular the face validity of each item, its adherence to the goals of the assessment, and its psychometric performance. Fifteen items were eliminated because they did not meet criteria for inclusion. These included the 4 items remaining in the Physical Characteristics Scale, and so this scale was eliminated. Three items were reinstated from those eliminated at the first meeting, as they were necessary to maintain the face validity of the scales. Five new items were added to improve the face validity of the Texture Management Scale. These were generated from the standard texture labels used by clinicians to describe aspiration-risk reduction diets for dysphagia [32]. Finally, the group discussed the number of scoring categories and the category labels for each item. It was decided that a 4-point scale would maximize the responsiveness of the tool and force a choice on either side of midrange ability. The principal investigator compiled the information from these meetings and independently revised the scoring categories.
The scores from the items that were retained were used to assemble a shortened profile for each subject. The psychometric properties of the revised version were estimated using the data from the shortened profiles and were compared to the properties calculated from the 190 items. Internal consistency (Cronbach's alpha) of the revised scales was good (Table 3, middle column). The Texture Management, Liquid Ingestion, and Ingestive Ability Scales on the revised version had α>0.80, which is adequate for clinical use. The Solid Ingestion Scale had an internal consistency approaching 0.8 when alpha was calculated using data from the first field test, and the Mealtime Situation Scale internal consistency was the poorest at < 0.75.
The revised MISA consisted of 56 items in 5 scales, which were renamed to reflect the change in content subsequent to the item reduction (Table 2, B.ii). Positioning replaced the Mealtime Situation Scale, and described the elderly person's position during feeding and his/her ability to maintain an appropriate position. Textures replaced Texture Management Scale and is a list of all food and liquid consistencies that are routinely offered in dysphagia care [32]. Self-Feeding came from the Ingestive Ability Scale and describes the individual's ability to function independently during the meal. Solid Ingestion and Liquid Ingestion retained their names and continue to comprise items regarding oral-motor skills and observable signs of pharyngeal dysfunction.
Preliminary Psychometric Test
The revised MISA underwent a second field test on a small, independent sample in order to examine its psychometric properties prior to large-scale testing. This part of the study entailed descriptive statistical analysis and further item reduction.
Subjects
The revised MISA was administered to 33 residents of a single nursing facility who were reported by nursing staff to have difficulty with self-feeding, eating, or swallowing. All subjects were aged 60 or older (mean age 84.5 years, standard deviation 9.4 years) and had one or more neurological problems that could contribute to ingestive skill loss (Table 5). Thirty percent also had psychiatric diagnoses requiring medical intervention; these were predominantly schizophrenia or depression. The median number of medical conditions that influenced ingestion was 2. No individuals who were receiving nonoral feeding or who had anatomic abnormalities or behavioral problems were referred to the study.
Data Collection
All subjects were evaluated at either lunch or supper by the principal investigator, following the guidelines described above. The occupational therapist on staff had been instructed in the use of the MISA by verbal explanation of each item. During her training period, she assessed 5 subjects. The principal investigator provided an immediate review and explanation of each of the items and their scoring. At the fifth evaluation, the two evaluators attained 100% agreement when independently rating the subject, and the staff therapist reported that she was comfortable with the assessment. From this time on, she randomly selected 6 subjects to evaluate so that the interrater agreement of the test could be verified.
Analysis
The adequacy of each of the items was examined. Items that had correlations > 0.80 with at least one other item on the assessment were identified. Each pair of redundant items was inspected and a judgment made whether to retain both items or eliminate one, based on knowledge of the relationship between the items' objectives. If the high correlation appeared spurious (i.e., no known relationship between the redundant characteristics having been published in the literature), both items were retained. If the items appeared to have a true redundancy, the item which was worded less clearly was eliminated.
After elimination of redundant items, further analyses were carried out on the remaining items. Frequency distributions for the scores on each item were constructed. Cronbach's alpha was calculated for each scale to determine its internal consistency. Percent agreement and Pearson's correlation coefficient were calculated using the MISA scores from individuals assessed by both raters (n = 6) in order to establish interrater agreement. The sample was too small to permit the use of a kappa statistic.
Results
After the preliminary psychometric test, 40 of the 56 items demonstrated no redundancy with any of the other items (interitem correlation < 0.8). Sixteen items had correlations > 0.8 with at least one other item. Of these, 6 were eliminated because the high correlations were due to redundancy in content. Ten items were judged to demonstrate spurious relationships and were retained.
The psychometric properties of the final version were calculated using the remaining 50 items. Twenty-nine (58%) items correlated more strongly with their parent scale than with any other scale. All scales were positively correlated with one another. Correlations between scales were generally below 0.80, with the exception of the correlation between the Position and Solid Ingestion scales (Table 6). Cronbach's alpha was also calculated for each scale (Table 3, last column). These values remained above 0.85 despite the extensive reduction in the number of items. The alpha statistics for the Position and Solid Ingestion Scales are above 0.9, and the Self-Feeding and Liquid Ingestion scales have α = 0.89.
On all of the items, interrater agreement was very high. Each item for each of the 6 subjects was taken as an independent judgment and percent agreements between raters were calculated for each scale (Table 7). Overall, 68% of the judgments made by the raters agreed, 12% differed by one point, and 16% differed by two or more points. Correlation between raters was above 0.90 on all scales.
Discussion
This study represents a methodologically thorough approach to the development of a reliable and valid diagnostic tool. The development of items is a crucial step in the construction of a valid assessment tool. Several methods of accomplishing this task have been used. DeVellis [33] described the use of a literature review for generating items and subsequent voting on the items by a focus group. This method was selected for the present study. Streiner and Norman [34] described guidelines for assembling the group and conducting the meetings. These authors recommend that the focus group decide on the themes to be used in the assessment and then be involved with the selection and refinement of items once they have been written by the test developers [34]. This method can introduce bias if the evaluators represent a limited knowledge base. For this reason, practitioners from a variety of professions were involved in the development and selection of the items. These professions brought the necessary diverse perspectives to the selection and creation of items. The authors are confident that the items retained and generated at the focus group meetings covered the entire construct of ingestive skill loss and that the exclusion of families from this process did not result in an omission of information. Furthermore, the patients targeted by the assessment would generally be unable to participate in such a group as a result of language impairment or cognitive deficit. It is unlikely that any systematic bias was introduced into this study as a result of the geographic proximity of the group members, as they had been trained in different institutions and followed different evaluation and treatment philosophies at their respective places of employment. This method allowed the development of items within the framework envisioned by the test developers. At the end of the item development process, enough items had been generated to satisfy the guideline of starting with double or triple the final number of items desired in order to achieve a sensitive and reliable assessment [35].
Diversity of diagnosis and functional performance is necessary for the development of a tool that is to be used for a wide range of abilities [36]. Subjects in the first field test were not selected by diagnosis to ensure that the tool will ultimately be useful for a wide variety of problems. Instead, they were selected so that a variety of problems and severity of feeding difficulty would be represented. The inclusion of a number of individuals with no known ingestive impairments ensured that the items included in the tool were able to distinguish between individuals who were functioning normally and those with minimal impairments. This will ultimately result in a more sensitive and reliable assessment tool [34].
Those items that could not be visually observed were recognized as being unmeasurable at the bedside, namely, pharyngeal function [37], bolus control, the competence of the swallow, and pocketing in the valleculae and pyriform sinuses [38]. They performed poorly during the first field test and generally did not meet the criteria for a measure of ability. They were eliminated from the MISA. These patient characteristics would be better tested by instrumental or neurological examination [39,40]. The importance of obtaining a medical history and assessing physiologic functions of the patient is indisputable. However, their inclusion in a bedside evaluation of ability is inappropriate because of the stated objectives and limitations of a bedside assessment.
The inclusion of impairment-based items in existing bedside assessments may have led to the argument that a bedside evaluation does not adequately measure aspiration risk [38]. However, many of the externally visible disabilities resulting from these impairments have scientific support as predictors of events in the pharyngeal stage of the swallow [14]. Behavioral manifestations of dysphagia are also similar across diagnoses [41]. It would therefore stand to reason that a carefully crafted assembly of observable signs of functional capacity may permit the clinician to predict physiologic events in a variety of swallowing problems. Further study will determine if the MISA permits clinicians to make reliable predictions regarding feeding safety, given that the assessment is formed only of such directly observable patient characteristics.
The number of items in the scales remains high. However, according to the analyses of Cronbach's alpha coefficient, further reduction in each of the scales would be detrimental to their internal consistency (data available from author upon request). In addition, it was the unanimous opinion of the second focus group that the high number of items was necessary to the face validity of the tool, as each measured distinct and clinically relevant skills. The number of items will be reverified on a new sample during the next stage of psychometric testing.
The number and labeling of scoring categories became more consistent through the evolution of the MISA. The guiding principle for selecting the number of levels in a categorical scale states that there will be a loss of information if the number of levels is less than the rater's ability to discriminate [34]. During the first field test, it quickly became evident that items scored on a 2-point scale were not sensitive to subtle differences in patient function. Three points were easily and reliably discriminated. On the other hand, raters had difficulty distinguishing between categories on a 5-point scale. A 4-point scale was eventually adopted in order to set an achievable standard of discrimination, forcing a choice to either side of a moderate level of disability and thus fostering increased reliability. As a result, it was decided not to put strong emphasis on kappa values during the item selection process because of the reorganization of scoring that needed to be done. A standardized list of category labels is available in the English language. These are known to be ordinal and demonstrate fairly equal intervals, which facilitates interpretation and statistical analysis [42,43]. In the revised MISA, these labels were used as widely as possible. With these changes, the reliability of the items was at an acceptable level as evidenced in the preliminary psychometric test.
The psychometric properties of the revised MISA indicate that the scales are approaching published standards of scale and item cohesiveness for screening, goal setting, and monitoring [34]. Levels of correlation of the items to each other and to the scales and between the scales should be set a priori by the test developers [44]. For the MISA, target values between 0.3 and 0.8 were sought. As suggested by Green and Lewis [44], more consideration is necessary than just the interitem and item-total correlations. By setting these high standards, only items with severe redundancy would be eliminated. This strategy left behind those items that were similar to, but not redundant with, others to be considered under the additional criteria presented in Table 3. The correlation above 0.80 found between the Positioning and Solid Ingestion Scales suggests redundancy and will be closely examined following future psychometric testing. At this time, the decision was made to keep all 5 scales despite the high interscale correlation in order to permit reanalysis on a larger sample. Positioning is a distinct domain that is amenable to modification separate from the treatments offered for loss of oral-motor skills for solid ingestion. Therefore, the inclusion of both scales should strengthen the assessment. A study of the assignment of items into the scales using factor analysis would also clarify this issue.
The internal consistency of the scales has improved throughout the item reduction process. Only the Textures scale has α<0.89. This result was expected, as this scale combines items regarding the acceptance of different liquid and solid textures, which are not necessarily interrelated. Therefore, the consistency of all scales may be considered adequate. The interrater agreement was excellent, with the raters demonstrating correlations on scale scores ≥0.92 on all scales and with ≥85% of scores on each scale being scored within one point. The preliminary psychometric test did not aim to definitively establish the properties of the MISA, rather, it served to justify the planning of a large-scale test. The authors are confident that the preliminary results show promise of the MISA's reliability and validity. Further revision of the assessment will be undertaken should large-scale testing demonstrate poor performance of certain items or scales.
The validity of the MISA has not yet been thoroughly tested. At this time we are able to conclude that the assessment has adequate face and content validity, as determined by the focus group and the panel of experts involved in the development process. Construct validity was established during the item reduction process, when items were chosen based on their ability to discriminate between well and ill individuals (i.e., known group validation). Criterion, concurrent, and predictive validation of the MISA will be undertaken in future studies.
In terms of limitations, the reader must keep in mind that this article outlines the preliminary testing of the assessment tool that is being used to justify further testing of the assessment. As such, the sample size is too small to permit conclusions regarding the reliability and validity of the assessment. The MISA shows indications of adequate psychometric properties and meets the criteria set forward by both Streiner and Norman [34] and Nunnally and Bernstein [30]. Certain psychometric properties, most notably responsiveness, have not yet been explored. This work will be undertaken in future studies. Although the participants included in this study have been recruited from a limited number of nursing facilities and community resources, these are representative of both the age range and diagnostic groups making up the projected population to which the assessment will be applied. Efforts were made to include participants with a wide variety of feeding ability so that the ceiling and floor effects of the items and the scales could be examined. The forthcoming trials of the assessment will be carried out on a large sample in a greater number of facilities, thereby allowing the final results to be generalized to a larger population.
The most novel aspect of the MISA is its emphasis on ability rather than impairment as defined by the World Health Organization [27,28]. The medical model dictates that health professionals seek out the reasons for a difficulty, that they assess physiologically, and treat accordingly. The individual's ability to function on a daily basis, and in a social framework, is not included in this model. Rather, the emphasis of the medical model is on the biological organism and physiological function. The International Classification of Impairments, Disabilities and Handicaps (ICIDH, ICIDH-2) provides a framework for functional diagnosis and goal planning by rehabilitation experts [45]. In rehabilitation, evaluation of an individual's skills can have greater clinical relevance than measures of their physical impairments because the goals of rehabilitation are then formulated and measured from the perspective of function [46,47]. To address the individual's ability, the “ability (or disability) measure” should correspond to socially important patterns of function [48], outside of the therapeutic setting [49]. This assists in the determination of clinically important change in function and the generalization of improvements as a result of rehabilitation [49].
The MISA strives to meet the goals of an ability assessment. It has passed the first of many hurdles in its path to becoming a clinically useful measure. It is not intended to replace instrumental assessments, as their strengths and limitations are well documented [12,13]. However, as the limitations of existing assessments are explored, the necessity of having a variety of tools at one's disposal is becoming more evident [15]. We now know that some individuals, especially those with cognitive loss, are not good candidates for rehabilitation with the goal of ameliorating impairment, but maintaining or maximizing their functional abilities by other means can still be anticipated [50]. The MISA will be useful for assessing individuals whose functional skills or behavior put them at risk for ingestive problems, whose physical or mental state prohibits the use of an instrumental assessment, or whose abilities can be maximized through conservative management techniques.
References
H Siebens H Trupe A Siebens F Cook S Anshen R Hanauer G Oster (1986) ArticleTitleCorrelates and consequences of eating dependency in institutionalized elderly. J Am Geriatr Soc 34 192–198 Occurrence Handle1:STN:280:BimC2c7jslw%3D Occurrence Handle3950287
KL Layne (1990) ArticleTitleFeeding strategies for the dysphagic patient: A nursing perspective. Dysphagia 5 84–88 Occurrence Handle1:STN:280:By6D3crjsFc%3D Occurrence Handle2119948
HM Hudson CR Daubert RH Mills (2000) ArticleTitleThe interdependency of protein-energy malnutrition, aging, and dysphagia. Dysphagia 15 31–38 Occurrence Handle1:STN:280:DC%2BD3c%2Fmt1Krug%3D%3D Occurrence Handle10594256
MJ Feinberg J Knebl J Tully (1996) ArticleTitlePrandial aspiration and pneumonia in an elderly population followed over 3 years. Dysphagia 11 104–109 Occurrence Handle1:STN:280:BymA3sbgt1c%3D Occurrence Handle8721068
JE Croghan EM Burke S Caplan S Denman (1994) ArticleTitlePilot study of 12-month outcomes of nursing home patients with aspiration on videofluoroscopy. Dysphagia 9 141–146 Occurrence Handle1:STN:280:ByuA28zptlE%3D Occurrence Handle8082320
JA Logemann (1983) Evaluation and treatment of swallowing disorders. Pro-Ed Austin, TX
A Scott A Perry J Bench (1998) ArticleTitleA study of interrater reliability when using videofluoroscopy as an assessment of swallowing. Dysphagia 13 223–227 Occurrence Handle1:STN:280:DyaK1czosVejsQ%3D%3D Occurrence Handle9716754
KV Kuhlemeier P Yates JB Palmer (1998) ArticleTitleIntra- and interrater variation in the evaluation of videofluorographic swallowing studies. Dysphagia 13 142–147 Occurrence Handle1:STN:280:DyaK1c3ps1yjuw%3D%3D Occurrence Handle9633153
ME Groher (1994) ArticleTitleEditorial: Determination of the risks and benefits of oral feeding. Dysphagia 9 233–235 Occurrence Handle1:STN:280:ByqC3czpsVQ%3D Occurrence Handle7805422
P Drinka S Voeks (1993) ArticleTitleVideofluoroscopic swallowing studies (letter) J Am Geriatr Soc 41 1275 Occurrence Handle1:STN:280:ByuD2cvjs1E%3D
O Ekberg MJ Feinberg (1991) ArticleTitleAltered swallowing function in elderly patients without dysphagia: Radiologic findings in 56 cases. Am J Radiol 156 1181–1184 Occurrence Handle1:STN:280:By6B38fpt10%3D
ME Groher (1994) ArticleTitleThe detection of aspiration and videofluoroscopy. Dysphagia 9 147–148 Occurrence Handle1:STN:280:ByuA28zptlI%3D Occurrence Handle8082321
HC Lambert EG Gisel (1996) ArticleTitleAssessment of oral, pharyngeal and esophageal dysphagia in elderly persons. Phys Occup Ther Geriatr 14 IssueID4 1–25
InstitutionalAuthorNameAgency for Health Care Policy and Research (1999) Diagnosis and treatment of swallowing disorders (dysphagia) in acute-care strokepatients summary Rockville, MD 1–8
MJ Feinberg (1997) ArticleTitleEditorial: Swallowing versus eating impairment in nursing home residents. Dysphagia 12 51 Occurrence Handle1:STN:280:DyaK1MzjsVWrtw%3D%3D Occurrence Handle10405713
HC Lambert EG Gisel S Wood–Dauphinee (2001) ArticleTitleThe functional assessment of dysphagia: Psychometric standards. Phys Occup Ther Geriatr 19 IssueID3 @15
DJ Kenny RM Koheil J Greenberg D Reid M Milner R Moran PL Judd (1989) ArticleTitleDevelopment of a multidisciplinary feeding profile for children who are dependent feeders. Dysphagia 4 16–28 Occurrence Handle1:STN:280:By%2BA383otVI%3D Occurrence Handle2534818
LC Parrott WG Selley WA Brooks PC Lethbridge JJ Cole FC Flack RE Ellis JH Tripp (1992) ArticleTitleDysphagia in cerebral palsy: A comparative study of the Exeter Dysphagia Assessment Technique and a multidisciplinary assessment. Dysphagia 7 209–219 Occurrence Handle1:STN:280:ByyD2cfitVU%3D Occurrence Handle1424834
S Reilly D Skuse B Mathisen D Wolke (1995) ArticleTitleThe objective rating of oral-motor functions during feeding. Dysphagia 10 177–191 Occurrence Handle1:STN:280:ByqA3sbnsVQ%3D Occurrence Handle7614860
CM Steele C Greenwood I Ens C Robertson R Seidman–Carlson (1997) ArticleTitleMealtime difficulties in a home for the aged: Not just dysphagia. Dysphagia 12 43–50 Occurrence Handle1:STN:280:ByiC2M7ovVc%3D Occurrence Handle8997832
AY Chen R Frankowski J Bishop–Leone T Hebert S Leyk J Lewin H Goepfert (2001) ArticleTitleThe development and validation of a dysphagia-specific quality-of-life questionnaire for patients with head and neck cancer: The M.D. Anderson Dysphagia Inventory. Arch Otolaryngol Head Neck Surg 127 870–876 Occurrence Handle1:STN:280:DC%2BD3MvjvVGjtg%3D%3D Occurrence Handle11448365
CA McHorney DE Bricker AE Kramer JC Rosenbek J Robbins KA Chignell JA Logemann C Clarke (2000) ArticleTitleThe SWAL-QOL outcomes tool for oropharyngeal dysphagia in adults: I. Conceptual foundation and item development. Dysphagia 15 115–121 Occurrence Handle1:STN:280:DC%2BD3czpsVKmsg%3D%3D Occurrence Handle10839823
CA McHorney DE Bricker J Robbins AE Kramer JC Rosenbek KA Chignell (2000) ArticleTitleThe SWAL-QOL outcomes tool for oropharyngeal dysphagia in adults: II. Item reduction and preliminary scaling. Dysphagia 15 122–133 Occurrence Handle1:STN:280:DC%2BD3czpsVKmsw%3D%3D Occurrence Handle10839824
CA McHorney J Robbins K Lomax JC Rosenbek K Chignell AE Kramer DE Bricker (2002) ArticleTitleThe SWAL-QOL and SWAL-CARE outcomes tool for oropharyngeal dysphagia in adults: III. Documentation of reliability and validity. Dysphagia 17 97–114 Occurrence Handle11956835
JA Robbins J Coyle J Rosenbek E Roecker J Wood (1999) ArticleTitleDifferentiation of normal and abnormal airway protection during swallowing using the Penetration–Aspiration Scale. Dysphagia 14 228–232 Occurrence Handle1:STN:280:DyaK1Mzps1Kruw%3D%3D Occurrence Handle10467048
JC Rosenbek J Robbins EB Roecker JL Coyle JL Wood (1996) ArticleTitleA penetration–aspiration scale. Dysphagia 11 93–98 Occurrence Handle1:STN:280:BymA3sbgt1U%3D Occurrence Handle8721066
InstitutionalAuthorNameWHO North American Collaborating Center (1998) ICIDH-2 Beta-1 field trial results. Canadian Institute for Health Information Ottawa, Canada 1–19
M Chamie (1990) ArticleTitleThe status and use of the International Classification of Impairments, Disabilities and Handicaps (ICIDH). World Health Stat Q 43 273–280 Occurrence Handle1:STN:280:By6C2MjksFc%3D Occurrence Handle2149896
S Fucile P Wright I Chan S Yee M-E Langlais EG Gisel (1998) ArticleTitleFunctional oral-motor skills: Do they change with age? Dysphagia 13 195–201 Occurrence Handle1:STN:280:DyaK1czosVaqug%3D%3D Occurrence Handle9716749
JC Nunnally IH Bernstein (1994) Psychometric theory. McGraw–Hill New York
LG Portney MP Watkins (1993) Validity of measurements. CT Norwalk (Eds) Foundations of clinical research: Applications to practice. Appleton & Lange Norwalk, CT 69–86
J Curran ME Groher (1990) ArticleTitleDevelopment and dissemination of an aspiration risk reduction diet. Dysphagia 5 6–12 Occurrence Handle1:STN:280:By%2BA28%2FmsVA%3D Occurrence Handle2202558
RF DeVellis (1991) Guidelines in scale development. Scale development: Theory and application. Sage Publishers London 51–90
DL Streiner GR Norman (1995) Health measurement scales. Oxford University Press Oxford
JG Wright AR Feinstein (1992) ArticleTitleA comparative contrast of clinimetric and psychometric methods for constructing indexes and rating scales. J Clin Epidemiol 45 1201–1218 Occurrence Handle1:STN:280:ByyD2MjmsFQ%3D Occurrence Handle1432001
S Ferketich (1991) ArticleTitleFocus on psychometrics. Aspects of item analysis. Res Nurs Health 14 165–168 Occurrence Handle1:STN:280:By6B283htFA%3D Occurrence Handle2047538
DJ Ott VN Peele YM Chen DW Gelfand (1990) ArticleTitleOropharyngeal function study: Radiologic means of evaluating swallowing difficulty. South Med J 83 191–193 Occurrence Handle1:STN:280:By%2BC283gslM%3D Occurrence Handle2305300
ML Splaingard B Hutchins LD Sulton G Chaudhuri (1988) ArticleTitleAspiration in rehabilitation patients: videofluoroscopy vs. bedside clinical assessment. Arch Phys Med Rehabil 69 637–640 Occurrence Handle1:STN:280:BieA3cfmvFQ%3D Occurrence Handle3408337
AL Perlman C Lu B Jones (1997) Radiographic contrast examination of the mouth, pharynx and esophagus. AL Perlman KS Schulze–Delrieu (Eds) Deglutition and its disorders: Anatomy, physiology, clinical diagnosis and management. Singular Publishing Group San Diego, CA 153–200
KS Schulze–Delrieu RM Miller (1997) Clinical assessment of dysphagia. AL Perlman KS Schulze–Delrieu (Eds) Deglutition and its disorders: Anatomy, physiology, clinical diagnosis and management. Singular Publishing Group San Diego, CA 125–152
EG Gisel R Birnbaum S Schwartz (1998) ArticleTitleHelping the feeding impaired child. Recent Adv Paediatr 16 59–72
P Bech (1999) Methodological issues in individual quality of life assessment. CRB Joyce HM McGee CA O'Boyle (Eds) Individual quality of life: Approaches to conceptualisation and assessment. Amsterdam Harwood Academic Publishers 51–64
A Fink (1995) How to ask survey questions. SAGE Publications Thousand Oaks, CA
LW Green FR Lewis (1986) Measurement and evaluation in health education and health promotion. Mayfield Publishing Company Palo Alto, CA
J Dekker (1995) ArticleTitleApplication of the ICIDH in survey research on rehabilitation: The emergence of the functional diagnosis. Disabil Rehabil 17 195–201 Occurrence Handle1:STN:280:ByqA3cnotV0%3D Occurrence Handle7787203
RA Keith (1994) ArticleTitleFunctional status and health status. Arch Phys Med Rehabil 75 478–483 Occurrence Handle1:STN:280:ByuB38nltVw%3D Occurrence Handle8172511
L Roberts C Counsell (1998) ArticleTitleAssessment of clinical outcomes in acute stroke trials. Stroke 29 986–991 Occurrence Handle1:STN:280:DyaK1c3lsFKrtA%3D%3D Occurrence Handle9596247
AC McFarlane PM Brooks (1997) ArticleTitleThe assessment of disability and handicap in musculoskeletal disease. J Rheumatol 24 985–949 Occurrence Handle1:STN:280:ByiB1MvitFY%3D Occurrence Handle9150096
RA Keith (1995) ArticleTitleConceptual basis of outcome measures. Am J Phys Rehabil 74 73–80 Occurrence Handle1:STN:280:ByqC2sfgtVY%3D
RM Miller ME Groher (1997) General treatment of neurologic swallowing disorders, ME Groher (Eds) Dysphagia: Diagnosis and management. Butterworth-Heinemann Boston 223–244
Acknowledgements
The authors wish to acknowledge the assistance of Dr. M. Abrahamowicz in the development of the project, data analysis, and in the preparation of this manuscript. This study was funded in part by a Health Canada NHRDP Fellowship, a REPAR Fellowship, a doctoral bursary from the Fonds de la Recherche en Santé du Quebec, and a Canadian Occupational Therapy Foundation–Royal Canadian Legion Fellowship in Gerontology to H.L.
Author information
Authors and Affiliations
Corresponding author
Appendices
Definition of Scales and Sample Items
Abstracted from the McGill Ingestive Skills Assessment User's Manual, Draft Version 2.
For ease of reading, the following text uses the male gender to refer to male or female patients.
Positioning
The purpose of the Positioning Scale is to assess the patient's ability to maintain a position that is safe for feeding. The observer should not alter the patient's position during the meal; this task should be left to the regular caregiver or the patient himself.
Maintains Symmetry of Posture
For this item, observe whether or not the patient leans to the right or the left during the meal.
-
1
Score 1 if the patient spends all or nearly all of the time leaning to one side and does not straighten himself even when he is taking a new mouthful or when he is are swallowing.
-
2
Score 2 if the patient spends more than half of the meal leaning to one side. The patient may lean from time to time and then reposition or may lose his position after a few minutes of the meal and does not regain a symmetric posture.
-
3
Score 3 if the patient spends about less than half of the meal leaning to one side. The patient may lean from time to time and then reposition or may lose his position partway through the meal and does not regain a symmetric posture.
-
4
Score 4 if the patient is able to maintain a symmetrical posture or if he adopts an asymmetric position only transitionally. The patient should be symmetric when taking a mouthful or swallowing. If he is not, score 2 or 3 as appropriate. Some individuals habitually shift their weight from side to side; if they come back to the centre, score 4.
Has Adequate Head Control for Feeding
For this item, observe the patient's ability to hold his head in a neutral position. During eating, the neck should not be extended or flexed more than a few degrees, so that the chin is tucked in.
-
1
Score 1 if the patient requires a head support to prevent loss of position or if he is never able to hold his head in a stable position.
-
2
Score 2 if the patient is able to bring his head into a neutral position and maintain it for a few seconds but does not have head control for the majority of the meal.
-
3
Score 3 if the patient is able to maintain his head position for the majority of the meal duration but has occasional loss of control, allowing his neck to flex or extend.
-
4
Score 4 if the patient is able to maintain his head position throughout the meal. Some individuals may voluntarily look around the room or voluntarily flex or extend to relax stiffness; these individuals should also be scored 4 if these movements are voluntary. If there are involuntary movements in addition to these, score 2 or 3 as appropriate.
Texture Management
The purpose of the Texture Management Scale is to assess the individual's ability to accept food textures. The purpose is not to assess the safety of the consumption of these textures; that aspect is addressed later. In this scale, we are assessing the individual's judgment, discretion, and sensitivity to different textures.
Each of the items is prefaced by the word accepts. This word is to be interpreted as the willing consumption of the texture described. If an individual does not accept the food, he may turn away or refuse to open the mouth. Some individuals realize that they are unable to handle a texture only when it is in the mouth. If an individual spits out a food, appears anxious, cries, or otherwise demonstrates hesitancy or resistance to swallowing, this should be interpreted as not accepting the texture. Some individuals may take a mouthful and then refuse to eat any more; this should be interpreted as nonacceptance unless the patient makes a statement that he dislikes the taste of the food.
Feeding Skills
The purpose of this scale is to assess the individual's ability to manage the meal activity independently and functionally. The scale touches on various aspects of meals, including preparation, self-feeding, behavior, judgment, and appetite.
Sets Up Tray Independently
This item is concerned with the patient's ability to arrange platters appropriately on the tray or table, open wrappers, remove lids, and prepare utensils.
-
1
Score 1 if the patient requires someone else to carry out all or part of these tasks.
-
2
Score 2 if the patient is able to carry out the tasks independently if he is given precise verbal instructions (“pick up the crackers, hold the plastic in each hand, and pull”) or if he is given a physical demonstration without the helper doing the task for him.
-
3
Score 3 if the patient needs only a verbal prompt (“the butter for your bread is on the tray”).
-
4
Score 4 if the patient is able to complete all tasks without assistance or prompting.
Able to Grasp Utensil Functionally
For this item, observe how the patient holds the utensil. The style of grasp is not important. Rather, the utensil should be held in such a way as to prevent spillage of the food before the utensil reaches the mouth.
-
1
Score 1 if the patient is fed by an assistant or if he almost never grasps the utensil functionally.
-
2
Score 2 if the patient self feeds and grasps the utensil functionally for less than half of the meal.
-
3
Score 3 if the patient self feeds and holds the utensil functionally for more than half of the meal.
-
4
Score 4 if the patient always uses a functional grasp.
Liquid Ingestion
The purpose of this scale is to assess the patient's ability to consume regular and thickened liquids. The scale should be scored whether the patient takes the liquid from a glass, cup, or spoon. The scale addresses the various motor functions associated with drinking and the observable signs of pharyngeal function and airway protection.
Seals Lips on Cup
This item addresses the patient's ability to close his lips on the cup when he drinks. Observe the closure of the lips with particular attention to the bottom lip. The glass or cup should rest on the bottom lip during drinking, and the upper lip should close towards the inside of the glass. Some individuals do not completely oppose the upper lip to the surface of the cup; this is considered normal.
-
1
Score 1 if the patient almost never closes his lips on the cup. This may be seen by stabilization of the glass on the lower teeth and/or a lax lower lip. Score 2 if the patient takes liquids from a spoon.
-
2
Score 2 if the patient closes his lips on the cup less than half of the time. He may stop closing his lips partway through the meal or close them only on occasion throughout the meal.
-
3
Score 3 if the patient closes his lips on the cup more than half of the time. He may stop closing his lips partway through the meal or close them only on occasion throughout the meal.
-
4
Score 4 if the patient closes his lips consistently for the entire meal.
Demonstrates Same Voice Quality After Drinking
This item assesses the patient's ability to protect the airway from penetration of liquid. The presence of aspiration and penetration is associated with a change in the patient's voice. A hoarse voice generally becomes deeper and takes on a rough quality. A gurgly voice can be described as sounding “well,” as if there is liquid on the vocal cords. The patient should be observed throughout the meal to determine if this phenomenon appears with fatigue.
-
1
Score 1 if the patient loses his voice after drinking or if he is unable to verbalize at the outset of the meal. A loss of voice on one occasion without any other abnormalities is scored 1.
-
2
Score 2 if the patient demonstrates a change in voice after drinking a small quantity of liquid or if this occurs near the beginning of the meal.
-
3
Score 3 if the patient demonstrates a change in voice after drinking a large quantity of liquid or if this occurs near the end of the meal.
-
4
Score 4 if there is never any change in voice after drinking.
Solid Ingestion
The purpose of this scale is to assess the patient's motor skills for eating, as well as to evaluate the observable signs of pharyngeal dysfunction. The patient should be observed as he consumes all foods of a solid texture, including purees and puddings.
Opens Mouth in Anticipation
This item assesses the patient's preparation to receive food. The patient should open his mouth to admit the utensil whether he is being fed or is self-feeding. The patient should open at the sight or smell of the food approaching, on a verbal cue from a feeder, or, in the case of individual with multiple sensory deficits, as the utensil is touched to the lower lip. Unless there is a physical limitation to the range of motion in the jaw, the mouth should open wide enough to allow the utensil to pass without stretching the corners of the mouth.
-
1
Score 1 if the patient almost never opens his mouth in anticipation. If the patient needs to be coerced to open his mouth or consistently opens his mouth so little that the utensil cannot pass, score 1.
-
2
Score 2 if the patient opens his mouth less than half of the time or opens his mouth widely enough only on occasion.
-
3
Score 3 if the patient opens his mouth more than half of the time or only occasionally does not open widely enough for the utensil to pass.
-
4
Score 4 if the patient consistently opens his mouth widely enough in anticipation.
Retains Food in Mouth
This item assesses the patient's ability to form a bolus and control the bolus in the mouth, as well as the ability of the lips to contain solid food. This should be scored based on the patient's performance throughout the processing of the bolus in preparation for the swallow.
-
1
Score 1 if the patient loses any amount of food on a consistent basis or if there is occasional loss of large quantities of the bolus.
-
2
Score 2 if the patient loses small amounts of food frequently. This may occur at intervals throughout the meal or begin to occur consistently as the patient becomes fatigued as the meal progresses.
-
3
Score 3 if the patient loses small quantities on occasion, either periodically throughout the meal or consistently for a short period of time.
-
4
Score 4 if the patient never loses food during oral processing.
Rights and permissions
About this article
Cite this article
Lambert, H.C., Gisel, E.G., Groher, M.E. et al. McGill Ingestive Skills Assessment (MISA): Development and First Field Test of an Evaluation of Functional Ingestive Skills of Elderly Persons . Dysphagia 18, 101–113 (2003). https://doi.org/10.1007/s00455-002-0091-2
Issue Date:
DOI: https://doi.org/10.1007/s00455-002-0091-2