Abstract
Nuclear stress in English highlights the most important information in a sentence. Its correct use and location are thus fundamental for achieving meaningful communication. English learners who manifest intelligibility and/or comprehensibility problems due to nuclear stress misplacement can improve their pronunciation through explicit focused instruction. This classroom-based study aimed to evaluate the effectiveness of two pronunciation instruction treatments in an EFL context using measurements of nuclear stress placement and comprehensibility. Participants were 50 Spanish-L1 trainees divided evenly into Groups A and B. Both groups were exposed to a traditional, teacher-centered approach to pronunciation teaching (TCT), but Group B added a communicative, awareness-building component (CABC). Participants’ free speech samples were assessed before and after instruction via pre- and post-test recordings. A slight tendency for improvement for nuclear stress and higher values for comprehensibility were observed between pre- and post-tests for Group B. A statistically significant simple linear regression was reported only for Group B in the relative response for nuclear stress and comprehensibility, thus demonstrating the benefits of CABC. The assessment protocols proved useful in determining the efficacy of one treatment over the other. The chapter concludes with a discussion of the implications of the findings for pronunciation assessment, research, and teaching.
Access provided by Autonomous University of Puebla. Download chapter PDF
Similar content being viewed by others
Keywords
1 Introduction
For years, second language (L2) pronunciation instruction has been marginalized in L2 language teaching and research. To date, however, with the advent of economic globalization, technological advances and the subsequent need to establish effective oral communication, pronunciation teaching has been revitalized and has thus reemerged in the applied linguistic research mainstream. As a result, there is a large number of high-ranking pronunciation-specific studies that recognize explicit instruction as crucial for the development of learners’ L2 speech intelligibility and comprehensibility (e.g., Derwing et al., 2014; Lee et al., 2015; Saito, 2011; Trofimovich & Isaacs, 2012; Trofimovich et al., 2017). Despite this renewed interest in L2 pronunciation teaching, many in-service and pre-service teachers still report being confused about how to teach and/or assess this construct (Foote et al., 2011; Murphy, 2014; Pennington & Rogerson-Revell, 2019) unless their teacher education programs specifically trained them for pronunciation teaching and assessment (Sardegna, 2020). Also, while some studies have found that segmental aspects are crucial for effective communication, particularly those that carry a high functional load (Munro & Derwing, 2006), others provide robust evidence that prosody, particularly nuclear stress, is essential for understanding (Dauer, 2005; Hahn, 2004; Jenkins, 2000; Luchini, 2017), and should thus be explicitly taught. Therefore, an exploration of the relationship between measurements of nuclear stress placement and comprehensibility and instructional approaches may provide useful information regarding the efficacy of L2 pronunciation instruction.
This chapter reports on an experimental study that conducted such exploration with 50 trainees at a local university in Mar del Plata, Argentina. Participants’ first language (L1) was Spanish and their L2 was English. They were split in two groups depending on the pronunciation instruction approach they received. Two specialists assessed their pre- and post-instruction speech samples with respect to nuclear stress placement and ten English native speakers judged the comprehensibility of the same speech samples. The results obtained provide interesting implications for L2 pronunciation assessment, research and teaching, which are discussed at the end of the chapter.
2 L2 Pronunciation Teaching and Assessment
The last 20 years have witnessed a paradigm shift in the goals of L2 pronunciation teaching as numerous renowned research studies in the field have given precedence to intelligibility and comprehensibility over those of nativeness or the eradication of a foreign accent (Derwing & Munro, 2009, 2015; Levis, 2005, 2018). Research findings have shown that pronunciation is a vital component of communicative competence and as such it should be given high priority in the L2 classroom (Morley, 1991). Provided that learners are intelligible and easy to understand, their pronunciation will not obstruct communication. Levis (2005) classified L2 pronunciation teaching into two main categories: teaching that follows the Nativeness Principle and teaching that follows the Intelligibility Principle. The first category comprises pronunciation instruction whose main goal is to push students to achieve a native-like pronunciation, while the second refers to speech that listeners can comfortably understand despite having some traces of local or regional accent coming from the speaker’s L1.
Munro and Derwing (1995) and Derwing and Munro (1997) presented three different dimensions of L2 speech. They refer to intelligibility as the extent to which a listener understands L2 speech. They define comprehensibility in regard to the measure of how easy or difficult it is for the listener to understand L2 speech; that is, the cognitive effort required by the listener to understand. Lastly, they define accentedness as differences between speakers’ and listeners’ speech production of sounds and sound patterns. Accent is partly independent from intelligibility and comprehensibility (Trofimovich & Isaacs, 2012). Although accent is perceptively evident, it does not necessarily obstruct understanding (Derwing & Munro, 2009, 2015). Frequently, it is difficulties with intelligibility and/or comprehensibility that may cause problems for understanding. This suggests that the main goal for L2 pronunciation teaching should be to focus on those features of pronunciation that may cause problems for understanding, unless the learner’s speech is already very clear.
Many studies examine the comparative efficacy of L2 pronunciation teaching for either segmental (sounds) or suprasegmental features (stress, rhythm and intonation). While various researchers show that sounds are easier to teach and learn (Levis, 2005; Saito, 2014), others claim that suprasegmental-based instruction has an influence on comprehensibility (Derwing et al., 1998; Gordon et al., 2013; Hahn, 2004; Isaacs & Trofimovich, 2012; Kang et al., 2010; McNerney & Mendelsohn, 1992; Munro, 1995; Saito & Saito, 2017). As for the different aspects that make up the suprasegmentals in English, it is known that the protagonist is nuclear stress. This salient prosodic feature plays a decisive role in producing textual cohesion and in sequencing a hierarchical organization of discourse. Nuclear stress points to new and contrastive information and data that are not available for the listener to retrieve from the context or prior knowledge (Bardovi-Harlig, 1986; Halliday, 2013; Pennington & Richards, 1986; Sperber & Wilson, 1986).
Many L2 learners have difficulty learning how to use nuclear stress in English. They often display two major problems: stressing almost all words in an utterance without signaling one major prominent stress, and/or misplacing nuclear stress (Field, 2005; Hahn, 2004). When nuclear stress is misplaced, sentence processing for the listener becomes more difficult, thus compromising comprehensibility (Birch & Clifton, 1995; Kang et al., 2010; Tajima et al., 1997; Terken & Hirschberg, 1994; Winters & O’Brien, 2013). Non-native speakers’ intonation, for example, seems to be a crucial factor in native listeners’ understanding, as tone choice and location can affect both perceived information structure and pragmatic cues in L2 discourse (Kang et al., 2010).
Numerous research studies show that prosodic features have a strong impact on L2 oral performance assessment (Anderson-Hsieh et al., 1992; Derwing et al., 1998; Isaacs & Trofimovich, 2012; Kang, 2012; Kang & Johnson, 2018; Kang et al., 2010; Saito, 2014). While most of these investigations explore different linguistic and phonological variables and their correlates with intelligibility and comprehensibility, few of them assess the effects of single parameters of English such as nuclear stress placement (Kang & Johnson, 2018) and their relationship with comprehensibility as predictors of L2 oral development. Therefore, classroom-based studies evaluating the properties of such prosodic features and their relationship with comprehensibility warrant further exploration.
In the past, the assessment of L2 pronunciation was marginalized in second language teaching and research, mainly because it was associated with discrete aspects of oral discourse (Lado, 1961). The advent of communicative competence (Hymes, 1972) brought about the years of neglect of pronunciation. It was not until the mid-90s that teachers and researchers began to focus their attention on the value and role of L2 pronunciation assessment for effective language use. At present, the emergence of pronunciation assessment can be partially ascribed to the shift in focus from perceptions of accentedness to the wide-ranging L2 speech dimensions of intelligibility and comprehensibility.
Recent indications among researchers and educational practitioners show that pronunciation assessment has attracted particular interest and gained special importance (Bøhn & Hansen, 2017; Chun, 2006, 2008; Fulcher, 2015; Isaacs, 2008, 2016; Isaacs & Trofimovich, 2016; Kang & Pickering, 2014; Kim, 2015; Thomson, 2018; Trofimovich et al., 2016; Xi, 2010, 2012), signaling that this process is now being considered part of the L2 speaking construct. Until recently, research on pronunciation assessment has relied heavily on listeners’ subjective judgments and other L2 speech measurements external to the listener such as speech rate, pause length and location, lexical stress, among others. However, there have been few attempts to explore the impact of measurements of nuclear stress placement and comprehensibility working in tandem for the development of L2 speech.
3 The Study
This classroom-based study sought to assess L2 learners’ pronunciation using measurements of nuclear stress placement and comprehensibility to evaluate the efficacy of one particular pronunciation pedagogical treatment over another. The research questions that guided the present study are:
-
1.
To what extent does the addition of a communicative, awareness-rising component to a traditional teacher-centered approach to the teaching of L2 pronunciation contribute to enhance the students’ perceived comprehensibility and nuclear stress placement?
-
2.
Is there any degree of association between comprehensibility and nuclear stress placement improvements in each of the treatments applied?
4 Method
4.1 Context and Participants
The experimental context of this classroom-based study was Discurso Oral II (DOII), a 16-week pronunciation-specific course of eight weekly hours focusing on suprasegementals. This course is taught in year 2 of the English Teacher Training Program offered at a local state university in Mar del Plata, Argentina. The students enroll in this class after having taken and passed English Phonetics and Phonology I and II, where they study the nature of English sounds.
Fifty Spanish-L1 trainees participated in this study. They were divided into two groups: A (n = 25) and B (n = 25). In Group A, learners were from 20 to 41 years old (M = 22), and in Group B, they were from 19 to 30 years old (M = 22). Each group consisted of 23 females and 2 males. Their level of English language competence before entering the university was equivalent to a TOEFL iBT Total Score of 70 or above. Their formal L2 instruction ranged from 5 to 9 years at private local language institutes in Mar del Plata, Argentina (M years of instruction: A = 7.12, B = 7.32). None reported having lived in an English-speaking country before taking the course. When data were gathered, these learners were taking other courses in English in the same teacher training program. In both groups, the participants reported not having used English outside the classroom, except for completing homework. Native and non-native English speaker models (their teachers and listening materials) were the type of input they received.
4.2 Teaching Intervention
Both groups were taught during a 16-week period at different times and received suprasegmental instruction using a teacher-centered approach to pronunciation teaching (TCT), which focused on form. The theoretical sessions of instruction lasted 16 weeks and covered aspects relating to English stress, rhythm and intonation. Practical sessions consisted in dictations whereby students were required to recognize and transcribe segmental and prosodic features using phonetic script and pronunciation conventions. Students completed controlled exercises, imitating British English native-speakers using the RP (Received Pronunciation) accent. Student-teacher and student-student interactions were limited. Unlike Group A, Group B included a communicative, awareness-building component (CABC) with a strong focus on the teaching of suprasegmentals. This CABC was taught within the same timeframe as the other group in a weekly 2-h block. To include this component, a lab controlled-practice block was taken out from the instruction. Within the CABC, learners completed a battery of communicative tasks aimed at raising their awareness of specific phonological target forms followed by a period of analysis and reflection (Luchini, 2018). These tasks required students to work collaboratively in class. They were asked to recognize, analyze, reflect and emulate different phonological target forms as well as to self-assess their productions. They were exposed to different native and nonnative English accents.
4.3 L2 Speech Samples
The speech samples were taken from task 2 (T2) of an oral achievement test (Luchini, 2004) administered to participants before and after instruction in the form of pre/post-tests at weeks 1 and 16, respectively. T2 asked learners to compare and contrast two pictures of people doing different activities. This task was chosen because it does not present any interactional phenomena, thus facilitating the data processing as there are no voice overlaps, or changes in tonal adaptation caused by turn taking. Thirty seconds of recording were selected from both the pre- and post-tests which lasted approximately two minutes each. Each speech sample was delimited by the use of two-time markers: after the first 10 s of starting T2, and within the stipulated 30 s. That is, neither the beginning nor the end of the task was included for analysis, thus allowing the study of the central portion of all the recordings, which is the extension of the speech signal with a greater degree of fluency. Working with standardized speech samples in terms of their duration allows for more consistent comparisons among productions.
4.4 Assessment Procedure for Nuclear Stress Placement
Two experienced English pronunciation teacher-researchers (one a balanced Spanish/English bilingual speaker, the other a Spanish-L1 speaker and advanced English-L2 speaker) worked independently, listened to, transcribed, and segmented the spelling transcripts of the students’ recordings into tone units. The tone unit is a unit of English phonology, which can be defined as one melodic contour (Halliday & Greaves, 2008). Both filled and empty pauses were removed from the spelling transcripts. The teachers identified and placed nuclear stresses in each tone unit following the rules that govern English nuclear stress, and informed by the context provided by the transcripts. To measure the assessors’ degree of agreement, interrater reliability was used. That is, the results of each assessor were compared in order to determine consensus degree. The percentage of homogeneity between results was 89%. Assessors negotiated final agreement for the remaining 11%. The assessors reported that segmenting the orthographic transcripts presented a high degree of complexity, resulting in, for example, one same statement being segmented differently. To standardize this process, both assessors were asked to arrive at a standard response against which they would later evaluate the learners’ speech samples. Therefore, the assessors compared the learners’ recordings to the standard response to determine the correct/incorrect location of nuclear stresses. That is, for each participant’s speech sample in both pre/post-test conditions, there was a corresponding standard response (100 speech samples = 100 standard responses). To operationalize this procedure, Trofimovich’s personal suggestion was followed (Trofimovich, October, 2009, personal conversation):
The problem with working with free speech data is normalizing for speech length. Different people produce speech samples that are different in length and therefore they have different opportunities to produce the items that you are measuring. To get a measure for each participant, I would divide each count by the total number of possibilities. These “counts” and “possibilities” depend on what you are measuring. If, for example, in a given speech sample there are five nuclear stresses (as suggested by the specialists), then you have your 5 possibilities. So everything the student has done will be counted out of 5. If, for example, a student got 3 out of 5 of these stresses right, then your correct count for this student is 3. And your final measure will be 3 divided by 5 (3/5), that is, 3 stresses out of 5. So your counts will be a proportion of nuclear stresses produced correctly. If a student got more stresses than there should be, I would not punish him/her for these “extra” stresses.
This procedure consists in dividing the total number of coincidences in the students’ productions of nuclear stresses by those agreed in the assessors’ standard responses. For example, if for the same speech sample, a learner marked three nuclear stresses while the assessors agreed on five, the average for that participant was 3 out of 5 (3/5), equivalent to: 0.6. Whenever learners’ production evidenced a greater number of nuclear stresses than those identified by the assessors, those were not considered as part of the total average. Only nuclear stresses that matched the standard response number counted as correct answers. This procedure is illustrated in Table 1, using Student 9’s speech sample in pre-test condition (Group A) as an example. Slanted bars (/) indicate tone unit boundaries. Syllables bearing the nuclear stress are shown in bold font.
Whereas the assessors identified six nuclear stresses in the standard response, the analysis of Student 9’s speech sample shows 8 nuclear stresses, 3 of which matched the ones they had identified in the standard response. Following Trofimovich’s suggestion, then, the value of (1) represents total coincidence of nuclear stress placement in both samples. In this case, it indicates a coefficient of 0.5.
The same assessment procedures were used to analyze Student 9’s production in the post-test condition (Group A). Table 2 shows both the standard response and the assessors’ perceptual analysis.
From their experience as pronunciation teachers and guided by phrase stress rules, the assessors identified ten nuclear stresses which they highlighted in their standard response. Interestingly, in their perceptual analysis of Student 9’s production, they also recognized ten nuclear stresses, of which six matched those they had identified in the standard response. The results in the post-test condition reveal a coefficient of 0.6, indicating an improvement in the location of nuclear stresses.
Two acoustic profiles of the same phrase “and in the second photograph” taken from this same speech sample are shown below. The computer program Speech Analyzer® for acoustic analysis of speech sounds was used (see https://software.sil.org/speech-analyzer/). Figure 1 shows Student 9’s production taken from the post-test condition. Figure 2 shows the production of the same phrase coming from the balanced Spanish/English bilingual assessor. The student misplaces the nuclear stress on the word “photograph,” while the assessor, in her role as bilingual speaker and specialist correctly locates the stress on the word “second,” consistent with the rules that govern contrastive stress placement in English.
Figure 1 shows three acoustic records in four windows that allow visualization of the variations in the speech wave and intensity (on the left), and frequency (F0) and harmonics (on the right). All reflect the physical properties with which Student 9 emitted the phrase “and in the second photograph.” In the windows located on the right-hand side, for example, two important peaks of F0 are located: the first of approximately 200 Hz corresponding to “second,” and the most significant is 258 Hz in ‘photograph,’ which acquires all the requirements of a nuclear stress, peak intensity of around 60 dB (decibels) being added to these F0 values.
Figure 2 illustrates the extent of individual variations in the production of prosodic contours. In principle, and always within the comparison of the same phrase emitted by two female speakers, it is observed that nuclear stress assignation is different. In this case, the assessor decides to highlight the first syllable of the word “second,” because she has taken into account the variants of the discursive context, always bearing in mind the order of the implementation of T2. The need to use contrastive stress in this case leads her to produce a 310 Hz frequency peak that accompanies an energy rise of around 89 dB. To her sharp register, we must add what is displayed in the first window on the left: the fluency of her continuous speech flow, which does not present any sign of hesitation, thus there is no explicit pause. This is clearly shown by the compression of the waveform, where we can see a noteworthy difference between the two speakers’ realizations of the same phrase. In Fig. 1, this same window presents hesitation or doubt, equivalent to a pause between the stresses mentioned (see distance in the temporal axis of the windows located to the right of Fig. 1, between the words “second” and “photograph”).
Observation of these acoustic profiles allows us to distinguish the scope of individual differences and degrees of training in the use of English pronunciation between the two speakers. The acoustic aspect that is associated with a better command of English is manifested by the balanced bilingual speaker. This type of acoustic analysis highlights the importance of the use and localization of the nuclear stress. We can see that the operationalization of this assessment procedure provides interesting information that allows to evaluate the efficacy of speakers’ use and placement of nuclear stress in free speech production in English and to measure their linguistic development and oral proficiency over time.
4.5 Assessment Procedure for Comprehensibility
Ten experienced English native speaker raters, operating independently, listened to the 100 speech samples and rated them using a Likert-like scale ranging from 1–9 to determine the speakers’ degree of perceived comprehensibility. In this context, comprehensibility means the perceived ease or difficulty of understanding L2 speech, that is, the cognitive effort made by the listener to understand accented speech (Munro & Derwing, 1995). The listeners made a scalar judgment of comprehensibility where 9 indicated total ease of understanding and 1 showed poor comprehensibility or high degree of effort on the part of the listener to understand non-native speech. The raters heard each stimulus once. To reduce the effects of fatigue, they were given short breaks in between the recordings. None of the raters reported having had hearing impediments.
4.6 Data Analysis
The statistical analysis was performed using InfoStat software v2020e (Di Rienzo et al., 2014). Mean values, standard deviation and least significant differences were calculated using the LeastSquares Fit model. Mean comparisons were made with independent samples t-tests in each group for both independent variables (nuclear stress and comprehensibility) with α = 0.05. A simple linear regression analysis was performed between the relative responses (RR) of nuclear stress and comprehensibility: RR = (post-test − pre-test / pre-test) × (100) to determine whether the variations in one of the variables explain the variations in the other. Outliers were removed prior to analysis.
5 Results
In either treatment, no significant differences were observed between pre- and post-test conditions for both nuclear stress and comprehensibility (see Tables 3 and 4).
However, a slight tendency for improvement for nuclear stress and higher values for comprehensibility are observed between pre- and post-tests in the CABC treatment, which indicates that Group B improved the nuclear stress coincidence coefficient (i.e., closer to 0.8) and the degree of comprehensibility (i.e., higher than 6) (see Figs. 3 and 4).
The simple linear regression analysis between RRNS (relative response nuclear stress) and RRC (relative response comprehensibility) for Group A (TCT) was not statistically significant with a p-value of 0.6073 and an adjusted R-squared of −0.03421. On the other hand, the simple linear regression analysis of Group B (CABC) was statistically significant with α = 0.1 (probability error of 10%) with a p-value of 0.0542 and an adjusted R-squared of 0.1383.
Figure 5 shows the dispersion of the data between the relative responses of the analyzed variables (RRNS and RRC), and the simple positive linear regression line is shown only for Group B. The improvements obtained by this group, exposed to the CABC treatment, explain 14% of the variation in RRC, while Group A, under the TCT treatment, does not register a relationship between the variables. This indicates the lack of relationship between the variation in nuclear stress placement throughout the instructional period and the variations in comprehensibility.
6 Discussion
Both experimental groups underwent a teacher-centered treatment (TCT), but only Group B included a communicative-awareness-building component (CABC). Intragroup analyses revealed that Group B obtained better results in the two variables analyzed (nuclear stress and comprehensibility), thereby demonstrating that formal instruction that includes a communicative component tends to show better improvements on students’ productions. In this communicative block, Group B learners completed a battery of progressive tasks aimed at raising their awareness of specific phonological target forms followed by a period of analysis and reflection. These tasks were sequenced in order to lay emphasis on a meaning-form-meaning progression that sought to recognize phonological gaps in the students’ interlanguage while in the process of constructing meaning. Phonological gaps were filled in language-pronunciation focused sessions by making comparisons between input and output which brought about discussions, always focusing on phonological target forms (Samuda, 2001; Swain & Lapkin, 2001). The aim of these tasks was to help students raise their awareness of key phonological features and the contribution of these aspects for establishing both receptive and productive intelligibility/comprehensibility. The inclusion of CABC promoted some degree of improvement in the target form, and thus provides the groundwork for more accurate nuclear stress placement.
The simple linear regression analysis between RRNS and RRC in Group A was not statistically significant, showing no relationship between the variables. The pedagogical treatment applied to Group A (TCT) was more aligned with the Nativeness paradigm. This finding echoes findings from other studies framed within the Nativeness paradigm (see Thomson & Derwing, 2014), which showed an unclear relationship between pronunciation improvement with discrete features and more intelligible and comprehensible speech. In contrast, a statistically significant linear regression between RRNS and RRC was found for Group B, which included the CABC treatment (more aligned with the Intelligibility principle). Group B’s 14% improvement in comprehensibility was due to students’ progress in nuclear stress placement. Thus, the results of the current study are more in line with previous findings showing that the Intelligibility-oriented paradigm is highly related to better achievements in intelligibility and comprehensibility (Isaacs & Trofimovich, 2012; Jułkowska & Cebrian, 2015; Kang, 2010; Saito et al., 2015, 2016; Thomson, 2018; Trofimovich & Isaacs, 2012). Isaacs and Trofimovich (2012) amalgamated intelligibility and comprehensibility suggesting that issues concerning comprehensibility are consistent with the instructional goals of helping learners attain intelligible pronunciation. It appears then that an awareness-rising, communicative-based approach for the teaching of suprasegmentals improves nuclear stress placement which, in turn, brings about advances in comprehensibility. Therefore, it seems to be advisable for pronunciation teachers to incorporate form-focused classroom tasks that strictly aim to develop the correct use and localization of nuclear stress enabling students to achieve better comprehensibility. The CABC instructional block was limited to two weekly hours. The question for further investigation remains: Had the students received more instructional hours within the CABC framework, would their degree of comprehensibility have been better?
The data from this study reinforce and complement the pedagogical claim that emphasizes the importance of teaching nuclear stress placement to achieve higher levels of comprehensibility (Hahn, 2004; Kang, 2010; Morley, 1991). In her Lingua Franca Core, Jenkins (2000, 2002) includes nuclear stress as an essential feature because it contributes to mutual intelligibility in interactions among non-native speakers from different linguistic backgrounds. Along these lines, McNerney and Mendelsohn (1992) affirm that suprasegmentals must be taught before any other phonological aspect because they have a direct impact on the students’ comprehensibility. They argue that giving priority to suprasegmentals not only improves students’ comprehensibility but also contributes to raising their self-esteem as greater changes can be effected in their speech. Similar pedagogical arguments have been put forward by some other researchers (Brazil et al., 1980; Brown, 1995; Celce-Murcia et al., 2010; Clennell, 1996; Derwing et al., 1998; Kang, 2010; Kang & Johnson, 2018; Morley, 1991; Pennington & Ellis, 2000; Pennington & Richards, 1986). These findings lead to important pedagogical implications for language teachers, program designers and developers. Pronunciation classes can focus—though not exclusively—on suprasegmental differences directly related to nuclear stress placement and listeners’ comprehensibility.
Finally, the design and systematization of an assessment protocol for measuring L2 pronunciation features permeates this chapter. The speech measures were analyzed using both auditory and instrumental techniques. Ten raters measured comprehensibility using a numerical scale of listener perception. For nuclear stress measurements, two specialized teacher-researchers provided a standard response for each speech sample that was later compared against the students’ productions. Nuclear stress measurements were then compared with those of comprehensibility using simple linear regression analysis. This comparison determined the efficacy of one treatment over the other. The main findings of this study draw light on the usefulness of the implemented pronunciation assessment protocol for evaluating the effectiveness of L2 pronunciation instruction. This protocol may be valuable for other teachers and researchers interested in measuring students’ L2 pronunciation gains and compare results in other teaching contexts using the same or other pedagogical treatments.
6.1 Limitations
Although the findings of this study yielded interesting results regarding the impact of one L2 pronunciation pedagogical treatment over another, there are a number of limitations that are worth discussing. As opposed to lab experiments, classroom-based studies, such as this one, inevitably allow for other influencing linguistic factors that need to be taken into account. The students in both groups were simultaneously taking other English classes along with DOII. This classroom input could have enhanced their L2 pronunciation development as well. Both groups showed a slight tendency towards improvement in their oral productions after instruction. Yet, Group B scored higher results than Group A. This intragroup difference is attributed to the inclusion of the CABC in the pedagogical treatment applied to Group B. As already mentioned, it is worth posing the question whether a larger CABC workload would have produced further advancement in comprehensibility. Moreover, a comparative study that evaluates the impact of two entirely different treatments, one of them being exclusively based on the CABC pedagogical principles, would be needed.
The current study involved the measurement of one single prosodic feature: nuclear stress placement. Research on measurements of other elements of oral proficiency such as lexical stress, rhythm and pause duration, location and frequency, for example, would have yielded more information to corroborate or contradict the findings obtained. Additionally, learning about the students’ beliefs and perceptions regarding the development of their L2 productions before and after instruction would have allowed to cross-check different types of data, confirm findings, and perhaps help to interpret the results obtained. Unfortunately, due to time constraints, neither option was possible. Finally, all the participants were L1-Spanish speakers studying to become English teachers. Results from populations of other cultural and linguistic backgrounds, and learning goals could provide other types of information.
7 Implications
This study may be a valuable contribution to future teachers and researchers. Correct nuclear stress placement contributes to increased comprehensibility and as such should be given high priority in the L2 pronunciation class. These findings may also lead to important pedagogical implications, providing additional evidence to support the importance of suprasegementals on listeners’ perception and clarify their relationship with comprehensibility on L2 learners’ speech. Teachers, trainers, program designers and developers should focus their attention on devoting more class time to teach this prosodic feature.
Furthermore, a pedagogical proposal for the teaching of suprasegmentals, as the one deployed in the CABC group, whereby tasks function as a pivot to develop phonological awareness, promotes self-efficacy and pushes learners to use metacognitive skills. Both these factors increase the chances of further development of comprehensible read-aloud L2 oral production (Sardegna, 2012, 2021). The current study contributes to this line of research by showing how improvements in nuclear stress placement via awareness-raising relate to improvements in speech comprehensibility in a picture description task. Further research in this area is needed to confirm and extend the findings to other speech features.
8 Conclusion
Pronunciation instruction is not a marginalized area of second language teaching and research anymore. This field is growing swiftly. Explicit pronunciation instruction can have a significant effect on students’ oral production because it focuses on learners’ attention to phonetic information and increases phonological awareness, which promotes learning in a way that exposure alone does not. Previous research on L2 pronunciation has concentrated on identifying L2 learners’ stress patterns. Only a few studies have measured the effect of nuclear stress placement along with comprehensibility ratings, and have used this assessment procedure as an instrument to evaluate the effectiveness of L2 pronunciation instruction. The innovative assessment procedure used in this classroom-based study proved useful to determine such efficacy. As mentioned earlier, further studies are needed to corroborate or contradict these findings, as well as to increase our understanding of suprasegementals as predictors of L2 pronunciation development, and to help define instructional priorities.
References
Anderson-Hsieh, J., Johnson, R., & Koehler, K. (1992). The relationship between native speaker judgments of nonnative pronunciation and deviance in segmentals, prosody, and syllable structure. Language Learning, 42(4), 529–555. https://doi.org/10.1111/j.1467-1770.1992.tb01043.x
Bardovi-Harlig, K. (1986). Pragmatic determinants of English sentence stress. Indiana University Linguistics Club.
Birch, S., & Clifton, C. (1995). Focus, accent, and argument structure: Effects on language comprehension. Language and Speech, 38(4), 365–391. https://doi.org/10.1177/002383099503800403
Bøhn, H., & Hansen, T. (2017). Assessing pronunciation in an EFL context: Teachers’ orientations towards nativeness and intelligibility. Language Assessment Quarterly, 14(1), 54–68. https://doi.org/10.1080/15434303.2016.1256407
Brazil, D., Coulthard, M., & Johns, C. (1980). Discourse intonation and language teaching. Longman.
Brown, A. (1995). Minimal pairs: Minimal importance? English Language Teaching Journal, 49(2), 169–175. https://doi.org/10.1093/elt/49.2.169
Celce-Murcia, M., Brinton, D. M., Goodwin, J. M., & Griner, B. (2010). Teaching pronunciation: A course book and reference guide (2nd ed.). Cambridge University Press.
Chun, C. W. (2006). An analysis of a language test for employment: The authenticity of the PhonePass test. Language Assessment Quarterly, 3(3), 295–306. https://doi.org/10.1207/s15434311laq0303_4
Chun, C. W. (2008). Comments on ‘evaluation of the usefulness of the Versant for English test: A response’: The author responds. Language Assessment Quarterly, 5(2), 168–172. https://doi.org/10.1080/15434300801934751
Clennell, C. (1996). Promoting the role of English prosody in a discourse-based approach to oral interaction. Prospect, 11(3), 17–28.
Dauer, R. (2005). The Lingua Franca Core. A new model for pronunciation instruction? TESOL Quarterly, 39(3), 543–549. https://doi.org/10.2307/3588494
Derwing, T., & Munro, M. J. (1997). Accent, intelligibility, and comprehensibility: Evidence from four L1s. Studies in Second Language Acquisition, 19(1), 1–16. https://doi.org/10.1017/S0272263197001010
Derwing, T., & Munro, M. J. (2009). Putting accent in its place: Rethinking obstacles to communication. Language Teaching, 42(4), 1–15. https://doi.org/10.1017/S026144480800551X
Derwing, T., & Munro, M. J. (2015). The interface of teaching and research: What type of pronunciation instruction should L2 learners expect? In P. Luchini, M. A. García Jurado, & U. Alves (Eds.), Fonética y fonología: Articulación entre enseñanza e investigación (pp. 14–26). Biblioteca Central Universidad Nacional de Mar del Plata.
Derwing, T., Munro, M., Foote, J., Waugh, E., & Fleming, J. (2014). Open the window on comprehensible pronunciation after 19 years: A workplace training study. Language Learning, 64(3), 526–548. https://doi.org/10.1111/lang.12053
Derwing, T., Munro, M., & Wiebe, G. (1998). Evidence in favor of a broad framework for pronunciation instruction. Language Learning, 48(3), 393–410. https://doi.org/10.1111/0023-8333.00047
Di Rienzo J., Casanoves, F., Balzarini, M., Gonzalez, L., Tablada, M., & Robledo, C. (2014). InfoStat (versión 2014) [Computer software]. Universidad Nacional de Córdoba. https://www.infostat.com.ar/
Field, J. (2005). Intelligibility and the listener: The role of lexical stress. TESOL Quarterly, 39(3), 399–423. https://doi.org/10.2307/3588487
Foote, J. A., Holtby, A. K., & Derwing, T. M. (2011). Survey of the teaching of pronunciation in adult ESL programs in Canada, 2010. TESL Canada Journal, 29(1), 1–22. https://doi.org/10.18806/tesl.v29i1.1086
Fulcher, G. (2015). Assessing second language speaking. Language Teaching, 48(2), 198–216. https://doi.org/10.1017/S0261444814000391
Gordon, J., Darcy, I., & Ewert, D. (2013). Pronunciation teaching and learning: Effects of explicit phonetic instruction in the L2 classroom. In J. Levis, & K. LeVelle (Eds.), Proceedings of the 4th Pronunciation in Second Language Learning and Teaching Conference (pp. 194–206). Iowa State University.
Hahn, L. D. (2004). Primary stress and intelligibility: Research to motivate the teaching of suprasegmentals. TESOL Quarterly, 38(2), 201–203. https://doi.org/10.2307/3588378
Halliday, M. A. K. (2013). Halliday’s introduction to functional grammar (4th ed.). Routledge. https://doi.org/10.4324/9780203431269
Halliday, M. A. K., & Greaves, W. (2008). Intonation in the grammar of English. Equinox. https://www.equinoxpub.com/home/intonation-grammar-english-m-k-halliday-william-greaves/
Hymes, D. H. (1972). On communicative competence. In J. B. Pride & J. Holmes (Eds.), Sociolinguistics: Selected readings (pp. 269–293). Penguin.
Isaacs, T. (2008). Towards defining a valid assessment criterion of pronunciation proficiency in non-native English-speaking graduate students. Canadian Modern Language Review, 64(4), 555–580. https://doi.org/10.3138/cmlr.64.4.555
Isaacs, T. (2016). Assessing speaking. In D. Tsagari & J. Banerjee (Eds.), Handbook of second language assessment (pp. 131–146). De Gruyter Mouton. https://doi.org/10.1515/9781614513827-011
Isaacs, T., & Trofimovich, P. (2012). Deconstructing comprehensibility: Identifying the linguistic influences on listeners’ L2 comprehensibility ratings. Studies in Second Language Acquisition, 34(3), 475–505. https://doi.org/10.1017/S0272263112000150
Isaacs, T., & Trofimovich, P. (2016). Second language pronunciation assessment: Interdisciplinary perspectives. Multilingual Matters. https://doi.org/10.21832/ISAACS6848
Jenkins, J. (2000). The phonology of English as an international language. Oxford University Press.
Jenkins, J. (2002). A sociolinguistically based, empirically researched pronunciation syllabus for English as an international language. Applied Linguistics, 23(1), 83–103. https://doi.org/10.1093/applin/23.1.83
Jułkowska, I. A., & Cebrian, J. (2015). Effects of listener factors and stimulus properties on the intelligibility, comprehensibility and accentedness of L2 speech. Journal of Second Language Pronunciation, 1(2), 211–237. https://doi.org/10.1075/jslp.1.2.04jul
Kang, O. (2010). Relative salience of suprasegmental features on judgments of L2 comprehensibility and accentedness. System, 38(2), 301–315. https://doi.org/10.1016/j.system.2010.01.005
Kang, O. (2012). Relative impact of pronunciation features on ratings of non-native speakers’ oral proficiency. In J. Levis & K. LeVelle (Eds.), Proceedings of the 4th Pronunciation in Second Language Learning and Teaching Conference (pp. 10–15). Iowa State University. https://apling.engl.iastate.edu/wp-content/uploads/sites/221/2015/05/PSLLT_4th_Proceedings_2012.pdf
Kang, O., & Johnson, D. (2018). The roles of suprasegmental features in predicting English oral proficiency with an automated system. Language Assessment Quarterly, 15(2), 150–168. https://doi.org/10.1080/15434303.2018.1451531
Kang, O., & Pickering, L. (2014). Using acoustic and temporal analysis for assessing speaking. In A. J. Kunnan (Ed.), The companion to language assessment (Vol. 2, pp. 1047–1062). Wiley-Blackwell. https://doi.org/10.1002/9781118411360.wbcla056
Kang, O., Rubin, D., & Pickering, L. (2010). Suprasegmental measures of accentedness and judgments of language learner proficiency in oral English. The Modern Language Journal, 94(4), 554–566. https://doi.org/10.1111/j.1540-4781.2010.01091.x
Kim, H. J. (2015). A qualitative analysis of rater behavior on an L2 speaking assessment. Language Assessment Quarterly, 12(3), 239–261. https://doi.org/10.1080/15434303.2015.1049353
Lado, R. (1961). Language testing: The construction and use of foreign language tests. Longman.
Lee, J., Jang, J., & Plonsky, L. (2015). The effectiveness of second language pronunciation instruction: A meta-analysis. Applied Linguistics, 36(3), 345–366. https://doi.org/10.1093/applin/amu040
Levis, J. (2005). Changing contexts and shifting paradigms in pronunciation teaching. TESOL Quarterly, 39(3), 369–377. https://doi.org/10.2307/3588485
Levis, J. (2018). Intelligibility, oral communication, and the teaching of pronunciation. Cambridge University Press. https://doi.org/10.1017/9781108241564
Luchini, P. (2004). Designing a pronunciation test for assessing free speech production: An evaluative case study. IATEFL Speak Out!, 31, 12–24. https://pronsig.iatefl.org/journal/
Luchini, P. (2017). Measurement for accentedness, pause frequency/duration and nuclear stress placement in the EFL classroom. Ilha Do Desterro, 70(3), 185–200. https://doi.org/10.5007/2175-8026.2017v70n3p185
Luchini, P. (2018). Suprasegmental phonology: Handbook for pronunciation skill teaching. Integrating theory with practice (2nd ed.). Biblioteca Central Universidad Nacional de Mar del Plata. http://biblio1.mdp.edu.ar/centro-ventas/producto/suprasegmental-phonology-pronunciation-skill-teaching/
McNerney, M., & Mendelsohn, D. (1992). Suprasegmentals in the pronunciation class: Setting priorities. In P. Avery & S. Ehrlich (Eds.), Teaching American English pronunciation (pp. 185–196). Oxford University Press. https://elt.oup.com/catalogue/items/global/teacher_development/oxford_handbooks_for_language_teachers/9780194328159?cc=global&selLanguage=en
Morley, J. (1991). The pronunciation component of teaching English to speakers of other languages. TESOL Quarterly, 25(3), 481–520. https://doi.org/10.2307/3586981
Munro, M. J. (1995). Nonsegmental factors in foreign accent: Ratings of filtered speech. Studies in Second Language Acquisition, 17(1), 17–34. https://doi.org/10.1017/S0272263100013735
Munro, M. J., & Derwing, T. M. (1995). Foreign accent, comprehensibility, and intelligibility in the speech of second language learners. Language Learning, 45(1), 73–97. https://doi.org/10.1111/j.1467-1770.1995.tb00963.x
Munro, M. J., & Derwing, T. M. (2006). The functional load principle in ESL pronunciation instruction: An exploratory study. System, 34(4), 520–531. https://doi.org/10.1016/j.system.2006.09.004
Murphy, J. (2014). Intelligible, comprehensible, non-native models in ESL/EFL pronunciation teaching. System, 42(1), 258–269. https://doi.org/10.1016/j.system.2013.12.007
Pennington, M., & Ellis, N. (2000). Cantonese speakers’ memory for English sentences with prosodic cues. The Modern Language Journal, 84(3), 372–389. https://doi.org/10.1111/0026-7902.00075
Pennington, M., & Richards, J. (1986). Pronunciation revisited. TESOL Quarterly, 20(2), 207–225. https://doi.org/10.2307/3586541
Pennington, M., & Rogerson-Revell, P. (2019). English pronunciation teaching and research. Palgrave MacMillan. https://doi.org/10.1057/978-1-137-47677-7
Saito, K. (2011). Examining the role of explicit phonetic instruction in native-like and comprehensible pronunciation development: An instructed SLA approach to L2 phonology. Language Awareness, 20(1), 45–59. https://doi.org/10.1080/09658416.2010.540326
Saito, K. (2014). Experienced teachers’ perspectives on priorities for improved intelligible pronunciation: The case of Japanese learners of English. International Journal of Applied Linguistics, 24(2), 250–277. https://doi.org/10.1111/ijal.12026
Saito, K., Trofimovich, P., & Isaacs, T. (2015). Using listener judgments to investigate linguistic influences on L2 comprehensibility and accentedness: A validation and generalization study. Applied Linguistics, 38(4), 1–25. https://doi.org/10.1093/applin/amv047
Saito, K., Trofimovich, P., & Isaacs, T. (2016). Second language speech production: Investigating linguistic correlates of comprehensibility and accentedness for learners at different ability levels. Applied Psycholinguistics, 37(2), 217–240. https://doi.org/10.1017/S0142716414000502
Saito, Y., & Saito, K. (2017). Differential effects of instruction on the development of second language comprehensibility, word stress, rhythm, and intonation: The case of inexperienced Japanese EFL learners. Language Teaching Research, 21(5), 589–608. https://doi.org/10.1177/1362168816643111
Samuda, V. (2001). Guiding relationships between form and meaning during task performance: The role of the teacher. In M. Bygate, P. Skehan, & M. Swain (Eds.), Researching pedagogic tasks: Second language learning, teaching and testing (pp. 119–140). Longman. https://doi.org/10.1075/tblt.1.20gui
Sardegna, V. G. (2012). Learner differences in strategy use, self-efficacy beliefs, and pronunciation improvement. In. J. Levis & K. LeVelle (Eds.), Proceedings of the 3rd Pronunciation in Second Language Learning and Teaching Conference (pp. 39–53). Iowa State University.
Sardegna, V. G. (2020). Pronunciation and good language teachers. In C. Griffiths & Z. Tajeddin (Eds.), Lessons from good language teachers (pp. 232–245). Cambridge University Press. https://doi.org/10.1017/9781108774390.021
Sardegna, V. G. (2021). Evidence in favor of a strategy-based model for English pronunciation instruction. Language Teaching, 1–16. Advance online publication. https://doi.org/10.1017/S0261444821000380
Sperber, D., & Wilson, D. (1986). Relevance: Communication and cognition. Harvard University Press.
Swain, M., & Lapkin, S. (2001). Focus on form through collaborative dialogue: Exploring task effects. In M. Bygate, P. Skehan & M. Swain (Eds.), Researching pedagogic tasks: Second language learning, teaching and testing (pp. 99–118). Longman. https://doi.org/10.4324/9781315838267-14
Tajima, K., Port, R., & Dalby, J. (1997). Effects of temporal correction on intelligibility of foreign-accented English. Journal of Phonetics, 25(1), 1–24. https://doi.org/10.1006/JPHO.1996.0031
Terken, J., & Hirschberg, J. (1994). Deaccentuation of words representing “given” information: Effects of persistence of grammatical function and surface position. Language and Speech, 37(2), 125–145. https://doi.org/10.1177/002383099403700202
Thomson, R. (2018). Measurement of accentedness, intelligibility and comprehensibility. In O. Kang, & A. Ginther (Eds.), Assessment in second language pronunciation (pp. 11–29). Routledge. https://doi.org/10.4324/9781315170756-2
Thomson, R., & Derwing, T. (2014). The effectiveness of L2 pronunciation instruction: A narrative review. Applied Linguistics, 36(3), 326–344. https://doi.org/10.1093/applin/amu076
Trofimovich, P., & Isaacs, T. (2012). Disentangling accent from comprehensibility. Bilingualism: Language and Cognition, 15(4), 905–916. https://doi.org/10.1017/S1366728912000168
Trofimovich, P., Isaacs, T., Kennedy, S., Saito, K., & Crowther, D. (2016). Flawed self-assessment: Investigating self- and other-perception of second language speech. Bilingualism: Language and Cognition, 19(1), 122–140. https://doi.org/10.1017/S1366728914000832
Trofimovich, P., Kennedy, S., & Blanchet, J. (2017). Development of second language French oral skills in an instructed setting: A focus on speech ratings. Canadian Journal of Applied Linguistics, 20(2), 32–50. https://doi.org/10.7202/1042675AR
Winters, S., & O’Brien, M. G. (2013). Perceived accentedness and intelligibility: The relative contributions of F0 and duration. Speech Communication, 55(3), 486–507. https://doi.org/10.1016/j.specom.2012.12.006
Xi, X. (2010). Automated scoring and feedback systems for language assessment and learning. Special Issue of Language Testing, 27(3), 291–300. https://doi.org/10.1177/0265532210364643
Xi, X. (2012). Validity and the automated scoring of performance tests. In G. Fulcher & F. Davidson (Eds.), The Routledge handbook of language testing (pp. 438–451). Routledge. https://doi.org/10.4324/9780203181287
Acknowledgements
Thanks to Mariela Xynos and Ubiratã Kickhöfel Alves for their comments and suggestions on earlier drafts.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this chapter
Cite this chapter
Luchini, P.L., Paz, C.D. (2022). Assessing L2 Pronunciation Using Measurements of Nuclear Stress Placement and Comprehensibility. In: Sardegna, V.G., Jarosz, A. (eds) Theoretical and Practical Developments in English Speech Assessment, Research, and Training. Second Language Learning and Teaching. Springer, Cham. https://doi.org/10.1007/978-3-030-98218-8_4
Download citation
DOI: https://doi.org/10.1007/978-3-030-98218-8_4
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-98217-1
Online ISBN: 978-3-030-98218-8
eBook Packages: EducationEducation (R0)