Abstract
Sports Coaching research continues to develop, although with a narrow spread of publication, mainly within Sports Psychology, and small impact across Sports Science journals. Nevertheless, Sports Coaching research potentially investigates an array of basic and applied research questions. Hence, there is an opportunity for improvement. Moreover, there is an increased awareness in several scientific areas, including Sports Science, about several problems pertaining to design, transparency, replicability, and trust of research practices. Particularly in Sports Coaching research, these problems include limited or inadequate validation of surrogate outcomes and lack of multidisciplinary designs, lack of longitudinal and replication studies, inappropriate data analysis and reporting, limited reporting of null or trivial results, and insufficient scientific transparency. In this chapter, we initially discuss the trends of publication in Sports Coaching, highlighting research problems as they pertain to their treatment in other disciplines, namely psychology. Lastly, we illustrate an example applied to Sport Coaching research with a repeated measures design and an interdisciplinary approach as a recommendation to promote transparency, replicability, and trust in Sports Coach research.
Access provided by Autonomous University of Puebla. Download chapter PDF
Similar content being viewed by others
Keywords
Sports Coaching research continues to develop (Gilbert & Trudel, 2004; Griffo, Jensen, Anthony, Baghurst, & Kulinna, 2019). Nevertheless, the initial argument in this chapter is that Sports Coaching Research still falls mostly within a narrow spread of publication, mainly within Sports Psychology, and with a small impact across Sports Science journals.
To support our argument, we examined the published Sports Coaching research between 2000 and 2019 in Sports Science journals indexed on Web of Science or Scopus. The records were retrieved limiting the keywords “coach, coaches and coaching” in the titles, abstracts, and keywords in English language manuscripts. The specific syntax for Web of Science or Scopus searches to reproduce our approach is available in a public repository (https://osf.io/vw8yq/). For convenience, we considered journal by main publication theme (Sports Coaching and Pedagogy, Sports Science, Applied Sports Science, Physiology and Nutrition, Biomechanics and Motor Control, Psychology, Social Sciences and Humanities, Sports and Exercise Medicine and Health). After removing duplicate entries, we used mapping analysis to examine on the fly the main trends of Sports Coaching publication. For this step, we used the bibliometrix package (Aria & Cuccurullo, 2017), in R statistical language (R Core Team, 2018). Furthermore, we fitted multilevel ordinal regressions to describe the frequency of Sports Coaching articles published in Sports Sciences journals from 2000 to 2019, adjusting for whether journals were indexed in the Journal of Citations Reports (JCR) in the Sport Sciences section, and for the journal main area of publication. We modeled the data using fully Bayesian methods with the “brms” package (Bürkner, 2017), which calls Stan (Carpenter et al., 2017), in R statistical language (R Core Team, 2018). The data, priors, model specification and computation details, and R codes are available as supplementary material (https://osf.io/vw8yq/).
The frequency of Sports Coaching articles published in Sports Sciences journals increased substantially after about 2009, apparently coincident with the increase of volume of non-JCR indexed publications (Fig. 22.1, upper panel). This indicates a trend of decrease in the proportion of Sports Coaching articles published in the JCR indexed journal, adjusting for journals’ main area of publication (Fig. 22.1, lower panel).
Our analysis is consistent with previous analysis of Coaching research (Griffo et al., 2019), as, within Sports Science journals, Psychology appears as the main target area, albeit the trend of increase of Social Sciences and Humanities, and Sports Coaching and Pedagogy areas (Fig. 22.2, upper panel). The latter in particular with the prominence of the International Journal of Sports Science and Coaching. Nowadays the proportion of published articles across these three areas appears to be similar (Fig. 22.2, lower panel). The trend of decrease in the proportion of published Sports Coaching articles in Sports Psychology journals became apparent after 2010. Overall, the impact of Sports Coaching research in the field of Sports Sciences is small.
Nevertheless, the inspection of the mapping analysis shows that psychology-related themes remain the main focus and influence of Sports Coaching research. The most frequent words in the abstract (to provide a deeper view of studies), summarized in a word map (Fig. 22.3), are consistently associated with Sports Psychology subjects, and with coach education, given the increase of Sports coaching articles in both Sports Coaching and Pedagogy, and Social Sciences and Humanities within Sports Science journals.
Despite the narrow spread of publication, the thematic analysis showed an apparent separation between themes across studies (Fig. 22.4). Considering a thematic map with five clusters with two main labels, it was identified as the main cluster that comprised themes such as coaching and sport (the main two labels), gender, education, expertise, pedagogy, self-determination theory, elite sport or swimming. There was a partial overlap with the second main cluster that identified youth sports and motivation as the main labels, comprised also themes such as self-determination theory, coach-athlete relationship, motivational climate, communication, support, autonomy, team sport, positive youth development or social support. The third cluster was more context-related (coach and soccer as main labels) such as performance, training, youth, or prevention, but there was also psychology associated themes such as leadership or stress. In a more distant quadrant and position, the smaller cluster was labeled as sport and athlete, including themes such as sport psychology, team sports, basketball attitude, burnout, performance analysis, coaching philosophy, or knowledge. Lastly, the most distant cluster from the three main clusters was identified with coach education and sports coaching as labels. The cluster included themes such as coach development, coach learning, professional development, mentoring, physical education, or qualitative analysis.
Our second argument lies in the increased awareness in several scientific areas (Gelman & Geurts, 2017; Pashler & Wagenmakers, 2012; Simmons, Nelson, & Simonsohn, 2011), including Sports Science (Halperin, Vigotsky, Foster, & Pyne, 2018; Knudson, 2017; Schweizer & Furley, 2016), about several problems of transparency, replicability, and trust of research practices. Note that there is also an intense discussion in medicine and health sciences (Bartell, 2019; Begley & Ioannidis, 2015; Gelman & Geurts, 2017). However, given the influence of Sports Psychology and Social Sciences and Humanities in Sports Coaching research, we can extrapolate that problems in our field may be similar. Particularly in Sports Science, these problems may include limited or inadequate validation of surrogate outcomes and lack of multidisciplinary designs, lack of longitudinal and replication studies, inappropriate data analysis and reporting, limited reporting of null or trivial results, and insufficient scientific transparency.
The first reason to supports our extrapolations lies in the lack of culture for replication studies in Sports Science, and by extension in Sports Coaching research. The awareness of potentially unreplicable findings in our field has likely risen with the discussion about the validity of a broadly used analytical approach in Sports Science, magnitude-based inference (Batterham & Hopkins, 2006), was noted (Sainani, 2018; Welsh & Knight, 2015). Incorrect statistical analysis and limited sample sizes, as often the case in Sports Science (Halperin et al., 2018; Knudson, 2017; Schweizer & Furley, 2016), and consequently the reporting of inaccurate inferences and inflated magnitude of effects can be common in our field.
Secondly, Sports Coaching research tends to be unidimensional, mostly based on cross-sectional observations, and comprising a narrow scope of behavioral characteristics and applied contexts. Not undervaluing the body of knowledge, sport is a living laboratory where diversity is the rule (Gonçalves, Carvalho, & Catarino, 2018). Coach practice and research deal with an extensive array of applied research questions. Often, the tension between biological and behavioral areas has been evident (Grecic & Collins, 2013; Jacobs, Claringbould, & Knoppers, 2016), and this situation likely limits researchers and coaches to develop a clear understanding of the coaching practice. Given the considerations about Sports Coaching research presented above, there is a clear need for interdisciplinary approaches to explore the interactions between individual learners/athletes exposed and responding to the coach’s intervention within the different learning environments. Hence, research designs and analytical approaches need to adjust for different sources and levels of influence on individual learners/athletes’ learnings and development, often requiring the assumption of limitations, whether theoretical, methodological, or practical (Gonçalves et al., 2018).
Lastly, we concur with the recent call in Sports Science for the adoption of more transparent research practices (Caldwell et al., 2020). In this case, we should follow examples from psychology where study preregistration, sharing of data, material, software, and code are helping to improve research transparency, albeit there is still a long way to go (Chambers, 2017). Code sharing allows for computational reproducibility, which promotes the ability to generate equivalent analytical outcomes from the same data set using the same code and software (Leek & Peng, 2015).
On the other hand, the traditional single-level analysis continues to be widely used for analysis and interpretation in Sports Science research and using null hypothesis testing and frequentist methods, albeit limitations being been noted (Amrhein & Greenland, 2018; Amrhein, Greenland, & McShane, 2019a; Amrhein, Greenland, & McShane, 2019b; Gelman & Shalizi, 2013; McShane, Gal, Gelman, Robert, & Tackett, 2019). Bayesian methods, particularly within a multilevel framework, offer a very natural alternative, especially for accounting for different sources of inferential uncertainty when making estimations and predictions for a target population (Kennedy & Gelman, 2020; McElreath, 2015). Assuming a Bayesian perspective allow for direct probabilistic interpretations, by combining the available information with the observed data to update the knowledge, expressed as the posterior distribution (Lee & Wagenmakers, 2013). Bayesian estimates are potentially valid for any sample size, given that plausible assumptions are stated (McElreath, 2015). Nevertheless, the process should be transparent and be inspected.
Practical Implications
Lastly, we illustrate an applied to Sport Coaching research with a repeated measures design and an interdisciplinary approach as a recommendation to promote transparency, replicability, and trust in Sports Coach research. Using simulated data based on an ongoing research project, we provide (as supplementary material) an application of analysis and interpretation of the coach intervention (different pedagogical coaching approaches) on athletes’ physiological performance and behavioral characteristics across a competitive season period among adolescent players in a team sport (e.g., 11–16 years). Game-centered approaches are advocated to improve decision-making, skill execution, and physical fitness in sports coaching. However, available data is scarce. In this example, the researcher initially should consider the need to adjust for different levels and sources of variation on the outcomes, such as coach-level (e.g., age, previous experience as a coach and/ or with the pedagogical coach approach), player-level (e.g., chronological age, maturity status or accumulated experience) or environmental-level variation (e.g., club competitive level, competitive age group or youth sport program expectations). Measures include anthropometry, maturity status (estimated age at peak height velocity), a composite score of physiological capacity, scores from the motivation for deliberate practice, considering a context of talent development as an example, and a measure of collective-efficacy (collective efficacy questionnaire for sports). We simulated data for 6 teams of 12 players where three coaches used game-centered approaches and the other three used skill-based and coach-oriented approaches. To deal with the different levels and sources of variation we used Bayesian multilevel regressions to consider each measurement (level 1) within each player (level 2) nested by the coaching approach (Level 3). Furthermore, we illustrate individual and contextual variation accounting for the age group (U12, U14, U16), maturity status (early, on-time and later maturers), and the onset of sport-specific deliberate practice (pre-puberty, during puberty and late puberty) as group-level effects. The data generation, model specifications, priors, codes and computation details, and R codes are available as supplementary material, allowing for replication, manipulation of our example, and transparency in the interpretations (https://osf.io/vw8yq/).
Coaches interpret reality and make decisions based on several observable parameters, mediated by their knowledge of the sport, and by their philosophies (Gonçalves et al., 2018). The coach must know how to locate and rank the athlete among his/her peers and must track the personal development trajectory of the athletes he/she coaches. Longitudinal research designs considering multidimensional approaches and available advanced modeling are essential to advance Sports Coaching research. This may contribute to provide meaningful information for coaching education/science exposure in academic settings and to develop research questions and designs applicable to applied coaching practice.
Key Points
Journal articles are the main means of disseminating Sports Coaching research. In our field, there is a growth in the body of knowledge, particularly in the last decade. Nevertheless, the range of topics remains mostly in the area of Sports Psychology and more recently growing in Social Sciences, and Coaching and Pedagogy. Hence, it will be key to increase interdisciplinary research in Sports Coaching research, which given the complexity of coaching practice should be the standard, as noted in general for Sports Sciences research (Burwitz, Moore, & Wilkinson, 1994; Piggott, Muller, Chivers, Papaluca, & Hoyne, 2018).
Moreover, there is a trend of an increase in non-JCR indexed publications, also in the last decade. This may partially reflect the positive trend of emergence of Sports Coaching specific journals (International Journal of Sports Science and Coaching, Sports Coaching Review, International Sport Coaching Journal). On the other hand, it may reflect an increased publication of less rigorous studies that would not be considered in many JCR indexed publications, in particular journals with a broader range of areas published in Sports Science.
Reproducibility and transparency are key issues as scientists across disciplines increasingly recognize the challenges of reproducing published results and the threats that irreproducible results pose to the scientific process (Powers & Hampton, 2019). Hence, this is a key point in our field, where researchers need to be aware that there may be a reproducibility crisis in Sports Coaching research. Scientific claims should not gain credence because of the status or authority of their originator but by the replicability of their supporting evidence (Open Science Collaboration, 2015). Hence, the estimation of reproducibility in Sports Coaching Science is an open area that warrants urgent attention. Furthermore, Sports Coaching researchers need more transparent research practices and reporting, as recently highlighted for Sports Sciences (Caldwell et al., 2020). This will require the incorporation and generalization of practices such as study pre-registration, sharing data and codes, and use of of appropriate statistical analysis. Overall, there is much to do to improve the potential translation of Sports Coaching research to the field.
Conclusion
The chapter focused on the trends of published Sports Coaching Science in reference journals of Sports Sciences. We advocate the need to have a wider range of questions and to incorporate interdisciplinary approaches and longitudinal designs in Sports Coaching research. Like in other scientific areas, Sports Coaching research potentially has problems of design, transparency, replicability, and trust of research practices. There is the need to advance on the examination of the reproducibility of the research in the field, as well as to adopt more transparent research practices that will allow developing trust in Sports Coach research.
References
Amrhein, V., & Greenland, S. (2018). Remove, rather than redefine, statistical significance. Nature Human Behaviour, 2(1), 4. https://doi.org/10.1038/s41562-017-0224-0
Amrhein, V., Greenland, S., & McShane, B. (2019a). Scientists rise up against statistical significance. Nature, 567(7748), 305–307. https://doi.org/10.1038/d41586-019-00857-9
Amrhein, V., Greenland, S., & McShane, B. B. (2019b). Statistical significance gives bias a free pass. European Journal of Clinical Investigation, 49(12), e13176. https://doi.org/10.1111/eci.13176
Aria, M., & Cuccurullo, C. (2017). Bibliometrix: An R-tool for comprehensive science mapping analysis. Journal of Informetrics, 11(4), 959–975. https://doi.org/10.1016/j.joi.2017.08.007
Bartell, S. M. (2019). Understanding and mitigating the replication crisis, for environmental epidemiologists. Current Environmental Health Reports, 6(1), 8–15. https://doi.org/10.1007/s40572-019-0225-4
Batterham, A. M., & Hopkins, W. G. (2006). Making meaningful inferences about magnitudes. International Journal of Sports Physiology Performance, 1(1), 50–57.
Begley, C. G., & Ioannidis, J. P. (2015). Reproducibility in science. Circulation Research, 116(1), 116–126. https://doi.org/10.1161/CIRCRESAHA.114.303819
Bürkner, P.-C. (2017). brms: An R package for Bayesian multilevel models using Stan. Journal of Statistical Software, 80, 1–28.
Burwitz, L., Moore, P. M., & Wilkinson, D. M. (1994). Future directions for performance-related sports science research: An interdisciplinary approach. Journal of Sports Science, 12(1), 93–109. https://doi.org/10.1080/02640419408732159
Caldwell, A. R., Vigotsky, A. D., Tenan, M. S., Radel, R., Mellor, D. T., Kreutzer, A., … Boisgontier, M. P. (2020). Moving sport and exercise science forward: A call for the adoption of more transparent research practices. Sports Medicine, 50(3), 449–459. https://doi.org/10.1007/s40279-019-01227-1
Carpenter, B., Gelman, A., Hoffman, M. D., Lee, D., Goodrich, B., Betancourt, M., … Riddell, A. (2017). Stan: A probabilistic programming language. Journal of Statistical Software, 76(1), 32. https://doi.org/10.18637/jss.v076.i01
Chambers, C. (2017). The seven deadly sins of psychology: A manifesto for reforming the culture of scientific practice. Princeton, NJ: Princeton University Press.
Gelman, A., & Geurts, H. M. (2017). The statistical crisis in science: How is it relevant to clinical neuropsychology? Clinical Neuropsychology, 31(6–7), 1000–1014. https://doi.org/10.1080/13854046.2016.1277557
Gelman, A., & Shalizi, C. R. (2013). Philosophy and the practice of Bayesian statistics. British Journal of Mathematical and Statistical Psychology, 66(1), 8–38. https://doi.org/10.1111/j.2044-8317.2011.02037.x
Gilbert, W. D., & Trudel, P. (2004). Analysis of coaching science research published from 1970–2001. Research Quarterly for Exercise & Sport, 75(4), 388–399. https://doi.org/10.1080/02701367.2004.10609172
Gonçalves, C. E., Carvalho, H. M., & Catarino, L. M. (2018). Body in movement: Better measurements for better coaching. In S. Pill (Ed.), Perspectives on athlete-centered coaching (pp. 116–126). Abingdon: Routledge.
Grecic, D., & Collins, D. (2013). The epistemological chain: Practical applications in sports. Quest, 65(2), 151–168. https://doi.org/10.1080/00336297.2013.773525
Griffo, J. M., Jensen, M., Anthony, C. C., Baghurst, T., & Kulinna, P. H. (2019). A decade of research literature in sport coaching (2005–2015). International Journal of Sports Science & Coaching, 14(2), 205–215. https://doi.org/10.1177/1747954118825058
Halperin, I., Vigotsky, A. D., Foster, C., & Pyne, D. B. (2018). Strengthening the practice of exercise and sport-science research. International Journal of Sports Physiology and Performance, 13(2), 127–134. https://doi.org/10.1123/ijspp.2017-0322
Jacobs, F., Claringbould, I., & Knoppers, A. (2016). Becoming a ‘good coach’. Sport, Education and Society, 21(3), 411–430. https://doi.org/10.1080/13573322.2014.927756
Kennedy, L., & Gelman, A. (2020). Know your population and know your model: Using model-based regression and poststratification to generalize findings beyond the observed sample. ArXiv e-prints, 1906.11323 (1906.11323 [stat.AP]).
Knudson, D. (2017). Confidence crisis of results in biomechanics research. Sports Biomechanics, 16(4), 425–433. https://doi.org/10.1080/14763141.2016.1246603
Lee, M. D., & Wagenmakers, E.-J. (2013). Bayesian cognitive modeling: A practical course. Cambridge: Cambridge University.
Leek, J. T., & Peng, R. D. (2015). Opinion: Reproducible research can still be wrong: Adopting a prevention approach. Proceedings of the National Academy of Sciences, 112(6), 1645. https://doi.org/10.1073/pnas.1421412111
McElreath, R. (2015). Statistical rethinking: A Bayesian course with examples in R and Stan. Boca Raton, FL: Chapman & Hall/CRC Press.
McShane, B. B., Gal, D., Gelman, A., Robert, C., & Tackett, J. L. (2019). Abandon statistical significance. The American Statistician, 73(suppl 1), 235–245. https://doi.org/10.1080/00031305.2018.1527253
Open Science Collaboration. (2015). Estimating the reproducibility of psychological science. Science, 349(6251), aac4716. https://doi.org/10.1126/science.aac4716
Pashler, H., & Wagenmakers, E. J. (2012). Editors’ introduction to the special section on replicability in psychological science: A crisis of confidence? Perspectives on Psychological Science, 7(6), 528–530. https://doi.org/10.1177/1745691612465253
Piggott, B., Muller, S., Chivers, P., Papaluca, C., & Hoyne, G. (2018). Is sports science answering the call for interdisciplinary research? A systematic review. European Journal Sport Science, 19(2), 1–20. https://doi.org/10.1080/17461391.2018.1508506
Powers, S. M., & Hampton, S. E. (2019). Open science, reproducibility, and transparency in ecology. Ecological Applications, 29(1), e01822. https://doi.org/10.1002/eap.1822
R Core Team. (2018). R: A language and environment for statistical computing. Retrieved from http://www.R-project.org/
Sainani, K. L. (2018). The problem with “Magnitude-Based Inference”. Medicine Science Sports Exercise, 50(10), 2166–2176. https://doi.org/10.1249/MSS.0000000000001645
Schweizer, G., & Furley, P. (2016). Reproducible research in sport and exercise psychology: The role of sample sizes. Psychology of Sport and Exercise, 23, 114–122. https://doi.org/10.1016/j.psychsport.2015.11.005
Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011). False-positive psychology: Undisclosed flexibility in data collection and analysis allows presenting anything as significant. Psychology Science, 22(11), 1359–1366. https://doi.org/10.1177/0956797611417632
Welsh, A. H., & Knight, E. J. (2015). “Magnitude-based inference”: A statistical review. Medicine Science Sports Exercise, 47(4), 874–884. https://doi.org/10.1249/MSS.0000000000000451
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this chapter
Cite this chapter
Carvalho, H.M., Gonçalves, C.E. (2020). Coaching in Sports: Implications for Researchers and Coaches. In: Resende, R., Gomes, A.R. (eds) Coaching for Human Development and Performance in Sports. Springer, Cham. https://doi.org/10.1007/978-3-030-63912-9_22
Download citation
DOI: https://doi.org/10.1007/978-3-030-63912-9_22
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-63911-2
Online ISBN: 978-3-030-63912-9
eBook Packages: Behavioral Science and PsychologyBehavioral Science and Psychology (R0)