Abstract
Science, understood to be the behavior of scientists, falls within the purview of behavior analysis. All scientists use scientific instruments to study a natural phenomenon, and for the behavior analyst, perhaps no tool is more important than the graph used to show changes in level, trend, and variability, and upon which behavior analysts make data-based decisions. Modern behaviorism as we know it dates back to the development of the cumulative recorder first developed in the 1930s. Though revolutionary to the science of behavior, two-dimensional graphs may be limited in application for analyzing complex human behavior. In the current article, we conceptualize verbal behavior as a multidimensional field of environmental relations, and introduce the use of multi-axial radar charts for its visual and quantitative analysis. From there, we survey the use of radar charts toward advancing a behavior-analytic understanding of human language and cognition. We demonstrate the use of radar charts for calculating simple shape descriptors as a quantitative measure of dynamic interactants, and show how they can be used to measure change over time.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
An analysis of the relationship between two quantities is a cornerstone of any scientific investigation, whether it be a comparison of naturally occurring properties (e.g., stress-strain) or the functional relationship between variables (e.g., force-displacement). At the most basic level, scientists measure the extent to which one quantity is affected by a change in the other. As the subject matter becomes more complex, however, our analyses must concomitantly adapt.
The cumulative recorder was a revolutionary development toward a natural science of behavior, because it made amenable both visual and quantitative analysis of environmental relations (Morris & Smith, 2004). Cumulative records provided the first real-time analysis of environmental relations, and were instrumental to the discovery of schedules of reinforcement (Lattal, 2004). Although the shape and display of the lines have changed over the last century, a perusal of the experimental or applied literature on behavior analysis reveals that time-series line graphs—those on which a dimension of behavior is plotted on one axis, and a dimension of time is plotted on another—serve as the primary means of analysis.
The study of language within the natural science of behavior analysis serves as a prime example. Researchers examining verbal behavior have generally approached functionally distinct verbal operants as categorical variables. According to Boolean logic, a given verbal response is classified as mand, tact, echoic, or intraverbal, with each separate operant giving way to a mutually exclusive line of research. As Michael et al. (2011) noted, “. . . a common preoccupation of students is to try to classify utterances as one or another verbal operant on the assumption that the example must be exclusively one type” (p. 4). Although this approach bears some utility for a basic analysis of verbal behavior, it fails to capture the complexity and dynamics of human language.
The segregation of verbal operants fits nicely into the standard analytic framework, with the frequency of responses on the ordinate and a sequence of events on the abscissa, but such a molecular approach to studying language obfuscates the history of reinforcement that supports more complex interactions. Although simple molecular analyses are useful for examining simple responses in highly controlled settings, a study of complex behavior must also account for supplementary sources of control—both present and historical—that work to support or compete with the prevailing contingencies. For example, the nature of researching emergent language precludes an analysis of the speaker’s response rate. Instead, researchers often resort to pre/posttesting to demonstrate this phenomenon. Figure 1, redrawn from the published literature on language emergence, provides a representative exemplar of this approach.
The vertical dashed line represents not only a phase change, but an undocumented history of conditioning that ostensibly accounts for the change in behavior. Throughout the literature, this unknown variable has been tact training (e.g., Miguel & Kobari-Wright, 2013), listener training (e.g., Petursdottir et al., 2008), mand training, (e.g., Egan & Barnes-Holmes, 2009), or intraverbal training (e.g., Ingvarsson et al., 2012). It should be noted that the emergence of untrained relations is inconsistent across studies (see Grow & Kodak, 2010; Wooderson et al., 2022). For the studies in which untrained relations successfully emerge, two-dimensional graphs do little to clarify the participant’s contingency history. In what ways has the participant’s relational network transformed over the course of the phase change? It is clear that something is missing in the analysis of language acquisition.
Sidman (1979/2010) noted “. . . that an analysis of stimulus control always involves an inference. . . . Unlike individual stimuli and responses, controlling relations are not directly observable” (p. 133). This certainly appears to be the case with research on emergent verbal behavior. Although the narratives that accompany each investigation provide additional details on their respective methodology, visual analysis of the data—the hallmark of single-case experimental research—breeds a large amount of inference between pretest and posttest outcomes. Though a sufficient literature base exists to demonstrate the emergence of untrained verbal relations, there is still far too much inference to demonstrate a functional relationship with its environmental determinants.
Grow and Kodak (2010) called for additional research on the skills that are assessed and targeted in early intervention programs to maximize the acquisition of emergent verbal behavior. There can be no doubt that the individual differences of research participants play an important role in their ability to derive stimulus relations, but a comprehensive picture of interdependent variables presupposes scientific explanation. Before researchers continue looking for a functional relationship between the acquisition of one verbal operant and the emergence of others, we should note that using a two-dimensional line graph to do so may be as effective as trying to clear away the darkness by thrusting it aside with one’s hands (Watts, 1951). “Perhaps more importantly,” observed Michael et al. (2011) “if one fails to consider multiple control, one’s interpretations of verbal behavior are likely to be conspicuously inadequate” (p. 4).
Continuum of Control
Natural biological materials exhibit a multitude of mechanical and functional properties. For example, spider silk is extraordinarily strong, yet elastic; mollusk shells are light though tough; and bird feathers and porcupine quills are both rigid and durable (Meyers et al., 2013). Stress-strain curves are frequently used to describe the relationship between two such properties (Ashby, 2000), but what if investigators are interested in examining combinations of properties or more complex interactions?
Researchers studying other complex systems have encountered similar difficulties when attempting to examine molecular relationships. Wilson and Wilson (2007) describe a multilevel theory of evolutionary selection. Porter and Niksiar (2018) introduce a multidimensional analysis of biological materials. Although behavior analysis has a rich history of research on multiple schedules of reinforcement (Ferster & Skinner, 1957), only more recently have researchers begun to examine complex behavior. An analysis of complex verbal behavior similarly benefits from treatment as a continuous variable. Rather than being mand or tact, echoic or intraverbal, a given verbal response is often simultaneously a member of two or more sets. Multiple control is the rule rather than the exception (Michael et al., 2011).
A radical departure from Boolean logic (i.e., dichotomous values of 0 or 1), the advent of fuzzy logic incorporates the range of variables existing between real numbers (i.e., continuous values from 0 to 1). Fuzzy logic changed the nature of computational electronics, contributing to the development of “smart” technologies (e.g., phones and kitchen appliances), automotive systems (e.g., antilock brakes and traction control), air conditioning, and artificial intelligence (Rushdi et al., 2015). No longer mutually exclusive 0s and 1s, fuzzy values are considered in terms of degrees.
Akin to complex numbers, which exist on a coordinate plane constructed of real and imaginary number lines, complex verbal behavior can be expressed on a coordinate plane comprised of intraverbal and extraverbal sources of control. Although intraverbal behavior is that which is under the control of other verbal behavior, extraverbal behavior is, by definition, under the control of nonverbal events. Vargas (1982) described a continuum of control that extends from intraverbal relations at one end, to extraverbal relations at the other (see Fig. 2).
Vargas’s notion of a continuum of control points to the mutual entanglement of the verbal operants. The control over a given verbal response may be more or less intraverbal while concomitantly less or more extraverbal, but rarely—if ever—mutually exclusive of the other (Belisle et al., 2021; Fryling, 2017).
Though Vargas (1982) described a single continuum between intraverbal and extraverbal sources, we argue that—for analyzing complex verbal behavior—the relationship is better expressed as the intersection of intraverbal and extraverbal control. Intraverbal control ranges from the presence of point-to-point correspondence (i.e., duplic) to the absence of point-to-point correspondence (i.e., sequelic). Extraverbal control ranges from the presence of a nonverbal stimulus (i.e., tact) to the absence of a nonverbal stimulus (i.e., mand).Footnote 1 These two continua of controlling variables converge perpendicularly to create a Cartesian coordinate system for analyzing complex verbal behavior (see Fig. 3).
The resulting radar chart affords an analysis of epicontextual relations, those both present (i.e., contemporary or explicit) and absent (i.e., historic or derived). For example, the frequency data from a verbal operant experimental (VOX) analysis, in which responses are induced across strictly controlled environmental relations (see Mason & Andrews, 2019), can be plotted on each of the corresponding radial axes. Drawing a straight line between each adjacent point on the radar chart then creates a unique polygonal language profile that is amenable to analysis using a compilation of shape descriptors (Peura & Iivarinen, 1997; see Fig. 4).
Unlike bar charts or pie charts, which emphasize discrete categorical variables, radar charts emphasize the continuity between extraverbal and intraverbal sources of control; depicting how a change in one parameter affects the entirety of the polygonal profile. Radar charts are sensitive to the multidimensionality of complex systems that account for combinations of input and output variables. As Michael et al. (2011) explained, “In convergent multiple control, more than one variable strengthens a response of a single topography, whereas in divergent multiple control, one variable strengthens more than one response” (pp. 5–6). As a result, a complete analysis of complex verbal behavior necessitates a framework that allows for exploring continuous variables across a continuum of control.
What follows is a survey of applications of radar charts to the analysis of human language and cognition. We begin by examining explicit verbal relations and progress through simple relational frames to higher-level interactants. For each scenario, different assessments methodologies can be found within the relevant literature. Across scenarios, we plot the frequency of discriminated responses on the corresponding radial axis of the radar chart to create distinct polygonal profiles for quantitative and visual analysis.
Shape Descriptors of Stimulus Relations
The tension between the ends of each continua creates the framework for conducting a multidimensional analysis on a Cartesian coordinate plane. Porter and Niksiar (2018) recommended the use of multi-axial radar charts for the performance mapping of natural biological systems. In particular, radar charts are useful for complex analyses consisting of a concurrent analysis of multiple mechanical or functional properties. Extending the work of Porter and Niksiar (2018), we employ the radar chart for visually analyzing the gestalt verbal repertoire, and perform quantitative analyses of the relevant shape descriptors for each resulting polygonal profile. A multitude of shape descriptors are commonly employed for 2D and 3D image analysis and pattern recognition, but for our purposes we will limit the discussion to three moment-based attributes: area, centroidal distance, and first moment of area.
For each of the following polygonal profiles, we began by calculating the area (A) of the polygonal profile using the following formula:
where the vertices are expressed in terms of the absolute value of Cartesian coordinates (x , y).
The geometric center of a mass, known as the centroid, is the arithmetic mean position of all the points in the figure. We used the following formulas to calculate the polygonal profile’s Euclidean distance from the horizontal axis:
and vertical axis:
respectively. This allowed us to pinpoint the centroid of the polygonal profile on the radar chart, along with the centroidal distance (R) from the origin of the coordinate system:
The centroid and centroidal distance allow us to begin to understand the skewedness of the verbal repertoire, giving us an understanding of prepotent sources of control. With all the prerequisites in place, the magnitude of the first moment of area (Q) is calculated in terms of the profile area (A) and the distance from the origin to the centroid (R). The multidimensional performance is defined as the profile’s normalized first moment of area relative to the circumference of the property space (C)Footnote 2:
This metric is analogous to a distribution function within statistics or the measure of inertia within physics (Flusser et al., 2009). The continuity between other natural sciences and behavior analysis (see Belisle & Dixon, 2020; Donahoe, 2021; Timberlake, 1999) affords the extension of this technology toward examining complex human behavior such as language and cognition.
First moment of area is a unique metric in that it summarizes both the size and distribution of the polygonal profile. A polygonal profile may have a large A (i.e., many different responses) along with a large R (i.e., the distribution is significantly skewed; see Mason et al., 2022). This combination would yield a small value for Q. Likewise, it is possible for a polygonal profile to have a small A (i.e., few responses) in conjunction with a small R (i.e., the distribution is relatively proportional). This combination would also result in a small value for Q.
First moment of area increases in value as the area of the polygonal profile increases (i.e., large A), whereas the centroidal distance decreases (i.e., small R). That is, fluent speakers tend to show a broad variety of responses that are equally balanced across the different verbal operants when sampled in isolation. A large Q value is foundational to the relational flexibility required of dynamic environmental interactions (Kelly, 2020; O’Toole & Barnes-Holmes, 2009).
Measuring Verbal Relations
Multidimensional radar charts are particularly useful for measuring change over time. Plotting frequency data on a radar chart emphasizes the dynamic nature of environmental control, and allow researchers and practitioners to observe the extent to which stimulus relations across the repertoire covary with the behavior of interest. An example of this can be seen in Fig. 5, on which we have plotted a functional language sample of a 4½-year-old boy with autism who received early intensive behavioral intervention (EIBI) over the course of 6 months. The results of both the initial assessment and 6-month reassessment showed skewed response distributions, though the speaker’s verbal repertoire displayed greater proportionality over time.
The dotted line shows the results of initial language assessment. Using the formulas above, we found A = 0.31, R = .30, with centroid located at x̄ = .17, ȳ = .25. This allowed us to calculate the first moment of area for the initial language profile at Q = 0.22. The dashed line shows the results of a reassessment conducted after 6 months of EIBI: A = 1.39, R = .16 (.14, .08), Q = 1.16. Between the two assessments, first moment of area increased by 0.94.
The solid line shows the maximum possible value of a fluent speaker. The relative balance of the verbal repertoire places the centroid at x̄ = 0, ȳ = 0 with R = 0, and A = 2. We can then calculate the maximum Q = 2. The proportional strength across all four verbal operants is indicative of neurotypical language development for speakers over 3 years of age, which allows Q = 2 to serve as a benchmark for measuring the language of speakers with autism and other verbal behavior disorders (see Table 1).
Measuring Derived Stimulus Relations
As a speaker’s language skills become more complex, the axes of the radar chart may be modified to account for derived stimulus relations. A similar analytic approach is applicable to the more abstract measures of human cognition described by relational frame theory (RFT; Hayes et al., 2001; Barnes-Holmes et al., 2020). Here, we develop a polygonal relational profile based on the frequency of responses to a series of logical syllogisms counterbalanced across frames of coordination.Footnote 3 Figure 6 displays a multi-axial radar chart comparing the frequency of directly trained, mutually entailed, and combinatorially entailed responses of a child with autism before and after 12-mo of EIBI (Cassidy et al., 2016; Kirsten & Stewart, 2022).
Visual analysis shows a significant difference in the speaker’s arbitrarily applicable relational responding across time. As above, shape descriptors can be found for each polygonal profile. Prior to intervention (dotted line), the speaker’s relational profile largely consisted of direct relations, with few mutual and no combinatorial relations. The relational profile measured A = 0.05, with R = 0.27, which yielded Q = 0.03. After 1 year of intervention (dashed line), the speaker’s relational profile is larger and shows greater proportionality. The updated relational profile measured A = 0.29, and R = 0.17, which equates to Q = 0.23. The difference between these two relating repertoires was calculated as Q = 0.20. Note that this same technique can be used to compare a speaker’s relational profile against a perfectly balanced model (solid line), in which Q = 1.30. In addition, the frame of coordination can be substituted for other families of relational frames (e.g., distinction, containment, and temporality; see Table 2).
Measuring Deictic Relations
Just as verbal behavior allows the speaker to extend their control of the environment across time and space, Harte and Barnes-Holmes (2021) identified three core deictic relations involved in locating oneself in time and space: the interpersonal relation (i.e., I–You), the spatial relation (i.e., Here–There), and the temporal relation (i.e., Now–Then). Deictic frames are considered a more advanced form of relational responding that involves both relating relations and relating entire relational networks (Kavanagh et al., 2019). A multidimensional analysis of the deictic relation provides a precise measure of the extent to which an individual relates oneself to others within a particular spatial–temporal context. Figure 7 shows a representative example of deictic relations developing over time, against a model showing proportional levels of interpersonal, spatial, and temporal relations.
The frequency of discriminated relations of the self can be plotted on each axis, allowing for the comparison of growth over time. The initial assessment (dotted line) shows A = 0.02, R = .10 (.05, .08), for Q = 0.02. A reassessment (dashed line) shows A = 0.27, R = .12 (.07, .10), for Q = 0.24. The deictic repertoire grew by Q = 0.22.
On a normalized scale, the maximum deictic profile (solid line) has an area of 1.30, centroidal distance of 0, and first moment of area of 1.30. Plotting the observed data against this model of the self may help to identify areas in need of clinical intervention (see Table 3).
Measuring Hyperdimensional Multilevel Frameworks
Parallel to our use of radar charts to show multidimensional relationships between behavior and environment, RFT has more recently been described as a field of interactants, rather than individual frames (Barnes-Holmes et al., 2020). Heretofore, our analyses have emphasized the development of a larger profile across verbal behavior, frames of coordination, and deictic relations. However, multi-axial radar charts may also be used to fit a particular model (or shape). For example, Harte and Barnes-Holmes (2021) explain that relating relational networks requires a foundation of basic and midlevel relational frames (i.e., coordination, distinction, containment, temporality, and deictic) that are high in coherence and complexity, whereas low in derivation and flexibility. Figure 8 provides representative data of the HDML developing over time, along with a model of the ideal proportion of dynamic interaction between these four dimensions to serve as a framework for clinical guidance.
The frequency of discriminated responses are plotted on their respective axes of the HDML framework: coherence, complexity, derivation, and flexibility. The initial assessment (dotted line) shows A = 0.18, R = .09 (-.04, .08), for Q = 0.17. A reassessment (dashed line) shows A = 0.59, R = .05 (-.03, .03), for Q = 0.56. The difference between the two can be quantified as Q = 0.39 (see Table 4).
Unlike the models discussed above, the target for the HDML profile is not the maximum Q value. The target HDML profile (solid line) has A = 0.50, R = 0, and Q = 0.50. Note that the Q value at the time of reassessment (Q = 0.56) is larger than that of the targeted profile (Q = 0.50). As a result, visual analysis may be particularly useful for analyzing HDML.
The polygonal HDML profile at the time of the initial assessment shows increased flexibility and derivation, along with minimal coherence and no complexity. This might be the case for a speaker with autism whose language skills are severely restrictive (i.e., low coherence and complexity) or under a prepotent source of control (i.e., high flexibility and derivation). The reassessment shows a high degree of balance across the four domains, as flexibility and derivation have decreased somewhat, whereas coherence and complexity have expanded. Contrary to the previously discussed models, however, proportionality is not the priority for HDML.
The precise numeric value of the terminal HDML profile is less important than the shape of its polygonal profile, which—when plotted as in Fig. 8—depicts a rhombus with height (p) substantially greater than width (q). Other geographic models with varying levels of coherence, complexity, derivation, and flexibility may also be useful for conceptualizing human psychological events in terms of relating, orienting, and evoking within a given motivational context (Harte & Barnes-Holmes, 2021).
Caveats of Radar Charts
Throughout this article, we have tried to demonstrate the utility of multi-axial radar charts for examining multidimensional relationships between environment and behavior. Using a methodology derived from the physical and biological sciences, we employed a multidimensional visualization strategy to compare the relative performance distributions of various environmental relations within a single visual graphic. The radar chart’s display of data as closed polygonal profiles affords the use of shape descriptors for quantitative analyses (Porter & Niksiar, 2018).
It should be noted that radar charts have several limitations to consider as we discuss their implications for studying complex behavior. Given our emphasis on area as a fundamental shape descriptor, we must acknowledge that the area of a polygonal profile is dependent on the ordering of the axes. For some analyses, the ordering of axes is more intuitive than others. Note that the radar chart in Fig. 3 was constructed from two continua, which led to a more natural ordering of axes. Order is also not a problem in Figs. 6 and 7, which only have three dimensions. However, for other analyses the ordering of axes is more arbitrary. For example, in Fig. 8 we purposefully placed coherence and complexity on opposite ends of the chart to create the more symmetric profile of a rhombus. Had we placed them adjacent to one another, the resulting trapezoidal profile would not only appear different, it would also yield a different area measure.
In addition, although multiple data series can be plotted on the same radar chart, too much data can quickly make a radar chart unreadable. For example, the hyperdimensional multilevel framework of RFT proposes five key levels of behavioral development (Barnes-Holmes et al., 2017; Barnes-Holmes et al., 2020; Harte & Barnes-Holmes, 2021). Attempting to plot all five levels of relational development across each of the four dimensions on the same radar chart is untenable. Instead, we suggest the creation of multiple charts to show each of the different levels. Likewise, although radar charts can be used to show change over time, we recommend limiting their use to two (e.g., pre- and post-) data series to avoid obfuscation.
Extended Relations
Quantifying the interdependence of complex subject matters has been an important transition in our understanding of natural phenomena. The natural progression of our understanding and interpretation of data has evolved as our need to comprehend complex and interrelated phenomena became more pronounced. Consider the verbal operants—mands, tacts, intraverbals, and echoics—historically treated as exclusive units of analysis. Without accounting for covariation, they are interpreted in a rudimentary fashion that underestimates the interdependence of different but related sources of control. This continues to be the case when analyzing emergent verbal behavior on a two-dimensional chart. Whereas the supplementary sources of control are hidden on a line graph, they are revealed on a radar chart, which allows us to observe the growth of the interdependent verbal repertoire prior to the emergence of a new operant.
Within the natural environment, the convergence of controlling variables may be so ubiquitous that the purity of an operant becomes irrelevant (Michael et al., 2011). As the complexity of control increases, our measurement system must act accordingly. We have presented an alternative means of displaying complex data outside of those typically seen within the field of behavior analysis. Despite their limitations, multi-axial radar charts have clear implications for examining multiple relations. In conjunction with other research in this area, the multidimensional display of radar charts strengthens the relationship between modern behavior analysis and the other natural sciences (Barnes-Holmes et al., 2017; Belisle & Dixon, 2020; Bickerton, 2007; Hayes & Stanford, 2014).
Similar to two-dimensional line graphs, radar charts have the ability to show the dynamic relationship between independent and dependent variables. However, radar charts are unique in their ability to show the relationship between multiple independent and multiple dependent variables. As demonstrated above, specific polygonal profiles can serve as comparative models and help direct clinical intervention.
The polygonal profiles found on radar charts are also beneficial for quantitative analysis using shape descriptors. First moment of area accounts for both the density and distribution of stimulus relations. By providing a precise measure of complex controlling relations, first moment of area allows for intra-subject comparisons over time, can be used to evaluate the effects of intervention, and may otherwise serve as a basis for making data-based decisions.
Future research should examine the potential clinical implications of such an analysis for conceptualizing mental disorders such as autism, in which stimulus overselectivity interferes with social communication among other adaptive skills. In addition, researchers should examine the correspondence between simple and complex environmental relations. For example, throughout the current article we argue for the use of first moment of area as a primary analytical unit. A sequential pattern of relating may occur throughout language acquisition, with directly taught relations precipitating mutual entailment, which later gives rise to combinatorial entailment due to its complexity and training history. Figure 9 displays the same data from Fig. 6 above plotted as a two-dimensional derivation gradient. Prior to intervention, the speaker’s relational responding shows a sharper loss of control across levels of derivation. Area under the curve (AUC), which was initially calculated as 0.25, increased to 0.48 after a year of EIBI. Future research should examine the relationship between first moment of area and the AUC that results from Fig. 9.
The current literature on language acquisition has made it abundantly clear that the standard approach to measuring behavior with two-dimensional line graphs is insufficient for analyzing complex human behavior. As the youngest of the natural sciences, behavior analysis can benefit from the example of its elders to address the growing pains of our field. Though unconventional, radar charts have offered potential applications within the realms of biological sciences and engineering. The utility of multi-axial radar charts to the field of behavior analysis ultimately lies in their explanatory power. Perhaps definitionally, complex behavior is that which necessitates a complex analysis.
Data Availability
All data generated or analyzed during this study are included in this published article.
Notes
As Hayes (2002) explained, “The word ‘want’ comes from the Old Norse term vant, meaning literally ‘missing’” (p. 63).
For normalized data, C will always equal 1.
We employ a three-axis radar chart to explicate the differences across explicit and implicit relations, however the level of derivation may also be extended (see Harte et al., 2018, 2021). Relations that are more distal can be incorporated into such an analysis with the inclusion of additional axes.
References
Ashby, M. F. (2000). Multi-objective optimization in material design and selection. Acta Materialia, 48(1), 359–369. https://doi.org/10.1016/S1359-6454(99)00304-3
Barnes-Holmes, D., Barnes-Holmes, Y., Luciano, C., & McEnteggart, C. (2017). From the IRAP and REC model to a multi-dimensional multi-level framework for analyzing the dynamics of arbitrarily applicable relational responding. Journal of Contextual Behavioral Science, 6(4), 434–445. https://doi.org/10.1016/j.jcbs.2017.08.001
Barnes-Holmes, D., Barnes-Holmes, Y., & McEnteggart, C. (2020). Updating RFT (more field than frame) and its implications for process-based therapy. The Psychological Record, 70(4), 605–624. https://doi.org/10.1007/s40732-019-00372-3
Belisle, J., & Dixon, M. R. (2020). Relational density theory: Nonlinearity of equivalence relating examined through higher-order volumetric-mass-density. Perspectives on Behavior Science, 43, 259–283. https://doi.org/10.1007/s40614-020-00248-w
Belisle, J., Dixon, M. R., Malkin, A., Hollie, J., & Stanley, C. R. (2021). Exploratory factor analysis of the VB-MAPP: Support for the interdependency of elementary verbal operants. Journal of Behavioral Education, 31(3), 503–523. https://doi.org/10.1007/s10864-020-09413-2
Bickerton, D. (2007). Language evolution: A brief guide for linguists. Lingua, 117(3), 510–526. https://doi.org/10.1016/j.lingua.2005.02.006
Cassidy, S., Roche, B., Colbert, D., Stewart, I., & Grey, I. M. (2016). A relational frame skills training intervention to increase general intelligence and scholastic aptitude. Learning & Individual Differences, 47, 222–235. https://doi.org/10.1016/j.lindif.2016.03.001
Donahoe, J. W. (2021). Biological behaviorism. In D. Zilio & K. Carrara (Eds.), Contemporary behaviorisms in debate (pp. 113–135). Springer.
Egan, C. E., & Barnes-Holmes, D. (2009). Emergence of tacts following mand training in young children with autism. Journal of Applied Behavior Analysis, 42(3), 691–696. https://doi.org/10.1901/jaba.2009.42-691
Ferster, C. B., & Skinner, B. F. (1957). Schedules of reinforcement. Appleton-Century-Crofts. https://doi.org/10.1037/10627-000
Flusser, J., Zitova, B., & Suk, T. (2009). Moments and moment invariants in pattern recognition. John Wiley & Sons.
Fryling, M. J. (2017). The functional independence of Skinner’s verbal operants: Conceptual and applied implications. Behavioral Interventions, 32(1), 70–78. https://doi.org/10.1002/bin.1462
Grow, L. L., & Kodak, T. (2010). Recent research on emergent verbal behavior: Clinical applications and future directions. Journal of Applied Behavior Analysis, 43(4), 775–778. https://doi.org/10.1901/jaba.2010.43-775
Harte, C., & Barnes-Holmes, D. (2021). A primer on relational frame theory. In M. P. Twohig, M. E. Levin, & J. M. Petersen (Eds.), The Oxford handbook of acceptance and commitment therapy (pp. 77–108). Oxford University Press. https://doi.org/10.1093/oxfordhb/9780197550076.013.4
Harte, C., Barnes-Holmes, D., Barnes-Holmes, Y., & McEnteggart, C. (2018). The impact of high versus low levels of derivation for mutually and combinatorially entailed relations on persistent rule following. Behavioural Processes, 157, 36–46. https://doi.org/10.1016/j.beproc.2018.08.005
Harte, C., Barnes-Holmes, D., Barnes-Holmes, Y., & McEnteggart, C. (2021). Exploring the impact of coherence (through the presence versus absence of feedback) and levels of derivation on persistent rule following. Learning & Behavior, 49(2), 222–239. https://doi.org/10.3758/s13420-020-00438-1
Hayes, S. C. (2002). Buddhism and acceptance and commitment therapy. Cognitive and Behavioral Practice, 9(1), 58–66. https://doi.org/10.1016/S1077-7229(02)80041-4
Hayes, S. C., & Sanford, B. T. (2014). Cooperation came first: Evolution and human cognition. Journal of the Experimental Analysis of Behavior, 101(1), 112–129. https://doi.org/10.1002/jeab.64
Hayes, S. C., Barnes-Holmes, D., & Roche, B. (2001). Relational frame theory: A post-Skinnerian account of human language and cognition. Kluwer Academic/Plenum. https://doi.org/10.1007/b108413
Ingvarsson, E. T., Cammilleri, A. P., & Macias, H. (2012). Emergent listener responses following intraverbal training in children with autism. Research in Autism Spectrum Disorders, 6(2), 654–664. https://doi.org/10.1016/j.rasd.2011.09.009
Kavanagh, D., Barnes-Holmes, Y., & Barnes-Holmes, D. (2019). The study of perspective taking: Contributions from mainstream psychology and behaviour analysis. The Psychological Record, 70, 581–604. https://doi.org/10.1007/s40732-019-00356-3
Kelly, M. E. (2020). The potential of a relational training intervention to improve older adults’ cognition. Behavior Analysis in Practice, 13(3), 684–697. https://doi.org/10.1007/s40617-020-00415-0
Kirsten, E. B., & Stewart, I. (2022). Assessing the development of relational framing in young children. The Psychological Record, 72(2), 221–246. https://doi.org/10.1007/s40732-021-00457-y
Lattal, K. A. (2004). Steps and pips in the history of the cumulative recorder. Journal of the Experimental Analysis of Behavior, 82(3), 329–355. https://doi.org/10.1901/jeab.2004.82-329
Mason, L. L., & Andrews, A. (2019). The verbal behavior stimulus control ratio equation: A quantification of language. Perspectives on Behavior Science, 42, 323–343. https://doi.org/10.1007/s40614-018-0141-1
Mason, L., Otero, M., & Andrews, A. (2022). Cochran’s Q test of stimulus overselectivity within the verbal repertoire of children with autism. Perspectives on Behavior Science, 45(1), 101–121. https://doi.org/10.1007/s40614-021-00315-w
Meyers, M. A., McKittrick, J., & Chen, P. Y. (2013). Structural biological materials: Critical mechanics-materials connections. Science, 339(6121), 773–779. https://doi.org/10.1126/science.1220854
Michael, J., Palmer, D. C., & Sundberg, M. L. (2011). The multiple control of verbal behavior. Analysis of Verbal Behavior, 27(1), 3–22. https://doi.org/10.1007/bf03393089
Miguel, C. F., & Kobari-Wright, V. V. (2013). The effects of tact training on the emergence of categorization and listener behavior in children with autism. Journal of Applied Behavior Analysis, 46(3), 669–673. https://doi.org/10.1002/jaba.62
Morris, E. K., & Smith, N. G. (2004). On the origin and preervation of cumulative record in its struggle for life as a favored term. Journal of the Experimental Analysis of Behavior, 82(3), 357–373. https://doi.org/10.1901/jeab.004.82-357
O’Toole, C., & Barnes-Holmes, D. (2009). Three chronometric indices of relational responding as predictors of performance on a brief intelligence test: The importance of relational flexibility. The Psychological Record, 59, 119–132. https://doi.org/10.1007/BF03395652
Petursdottir, A. I., Ólafsdóttir, A. R., & Aradóttir, B. (2008). The effects of tact and listener training on the emergence of bidirectional intraverbal relations. Journal of Applied Behavior Analysis, 41(3), 411–415. https://doi.org/10.1901/jaba.2008.41-411
Peura, M., & Iivarinen, J. (1997). Efficiency of simple shape descriptors. Proceedings of international workshop on visual form (pp. 443–451). World Scientific.
Porter, M. M., & Niksiar, P. (2018). Multidimensional mechanics: Performance mapping of natural biological systems using permutated radar charts. PLoS ONE, 13(9), e0204309. https://doi.org/10.1371/journal.pone.0204309
Rushdi, A. M., Zarouan, M., Alshehri, T. M., & Rushdi, M. A. (2015). A modern syllogistic method in intuitionistic fuzzy logic with realistic tautology. Scientific World Journal, 2015, 327390. https://doi.org/10.1155/2015/327390
Sidman, M. (1979/2010). Remarks. Behavior & Philosophy, 38, 133–136. https://doi.org/10.1080/15021149.2011.11434377
Timberlake, W. (1999). Biological behaviorism. In W. O’Donohue & R. Kitchener (Eds.), Handbook of behaviorism (pp. 243–284). Academic Press.
Vargas, E. A. (1982). Intraverbal behavior: The codic, duplic and sequelic subtypes. Analysis of Verbal Behavior, 1(1), 5–7. https://doi.org/10.1007/BF03392792
Watts, A. (1951). The wisdom of insecurity: A message for an age of anxiety. Vintage Books.
Wilson, D. S., & Wilson, E. O. (2007). Rethinking the theoretical foundation of sociobiology. Quarterly Review of Biology, 82(4), 327–348. https://doi.org/10.1086/522809
Wooderson, J. R., Bizo, L. A., & Young, K. (2022). A systematic review of emergent learning outcomes produced by foreign language tact training. Analysis of Verbal Behavior, 38, 157–178. https://doi.org/10.1007/s40616-022-00170-z
Funding
Open access funding provided by SCELC, Statewide California Electronic Library Consortium. No funding was received to assist with the preparation of this manuscript.
Author information
Authors and Affiliations
Contributions
Lee Mason: Conceptualization, Formal Analysis, Investigation, Methodology, Visualization, Writing—Original Draft, Writing—Review & Editing. Alonzo Andrews: Conceptualization, Investigation, Methodology, Writing—Original Draft, Writing—Review & Editing. Maria Otero: Methodology, Writing—Original Draft, Writing—Review & Editing. Kimberly James-Kelly: Writing—Original Draft, Writing —Review & Editing.
Corresponding author
Ethics declarations
Ethical Approval
The procedures performed involving human participants were in accordance with the ethical standards of Cook Children’s Health Care System’s Institutional Review Board, and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.
Informed Consent
Informed consent was obtained from all individual participants included in the study.
Conflicts of Interest
The authors have no relevant financial or nonfinancial interests to disclose.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Mason, L., Andrews, A., Otero, M. et al. The Shape of Relations to Come: Multidimensional Analyses of Complex Human Behavior. Psychol Rec (2024). https://doi.org/10.1007/s40732-023-00575-9
Accepted:
Published:
DOI: https://doi.org/10.1007/s40732-023-00575-9