Abstract
Research in applied behavior analysis often involves the measurement of behavior under conditions precluding the use of precision mechanical recording equipment often found in experimental laboratories. As a result, it has been necessary to rely on human observers to record data that reflect some characteristic of the behavior observed; rate, duration, magnitude, or latency measures, for instance.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Baer, D. M. (1977). Reviewer’s comment: Just because it’s reliable doesn’t mean that you can use it. Journal of Applied Behavior Analysis, 10, 117–119.
Baer, D. M., Wolf, M. M., & Risley, T. R. (1968). Some current dimensions of applied behavior analysis. Journal of Applied Behavior Analysis, 1, 91–97.
Bailey, J. S. & Bostow, D. E. (1979). Research methods in applied behavior analysis. Tallahassee, FL: Copy Grafix.
Bijou, S. W., Peterson, R. F., & Ault, M. H. (1968). A method to integrate descriptive and empirical field studies at the level of data and empirical concepts. Journal of Applied Behavior Analysis,1, 175–191.
Birkimer, J. C., & Brown, J. H. (1979). A graphical judgmental aid which summarizes obtained and chance reliability data and helps assess the believability of experimental effects. Journal of Applied Behavior Analysis, 12, 523–533.
Clement, P. G. (1976). A formula for computing inter–observer agreement. Psychological Reports, 39, 257–258.
Cohen, J. A. (1960). A coefficient of agreement for nominal scales. Educational and Psychological Measurement, 20, 37–46.
Cone, J. D. (1979). Why the “I’ve got a better agreement measure” literature continues to grow: A commentary on two articles by Birkimer and Brown. Journal of Applied Behavior Analysis, 12, 571.
Cronbach, L. S. (1960). Essentials of psychological testing. New York: Harper & Row.
Gehring, R. E. (1978). Basic behavioral statistics. Boston, MA: Houghton Mifflin.
Harris, F. C., & Ciminero, A. R. (1978). The effect of witnessing consequences on the behavioral recordings of experimental observers. Journal of Applied Behavior Analysis, 11, 513–521.
Harris, F. C., & Lahey, B. B. (1978). A method for combining occurrence and non–occurrence interobserver agreement scores. Journal of Applied Behavior Analysis, 11, 523–527.
Hartmann, D. (1977). Considerations in the choice of inter–observer reliability estimates. Journal of Applied Behavior Analysis, 10, 103–116.
Hawkins, R. P. & Dotson, V. A. (1975). Reliability scores that delude: An Alice in Wonderland trip through misleading characteristics of interobserver agreement scoresin interval recording. In E. Ramp & G. Semb (Eds.), Behavior analysis: Areas of research and application (pp. 359–376). Englewood Cliffs, NJ: Prentice-Hall.
Helmstadter, G. C. (1964). Principles of psychological measurement. New York: Appleton-Century-Crofts.
Hilgard, E. R., & Atkinson, R. C. (1967). Introduction to psychology. New York: Harcourt, Brace, & World.
Hopkins, B. L., & Hermann, J. A. (1977). Evaluating interobserver reliability of interval data. Journal of Applied Behavior Analysis, 10, 121–126.
Johnson, S. M., & Bolstad, O. D. (1973). Methodological issues in naturalistic observation: Some problems and solutions for field research. In L. A. Hamerlynck, L. C. Handy& E. J. Mash (Eds.), Behavior change: Methodology, concepts and practice (pp. 7–67). Champaign, IL: Research Press.
Kazdin, A. E. (1977a). Assessing the clinical or applied importance of behavior change through social validation. Behavior Modification, 1, 427–451.
Kazdin, A. E. (1977b). Artifact, bias and complexity of assessment: The ABC’s of reliability. Journal of Applied Behavior Analysis, 10, 141–150.
Kelly, M. B. (1977). A review of observational data-collection and reliability procedures reported in the Journal of Applied Behavior Analysis, 10, 97–101.
Koegel, R. L., Russo, D. C., & Rincover, A. (1977). Assessing and training teachers in thegeneralized use of behavior modification with autistic children. Journal of Applied Behavior Analysis,10, 197–205.
Kratochwill, T. R., & Wetzel, R. J. (1977). Observer agreement, credibility, and judgment: Some considerations in presenting observer agreement data. Journal of Applied Behavior Analysis, 10, 133–139.
Lindsley, O. R. (1960). Characterization of the behavior of chronic psychotics as revealed by free operant conditioning methods. Diseases of the Nervous System, MonographSupplement, 21, 66–78.
Michael, J. (1974). Statistical inference for individual organism research: Mixed blessing or curse? Journal of Applied Behavior Analysis, 7, 647–653.
Page, T. J., Iwata, B. A., & Neef, N. A. (1976). Teaching pedestrian skills to retarded persons: Generalization from the classroom to the natural environment. Journal of Applied Behavior Analysis, 9, 433–444.
Powell, J., Martindale, A., & Kulp, S. (1975). An evaluation of time-sample measures of behavior. Journal of Applied Behavior Analysis, 8, 463–469.
Powers, R. B., Osborne, J. G., & Anderson, E. G. (1973). Positive reinforcement of litter removal in the natural environment. Journal of Applied Behavior Analysis, 6, 579–589.
Rapport, M. D., Murphy, H. A., & Bailey, J. S. (1982). Ritalin vs. response cost in the control of hyperactive children: A within-subject comparison. Journal of Applied Behavior Analysis, 15, 205–216.
Repp, A. C., Dietz, D. E., Boles, S. M., Dietz, S. M., & Repp, C. F. (1976). Differences among common methods for assessing interobserver agreement. Journal of Applied Behavior Analysis,9, 109–113.
Yelton, A. R., Wildman, B. G., & Erickson, M. T. (1977). A probability based formula for calculating interobserver agreement. Journal of Applied Behavior Analysis, 10, 127–131
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 1986 Plenum Press, New York
About this chapter
Cite this chapter
Page, T.J., Iwata, B.A. (1986). Interobserver Agreement. In: Poling, A., Fuqua, R.W. (eds) Research Methods in Applied Behavior Analysis. Applied Clinical Psychology. Springer, Boston, MA. https://doi.org/10.1007/978-1-4684-8786-2_6
Download citation
DOI: https://doi.org/10.1007/978-1-4684-8786-2_6
Publisher Name: Springer, Boston, MA
Print ISBN: 978-1-4684-8788-6
Online ISBN: 978-1-4684-8786-2
eBook Packages: Springer Book Archive