Abstract
In the original formulation of an experimental analysis of behavior, Skinner (1938) laid out the principal problem to be the establishment of laws for individual responses (reflexes). Skinner hastened to add that the remaining part of the field was “the interaction of separate reflexes” (1938, p. 46). Models favoring competition among behaviors, however, have not been particularly attractive, which is somewhat surprising, given the awareness among the first experimental analysts of such a phenomenon. Initially, experimental subjects were merely positioned on a table or in an open box with stimuli and objects delivered to the subjects more or less by hand. The investigatory reflexes elicited by even slight noise, odor, light, or temperature changes were well known to “inhibit” the conditioned reflexes. Thus, behavior competition was a serious everyday problem, which in fact must have prevented or at best delayed collection of replicable data. Thus, Pavlov wrote:
In our old laboratory the neglect to provide against external stimuli often led to a curious complication when I visited some of my co-workers. Having by himself established a new conditioned reflex, working in the room with the dog, the experimenter would invite me for a demonstration, and then everything would go wrong and he would be unable to show anything at all. It was I who presented the extra stimulus: the investigatory reflex was immediately brought into play: the dog gazed at me, and smelled at me, and of course this was sufficient to inhibit every recently established reflex. (Pavlov, 1927, p. 45)
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Allen, J. D., and Porter, J. H.: Sources of control over schedule-induced drinking produced by second-order schedules of reinforcement. Physiol. Behav., 18, 853–863, 1977.
Allen, J. D., Porter, J. H., and Arazie, R.: Schedule-induced drinking as a function of percentage reinforcement. J. Exp. Analy. Behav., 23, 223–232, 1975.
Amsel, A.: The role of frustrative nonreward in noncontinuous reward situations. Psychol. Bull., 55, 102–119, 1958.
Amsel, A., and Roussel, J.: Motivational properties of frustration: I. Effect on a running response of the addition of frustration to the motivational complex. J. Exp. Psychol., 43, 363–368, 1952.
Anderson, M. C., and Shettleworth, S. J.: Behavioral adaptation to fixed-interval and fixed-time food delivery in golden hamsters. J. Exp. Anal. Behav., 27, 33–49, 1977.
Anger, D.: The dependence of interresponse times upon the relative reinforcement of different interresponse times. J. Exp. Psychol., 52, 145–161, 1956.
Ator, N.: Interchangeability of mirror attack and response-produced time out in pigeons. Paper presented at the meeting of the Americal Psychological Association, Washington, D. C., September 1976.
Azrin, N. H., Hutchinson, R. R., and McLaughlin, R.: The opportunity for aggression as an operant reinforcer during aversive stimulation. J. Exp. Anal. Behav., 8, 171–180, 1965.
Barowsky, E. I., and Mintz, D. E.: The effects of time-out locus during fixed-ratio reinforcement. Bull. Psychonomic Soc., 5, 137–140, 1975.
Berlyne, D. E.: Conflict, Arousal, and Curiosity. New York, McGraw-Hill, 1960.
Bolles, R. C.: Theory of Motivation. New York, Harper & Row, 1967.
Boren, J. J.: Stimulus probes of the fixed ratio run. Paper presented at Eastern Psychological Association, Philadelphia, 1961.
Boren, J. J.: The study of drugs with operant techniques. In, W. K. Honig (ed.): Operant Behavior: Areas of Research and Application. New York, Appleton-Century-Crofts, 1966.
Breland, K., and Breland, M.: The misbehavior of organisms. Am. Psychol., 16, 681–684, 1961.
Bush, R. R., and Mosteller, F.: Stochastic Models for Learning. New York, Wiley, 1955.
Carlisle, H. J.: Fixed-ratio polydipsia: termal effects of drinking, pausing, and responding. J. Comp. Physiol. Psychol., 75, 10–22, 1971.
Carlisle, H. J.: Schedule-induced polydipsia: effects of water termperature, ambient temperature, and hypothalamic cooling. J. Comp. Physiol. Psychol., 83, 208–220, 1973.
Catania, A. C., and Gill, C. A.: Inhibition and behavioral contrast. Psychonomic Sci., 1, 257–258, 1964.
Clark, F. C.: Some observations on the adventitious reinforcement of drinking under food reinforcement. J. Exp. Anal. Behav., 5, 61–63, 1962.
Cohen, P. S., and Looney, T. A.: Schedule-induced mirror responding in the pigeon. J. Exp. Anal. Behav., 19, 395–408, 1973.
Cole, J. M., and Parker, B. K.: Schedule-induced aggression: access to an attackable target bird as a positive reinforcer. Psychonomic Sci., 22, 33–35, 1971.
Colotla, V. A., and Keehn, J. D.: Effects of reinforcer-pellet composition on schedule-induced polydipsia with alcohol, water, and saccharin. Psychol. Record, 25, 91–98, 1975.
Cook, P., and Singer, G.: Effects of stimulus displacement on adjunctive behavior. Physiol. Behav., 16, 79–82, 1976.
Corfield-Sumner, P. K., Blackman, D. E., and Stainer, G.: Polydipsia induced in rats by second-order schedules of reinforcement. J. Exp. Anal. Behav., 27, 265–273, 1977.
Dardano, J. F., and Sauerbrunn, D.: Selective punishment of fixed-ratio performance. J. Exp. Anal. Behav., 7, 255–260, 1964.
Dews, P. B.: The effect of multiple SΔ periods on responding on a fixed-interval schedule: V. Effect of periods of complete darkness and of occasional omissions of food presentations. J. Exp. Anal. Behav., 9, 573–578, 1966.
Dunham, P. J.: Punishment: method and theory. Psychol. Rev., 78, 58–70, 1971.
Dunham, P. J.: Some effects of punishment upon unpunished responding. J. Exp. Anal. Behav., 17, 443–450, 1972.
Ellen, P., Gillenwater, G., and Richardson, W. K.: Extinction responding by septal and normal rats following acquisition under four schedules of reinforcement. Physiol. Behav., 18, 609–615, 1977.
Estes, W. K.: Toward a statistical theory of learning. Psychol. Rev., 57, 94–107, 1950.
Falk, J. L.: The motivational properties of schedule-induced polydipsia. J. Exp. Anal. Behav., 9, 19–25, 1966.
Falk, J. L.: Conditions producing psychogenic polydipsia in animals. Ann. N. Y. Acad. Sci., 157, 569–593, 1969.
Falk, J. L.: The nature and determinants of adjunctive behavior. Physiol. Behav., 6, 577–588, 1971.
Felton, M., and Lyon, D. O.: The post-reinforcement pause. J. Exp. Anal. Behav., 9, 131–134, 1966.
Ferster, C. B., and Skinner, B. F.: Schedules of Reinforcement. New York, Appleton-Century-Crofts, 1957.
Findley, J. D.: An experimental outline for building and exploring multi-operant behavior repertoires. J. Exp. Anal. Behav., 5, 113–166, 1962.
Findley, J. D., and Brady, J. V.: Facilitation of large ratio performance by use of conditioned reinforcement. J. Exp. Anal. Behav., 8, 125–129, 1965.
Flory, R. K.: Attack behavior in a multiple fixed-ratio schedule of reinforcement. Psychonomic Sci., 16, 15615–15157, 1969.
Flory, R. K., and O’Boyle, M. K.: The effect of limited water availability on schedule-induced polydipsia. Physiol. Behav., 8, 147–149, 1972.
Gilbert, R. M.: Ubiquity of schedule-induced polydipsia. J. Exp. Anal. Behav., 21, 277–284, 1974.
Gray, V. A.: Stimulus control of differential-reinforcement of low-rate responding. J. Exp. Anal. Behav., 25, 199–207, 1976.
Griffiths, R. R., and Thompson, T.: The post-reinforcement pause: a misnomer. Psychol. Record, 23, 229–235, 1973.
Guthrie, E. R.: The Psychology of Learning. New York, Harper, 1935.
Hearst, E.: Some persistent problems in the analysis of conditioned inhibition. In, R. A. Boakes and M. S. Halliday (ed.): Inhibition and Learning. London and New York, Academic Press, 1972.
Herrnstein, R. J.: On the law of effect. J. Exp. Anal. Behav., 13, 243–266, 1970.
Herrnstein, R. J.: Formal properties of the matching law. J. Exp. Anal. Behav., 21, 159–164, 1974.
Hodos, W., Ross, G. S., and Brady, J. V.: Complex response patterns during temporally spaced responding. J. Exp. Anal. Behav., 5, 473–479, 1962.
Honig, W. K.: Introductory remarks. In, W. K. Honig (ed.): Operant Behavior: Areas of Research and Application. New York, Appleton-Century-Crofts, 1966.
Horridge, G. A.: The interpretation of behavior in terms of interneurons. In, M. A. B. Brazier (ed.): The Interneuron. Los Angeles, University of California Press, 1969.
Hull, C. L.: A Behavior System. New Haven, Yale University Press, 1952.
Huston, J. P., and Desisto, M. J.: Interspecies aggression during fixed-ratio hypothalamic self-stimulation in rats. Physiol. Behav., 7, 353–357, 1971.
Hutchinson, R. R., Azrin, N. H., and Hunt, G. M.: Attack produced by intermittent reinforcement of a concurrent operant response. J. Exp. Anal. Behav., 11, 489–495, 1968.
Iversen, I. H.: Interactions between reinforced and non-reinforced responses. Paper presented at the Third Scandinavian Meeting on Physiological Psychology, Copenhagen, May 1973.
Iversen, I. H.: Concurrent responses during multiple schedules in rats. Scand. J. Psychol., 16, 49–54, 1975a.
Iversen, I. H.: Interactions between lever pressing and collateral drinking during VI with limited hold. Psychol. Record, 25, 47–50, 1975b.
Iversen, I. H.: Interactions between reinforced responses and collateral responses. Psychol. Record, 26, 399–413, 1976.
Iversen, I. H.: Behavioral pauses and their relation to concurrent behaviors. Paper presented at the Easter Conference of the English Experimental Analysis of Behavior Group. Exeter, March 1977a.
Iversen, I. H.: Reinforcement omission and schedule-induced drinking in a response-independent schedule in rats. Physiol. Behav., 18, 535–537, 1977b.
Keehn, J. D., and Colotla, V. A.: Schedule-induced drinking as a function of interpellet interval. Psychonomic Sci., 23, 69–71, 1971.
Killeen, P.: On the temporal control of behavior. Psychol. Rev., 82, 89–115, 1975.
Kuhn, T. S.: The Structure of Scientific Revolutions. International Encyclopedia of Unified Science, vol. 2, No. 2, 2nd ed. Chicago, University of Chicago Press, 1970.
Laties, V. G., Weiss, B., Clark, R. L., and Reynolds, M. D.: Overt “mediating” behavior during temporally spaced responding. J. Exp. Anal. Behav., 8, 107–116, 1965.
Laties, V. G., Weiss, B., and Weiss, A. B.: Further observations on overt “mediating” behavior and the discrimination of time. J. Exp. Anal. Behav., 12, 43–57, 1969.
Lyon, D. O.: Some notes on conditioned suppression and reinforcement schedules. J. Exp. Anal. Behav., 7, 289–291, 1964.
McCoy, J. F., and Christian, W. P.: Schedule-induced drinking and reinforcement omission. Physiol. Behav., 17, 537–539, 1976.
McLeod, D. R., and Gollub, L. R.: An analysis of rats’ drinking-tube contacts under tandem and fixed-interval schedules of food presentation. J. Exp. Anal. Behav., 25, 361–370, 1976.
McMillan, J. C.: Percentage reinforcement of fixed-ratio and variable-interval performances. J. Exp. Anal. Behav., 15, 297–302, 1971.
Neuringer, A. J., and Schneider, B. A.: Separating the effects of interreinforcement time and number of interreinforcement responses. J. Exp. Anal. Behav., 11, 661–667, 1968.
Pavlov, I. P.: Conditioned Reflexes (Translated by G. V. Anrep). London, Oxford, 1927 (Reprinted, New York, Dover, 1960).
Penney, J., and Schull, J.: Functional differentiation of adjunctive drinking and wheel running in rats. Anim. Learning Behav., 5, 272–280, 1977.
Porter, J. H., and Kenshalo, D. R.: Schedule-induced drinking following omission of reinforcement in the rhesus monkey. Physiol. Behav., 12, 1075–1077, 1974.
Porter, J. H., Arazie, R., Holbrook, J. W., Cheek, M. S., and Allen, J. D.: Effects of variable and fixed second-order schedules on schedule-induced polydipsia in the rat. Physiol. Behav., 14, 143–149, 1975.
Powell, R. W.: The effect of small sequential changes in fixed-ratio size upon the post-reinforcement pause. J. Exp. Anal. Behav., 11, 589–593, 1968.
Powell, R. W.: The effect of reinforcement magnitude upon responding under fixed-ratio schedules. J. Exp. Anal. Behav., 12, 605–608, 1969.
Premack, D.: Catching up with common sense or two sides of a generalization: reinforcement and punishment. In, R. Glaser (ed.): The Nature of Reinforcement. New York, Academic Press, 1971.
Rand, J. F.: Behaviors observed during S- in a simple discrimination learning task. J. Exp. Anal. Behav., 27, 103–117, 1977.
Ray, R. D., and Brown, D. A.: A systems approach to behavior. Psychol. Record, 25, 459–478, 1975.
Reynolds, G. S., and McLeod, A.: On the theory of interresponse-time reinforcement. In, G. H. Bower (ed.): The Psychology of Learning and Motivation. New York, Academic Press, 1970.
Rosenblith, J. Z.: Polydipsia induced in the rat by a second-order schedule. J. Exp. Anal. Behav., 14, 139–144, 1970.
Sanger, D.: Schedule-induced drinking of chlordiazepoxide solutions by rats. Pharmacol. Bio-chem. Behav., 7, 1–6, 1977.
Schaeffer, R. W., and Diehl, J. C.: Collateral water drinking in rats maintained on FR food reinforcement schedules. Psychonomic Sci., 4, 257–258, 1966.
Schoenfeld, W. N., and Farmer, J.: Reinforcement schedules and the “behavior stream.” In, W. N. Schoenfeld (ed.): The Theory of Reinforcement Schedules. New York, Appleton-Century-Crofts, 1970.
Segal, E. F.: Transformation of Polydipsic drinking into operant drinking: A paradigm? Psycho-nomic Sci., 16, 133–135, 1969.
Segal, E. F.: Induction and the provenance of operants. In, R. M. Gilbert and J. R. Millenson (eds.): Reinforcement: Behavioral Analysis. New York, Academic Press, 1972.
Segal, E. F., and Bandt, W. M.: Influence of collateral water drinking on bar pressing under complex reinforcement contingencies. Psychonomic Sci., 4, 377–378, 1966.
Seward, J. P., Pereboom, A. C., Butler, B., and Jones, R. B.: The role of prefeeding in an apparent frustration effect. J. Exp. Psychol., 54, 445–450, 1957.
Shimp, C. P.: Optimal behavior in free-operant experiments. Psychol. Rev., 76, 97–112, 1969.
Shimp, C. P.: Synthetic variable-interval schedules of reinforcement. J. Exp. Anal. Behav., 19, 311–330, 1973.
Skinner, B. F.: The Behavior of Organisms, New York, Appleton-Century-Crofts, 1938.
Skinner, B. F.: Are theories of learning necessary? Psychol. Rev., 57, 193–216, 1950.
Skinner, B. F., and Morse, W. H.: Concurrent activity under fixed-interval reinforcement. J. Comp. Physiol. Psychol., 50, 279–281, 1957.
Slonaker, R. L., and Hothersall, D.: Collateral behaviors and the DRL deficit of rats with septal lesions. J. Comp. Physiol. Psychol., 80, 91–96, 1972.
Smith, J. B., and Clark, F. C.: Effects of d-amphetamine, chlorpromazine, and chlordiazepoxide on intercurrent behavior during spaced-responding schedules. J. Exp. Anal. Behav., 24, 241–248, 1975.
Staddon, J. E. R.: Temporal effects of reinforcement: a negative “frustration” effect. Learning Motivation, 1, 227–247, 1970.
Staddon, J. E. R.: Schedule-induced behavior. In, W. K. Honig and J. E. R. Staddon (eds.): Handbook of Operant Behavior. Englewood Cliffs, New Jersey: Prentice-Hall, 1977.
Staddon, J. E. R., and Ayres, S. L.: Sequential and temporal properties of behavior induced by a schedule of periodic food delivery. Behaviour, 54, 26–49, 1975.
Staddon, J. E. R., and Innis, N. K.: An effect analogous to “frustration” on interval reinforcement schedules. Psychonomic Sci., 4, 287–288, 1966.
Staddon, J. E. R., and Innis, N. K.: Reinforcement omission on fixed-interval schedules. J. Exp. Anal. Behav., 12, 689–700, 1969.
Staddon, J. E. R., and Simmelhag, V. L.: The “superstition” experiment: a reexamination of its implications for the principles of adaptive behavior. Psychol. Rev., 78, 3–43, 1971.
Thompson, T.: Effect of chlorpromazine on “aggressive” responding in the rat. J. Comp. Physiol. Psychol., 54, 398–400, 1961.
Timberlake, W., and Allison, J.: Response deprivation: an empirical approach to instrumental performance. Psychol. Rev., 81, 146–164, 1974.
Wallace, M., and Singer, G.: Schedule-induced behavior: a review of its generality, determinants and pharmacological data. Pharmacol. Biochem. Behav., 5, 483–490, 1976.
Wayner, M. J., and Greenberg, I.: Effects of septal lesions on palatability modulation and schedule-induced behavior. Physiol. Behav., 9, 663–665, 1972.
Wong, P. T.: A behavioral field approach to instrumental learning in the rat: I. Partial reinforcement effects and sex differences. Anim. Learning Behavior, 5, 5–13, 1977.
Wookey, P. E., and Strongman, K. T.: Reward shift and general activity in the rat. Br. J. Psychol., 65, 103–110, 1974.
Wuttke, W., and Innis, N. K.: Drug effects upon behavior induced by second-order shcedules of reinforcement: the relevance of ethological analysis. In, R. M. Gilbert and J. D. Keehn (eds.): Schedule Effects: Drugs, Drinking, and Aggression. Toronto, University of Toronto Press, 1972.
Zimmerman, D. W.: Rate changes after unscheduled omission and presentation of reinforcement. J. Exp. Anal. Behav., 15, 261–270, 1971.
Rights and permissions
Copyright information
© 1978 Springer-Verlag New York Inc.
About this chapter
Cite this chapter
Iversen, I.H. (1978). Collateral Responses with Simple Schedules. In: Classical Conditioning and Operant Conditioning. Springer, New York, NY. https://doi.org/10.1007/978-1-4612-6310-4_6
Download citation
DOI: https://doi.org/10.1007/978-1-4612-6310-4_6
Publisher Name: Springer, New York, NY
Print ISBN: 978-1-4612-6312-8
Online ISBN: 978-1-4612-6310-4
eBook Packages: Springer Book Archive