Abstract
The ability to simultaneously maintain multiple representations through motion is an essential feature of the visual system. The multiple object tracking paradigm (MOT) has been devised in order to develop an understanding of how the visual system retains the correspondence between visual objects and their neural representation across time. A multitude of potential mechanisms maintaining this correspondence have been proposed, each being either supported or challenged by several studies. In order to provide a background for developing MOT paradigms focusing on current MOT literature, we will discuss design strategies for creating object tracking environments and present methods to quantify tracking performance under different task conditions. Finally, methods to measure resource deployment for spatial locations during tracking will be presented that will allow for inferences about potential underlying tracking mechanisms.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Wolfe JM (1994) Guided Search 2.0 A revised model of visual search. Psychon Bull Rev 1(2):202–238. https://doi.org/10.3758/BF03200774
Treisman AM, Gelade G (1980) A feature-integration theory of attention. Cogn Psychol 12(1):97–136
Treisman AM (1996) The binding problem. Curr Opin Neurobiol 6(2):171–178
Driver J, Davis G, Russell C et al (2001) Segmentation, attention and phenomenal visual objects. Cognition 80(1-2):61–95
Jonides J, Smith EE, Koeppe RA et al (1993) Spatial working memory in humans as revealed by PET. Nature 363(6430):623–625
Luck SJ, Vogel EK (1997) The capacity of visual working memory for features and conjunctions. Nature 390:279–281
Pylyshyn Z, Storm RW (1988) Tracking multiple independent targets: evidence for a parallel tracking mechanism. Spat Vis 3:1–19
Muller MM, Malinowski P, Gruber T et al (2003) Sustained division of the attentional spotlight. Nature 424(6946):309–312. https://doi.org/10.1038/nature01812
McMains SA, Somers DC (2004) Multiple spotlights of attentional selection in human visual cortex. Neuron 42(4):677–686
Cave KR, Bichot NP (1999) Visuo-spatial attention: beyond a spotlight model. Psychon Bull Rev 6:204–223
Posner MI (1980) Orienting of attention. Q J Exp Psychol 32:3–25
Eriksen CW, James JDS (1986) Visual attention within and around the field of focal attention: a zoom lens model. Percept Psychophys 40(4):225–240
Schoenfeld MA, Hopf JM, Merkel C et al (2014) Object-based attention involves the sequential activation of feature-specific cortical modules. Nat Neurosci 17(4):619–624. https://doi.org/10.1038/nn.3656
Huang L, Treisman A, Pashler H (2007) Characterizing the limits of human visual awareness. Science 317(5839):823–825
VanRullen R (2013) Visual attention: a rhythmic process? Curr Biol 23(24):R1110–R1112. https://doi.org/10.1016/j.cub.2013.11.006
Scholl BJ (2001) Objects and attention: the state of the art. Cognition 80(1–2):1–46
Pylyshyn Z (1989) The role of location indexes in spatial perception: a sketch of the FINST spatial-index model. Cognition 32:65–97
Posner MI, Walker JA, Friedrich FA et al (1987) How do the parietal lobes direct covert attention? Neuropsychologia 25(1A):135–145
Eriksen CW, Murphy TD (1987) Movement of attentional focus across the visual field: a critical look at the evidence. Percept Psychophys 42(3):299–305
Oksama L, Hyona J (2004) Is multiple object tracking carried out automatically by an early vision mechanism independent of higher-order cognition? An individual difference approach. Vis Cogn 11(5):631–671
Yantis S (1992) Multielement visual tracking: attention and perceptual organization. Cogn Psychol 24(3):295–340
Carlson TA, Hogendoorn H, Verstraten FA (2006) The speed of visual attention: what time is it? J Vis 6(12):1406–1411. https://doi.org/10.1167/6.12.6
Horowitz TS, Holcombe AO, Wolfe JM et al (2004) Attentional pursuit is faster than attentional saccade. J Vis 4(7):585–603. https://doi.org/10.1167/4.7.6
Hogendoorn H, Carlson TA, Verstraten FA (2007) The time course of attentive tracking. J Vis 7(14):2.1–2.10. https://doi.org/10.1167/7.14.2
Holcombe AO, Chen WY (2013) Splitting attention reduces temporal resolution from 7 Hz for tracking one object to <3 Hz when tracking three. J Vis 13(1):12. https://doi.org/10.1167/13.1.12
Pylyshyn Z (2001) Visual indexes, preconceptual objects, and situated vision. Cognition 80:127–158
Sears CR, Pylyshyn ZW (2000) Multiple object tracking and attentional processing. Can J Exp Psychol 54(1):1–14
Cowan N (2001) The magical number 4 in short-term memory: a reconsideration of mental storage capacity. Behav Brain Sci 24(1):87–114. discussion 114-185
Kahneman D, Treisman A, Gibbs BJ (1992) The reviewing of object files: object-specific integration of information. Cogn Psychol 24(2):175–219
Scholl BJ, Pylyshyn ZW, Feldman J (2001) What is a visual object? Evidence from target merging in multiple object tracking. Cognition 80(1–2):159–177
Pylyshyn Z (2004) Some puzzling findings in multiple object tracking: I. Tracking without keeping track of object identities. Vis Cogn 11(7):801–822
Saiki J (2003) Feature binding in object-file representations of multiple moving items. J Vis 3(1):6–21. https://doi.org/10.1167/3.1.2
Tripathy SP, Barrett BT (2004) Severe loss of positional information when detecting deviations in multiple trajectories. J Vis 4(12):1020–1043. https://doi.org/10.1167/4.12.4
Alvarez GA, Franconeri SL (2007) How many objects can you track? Evidence for a resource-limited attentive tracking mechanism. J Vis 7(13):14.11–14.10
Shim WM, Alvarez GA, Jiang YV (2008) Spatial separation between targets constrains maintenance of attention on multiple objects. Psychon Bull Rev 15(2):390–397
Franconeri SL, Jonathan SV, Scimeca JM (2010) Tracking multiple objects is limited only by object spacing, not by speed, time, or capacity. Psychol Sci 21(7):920–925. https://doi.org/10.1177/0956797610373935
Liu G, Austen EL, Booth KS et al (2005) Multiple-object tracking is based on scene, not retinal, coordinates. J Exp Psychol Hum Percept Perform 31(2):235–247. https://doi.org/10.1037/0096-1523.31.2.235
Cavanagh P, Alvarez GA (2005) Tracking multiple targets with multifocal attention. Trends Cogn Sci 9:349–354
Franconeri SL, Alvarez GA, Cavanagh P (2013) Flexible cognitive resources: competitive content maps for attention and memory. Trends Cogn Sci 17(3):134–141. https://doi.org/10.1016/j.tics.2013.01.010
Chen WY, Howe PD, Holcombe AO (2013) Resource demands of object tracking and differential allocation of the resource. Atten Percept Psychophys 75(4):710–725. https://doi.org/10.3758/s13414-013-0425-1
Iordanescu L, Grabowecky M, Suzuki S (2009) Demand-based dynamic distribution of attention and monitoring of velocities during multiple-object tracking. J Vis 9(4):1.1–1.12. https://doi.org/10.1167/9.4.1
Alvarez GA, Cavanagh P (2005) Independent resources for attentional tracking in the left and right visual fields. Psychol Sci 16:637–643
Stormer VS, Alvarez GA, Cavanagh P (2014) Within-hemifield competition in early visual areas limits the ability to track multiple objects with attention. J Neurosci 34(35):11526–11533. https://doi.org/10.1523/JNEUROSCI.0980-14.2014
Howe PD, Cohen MA, Pinto Y et al (2010) Distinguishing between parallel and serial accounts of multiple object tracking. J Vis 10(8):11. https://doi.org/10.1167/10.8.11
Merkel C, Hopf JM, Heinze HJ et al (2015) Neural correlates of multiple object tracking strategies. Neuroimage 118:63–73. https://doi.org/10.1016/j.neuroimage.2015.06.005
Merkel C, Hopf JM, Schoenfeld MA (2017) Spatio-temporal dynamics of attentional selection stages during multiple object tracking. Neuroimage 146:484–491. https://doi.org/10.1016/j.neuroimage.2016.10.046
Merkel C, Stoppel CM, Hillyard SA et al (2014) Spatio-temporal patterns of brain activity distinguish strategies of multiple-object tracking. J Cogn Neurosci 26(1):28–40. https://doi.org/10.1162/jocn_a_00455
Bahrami B (2003) Object property encoding and change blindness in multiple object tracking. Vis Cogn 10:949–963
Horowitz TS, Klieger SB, Fencsik DE et al (2007) Tracking unique objects. Percept Psychophys 69(2):172–184
Botterill K, Allen R, McGeorge P (2011) Multiple-object tracking: the binding of spatial location and featural identity. Exp Psychol 58(3):196–200. https://doi.org/10.1027/1618-3169/a000085
Oksama L, Hyona J (2008) Dynamic binding of identity and location information: a serial model of multiple identity tracking. Cogn Psychol 56(4):237–283. https://doi.org/10.1016/j.cogpsych.2007.03.001
Fehd HM, Seiffert AE (2008) Eye movements during multiple object tracking: where do participants look? Cognition 108(1):201–209. https://doi.org/10.1016/j.cognition.2007.11.008
Fehd HM, Seiffert AE (2010) Looking at the center of the targets helps multiple object tracking. J Vis 10(4):19.11–19.13. https://doi.org/10.1167/10.4.19
Zelinsky GJ, Neider MB (2008) An eye movement analysis of multiple object tracking in a realistic environment. Vis Cogn 16(5):553–566
Oksama L, Hyona J (2016) Position tracking and identity tracking are separate systems: evidence from eye movements. Cognition 146:393–409. https://doi.org/10.1016/j.cognition.2015.10.016
Li J, Oksama L, Hyona J (2019) Model of multiple identity tracking (MOMIT) 2.0: resolving the serial vs. parallel controversy in tracking. Cognition 182:260–274. https://doi.org/10.1016/j.cognition.2018.10.016
Horowitz TS, Cohen MA (2010) Direction information in multiple object tracking is limited by a graded resource. Atten Percept Psychophys 72(7):1765–1775. https://doi.org/10.3758/APP.72.7.1765
Fencsik DE, Klieger SB, Horowitz TS (2007) The role of location and motion information in the tracking and recovery of moving objects. Percept Psychophys 69(4):567–577
Keane BP, Pylyshyn ZW (2006) Is motion extrapolation employed in multiple object tracking? Tracking as a low-level, non-predictive function. Cogn Psychol 52(4):346–368
Franconeri SL, Pylyshyn ZW, Scholl BJ (2012) A simple proximity heuristic allows tracking of multiple objects through occlusion. Atten Percept Psychophys 74(4):691–702. https://doi.org/10.3758/s13414-011-0265-9
Zhong SH, Ma Z, Wilson C et al (2014) Why do people appear not to extrapolate trajectories during multiple object tracking? A computational investigation. J Vis 14(12):12. https://doi.org/10.1167/14.12.12
Vul E, Frank M, Alvarez GA et al (2009) Explaining human multiple object tracking as resource-constrained approximate inference in a dynamic probabilistic model. Adv Neural Inf Process Syst 22:1955–1963
Freyd JJ, Finke RA (1984) Representational momentum. J Exp Psychol Learn Mem Cogn 10:126–132
Freyd JJ, Finke RA (1985) A velocity effect for representational momentum. Bull Psychon Soc 23:443–446
Finke RA, Shyi GC (1988) Mental extrapolation and representational momentum for complex implied motions. J Exp Psychol Learn Mem Cogn 14(1):112–120
Verghese P, McKee SP (2002) Predicting future motion. J Vis 2(5):413–423. https://doi.org/10.1167/2.5.5
Scholl BJ, Pylyshyn ZW (1999) Tracking multiple items through occlusion: clues to visual objecthood. Cogn Psychol 38(2):259–290
Flombaum JI, Scholl BJ, Pylyshyn ZW (2008) Attentional resources in visual tracking through occlusion: the high-beams effect. Cognition 107(3):904–931. https://doi.org/10.1016/j.cognition.2007.12.015
Watamaniuk SN, McKee SP (1995) Seeing motion behind occluders. Nature 377(6551):729–730. https://doi.org/10.1038/377729a0
Yantis S (1995) Perceived continuity of occluded visual objects. Psychol Sci 6:182–186
Olson IR, Gatenby JC, Leung HC et al (2004) Neuronal representation of occluded objects in the human brain. Neuropsychologia 42(1):95–104
Tripathy SP, Narasimhan S, Barrett BT (2007) On the effective number of tracked trajectories in normal human vision. J Vis 7(6):2. https://doi.org/10.1167/7.6.2
Howe PD, Holcombe AO (2012) Motion information is sometimes used as an aid to the visual tracking of objects. J Vis 12(13):10. https://doi.org/10.1167/12.13.10
Bettencourt KC, Somers DC (2009) Effects of target enhancement and distractor suppression on multiple object tracking capacity. J Vis 9(7):9. https://doi.org/10.1167/9.7.9
Intriligator J, Cavanagh P (2001) The spatial resolution of visual attention. Cogn Psychol 43(3):171–216. https://doi.org/10.1006/cogp.2001.0755
VanMarle K, Scholl BJ (2003) Attentive tracking of objects versus substances. Psychol Sci 14(5):498–504. https://doi.org/10.1111/1467-9280.03451
Hulleman J (2005) The mathematics of multiple object tracking: from proportions correct to number of objects tracked. Vis Res 45(17):2298–2309. https://doi.org/10.1016/j.visres.2005.02.016
Pylyshyn ZW, Annan V Jr (2006) Dynamics of target selection in multiple object tracking (MOT). Spat Vis 19(6):485–504
Pylyshyn ZW, Haladjian HH, King CE et al (2008) Selective nontarget inhibition in multiple object tracking. Vis Cogn 16(8):1011–1021. https://doi.org/10.1080/13506280802247486
Tran A, Hoffman JE (2016) Visual attention is required for multiple object tracking. J Exp Psychol Hum Percept Perform 42(12):2103–2114. https://doi.org/10.1037/xhp0000262
Atsma J, Koning A, van Lier R (2012) Multiple object tracking: anticipatory attention doesn’t “bounce”. J Vis 12(13):1. https://doi.org/10.1167/12.13.1
Alvarez GA, Scholl BJ (2005) How does attention select and track spatially extended objects? New effects of attentional concentration and amplification. J Exp Psychol Gen 134(4):461–476
Heinze HJ, Mangun GR, Burchert W et al (1994) Combined spatial and temporal imaging of brain activity during visual selective attention in humans. Nature 372(8):543–546
Hillyard SA, Anllo-Vento L (1998) Event-related brain potentials in the study of visual selective attention. Proc Natl Acad Sci 95(3):781–787
Hopf J-M, Boehler CN, Luck SJ et al (2006) Direct neurophysiological evidence for spatial suppression surrounding the focus of attention in vision. Proc Natl Acad Sci 103(4):1053–1058
Drew T, McCollough AW, Horowitz TS et al (2009) Attentional enhancement during multiple-object tracking. Psychon Bull Rev 16(2):411–417. https://doi.org/10.3758/PBR.16.2.411
Stormer VS, Li SC, Heekeren HR et al (2013) Normal aging delays and compromises early multifocal visual attention during object tracking. J Cogn Neurosci 25(2):188–202. https://doi.org/10.1162/jocn_a_00303
Sternshein H, Agam Y, Sekuler R (2011) EEG correlates of attentional load during multiple object tracking. PLoS One 6(7):e22660. https://doi.org/10.1371/journal.pone.0022660
Doran MM, Hoffman JE (2010) The role of visual attention in multiple object tracking: evidence from ERPs. Atten Percept Psychophys 72(1):33–52. https://doi.org/10.3758/APP.72.1.33
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Science+Business Media, LLC
About this protocol
Cite this protocol
Merkel, C., Hopf, JM., Schoenfeld, M.A. (2019). How to Perceive Object Permanence in Our Visual Environment: The Multiple Object Tracking Paradigm. In: Pollmann, S. (eds) Spatial Learning and Attention Guidance. Neuromethods, vol 151. Humana, New York, NY. https://doi.org/10.1007/7657_2019_28
Download citation
DOI: https://doi.org/10.1007/7657_2019_28
Published:
Publisher Name: Humana, New York, NY
Print ISBN: 978-1-4939-9947-7
Online ISBN: 978-1-4939-9948-4
eBook Packages: Springer Protocols