Introduction

“When the type of stuff that they’re (offenders) involved in kept happening and they realized they weren’t getting arrested, nothing was happening because of those cameras. I do not think (the camera program) works as a deterrent at all….because there’s no immediate consequence to the behavior” (King et al. 2008: p. 86–87). The previous quote was provided by a San Francisco police inspector during an interview with researchers from the University of California, Berkeley. This quote articulates an inherent shortcoming of CCTV use by police, namely that the practical application of CCTV typically results in surveillance barriers that hinder the occurrence of enforcement activity (Piza et al. 2012). Such low levels of enforcement may diminish CCTV’s crime prevention capacity, since certainty of punishment is widely recognized as a key aspect of deterrence (Durlauf and Nagin 2011). As articulated by Pease (1999) “No public place…will be crime free if offenders have good reason to believe that they will not be recognised, or, if recognised, will not be reported to the police, or, if reported will escape meaningful criminal justice outcomes” (p. 49). Therefore, the increased risk suggested by camera presence can ring hollow if offenders learn that CCTV does not truly increase the likelihood of apprehension in response to crime commission (Tilley 1993).

The current study reports the results of a randomized controlled trial testing the effect of increasing certainty of punishment on the crime prevention capacity of CCTV in Newark, NJ. The experimental strategy was designed for the purpose of overcoming specific surveillance barriers that prior research has found to impede upon the certainty of punishment in CCTV systems: high camera-to-operator ratios and the differential response strategy of police dispatch. Results suggest that the experiment increased proactive CCTV activity while producing a significant reduction of violent crime and social disorder incidents. The experiment did not have a significant effect on narcotics activity. These findings have implications for police-led CCTV strategies. Specifically, this study supports the hypothesis that the integration of CCTV with proactive, focused police activity generates crime control benefits greater than what research suggests is achievable via stand-alone camera deployment.

Review of relevant literature

CCTV and crime prevention

Champions of video surveillance have consistently touted the technology as an effective crime deterrent and a force multiplier for the police (Norris 2003). Such enthusiasm has led many to view CCTV as a panacea against crime, an “all seeing” mechanism that is successful in all circumstances (Fyfe and Bannister 1996). Norris and Armstrong (1999a) argued that this widespread acceptance of CCTV is largely the result of “technological determinism,” which they define as “an unquestioning belief in the power of technology” (p. 9). Whatever the driver, public stakeholders’ enthusiasm for CCTV quickly translated into public policy. In Great Britain, for example, the vast expansion of government-funded CCTV systems established CCTV as the “crime prevention initiative of the century” (Norris and Armstrong 1999a) with leaders from both major political parties allocating substantial funds towards CCTV-related projects since the early 1990’s (Taylor 2010). This rapid expansion of CCTV has seemingly spread to the United States. While the latest meta-analysis by Welsh and Farrington (2009) identified only one evaluation conducted in the U.S. (Mazerolle et al. 2002), numerous U.S. evaluations have appeared in the relatively short time since the review (Cameron et al. 2008; Caplan et al. 2011; King et al. 2008; La Vigne et al. 2011; McLean et al. 2013; Ratcliffe et al. 2009). Furthermore, published studies likely represent a fraction of the overall systems in the U.S., with news reports suggesting “that CCTV cameras are being implemented at a significant rate” (Ratcliffe et al. 2009: p. 749).

Despite this rapid expansion, evidence of CCTV’s effectiveness is inconclusive, at best. Some studies find CCTV to be moderately effective (Armitage et al. 1999; Caplan et al. 2011; Gill and Spriggs 2005; La Vigne et al. 2011; McLean et al. 2013; Ratcliffe et al. 2009) with others finding little-to-no effect (Brown 1995; Cameron et al. 2008; King et al. 2008; Waples and Gill 2006). Meta analyses conducted by Welsh and Farrington (2002, 2007, 2009) suggest that, while CCTV has little effect in most settings, it is effective in preventing motor vehicle crime in car parks. However, in each of the car park evaluations included in the meta-analyses, CCTV was combined with other interventions, namely improved lighting, improved fencing, and security guards. Furthermore, a more recent evaluation of a car park system (Reid and Andresen 2014) found no evidence (via monthly structural break tests) that CCTV influenced crime levels. Interestingly, Reid and Andresen (2014) found that an alternate 1-year pre/post test indicated a significant drop in vehicle crime. Thus, evidence in-support of car park systems may speak more to the impact of a package of interventions (Welsh and Farrington 2007: p. 47) or the choice of statistical models (Reid and Andresen 2014) than CCTV effect, adding to the inconclusiveness of the literature.

CCTV and deterrence mechanisms

Such inconclusive findings have led some to conclude that CCTV has not lived up to its initial lofty expectations (Sasse 2010). Recent research suggests that the shortcomings of CCTV may be largely related to the detached manner in which it is incorporated into police operations. CCTV systems often have a vague mission to “prevent crime,” with little consideration given to a number of pertinent issues, namely best practices regarding camera monitoring and police response (Gill and Spriggs 2005; Piza et al. 2012, 2014a, b). This has often led police to deploy CCTV as a stand-alone mechanism rather than integrating surveillance into existing practices of the agency (La Vigne et al. 2011).

The theoretical underpinnings of CCTV suggest that the mere presence of cameras may be insufficient to generate significant crime reductions. CCTV is considered a situational crime prevention measure that specifically aims to reduce crime by increasing the perceived risks to potential offenders (Clarke 1997: p. 18). However, little attention has been paid to exactly how CCTV can increase perceived risks. On the one hand, camera presence alone may seem adequate to communicate an increased level of risk within a target area. Indeed, a widely accepted proposition is “CCTV will be most effective if potential offenders believe that they will be seen” (Farrington et al. 2007: p. 22). This suggests a deterrence mechanism by which an offender recognizes a camera, considers the risk of offending to outweigh the potential rewards, and chooses to abstain in this instance. This risk-calculus aligns with the Rational Choice Theory (Cornish and Clarke 1986), which argues that offender decision making involves a number of “choice structuring properties” comprising the pros, cons, and inherent risk involved in the commission of a particular crime.

In the study of CCTV, the influence of camera presence on offender decision making has seemingly been taken for granted by researchers. As noted by Mazerolle et al. (2002), “for some people, the very presence of CCTV is enough to deter” (p. 59). However, offender behavior suggests that such calculations are not always as we would expect. Numerous studies have documented offender willingness to operate in sight of surveillance cameras (Butler 1994; Ditton and Short 1998; Gill and Loveday 2003; Gill and Turbin 1998). During interviews with prisoners, Gill and Loveday (2003) found that most offenders did not consider CCTV as a serious threat. Interestingly, offenders were more concerned with police presence and the ability of the police to respond to crime observed on camera than the cameras themselves. Indeed, while Gill and Loveday (2003) found that most offenders did not equate CCTV with increased risk of punishment, those previously caught or convicted through surveillance footage were significantly more likely to report that CCTV increases the likelihood of apprehension.

The findings of Gill and Loveday (2003) suggest that CCTV operations may need to incorporate more than conspicuous camera presence in order to produce deterrence. Recent research further suggests that CCTV effect may be bolstered when the technology is integrated into proactive police strategies, rather than deployed as a stand-alone tactic. In their study of CCTV in three U.S. cities, La Vigne et al. (2011) found the systems that effectively reduced crime were those incorporating active monitoring of cameras and direct integration of CCTV into proactive police functions. Conversely, the systems removed from active monitoring and proactive police activities produced no tangible crime control benefits. However, CCTV integration into the police function was ascertained from discussions with police personnel rather than any empirical measures. Thus, the precise relationship between proactive enforcement and CCTV effect remains somewhat elusive.

Despite the imprecise evidence regarding the influence of proactive enforcement on CCTV effect, findings from the policing literature provide additional support for the hypothesis that integration with proactive police activity may enhance CCTV operations. Decades of research confirm that the standard model of policing, comprised of mainly reactive strategies, has little crime control utility, with highly focused, proactive police practices having a strong track record of crime reduction (Lum et al. 2011; Skogan and Frydl 2004; Weisburd and Eck 2004). The finding regarding the effect of focused, proactive policing has largely been attributed to police strategies, such as hot spots policing and problem-oriented policing. However, evidence suggests that particular police actions, which can be incorporated into a wide-range of strategies, can also generate significant crime reductions. For example, in their review of research on policing Sherman and Eck (2002) found that proactive arrests (generated through officer-initiated activity, rather than a citizen call-for-service) effectively reduced crime across a wide range of studies and research designs. In explaining this finding, Sherman and Eck (2002) hypothesized that proactive arrests strategically applied towards problematic places or offenders create higher certainty of punishment than generally applied reactive police enforcement. This implies that maximizing proactive police enforcement in CCTV operations, where officers swiftly address incidents detected and reported by CCTV operators (rather than 9-1-1 calls), may be promising.

CCTV’s detachment from proactive policing: the effect of surveillance barriers

Unfortunately, the practical application of CCTV typically results in the emergence of surveillance barriers that impede upon proactive surveillance functions (Piza et al. 2012). The first surveillance barrier relates to how CCTV is typically incorporated into the police function. Despite being a technological innovation, CCTV is deployed in a manner that ties it to reactive law enforcement philosophies originating from the Professional Era of policing, specifically regarding police deployment (Wilson 1963). Specifically, both CCTV detections and 9-1-1 calls are typically reported via the computer-aided dispatch (CAD) system and addressed in a differential response manner, with calls of a higher priority being dispatched before lower priority calls (LEITSC 2008). This process negates any benefits offered by CCTV’s real-time discovery of crime or its precursors. In addition, the differential response nature of dispatch may discourage CCTV operators from reporting incidents they detect on camera. Operators may become frustrated when CCTV detections do not receive a timely police response and may, as a result, not bother reporting certain incidents. For example, Lomell (2004) reported that CCTV operators in Oslo, Norway stopped reporting street-level drug transactions due to the police emphasizing the apprehension of drug traffickers rather than the disruption of street-level markets. Similarly, Norris and McCahill (2006) documented a CCTV operator not reporting in-progress shoplifting due to his belief that there was not enough staff on duty for a swift response.

The second common surveillance barrier relates to the large number of cameras typically present within CCTV systems. For example, Norris and Armstrong (1999a: p. 159) estimated that the 20 cameras in a British CCTV system created over 43 million unique “images” on a daily basis, presenting operators with an unrealistic amount of footage to monitor. This burden is compounded when systems include a large amount of cameras, which appears to be the norm (Farrington et al. 2007). Research in the cognitive and behavioral sciences has found that humans work with a limited capacity of visual memory (Cowan 2000; Luck and Vogel 1997), and the accuracy and speed of task completion drastically reduces as task complexity increases (Halford et al. 2005). While empirically determining the complexity of CCTV monitoring is difficult, previous research has found that operators believe they cannot adequately monitor the number of cameras within their respective systems (Keval and Sasse 2010). Indeed, Piza et al. (2012) found an inverse, significant relationship between CCTV system size and CCTV activity, with other research generating similar results (Gill et al. 2005).

Literature review summary and scope of the current study

Surveillance barriers seem to have a minimizing effect on the active monitoring of CCTV, with research reporting proactive activity to be a rare occurrence. This finding is consistent across a range of metrics, such as detection of crime by CCTV operators (Gill and Hemming 2004; Piza et al. 2012), arrests and other enforcement actions generated by CCTV (Ditton and Short 1999; Piza et al. 2012), the capturing of visual evidence for prosecution (King et al. 2008; Sarno et al. 1999), and targeted surveillances: observations of an individual or group lasting one minute or more (Norris and Armstrong 1999a, b; Norris and McCahill 2006). The lack of enforcement likely means that “the certainty of a disciplinary response to deviancy is absent” in CCTV operations (Norris and Armstrong 1999b: p. 199). With certainty of punishment being a key aspect of deterrence (Durlauf and Nagin 2011), the lack of enforcement may minimize CCTV’s crime prevention capacity. As argued by Tilley (1993), “If the mechanism is deterrence via a rise in perceived risk which is not rooted in real risk increase, then many offenders may come to appreciate that they can safely resume their criminal behavior” (p. 5).

In an attempt to shed empirical light on these issues, this study reports on a randomized controlled trial conducted in partnership with the Newark, NJ Police Department. The experimental strategy directly addressed the aforementioned surveillance barriers: the high camera-to-operator ratio and the differential response strategy of police dispatch. To alleviate the high camera-to-operator ratio, an additional CCTV operator was deployed to the control room and dedicated to strictly monitoring the treatment areas during the experiment tours-of-duty. To alleviate issues caused by differential police response, the experimental operators were assigned two patrol cars for the purpose of responding to the incidents detected on treatment cameras. Incidents were not reported via CAD, but were relayed via two-way radio directly to the field supervisor patrolling with the experimental police units. The analysis was driven by the research question “What effect did the experimental strategy have on observed crime levels?”

Study setting

Newark is the largest city in New Jersey, spanning over 26 square miles with a population of 277,140 (U.S. Census Bureau 2010). The city has a long-standing reputation as a tumultuous, dangerous urban environment and has particularly struggled with issues of serious violence (Tuttle 2009). In recent years, the city upgraded many of its technological capabilities, including the installation of a CCTV system in 2007. One-hundred-forty-six surveillance cameras are located throughout Newark to-date. Two CCTV operators under the supervision of a police sergeant monitor live video footage from the cameras during all shifts within a control room at the department’s communications center. They are tasked with detecting incidents of probable cause or reasonable suspicion and reporting said incidents via the department’s CAD system. Reported incidents (both CCTV detections and calls for service) are stored in CAD’s calls-pending queue and addressed in a differential response manner. This process parallels those observed by researchers elsewhere (Gill et al. 2005; Lomell 2004; Ratcliffe et al. 2009). Previous research on Newark’s CCTV system shows that it suffers from specific shortcomings common to CCTV operations. For one, the system has demonstrated little effect outside the single crime of auto theft. In their analysis of the first 73 cameras installed in Newark, Caplan et al. (2011) found that auto theft was the only one of three crimes included in the analysis to have experienced a statistically significant reduction. Subsequent studies found that Newark’s system generated little proactive activity. While the system reported an average of 26.84 detections and 9.47 enforcement actions over its first 19 weeks, a weekly average of only 2.11 detections and 1.22 enforcement actions occurred after the system expanded to 146 cameras (Piza et al. 2012: p. 19). Intra-system statistics further reflect that proactive activity was virtually absent at most camera sites. During their first year in place, 17.9 % of Newark’s CCTV cameras generated no detections and 73.5 % generated five detections or less; 55.5 % of cameras generated no enforcement actions and 92.3 % generated five or less (Piza et al. 2014a: p. 242). This lack of activity is likely due to the aforementioned surveillance barriers discussed in the literature review. Piza et al. (2012) found that each additional phase of camera deployment was associated with between a 36 and 47 % reduction in weekly detection levels and between a 39 and 47 % reduction in weekly enforcement levels. While this suggests that the increasing system size was largely responsible for low levels of activity, the differential response policy of police dispatch likely also played a role. During interviews with researchers (Piza et al. 2014b), Newark’s CCTV operators reported that they routinely did not report incidents of concern they witnessed on camera because of large calls-pending queue times. For example, when asked why she did not report a particular incident, an operator stated, “Because by the time the radio car gets there they’ll be long gone” (p. 12). In all, operators in the Piza et al. (2014b) study “overwhelmingly reported that aspects of police dispatch—specifically large queue times—discouraged them from reporting” many of the criminal infractions they observed (p. 12). If proactive enforcement is truly related to CCTV’s deterrent effects, this prior research may explain the lack of a significant, wide spread effect in Newark.

The experimental strategy

The experiment was designed in a manner that the research team and Newark Police officials believed would improve upon the standard CCTV operation in Newark. The lead author worked with the department’s Command Staff to design and implement the intervention.Footnote 1 An additional CCTV operator was deployed to the control room and dedicated to strictly monitoring the treatment areas during the experiment tours-of-duty. We anticipated that having a camera-to-operator ratio drastically lower than that of the normal CCTV operation (73:1) would result in increased levels of CCTV detections. In addition, the experimental operators were assigned two patrol cars for the purpose of responding to the incidents detected on treatment cameras. Incidents were not reported through CAD, but were relayed via two-way radio directly to the field supervisor patrolling with the experimental police units. The field units were exclusively assigned to the experiment. They had no responsibilities for responding to calls-for-service and were instructed not to enact enforcement actions against incidents not reported by the operators (unless they observed or were flagged-down for an in-progress crime or other emergency). We anticipated that the removal of differential response deployment, via the persistent availability of the field units, would result in increased enforcement actions in response to CCTV detections. Control group cameras were monitored and policed as normal, with two operators monitoring all non-experimental cameras and reporting incidents of concern through CAD.

Specific steps were taken to minimize potential threats to validity. For one, if experimental operators were able to watch control cameras, and standard CCTV operators were able to watch experimental cameras, their respective practices could influence one another. To protect against this, the CCTV software was configured so that experimental operators (identified by their username and password) were only able to view experimental cameras during the times of the experiment. Conversely, operators normally assigned to the surveillance unit (likewise identified by their username and password) were only able to monitor non-experiment cameras during the times of the experiment. The experiment’s patrol function also raised potential threats to validity. Deploying additional units to target areas may have added to the police presence provided by regular patrol units. Furthermore, experimental units could potentially linger around specific camera locations leading to near-instantaneous response times. In recognition of these threats, officers drove unmarked police cars so as to not increase perceived levels of police presence. Also, when not en-route to a CCTV-detected incident, each unit patrolled a pre-determined grid encompassing all of the experimental cameras.Footnote 2 This protocol maintained the validity of the experiment by ensuring that it measured what it was intended to: the impact of merging proactive CCTV monitoring and directed police patrol, not simply the impact of increased police presence.

The experiment ran for an 11-week period from 7/20/11 to 10/1/11. Based on the Newark Police Department’s temporal analysis of violent crime, social disorder, and narcotics activity calls-for-service, the experiment tours were designed to run 4 days a week, Wednesday through Saturday, from 8 pm to 12 am. This reflected the days and times the targeted crime categories were at their peak occurrence during the prior summer.

Methodology

Units of analysis

Units of analysis followed the approach of the newly developed viewshed methodology (Caplan et al. 2011; McLean et al. 2013; Ratcliffe et al. 2009). Viewsheds incorporate GIS methods to digitize the actual line-of-sight of CCTV cameras, which more accurately reflects camera coverage than traditional units of analysis, such as aggregate geographies (i.e., neighborhoods or police beats) and circular buffers drawn around camera sites. Viewsheds were created in a hands-on manner, similar to the approach of Ratcliffe et al. (2009). Researchers viewed the live feeds of all CCTV cameras in Newark and digitized the viewshed of each site within a GIS. A detailed base map (with layers displaying streets, land parcels, building footprints, and aerial imagery) was incorporated to ensure that the digitized viewsheds accurately reflected the physical landscape. For example, if the viewable area to the southeast of a camera was obstructed by a building, researchers “snapped” the viewshed boundaries to that building in order to accurately reflect the extent of the camera’s view.Footnote 3 From a police patrol standpoint, it makes little sense for viewsheds lying directly adjacent to each other to be considered separate entities. For this reason, viewsheds that overlapped or were directly adjacent (less than one-city block) to each other were grouped together into singular CCTV schemes for the experiment. These modifications created 75 separate CCTV schemes from the 146 individual viewsheds.

To allow for a test of displacement and diffusion of benefits (Clarke and Weisburd 1994), catchment zones were created for each of the CCTV schemes. Following the approach of Ratcliffe et al. (2009), catchment zones began as 291-ft buffers around each viewshed, to reflect the median block size in Newark, as measured within a GIS. The buffers were adjusted to take into account local geography and road patterns. While this approach created zones of slightly varying sizes, it reflected the variability of street networks around cameras. As explained by Ratcliffe et al. (2009), “…the use of actual camera viewsheds can mean that a…buffer stretches to just short of a neighboring intersection. In circumstances like this, the addition of an extra 20 ft. is sufficient to include the street intersection…and create a buffer that is a more realistic approximation of the likely displacement area” (p. 752). With this in mind, when a buffer was half a block or less from the nearest intersection, the catchment zone was extended to the intersection. Otherwise, the catchment zone was constricted to the buffer.

Target area selection

Since only two patrol cars were available for the experiment, Newark Police officials did not want to have the units cover such large an area that intervention dosage was overly diluted. Therefore, to obtain an appropriate target area for the intervention, researchers created a standard deviation ellipse for Newark’s CCTV schemes. The ellipse represents one standard deviation around the mean center of the schemes, resulting in an area both concise in size and inclusive of a large proportion of the places of interest (Smith and Bruce 2008).Footnote 4 Thirty-eight schemes (encompassing 64 CCTV cameras) fell within the standard deviation ellipse and were selected for inclusion in the experiment.

A randomized block design was used in the creation of treatment and control groups. Randomized block designs minimize the effects of variability between treatment and control groups, allowing for the comparison of equivalent cases (Ariel and Farrington 2010; Weisburd et al. 1993). Randomized block designs have the added benefits of guaranteeing treatment exogeneity and offering transparency for policy makers, since they are generally easier to understand than more technically elaborate research designs (Nagin and Weisburd 2013).

Figure 1 provides a visual flow diagram depicting the progress of the experiment. This outline is in accordance with the Consolidated Standards of Reporting Trials (CONSORT) Statement (www.consort-statement.org).Footnote 5 Founded in the medical field, the CONSORT Statement offers recommendations on the reporting of randomized controlled trials (Schulz et al. 2010). Recently, there has been a push to incorporate the CONSORT Statement into social science research to increase transparency of randomized controlled trials (Grant et al. 2013), fueled by concerns regarding reporting transparency, similar to what was observed in the medical field (Sherman 2010: p. 412).

Fig. 1
figure 1

CONSORT RCT flow diagram of the experiment

CCTV Schemes were matched into pairs based on their level of three types of calls-for-service: violent crime, social disorder, and narcotics activity.Footnote 6 These specific crime types were selected for the evaluation in recognition of previous research illustrating CCTV effect to be greatest on automobile crime in car parks and limited in public places, specifically against such street-level activity as the aforementioned crimes. Since we were interested in whether the reconfiguration of Newark’s CCTV operation would improve its deterrence capabilities, we tested the strategy’s impact on crimes for which CCTV has previously demonstrated limited effect.

Crime levels within each scheme were determined via geoprocessing functions in the ArcGIS software suite. Calls-for-service data were measured for the period July 2010 through September 2010 to mirror the period in 2011 that the Newark Police Department agreed to conduct the experiment. Data were extracted from the Newark Police Department’s Records Management System. Calls-for-service data were used rather than Part 1 crime data due to the nature of crime problems under study. Narcotics and disorder incidents are directly reported to police through calls for service, and are not captured within Part 1 crime data. Since calls data were used for these crime types, it made sense to measure violence via the same method to ensure a standard mode of operationalization.Footnote 7

Calls-for-service were mapped as point shapefiles and then spatially joined to the CCTV schemes, which generated a count of each crime type for each scheme. CCTV schemes varied in size since they reflected the precise visibility of cameras. Therefore, it is possible that certain schemes may have exhibited higher crime counts than others simply due to their larger area. For this reason, Location Quotients (LQs) were calculated to determine the pairing of schemes. LQs measure the occurrence of crime in a target area compared to its occurrence over a larger control area (Brantingham and Brantingham 1998). LQs were calculated via the following equation: LQ = (x i /t i )/(X/T), where x i represents the number of crimes in the scheme i; t i represents the size of the scheme i; and X and T represent the numbers of crimes of type x within a larger control area and the size of the larger area, respectively.Footnote 8

Three separate LQ values were computed for each scheme, to reflect violent crime, social disorder, and narcotics activity. These three LQs were then summed to create a composite value capturing the overall level of crime activity. To reflect the Newark Police Department’s desire to emphasize violent crime, the violence LQ was weighted to be more influential than social disorder and narcotics activity in the following formula: Composite LQ = (Violence LQ * 1.5) + Narcotics LQ + Disorder LQ. The schemes were sorted and grouped into 19 different pairs based on their composite LQ values. One case from each pair was then randomly selected (via random numbers generated in Microsoft Excel) to the treatment group with the other being assigned to the control group (see Fig. 2). Paired-samples t tests (across the 19 different pairs of schemes) were conducted to compare the pre-intervention crime levels of the experimental and control schemes, from July through September 2010. For each crime category, the difference between the mean number of incidents in treatment and control areas was insignificant, demonstrating balance between the groups.Footnote 9

Fig. 2
figure 2

Treatment CCTV schemes, control CCTV schemes, and the standard deviation ellipse

Analytical design

The evaluation is driven by the research question, “What effect did the experimental strategy have on observed crime levels?” The effect of the experimental strategy was tested through a series of negative binomial regression models.Footnote 10 The models were constructed in a manner consistent with prior place-based policing experiments (i.e., Braga and Bond 2008; Braga et al. 1999; Ratcliffe et al. 2011; Taylor et al. 2011). The dependent variable in each model was the number of events occurring during the experimental period. The pre-intervention crime count and a dichotomous variable representing assignment to the treatment (1) or control (0) group were the model covariates. The difference in geographic size across the experimental areas was controlled for with a variable denoting the total length (ft.) of the street segments encompassed by the CCTV scheme (Sorg et al. 2013). To ensure that coefficient variances were robust to the presence of heteroscedasticity, robust standard errors were used (Braga and Bond 2008). To account for the matching used in the random assignment, the models incorporated the standard errors for each of the 19 pairs of CCTV schemes. It should be noted that we obtained similar results when traditional robust variances were calculated.Footnote 11 For each crime category experiencing a statistically significant reduction, a Weighted Displacement Quotient (WDQ) was calculated, with negative values suggesting displacement and positive values suggesting a diffusion of benefits (Bowers and Johnson 2003: p. 286). Finally, a Total Net Effect (TNE), which measures the overall effect of the response on crime in the target area relative to changes in the control and catchment areas (Clarke and Eck 2005: step 51; Guerette 2009: p. 43), was calculated for each model reporting a statistically significant reduction. The WDQ and TNE values were calculated in Ratcliffe and Breen’s (2008) Spatial Evaluation of Police Tactics in Context (SEPTIC) tool.

Crime prevention effects were measured for three distinct time periods. Different time periods were incorporated to provide multiple measures of experiment effect and to ensure that the observed results were not merely the byproduct of a single temporal parameter. The first time period was the experiment tours of duty (Wednesday through Saturday, 8 pm to midnight from 7/20/11 to 10/1/11). The second time period was the entire days (e.g., 24-h period) the experimental tours took place, in recognition of previous studies finding that temporally limited activity may produce deterrence effects lasting the entire day (Telep et al. 2012). Finally, crime was measured for the entire 11-week experimental period (7/20/11 to 10/1/11). Since we expected that the experiment would result in increased enforcement in target areas, we recognized the possibility that deterrence effects generated by enforcement may have lasted several days, as observed in prior research (Wyant et al. 2012). To account for seasonal cycles in crime data (Hipp et al. 2004; McDowall et al. 2012), each time period was compared to the same time period from the previous year (i.e., 7/8/11, the third Friday in July 2011, was compared with 7/9/10, the third Friday in July 2010), following the approach of recent place-based policing experiments (e.g., Telep et al. 2012).

While the multiple time periods allowed for repeated exploration of the research question, it increased the possibility of committing a Type I error by subjecting each crime type to multiple significance tests, commonly referred to as the alpha inflation issue. The traditional procedure for controlling alpha inflation is the Bonferroni method, where each obtained p value is multiplied by the number of tests performed and then compared to the target p value (Belkap 1992). However, the Bonferroni method, as well as modified Bonferroni procedures like the Holm–Bonferroni method (Holm 1979), have the serious problem of increasing the chance for committing a Type II error by reducing statistical power (Olejnik et al. 1997; Sankoh et al. 1997). This issue is particularly troublesome in the current study given the low statistical power of the analysis (discussed below). In addition, study-wide Bonferroni correction methods exclusively address the hypothesis that the treatment and control groups are identical across all dependent variables, and ignore the importance of understanding differences across specific variables (Perneger 1998). As argued by Perneger (1998), a clinical equivalent of this scenario is “the case of a doctor who orders 20 different laboratory tests for a patient, only to be told that some are abnormal, without further detail” (p. 1237). This has led to significant backlash against the application of Bonferroni corrections to statistical findings, particularly in the medical field (Perneger 1998, 1999; Feise 2002).

These aforementioned issues informed our alpha inflation correction. Rather than using a study-wide correction, we incorporated the Dubey/Armitage-Parmer approach (Sankoh et al 1997: p. 2534–2535) of accounting for the correlations amongst the dependent variables in the alpha corrections. As illustrated by Garcia (2004), when dependent variables are significantly correlated “the approach used should account for variable dependence while correcting for alpha inflation” to maintain statistical power by allowing for the adjusted alpha level to be closer to the desired alpha level when the dependent variables are strongly correlated (p. 659). Since we were interested in detecting whether the experiment had differential effect across crime types, alpha corrections were conducted for the three tests conducted for each crime category (violent crime, social disorder, and narcotics offenses) rather than the nine tests conducted across all categories. As will be discussed later, this enabled us to identify specific crime types that were more impacted by the experiment than others. We used the web-based statistical program SISA to estimate the adjusted p value for our statistical tests, accounting for our desired alpha, number of tests, average correlation,Footnote 12 and degrees of freedom (Uitenbroek 1997).

Results

Process evaluation

Our analysis begins with a brief process evaluation of the experiment. While evaluations of police interventions often only include tests of outcome measures, process measures allow researchers to contextualize program effects and more readily extract policy implications from the findings (Sherman and Eck 2002). To review, we expected that the mechanism through which the experimental strategy would reduce crime was an increase in certainty of punishment within target areas. This increased punishment certainty was expected to be generated from increased CCTV detections and the subsequent enforcement actions carried out by the experimental patrol officers. Therefore, we measured two process measures: reported detections of the experimental CCTV operators and the enforcement actions of the experimental patrol officers.

In total, the experimental operators reported 74 incidents of concern to the patrol officers. Most of the activity was related to the drug trade, with 55 of the 74 (74.3 %) of the reported detections classified as narcotics-related.Footnote 13 Sixty-four (56.5 %) of the detections resulted in an enforcement action. Thirty-nine of the 64 enforcement actions (60.9 %) were arrests. The remaining 25 (39.0 %) were record checks or field interrogations.Footnote 14 This represents a drastic increase in enforcement when compared with the standard CCTV operation. Only four detections and four enforcement actions were conducted within the treatment schemes during the pre-intervention period (7/21/10 to 10/2/10). Furthermore, during the 52 weeks preceding the experiment, the entire 146-camera system averaged only 1.5 detections and 0.71 enforcement actions per week. We concluded that the experiment was implemented as intended, with an increase in CCTV activity, and perceived certainty of punishment, being achieved.Footnote 15

Outcome evaluation

Statistical power

Before presenting the results of the outcome evaluation, we will discuss the statistical power of the analysis. The small sample size coupled with the concise study period caused the experiment to be underpowered. The experiment included only 19 treatment areas and 19 controls areas and ran for an 11-week period. Given a sample of 19 treatment locations, the experiment had about a 10 % chance of detecting a small effect of 0.2, about a 30 % chance of detecting a medium effect of 0.5, and about a 70 % chance of detecting a large effect size of 0.8 (Lipsey 1990), as defined by Cohen (1988).Footnote 16 While prior place-based policing experiments have incorporated similar sample sizes they have typically occurred for longer periods of time than the current experiment. For example, Braga (1997), Braga and Bond (2008), and Weisburd and Green (1995) incorporated only 12, 17, and 28 target areas, respectively. However, interventions occurred for approximately 1 year in the Braga (1997) and Braga and Bond (2008) studies and 15 months in the case of Weisburd and Green (1995). This suggests the small sample in the current experiment may have had a more negative effect on power than in previous experiments.Footnote 17

Post hoc analysis of our statistical tests also suggested that our design was underpowered. This post hoc analysis, conducted in the G* Power software package (Faul et al. 2009), revealed that the statistical tests achieved statistical power ranging from 0.15 to 0.53, with none meeting the standard power level of 0.80 (Britt and Weisburd 2010). To increase statistical power, we set the alpha level for statistical significance at 0.10, rather than 0.05, in order to minimize the chance of making a Type II error of falsely failing to reject the null hypothesis (Lipsey 1990). Prior underpowered experiments have similarly incorporated alpha levels of 0.10 in order to protect against Type II errors (see Weisburd and Green 1995).Footnote 18

Main effects

Table 1 displays the pre and during intervention crime counts for the treatment and control schemes across the three time periods. Crime counts reduced within the treatment areas in seven of a possible nine instances. In comparison, control areas experienced a reduction in crime counts in only two instances. The statistical significance of these changes was tested via negative binomial regression models.

Table 1 Raw crime counts

Table 2 displays the results of the statistical models over the three time periods. The treatment variable was statistically significant in four of nine instances, each suggestive of a crime decrease within treatment areas. During the “tours” period, assignment to the treatment group was associated with a violent crime reduction of 48 % (IRR = 0.52) and a social disorder reduction of 49 % (IRR = 0.51). During the “days” period, violent crime reduced 40 % (IRR = 0.60) in the treatment areas compared to the control areas. During the 11-week experiment period, social disorder (IRR = 0.59) achieved statistically significant 41 % reduction. All of these results maintained their statistical significance following the application of the SISA alpha inflation adjustment. Assignment to the treatment group had no effect on narcotics activity in any model.

Table 2 Negative binomial regression results, crime incidents (main effects: 7/20/11–10/1/11)

Table 3 displays the results of the displacement analysis. Across the three time intervals, a weighted displacement quotient was calculated for each crime category that experienced a reduction. In each instance, Phi statistics suggest that the WDQ calculations were statistically significant (Ratcliffe and Breen 2008). For the “tours” period, violent crime and social disorder experienced diffusion of benefits and displacement effects, respectively. The WDQ value for violent crime (0.46) suggests a diffusion of benefits effect less than the direct effects in the treatment area. For social disorder, the WDQ of −1.09 demonstrates that the catchment zone experienced a displacement effect greater than the achieved reduction in the treatment area. For the “days” period, violent crime’s WDQ suggests no real displacement or diffusion effects (−0.06). For the 11-week period, social disorder experienced a diffusion of benefits that was greater than the reduction in the target area (1.34).

Table 3 Weighted displacement quotients (main effects: 7/20/11–10/1/11)

Residual effects

Additional analyses tested the effect of the experiment on crime counts following the conclusion of the intervention, a phenomenon Sherman (1990) referred to as “residual deterrence.” To test the residual effect of the current experiment, three additional negative binomial regression models were conducted. The models mirrored the time periods of the main analysis: “residual tours” (Wednesday through Saturday, 8 pm to midnight, from 10/5/11 to 12/17/11); “residual days” (Wednesday through Saturday, from 10/5/11 to 12/17/11); and “residual 11-weeks” (10/5/11–12/17/11). As with the main analysis, each time period was compared to the same time period from the previous year.

Table 4 displays the results of the residual models. Narcotics Activity during the “residual days” period was the only instance where assignment to the treatment group was associated with a statistically significant reduction (IRR = 0.51; p = 0.07). This result maintained statistical significance following the application of the SISA alpha inflation adjustment. However, the WDQ calculated for this finding (−1.24) suggests a displacement effect larger than the reduction experienced in the target area.Footnote 19

Table 4 Negative binomial regression results, crime incidents (residual effects: 10/5/11–12/17/11)

Total net effects

Total Net Effect (TNE) values suggest a crime reduction in a total of three instances. For violent crime, the experiment produced a reduction of 58 incidents in the “tours” period and a reduction of 47 incidents in the “days” period. Social disorder experienced a reduction of 189 incidents in the “11-week” period. The experiment was associated with an increase of social disorder during the “tours” period and narcotics activity during the “days” period. However, in each instance the increase was only three incidents, a very modest figure in comparison to the aforementioned decreases. Furthermore, since social disorder reduced by 189 incidents during the “11-week” period, with a diffusion of benefits greater than the target area reduction, the “tour” increase of three incidents is arguably negligible. Therefore, the TNE statistics suggest that the experiment produced sizable crime decreases with minimal negative effects (Table 5).

Table 5 Total net effects (across both main and residual periods)

Discussion of results

Results suggest that the experimental strategy had a positive effect on Newark’s CCTV operation, producing tangible and meaningful crime reductions of violent crime and social disorder. Examination of the IRR and TNE values suggests that these crime reductions were sizable in many instances. While potential backfire effects were observed in two instances, they were very modest in comparison to the crime decreases, and, in the case of social disorder, were negated by large decreases during other time periods. Furthermore, when considered in context of the overall findings, the social disorder “tours” finding may represent an instance of “benign displacement,” which Barr and Pease (1990) define as a redistribution of crime patterns from a more serious state to a less serious state. As an example of benign displacement, Barr and Pease (1990) discussed a debate around gun control. They argued that even in the unlikely event that a reduction in gun assaults was completely negated by displacement to knife assaults the observed displacement would be benign since the more lethal weapon (gun) was replaced with a less lethal weapon (knife). In this sense, officials may consider the prevention of serious violent crime to be worth a slight increase in relatively minor incidents of social disorder.

Somewhat curious findings were observed in respect to narcotics offenses. Narcotics incidents did not reduce in a single instance during the experiment, despite the fact that officers spent most of their time addressing narcotics-related incidents. The illicit drug trade has long been known to generate a number of ancillary public safety concerns, including violence and disorder (Harocopos and Hough 2005). It may be that police response to narcotics incidents prevented ancillary violence or disorder from taking place without substantially disrupting drug markets themselves. With that said, narcotics offenses experienced a significant decrease during the “residual days” period. However, this residual deterrence in the treatment areas was met with an increase of three narcotics activity incidents in the catchment zone. These findings beg the question of why narcotics offenders seemingly relocated their operations after the conclusion of the experiment, but not during the actual intervention. This may be at least partially due to the resiliency of drug markets, which are recognized as being largely immune to street-level police enforcement (Gajewski 1994; Kennedy and Wong 2009; Weisburd et al. 2006). As argued by Kennedy (2006), “[a] street drug dealer may have been arrested a number of times. But each day, when he considers whether to go to work his corner, the chance that he will be arrested today will be…small” (p. 165: emphasis in original text). It may have been that, while enforcement deterred violent and disorderly offenders from the outset of the experiment, the entire experiment’s worth of enforcement may have been necessary for narcotics offenders to collectively recognize the heightened risk of apprehension in the treatment areas. The spatial displacement of narcotics offenses may be explained by its difference from other crime types. Offenders motivated by monetary profit (i.e., drug offenders) are more likely to displace their activities to nearby areas than other offenders (Guerette et al. 2005). While Weisburd et al. (2006), for example, found that drug dealers did not relocate their operation in response to a place-based narcotics initiative, drug offenders in the current study may have found it easier to relocate. Since CCTV cameras have a limited view of a block or so, “relocating” a drug market may only entail traveling a handful of feet (i.e., immediately around the corner or across the street) to an area out of camera view. Drug offenders interviewed by Gill and Loveday (2003) reported that they were easily able to escape detection by conducting business in camera blind spots, or just beyond the visual reach of CCTV. This contrasts with offenders not driven by money, who would have to travel greater distances from CCTV and who would receive little benefit by doing so, when they are blocked from committing their intended crime at their preferred location. As Piza and O’Hara (2014) argued, “It is unlikely that a slighted bar patron, for example, would respond to a thwarted opportunity to attack someone in front of the establishment by traveling outside of the target area and attacking a person not involved in the quarrel” (p. 711).

Policy implications and conclusions

In our view, the results of this study make the experimental strategy a viable option for jurisdictions with existing CCTV infrastructure, specifically those burdened with high levels of street crime. While the current study involved assignment of additional personnel to the CCTV operation to conduct the experimental strategy, alternate options may exist for police to lower camera-to-operator ratios and avoid the differential response deployment of officers in response to CCTV detections. Research suggests that CCTV installation should be preceded by an in-depth analysis of the spatial distribution and nature of crime patterns (Ratcliffe 2006; Welsh and Farrington 2002). Such analysis could also be incorporated into existing CCTV operations to determine whether a higher priority for active monitoring should be given to certain cameras over others. For instance, a spatial analysis of crime could identify specific camera sites experiencing higher levels of crime than others. In such a case, these cameras could be actively monitored while the others are only viewed in a post-hoc manner after a crime has been reported. Furthermore, the concentration of crime may not be temporally consistent, but may fluctuate across times of the day or days of the week. Operator attention can be further focused by having them actively monitor only those cameras most at-risk of experiencing crime during their particular tours-of-duty. The Chicago Police Department utilizes such a strategy in which a dozen or so CCTV locations are prioritized for active monitoring each day. A list of such locations is disseminated as “missions” to the Crime Prevention Information Center (CPIC) and the Office of Emergency Management and Communications (OEMC), who are responsible for the proactive monitoring of the priority cameras (La Vigne et al. 2011: p. 56). As noted by Piza et al. (2012), such a strategy is consistent with hot spots policing, which has consistently demonstrated the concentration of resources amongst a few problematic targets to be more effective than the even distribution of resources across space (Braga et al. 2012; Braga and Weisburd 2010; Weisburd 2008).

Regarding police response, CCTV operations can make more use of proactive police units (i.e., undercover narcotics units or foot patrol officers) rather than standard patrol units. Since such units typically are not responsible for responding to calls for service they can immediately address incidents detected by CCTV operators. This would drastically reduce the large police response times inherent in the differential response policy of police dispatch. Such tactics have been successfully incorporated by police. In Baltimore, for example, CCTV operators routinely alerted officers from the narcotics and bicycle units when they observed incidents on cameras within specific target areas (La Vigne et al. 2011).

Despite these policy implications, the current study, like most research, suffers from certain limitations that warrant mentioning. For one, the outcome analysis suffered from low statistical power. To minimize the chance of a Type II error, a 90 % confidence interval was used rather than the more traditional 95 %, an approach incorporated in previous underpowered experiments (Weisburd and Green 1995). However, it should be noted that significance was p < 0.05 (prior to alpha inflation correction) in each of the reductions observed across the “main” analyses. This may have been due to the randomized block design, which has been demonstrated to maintain statistical power even in the case of small sample sizes (Weisburd and Gill 2014). We advocate for the use of larger samples and longer study periods than what was incorporated in the current study, when feasible.

Regarding the increase in CCTV detections and subsequent enforcement, we largely attributed the increased activity to the lowering of the camera-to-operator ratio and elimination of differential response deployment, in recognition of prior research (Piza et al. 2012, 2014b). However, since the experimental operators were new to the operation, they may have approached CCTV monitoring with a higher level of vigilance than the standard operators, who had all worked in the surveillance unit for a considerable amount of time. Prior research has found that CCTV operators often experience decreased vigilance when they have spent considerable time working in surveillance units (Norris and McCahill 2006). Future research should account for such factors by using the standard CCTV operators in the experiment, or by shifting the experimental operators between the treatment and control groups.

In all, and given these qualifications, this experiment produced meaningful results with relatively minimal personnel resources. Only two patrol cars and one CCTV operator were needed for this 4-h per day, 4-days per week, 11-week intervention to achieve sizable reductions in street crime. More generally, the findings add support to the hypothesis that the integration of CCTV with proactive, focused police activity generates a crime control benefit greater than what research suggests is achievable via stand-alone camera deployment. We recommend that future research continues to test and expand upon this proposition.