Journal of Substance Abuse Treatment
Volume 32, Issue 3 , Pages 225-238 , April 2007

The National Criminal Justice Treatment Practices survey: Multilevel survey methods and procedures

  • Faye S. Taxman, Ph.D.

      Affiliations

    • Wilder School of Government and Public Affairs, Virginia Commonwealth University, Richmond, VA 23220, USA
    • Corresponding Author InformationCorresponding author. Wilder School of Government and Public Affairs, Virginia Commonwealth University, Ste 501, 923 West Franklin Street, Richmond, VA 23220, USA. Tel.: +1 804 828 8012; fax: +1 804 827 1843.
    • ,
  • Douglas W. Young, M.S.

      Affiliations

    • Institute for Governmental Service and Research, University of Maryland College Park, College Park, MD 20740, USA
    • ,
  • Brian Wiersema, A.B.

      Affiliations

    • Department of Criminology and Criminal Justice, University of Maryland College Park, College Park, MD 20740, USA
    • ,
  • Anne Rhodes, M.S.

      Affiliations

    • Wilder School of Government and Public Affairs, Virginia Commonwealth University, Richmond, VA 23220, USA
    • ,
  • Suzanne Mitchell, M.F.A.

      Affiliations

    • Institute for Governmental Service and Research, University of Maryland College Park, College Park, MD 20740, USA

Received 26 September 2006 ,Revised 24 December 2006 ,Accepted 8 January 2007.

References 

  1. Alderfer CP, Simon AF. Nonresponse rates to organic questionnaire items as evidence of parallel processes during organizational diagnosis. Journal of Applied Behavioral Science. 2002;38:416–435
  2. American Correctional Association (ACA) . 2003 directory of adult and juvenile correctional departments, institutions, agencies, and probation and parole authorities. Laurel, MD: American Correctional Association; 2003;
  3. Andrews DA, Bonta J. The psychology of criminal conduct. Cincinnati, OH: Anderson; 1996;
  4. Anglin D, Maugh T. Ensuring success in interventions with drug using offenders. Annals of the American Academy of Political and Social Science. 1992;521:66–90
  5. Baldauf A, Reisinger H, Moncrief WC. Examining motivations to refuse in industrial mail surveys. Journal of the Market Research Society. 1999;41:345–353
  6. Baruch Y. Response rate in academic studies: A comparative analysis. Human Relations. 1999;52:421–438
  7. Belenko S. The challenges of conducting research in drug treatment court settings. Substance Use and Misuse. 2002;37:1635–1665
  8. Belenko S, Peugh J. Estimating drug treatment needs among state prison inmates. Drug and Alcohol Dependence. 2005;3:269–281
  9. Cameron KS, Quinn RE. Diagnosing and changing organizational culture. Reading: Addison-Wesley; 1999;
  10. Chao M, Sullivan K, Harwood R, Schildhaus S, Zhand Z, Imhof L. Survey of substance abuse treatment providers as information customers. Washington, DC: Center for Substance Abuse Treatment, U.S. Department of Health and Human Services Substance Abuse and Mental Health Services Administration; 2000;
  11. Cycyota CS, Harrison DA. Enhancing survey response rates at the executive level: Are employee- or consumer-level techniques effective?. Journal of Management. 2002;28:151–176
  12. Denison DR, Mishra AK. Toward a theory of organizational culture and effectiveness. Organization Science. 1995;6:204–217
  13. Dillman DA. In: Mail and Internet surveys: The tailored design method. revised ed.. New York: Wiley; 2000;
  14. Drake RE, Goldman HH, Leff HS, Lehman AF, Dixon L, Meuser KT, et al. Implementing evidence-based practices in routine mental health service settings. Psychiatric Services. 2001;52:179–182
  15. Elliot D. Weighting for non-response: A survey researcher's guide. London: Social Survey Division, Office of Population Censuses and Surveys; 1991;
  16. Farabee D, Prendergast ML, Cartier J, Wexler W, Knight , Anglin K. Barriers to implementing effective correctional treatment programs. Prison Journal. 1999;79:150–162
  17. Farrington DP, Welsh BC. Surveillance for crime prevention in public space: Results and policy choices in Britain and America. Criminology and Public Policy. 2004;3:497–525
  18. Fletcher BW, Tims FM, Brown BS. Drug Abuse Treatment Outcome Study (DATOS): Treatment evaluation research in the United States. Psychology of Addictive Behaviors. 1997;11:216–229
  19. Flynn PM, Craddock SG, Hubbard RL, Anderson J, Etheridge RM. Methodological overview and research design for DATOS. Psychology of Addictive Behaviors. 1997;11:230–243
  20. Georgopoulos BS, Mann FC. The community general hospital. New York: Macmillan; 1962;
  21. Glaze LE, Palla S. Probation and parole in the United States, 2004 (NCJ-210676). Washington, DC: Bureau of Justice Statistics; 2005;
  22. Gottfredson DC, Gottfredson GD. Quality of school-based prevention programs: Results from a national study. Journal of Research in Crime and Delinquency. 2002;39:3–35
  23. Gottfredson DC, Najaka SS, Wilson DB. School-based prevention of problem behaviors: A meta-analysis. Journal of Quantitative Criminology. 2001;17:247–273
  24. Grella CE. The drug abuse treatment outcomes studies: Outcomes with adolescent substance abusers. In:  Liddle HA,  Rowe CL editor. Adolescent substance abuse: Research and clinical advances. Cambridge, UK: Cambridge University Press; 2006;p. 148–173
  25. Groves RM. Survey errors and survey costs. New York: Wiley; 1989;
  26. Groves RM, Fowler FJ, Couper MP, Lepkowski JM, Singer E, Tourangeau R. Survey methodology. Hoboken, NJ: Wiley; 2004;
  27. Hager MA, Wilson S, Pollak TH, Rooney PM. Response rates for mail surveys of nonprofit organizations: A review and empirical test. Nonprofit and Voluntary Sector Quarterly. 2003;32:252–267
  28. Harrison PM, Beck AJ. Prisoners in 2004. (publication no. NCJ-210677) Washington, DC: Bureau of Justice Statistics; 2005;
  29. Harrison PM, Beck AJ. Prisoners in 2005. (publication no. NCJ-215092) Washington, DC: Bureau of Justice Statistics; 2006;
  30. Hiller ML, Knight K, Broome KM, Simpson DD. Legal pressure and treatment retention in a national sample of long-term residential programs. Criminal Justice and Behavior. 1998;25:463–481
  31. Hubbard R, Marsden M, Rachal J, Harwood H, Cavanaugh E, Ginzburg H. Drug abuse treatment: A national study of effectiveness. North Carolina: University of North Carolina Press; 1989;
  32. Inciardi J. Prison-based therapeutic communities: An effective modality for treating drug-involved offenders. In:  Haas KC,  Alpert GP editor. The dilemmas of punishment. Prospect Heights, IL: Waveland; 1999;p. 403–417
  33. Institute of Medicine . Guidelines for clinical practice: From development to use. Washington, DC: National Academy of Sciences; 1992;
  34. Kish L. Survey sampling. New York: Wiley; 1965;
  35. Knight K, Simpson DD, Hiller ML. Prison-based substance abuse treatment, residential aftercare and recidivism. Addiction. 1999;94:321–336
  36. Landenberger N, Lipsey M. The positive effects of cognitive–behavioral programs for offenders: A meta analysis of factors associated with effective treatment. Journal of Experimental Criminology. 2005;1:451–476
  37. Lehman WEK, Greener JM, Simpson DD. Assessing organizational readiness for change. Journal of Substance Abuse Treatment. 2002;22:197–210
  38. Lipsey MW, Landenberger NA. Cognitive–behavioral interventions. In:  Welsh BC,  Farrington DP editor. Preventing crime: What works for children, offender, victims, and places. Great Britain: Springer; 2006;
  39. Little RJA, Rubin DB. Statistical analysis with missing data. New York: Wiley; 1987;
  40. Lowenkamp CT, Latessa EJ, Holsinger AM. The risk principle in action: What have we learned from 13,676 offenders and 97 correctional programs?. Crime and Delinquency. 2006;52:77–93
  41. Lurigio AJ. Drug treatment availability and effectiveness: Studies of the general and criminal justice populations. Criminal Justice and Behavior. 2000;27:495–528
  42. MacKenzie DL. Evidence based corrections: Identifying what works. Crime and Delinquency. 2000;46:457–461
  43. Marlowe DB, DeMatteo DS, Festinger DS. A sober assessment of drug courts. Federal Sentencing Reporter. 2003;16:53–157
  44. Marlowe DB, Festinger DS, Lee PA, Dugosh KL, Benasutti KM. Matching judicial supervision to clients' risk status in drug court. Crime and Delinquency. 2006;52:52–76
  45. Martin SS, Butzin CA, Saum CA, Inciardi J. Three-year outcomes of therapeutic community treatment for drug involved offenders in Delaware: From prison to work release to aftercare. Prison Journal. 1999;79:294–320
  46. Melnick G, DeLeon G. Clarifying the nature of therapeutic community treatment. The Survey of Essential Elements Questionnaire (SEEQ). Journal of Substance Abuse Treatment. 1999;16:307–313
  47. Melnick G, Hawke J, Wexler HK. Client perceptions of prison-based therapeutic community drug treatment programs. Prison Journal (Special Edition). 2004;84:121–138
  48. National Institute on Drug Abuse (NIDA) . Principles of drug addiction treatment: A research based guide. (NIH publication no. 99-4180) Rockville, MD: National Institutes of Health; 1999;
  49. National Institute on Drug Abuse (NIDA) . Principles of drug abuse treatment for criminal justice populations: A research based guide. (NIH publication no. 06-5316) Rockville, MD: National Institutes of Health; 2006;
  50. National Survey on Drug Use and Health . Table 7.98B Illicit drug or alcohol dependence or abuse in the past year among person aged 18 or older, by probation states and demographic characteristics: Percentages, 2005 and 2004. http://www.oas.samhsa.gov/nsdah/2k4nsdah/2K4tabs/sec7peTab66to129.htm#tab7.97bWashington, DC: Office of Applied Studies; 2006;
  51. Newell CE, Rosenfeld P, Harris RN, Hindelang RL. Reasons for nonresponse on U.S. Navy surveys: A closer look. Military Psychology. 2004;16:265–276
  52. Office of Applied Statistics (2003). National Survey of Substance Abuse Treatment Services (N-SSATS). www.oas.samsha.gov/dasis.
  53. Orthner DK, Cook PG, Sabah Y, Rosenfeld J. Measuring organizational learning in human services: Development and validation of the program style assessment instrument. In: Invited presentation to the National Institute on Drug Abuse, Bethesda, MD. 2004;
  54. Parker SK, Axtell CM. Seeing another viewpoint: Antecedents and outcomes of employee perspective taking. Academy of Management Journal. 2001;44:1085–1100
  55. Pearson FS, Lipton DS. A meta-analytic review of the effectiveness of corrections-based treatments for drug abuse. Prison Journal. 1999;79:384–409
  56. Peters RH, May RL, Kearns WD. Drug treatment in jails: Results of a nationwide survey. Journal of Criminal Justice. 1992;20:283–295
  57. Petroni R, Sigman R, Willimack D, Cohen S, Tucker C. Response rates and nonresponse in establishment surveys—BLS and Census Bureau. In: Paper presented to the Federal Economic Statistics Advisory Committee, Washington, DC. 2004, December;
  58. Podsakoff, MacKenzie, & Fetter. (1990).
  59. Potter F. Survey of procedures to control extreme sampling weights. In: Proceedings of the Section on Survey Research Methods, American Statistical Association, Alexandria, VA. 1988;p. 453–458
  60. Potter F. A study of procedures to identify and trim extreme sampling weights. In: Proceedings of the Section on Survey Research Methods, American Statistical Association, Alexandria, VA. 1990;p. 225–230
  61. Roman PM, Johnson JA. Adoption and implementation of new technologies in substance abuse treatment. Journal of Substance Abuse Treatment. 2002;22:211–219
  62. SAS Institute . SAS/STAT Software version 8 of the SAS System for Windows. Cary, NC: SAS Institute; 2000;
  63. Schneider B, White SS, Paul MC. Linking service climate and customer service perceptions of service quality: Test of a causal model. Journal of Applied Psychology. 1998;83:150–163
  64. Scott SG, Bruce RA. Determinants of innovative behavior: A path model of individual innovation in the workplace. Academy of Management Journal. 1994;37:580–607
  65. Sells SB. The DARP research program and data system. American Journal of Drug and Alcohol Abuse. 1975;2:1–14
  66. Sherman LW, Gottfredson D, MacKenzie DL, Eck J, Reuter P, Bushway S. Preventing crime: What works, what doesn't, what's promising. Washington, DC: Office of Justice Programs; 1997;
  67. Simpson DD. A conceptual framework for drug treatment process and outcomes. Journal of Substance Abuse Treatment. 2004;27:99–121
  68. Simpson DD, Wexler HK, Inciardi JA. Drug treatment outcomes for correctional settings. Prison Journal. 1999;79:291–293
  69. Smith J. Nonresponse bias in organizational surveys: Evidence from a survey of groups and organizations working for peace. Nonprofit and Voluntary Sector Quarterly. 1997;26:359–368
  70. Snyder HN, Sickmund M. Juvenile offenders and victims: 2006 national report. Washington, DC: Office of Justice Programs and Office of Juvenile Justice and Delinquency Prevention; 2006;
  71. Spitzmüller C, Glenn DM, Barr CD, Rogelberg SG, Daniel P. “If you treat me right, I reciprocate”: Examining the role of exchange in organizational survey response. Journal of Organizational Behavior. 2006;27:19–35
  72. Stephan JJ, Karberg JC. Census of state and federal correctional facilities, 2000. Washington, DC: Bureau of Justice Statistics; 2003;
  73. Substance Abuse and Mental Health Services Administration . Substance abuse treatment in adult and juvenile correctional facilities, Rockville, MD. www.drugabusestatistics.samhsa.gov/UFDS/CorrectionalFacilities97/4alla.htmS2006;
  74. Taxman FS. Reducing recidivism through a seamless system of care: Components of effective treatment, supervision, and transition services in the community. Washington, DC: Office of National Drug Control Policy; 1998;Available: http://www.whitehousedrugpolicy.gov/treat/consensus/consensus.html
  75. Taxman FS. Twelve Steps to improved offender outcomes: Developing responsive systems of care for substance-abusing offenders. Corrections Today. 1998;60:114–117
  76. Taxman FS. Supervision—Exploring the dimensions of effectiveness. Federal Probation. 2002;66:14–27
  77. Taxman FS, Bouffard JA. The importance of systems issues in improving offender outcomes: Critical elements of treatment integrity. Justice Research and Policy. 2000;2:9–30
  78. Taxman FS, Bouffard JA. Treatment inside the drug treatment court: The who, what, where, and how of treatment services. Substance Use and Misuse. 2002;37:1665–1689
  79. Taxman FS, Bouffard JA. Looking inside the “black box” of drug court treatment services using direct observations. Journal of Drug Issues. 2004;43:195–218
  80. Taxman FS, Marlowe DB. Risk, needs, responsivity: In action or inaction?. Crime and Delinquency. 2006;52:3–6
  81. Taxman FS, Thanner M. Risk, need, and responsivity: It all depends. Crime and Delinquency. 2006;52:28–52
  82. Taxman FS, Young DW. Development of system integration measures (CJ-DATS Coordinating Center working paper). 2004;College Park, MD
  83. Taylor B, Fitzgerald N, Hunt D, Reardon W, Brownstein H. ADAM preliminary 2000 findings on drug use and drug market: Adult male arrestees. Washington, DC: National Institute of Justice; 2001;
  84. Tesluk PE, Farr JL, Mathieu JE, Vance RJ. Generalization of employee involvement training to the job setting: Individual and situational effects. Personnel Psychology. 1995;48:607–632
  85. Thanner M, Taxman FS. Responsivity: The value of providing intensive services to high-risk offenders. Journal of Substance Abuse Treatment. 2003;24:137–147
  86. Tomaskovic-Devey D, Leiter J, Thompson S. Organizational survey nonresponse. Administrative Science Quarterly. 1994;39:439–457
  87. Wenzel S, Longshore D, Turner S, Ridgley S. Drug courts: A bridge between criminal justice and health services. Journal of Criminal Justice. 2001;29:241–253
  88. Wexler HK, Melnick G. Three-year re-incarceration outcomes for amity in-prison therapeutic community and aftercare in…. Prison Journal. 1999;79:321–336
  89. Wiersema B, Taxman FS. Effects of organizational culture and climate on administrator responses to surveys of correctional agencies (CJ-DATS Coordinating Center working paper). 2006;College Park, MD
  90. Young D, Taxman FS. Instrument development on treatment practices and rehabilitation philosophy (CJ-DATS Coordinating Center working paper). 2004;College Park, MD

 The contents are solely the responsibility of the authors and do not necessarily represent the official views of the National Institutes of Health/National Institute on Drug Abuse or of other participants in Criminal Justice Drug Abuse Treatment Studies.

PII: S0740-5472(07)00016-5

doi: 10.1016/j.jsat.2007.01.002

Journal of Substance Abuse Treatment
Volume 32, Issue 3 , Pages 225-238 , April 2007

Article Tools