Longitudinal research designs involve data collection at multiple time points to measure change over time. Therefore, identification of the same respondents is essential at each time point so that data from the same respondents can be matched for comparison over time. Subject-generated identification codes permit an anonymous means to track respondents over multiple data collection points. This…
The Collegiate Learning Assessment (CLA) program measures value added in colleges and universities, by testing the ability of freshmen and seniors to think logically and write clearly. The program is popular enough that it has attracted critics. In this paper, we outline the methods used by the CLA to determine value added. We summarize the criticisms, which revolve around the question of which…
We conduct an evaluation of MedShare, a program designed to enhance access to prescription drugs for indigent patients in the Greater Cincinnati area. The program expands access to drugs by providing subsidies to reduce the costs paid by patients for their prescriptions. The assumption is that by expanding access to prescription drugs, participant health outcomes as measured by quality of life …
The chronic and relapsing nature of substance abuse points to the need for continuing care after a primary phase of treatment. This article reviews the economic studies of continuing care, discusses research gaps, highlights some of the challenges of conducting rigorous economic evaluations of continuing care, and offers research guidelines and recommendations for future economic studies in thi…
Several school performance indices were evaluated using achievement data from multiple longitudinally matched middle school student cohorts in a large district in the southwestern United States. Measures designed to index the within-cohort achievement status and growth of students as well as the status and growth-based changes that occur over years between different student cohorts were studied…
This study translated and validated the Substance Use Risk Profile Scale (SURPS) among 13 to 18 year old Sri Lankan adolescents attending school. A standard systematic translation procedure was followed to translate the original SURPS into Sinhala language. A Delphi process was conducted to determine judgmental validity of Sinhala SURPS. Confirmatory factor analysis was performed to test the tr…
Poisson and negative binomial regression methods are used to analyze the monthly time series data to determine the effects of introducing an integrated security management system including closed-circuit television (CCTV), door alarm monitoring, proximity card access, and emergency call boxes to a large privately-owned complex of apartment buildings in New York City. Crime rates in a control ap…
Although most academic disciplines evolve at a measured pace, the emerging field of homeland security must, for reasons of safety and security, evolve rapidly. The Department of Homeland Security sponsored the establishment of a graduate educational program for key officials holding homeland security roles. Because homeland security is a nascent field, the establishment of a program curriculum …
The objective of this study is to evaluate the impact of a pilot study that promoted productive and capacity-building activities among deprived rural women of Mexico. The evaluation design is observational; 1,278 women are interviewed, and the comparison group is estimated by propensity score matching. The results show a positive impact on the carrying out of agricultural activities, in the aut…
The study of "scientific excellence" is taking on increasing importance in the development of research policies in many nations. However, scientific excellence is difficult to define because of its multidimensional and highly complex character. This work contributes to the state of the art by exploring an effective, simple, and inexpensive bibliometric methodology that further identifies "excel…
We reviewed 39 national government- and nongovernment-sponsored data sets related to substance addiction policy. These data sets describe patients with substance use disorders (SUDs), treatment providers and the services they offer, and/or expenditures on treatment. Findings indicate the availability of reliable data on the prevalence of SUD and the characteristics of specialty treatment facili…
This study is an exploratory examination of the projected sustainability of more than 100 projects funded by the Australian government. Using data collected by the body that evaluated the projects and data from a government database, it examines the predictors of various forms of sustainability. Findings show that some two thirds of the project leaders who expected their programs to continue af…
In a randomized test of mixed-mode data collection strategies, 386 participants in the Raising Healthy Children (RHC) Project were either (a) asked to complete a survey via the Internet and later offered the opportunity to complete the survey in person or (b) first offered an in-person survey, with the Web follow-up. The Web-first condition resulted in cost savings although the overall completi…
Recent meta-analyses of drug-court studies recognized the poor methodological quality of the evaluations, with only a few being randomized. This article critiques the design of the randomized studies from a statistical perspective. Learning points are identified for future drug-court studies and are applicable to evaluations both of other specialist courts and of court-based interventions more …
Growing interest in the institutionalization of evaluation in the public administration raises the question as to which institutional arrangement offers optimal conditions for the utilization of evaluations. Institutional arrangement denotes the formal organization of processes and competencies, together with procedural rules, that are applicable independently of individual evaluation projects.…
Most information on the prevalence of drug use comes from self-report surveys. The sensitivity of such information is cause for concern about the accuracy of self-report measures. In this study, self-reported drug use in the last 48 hr is compared to results from biological assays of saliva samples from 371 young adults entering clubs. The relationship between self-reports and drug presence in …
Findings from an evaluation of a model system for delivering mental health services to youth were reassessed to determine the robustness of key findings to the use of methodologies unavailable to the original analysts. These analyses address a key concern about earlier findings—that the quasi-experimental design involved the comparison of two noncomparable groups. The authors employed propensit…
Communities That Care (CTC) is a prevention system designed to reduce adolescent substance use and delinquency through the selection of effective preventive interventions tailored to a community's specific profile of risk and protection. A community-randomized trial of CTC, the Community Youth Development Study, is currently being conducted in 24 communities across the United States. This artic…
In experimental designs with nested structures, entire groups (such as schools) are often assigned to treatment conditions. Key aspects of the design in these cluster-randomized experiments involve knowledge of the intraclass correlation structure, the effect size, and the sample sizes necessary to achieve adequate power to detect the treatment effect. However, the units at each level of the hi…
This article reports results from a student survey fielded using an experimental design with 14 Kentucky school districts. Seven of the 14 districts were randomly assigned to implement the survey with active consent procedures; the other seven districts implemented the survey with passive consent procedures. We used our experimental design to investigate the impact of consent procedures on (a) …