This article addresses the issue of falling response rates in telephone surveys. To better understand and maintain respondent goodwill, concepts of psychological contract and respondent expectations are introduced and explored. Results of the qualitative study show that respondent expectations are not only socially contingent but also ego-expressive, utilitarian, pleasurable, and epistemic by n…
The development of European Community administrative authority has greatly influenced the development of an evaluation culture among the southern and central member states of the European Union. The present case study from Spain provides an example of this diffusion through the use of an empowerment evaluation approach to build evaluation capacity within the context of rural development. The st…
Though collaboration is often required in community initiatives, little evidence documents relationships between collaboration and program success. The authors contend that clarification of the construct collaboration is necessary for investigating its contribution to the success of community initiatives. After respecifying collaboration, they present a study of a multisite program that involve…
Both true experiments and regression discontinuity (RD) designs produce unbiased estimates of effects. However, true experiments are, of course, often criticized on equity grounds, whereas RD designs entail sacrifices in terms of statistical precision. In this article, a hybrid of true experiments and RD designs is considered. This hybrid entails smaller sacrifices in statistical efficiency tha…
Longitudinal research designs involve data collection at multiple time points to measure change over time. Therefore, identification of the same respondents is essential at each time point so that data from the same respondents can be matched for comparison over time. Subject-generated identification codes permit an anonymous means to track respondents over multiple data collection points. This…
The Collegiate Learning Assessment (CLA) program measures value added in colleges and universities, by testing the ability of freshmen and seniors to think logically and write clearly. The program is popular enough that it has attracted critics. In this paper, we outline the methods used by the CLA to determine value added. We summarize the criticisms, which revolve around the question of which…
We conduct an evaluation of MedShare, a program designed to enhance access to prescription drugs for indigent patients in the Greater Cincinnati area. The program expands access to drugs by providing subsidies to reduce the costs paid by patients for their prescriptions. The assumption is that by expanding access to prescription drugs, participant health outcomes as measured by quality of life …
The chronic and relapsing nature of substance abuse points to the need for continuing care after a primary phase of treatment. This article reviews the economic studies of continuing care, discusses research gaps, highlights some of the challenges of conducting rigorous economic evaluations of continuing care, and offers research guidelines and recommendations for future economic studies in thi…
Several school performance indices were evaluated using achievement data from multiple longitudinally matched middle school student cohorts in a large district in the southwestern United States. Measures designed to index the within-cohort achievement status and growth of students as well as the status and growth-based changes that occur over years between different student cohorts were studied…
This study translated and validated the Substance Use Risk Profile Scale (SURPS) among 13 to 18 year old Sri Lankan adolescents attending school. A standard systematic translation procedure was followed to translate the original SURPS into Sinhala language. A Delphi process was conducted to determine judgmental validity of Sinhala SURPS. Confirmatory factor analysis was performed to test the tr…
Poisson and negative binomial regression methods are used to analyze the monthly time series data to determine the effects of introducing an integrated security management system including closed-circuit television (CCTV), door alarm monitoring, proximity card access, and emergency call boxes to a large privately-owned complex of apartment buildings in New York City. Crime rates in a control ap…
Although most academic disciplines evolve at a measured pace, the emerging field of homeland security must, for reasons of safety and security, evolve rapidly. The Department of Homeland Security sponsored the establishment of a graduate educational program for key officials holding homeland security roles. Because homeland security is a nascent field, the establishment of a program curriculum …
The objective of this study is to evaluate the impact of a pilot study that promoted productive and capacity-building activities among deprived rural women of Mexico. The evaluation design is observational; 1,278 women are interviewed, and the comparison group is estimated by propensity score matching. The results show a positive impact on the carrying out of agricultural activities, in the aut…
The study of "scientific excellence" is taking on increasing importance in the development of research policies in many nations. However, scientific excellence is difficult to define because of its multidimensional and highly complex character. This work contributes to the state of the art by exploring an effective, simple, and inexpensive bibliometric methodology that further identifies "excel…
We reviewed 39 national government- and nongovernment-sponsored data sets related to substance addiction policy. These data sets describe patients with substance use disorders (SUDs), treatment providers and the services they offer, and/or expenditures on treatment. Findings indicate the availability of reliable data on the prevalence of SUD and the characteristics of specialty treatment facili…
This study is an exploratory examination of the projected sustainability of more than 100 projects funded by the Australian government. Using data collected by the body that evaluated the projects and data from a government database, it examines the predictors of various forms of sustainability. Findings show that some two thirds of the project leaders who expected their programs to continue af…
In a randomized test of mixed-mode data collection strategies, 386 participants in the Raising Healthy Children (RHC) Project were either (a) asked to complete a survey via the Internet and later offered the opportunity to complete the survey in person or (b) first offered an in-person survey, with the Web follow-up. The Web-first condition resulted in cost savings although the overall completi…
Recent meta-analyses of drug-court studies recognized the poor methodological quality of the evaluations, with only a few being randomized. This article critiques the design of the randomized studies from a statistical perspective. Learning points are identified for future drug-court studies and are applicable to evaluations both of other specialist courts and of court-based interventions more …
Growing interest in the institutionalization of evaluation in the public administration raises the question as to which institutional arrangement offers optimal conditions for the utilization of evaluations. Institutional arrangement denotes the formal organization of processes and competencies, together with procedural rules, that are applicable independently of individual evaluation projects.…
Most information on the prevalence of drug use comes from self-report surveys. The sensitivity of such information is cause for concern about the accuracy of self-report measures. In this study, self-reported drug use in the last 48 hr is compared to results from biological assays of saliva samples from 371 young adults entering clubs. The relationship between self-reports and drug presence in …