The contemporary policy environment makes persistent demands on agency officials to use the best information available when making decisions about policies, programs, and practices. State and federal legislation calls on agencies to incorporate evidence-based practices (EBP) in their programs. Using data from a 2008 survey of state agency directors, we examine the extent to which state governme…
Public participation in administrative decision making has been widely advocated by both theorists and practitioners of public administration. Despite the importance of citizen engagement, we know little about its impact on the performance of government agencies. Is participation only normatively desirable or does it have some practical value attached to it? We draw on data from U.S. state tran…
Analysis of local government contracting decisions typically focuses on transactions costs related to service characteristics, especially asset specificity and difficulty of contract management. This analysis expands the focus to include market characteristics (competition), citizen characteristics (public interest in the service delivery process), and place characteristics (metro status and pu…
The advocacy coalition framework (ACF) pays special attention to “so-called” policy brokers when explaining policy change. However, this prominent policy approach neither clearly defines who the policy brokers are nor identifies under which institutional rules they have an influence on policy processes and outputs. This article thus formulates two theoretical hypotheses that complement the ACF …
Scholars generally agree that interest groups are active and at times influential during the notice and comment period of regulatory policymaking (or “rulemaking”). But current research often ignores the agenda setting that may take place during the pre-proposal stage of rulemaking. During proposal development, interest groups may lobby to: (1) influence the content of proposed regulations or (…
In this introductory article, a brief history and introduction to contribution analysis is provided to lay the stage for the articles that follow. At the heart of contribution analysis is the aim to be able to make credible causal claims about the contribution an intervention is making to observed results. The key role that theories of change play is noted, and what a useful theory of change ou…
Contribution analysis (CA) has been advocated and discussed more than it has been applied. This article draws on five evaluations applying CA in the context of EU policies in the areas of development aid, agriculture, employment, and governance. Over the last five years, the authors have developed their capacity to implement the six steps of CA and especially to draft contribution stories and t…
This article examines the methodological strengths and weaknesses of contribution analysis. The authors contend that a salient characteristic of contribution analysis is its accounting for influencing factors and alternative explanations. We argue that contribution analysis in its current form needs further methodological and practical elaboration in this respect. Therefore, this article pays p…
Contribution analysis is a structured approach to theory-based impact evaluation originally developed in Canada in the context of Results-Based Management (RBM) although there have been few examples of contribution analysis in practice since Mayne’s original paper (2001). We argue that contribution analysis adds value to other theory-based evaluation approaches by providing a more structured an…
Contribution analysis and theory-based evaluation are linked. This article discusses the contributions of several (recent) developments to further deepen the links between theory-based evaluation and contribution analysis. This will be done by describing how three well-known (and almost classical) problematic situations for impact evaluations can be addressed through the application of insights…
Utilization-focused evaluation involves identifying and working with primary intended users to design and interpret an evaluation. This includes the process of working with primary intended users to render judgments about the extent to which the preponderance of evidence supports a meaningful and useful conclusion about degree to which an intervention has affected observed outcomes and impacts.…
This article discusses the further development of theory-driven evaluation approaches that are informed by contribution analysis. Using an illustrative example of an ongoing dance/physical activity programme for health promotion, a number of challenges are identified when applying a theory-driven evaluation approach. These challenges are reformulated as questions that need to be answered to mak…
This article aims to contribute to a controversy over whether excluding some small or incomplete groups from a sample improves statistical power in group research designs (designs that relate group-level characteristics to group-level outcome measures). In a series of simulation studies, we examined the trade-off between lower reliability and smaller sample size that occurs when very small grou…
This study examines the interaction of collective personality (i.e., the Big Five traits) and national diversity on group interpersonal citizenship behavior. Groups composed of diverse nationalities are theorized to manifest fewer initial shared understandings, enabling them to obtain more benefits than homogeneous groups from collective personality traits that promote better quality relationsh…
Items that capture group members’ outcomes from small group processes (e.g., satisfaction, cohesion) are often nonindependent. A primary assumption of most measurement models is that the data are independent; applying such models to group-outcome data measured at the individual level of analysis is thus likely to produce inaccurate estimates. A solution to the measurement of nonindependent data…
We extend the actor–partner interdependence model (APIM), a model originally proposed for the analysis of dyadic data, to the study of groups. We call this extended model the group actor–partner interdependence model or GAPIM. For individual outcomes (e.g., satisfaction with the group), we propose a group composition model with four effects; for group-level outcomes (e.g., group productivity), …
This article presents a case study that investigated primary school students’ social interaction while working in small groups in science. The aim was to identify what characterizes and triggers students’ efficacious interaction in collaborative learning situations. This was done by exploring and analyzing students’ and groups’ task involvement and the quality of their activity. The micro-level…
Over the past two decades the use of referenda has spread throughout Latin America, and 39 referenda have taken place since 1990. For some observers, referenda can improve accountability, promote participation, and reduce corruption. For others, given the strong tradition of Latin American presidentialism, referenda can be manipulated by populist presidents attempting to bypass unpopular repres…
In practice, democracies privilege plurality parties. Theories of the democratic process challenge the democratic credentials of this practice. Abstract social choice theory wonders whether an electoral majority even exists. A more optimistic line of argument, prominent in research on collective representation, assumes that the policy position of the median voter embodies the majority electoral…
Empirical evidence of how citizens around the world understand democracy highlights the predominance of the liberal model of democracy. Yet the existence of a dominant view does not mean that all citizens in every nation exclusively endorse a liberal conceptualization. Hence, this article asks whether public beliefs about the meaning of democracy affect people’s political attitudes and behavior…