Evaluation How-to Overview


AELRC pink and blue overlapping flower logoStart on this page to get a general sense of what evaluation is and the various ways in which evaluation can be implemented. Also, find below additional sources providing overview-type information, as well as links to prominent evaluation organizations and established research journals.

Blue flower Featured Resource

Cover of Roles and responsibilities for evaluation in foreign language programsNorris, J. M., & Watanabe, Y. (2007). Roles and responsibilities for evaluation in foreign language programs. Honolulu, HI: Foreign Language Program Evaluation Project, National Foreign Language Resource Center.

This short booklet presents a step-by-step overview of the program evaluation process with particular emphasis on who participates at distinct phases of an evaluation and what their responsibilities are for making evaluation happen.

Blue flower Selected How-to Books on Language Program Evaluation

This handbook acts as a practical resource for both evaluation teams and individual teachers who aim to improve their understanding of the content of language programs or courses and the context in which they are situated and operate.  Divided into three parts, this handbook deals with the initial staging of an evaluation, determining evaluation questions and means for addressing them, and the reporting and follow-up of evaluation findings.

This text offers a comprehensive and accessible overview of the various stages involved in the development, implementation, and evaluation of language programs.  It provides practical examples from the author’s experiences as curriculum developer, program administrator, and teacher.  Checklists, key terms, and application activities and exercises allow for more hands-on practice and integration with material.

This text doubles as both a textbook for students of program evaluation and a useful how-to starting point for those embarking on evaluations and evaluation research.  It is broken into four parts: background of evaluation and assessment, case studies, a how-to guide to evaluation and research, and resources for initiating, conducting, and researching program evaluation.

Through examples from language education contexts, this book provides an introduction to qualitative and quantitative approaches to language program evaluation for researchers, teachers, and those in administration.  It advocates for a focus on the formative aspects of program evaluation in lieu of quantitative measures of summative achievements and learning gains. 

This book explores the intersection and interplay of evaluation and assessment in conjunction with language as a system for creating and constructing power and social relations in present-day society.  It delves into purposes, design, and methods of data collection, for instance, with an eye to the social, political, and ethical aspects that accompany evaluation and assessment.

Blue flower Selected How-to Books on Evaluation

Provides comprehensive overviews and historical contexualization of the main evaluation approaches to date. The second half of the volume addresses practical aspects of planning and conducting evaluation, as well as guidelines for conducting metaevaluations.

A practical, how-to text divided into four parts corresponding to the main components of evaluation implementation: (a) evaluation planning and design, (b) data collection procedures, (c) use of evaluation, (d) data analysis. Chapters within each section are authored by leading researchers and experts on a given evaluation topic.

An abridged and practical treatment of Michael Quinn Patton's seminal "utilization-focused" evaluation approach (described in more detail in Patton, 1998, 2008). Topics include program/organizational readiness, evaluator readiness, capability assessment, identifying intended users and uses, situational analysis, evaluation design, data collection/analysis, and metaevaluation.

One of the seminal texts in the field. A detailed description of Rossi, Lipsey, and Freeman's "systematic" evaluation approach. Encompasses a wide (and more technical) range of evaluation topics, steps, and processes.

Blue flower Selected Online How-to Resources

NFLRC flower logoThe Foreign Language Program Evaluation Project, NFLRC
Website
An extensive listing and repository of language program evaulation resources maintained by the National Foreign Language Resource Center. The "FLPEP" site and project is the predecessor of the AELRC site.

 

PDE block logo The Program Development and Evaluation Unit (University of Wisconsin-Extension)
Website
The Evaluation Unit at the University of Wisconsin-Extension provides a comprehensive suite of user-friendly, high-quality guides and templates for many aspects of program evaluation.

 

Circular graphic of assessment process, showing how planning leads to gathering data leads to reporting results, leading back to planningInstructional Assessment Resources (University of Texas at Austin)
Website
The University of Texas at Austin provides short, easy-to-follow modules on conducting program evaluation, including evaluation planning, methods of data collection, analysis and reporting. 

 

Blue flower Professional Organizations

 American Evaluation AssociationLogo of the American Evaluation Association
 Website
 

 Canadian Evaluation SocietyLogo of the Canadian Evaluation Society
                               Website
 

Logo for the IOCE

International Organization for Cooperation in Evaluation
Website
 

 Research Journals

GENERAL

Below are a variety of professional journals dedicated to program evaluation for all types of programs.

  • American Journal of Evaluation 
  • American Educational Research Journal
  • Assessment and Evaluation in Higher Education
  • Canadian Journal of Program Evaluation 
  • Educational Evaluation and Policy Analysis 
  • Educational Research and Evaluation
  • Evaluation Review 
  • New Directions for Evaluation 
  • Practical Assessment, Research and Evaluation (free online journal)
LANGUAGE

None of the journals above are specific to language programs. Most language program evaluation work has appeared in the following journals, although none makes a particular claim to be “the” journal on language program evaluation.

  • ADFL Bulletin
  • Applied Linguistics
  • ELT journal
  • English for Specific Purposes
  • Foreign Language Annals
  • Language Assessment Quarterly
  • Language Teaching Research
  • Language Testing
  • Modern Language Journal
  • TESOL Quarterly