Jump to: Test Development | Professional Development | Research Dissemination | Evaluation
Test Development
IPIC (Intercultural, Pragmatic, and Interactional Competence Assessment)
Investigators: Meg Montee, Meg Malone, Negar Siyari, Vashti Lee, Linda Forrest (CASLS), Julie Sykes (CASLS)
This project aims to develop, pilot, and validate a digital simulation instrument to help educators assess second language learners’ pragmatic, interactional, and intercultural competence. Through scenarios with varying degrees of social and individual factors (e.g., gender, social distance, power), the assessment tool hopes to reflect the individualized, multilingual interactions learners are likely to engage in real life. The IPIC project is a partnership with the Center for Applied Second Language Studies (CASLS) at the University of Oregon. Read our research brief for an accessible overview of current IPIC research.
Study of high-impact student learning outcomes assessment factors
Investigators: Nic Subtirelu, Margaret Borowczyk, Montgomery College, UGA, UConn, Glastonbury [CT] Public Schools, NCSSFL
Dr. Subtirelu will conduct research to investigate national and local efforts to promote the Seal of Biliteracy; the impact of the Seal on enrollment in and articulation to foreign language courses; and the degree to which the Seal is accessible to groups whose existing language abilities often go unrecognized or who have not been adequately represented in foreign language education. This research will lead to the development of materials for ensuring that the Seal of Biliteracy is implemented in a way that expands opportunities for language study, promotes rigorous assessment of language skills, and effectively highlights the value that foreign language learners and heritage language users can offer to employers and higher education institutions. Read our research brief for an accessible overview of current Seal of Biliteracy research.
AAPPL (Assessment of Performance toward Proficiency in Languages)
Investigators: AELRC, NHLRC, NCSSFL
Georgetown and ACTFL will work to identify the most critical languages to add to ACTFL’s AAPPL assessment via census data and surveys of the field. This project will support future efforts to help students meet the Seal of Biliteracy. Read our research brief for an accessible overview of current Seal of Biliteracy research.
Developing a Turkish C-test for Research Purposes
Investigators: Şeyma Toker, Derek Reagan, Meg Malone, Olivia Stevens
This project aims to expand and validate an existing short-cut proficiency measure of Turkish. The existing texts will be reviewed for their alignment with ACTFL levels, and domain experts, Turkish native speakers, instructors, and learners of Turkish will be included in the development stages for feedback and quality control. Think-aloud data will be collected to inform native and learner processes of linguistic items. The results of the C-test will be further correlated with learners’ performance on ACTFL tests. Five optimal texts of high reliability, good separation indices and fit statistics will be selected to inform future L2 research.
Professional Development
Heritage Language Assessment Module
The Heritage Language Assessment Module launched in spring of 2021 and was developed as an additional component of the Understanding Assessment Tutorial. This module focuses on selecting assessments for heritage language programs, and it is designed for educators working in K-12 heritage language classes, community-based heritage language schools, and university-level heritage language courses.
Post-Secondary World Language Assessment Module
We are excited to announce the launch of the Post-Secondary World Language Assessment Module! This module is another component of the Understanding Assessment Tutorial that focuses on planning for and selecting assessments for post-secondary world language courses and programs. It is designed for educators working in any post-secondary context, including public/private colleges and universities, community colleges, and other community-based adult education settings.
Assessment for Language Instructors: The Basics
Investigators: Jamie Morgan, Francesca Di Silvio, Meg Montee, Valentina Michelotti
Through the AELRC, CAL offers a free online training course that teaches world language instructors about the fundamentals of assessment. The asynchronous course provides world language instructors with an understanding of the fundamentals of assessment by presenting specific examples of how each applies to real classroom assessment situations. The course lasts five weeks and includes five units that require two hours each. Units focus on: (1) an introduction to assessment, (2) validity, (3) reliability, (4) practicality, and (5) impact. Recruitment for courses during the 2018-2022 funding cycle will include targeted outreach to educators working in community colleges and minority serving institutions.
STARTALK: Understanding the ACTFL Guidelines
Investigators: Meg Malone, Margaret Borowczyk, Rima Elabdali, Caitlyn Pineault, Camille Kurtz
The goal of this project is to work with instructors of critical languages in community colleges and higher education to take part in a professional development workshop on how to incorporate the ACTFL Proficiency Guidelines into teaching and assessment. The project promotes foreign language educators’ understanding of ACTFL proficiency levels, which in turn can improve curricular design and implementation.
East Coast Organization of Language Testers (ECOLT) annual conference
Investigators: AELRC, ILR
The AELRC supports this conference, initiated in 2002, to provide a forum for the dissemination of high-quality, peer-reviewed research on language assessment to national educators, scholars, students, and other professionals. Pre- and post-conference workshops will be offered to enhance language teacher assessment literacy. Approximately 140 language testers participate annually, and post-conference evaluations reveal high satisfaction with the conference.
Summer Assessment Institutes
Investigators: AELRC, CASLS, local education agencies, community colleges
The AELRC conducts summer institutes on the basics of language assessment, rating oral proficiency assessments, and developing assessment tasks. Two upcoming institutes will focus on the IPIC and its uses for teaching intercultural communication in the classroom. The AELRC and the Center for Applied Second Language Study (CASLS) will each support a summer institute on assessing intercultural competence. Institutes are designed to be applicable to key constituencies such as K-12 teachers and community college and heritage language program instructors and to date have served over 100 such language teachers and instructors.
Conducting and assessing the impact of professional development in student learning outcomes assessment
Investigators: AELRC, Camelot Marshall, Leah Adelson (ACTFL) Montgomery College, UDC, NHLRC, MSU
The AELRC will investigate the impact of professional development in student learning outcomes assessment, as provided through ACTFL Oral Proficiency Interview training, on instructors in these contexts, including the apparent effects on language education and what activities might help or hinder the usefulness of student learning outcomes assessment in such contexts. Four-day OPI workshops will be scheduled and ACTFL will work with Georgetown to conduct follow-on research on the influences of these workshops on teaching and learning, specifically curriculum development and assessment practices. Findings will lead to the development of recommended practices, procedures, and educational materials. Other outcomes will include presentations at the ACTFL annual conference and a publication in a journal such as Foreign Language Annals.
Research Dissemination
Heritage Teacher Perceptions Article
Investigators: Meg Montee, Anne Donovan, John Chi, Meg Malone
This study investigates language teachers’ perceptions of heritage language learners on a large scale using survey methodology. The study is inclusive of teachers of different grade levels, of different types of classrooms, and different languages. By looking at a wide array and large number of participants (N=325) this study provides robust data to answer the overarching question: How do language teachers perceive their HLLs in the classroom? Using both qualitative and quantitative data from the survey, the findings will provide insight on teachers’ views of heritage language learners’ dialects, their expectations of the learners, and the assessment needs of the learners, as well as their overall perceptions of the learners. A manuscript is currently in preparation for publication.
Foreign Language Assessment Directory (FLAD)
Investigators: Francesca Di Silvio, Jamie Morgan, Valentina Michelotti, NHLRC, Montgomery College,
The AELRC updates and continually maintains this free, online, searchable directory of information about currently available language assessments, hosted by CAL. The FLAD also includes a free, web-based tutorial designed to support educators in selecting an assessment. The existing FLAD resources focus on university audiences; the AELRC is developing new web-based materials for heritage, K-12, and community college educators with information about how to use the FLAD to select assessments that meet their needs.
Expanding the Foreign Language Data Sharing System
Investigator: Bradford Salen
The AELRC is developing a database of about 1,200 pre-rated simulated oral proficiency tests in seven languages from a previous study of pre- and post-study abroad students. We will support this effort by working with Georgetown graduate students, internal researchers, and external researchers to further anonymize the data for national research, transcribe it, and make it available for widespread use.
Evaluation
Survey of K-12 program evaluation needs
The AELRC is currently conducting a study of K-12 world language program evaluation. This national study, which includes both focus group interviews and a questionnaire, gathers information from teachers and administrators about their experiences with and perceptions of world language program evaluation in their schools. The goal of this study is to investigate teachers’ and administrators’ experiences with K-12 world language program evaluation in order to begin to determine their needs.
Seal of Biliteracy Support
Investigators: Malik Stevenson, Francesca Venezia, Olivia Stevens
The AELRC is conducting research on how the Seal of Biliteracy impacts students as they transition from high school to higher education. We are collecting data through a survey and interviews with various stakeholders including students, university language instructors, university admissions officers, high school counselors, high school language teachers, and high school and district world language supervisors/coordinators from California, North Carolina, and Illinois (the 3 states with the most Seal recipients in 2018-2019). Through this study, we hope to better understand how receiving the Seal impacts students as they apply to college and take university-level language courses.