Current Projects

Project Title Description                                                                                       Investigator(s)

Developing a Chinese C-test for Research Purposes

The project aims to develop and validate a short-cut proficiency measure of Mandarin. Domain experts, native speakers of Mandarin and learners of Mandarin are included in the development stages for feedback and quality control. Think-aloud data are being collected to inform native and learner processes of linguistic items. The results of the C-test will be correlated with learners’ performance on OPIc and the ACTFL reading test.

Yiran Xu, Todd McKay, Meg Malone

IPIC (Intercultural Pragmatic Interactional Competence Assessment)

This project aims to develop, pilot, and validate a digital simulation instrument to help educators assess second language learners' pragmatic, interactional, and intercultural competence. Through scenarios with varying degrees of social and individual factors (e.g., gender, social distance, power), the assessment tool hopes to reflect the ​individualized, multilingual interactions learners are likely to engage in real life.​ The IPIC project is a partnership with the Center for Applied Second Language Studies (CASLS) at the University of Oregon.

Meg Malone (AELRC), Aysenur Sagdic (AELRC), Linda Forrest (CASLS), Julie Sykes (CASLS)

AAPPL (Assessment of Performance toward Proficiency in Languages)

Georgetown and ACTFL will work to identify the most critical languages to add to ACTFL’s AAPPL assessment via census data and surveys of the field. This project will support future efforts to help students meet the Seal of Biliteracy.

Nic Subtirelu, NHLRC, NCSSFL

Study of high-impact student learning outcomes assessment factors

Dr. Nic Subtirelu will conduct research to investigate national and local efforts to promote the Seal of Biliteracy; the impact of the Seal on both enrollment in and articulation to foreign language courses in higher education; and the degree to which the Seal is accessible to groups whose existing language abilities often go unrecognized (such as heritage language users) or who have not been adequately represented in foreign language education (such as students of color). This research will lead to the development of recommended practices, procedures, and materials for ensuring that the Seal of Biliteracy is implemented in a way that expands opportunities for language study, promotes rigorous assessment of language skills, and effectively highlights the valuable skills that foreign language learners and heritage language users can offer to employers and institutions of higher education. 

Nic Subtirelu, Montgomery College, UGA, UConn, Glastonbury [CT] Public Schools, NCSSFL

 

Pink and blue flowers Professional Development

Project Title Description                                                                                       Investigator(s)

Assessment for Language Instructors: The Basics

Through the AELRC, CAL offers a free online training course that teaches world language instructors about the fundamentals of assessment. The asynchronous course provides world language instructors with an understanding of the fundamentals of assessment by presenting specific examples of how each applies to real classroom assessment situations. The course lasts five weeks and includes five units that require two hours each. Units focus on: (1) an introduction to assessment, (2) validity, (3) reliability, (4) practicality, and (5) impact. Recruitment for courses during the 2018-2022 funding cycle will include targeted outreach to educators working in community colleges and minority serving institutions.

Anne Donovan (CAL), Meg Montee (CAL)

Workshop on Language Assessment and Understanding: Application and Use

This hands-on assessment workshop covers key concepts in formative, classroom-based language assessment with a focus on how educators can integrate language assessment with daily instruction. The workshop will provide educators with a foundational understanding of language assessment as well as principles and strategies for implementing assessment. Participants will come away with an understanding of practical ways to use formative assessment to better understand students' language proficiency and their language development.

Meg Montee (CAL), Meg Malone

STARTALK: Understanding the ACTFL Guidelines

The goal of this project is to work with instructors of critical languages in community colleges and higher education to take part in a professional development workshop on how to incorporate the ACTFL Guidelines into teaching and assessment. The project promotes FL educators' understanding of ACTFL proficiency levels, which in turn, can improve curricular design and implementation. This is the second time the project has been funded.

Meg Malone, Amy Kim, Yiran Xu, Aysenur  Sagdic

East Coast Organization of Language Testers annual conference

The AELRC supports this conference, initiated in 2002, to provide a forum for the dissemination of high-quality, peer-reviewed research on language assessment to national educators, scholars, students, and other professionals. Pre- and post-conference workshops will be offered to enhance language teacher assessment literacy. Approximately 140 language testers participate annually, and post-conference evaluations reveal high satisfaction with the conference.

AELRC, Interagency Language Roundtable, Educational Testing Service

Summer Assessment Institutes

The AELRC will conduct one or more institutes annually on the basics of language assessment, rating oral proficiency assessments, and developing assessment tasks. Two summer institutes will focus on the IPIC and its uses for teaching intercultural communication in the classroom. The AELRC and the Center for Applied Second Language Study (CASLS) will each support a summer institute on assessing intercultural competence. Institutes are designed to be applicable to key constituencies such as K-12 teachers and community college and heritage language program instructors. To date, such institutes have served over 100 U.S. language teachers and instructors in K-12, community colleges and higher education, and the participant evaluations show that they are useful for participants.

AELRC, CASLS,  local education agencies, community colleges

Consortium on Useful Student Learning Outcomes Assessment

The annual Consortium on Useful Assessment in Language and Humanities Education continues as a vehicle to bring foreign language education stakeholders together and create opportunities for disciplinary dialogue on topics related to student learning outcomes assessment. Project work will include an annual summit on student learning outcomes assessment in college foreign language programs, with round tables on best practices, paper/poster sessions, and colloquia addressing student learning outcomes assessment in college foreign language education.

AELRC, CASLS

Conducting and assessing the impact of professional development in student learning outcomes assessment

The AELRC will investigate the impact of professional development in student learning outcomes assessment, as provided through ACTFL Oral Proficiency Interview training, on instructors in these contexts, including the apparent effects on language education and what activities might help or hinder the usefulness of student learning outcomes assessment in such contexts. Dr. Ann Aly of ACTFL will schedule four-day OPI workshops and work with Georgetown to conduct follow-on research on the influences of these workshops for teaching and learning, specifically curriculum development and assessment practices. Findings will lead to the development of recommended practices, procedures, and educational materials. Other outcomes will include presentations at the ACTFL annual conference and a publication in a journal such as Foreign Language Annals.

AELRC, Montgomery  College, UDC, NHLRC, MSU

 

Pink and blue flowers Research Dissemination

Project Title Description                                                                                       Investigator(s)

Updating Existing Bibliographies

We aim to provide an up-to-date list of publications related to the assessment and evaluation of heritage language learners.  

Amy Kim

Heritage Teacher Perceptions Article

This study investigates language teachers' perceptions of heritage language learners on a large scale using survey methodology. The study is inclusive of teachers of different grade levels, of different types of classrooms, and different languages. By looking at a wide array and large number of participants (N=325) this study provides robust data to answer the overarching question: How do language teachers perceive their HLLs in the classroom? Using both qualitative and quantitative data from the survey, the findings will provide insight on teachers’ views of heritage language learners’ dialects, their expectations of the learners, and the assessment needs of the learners, as well as their overall perceptions of the learners. A manuscript is currently in preparation for publication.

John Chi, Meg Montee

Foreign Language Assessment Directory (FLAD)

The AELRC updates and continually maintains this free, online, searchable directory of information about currently available language assessments, hosted by CAL. The FLAD also includes a free, web-based tutorial designed to support educators in selecting an assessment. The existing FLAD resources focus on university audiences; the AELRC is developing new web-based materials for heritage, K-12, and community college educators with information about how to use the FLAD to select assessments that meet their needs.

Melissa Cheston, NHLRC, Montgomery College, other institutions TBD

Expanding the Foreign Language Data Sharing System

The AELRC is developing a database (N=~1,200) of pre-rated simulated oral proficiency tests in seven languages from a previous study of pre- and post-study abroad students. We will support this effort by working with Georgetown graduate students, internal researchers, and external researchers to further anonymize the data for national research, transcribe it, and make it available for widespread use.

Bradford Salen

 

Pink and blue flowers EVALUATION

Project Title Description                                                                                       Investigator(s)
Difficulty study

To date, claims of differential difficulty have neither been substantiated through empirical research nor fully supported in the SLA literature. This pilot study represents an initial attempt to investigate these claims via both quantitative and qualitative methods, examining the progress of complete beginners in a summer university-level immersion program that included a promise to use the target language (Chinese, Russian or Spanish) exclusively. Participants took standard, large scale listening, reading, and oral interview (OPI) tests after six to seven weeks of study. Interviews with instructors and directors, as well as classroom observations, were conducted to determine the comparability of instruction across languages and how perceptions of language difficulty influenced instruction.

Meg Malone, Yiran Xu, Charlene Polio (MSU)

Evaluation planning and capacity building in self-access language learning labs/centers  The project seeks to understand and develop approaches to evaluation capacity building, logic model development, and situational analysis for college language laboratory/self-access centers. A key purpose of the study is to identify best educational practices for university and college language labs.  

John McE. Davis, Todd McKay