APLNG 583: Language Testing

Spring 2008

Pennsylvania State University

General Information

Instructor: Xiaofei Lu

Office: 301 Sparks Building

Mailbox: 305 Sparks Building

Phone: (814) 8654692

Email: xxl13 at psu dot edu

Webpage: http://www.personal.psu.edu/xxl13/teaching/sp08/583

Lectures: Monday & Wednesday, 4:15pm-5:30pm, 011 Ferguson

Office hours: By appointment

Required Textbooks

1. Brown, J. D. and Hudson, T. (2002). Criterion-referenced Language Testing. Cambridge University Press.

2. Genesee, F. and Upshur, J. A. (1996). Classroom-based Evaluation in Second Language Education. Cambridge University Press.

Course Description

This course is designed as both a theoretical treatment of language testing and a practical “hands-on” introduction to developing and using language tests. The course lays the theoretical foundation for language testing on current conceptions of language proficiency as communicative ability and on classical and modern psychometric techniques. Practical applications explore how to select, develop, administer, and analyze both norm-referenced and criterion-referenced instruments in both research and teaching. Students will also have practice in interpreting and reporting scores. 

Course Outline

This course will be organized around the following topics:

• Overview of second language evaluation: We will begin with an overview of the context of, the general framework for, and the information used in second language evaluation.
• Evaluating with tests: We will discuss the design, development and administration of both norm-referenced and criterion-referenced tests as well as methods for interpreting and reporting test scores.
• Evaluating without tests: We will briefly touch upon alternative methods for second language evaluation, including observation, portfolios, conferences, journals, questionnaires, and interviews.
• Test analysis and evaluation: We will conclude with a thorough discussion of psychometric methods for test analysis and evaluation.

Course Requirements

• Participation (10%). Students are expected to attend classes regularly, to read all required readings, and to actively participate in in-class discussions.
• Assignments (30%). There will be three take-home assignments (10% each).
• Test practicum (20%). All students will be asked to administer 2-3 language tests. Instructions will be provided in class later. 
• Final project (30%). All students will be asked to submit a written proposal for developing a language test as a final project, which is due in class on Wednesday, 4/30/2008. Instructions will be provided in class later.
• Final project presentation (10%). All students will be asked to give a 10-12 minute oral presentation of the final project. Instructions will be provided in class later.

Grading Policy

• Scale: A = 94-100; A- = 90-93.9; B+ = 87-89.9; B = 84-86.9; B- = 80-83.9; C+ = 75-79.9; C = 70-74.9; D = 60-69.9; and F = 59.9 or lower.
• Your work will be graded based on quality, effort, and how it compares with other students’ work; participation is graded based on attendance, attentiveness, and participation in in-class discussions.
• If at any time you feel that your work has been graded unfairly, please notify me immediately and I will try my best to address your concerns.

Make-up Policy

• Unless accompanied with official documentation of an acceptable reason, late submissions of assignments and final project will be subject to a 10% penalty for each day late (including Saturdays and Sundays).
• If you have to miss a scheduled presentation for an acceptable reason, please notify me immediately so that your presentation may be rescheduled.

Academic Misconduct

Penn State defines academic integrity as the pursuit of scholarly activity in an open, honest and responsible manner.  All students should act with personal integrity, respect other students’ dignity, rights and property, and help create and maintain an environment in which all can succeed through the fruits of their efforts (Faculty Senate Policy 49-20).  Dishonesty of any kind will not be tolerated in this course. Dishonesty includes, but is not limited to, cheating, plagiarizing, fabricating information or citations, facilitating acts of academic dishonesty by others, having unauthorized possession of examinations, submitting work of another person or work previously used without informing the instructor, or tampering with the academic work of other students.  Students who are found to be dishonest will receive academic sanctions and will be reported to the University’s Judicial Affairs office for possible further disciplinary sanction. 

Tentative Schedule*

W	D	Date	Topic	Readings	What’s due
1	M	1/14	Introduction	G&U: Ch1
	W	1/16	Context of SLE	G&U: Ch2
2	M	1/21	Martin Luther King Day - No Classes
	W	1/23	A framework for SLE	G&U: Ch3-4
3	M	1/28	Testing	G&U: Ch8; B&H: Ch1
	W	1/30	Curriculum-related testing	B&H: Ch2
4	M	2/4	Objectives-referenced testing	G&U: Ch9
	W	2/6	Choosing and devising test tasks	G&U: Ch10
5	M	2/11	CRT items	B&H: Ch3
	W	2/13			Assignment 1; Sample Questions
6	M	2/18	Assembling and scoring tests	G&U: Ch11
	W	2/20	Administering CRTs	B&H: Ch7
7	M	2/25	Interpreting test scores	G&U: Ch12
	W	2/27	Standardized tests	G&U: Ch13	Assignment 2
8	M	3/3	Evaluating without tests	G&U: Ch5-7
	W	3/5
9	Spring Break
10	M	3/17	Test practicum
	W	3/19	Test practicum
11	M	3/24	Descriptive and item statistics for CRTs	B&H: Ch4; IRT
	W	3/26			Test practicum report
12	M	3/31
	W	4/2	Reliability, dependability, and unidimensionality	B&H: Ch5
13	M	4/7
	W	4/9			Assignment 3
14	M	4/14	Validity	B&H: Ch6	Final project sign-up
	W	4/16
15	M	4/21	Final project presentations	Jeff, Lindsay, Meghan, Jennifer
	W	4/23	Final project presentations	Miranda, Mandy, Erin, Laure, Lu, Lydia
16	M	4/28	Final project presentations	Youngsook, Kristen, Eunjung, Freeman, Ethan, Eden
	W	4/30	Final project presentations	Yoshiho, Sherry, Ashley, Chrystal, Linh, Jingyao	Final project

* The schedule and readings are subject to change.