- ITAEC, Chapter 13: Writing a Test
- Here are some articles about test writing. Choose the ones you prefer, print them out, and bring them to class:
- Writing a Good Test
- What you Should Learn about Standardized Tests
- Test Specifications
- Test Writing
- Guidelines to Writing Good Test Items
- "F for assessment" online link full PDF version
- Making End-of-Term tests
- Making a test: Group Activity
- Chapter 13 Follow-up Activities
The Parable of the Job Test
Your boss tells you that you have to take a test in order to keep your job. So you spend weeks cramming for the test. Pass it, you keep your job. Fail it, you're fired. So you're very nervous. The day of the test arrives. You sit down to take the test. The first question is:
1. " How many staples does your stapler hold?"
A: 224 B: 244 C: 184: D: 481
Paniced, you take a wild guess and circle answer " C," 184. The next question is:
2. " What are the last 4 digits of the phone call you made at the end of the day last week?"
A: 4422 B: 2244 C: 2424 D: 4224
You have no idea, so you again guess wildly and circle answer " A," 4422. All the rest of the questions ask the same kind of thing. You finish the test and reluctantly hand it in to your boss. You know there is no way you passed. You are going to be fired.
So you say to your boss,
- " Gee, I spent weeks getting ready for that test. I think I do my job pretty well. But none of the questions were about my job."
- " Is that so?," replies your boss. " You use a stapler in your job, don't you? You make phone calls in your job, don't you?"
- " Yes, that's true," you admit. " But the test didn't allow me to show what I know and what I can do."
Then your boss says, " Can you remember how many staples your stapler contains? Can you remember the last 4 digits of the phone call you made at the end of the day last week? If so, then you obviously know a thing or two."
Finally, you lose your cool and scream, " But that is useless trivia! Knowing how may staples my stapler contains has nothing to do with how well I can do my job! Why don't you ask me questions that show I know something useful and can do meaningful things?"
" Because," your boss replies in an aggressive monotone, " we only test the things that we can measure. Good luck in your next job. Maybe they will be more accommodating to someone with your special needs. But this company doesn't cater to you fancy-schmancy intellectual types and your need to show what you know and can do. I guess our test just isn't good enough for you. Well, good riddance!"