Find out the type of assessment that your students (conversation partners, etc)
took to get placed in the class they are in. Consider their goals and the goals
of the program, and discuss whether you think the assessment is valid and
reliable.
(Additional comments on this post no longer earn points. Please choose a more recent entry).
(Additional comments on this post no longer earn points. Please choose a more recent entry).
My conversation partner entered the IEP program. She was accepted into a class for late intermediate students. She had to take a placement test to determine her placement. Apparently if the students feel they are in the wrong class, they can take a diagnostic test in the second week of the program to reevaluate them.
ReplyDeleteWhile I do not know the details of the assessment, I know that my partner wants to be completely fluent in English so she can get a job in the US. She says there is a wide range of proficiency levels WITHIN her class. So, while the assessment can help put a range of students together, these students were not divided by areas of skill. My partner says she is better at listening and speaking than writing while other students can hardly say anything but get very good grades from their grammar. This is troubling because it suggests that the most truly fluent students might be getting worse grades and the students who cannot communicate are getting praised for strictly grammatical understanding.
I think an assessment in all skill areas should be required. And if that was the case in this assessment for the ELI, then that class should perhaps be divided into two classes and those advanced as speaker/listeners should be in a class more grammar-oriented and those better at reading/writing should be in a class more speaking/listening focused. However, I do understand that often resources do not allow such divisions within a program.
My students were assessed through an informal interview process. One of our program coordinators sits down with a student and begins assessing how much, if any, of english the student knows. In some interviews, a translator is there (if available) to help the student along to understand certain questions. This interview is designed to not only determine how much english the student knows, but what their educational background is as well. A lot of students who come into our program are illiterate and have no experience with reading or writing. Also, since one of the goals of this class is to become a U.S. citizen, the interviewer asks the student basic U.S. facts and information to determine how much knowledge the student has of the U.S. Unfortunately, the students only have two options for class levels: the beginner level and the "advanced" level. So basically, if the student has little to no experience with english, and if they are illiterate, they go to the beginning level. If the students have some experience with english and have experience reading and writing, even if only in their own language, they are put in the advanced level. I understand that this isn't the most sophisticated process but a lot of other factors are involved as well. For example, the students have to meet a certain age requirement (65 and older) and they have to be refugees that came here through the catholic charities organization. Also, I can confidently say that no student owns a car. That means, they need to rely on public transportation (if they're provided the funds for that) or attending a class that is nearby. That means, a lot of students who are assigned to a particular class are only there because that is the only class they can reasonably attend due to location. I think this is the main factor when assigning students to a class. This is unfortunate, but when it's a volunteer-based organization who doesn't have a whole lot of money coming in, you do the best with what you got.
ReplyDeleteI, obviously, don't think this is a valid or reliable assessment and I hope in the future that this program will be given enough money to make it better.
Jarrod Duarte
ReplyDeleteThe type of assessment that the students took to get placed in my class was a basic one, there were basic grammatical cloze type questions. As well as a small listening portion and reading comprehension questions along with various open ended questions in accordance with some reading. I believe that this type of assessment is valid and reliable according to the curriculum at VMLC, the curriculum is based around this structure, so in essence we really seem to be teaching to the test. I understand why VMLC does this, they need clear precise data (hopefully data showing improvement in English) to put into their grant proposals and to justify whatever grants they are currently receiving. Regarding the goals of the students, I am not sure if this meets their goals for English fluency and proficiency in all 4 skills, not to say that it is counter to them but it is not as efficient as it could be in my opinion.
Jarrod Duarte
The assessment my students took to get placed in our ESL program is part of the textbook package that the program uses. For the most part, my students want to become proficient in English, reading, writing and understanding. The goal of the program is to teach them English, and make sure they are able to effectively communicate. I think the assessment they had to take is relevant simply because it places them according to the book series we use. The ESL courses offered are based around the different levels of the text book, and they are placed according to that system.
ReplyDeleteI think this is really helpful on one level because it helps to narrow down the specific needs of each student. I also think this can be misleading simply because a lot of my students are fairly proficient with speaking, but not necessarily with reading and writing. The problem here stems from the fact that there is not a lot of focus in the books on reading and writing, but rather on speaking, but the assessment itself is a written exam. What I've noticed about my class is that the students are, on average, pretty proficient speakers, but reading, writing, and test taking are all very difficult for them.
This assessment, while helpful in the context of the books used, really focuses on people with a formal education, who are literate in their L1.
I have conversation partners that are in the IEP and they too took a placement test. They just want to speak English. They are eventually going back to Korea. That is something that is common that I hear from many of the students from the ELI. I have two partners. The first says that he is better at speaking and grammar, but his listening comprehension needs help. My second partner says she is better at writing, but the rest she feels that she is weak. If their goal is to speak English, then I suppose that maybe there should be some more emphasis on speaking. I’m sure that they try to be communicative and weave all three courses together as we discussed last week, but maybe if they equaled out the time spend in all three courses, maybe the students would feel like they’ve made progress. I really think that’s the core issue here. My partners do not feel like they’ve grown much in terms of speaking English. So, for my partners, the assessment should reflect their personal growth rather than a standard to move up in the program.
ReplyDeleteThe same placement test my students took to get into the program is what they took at the end of the program. I am not sure this is a good placement test. The students take this test before entering a specific level. Depending on their score they are placed in a level and can choose to go down a level if the level is too advanced for them. Then at the end of the semester they take the same test see if they can advance a level. All the students take the exact same test (level 0-4). The tests are not locked away so cheating can be possible. Though I think I would use this test as a test that allows teachers to know what the can achieve during the semester I don't know if I would let them use this as a valid assessment for moving up a level. Plus this test only tests on grammar and reading. Students are asked or fill in the circle with the right answer (multiple choice), so writing is also lacking. They aren't test on listening, speaking, and pronunciation. I would say this test isn't completely reliable and I am not too sure how valid it is.
ReplyDeleteStefani Goode
My conversation partner took assessments in several different (separate) skill levels to determine her placement in her classes. Her goal is to learn English well enough to be considered fluent at home (Korea) so that she can get a corporate job and be considered bilingual. The goals of the course seem to be to bring up her grammar profiency level (as far as I can tell) and get her comfortable giving presentations in English. (Which also seem to be consistent with her goals.) I'm not sure I agree with her placement in levels 5 and 6 speaking and grammar classes, unless she just performs better on paper than one-on-one.
ReplyDeleteMy students take a shortened version of the BEST (Basic English Skills Test) to get placed into classes. There are only two levels, so it's basically the class for the people who can hold a basic conversation and class for the people who can't. The test is all oral and begins with basic questions, such as "What is your name? Can you spell that?" and then moves on to harder questions about pictures we show them. Honestly, I really dislike the assessment we give them and think it is neither valid nor reliable. Their goal is to pass the citizenship exam, and very few of the questions on the test are similar to the questions they will face at the interview. Also, the test requires them to read a clock and count change, two skills not needed on the citizenship exam. Also, there are two types of questions - one scored on the basis of fluency and the other on the basis of grammar. The fluency scale strictly measured how many coherent ideas the person produced. That meant that many people scored artificially low because they weren't big talkers. The other big problem is that it doesn't measure literacy, which is a huge determiner in a student's success in our classes (in addition to being a required skill for the citizenship exam). The logical thing to do would be to change the assessment. However, when the grant was written, it specifically states that we will use this test, and there is no way around it. We're stuck.
ReplyDeleteThe students were required to take a written placement followed by a 30 minute interview. As it was explained to me they were some very general questions with some really life bases. A lot of the questions were also very culture oriented, for example they were asked questions that would test how to fill out a check, talking to a principle of their child’s school, and shopping. The book we use was very similar to the lessons and exercises in book, so I felt the exam was a great assessment for the course. The interview was also to see if they could talk at an elementary level or more. They were required to take the test at the beginning of class and after 30 hours of that class to see improvement. When I taught the second level for few classes I was able to clearly see a difference in the students and have to say it was fairly accurate on which students belong in which level. So a very valid and reliable test that I plan to use in more own ESL program one day.
ReplyDelete