View previous topic :: View next topic |
Author |
Message |
kazpat
Joined: 04 Jul 2010 Posts: 140 Location: Kazakhstan
|
Posted: Sun Mar 29, 2015 12:06 pm Post subject: Low IELTS writing scores |
|
|
Hello,
I work at a secondary school in Kazakhstan. We recently had an IELTS exam for English teachers which saw some very low writing scores come back. For example, one teacher who studied for a year at a US high school through the FLEX program got an 8.5 in speaking, 7.5 in both reading and listening but a 6 in writing. Another had scores of 6.5 and 7 for other areas but a 5 in writing. The same pattern held true for a few others. Additionally, the test for students a few months ago had some kids come back with 6-7 in writing who don't appear to be on par with the aforementioned teachers.
Has anyone else experienced this? I've helped some of these teachers with writing and at least according to the public rubric they seemed poised to perform well on the test. The student scores along with the varied results cause me to think this might be a rater reliability issue. I am not an examiner and don't have access to the actual rubric and don't know anything about the marking process so am hesitant to point that finger. As an organization we know writing is an area for concern but the scores are really surprising given the training, background, preparation and international teaching staff opinion of some of the teachers.
I think a few are going to request a remark, I don't have any experience with that either. I assume a different rater checks the test without knowing the original mark.
Any experience or comments? |
|
Back to top |
|
 |
adaruby
Joined: 21 Apr 2014 Posts: 171 Location: has served on a hiring committee
|
Posted: Sun Mar 29, 2015 12:52 pm Post subject: Re: Low IELTS writing scores |
|
|
kazpat wrote: |
Hello,
I work at a secondary school in Kazakhstan. We recently had an IELTS exam for English teachers which saw some very low writing scores come back. For example, one teacher who studied for a year at a US high school through the FLEX program got an 8.5 in speaking, 7.5 in both reading and listening but a 6 in writing. Another had scores of 6.5 and 7 for other areas but a 5 in writing. The same pattern held true for a few others. Additionally, the test for students a few months ago had some kids come back with 6-7 in writing who don't appear to be on par with the aforementioned teachers.
Has anyone else experienced this? I've helped some of these teachers with writing and at least according to the public rubric they seemed poised to perform well on the test. The student scores along with the varied results cause me to think this might be a rater reliability issue. I am not an examiner and don't have access to the actual rubric and don't know anything about the marking process so am hesitant to point that finger. As an organization we know writing is an area for concern but the scores are really surprising given the training, background, preparation and international teaching staff opinion of some of the teachers.
I think a few are going to request a remark, I don't have any experience with that either. I assume a different rater checks the test without knowing the original mark.
Any experience or comments? |
This could be less a matter of language and more content. Many very well qualified non-native speakers can be quite flowery in their written work, which will cause them to lose substantial marks in an IELTS written exam if they haven't addressed the key points in the actual question. |
|
Back to top |
|
 |
spiral78

Joined: 05 Apr 2004 Posts: 11534 Location: On a Short Leash
|
Posted: Sun Mar 29, 2015 1:20 pm Post subject: |
|
|
Quote: |
IELTS written exam if they haven't addressed the key points in the actual question |
ESPECIALLY if they haven't addressed the key points:-)
Writing on task is a fairly important factor for proficient users of English - and they are also the ones who don't want to listen/read carefully because they assume they get it instantly.
Further, if they have a need or desire to show off, this can lead them astray considerably. |
|
Back to top |
|
 |
nomad soul

Joined: 31 Jan 2010 Posts: 11454 Location: The real world
|
Posted: Sun Mar 29, 2015 1:36 pm Post subject: |
|
|
spiral78 wrote: |
ESPECIALLY if they haven't addressed the key points:-)
Writing on task is a fairly important factor for proficient users of English - and they are also the ones who don't want to listen/read carefully because they assume they get it instantly. |
Negative washback. This is often a problem of the tester anticipating the prompt and relying on what they think they should write rather than addressing the actual context and/or criteria. |
|
Back to top |
|
 |
adaruby
Joined: 21 Apr 2014 Posts: 171 Location: has served on a hiring committee
|
Posted: Sun Mar 29, 2015 1:42 pm Post subject: |
|
|
nomad soul wrote: |
spiral78 wrote: |
ESPECIALLY if they haven't addressed the key points:-)
Writing on task is a fairly important factor for proficient users of English - and they are also the ones who don't want to listen/read carefully because they assume they get it instantly. |
Negative washback. This is often a problem of the tester anticipating the prompt and relying on what they think they should write rather than addressing the actual context and/or criteria. |
Which is what some try to do with the speaking section.....
Nice to see us singing from the same hymn sheet anyway, NS and Spiral  |
|
Back to top |
|
 |
Sashadroogie

Joined: 17 Apr 2007 Posts: 11061 Location: Moskva, The Workers' Paradise
|
Posted: Sun Mar 29, 2015 2:41 pm Post subject: |
|
|
nomad soul wrote: |
spiral78 wrote: |
ESPECIALLY if they haven't addressed the key points:-)
Writing on task is a fairly important factor for proficient users of English - and they are also the ones who don't want to listen/read carefully because they assume they get it instantly. |
Negative washback. This is often a problem of the tester anticipating the prompt and relying on what they think they should write rather than addressing the actual context and/or criteria. |
Testee or tester? : ) |
|
Back to top |
|
 |
nomad soul

Joined: 31 Jan 2010 Posts: 11454 Location: The real world
|
Posted: Sun Mar 29, 2015 2:46 pm Post subject: |
|
|
Sashadroogie wrote: |
Testee or tester? : ) |
Oops! The test taker.
Thanks, Sasha! |
|
Back to top |
|
 |
johnslat

Joined: 21 Jan 2003 Posts: 13859 Location: Santa Fe, New Mexico, USA
|
Posted: Sun Mar 29, 2015 2:55 pm Post subject: |
|
|
Dear nomad soul,
Glad to see that Sasha's query didn't make you testy.
Regards,
John |
|
Back to top |
|
 |
nomad soul

Joined: 31 Jan 2010 Posts: 11454 Location: The real world
|
Posted: Sun Mar 29, 2015 3:00 pm Post subject: |
|
|
johnslat wrote: |
Dear nomad soul,
Glad to see that Sasha's query didn't make you testy. |
You're silly.
I figured he was just testing me.  |
|
Back to top |
|
 |
kazpat
Joined: 04 Jul 2010 Posts: 140 Location: Kazakhstan
|
Posted: Sun Mar 29, 2015 3:44 pm Post subject: |
|
|
Thanks for the replies. I get the whole flowery language - showing off thing. During the speaking exams the kids were trying to use idioms and most often it comes out just awful. The examiner gave us a heads up to tell them to keep it simple.
The teacher with a 5 for example, on a problem / solution essay she will identify causes, present solutions, has excellent grammar control, stays on topic, etc. She actually teaches an A level Cambridge course called Global Perspectives. A good portion of the course deals with proper essay writing. I got a MEd. in Leadership not TESOL but have a CELTA and several years teaching K-12 ESL and the practice essays looked good to me.
Maybe several of them did what has been suggested in this thread.
It will be interesting to see the results of the re-marking. |
|
Back to top |
|
 |
spiral78

Joined: 05 Apr 2004 Posts: 11534 Location: On a Short Leash
|
Posted: Sun Mar 29, 2015 4:09 pm Post subject: |
|
|
Yes, do let us know! |
|
Back to top |
|
 |
Dedicated
Joined: 18 May 2007 Posts: 972 Location: UK
|
Posted: Sun Mar 29, 2015 5:54 pm Post subject: |
|
|
I am an IELTS examiner for the writing and this is actually quite a common phenomenon.
Remember the criteria for IELTS writing -
Answering the question
Coherence and cohesion
Vocabulary
Grammar.
Task 1 is quite formulaic, and many students lose marks by writing a list rather than picking out the main trends, differences or stages and using a wide range of comparative structures.
Task 2, the essay, nearly always asks about your opinion/do you agree - you must specifically say this. Students who are studying EAP often forget this and say 'This essay will discuss..' which is incorrect. There must be 4 or 5 clear paragraphs and no less than 250 words or you will not get more than Band 7.0.
An academic essay is different from an IELTS essay. |
|
Back to top |
|
 |
Sashadroogie

Joined: 17 Apr 2007 Posts: 11061 Location: Moskva, The Workers' Paradise
|
Posted: Mon Mar 30, 2015 7:56 pm Post subject: |
|
|
Where does it say there must be 4 or 5 paragraphs? Or maximum of band 7 for not meeting the word count? Was I asleep during the last re-cert? |
|
Back to top |
|
 |
scot47

Joined: 10 Jan 2003 Posts: 15343
|
Posted: Tue Mar 31, 2015 11:36 am Post subject: |
|
|
Low scores on Writing in IELTS are very common with students from the Middle East. There is no magic cure, but a good Writing Course geared at IELTS might do the trick. |
|
Back to top |
|
 |
MuscatGary
Joined: 03 Jun 2013 Posts: 1364 Location: Flying around the ME...
|
Posted: Tue Mar 31, 2015 11:41 am Post subject: |
|
|
scot47 wrote: |
Low scores on Writing in IELTS are very common with students from the Middle East. There is no magic cure, but a good Writing Course geared at IELTS might do the trick. |
Reading regularly is the key to writing well. It isn't going to happen with ME students. |
|
Back to top |
|
 |
|