Site Search:
 
Speak Korean Now!
Teach English Abroad and Get Paid to see the World!
Korean Job Discussion Forums Forum Index Korean Job Discussion Forums
"The Internet's Meeting Place for ESL/EFL Teachers from Around the World!"
 
 FAQFAQ   SearchSearch   MemberlistMemberlist   UsergroupsUsergroups   RegisterRegister 
 ProfileProfile   Log in to check your private messagesLog in to check your private messages   Log inLog in 

TOPIK SCORES REFLECT HORRIBLE SCORING SYSTEM & FLAW
Goto page 1, 2, 3, 4  Next
 
Post new topic   Reply to topic    Korean Job Discussion Forums Forum Index -> General Discussion Forum
View previous topic :: View next topic  
Author Message
duhweecher



Joined: 06 Nov 2013

PostPosted: Mon Dec 02, 2013 10:51 pm    Post subject: TOPIK SCORES REFLECT HORRIBLE SCORING SYSTEM & FLAW Reply with quote

I have a friend who showed me his score results. I know him pretty well. What I really know is that he's seriously good or close to fluent in Korean. He speaks flawlessly and seems pretty good at reading books in the language. He also has a master's in a subject that was taught entirely in Korean.

He knows that I was a reader for the SAT so I offered to look at his scores. There's clearly something odd.

He's taken the test nearly 15 times and often both the intermediate and advanced levels (over several years). He nearly gets 80 or 90 on all sections (and particularly high in sections on the advanced portion of the test) but ends up getting a 47 or some other random score in only one section, which is below the 50 cut off for getting the score he needs to pass.

I did a rough search online for people with the same problem and found a couple. Is this the general findings?

Had he not taken the test 15 or so odd times and knowing that I've seen him pretty able to focus on the most uninteresting crap for hours at a time, I would suspect that he was just having a bad day. But something seems odd with scoring 80s and then a 47 or 48 in only one section (a section that he scored in the 90s in years prior).

However, I'm thinking that there's something honestly wrong with the scoring system or systematical flawed in terms of the test itself.

How can a person score 80 or 90 consistently then fall to 45 or so in one subject unless either the test is horribly created in terms of difficult from year to year or there being something totally off with the scoring system?

I know that the SAT and GRE exams usually protect against this by also calculating the weighed scores with other exam takers to get a general feel for difficulty.

It really doesn't make sense that people would be deterred from "passing" an exam based on such a strange scoring system.

Can someone educate me on this...I'm planning to take the test and after seeing the results...i.e. a person seemingly fluent in the language (I'm Korean and he speaks and reads a heck of a lot better than me) but they keep failing him? I'm now considering staying away from the flawed system altogether.


Last edited by duhweecher on Mon Dec 02, 2013 11:07 pm; edited 1 time in total
Back to top
View user's profile Send private message
Lucas



Joined: 11 Sep 2012

PostPosted: Mon Dec 02, 2013 11:05 pm    Post subject: Reply with quote

Quote:
He's taken the test nearly 15 times and often both the intermediate and advanced levels. He nearly gets 80 or 90 on all sections (and particularly high in sections on the advanced portion of the test) but ends up getting a 47 or some other random score in only one section, which is below the 50 cut off for getting the score he needs to pass.


White envelope time?
Back to top
View user's profile Send private message
duhweecher



Joined: 06 Nov 2013

PostPosted: Mon Dec 02, 2013 11:09 pm    Post subject: Reply with quote

Lucas wrote:
Quote:
He's taken the test nearly 15 times and often both the intermediate and advanced levels. He nearly gets 80 or 90 on all sections (and particularly high in sections on the advanced portion of the test) but ends up getting a 47 or some other random score in only one section, which is below the 50 cut off for getting the score he needs to pass.


White envelope time?


Sorry I'm seriously new to the system? "White envelope?"
Back to top
View user's profile Send private message
chickenpie



Joined: 24 Dec 2008

PostPosted: Mon Dec 02, 2013 11:12 pm    Post subject: Reply with quote

It's clearly covered in the "Understanding Korean Culture" part of the test.
Back to top
View user's profile Send private message
salutbonjour



Joined: 22 Jan 2013

PostPosted: Tue Dec 03, 2013 12:53 am    Post subject: Reply with quote

Perhaps your friend is consistently weak in one of the section. Usually writing or reading.

The test is divided into 2 sections of 45 minutes where one does 2 tests within 45 minutes. Perhaps your friend is spending 30 minutes doing the grammar section (arguably the easiest one) and 15 minutes doing the writing section (which is often the hardest and most time-consuming).

This is a repeated pattern that I have seen 10+ times among people I know where their average is 70+ thanks to 90+ score in grammar, but they fail because of low score in writing.

I suggest your friend practices the test at home and aims to nail his timing on top of his Korean abilities. Making sure that he can fit easily within the required time.
Back to top
View user's profile Send private message
duhweecher



Joined: 06 Nov 2013

PostPosted: Tue Dec 03, 2013 1:48 am    Post subject: Reply with quote

salutbonjour wrote:
Perhaps your friend is consistently weak in one of the section. Usually writing or reading.

The test is divided into 2 sections of 45 minutes where one does 2 tests within 45 minutes. Perhaps your friend is spending 30 minutes doing the grammar section (arguably the easiest one) and 15 minutes doing the writing section (which is often the hardest and most time-consuming).

This is a repeated pattern that I have seen 10+ times among people I know where their average is 70+ thanks to 90+ score in grammar, but they fail because of low score in writing.

I suggest your friend practices the test at home and aims to nail his timing on top of his Korean abilities. Making sure that he can fit easily within the required time.


Well that's the odd part. He often gets 80 on every part...not just the overall average (his overall average was something like a low to mid 80 range). But (from what I remember) he had nearly zero consistency in terms of which part he had below 50. I think it was between writing and reading. But it's odd to get 90 on writing one time then 47 on another...and confident on his score (assuming timing too). He says he was confident his answers were no worse than other times he's taken any particular part. He's been here for nearly a decade and pretty darn proficient. He didn't say anything specifically about time so I'll ask him.

I studied stats in college and when I saw his results they seemed to smack of either a test creation problem of piss poor scoring methods. I mean we're all teachers and looking at 15 scores with an odd pattern smacks of funny business or just bad methodological scoring.

Thanks for the suggestion I'll definitely point him to this thread!
Back to top
View user's profile Send private message
littlelisa



Joined: 12 Jun 2007
Location: Seoul

PostPosted: Tue Dec 03, 2013 2:28 am    Post subject: Reply with quote

Or bad time management. But I imagine you would know in this case, based on how much you had to rush/guess at the end?

I only took it once, so I can't say. Actually, here's a question. Is there a way to request back your test booklet or your answer sheet? I wouldn't mind reviewing. I know the old tests are online, but I don't remember every single answer I put.
Back to top
View user's profile Send private message
duhweecher



Joined: 06 Nov 2013

PostPosted: Tue Dec 03, 2013 3:03 am    Post subject: Reply with quote

littlelisa wrote:
Or bad time management. But I imagine you would know in this case, based on how much you had to rush/guess at the end?


?
Back to top
View user's profile Send private message
salutbonjour



Joined: 22 Jan 2013

PostPosted: Tue Dec 03, 2013 3:42 am    Post subject: Reply with quote

Also you have to take into account the answer counting. All test takers know that there is 7 or 8 of every answer (never 6 or 9) and that getting a few answers wrong can seriously shift your score in one direction or the other.

I got my best reading score on TOPIK intermediate for level 3 reading when the answers I know were mostly the answers without C. I could understand about 40-45% of the questions which isn't enough to pass, but I had only 1 answer with C. I filled in everything else with a C which gave me 7 more answers.

On the other hand guessing a lot of answers on the wrong number can tug you in the other direction.

It's a stupid test with a lot of variance. But the results are in line with what you handed in apart from perhaps the writing section.
Back to top
View user's profile Send private message
littlelisa



Joined: 12 Jun 2007
Location: Seoul

PostPosted: Tue Dec 03, 2013 4:07 am    Post subject: Reply with quote

duhweecher wrote:
littlelisa wrote:
Or bad time management. But I imagine you would know in this case, based on how much you had to rush/guess at the end?


?


As others mentioned before, the tests are timed.

Grammar/Writing -> 90 minutes for both together
Break
Listening/Reading -> 90 minutes for both together

If you take too long on grammar, you have not enough time for writing, and you rush and get lower marks.

For reading, the time is already pretty tight, so even though listening is set at 45 minutes, if you read too slowly, or take too long reviewing your answers near the beginning of the reading section, you could easily run out of time at the end.
Back to top
View user's profile Send private message
nicwr2002



Joined: 17 Aug 2011

PostPosted: Tue Dec 03, 2013 4:47 am    Post subject: Reply with quote

Another thing that people may not know is that the TOPIK is not geared towards foreigners. It's for Koreans who want to become announcers and such unlike the JLPT.
Back to top
View user's profile Send private message
Drew345



Joined: 24 May 2005

PostPosted: Tue Dec 03, 2013 5:40 am    Post subject: Reply with quote

I'll just reiterate what someone said above. This is true for the intermediate (level3-4) test, but may not be true for the advance (level 5-6), which from your description your friend is probably taking.

For me, doing practice tests, I found the writing to be the hardest, followed by the reading. I found the grammar/vocab to be the easiest.
On the exam, you have 90 minutes to do the writing and grammar/vocab together. So I purposely split the time 30 minutes on grammar and 60 minutes on writing (about) . This probably costs me 20 points from the grammar test, to gain 10 points on the writing test. So, overall I lost 10 points by doing this, but it allowed me to get over 50 on the writing, which was the critical number to avoid failing.

Likewise for the listening / reading. I totally skipped the last listening question and started the reading early.

Working with practice tests (all previous tests are available for download) will help to see the weak and strong areas and you can adjust the time you spend accordingly. Notably, it is probably recommended to give up some easy points on the grammar to gain a few of the more critical points on the writing section.
Back to top
View user's profile Send private message
Popocatepetl



Joined: 14 Oct 2013
Location: Winter in Korea: One Perfect day after another

PostPosted: Tue Dec 03, 2013 5:51 am    Post subject: Re: TOPIK SCORES REFLECT HORRIBLE SCORING SYSTEM & FLAW Reply with quote

duhweecher wrote:
I There's clearly something odd.


It sounds a bit like the driving written test which you basically have to give the wrong answers in order to pass.

The wording of the english questions is nonsensical in places.

Maybe the person they employed to write that particular section has substandard language ability.

Or it was inserted accidentally on-purpose by some jaundiced anti-foreigner person. A cunning, imperceptible curveball to keep the pass rate unreasonably low.
Back to top
View user's profile Send private message
furtakk



Joined: 02 Jun 2009

PostPosted: Tue Dec 03, 2013 7:03 am    Post subject: Reply with quote

nicwr2002 wrote:
Another thing that people may not know is that the TOPIK is not geared towards foreigners. It's for Koreans who want to become announcers and such unlike the JLPT.


No it's not.

시험의 목적
- 한국어를 모국어로 하지 않는 재외동포 · 외국인의 한국어 학습 방향 제시 및 한국어 보급 확대
- 한국어 사용 능력을 측정 · 평가하여 그 결과를 국내 대학 유학 및 취업 등에 활용
Back to top
View user's profile Send private message
duhweecher



Joined: 06 Nov 2013

PostPosted: Tue Dec 03, 2013 3:08 pm    Post subject: Reply with quote

Drew345 wrote:
I'll just reiterate what someone said above. This is true for the intermediate (level3-4) test, but may not be true for the advance (level 5-6), which from your description your friend is probably taking.

For me, doing practice tests, I found the writing to be the hardest, followed by the reading. I found the grammar/vocab to be the easiest.
On the exam, you have 90 minutes to do the writing and grammar/vocab together. So I purposely split the time 30 minutes on grammar and 60 minutes on writing (about) . This probably costs me 20 points from the grammar test, to gain 10 points on the writing test. So, overall I lost 10 points by doing this, but it allowed me to get over 50 on the writing, which was the critical number to avoid failing.

Likewise for the listening / reading. I totally skipped the last listening question and started the reading early.

Working with practice tests (all previous tests are available for download) will help to see the weak and strong areas and you can adjust the time you spend accordingly. Notably, it is probably recommended to give up some easy points on the grammar to gain a few of the more critical points on the writing section.


Final update: He had 10 min left over to review the intermediate writing section and says that it was super easy. After consulting with him he informed me that his answer to the question if there was something you could not do in life explain why and so forth. I'm assuming his essay was simply ignored as off topic because he choose to write a very introspective response that required reading to the end, which I realized while reading the one he rewrote for me. I'm pretty sure that's the problem too. He showed me how he answered the other parts and I didn't find much wrong with his responses.


Last edited by duhweecher on Tue Dec 03, 2013 3:24 pm; edited 1 time in total
Back to top
View user's profile Send private message
Display posts from previous:   
Post new topic   Reply to topic    Korean Job Discussion Forums Forum Index -> General Discussion Forum All times are GMT - 8 Hours
Goto page 1, 2, 3, 4  Next
Page 1 of 4

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum


This page is maintained by the one and only Dave Sperling.
Contact Dave's ESL Cafe
Copyright © 2018 Dave Sperling. All Rights Reserved.

Powered by phpBB © 2001, 2002 phpBB Group

TEFL International Supports Dave's ESL Cafe
TEFL Courses, TESOL Course, English Teaching Jobs - TEFL International