The right kind of example. Cobblers? Or, 'Cobblers!'
Posted: Wed Feb 09, 2005 1:47 pm
You'll need to plough through this at some point (but I think it's a good paper, and therefore worth it):
http://www.er.uqam.ca/nobel/r21270/cv/replace_conc.htm
Sorry about its length (and the length of this post too!). You should perhaps just skip down to the highlighted section (between vvv and ^^^ symbols) below in this post! The main question I want to ask everyone is to be found there, anyway (that is, everything before the vvv/^^^ bit is just "for your information", just a summary of the less contentious parts of Cobb's paper with a few additional comments from me).
Summary: After the opening preamble for his paper (entitled 'Do corpus-based electronic dictionaries replace concordancers?' - incidentally, he is talking about online, free versions of learner dictionaries, not versions on CD ROM or in pocket-sized machines), Cobb asks four questions before reaching his conclusions.
The answer to the first ('What is the quantity of examples in an online entry?') is obviously going to be 'Much less than a concordancer', with the equally obvious corollary that there will be more waiting for an 'enterprising learner...to discover' than can be fitted into a dictionary (I haven't checked though to see if the findings he points out in relation to collocates of the complain word family are in fact 'vague or absent even from a good dictionary', especially a paper version). His fourth question is pretty much a refinement of the thrust of his first.
The main thing of interest to me in his answer to his first question were his comments about the relative merits of each of the then* available online dictionaries. Cobb initially (in this section of his paper) compares the Longman Dictionary of Contemporary English 3rd Web edition with two substantially smaller learner ones (the Cambridge Learner's and Collins COBUILD Student's Dictionary Online [CCSD Online]) - no prizes for guessing which of these emerges as the best.
However, Cobb then goes on to point out the advantages and flexibility of concordances over dictionaries in answering his third question ('How accessible are the examples in an online dictionary?'), and in doing so, leads into a short discussion of the superiority of Cambridge's advanced learner dictionaries (the CIDE, and now the CALD) for his purposes (providing students with/directing them, as homework or correction of other homework, to the exact information - "tailored feedback" - that they need, in the form of specific subentry/submeaning URLs, rather than links which in the case of the LDOCE 'have to be an entire page', that is, a whole dictionary entry with all its potential subsenses):
(No mention of the Oxford (OALDCE6), but then it wasn't available then. In a nutshell, it is also a pop-up window type, and it doesn't even have that "click away with the mouse" function...a bog-standard LDOCE, in other words).
vvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvv
The most interesting part of Cobb's paper must, however, be the answer to his second question ('What is the quality of examples in a learner dictionary?'). I can understand him saying that meaning shouldn't be 'made too evident', that language often passes learner completely by (if it is all very clear and contextualized), but it seems counterintuitive to suggest that a learner's first encounter with a word should be (made) a difficult one, the word a rarer form of the lemma in an only sparsely clued context, and even if it makes total sense to you, would your learners appreciate you adopting this sort of approach? (I for one can see it leading into blissful infrequent oblivion at least).
What do you guys think? Any comments? I was imagining that browsing dictionaries would be a great way to learn words in very adequate (authentic, not too contrived nor too uncontrolled contexts/example sentences), surrounded by a lot of supporting information, but it seems I was wrong - when Cobb says 'What learners find in their learner dictionaries is, of course, a small number of very clear examples', he means it to be damming.
But of course, if, as Cobb concludes, 'the ideal electronic resource for language learning...a blend of dictionary and concordance' is developed as hoped and expected, students will have the best of both worlds available to them at the puch of a button.
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Just a few comments on his 2001 study: If you look at words in the most and least learned categories that have the same number of occurences e.g. 2: sow vs. oars and sheep, or 4: plow vs. drew, are the differences in the mean 'Contextual Support Rating' that high? (I'm not a statistician and its been a while since read anything even remotely technical, so I'm not quite sure how to interpret the s.d. - standard deviation, right?). The thing that seems really obvious is just the raw frequency, the number of times the words were met. It seems a leap to go on from this study to imply that it is the mix of context support levels (i.e. less optimal contextual support), rather than frequency (or, for that matter, clarity) that is the deciding factor in retention.
That being said, I have said at least once elsewhere on Dave's that:
I'd actually be more interested in hearing how you would propose the most frequent 2000-3000 words or so be taught, because they do not form a simple, basic and discrete orderly list of items to be ticked off one by one, but reoccur and recombine much like DNA to produce a wonderful and complex myriad of linguistic forms. In contrast, the more advanced (i.e. less frequent) words are probably easier to acquire simply by virtue of being so much more distinct (they "stand out" more); and they may ultimately only be understandable not so much from context but more by paraphrase (definition) using the more basic words.
http://www.eslcafe.com/forums/teacher/v ... 3131#13131
(The 'An argument for reading in the target language' thread started by Atreju(
))
Still, all I really said there was that less frequent words might be more "distinctive" or memorable meaning if not context-wise, and who's believes that so-called easy words in boring old everyday contexts don't constitute a major challenge and don't just pass learners by without incident or, for that matter, the occassional appreciation?
Hmm, I guess we need to distinguish between the complexities involved in both speech and writing, and understand in more depth exactly how they differ or are similar, and to what extent vocabulary might cross over from one to the other (and in the process be transformed). It's a dinstinction I didn't make clearly enough in the above quote, and one which Cobb himself doesn't either (perhaps we are just to assume from him quoting mainly SL reading studies 'that show that when new words are easy to interpret in fully redundant or "pregnant" contexts, they are often not noticed let alone retained' that he sees the challenge and acquisition opportunities as more lying in written texts, printed or electronic, than speech (but obviously, speech can be transcribed),whereas I tend to always be prioritizing on strenthening speech, to form a stronger basis for literacy, and in turn assured and perhaps as a consequence faster reading and writing development.
*The Cambridge Learner's has been superceded by the International and now Advanced versions, although it is still also one of those available at Cambridge's website; and the CCSD Online still seems to be unavailable through the university link I tried (due to server overdemand/overuse).
http://www.er.uqam.ca/nobel/r21270/cv/replace_conc.htm
Sorry about its length (and the length of this post too!). You should perhaps just skip down to the highlighted section (between vvv and ^^^ symbols) below in this post! The main question I want to ask everyone is to be found there, anyway (that is, everything before the vvv/^^^ bit is just "for your information", just a summary of the less contentious parts of Cobb's paper with a few additional comments from me).

Summary: After the opening preamble for his paper (entitled 'Do corpus-based electronic dictionaries replace concordancers?' - incidentally, he is talking about online, free versions of learner dictionaries, not versions on CD ROM or in pocket-sized machines), Cobb asks four questions before reaching his conclusions.
The answer to the first ('What is the quantity of examples in an online entry?') is obviously going to be 'Much less than a concordancer', with the equally obvious corollary that there will be more waiting for an 'enterprising learner...to discover' than can be fitted into a dictionary (I haven't checked though to see if the findings he points out in relation to collocates of the complain word family are in fact 'vague or absent even from a good dictionary', especially a paper version). His fourth question is pretty much a refinement of the thrust of his first.
The main thing of interest to me in his answer to his first question were his comments about the relative merits of each of the then* available online dictionaries. Cobb initially (in this section of his paper) compares the Longman Dictionary of Contemporary English 3rd Web edition with two substantially smaller learner ones (the Cambridge Learner's and Collins COBUILD Student's Dictionary Online [CCSD Online]) - no prizes for guessing which of these emerges as the best.
However, Cobb then goes on to point out the advantages and flexibility of concordances over dictionaries in answering his third question ('How accessible are the examples in an online dictionary?'), and in doing so, leads into a short discussion of the superiority of Cambridge's advanced learner dictionaries (the CIDE, and now the CALD) for his purposes (providing students with/directing them, as homework or correction of other homework, to the exact information - "tailored feedback" - that they need, in the form of specific subentry/submeaning URLs, rather than links which in the case of the LDOCE 'have to be an entire page', that is, a whole dictionary entry with all its potential subsenses):
Cobb's observations still hold true even though Longman now have the 4th edition of the LDOCE Web version up and running. The Cambridge dictionaries provide URLs, whilst with the Longman, you are confined to jumping around in a pop up box sans address box (actually, although Cobb says - see above quote - of the LDOCE that 'Suppose a learner had written, "He complained about he was never allowed to speak*," and his or her document was returned with the error marked and a link to the LDOCE entry in Figure 3. The link would have to be to the entire page, since the individual pieces of information', how would one even supply the link to the entry beyond the Web dictionary homepage when there is no address box to copy it from? Come on, you PC whizzkids, or do learners just have to manually type in each word and wade through potentially long entries?). Also, there are a host of other dictionaries available to also browse on the Cambridge website. One thing, however, that the Longman does provide is frequency information in both "speech" and "writing" (relative to the size of the corresponding corpora); both dictionaries seem to be "interactive" to similar degrees (e.g. you can click on any word you don't know to be automatically directed to the relevant entry).Unfortunately, all three of the dictionaries under investigation would be quite poor for the purpose of giving learners highly specific examples, because their pages can only be accessed whole and not via particular examples or any other page components. Suppose a learner had written, "He complained about he was never allowed to speak*," and his or her document was returned with the error marked and a link to the LDOCE entry in Figure 3. The link would have to be to the entire page, since the individual pieces of information (even complain, complain about, complain that) cannot be accessed separately. Which part of the entry is the learner supposed to look at?
None of the three dictionaries have separate URLs leading to complain about or any other piece within the entry, i.e. they do not allow targeting of specific lexical or grammatical information. Searching for complain about will either generate an error, or else lead to the general entry for the first word. A concordance, of course, can target very specific information, whether of several words, or parts of words, or either separated by still other words. The dictionary pages are precast wholes, while concordance pages are constructed dynamically, from small pieces, on demand. But is this dictionary limitation one of principle or just of current technology?
.....
A recent addition to the Cambridge online series offers greater accessibility than any of the three dictionaries we have focused on hitherto, as well as greater exploitation of the Internet medium. This dictionary, the Cambridge International Dictionary of English (CIDE, 2002), is not strictly classified as a learner dictionary, but it has much in common with the Longman LDOCE including the within-entry hyperlink (click any word inside the entry and you are led to that word's definition), and this technology will no doubt be re-used in the long awaited Cambridge Advanced Learner's Dictionary. The CIDE has structured its information in far smaller pieces than any other online dictionary, and it has given the pieces their own URLs. The prospects for finer-grained access may be good.
As can be seen on the left side of Figure 6, the main CIDE entry for love (to take a fresh example) asks the enquirer to refine his or her search into one of three directions (love somebody, love something, and love as a tennis score). The main entry is accessed via a URL of the usual kind (http://dictionary.cambridge.org/cmd_sea ... hword=love), and each separate sense has its own URL (e.g., love something is via http://dictionary.cambridge.org/define.asp?key=love*2+0), as do each of several multi-word units involving the term (love triangle, labour of love, and 18 others). In all, the entry has been broken into 23 separate Web pages all with their own URLs. All of these can be fairly easily found, copied, and embedded into a learner's text to provide information about a revision. For example, the learner who writes he is "in love with ice-cream" could be sent to the like something sub-page for reasonably specific help with a revision.
(No mention of the Oxford (OALDCE6), but then it wasn't available then. In a nutshell, it is also a pop-up window type, and it doesn't even have that "click away with the mouse" function...a bog-standard LDOCE, in other words).
vvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvv
The most interesting part of Cobb's paper must, however, be the answer to his second question ('What is the quality of examples in a learner dictionary?'). I can understand him saying that meaning shouldn't be 'made too evident', that language often passes learner completely by (if it is all very clear and contextualized), but it seems counterintuitive to suggest that a learner's first encounter with a word should be (made) a difficult one, the word a rarer form of the lemma in an only sparsely clued context, and even if it makes total sense to you, would your learners appreciate you adopting this sort of approach? (I for one can see it leading into blissful infrequent oblivion at least).
What do you guys think? Any comments? I was imagining that browsing dictionaries would be a great way to learn words in very adequate (authentic, not too contrived nor too uncontrolled contexts/example sentences), surrounded by a lot of supporting information, but it seems I was wrong - when Cobb says 'What learners find in their learner dictionaries is, of course, a small number of very clear examples', he means it to be damming.
But of course, if, as Cobb concludes, 'the ideal electronic resource for language learning...a blend of dictionary and concordance' is developed as hoped and expected, students will have the best of both worlds available to them at the puch of a button.
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Just a few comments on his 2001 study: If you look at words in the most and least learned categories that have the same number of occurences e.g. 2: sow vs. oars and sheep, or 4: plow vs. drew, are the differences in the mean 'Contextual Support Rating' that high? (I'm not a statistician and its been a while since read anything even remotely technical, so I'm not quite sure how to interpret the s.d. - standard deviation, right?). The thing that seems really obvious is just the raw frequency, the number of times the words were met. It seems a leap to go on from this study to imply that it is the mix of context support levels (i.e. less optimal contextual support), rather than frequency (or, for that matter, clarity) that is the deciding factor in retention.
That being said, I have said at least once elsewhere on Dave's that:
I'd actually be more interested in hearing how you would propose the most frequent 2000-3000 words or so be taught, because they do not form a simple, basic and discrete orderly list of items to be ticked off one by one, but reoccur and recombine much like DNA to produce a wonderful and complex myriad of linguistic forms. In contrast, the more advanced (i.e. less frequent) words are probably easier to acquire simply by virtue of being so much more distinct (they "stand out" more); and they may ultimately only be understandable not so much from context but more by paraphrase (definition) using the more basic words.
http://www.eslcafe.com/forums/teacher/v ... 3131#13131
(The 'An argument for reading in the target language' thread started by Atreju(



Still, all I really said there was that less frequent words might be more "distinctive" or memorable meaning if not context-wise, and who's believes that so-called easy words in boring old everyday contexts don't constitute a major challenge and don't just pass learners by without incident or, for that matter, the occassional appreciation?
Hmm, I guess we need to distinguish between the complexities involved in both speech and writing, and understand in more depth exactly how they differ or are similar, and to what extent vocabulary might cross over from one to the other (and in the process be transformed). It's a dinstinction I didn't make clearly enough in the above quote, and one which Cobb himself doesn't either (perhaps we are just to assume from him quoting mainly SL reading studies 'that show that when new words are easy to interpret in fully redundant or "pregnant" contexts, they are often not noticed let alone retained' that he sees the challenge and acquisition opportunities as more lying in written texts, printed or electronic, than speech (but obviously, speech can be transcribed),whereas I tend to always be prioritizing on strenthening speech, to form a stronger basis for literacy, and in turn assured and perhaps as a consequence faster reading and writing development.
*The Cambridge Learner's has been superceded by the International and now Advanced versions, although it is still also one of those available at Cambridge's website; and the CCSD Online still seems to be unavailable through the university link I tried (due to server overdemand/overuse).