Raters’ Decision Making Variations in Scoring Writing Samples
| Main Author: | Dabiri, Asma |
|---|---|
| Format: | Article info application/pdf eJournal |
| Bahasa: | eng |
| Terbitan: |
University of Muhammadiyah Prof. DR. HAMKA
, 2018
|
| Online Access: |
https://journal.uhamka.ac.id/index.php/jer/article/view/905 https://journal.uhamka.ac.id/index.php/jer/article/view/905/708 |
| ctrlnum |
article-905 |
|---|---|
| fullrecord |
<?xml version="1.0"?>
<dc schemaLocation="http://www.openarchives.org/OAI/2.0/oai_dc/ http://www.openarchives.org/OAI/2.0/oai_dc.xsd"><title lang="en-US">Raters’ Decision Making Variations in Scoring Writing Samples</title><creator>Dabiri, Asma</creator><description lang="en-US">This study examined raters’ decision making variations in a writing assessment task focusing on individual differences in decision-making style (DMS). The participants’ of the study were six TEFL instructors. A rating scale obtained from Turner and Upshur, 2002 and a General Decision Making Style Inventory questionnaire, GDMSI, obtained from Scott and Bruce (1995) were administered to raters. The results showed the raters’ behaviors were not equally the same in the same rating situations. These discrepancies suggested individual socio-cognitive differences in accounting for some rater variability in scoring. In addition, characteristics of the texts (not just individual cognitive characteristics) favored certain decision-making behaviors. Accordingly, a re-visioning of the one-size-fits-all approach that is currently the norm in the training of raters for scoring writing assessments is needed. Further, a more individualized approach to rater training is needed. If the individual decision-making style to a great extent is dependent on basic cognitive abilities that are stable and not easily changed, then the decision support systems need to be flexible in order to match the needs of the individual decision makers.</description><publisher lang="en-US">University of Muhammadiyah Prof. DR. HAMKA</publisher><date>2018-09-10</date><type>Journal:Article</type><type>Other:info:eu-repo/semantics/publishedVersion</type><type>Journal:Article</type><type>File:application/pdf</type><identifier>https://journal.uhamka.ac.id/index.php/jer/article/view/905</identifier><identifier>10.22236/JER_Vol3Issue2pp142-151</identifier><source lang="en-US">Journal of ELT Research: The Academic Journal of Studies in English Language Teaching and Learning; 2018: Journal of ELT Research, Vol. 3 , Issue 2; 142-151</source><source>2527-7448</source><source>2502-292X</source><source>10.22236/JER_Vol3Issue2</source><language>eng</language><relation>https://journal.uhamka.ac.id/index.php/jer/article/view/905/708</relation><rights lang="en-US">Copyright (c) 2018 Asma Dabiri</rights><rights lang="en-US">https://creativecommons.org/licenses/by-nc-nd/4.0</rights><recordID>article-905</recordID></dc>
|
| language |
eng |
| format |
Journal:Article Journal Other:info:eu-repo/semantics/publishedVersion Other File:application/pdf File Journal:eJournal |
| author |
Dabiri, Asma |
| title |
Raters’ Decision Making Variations in Scoring Writing Samples |
| publisher |
University of Muhammadiyah Prof. DR. HAMKA |
| publishDate |
2018 |
| url |
https://journal.uhamka.ac.id/index.php/jer/article/view/905 https://journal.uhamka.ac.id/index.php/jer/article/view/905/708 |
| contents |
This study examined raters’ decision making variations in a writing assessment task focusing on individual differences in decision-making style (DMS). The participants’ of the study were six TEFL instructors. A rating scale obtained from Turner and Upshur, 2002 and a General Decision Making Style Inventory questionnaire, GDMSI, obtained from Scott and Bruce (1995) were administered to raters. The results showed the raters’ behaviors were not equally the same in the same rating situations. These discrepancies suggested individual socio-cognitive differences in accounting for some rater variability in scoring. In addition, characteristics of the texts (not just individual cognitive characteristics) favored certain decision-making behaviors. Accordingly, a re-visioning of the one-size-fits-all approach that is currently the norm in the training of raters for scoring writing assessments is needed. Further, a more individualized approach to rater training is needed. If the individual decision-making style to a great extent is dependent on basic cognitive abilities that are stable and not easily changed, then the decision support systems need to be flexible in order to match the needs of the individual decision makers. |
| id |
IOS3444.article-905 |
| institution |
Universitas Muhammadiyah Prof. DR. HAMKA |
| institution_id |
472 |
| institution_type |
library:university library |
| library |
Perpustakaan Universitas Muhammadiyah Prof. DR. HAMKA |
| library_id |
549 |
| collection |
JOURNAL OF ELT RESEARCH |
| repository_id |
3444 |
| subject_area |
Bahasa Kesusastraan Sosial dan Budaya |
| city |
JAKARTA SELATAN |
| province |
DKI JAKARTA |
| repoId |
IOS3444 |
| first_indexed |
2019-05-06T00:48:49Z |
| last_indexed |
2020-08-18T05:56:56Z |
| recordtype |
dc |
| _version_ |
1685951544327929856 |
| score |
17.60897 |