E-ISSN 2277-338X | ISSN 2320-4664
 

Original Research 


Study of standard setting in constructed response type written examination

Chinmay Shah, Dhaval Parmar, Rasmika Parmar.

Cited by (1)

Abstract
Background: Standard setting is the process of determining what the minimum requirements are to be deemed knowledgeable, or competent to practice. In it, the items prepared for the student assessment is standardized before and/or after the student assessment process. The main objective of standard setting is to determine the cut-off score, or pass mark, of an item or a test.

Aims & Objective: Objective of the present study was to look at standard setting of summative assessment.

Materials and Methods: Present retrospective study of previous 5 years theory papers used Modified Angoff & Hofstee method.

Results: It is observed that Cut-off score of all 5 years by Modified Angoff method was set below 50% while same was set above 50% when derived using Hofstee method. Thus, the Hofstee method consistently produced more stringent passing scores than the Modified Angoff method. Study showed statistically significant difference between averages of cut-off scores obtained by the two methods.

Conclusion: Study provided us with an insight regarding standard setting i.e. standard setting must be done in concert with the test development process and not be treated as a last or separate step independent of the process. It also puts emphasis on the need of variability in cut-off score in different summative examination depending on difficulty level of the paper.

Key words: Standard Setting, Constructed Response Type Examination, Assessment


 
ARTICLE TOOLS
Abstract
PDF Fulltext
Print this article Print this Article
How to cite this articleHow to cite this article
Citation Tools
Related Records
 Articles by Chinmay Shah
Articles by Dhaval Parmar
Articles by Rasmika Parmar
on Google
on Google Scholar
Article Statistics
 Viewed: 3725
Downloaded: 715
Cited: 1


REFERENCES
1. Lilley PM, Harden RM. Standards and medical education. Med Teach 2003;25:349-51. [DOI via Crossref]    [Pubmed]   
2. An Information Brief from ACT. Available from: URL: http://www.act.org/workforce/cewd.html
3. Kane M. Validating the performance standards associated with passing score. Rev Educ Res 1994;64:425-61. [DOI via Crossref]   
4. Barman A. Standard Setting in Student Assessment: Is a Defensible Method Yet to Come? Ann Acad Med Singapore 2008;37:957-63. [Pubmed]   
5. Cusimano MD. Standard setting in medical education. Acad Med 1996;71:S112-20. [DOI via Crossref]    [Pubmed]   
6. Isaac IB. Standard Setting: What Is It? Why Is It Important? R & D Connections; 2008:7.
7. Schoeman, Scarpa. Setting standards in health sciences education – a wake-up call. African Journal of Health Professions Education 2011;3:2.
8. Assessment in undergraduate medical education: Supplementary advice to Tomorrow's Doctors. General Medical Council 2011. p. 1-23.
9. Bandaranayake RC. Setting and maintaining standards in multiple choice exami¬nations: AMEE Guide No. 37. Med Teach 2008;30:836-45. [DOI via Crossref]    [Pubmed]   
10. Berk RA. A consumer's guide to setting performance standard oncriterion-referenced tests. Rev Educ Res 1986;56:137-72. [DOI via Crossref]   
11. Bhandary S. Standard Setting in Health Professions Education. Kathmandu Univ Med J (KUMJ) 2011;9:3-4.
12. Norcini JJ. Setting standards on educational tests. Med Educ 2003;37:464-9. [DOI via Crossref]    [Pubmed]   
13. Kaufman DM, Mann KV, Muijtjens AMM, van der Vlueten CPM. A Comparison of Standard-setting Procedures for and OSCE in Undergraduate Medical Education. Academic Medicine 2000;75:267 – 71 . [DOI via Crossref]    [Pubmed]   
14. George S, Haque MS, Oyebode F. Standard setting: comparison of twomethods. BMC Med Educ 2006;6:46. [DOI via Crossref]    [Pubmed]    [PMC Free Fulltext]   
15. Dunn L, Parry S, Morgan C. Seeking quality in criterion reference assessment. Presented at: Learning Communities and assessment Cultures Conference organized by the EARLI Special Interest Group on Assessment and Evaluation. University of Northumbria, 28-30 August 2002. Available from: URL: http://www.leeds.ac.uk/educol/documents/00002257.htm.
16. Harden RM. Ten questions to ask when planning a course or curriculum. Med Educ 1986;20:356-65. [DOI via Crossref]    [Pubmed]   
17. Glaser R. Instructional technology and the measurement of learning outcomes: Some questions. Am Psychol 1963;18:519-21. [DOI via Crossref]   
18. Glass GV. Standard and criteria. J EducMeas 1978;15:237-61. [DOI via Crossref]   
19. Downing SM, Tekian A, Yudkowsky R. Proceduresfoe establishing defensible absolute passing scores on performance examinations in health professions education. Teach Learn Med 2006;18:50-7. [DOI via Crossref]    [Pubmed]   
20. Ben-David MF. AMEE Guide No. 18: Standard setting in student assessment. AMEE Guide. Medical Teacher 2000;22: 120-30. [DOI via Crossref]   
21. Boursicot K, Roberts T. Setting standards in a professional higher education course: Defining the concept of the minimally competent student in performance based assessment at the level of graduation from medical school. Higher Education Quarterly 2006;60:74-90. [DOI via Crossref]   
22. Wayne DB, Fudala MJ, Butter J, Siddall VJ, Feinglass J, Wade LD, et al. Comparison of two standard setting methods for advanced cardiac life support training. Academic Medicine 2005;80:S63-6. [DOI via Crossref]    [Pubmed]   
23. Kramer A, Muijtjens A, Jansen K, Dusman H, Tan L, Vleuten C. Comparison of a rational and an empirical standard setting procedure for an OSCE. Medical Education 2003;37:132-9. [DOI via Crossref]    [Pubmed]   
24. Linn RL. Performance standards: Utility for different uses of assessments. Educ Pol Anal Arch 2003;11:1-20.
25. Boursicot KA, Roberts TE, Pell G. Standard setting for clinical competence at graduation From medical school: a comparison of passing scores across five medical schools. Adv Health SciEduc Theory Pract 2006;11:173-83. [DOI via Crossref]    [Pubmed]   
26. Cizek GJ. Reconsidering standards and criteria. J EducMeas 1993;30: 93-106. [DOI via Crossref]   
27. Verhoeven BH, Verwijnen GM, Muijtjens AMM, Scherpbier AJJA, van der Vleuten CPM. Panel expertise for an Angoff standard setting procedure in progress testing: item writerscompared to recently graduated students. Medical Education 2002;36:860-7. [DOI via Crossref]    [Pubmed]   
28. Norcini JJ, Shea JA. The credibility and comparability of standards. Applied Measurement in Education 1997;10:39-59. [DOI via Crossref]   
29. Norcini JJ, Guille RA. Combining tests and setting standards. International Handbook of Research in Medical Education 2002. p. 811-34.
30. George S, Haque MS, Oyebode F. Standard setting: Comparison of two method. BMC Med Educ 2006;6:46. [DOI via Crossref]    [Pubmed]    [PMC Free Fulltext]   

This Article Cited By the following articles

General principles to consider when designing a clinical communication assessment program
Patient Education and Counseling 2017; 100(9): 1762.

1
 
How to Cite this Article
Pubmed Style

Chinmay Shah, Dhaval Parmar, Rasmika Parmar. Study of standard setting in constructed response type written examination. Int J Med Sci Public Health. 2014; 3(9): 1046-1050. doi:10.5455/ijmsph.2014.170620142


Web Style

Chinmay Shah, Dhaval Parmar, Rasmika Parmar. Study of standard setting in constructed response type written examination. http://www.ijmsph.com/?mno=160115 [Access: August 24, 2019]. doi:10.5455/ijmsph.2014.170620142


AMA (American Medical Association) Style

Chinmay Shah, Dhaval Parmar, Rasmika Parmar. Study of standard setting in constructed response type written examination. Int J Med Sci Public Health. 2014; 3(9): 1046-1050. doi:10.5455/ijmsph.2014.170620142



Vancouver/ICMJE Style

Chinmay Shah, Dhaval Parmar, Rasmika Parmar. Study of standard setting in constructed response type written examination. Int J Med Sci Public Health. (2014), [cited August 24, 2019]; 3(9): 1046-1050. doi:10.5455/ijmsph.2014.170620142



Harvard Style

Chinmay Shah, Dhaval Parmar, Rasmika Parmar (2014) Study of standard setting in constructed response type written examination. Int J Med Sci Public Health, 3 (9), 1046-1050. doi:10.5455/ijmsph.2014.170620142



Turabian Style

Chinmay Shah, Dhaval Parmar, Rasmika Parmar. 2014. Study of standard setting in constructed response type written examination. International Journal of Medical Science and Public Health, 3 (9), 1046-1050. doi:10.5455/ijmsph.2014.170620142



Chicago Style

Chinmay Shah, Dhaval Parmar, Rasmika Parmar. "Study of standard setting in constructed response type written examination." International Journal of Medical Science and Public Health 3 (2014), 1046-1050. doi:10.5455/ijmsph.2014.170620142



MLA (The Modern Language Association) Style

Chinmay Shah, Dhaval Parmar, Rasmika Parmar. "Study of standard setting in constructed response type written examination." International Journal of Medical Science and Public Health 3.9 (2014), 1046-1050. Print. doi:10.5455/ijmsph.2014.170620142



APA (American Psychological Association) Style

Chinmay Shah, Dhaval Parmar, Rasmika Parmar (2014) Study of standard setting in constructed response type written examination. International Journal of Medical Science and Public Health, 3 (9), 1046-1050. doi:10.5455/ijmsph.2014.170620142





Most Viewed Articles
  • Management of Appendicular Lump: Early exploration Vs conservative management
    Chandra Prakash Pandey, Ram Chandra Kesharwani, Chandra Gopal Singh Chauhan, Manmohan Krishna Pandey, Purnima Mittra, Pramod Kumar, Arshad Raza
    Int J Med Sci Public Health. 2013; 2(4): 1046-1049
    » Abstract & References » doi: 10.5455/ijmsph.2013.230820131

  • Internet addiction among professional courses students: A study from central India
    Arvind Sharma, Rupesh Sahu, Pradeep Kumar Kasar, Richa Sharma
    Int J Med Sci Public Health. 2014; 3(9): 1069-1073
    » Abstract & References » doi: 10.5455/ijmsph.2014.180620142

  • Burden of non communicable diseases in India: Setting priority for action
    Kalpa Sharma
    Int J Med Sci Public Health. 2013; 2(1): 7-11
    » Abstract & References » doi: 10.5455/ijmsph.2013.2.7-11

  • Diabetic nephropathy: Progression and pathophysiology
    Deepak N Parchwani, Amit A Upadhyah
    Int J Med Sci Public Health. 2012; 1(2): 59-70
    » Abstract & References » doi: 10.5455/ijmsph.2012.1.59-70

  • Elevated levels of serum uric acid, creatinine or urea in preeclamptic women
    Magna Manjareeka, Sitikantha Nanda
    Int J Med Sci Public Health. 2013; 2(1): 43-47
    » Abstract & References » doi: 10.5455/ijmsph.2013.2.43-47

  • Maternal and fetal outcome in oligohydramnios- Study of 100 cases
    Krishna Jagatia, Nisha Singh, Sachin Patel
    Int J Med Sci Public Health. 2013; 2(3): 724-727
    » Abstract & References » doi: 10.5455/ijmsph.2013.070520132

  • Zinc: The trace element of major importance in human nutrition and health
    Jayant D Deshpande, Mohini M Joshi, Purushottam A Giri
    Int J Med Sci Public Health. 2013; 2(1): 1-6
    » Abstract & References » doi: 10.5455/ijmsph.2013.2.1-6

  • Knowledge, Attitude, and Practices (KAP) study on HIV / AIDS among HIV patients, care givers and general population in north-eastern part of India.
    L P Meena, S K Pandey, M Rai, Anju Bharti, Shyam Sunder
    Int J Med Sci Public Health. 2013; 2(1): 36-42
    » Abstract & References » doi: 10.5455/ijmsph.2013.2.36-42

  • Patient satisfaction about health care services: A cross sectional study of patients who visit the outpatient department of a civil hospital at Surendranagar, Gujarat
    Krupal Joshi, Kishor Sochaliya, Shyamal Purani, Girija Kartha
    Int J Med Sci Public Health. 2013; 2(3): 659-663
    » Abstract & References » doi: 10.5455/ijmsph.2013.250420131

  • Prevalence and pattern of substance abuse among school childern in nothern India: A rapid assesment study
    Syed Shuja Qadri, RKD Goel, Jagjeet Singh, Surendra Kumar Ahluwalia, Rambha Pathak, Humaira Bashir
    Int J Med Sci Public Health. 2013; 2(2): 273-282
    » Abstract & References » doi: 10.5455/ijmsph.2013.2.271-280

  • Most Downloaded
  • Minor disorder of pregnancy and its home management
    Lata Gururani, Atul Kumar, Gomathi Mahalingam
    Int J Med Sci Public Health. 2016; 5(4): 684-687
    » Abstract & References » doi: 10.5455/ijmsph.2016.03082015111

  • Association between serum ferritin and thyroid hormone profile in hypothyroidism
    Ashuma Sachdeva, Veena Singh, Isha Malik, Prasanta Saha Roy, Himanshu Madaan, Rajesh Nair
    Int J Med Sci Public Health. 2015; 4(6): 863-865
    » Abstract & References » doi: 10.5455/ijmsph.2015.24012015174

  • Internet addiction among professional courses students: A study from central India
    Arvind Sharma, Rupesh Sahu, Pradeep Kumar Kasar, Richa Sharma
    Int J Med Sci Public Health. 2014; 3(9): 1069-1073
    » Abstract & References » doi: 10.5455/ijmsph.2014.180620142

  • Effect of sleep deprivation on the attitude and performance of medical students, Riyadh, Saudi Arabia
    Hussein Saad Amin, Ibrahim Salamah Almazroua, Abdullah Sulaiman Alsahlan, Mohammed Abdullah Alrishan, Houssam Mourad Elmourad, Mohammed Mansour Alotaibi, Abdulaziz Ibrahim Almohaisin
    Int J Med Sci Public Health. 2016; 5(3): 575-580
    » Abstract & References » doi: 10.5455/ijmsph.2016.17112015207

  • Management of Appendicular Lump: Early exploration Vs conservative management
    Chandra Prakash Pandey, Ram Chandra Kesharwani, Chandra Gopal Singh Chauhan, Manmohan Krishna Pandey, Purnima Mittra, Pramod Kumar, Arshad Raza
    Int J Med Sci Public Health. 2013; 2(4): 1046-1049
    » Abstract & References » doi: 10.5455/ijmsph.2013.230820131

  • Epidemiology and prevalence of dermatological diseases among schoolchildren of Medak district, Telanganaa clinical survey
    Lakshmi Kumari Villa, Gopi Krishna
    Int J Med Sci Public Health. 2016; 5(7): 1475-1478
    » Abstract & References » doi: 10.5455/ijmsph.2016.28102015238

  • Gunthers with haemolytic anaemia extremly rare: A case report
    Nilesh Kumar, Ankur Varshney, Arvind Anand, Dibyaranjan Behera, Ravi Anand, Ashutosh Tiwari
    Int J Med Sci Public Health. 2013; 2(2): 472-474
    » Abstract & References » doi: 10.5455/ijmsph.2013.2.313-315

  • Diabetic nephropathy: Progression and pathophysiology
    Deepak N Parchwani, Amit A Upadhyah
    Int J Med Sci Public Health. 2012; 1(2): 59-70
    » Abstract & References » doi: 10.5455/ijmsph.2012.1.59-70

  • Patient satisfaction about health care services: A cross sectional study of patients who visit the outpatient department of a civil hospital at Surendranagar, Gujarat
    Krupal Joshi, Kishor Sochaliya, Shyamal Purani, Girija Kartha
    Int J Med Sci Public Health. 2013; 2(3): 659-663
    » Abstract & References » doi: 10.5455/ijmsph.2013.250420131

  • Burden of non communicable diseases in India: Setting priority for action
    Kalpa Sharma
    Int J Med Sci Public Health. 2013; 2(1): 7-11
    » Abstract & References » doi: 10.5455/ijmsph.2013.2.7-11

  • Most Cited Articles
  • Zinc: The trace element of major importance in human nutrition and health
    Jayant D Deshpande, Mohini M Joshi, Purushottam A Giri
    Int J Med Sci Public Health. 2013; 2(1): 1-6
    » Abstract & References » doi: 10.5455/ijmsph.2013.2.1-6
    Cited : 25 times [Click to see citing articles]

  • Burden of non communicable diseases in India: Setting priority for action
    Kalpa Sharma
    Int J Med Sci Public Health. 2013; 2(1): 7-11
    » Abstract & References » doi: 10.5455/ijmsph.2013.2.7-11
    Cited : 13 times [Click to see citing articles]

  • Design of fuzzy expert system for diagnosis of cardiac diseases
    Smita Sushil Sikchi , Sushil Sikchi , M S ALI
    Int J Med Sci Public Health. 2013; 2(1): 56-61
    » Abstract & References » doi: 10.5455/ijmsph.2013.2.56-61
    Cited : 9 times [Click to see citing articles]

  • Sugammadex associate persistant bradycardia
    Murat Bilgi, Abdullah Demirhan, Akcan Akkaya, Umit Yasar Tekelioglu, Hasan Kocoglu
    Int J Med Sci Public Health. 2014; 3(3): 372-374
    » Abstract & References » doi: 10.5455/ijmsph.2013.251220131
    Cited : 8 times [Click to see citing articles]

  • Migration and health-care access: Barriers to access government health services by migrant tribal community living in an eastern Indian city
    Suchismita Mishra, Yadlapalli S Kusuma, Bontha V Babu
    Int J Med Sci Public Health. 2015; 4(1): 101-108
    » Abstract & References » doi: 10.5455/ijmsph.2015.0110201424
    Cited : 7 times [Click to see citing articles]

  • Clinico-microbiological profile of women with vaginal discharge in a tertiary care hospital of northern India
    Varsha Chaudhary, Ved Prakesh, Kian Agarwal, Vijender Kumar Agrawal, Arun Singh, Sachin Pandey
    Int J Med Sci Public Health. 2012; 1(2): 75-80
    » Abstract & References » doi: 10.5455/ijmsph.2012.1.75-80
    Cited : 6 times [Click to see citing articles]

  • Correlation between obesity and cardio respiratory fitness
    Prabha Setty, BV Padmanabha, BR Doddamani
    Int J Med Sci Public Health. 2013; 2(2): 300-304
    » Abstract & References » doi: 10.5455/ijmsph.2013.2.298-302
    Cited : 6 times [Click to see citing articles]

  • Knowledge, Attitude, and Practices (KAP) study on HIV / AIDS among HIV patients, care givers and general population in north-eastern part of India.
    L P Meena, S K Pandey, M Rai, Anju Bharti, Shyam Sunder
    Int J Med Sci Public Health. 2013; 2(1): 36-42
    » Abstract & References » doi: 10.5455/ijmsph.2013.2.36-42
    Cited : 6 times [Click to see citing articles]

  • Non albicans Candida species: its isolation pattern, species distribution, virulence factors and antifungal susceptibility profile
    Sachin Chandrakant Deorukhkar, Santosh Saini
    Int J Med Sci Public Health. 2013; 2(3): 533-538
    » Abstract & References » doi: 10.5455/ijmsph.2013.080320131
    Cited : 6 times [Click to see citing articles]

  • Initial default among tuberculosis patients diagnosed in selected medical colleges of Puducherry: issues and possible interventions
    Divija Pillai, Anil J Purty, Stalin Prabakaran, Zile Singh, Govindarajan Soundappan, Velavan Anandan
    Int J Med Sci Public Health. 2015; 4(7): 957-960
    » Abstract & References » doi: 10.5455/ijmsph.2015.30012015196
    Cited : 6 times [Click to see citing articles]