Assessing Critical Thinking Ability via the Writing Process: Developing and implementing a Rating Scale (Research Paper)

Document Type : Original Article

Authors

1 English Department, Islamic Azad University, Science and Research Branch, Tehran, Iran

2 TEFL Department, IAU, North Tehran Branch

Abstract

The present exploratory mixed methods study aimedto develop a scale for assessing critical thinking (CT) ability of Iranian EFL learners. The study wasconducted in three phases. In phase one, the features of CT components were examined in the writingsof 120 participants. A holistic and an analytic scale were developed based on their performance in exploiting the components of CT and the features of CT components.In the second phase, the language learners' new writing samples (N=110) were analyzed to examine to what extent they could employ the CT components.Also, the reliability and validity of the newly developed scale was calculated. Factor analysis revealed that the scale measured the four constructs of clarity, fairness-breadth, depth- significance-logicalness, and accuracy-precision-relevance.In the final phase, the researchers implemented the newly developed scale on a new group of learners (N=33)to observe the degree the scale couldassess the CT ability of language learners.

Keywords

Article Title [Persian]

ارزیابی توانایی تفکر انتقادی از طریق مهارت نوشتاری: طراحی و اجرای یک مقیاس ارزیابی

Authors [Persian]

  • ریحانه شیخی بهدانی 1
  • مژگان رشتچی 2
1
2
Abstract [Persian]

The present exploratory mixed methods study aimedto develop a scale for assessing critical thinking (CT) ability of Iranian EFL learners. The study wasconducted in three phases. In phase one, the features of CT components were examined in the writingsof 120 participants. A holistic and an analytic scale were developed based on their performance in exploiting the components of CT and the features of CT components.In the second phase, the language learners' new writing samples (N=110) were analyzed to examine to what extent they could employ the CT components.Also, the reliability and validity of the newly developed scale was calculated. Factor analysis revealed that the scale measured the four constructs of clarity, fairness-breadth, depth- significance-logicalness, and accuracy-precision-relevance.In the final phase, the researchers implemented the newly developed scale on a new group of learners (N=33)to observe the degree the scale couldassess the CT ability of language learners.

Keywords [Persian]

  • مهارت نوشتاری: مقیاس ارزیابی: عناصر تفکر: توانایی تفکر انتقادی

References

REFERENCES
Akef, K. (2007). Assessing the steps adopted by Iranian student writers in their writing process: A model for developing rating scale descriptors (Unpublished doctoral dissertation), Islamic Azad University, Tehran, Iran.
Angelo, T.A., & Cross, K. P. (1993).Classroom assessment techniques: A handbook for college teachers. San Francisco, CA:Jossey-Bass.
Bailin, S.,  Case, R., Coombs, J. R., & Daniels, L. B. (1999). Conceptualizing critical thinking.Journal of Curriculum Studies, 31(3), 285-302.http://dx.doi.org/10.1080/002202799183133
Beyer, B. (1987).Practical strategies for the teaching of thinking. Boston, MA: Allyn& Bacon.
Case, R. (2005).Moving CT to the main stage.Education Canada, 45 (2), 45-49.
Creswell, J. W., & Plano Clark, V. L. (2011).Designing and conducting mixed methods research. London: Sage.
Ennis, R. H. (1987). A taxonomy of critical thinking dispositions and abilities. In J. B. Baron & R. J. Sternberg (Eds.), Teaching thinking skills: Theory and practice (pp. 9-26). New York, NY: W. H. Freeman.
Ennis, R. H. (1993). Critical thinkingassessment.Theory into Practice, 33 (3), 179-186.http://dx.doi.org/10.1080/00405849309543594
Ennis, R. H. (2003). Critical thinking assessment.In D. Fasko (Ed.), Critical thinking and reasoning (pp. 293-310). Cresskill, NJ: Hampton Press.
Ennis, R. H., &Norris, S. P. (1990). Critical thinking evaluation: Status, issues, needs. In J. Algina& S. M. Legg (Eds.), Cognitive assessment of language and math outcomes (pp. 1-42). Norwood, MA: Ablex.
Ennis, R. H., & Weir, E. (1985).The Ennis-Weir critical thinking essay test. Pacific Grove, CA: Midwest.
Facione, P. A. (1990). Critical thinking: A statement of expert consensus for purposes of educational assessment and instruction. Millbrae, CA: The California Academic Press.
Facione, P. A. (2000). The disposition toward critical thinking: Its character, measurement, and relation to critical thinking skill. Informal Logic, 20 (1), 61-84.
Facione, P. A., &Facione, N. C. (1992).The California critical thinking dispositions inventory (CCTDI) and CCTDI test manual. Millbrae, CA: California Academic Press. 
Gellin, A. (2003). The effect of undergraduate student involvement on critical thinking: A meta-analysis of the literature 1991-2000. Journal of College Student Development, 4 (6), 746-762. http://dx.doi.org/10.1353/csd.2003.0066
Halpern, D. F. (1998).Teaching critical thinking for transfer across domains: Dispositions, skills, structure, training, and metacognitive monitoring.American Psychologist, 53 (4), 449-455.http://dx.doi.org/10.1037/0003-066X.53.4.449
Halpern, D. F. (2003).Thought and knowledge: An introduction to critical thinking. Mahwah, NJ: Laurence Erlbaum.
Hamp-Lyons, L. (1991). Assessing second language writing in academic contexts. Norwood, MA: Ablex.
Hatch, E., &Lazaraton, A. (1991).The research manual: Design and statistics for applied linguistics. Boston, MA: Heinle&Heinle.
Henri, F., &Rigault, C. R. (1996).Collaborative distance learning and computer conferencing. In T. T. Liao (Ed.), Advancededucational technology: Research issues and future potential (pp. 45-74). New York, NY: Springer-Verlag.
Kaiser, H. F. (1974). An index of factorial analysis simplicity.Psychometrika, 39, 31-36. http://dx.doi.org/10.1007/bf02291575
Kroll, B., & Reid, J. (1994). Guidelines for designing writing prompts: Clarifications, caveats, and cautions. Journal of Second Language Writing, 3 (3), 231-255.http://dx.doi.org/10.1016/1060-3743(94)90018-3
Ku, K. Y. L. (2009). Assessing students' critical thinking performance: Urging for measurements using multi-response format. Thinking Skills and Creativity, 4(1), 70-76. http://dx.doi.org/10.1016/j.tsc.2009.02.001
Kuhn, D. (1999). A developmental model of critical thinking.Educational Researcher, 28 (2), 16-26.http://dx.doi.org/10.3102/0013189X028002016
Lipman, M. (1988). Critical thinking: What can it be? Educational Leadership, 46 (1), 38-41.
McLean, C. L. (2005). Evaluating critical thinking skills: Two conceptualization. Journal of Distance Education, 20 (2), 1-20.
McMillan, J. (1987). Enhancing college student's critical thinking: A review of studies.Research in Higher Education, 26, 3-29.
McPeck, J. E. (1981). Critical thinking and education. New York, NY: St Martin's Press.
Norris, S. P. (2003). The meaning of critical thinking test performance: The effects of abilities of abilities and dispositions on scores. In D. Fasko (Ed.), Critical thinking and reasoning: Current research, theory and practice. Cresskill, NJ: Hampton Press. 
Norris, S. P. & Ennis, R. H. (1989).Evaluating critical thinking. Pacific Grove, CA: Midwest.
Norris, S. P., Ennis, R. H. (1989). Evaluating critical thinking.Pacific Grove: Critical thinking Books and Software.
Nosich, G. (2012). A model for the national assessment of higher order thinking. In R. Paul (Ed.), Critical thinking: What every student needs to survive in a rapidly changing world (pp. 78-123). Dillon Beach, CA: Foundation for Critical Thinking.
O'Hare, L. O., &McGuinness, C. (2009).Measuring critical thinking, intelligence, and academic performance in psychology undergraduates.The Irish Journal of Psychology, 30 (3-4), 123-131. http://dx.doi.org/10.1080/03033910.2009.10446304
Paul, R. (2012). Critical thinking: What every person needs to survive in a rapidly changing world. Dillon Beach, CA: Foundation for Critical Thinking.
Paul, R., & Elder, L. (2003).The thinker's guide to how to write a paragraph: The art of substantive writing. Dillon Beach, CA: Foundation for Critical Thinking.
Paul, R., & Elder, L. (2006).Critical thinking: Concepts and tools.The Foundation of Critical Thinking.Retrieved fromhttps://www.criticalthinking.org/files/Concepts_Tools.pdf
Paul, R., & Elder, L. (2007).Consequential validity: Using assessment to drive instruction. Retrieved from: www.criticalthinking .org
Paul, R., & Elder, L. (2014).Critical thinking: Tools for taking charge of your professional and personal life. Cranbury, NJ:Pearson.
Perkins, D. N., Jay, E., &Tishman, S. (1993). Beyond abilities: A dispositional theory of thinking. Merrill Palmer Quarterly, 39, 1.
Stupple, E. N. J., Maratos, F.A., Elander, J., Hunt, T. E., Cheung, K. Y. F., Aubeeluck, A. V. (2017). Development of critical thinking toolkit (CriTT): A measure of student attitudes and beliefs about critical thinking. Thinking Skills & Creativity, 23, 91-100.http://dx.doi.org/10.1016/j.tsc.2016.11.007
Taube, K. T. (1997). Critical thinking ability and disposition as features of performance on a written critical thinking test. Journal of General Education, 46, 129-164.
White, R., & Arndt, V. (1991).Process writing. London: Longman.
 
Iranian Journal of English for Academic Purposes
Volume 5, Issue 2 - Serial Number 2016
September 2016
Pages 123-142

Files

History

  • Receive Date: 20 September 2017
  • Accept Date: 20 September 2017

Share

How to cite

Statistics