The Development of Concept Inventory Assessment Integrated with STEM Literacy to Measure Students’ Creative Thinking Skills: A Need Analysis
Abstract
Improving 21st-century skills and STEM literacy is the main goal of STEM education for students. Assessment is crucial since it is the outcome of the learning process that can be used as a benchmark for students' abilities. This study aimed to analyze teacher needs for product development in an integrated concept inventory assessment with STEM literacy to measure creative thinking skills. This is descriptive qualitative research. Closed surveys, unstructured interviews, and documentation studies were all used to obtain data. The participants in this study were 30 physics teachers from various Indonesian high schools. The results showed that teachers have a diverse understanding of the development concept inventory integrated with STEM literacy, so it is very important to develop this happens because the teachers do not have sufficient experience in making assessments. The teacher made the assessment, and still, in the form of questions towards mathematical completion, there is no literacy charge and is not associated with phenomena in the real world. In addition, the assessment that the teacher has made has not been tested for validity and reliability. The obstacles teachers face are short, and they do not have a deep understanding of STEM literacy in their learning. Therefore, those teachers want a good assessment that can combine the concepts of physics and its application. The teachers' interest in product development shows that 96.7% (29) of teachers are interested and need the development of a STEM literacy-based concept inventory assessment to measure creative thinking skills.
Keywords: assessment, concept inventory, STEM literacy, creative thinking skills, needs analysis.
Full Text:
PDFReferences
FAKHRIYAH, F., MASFUAH, S., and MARDAPI, D. Developing Scientific Literacy-Based Teaching Materials to Improve Students’ Computational Thinking Skills. Jurnal Pendidikan IPA Indonesia, 2019, 8: 482-491.
MARTZ, W.B., HUGHES, J., and BRAUN, F. Creativity and Problem-Solving: Closing the Skills Gap. Journal of Computer Information Systems, 2017, 57: 39-48.
KIM, S., RAZA, M., and SEIDMAN, E. Improving 21st-century teaching skills: The key to effective 21st-century learners. Research in Comparative and International Education, 2019, 14: 117-99.
RIZAL, R., RUSDIANA, D., SETIAWAN, W., and SIAHAAN, P. Creative thinking skills of a prospective physics teacher. ICMScE, 2020, 1521(022012).
AMRINA, Z., DESFITRI, R., ZUZANO, F., WAHYUNI, Y., HIDAYAT, H., and ALFINO, J. Developing Instruments to Measure Students' Logical, Critical, and Creative Thinking Competencies for Bung Hatta University Students. International Journal of Engineering and Technology, 2018, 7(4.9): 128–131.
SUMARNI, W., and KADARWATI, S. Ethno-Stem Project-Based Learning: Its Impact to Critical and Creative Thinking Skills. Jurnal Pendidikan IPA Indonesia, 2020, 9(1): 11-21.
MANSYUR, J., KAHARU, S.N., and HOLDSWORTH, J.L. A Simple Approach to Teach Newton’s Third Law. Jurnal Pendidikan IPA Indonesia, 2020, 9(1): 79-90.
FALLOON, G., HATZIGIANNI, M., BOWER, M., FORBES, A., and STEVENSON, M.E. Understanding K-12 STEM Education: a Framework for Developing STEM Literacy. Journal of Science Education and Technology, 2020, 29(3): 369-385.
N.A. National Research Council, STEM Integration in K-12 Education: Status, Prospects, and an Agenda for Research. Washington, DC: The National Academies Press, 2014.
TECHAKOSIT, S., and NILSOOK, P. The Development of STEM Literacy Using the Learning Process of Scientific Imagineering through AR. iJET, 2018, 13(1): 230-238.
MCGUNAGLE, D.M., and ZIZKA, L. Employability skills for 21st-century STEM students: the employers' perspective. Higher Education, Skills and Work-based Learning, 2020, 10(3): 591-606.
HAYFORD, B., BLOMSTROM, S., and MUMPOWER, L.A. Formation and Assessment of a Tool to Evaluate STEM Literacy in Service-Learning Projects. Journal on excellence in college teaching, 2018, 26(4): 73-101.
JACKSON, C., MOHR-SCHROEDER, M.J., BUSH, S.B., MAIORCA, C., ROBERTS, T., YOST, C., and FOWLER, A. Equity-Oriented Conceptual Framework for K-12 STEM literacy. International Journal of STEM Education, 2021, 8(38): 1-16.
LAWLESS, K.A., BROWN, S.W., and BOYER, M.A. Educating Students for STEM Literacy: GlobalEd 2. Technology, Theory, and Practice in Interdisciplinary STEM Programs: Connecting STEM and Non-STEM Approaches, 2016: 53–82.
KHUYEN, N.T., BIỂN, N.V., LIN, P.L., LIN, J., and CHANG, C. Measuring Teachers’ Perceptions to Sustain STEM Education Development. Sustainability, 2020, 12(1531): 1–15.
LAVERTY, J.T., and CABALLERO, M.D. Analysis of the Most Common Concept Inventories in Physics: What Are We Assessing?. Physical Review: Physical Education, 2018, 14(1): 10123.
SUJARWANTO, E., MADLAZIM, and SANJAYA, I. A conceptual framework of STEM education based on the Indonesian Curriculum. Journal of Physics: Conference Series, 2021, 1760.
PUTRANTA, H., and SUPAHAR, S. Development of Physics-Tier Tests (PysTT) to Measure Students' Conceptual Understanding and Creative Thinking Skills: A Qualitative Synthesis. Journal for the Education of Gifted Young Scientists, 2019, 7(3): 747–775.
HARRIS, A., and BRUIN, L.R. Training teachers for twenty-first-century creative and critical thinking: Australian implications from an international study. Teaching Education, 2018, 29: 234 - 250.
MADSEN, A.M., MCKAGAN, S.B., and SAYRE, E.C. Best Practices for Administering Concept Inventories. The Physics Teacher, 2014, 55: 530-536.
WELLS, J., HENDERSON, R., STEWART, J., STEWART, G., YANG, J., and TRAXLER, A. Exploring the structure of misconceptions in the Force Concept Inventory with modified module analysis. Physical Review Physics Education Research, 2019, 15(2): 20122.
MĄDRALA, M., WĄSIK, M., and MALOSZEWSKI, P. Interpretation of environmental tracer data for conceptual understanding of groundwater flow: an application for fractured aquifer systems in the Kłodzko Basin, Sudetes, Poland. Isotopes in Environmental and Health Studies, 2017, 53: 466 - 483.
CHEN, Q., ZHU, G., LIU, Q., HAN, J., FU, Z., and BAO, L. Development of a multiple-choice problem-solving categorization test to assess student knowledge structure. Physical Review Physics Education Research, 2020, 16(2): 20120.
MOHR-SCHROEDER, M.J., BUSH, S.B., MAIORCA, C., and NICKELS, M. Moving Toward an Equity-Based Approach for STEM Literacy. London: Routledge, 2020.
DARE, E., RING-WHALEN, E.A., and ROEHRIG, G.H. Creating a continuum of STEM models: Exploring how K-12 science teachers conceptualize STEM education. International Journal of Science Education, 2019, 41(12): 1701-1720.
WILLIAMS, M. STEM Literacy: Challenges implementing ‘E’ in local Texas-STEM academies. 2015 IEEE Frontiers in Education Conference (FIE), 2015, 1-5.
VEENA. Importance of Needs Analysis in Curriculum Development for Vocational Purposes Lecturer in English. International Journal of English Language, Literature in Humanities, 2016, 4(5): 440–449.
PUSHPANATHAN, L.N.T. A Need for Needs Analysis. International Journal of Applied Research and Studies, 2014, 2(1): 1–6.
CRIȘAN, C., PAVELEA, A., and GHIMBULUŢ, O. A Need Assessment on Students’ Career Guidance. Procedia - Social and Behavioral Sciences, 2015, 180: 1022-1029.
ABRAHAM, R.R., ALELE, F.O., KAMATH, U., KURIEN, A., RAI, K.S., BAIRY, I., RAO, M.K., RAO, G., DEVI, V., RAO, Y.K., SEN GUPTA, T.K., and MALAU-ADULI, B.S. Assessment for learning: a needs analysis study using formative assessment to evaluate the need for curriculum reform in basic sciences. Advances in physiology education, 2018, 42(3): 482-486.
ARY, D., JACOBS, L.C., and SORENSEN, C.K. Introduction to Research in Education, Eighth Edi. Belmont: WADSWORTH CENGANGE Learning, 2010.
SPRADLEY, J. The Ethnographic Interview. New York: Holt Rinehart and Winston, 1979.
SUGIYONO, S. Metode Penelitian Kuantitatif dan Kualitatif dan RandD. Bandung, 2010.
ANIKARNISIA, N.M., and WILUJENG, I. Need assessment of STEM education-based based on local wisdom in junior. Journal of Physics: Conference Series, the fifth International Seminar on Science Education 26 October 2019, Yogyakarta, Indonesia, 2020, 1440: 1–7.
GRANT, J.R. Learning needs assessment: assessing the need. BMJ: British Medical Journal, 2002, 324: 156-159.
MILES, J., HUBERMAN, M.B., and SALDANA, A.M. Qualitative Data Analysis: A Methods Sourcebook. London: Sage, 2014.
BURKHOLDER, E., WALSH, C., and HOLMES, N.G. Examination of quantitative methods for analyzing data from concept inventories. Physical Review Physics Education Research, 2020, 16(1): 10141.
BEKAERT, H., VAN WINCKEL, H., VAN DOOREN, W., STEEGEN, A., and DE COCK, M. Design and validation of an instrument to test students’ understanding of the apparent motion of the Sun and stars. Physical Review Physics Education Research, 2020, 16(2): 20135.
GAO, X., LI, P., SHEN, J., and SUN, H. Reviewing assessment of student learning in interdisciplinary STEM education. International Journal of STEM Education, 2020, 7(1): 1-14.
SUYITNO. Metode Penelitian Kualitatif Konsep, Prinsip, dan Operasionalnya. Tulungagung: Akademia Pustaka, 2018.
LIU, Q., KOENIG, K., and XIAO, Q.L. Analysis of Two-Tier Question Scoring Methods : A Case Study on The Lawson’s Classroom Test. Physical Review Physics Education Research, 2019, 20(1): 146–159.
Refbacks
- There are currently no refbacks.
