Computerized Testlet Instrument for Assessing Students’ Chemical Literacy in High School

Sri Yamtinah, Sulistyo Saputro, Sri Mulyani, Ari Syahidul Shidiq

Abstract

Teaching chemistry must contribute to students’ chemical literacy skills. However, the teacher pays a little attention to preparing assessment instruments to measure these skills. This research aims to assess students’ chemical literacy skills by using a computerized testlet assessment instrument. The purpose-designed survey method was used in this research. The subjects used in this study were 240 students from 3 different representative schools in Boyolali, Central Java, Indonesia. This instrument was developed in the form of multiple choice, which is arranged hierarchically and consists of 10 stem and 30 supporting questions. Hypertext Preprocessor programming language was used to develop the computerized testlet assessment instrument. The analysis menu provided on this instrument includes analysis of item quality of students’ chemical literacy skills The research result proves that the computerized testlet instrument facilitates the process of assessing for the teacher. The quality of the items used and students’ chemical literacy skills can be analyzed automatically. The students have good chemical literacy skills in the indicators of identifying questions and finding scientific information. However, they still have low chemical literacy on the indicators of interpreting scientific evidence and drawing conclusions. This research provides novelty to the types of instruments used to measure students’ chemical literacy skills.

 

Keywords: assessment instrument, chemical literacy, computerized testlet.

 

 


Full Text:

PDF


References


OSBORNE J. & DILLON J. Science education in Europe: Critical reflections London: The Nuffield Foundation, 2008

CIGDEMOGLU C. & GEBAN O. Improving students’ chemical literacy levels on thermochemical and thermodynamics concepts through a context-based approach. Chemistry Education Research and Practice, 2015, 16, 2: 302–317.

TURIMAN P., OMAR J., DAUD A.M. & OSMAN K. Fostering the 21st Century Skills through Scientific Literacy and Science Process Skills. Social and Behavioral Sciences, 2012, 59: 110–116.

AD’HIYA E. & LAKSONO E.W. Development and validation of an integrated assessment instrument to assess students’ analytical thinking skills in chemical literacy. International Journal of Instruction, 2018, 11, 4: 241–256.

SHWARTZ Y., BEN-ZVI R. & HOFSTEIN A. Chemical Literacy: What Does This Mean to Scientists and School Teachers ? Journal of Chemical Education, 2006, 83, 10: 1557–1561.

FAHMINA S.S., INDRIYANTI N.Y., SETYOWATI W. et al. Dimension of Chemical Literacy and its Influence in Chemistry Learning. Journal of Physics: Conference Series, 2019, 1233, 1. https://doi.org/10.1088/1742-6596/1233/1/012026

HAZEN R.M. & TREFIL J.S. Acchieving Chemical Literacy. Journal of Chemical Education, 1991, 68, 5: 392–394.

BOND D. In pursuit of chemical literacy: A place for chemical reactions Journal of Chemical Education, 1989, 66, 2: 157–160.

THUMMATHONG R. & THATHONG K. Chemical literacy levels of engineering students in Northeastern Thailand. Kasetsart Journal of Social Sciences, 2018, 39, 3: 478–487.

KHATRI R., HENDERSON C., COLE R FROYD J., et al. Characteristics of well-propagated teaching innovations in undergraduate STEM. International Journal of STEM Education, 2017, 4, 1.

YAMTINAH S., SAPUTRO S., MULYANI S. et al. Do students have enough scientific literacy? A computerized testlet instrument for measuring students’ scientific literacy. AIP Conference Proceedings, 2019, 2194, 020143: 1–8.

SHIDIQ A.S., YAMTINAH S. & MASYKURI M. Identifying and addressing students’ learning difficulties in hydrolysis using testlet instrument. AIP Conference Proceedings, 2019, 2194, 020117: 1–8.

WAINER H., BRADLOW E.T., & WANG X. Testlet Response Theory and Its Applications Cambridge: Cambridge University Press, 2013.

SHIDIQ A.S., YAMTINAH S. & MASYKURI M. Assessing Science Process Skills using Testlet Instrument. In Assessment for Improving Students’ Performance 2016: 231–234.

HUANG H.Y. & WANG W.C. Higher Order Testlet Response Models for Hierarchical Latent Traits and Testlet-Based Items. Educational and Psychological Measurement, 2013, 73, 3: 491–511.

YAMTINAH S., MASYKURI M., ASHADI M. & SHIDIQ A.S. An Analysis of Students’ Science Process Skills in Hydrolysis Subject Matter Using Testlet Instrument. Advances in Social Science, Education and Humanities Research, 2017, 158: 101–110.

YAMTINAH S., MASYKURI M. & SHIDIQ A.S. Gender Differences in Students ’ Attitudes toward Science : An Analysis of Students ’ Science Process Skill using Testlet Instrument. AIP Conference Proceedings, 2017, 1868, 030003: 1–6.

RATNA I.S., YAMTINAH S., ASHADI MASYKURI M. & SHIDIQ A.S. The Implementation of Testlet Assessment Instrument in Solubility and Solubility Product Material for Measuring Students’ Generic Science Skills. Advances in Social Science, Education and Humanities Research, 2017, 158: 958–963.

LUTVIANA E., RAHARDJO S.B., SUSANTI E. et al. The computer-assisted testlet assessment instrument to measure students ’ learning difficulties in chemical bonding. Journal of Physics: Conference Series 2019, 1156, 01201: 1–5.

TONG Y. & KOLEN M.J. Comparisons of methodologies and results in vertical scaling for educational achievement tests. Applied Measurement in Education, 2007, 20, 2: 227–253.

CHANG Y. & WANG J. Examining testlet effects on the PIRLS 2006 assessment. In 4th IEA International Research Conference. 2010.

LUECHT R., BRUMFIELD T. & BREITHAUPT K.J. A Testlet Assembly Design for Adaptive Multistage Tests Applied Measurement in Education, 2006, 19, 3: 189–202.

GRIFFIN P., CARE E. & MCGAW B. Assessment and Teaching of 21st Century Skills Dordrecht: Springer Netherlands, 2012.

GRIFFIN P., MCGAW B. & CARE E. Assessment and Teaching of 21st Century Skills Melbourne: Springer. 2015.

KHLAISANG J. & KORANEEKIJ P. Open online assessment management system platform and instrument to enhance the information, media, and ICT literacy skills of 21st century learners. International Journal of Emerging Technologies in Learning, 2019, 14, 7: 111–127.

BAHATI B., FORS U., HANSEN P., NOURI J. & MUKAMA E. Measuring learner satisfaction with formative e-assessment strategies. International Journal of Emerging Technologies in Learning, 2019, 14, 7: 61–79.

BANERES D., BARÓ X., GUERRERO-ROLDÁN A.E. & RODRÍGUEZ M.E. Adaptive e-assessment system: A general approach. International Journal of Emerging Technologies in Learning, 2016, 11, 7: 16–23.

YAMTINAH S., MASYKURI M., ASHADI M. & SHIDIQ A.S. An Analysis of Students’ Science Process Skills in Hydrolysis Subject Matter Using Testlet Instrument. Proceedings of the International Conference on Technics, Technologies and Education, (ICTTE 2017). 2017, 158: 101–110.

LI Y., BOLT D.M. & FU J. A test characteristic curve linking method for the testlet model. Applied Psychological Measurement 2005, 29, 5: 340–356.

LIN Y.C., YANG D.C. & LI M.N. Diagnosing students’ misconceptions in number sense via a web-based two-tier test. EURASIA Journal of Mathematics, Science and Technology Education, 2016, 12, 1: 41–55.

KUO B., DAUD M. & YANG C. Multidimensional Computerized Adaptive Testing for Indonesia Junior High School Biology. EURASIA Journal of Mathematics, Science and Technology Education, 2015, 11, 5: 1105–1118.

CALVO M., CARNICER A., CUADROS J., et al. Computer-Assisted Assessment in Open-Ended Activities through the Analysis of Traces : A Proof of Concept in Statistics with R Commander. EURASIA Journal of Mathematics, Science and Technology Education, 2019, 15, 9.

CARE E., & GRIFFIN P. Assessment and Teaching of 21st Century Skills. Dordrecht: Springer. 2015.

CARE E., GRIFFIN P. AND WILSON M. Assessment and Teaching of 21st Century Skills Cham: Springe. 2018.

URBANI J.J.M. et al., Assessment and Teaching of 21st Century Skills. Educación Química, 2017, 1, 1: 1709–1716.

TAASOOBSHIRAZI G. & CARR M. Gender Differences in Science: An Expertise Perspective Educational Psychology Review, 2008, 20: 149–169.

GREENFIELD T.A. Gender and Grade Level Differences in Science Interest and Participation. Science Education, 1996, 81: 259–276.

BUNTTING C., KEVIN R. & CAMPBELL A. Student views of concept mapping use in introductory tertiary biology classes. International Journal of Science and Mathematics Education, 2006, 4: 641–668.

COLL R.K., ALI S., BONATO J. & ROHINDRA D. Investigating first-year chemistry learning difficulties in the South Pacific: A case study from Fiji. International Journal of Science and Mathematics Education, 2006, 4, 3: 365–390.

IRWANSYAH F.S., LUBAB I., FARIDA I. & RAMDHANI M.A. Designing Interactive Electronic Module in Chemistry Lessons. Journal of Physics: Conference Series 2017, 895: 12009.


Refbacks

  • There are currently no refbacks.