Survey Instrument Validation for a Learner’s Motivation to Attain Digital Badge for Micro-Credential Courses: Cognitive Interview and Validity Test
Abstract
COVID-19 has lately changed the way that people learn and teach by making it accessible at any time, from any location, and for a reasonable price. Traditional face-to-face teaching and learning are losing in popularity as more students choose hybrid or online mode study. The gig economy expansion in today's fast-paced business requires the cultivation of people and specialists with increasingly specific skill sets to fill increasingly specialized positions. Micro-Credential is a prominent actor in 21st-century training and education that offers higher education providers a more dynamic and quick learning style to match these demands. It is observed that learners in Malaysia are substantially new to the Micro-Credential and Digital Badge. Hence, this paper aims to present the findings on survey instrument validation in measuring the motivation of learners to attain the digital badge. The study uses a cognitive interviewing method for pre-test in validating the items of the adopted survey instrument. Then, in a pilot test, the survey instrument is again evaluated to measure the validity and reliability of the items using SPSS statistical software. The findings from the pre-test summarized the feedback and suggestions for improvements in fitting the study context and language used. The improved survey instrument undergoes a pilot test to confirm the validity and reliability of the survey items. The finalized survey instrument is then adopted for the main study with a larger sample of learners – university students, working professionals, business owners, and non-working adults using purposive sampling.
Keywords: digital badge, micro-credential, motivation, survey, pre-test and pilot test.
Full Text:
PDFReferences
ABDULLAH H.S., ALIAS A.K., KOOI A.L.T., KHALIL M.A.K.M., CHOY C.S., and YUSOFF N.M. Guidelines to good practices: micro-credential, Documentation. Malaysian Qualifications Agency, 2020.
ADAMS D., CHUAH K. M., SUMINTONO B., and MOHAMED A. Students’ readiness for e-learning during the COVID-19 pandemic in a South-East Asian university: a Rasch analysis. Asian Education and Development Studies, 2021, 11(2): 324-339. https://www.emerald.com/insight/content/doi/10.1108/AEDS-05-2020-0100/full/html
BACON-SHONE J. Introduction to Quantitative Research Methods. Hong Kong, 2022. https://www.researchgate.net/publication/265793712_Introduction_to_Quantitative_Research_Methods
BANDURA A., FREEMAN W.H., and LIGHTSEY R. Self-Efficacy: The Exercise of Control. Journal of Cognitive Psychotherapy, 1997, 13(2), 158–166. https://doi.org/10.1891/0889-8391.13.2.158
BOPARAI, JASPREET K, SINGH S., and KATHURIA P. How to Design and Validate A Questionnaire: A Guide. Current Clinical Pharmacology, 2018, 13(4): 210-215.
CHE AHMAT N.H., AIZAT BASHIR M.A., RAZALI A.R., and KASOLANG S. Micro-credential in Higher Education Institutions : Challenges and Opportunities. Asian Journal of University Education, 2021, 17(3).
CHIU T.K.F. Digital support for student engagement in blended learning based on self-determination theory. Computers in Human Behavior, 2021, 124: 106909. https://doi.org/10.1016/j.chb.2021.106909
DEMONTE J. Micro-credential for teachers: what three early adopters have learned so far. Report. American Institutes for Research, 2017. https://www.air.org/resource/report/micro-credentials-teachers-what-three-early-adopters-have-learned-so-far
DUKLAS J. Micro-Credentials. Trends in Credit Transfer and Credentialing. Duklas Cornerstone Consulting Inc., 2020. https://www.bccat.ca/pubs/Reports/MicroCredentials2020.pdf
DUNCAN O.J. Assessment of Digital Badges and Microcredentials on Student Learning Outcomes in the Introductory Public Speaking Course. Southern Illinois University Carbondale, 2020. https://opensiuc.lib.siu.edu/cgi/viewcontent.cgi?article=2310andcontext=gs_rp
DYJU, P., and LINDSTROM G. Perceptions and Uses of Digital Badges for Professional Learning Development in Higher Education. Tech Trends, 2017, 61(4): 386-392. https://doi.org/10.1007/s11528-017-0168-2
EASTIN M.S., and LAROSE R. Internet self-efficacy and the psychology of the digital divide. Journal of Computer-Mediated Communication, 2000, 6(1). https://doi.org/10.1111/j.1083-6101.2000.tb00110.x
FERRI F., GRIFONI P., and GUZZO T. Online Learning and Emergency Remote Teaching: Opportunities and Challenges in Emergency Situations. Societies, 2020, 10(4): 86. https://doi.org/10.3390/soc10040086
FIELD A. Discovering Statistics Using IBM SPSS Statistics. SAGE Publications Inc., 2018.
FRENCH D., and BERRY B. Teachers, micro-credential, and the performance assessment movement. Voices in Urban Education, 2017, 46: 37-43. http://badge.aurorak12.org/%0Ahttp://www.annenberginstitute.org
GHASIA M., MACHUMU, H., and DESMET E. Micro-credential in Higher Education Institutions: An Exploratory Study of Its Place in Tanzania. International Journal of Education and Development Using Information and Communication Technology, 2019, 15(1): 233.
GILAL F. G., ZHANG J., PAUL J., and GILAL N.G. The role of self-determination theory in marketing science: An integrative review and agenda for research. European Management Journal, 2019, 37(1): 29-44. https://doi.org/10.1016/j.emj.2018.10.004
HAIR J.F., HULT G.T.M., RINGLE C.M., and SARSTEDT M. A primer on partial least squares structural equation modeling (PLS-SEM). SAGE Publications Inc., 2021.
HAMDAN K.M., AL-BASHAIREH A.M., ZAHRAN Z., AL-DAGHESTANI A., AL-HABASHNEH S., and SHAHEEN A.M. University students’ interaction, Internet self-efficacy, self-regulation and satisfaction with online education during pandemic crises of COVID-19 (SARS-CoV-2). International Journal of Educational Management, 2021, 35(3): 713-725. https://doi.org/10.1108/IJEM-11-2020-0513
HATEM G., ZEIDAN J., and MOREIRA C. Normality testing methods and the importance of skewness and kurtosis in statistical analysis. Science and Technology, 2022, 3(2).
HERNANDEZ H. Testing for Normality: What is the Best Method. ForsChem Research Reports, 2022, 6: 3-38. https://doi.org/10.13140/RG.2.2.13926.14406
ISAAC O., ALDHOLAY A., ABDULLAH Z., and RAMAYAH T. Online learning usage within Yemeni higher education: The role of compatibility and task-technology fit as mediating variables in the IS success model. Computers and Education, 2019, 136: 113-129. https://doi.org/10.1016/j.compedu.2019.02.012
KAUR P., DHIR A., CHEN S., MALIBARI A., and ALMOTAIRI M. Why do people purchase virtual goods? A uses and gratification (UandG) theory perspective. Telematics and Informatics, 2020, 53: 101376. https://doi.org/10.1016/j.tele.2020.101376
KEENGWE J., and HOFMEISTER D. Faculty integration of computer technology into instruction and students’ perceptions of computer use to improve their learning. Journal of Information Technology Education, 2007, 6: 169-179. https://jite.org/documents/Vol6/JITEv6p169-180Keengwe218.pdf
KHAMARUDDIN P. F.M., SAUKI A., OTHMAN KADRI, N.H., RAHIM A.N.C.A., and KADRI A. Technology Acceptance Model Analysis on Students’ Behavioral Intention of Using Moodle for FYP. In: 7th World Engineering Education Forum, 13-16 November, 2017, 2017: 18098472. https://doi.org/10.1109/WEEF.2017.8467082
KHANAM S., TALIB F., and SIDDIQUI J. An instrument validation of TQM enablers and IT resources in Indian ICT organizations. Journal of Systems and Information Technology, 2020, 22(2): 179-200. https://doi.org/10.1108/JSIT-01-2017-0004
KHATUN N. Applications of Normality Test in Statistical Analysis. Open Journal of Statistics, 2021, 11(01): 113-122. https://doi.org/10.4236/ojs.2021.111006
KUO Y. C., TSENG H., and KUO Y.T. Internet self-efficacy, self-regulation, and studenperformance: african-american adult students in online learning. International Journal on E-Learning: Corporate, Government, Healthcare, and Higher Education, 2020, 19(2): 161-180.
KUOY.C., WALKER A.E., SCHRODER K.E.E., and BELLAND B. R. Interaction, Internet self-efficacy, and self-regulated learning as predictors of student satisfaction in online education courses. Internet and Higher Education, 2014, 20: 35-50. https://doi.org/10.1016/j.iheduc.2013.10.001
BONSAKSEN T. BITS Scale Table. 2013. https://www.researchgate.net/figure/tems-of-the-general-self-efficacy-scale_tbl1_258852251
MASSEY M. The development and testing of a module on child functioning for identifying children with disabilities on surveys. II: Question development and pretesting. Disability and Health Journal, 2018, 11(4): 502-509. https://doi.org/10.1016/j.dhjo.2018.06.006
MICROHE. Challenges and Opportunities of Micro-credential in Europe. Briefing Paper on the Award, Recognition, Portability and Accreditation of Micro-Credentials: an Investigation through Interviews with Key Stakeholders and Decision Makers. The European Commission, 2019.
PAN X. Technology Acceptance, Technological Self-Efficacy, and Attitude Toward Technology-Based Self-Directed Learning: Learning Motivation as a Mediator. Frontiers in Psychology, 2020, 11(October). https://doi.org/10.3389/fpsyg.2020.564294
PERKINS J., and PRYOR M. Digital badges: Pinning down employer challenges. Journal of Teaching and Learning for Graduate Employability, 2021, 12(1): 24-38. https://ojs.deakin.edu.au/index.php/jtlge/
PRASETIYO W.H., NAIDU N.B.M., SARI B.I., MUSTOFA R.H., RAHMAWATI N., WIJAYA G.P.A., and HIDAYAT O.T. Survey data of internet skills, internet attitudes, computer self-efficacy, and digital citizenship among students in Indonesia. Data in Brief, 2021, 39. https://doi.org/10.1016/j.dib.2021.107569
RAFIQUE G.M., MAHMOOD K., WARRAICH N.F., and REHMAN S.U. Readiness for Online Learning during COVID-19 pandemic: A survey of Pakistani LIS students. Journal of Academic Librarianship, 2021, 47(3): 102346. https://doi.org/10.1016/j.acalib.2021.102346
RUDDY C., and PONTE F. Preparing students for university studies and beyond: a micro-credential trial that delivers academic integrity awareness. Journal of the Australian Library and Information Association, 2019, 68(1): 56-67. https://doi.org/10.1080/24750158.2018.1562520
RYAN R.M., and DECI E.L. Intrinsic and extrinsic motivation from a self-determination theory perspective: Definitions, theory, practices, and future directions. Contemporary Educational Psychology, 2020, 61(April): 101860. https://doi.org/10.1016/j.cedpsych.2020.101860
SØREBØ Ø., HALVARI H., GULLI V.F., and KRISTIANSEN R. The role of self-determination theory in explaining teachers’ motivation to continue to use e-learning technology. Computers and Education, 2009, 53(4): 1177-1187. https://doi.org/10.1016/j.compedu.2009.06.001
STANDAGE M., DUDA J.L., and NTOUMANIS N. A test of self-determination theory in school physical education. British Journal of Educational Psychology, 2005, 75(3): 411-433. https://doi.org/10.1348/000709904X22359
STEFANIAK J., and CAREY K. Instilling purpose and value in the implementation of digital badges in higher education. International Journal of Educational Technology in Higher Education, 2019, 16(1). https://doi.org/10.1186/s41239-019-0175-9
THANH T., and DOAN T. The Effect of Perceived Risk and Technology Self-Efficacy on Online Learning Intention : An Empirical Study in Vietnam. The Journal of Asian Finance, Economics and Business, 2021, 8(10): 385-393. https://doi.org/10.13106/jafeb.2021.vol8.no10.0385
UNESCO. 1.3 billion learners are still affected by school or university closures, as educational institutions start reopening around the world. 2020. https://en.unesco.org/news/exams-and-assessments-covid-19-crisis-fairness-centre
WEIGOLD A., and WEIGOLD I.K. Measuring confidence engaging in computer activities at different skill levels: Development and validation of the Brief Inventory of Technology Self-Efficacy (BITS). Computers and Education, 2021, 169(August): 104210. https://doi.org/10.1016/j.compedu.2021.104210
WHEELAHAN L., and MOODIE G. Gig qualifications for the gig economy : micro-credential and the ‘hungry mile.’ Higher Education, 2022, 83(6): 1279-1295. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8331095/
YAU H.K., and CHENG A.L.F. The influence of study mode on the confidence in using technology for learning: An empirical study in hong kong higher education. In: Proceedings of the International MultiConference of Engineers and Computer Scientists March 13 - 15, 2013, Hong Kong, 2013, Vol II.
YOUNG D., WEST R.E., and NYLIN T.A. Value of open microcredentials to earners and issuers: A case study of national instruments open badges. International Review of Research in Open and Distance Learning, 2019, 20(5): 104-121. https://doi.org/10.19173/irrodl.v20i5.4345
GAUTHIER T. The value of microcredentials: The employer's perspective. The Journal of Competency-Based Education, 2020, 5(2): e01209. https://doi.org/10.1002/cbe2.1209
LIM C.L., NAIR P.K., KEPPELL M.J., HASSAN N., and AYUB E. Developing a framework for the university-wide implementation of micro-credentials and digital badges: a case study from a Malaysian private university. In: 2018 IEEE 4th International Conference on Computer and Communications, 2018: 1715-1719.
PANGARIBUAN C.H., HIDAYAT D., PUTRA O.P.B., AGUZMAN G., and FEBRIYANTO R. Digital badge from the perspective of self-determination theory. Palarch’s Journal of Archaeology of Egypt/Egyptology, 2020, 18(1): 116-127.
AHMED D., and GHADA J. Micro-credentials Life and Employability Skills: Evaluating Students’ and Teachers’ Attitudes Towards Implementing Micro-credentials in Higher Education. In: Proceedings of the AUBH E-Learning Conference 2021: Innovative Learning and Teaching - Lessons from COVID-19, 2021.
Refbacks
- There are currently no refbacks.
