Validation of e-learning satisfaction questionnaire for secondary education
DOI:
https://doi.org/10.12795/revistafuentes.2022.19773Keywords:
Questionnaire, validation, factor analysis, satisfaction, electronic learning, education, secondary school students, information technologyAbstract
Satisfaction with e-learning is a key factor in students' assessment of the educational services they receive. Therefore, it is necessary to measure it on an ongoing basis using validated instruments. The objective was to design and validate a questionnaire to measure satisfaction with e-learning (SEV) in secondary school students. The design started with a literature review, followed by open interviews via telephone with teachers and students. The content of the questionnaire, in its first version of 27 items, was corrected through the opinion of five experts and a pilot sample. Subsequently, construct validation was carried out with a sample of 572 students divided into two groups of 286 from seven schools in the Tacna region (Peru). The exploratory factor analysis (EFA) reported a model of seven (7) emerging factors grouping 22 items. The confirmatory factor analysis (CFA) validated a plausible model (X2 /g.l. = 2.219, p = 0.0000, CFI = 0.952, TLI = 0.939 and RMSEA = 0.073) of six factors (ICT management, availability of virtual media, evaluation, school work, teaching methodology and school bonding) with 19 items. The reliability analysis of the questionnaire reports ordinal alpha coefficients ranging from 0.88 to 0.926 among its dimensions. It is concluded that SEV is valid for measuring satisfaction with e-learning among secondary school students.
Downloads
References
Alcoba, J. (2012). La clasificación de los métodos de enseñanza en educación superior. Contextos Educativos. Revista de Educación, (15), 93-106. https://doi.org/10.18172/con.657
Amador-Salinas, J., González, V., y Luna, P. (2020). Incremento en la entrega de tareas escolares por medio de la economía de fichas grupal. Revista Digital Internacional De Psicología Y Ciencia Social, 6(2), 372-387. https://doi.org/10.22402/j.rdipycs.unam.6.2.2020.282.372-387
Appuhamilage, K., y Torii, H. (2019). The impact of loyalty on the student satisfaction in higher education: A structural equation modeling analysis. Higher Education Evaluation and Development, 13(2), 82-96. https://doi.org/10.1108/HEED-01-2019-0003
Asoodar, M., Vaezi, S., y Izanloo, B. (2016). Framework to improve e-learner satisfaction and further strengthen e-learning implementation. Computers in Human Behavior, 63, 704-716. https://doi.org/10.1016/j.chb.2016.05.060
Bartlett, M. S. (1951). A further note on tests of significance. British Journal of Psychology, 4, 1-2. https://doi.org/10.1111/j.2044-8317.1951.tb00299.x
Bawaneh, A. (2020). The Satisfaction Level Of Undergraduate Science Students Towards Using E-Learning And Virtual Classes In Exceptional Condition Covid-19 Crisis. Turkish Online Journal of Distance Education, 22(1), 52-56. https://doi.org/10.17718/tojde.849882
Beavers, A. S., Lounsbury, J. W., Richards, J. K., Huck, S. W., Skolits, G. J., y Esquivel, S. L. (2013). Practical Considerations for Using Exploratory Factor Analysis in Educational Research. Practical Assessment, Research & Evaluation, 18(6). https://doi.org/10.7275/qv2q-rk76
Bervell, B., Umar, I., y Kamilin, M. (2019). Towards a model for online learning satisfaction (MOLS): re-considering non-linear relationships among personal innovativeness and modes of online interaction. Open Learning: The Journal of Open, Distance and e-Learning, 35(2), 1-24. https://doi.org/10.1080/02680513.2019.1662776
Biasutti, M., y El-Deghaidy, H. (2012). Using wiki in teacher education: Impact on knowledge management processes and student satisfaction. Computers & Education, 59(3), 861-872. https://doi.org/10.1016/j.compedu.2012.04.009
Bolliger, D. U., y Anne, E. (2013). Student Satisfaction with Blended and Online Courses Based on Personality Type. Canadian Journal of Learning and Technology, 39(1), 2-23. Retrieve from https://bit.ly/3EQ0JeU
Bolliger, D., y Halupa, C. (2012). Student perceptions of satisfaction and anxiety in an online doctoral program. Distance Education, 33(1), 81-98. https://doi.org/10.1080/01587919.2012.667961
Christensen, L. B., Johnson, B. R., y Turner, A. L. (2015). Métodos de investigación, diseño y análisis (12ª ed.). Pearson.
Chua, C., y Montalbo, J. (2014). Assessing Students' Satisfaction on the Use of Virtual Learning Environment (VLE): An Input to a Campus-wide E-learning Design and Implementation. Journal of Information & Knowledge Management 3(4), 108-116. Retrieve from https://bit.ly/31olhwD
Creswell, J. W. (2009). Research design: Qualitative, quantitative, and mixed methods approaches (3rd ed.). Sage Publications, Inc.
De Vellis, R. F. (2012). Scale Development, Theory and Applications. SAGE.
Del Moral, E., y Villalustre, L. (14 de febrero de 2013). e-Evaluación en entornos virtuales: Herramientas y estrategias. IV Jornadas Internacionales de Campus virtuales. Retrieve from https://bit.ly/3bNdvOO
Dien, J. (2010). Evaluating two-step PCA of ERP data with Geomin, Infomax, Oblimin, Promax, and Varimax rotations. Psychophysiology, 47(1), 170-183. https://doi.org/10.1111/j.1469-8986.2009.00885.x
Escobedo, M., Hernández, A. J., Estebané, V., y Martínez, G. (2016). Modelos de Ecuaciones Estructurales: Características, fases, construcción, aplicación y resultados. Revista Ciencia y Trabajo, 18(55), 16–22. https://doi.org/10.4067/S0718-24492016000100004
Flores, E., Maurera, F., Hadweh, M., Gutiérrez, S. A., Silva-Salse, Á., Peña-Troncoso, S., Castillo-Retamal, F., González, P., Pauvif, F., Bahamondes, V., Zapata, G., Zavala-Crichton, J. P., Maureira, J., Brevis-Yever, M. y Lagos, C. (2021). Nivel de satisfacción de las clases online por parte de los estudiantes de Educación Física de Chile en tiempos de pandemia. Retos, 41, 123-130. https://doi.org/10.47197/retos.v0i41.82907
García, M. (2012). Autorregulación académica como variable explicativa de los procesos de aprendizaje universitario. Profesorado, 16(1), 203-221. Retrieve from https://bit.ly/3qc1qLI
Hair, J., Anderson, R., Tatham, R., y Black, W. (1999). Análisis Multivariante (5ª ed.) Prentice Hall
Hamutoglu, N., Gemikonakli, O., Savasci, M., y Sezen-Gultekin, G. (2018). Development of a Scale to Evaluate Virtual Learning Environment Satisfaction. International Journal of Assessment Tools in Education, 5(2), 201-222. https://doi.org/10.21449/ijate.345150
Harman, H. H. (1962). Análisis factorial moderno. Prensa de la Universidad de Chicago, Chicago.
Herrera, L., Soares de Quadros, M. R., y Soares de Quadros, J. F. (2018). Evaluación de la Calidad en la Educación Superior: Una Revisión de la Literatura a Partir de la Satisfacción Del Alumnado. Cadernos de Pesquisa, 25(2). http://dx.doi.org/10.18764/2178-2229.v25n2p71-89
Hogarty, K., Hines, C., Kromrey, J., Ferron, J., y Mumford, K. (2005). The quality of factor solutions in exploratory factor analysis: The influence of sample size, communality, and overdetermination. Educational and Psychological Measurement, 65, 202-226. https://doi.org/10.1177/0013164404267287
Kaiser, H. F. (1970). A second generation Little Jiffy. Psychometrika, 35, 401-415. https://doi.org/10.1007/BF02291817
Koller, D., Ng, A., Do, C., y Chen, Z. (3 de junio de 2013). Retention and intention in massive open online courses: In depth. Educause Review. Retrieve from https://bit.ly/3BONvxf
Landa, M., y Ramírez, M. (2018). Diseño de un cuestionario de satisfacción de estudiantes para un curso de nivel profesional bajo el modelo de aprendizaje invertido. Páginas De Educación, 11(2), 153-175. https://doi.org/10.22235/pe.v11i2.1632
Lévy, J. & Varela. J. (2006). Modelización con estructuras de covarianzas en Ciencias Sociales: temas esenciales, avanzados y aportaciones especiales. (1a ed.). España: Netbiblo.
Lorenzo-Seva, U., y Ferrando, P. (2006). Factor: a computer program to fit the exploratory Factor Analysis model. Behavioral Research Methods, 38(1), 88-91. https://doi.org/10.3758/BF03192753
Lozano-Lozano, M., Fernández-Lao, C., Cantarero-Villanueva, I., Noguerol, I., Álvarez-Salvago, F., Cruz-Fernández, M., Arroyo-Morales, M., y Galiano-Castillo, N. (2020). A Blended Learning System to Improve Motivation, Mood State, and Satisfaction in Undergraduate Students: Randomized Controlled Trial. J Med Internet Res, 22(5), e17101. Retrieve from https://bit.ly/3ka6HzD
Manzano, D., y Fernández-Mellizo, M. (2019). Origen familiar, uso del tiempo y de las tecnologías de la información. Revista Internacional De Sociología, 77(3), e136. https://doi.org/10.3989/ris.2019.77.3.17.165
Montero-Mora, J. G., y Cantón-Croda, R. M. (2020). Validación de un instrumento para medir satisfacción de usuarios en instituciones educativas del sector privado: ciudad de Xalapa-Enríquez (México). Innovaciones Educativas, 22(32), 122-136. https://doi.org/10.22458/ie.v22i32.2727
Muthén B. (2004). Latent variable analysis: Growth mixture modeling and related techniques for longitudinal data. En D. Kaplan (ed.). Handbook of quantitative methodology for the social sciences. Sage Publications.
Navarro, D., y Samón, M. (2017). Redefinición de los conceptos método de enseñanza y método de aprendizaje. EduSol, 17(60), 26-33. Retrieve from https://bit.ly/3CUekBp
Palvia, S., Aeron, P., Gupta, P., Mahapatra, D., Parida, R., Rosner, R., y Sindhi, S. (2018). Online Education: Worldwide Status, Challenges, Trends, and Implications. Journal of Global Information Technology Management, 21(4), 233-241. https://doi.org/10.1080/1097198X.2018.1542262
Recio, M., y Cabero, J. (2005). Enfoques de aprendizaje, rendimiento académico y satisfacción de los alumnos en formación en entornos virtuales. Pixel-Bit. Revista de Medios y Educación, (25), 93-115. Retrieve from https://bit.ly/3wkdRG5
Rietveld, T., y Hout, R. (1993). Statistical techniques for the study of language and language behaviour. Mouton de Gruyter. https://doi.org/10.1515/9783110871609
Sahin, I., y Shelley, M. (2008). Considering Students' Perceptions: The Distance Education Student Satisfaction Model. Journal of Educational Technology & Society, 11(3), 216-223. Retrieve from https://bit.ly/3bLI8Eq
Sánchez-Torres, J. M., González-Zabala, M. P., y Sánchez, M. P. (2012). La sociedad de la información: génesis, iniciativas, concepto y su relación con las TIC. Revista UIS Ingenierías, 11(1), 113-128. Retrieve from https://bit.ly/3GUVrk5
Strauss, A. y Corbin, J. (1990). Bases de la investigación cualitativa. Técnicas y procedimientos para desarrollar la teoría fundamentada. Editorial Universidad de Antioquia.
Lévy Thompson, B. (2008). Exploratory and Confirmatory Factor Analysis, Understanding concepts and applications. American Psychological Association. https://doi.org/10.1037/10694-000
Valente, R., y Berry, B. (2016). Effects of Perceived discrimination on the school satisfaction of Brazilian high school graduates. BRASILIANA–Journal for Brazilian Studies, 5(1), 405-440. Retrieve from https://bit.ly/2ZUAx3Q
Velicer, W., y Fava, J. (1998). Affects of variable and subject sampling on factor pattern recovery. Psychological Methods, 3(2), 231-251. https://doi.org/10.1037/1082-989X.3.2.231
Yanai, H., y Ichikawa, M. (2007). Factor Analysis. En C. R. Rao y S. Sinharay (eds). Handbook of Statistics 26. Psychometric. Elsevier.
Published
How to Cite
Issue
Section
License
Copyright (c) 2022 Raúl Alberto García Castro, Gilber Chura Quispe, Martín Pedro Llapa Medina, Martín Pedro Arancibia Baspineiro
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
Authors who publish in this journal accept the following conditions:
Authors conserve the copyrights and cede to the journal the right for first publication, with the work registered with the attribution licence of Creative Commons, which allows third parties to use the published work as long as they mention the authorship and the first publication in this journal.
The authors may make other independent and additional contractual agreements for the non-exclusive distribution of the version of the article published in this journal (e.g. include it an institutional repository or publish it in a book) as long as it clearly indicates that the work was first published in this journal.
Authors are allowed and indeed recommended to publish their work on the internet (for example on institutional or personal pages) before and during the revision and publication process, because it can lead to productive exchanges and greater and faster dissemination of the published work (see The Effect of Open Access).
