Meta-evaluation of a Teaching Evaluation System from students perspective
DOI:
https://doi.org/10.12795/revistafuentes.2023.21273Keywords:
Higher Education, academic teaching personnel, teacher qualifications, teacher evaluation, questionnaires, case studies, feedback, educational qualityAbstract
The aim of this study was to carry out a meta-evaluation of the Teaching Evaluation System (TES) of the Autonomous University of Baja California to identify its strengths and aspects of the educational quality in: the Survey of Teaching Competence Evaluation (STCE), the management system of the TES, the administration of the STCE and how the results are used. The study corresponds to a case study that adapted elements of the responsive evaluation model. The non-probabilistic sample was of 10,160 students who answered an on-line questionnaire. The data was processed with univariate analysis techniques and qualitative analysis of the content. It was found a divided opinion with respect to the use of the results, the structure and content of the STCE, and the procedure of application, as well as with the critical remarks towards the TES. However, the global assessment weighted the usefulness of the TES. Conclusions relate to the necessity to better the usability of the results of the teaching evaluation.
Downloads
References
Afifi, A., May, A., Donatello, R. A., y Clark, V. A. (2020). Data visualization. En Practical Multivariate Analysis (6ta. ed., pp. 37-58). Taylor & Francis Group.
Benton, S. L., y Cashin, W. E. (2014). Student ratings of instruction in college and university courses. En Michael B. Paulsen (Ed.), Higher Education: Handbook of Theory & Research (vol. 29, pp. 279-326). Springer.
Coll, C., y Solé, I. (2014). Enseñar y aprender en el contexto del aula. C. Coll, J., Palacios y Á. Marchesi (Comps.), Desarrollo psicológico y educación: 2. Psicología de la educación escolar (2da ed., pp. 357-386). Editorial Alianza.
Darwin, S. (2017). What contemporary work are student ratings actually doing in higher education? Studies in Educational Evaluation, 54, 13-21. http://dx.doi.org/10.1016/j.stueduc.2016.08.002
Elizalde, L., Pérez, C. G., y Olvera, B. I. (2008). Metaevaluación del proceso de evaluación docente: Universidad Autónoma del Estado de Hidalgo. Reencuentro, (53), 113-124. https://bit.ly/3nqtXdB
Elizalde, L., Olvera, B. I, y Bezies, P. (2017). Metaevaluación: herramienta para la valoración integral del proceso evaluativo docente de la UAEH. En E. Luna y M. Rueda (Coords.), Experiencias de evaluación de la docencia en Iberoamérica (pp. 257-278). Universidad Autónoma de Baja California.
Flores-Hernández, F., Gatica, F., Sánchez-Mendiola, M., y Martínez, A. (2017). Evolución de la evaluación del desempeño docente en la Facultad de Medicina; evidencia de validez y confiabilidad. Investigación en educación médica, 6(22), 96-103. https://doi.org/10.1016/j.riem.2016.06.004
Gallego, C., y Rojo, N. (2014). Meta-evaluación del programa Docentia de la UCM. Universidad Complutense de Madrid. https://bit.ly/3nndFlJ
Hativa, N. (2015). ¿Qué dice la investigación sobre la buena enseñanza y los excelentes profesores? Docencia en la academia, 5, 42-75 [Hebreo]. https://bit.ly/3noMdEl
Holsti, O. R. (1966). Coding content data. En Content Analysis for the social humanities (pp. 94-126). Addison-Wesley Publishing Company.
Jornet, J. M., Perales, M. J., y González-Such, J. (2020). El concepto de validez de los procesos de evaluación de la docencia. Revista Española de Pedagogía, 78(276), 233-252. https://doi.org/10.22550/REP78-2-2020-01
Luna, E., y Reyes, É. (2015). Validación de constructo de un cuestionario de evaluación de la competencia docente. Revista electrónica de investigación educativa, 17(3), 13-27. https://bit.ly/3a04GE2
Linse, A. R. (2017). Interpreting and using student ratings data: Guidance for faculty serving as administrators and on evaluation committees. Studies in Educational Evaluation, 54, 94-106. https://doi.org/10.1016/j.stueduc.2016.12.004
Martínez, F., Taut, S., y Schaaf, K. (2016). Classroom observation for evaluating and improving teaching: An international perspective. Studies in Educational Evaluation, 49, 15-29. http://dx.doi.org/10.1016/j.stueduc.2016.03.002
Marsh, H. W. (2007). Students' evaluations of university teaching: Dimensionality, reliability, validity, potential baises, and usefulness. En R. P. Perry y J. C. Smart (Eds.), The scholarship of teaching and learning in higher education: An evidencebased perspective (pp. 319-384). Springer.
Mayring, P. (2000). Qualitative content analysis. Forum qualitative social research, 1(2). https://bit.ly/3ubZpAl
Nasser-Abu, F. (2017). Teaching in higher education: good teaching through students’ lens. Studies in Educational Evaluation, 54, 4-12. http://dx.doi.org/10.1016/j.stueduc.2016.10.006
Red Iberoamericana de Investigadores de la Evaluación de la Docencia. (2008). Reflexiones sobre el diseño y puesta en marcha de programas de evaluación de la docencia. Revista Iberoamericana de Evaluación Educativa, 1(3), 163-168. https://bit.ly/3OTxn4B
Rueda, M. (2010). Reflexiones generales a considerar en el diseño y puesta en operación de programas de evaluación de la docencia. Revista Iberoamericana de Evaluación Educativa, 3(1), 344-350. https://bit.ly/3a2hutK
Scriven, M. (1991). Evaluation thesaurus (4ta. ed.). Sage publications.
Scriven, M. (2009). Meta-Evaluation Revisited. Journal of MultiDisciplinary Evaluation, 6(11). https://bit.ly/3npC8Ha
Scriven, M. (2011). Evaluating evaluations: A meta-evaluation checklist (9na ed.). Claremont Graduate University. https://bit.ly/3ysIhc1
Scriven, M. (2015). The Meta-Evaluation Checklist. Claremont Evaluation Center.
Spooren, P., Brockx, B., y Mortelmans, D. (2013). On the validity of student evaluation of teaching: The state of the art. Review of Educational Research, 83(4), 598-642. https://doi.org/10.3102/0034654313496870
Spooren, P., y Christiaens, W. (2017). I liked your course because I believe in (the power of) student evaluations of teaching (SET). Students’ perceptions of a teaching evaluation process and their relationships with SET scores. Studies in educational evaluation, 54, 43-49. http://dx.doi.org/10.1016/j.stueduc.2016.12.003
Spooren, P., Vandermoere, F., Vanderstraeten, R., y Pepermans, K. (2017). Exploring high impact scholarship in research on student's evaluation of teaching (SET). Educational Research Review, 22, 129-141. https://doi.org/10.1016/j.edurev.2017.09.001
Stake, R. E. (1976). A theoretical statement of responsive evaluation. Studies in Educational Evaluation, 2(1), 19-22. https://doi.org/10.1016/0191-491X(76)90004-3
Stake, R. E. (2011). Program evaluation particulary responsive evaluation. Journal of MultiDisciplinary Evaluation, 7(15), 180-201. https://bit.ly/3OvHJru
Stake, R. E. (2017). Meta-evaluation of systems for the evaluation of teaching. En E. Luna y M. Rueda, Experiencias de evaluación de la docencia en Iberoamérica (pp. 248-256). Universidad Autónoma de Baja California.
Stufflebeam, D. L. (2001). The Metaevaluation Imperative. American Journal of Evaluation, 22(2), 183-209. https://doi.org/10.1016/S1098-2140(01)00127-8
Stufflebeam, D. L. (2011). Meta-evaluation. Journal of MultiDisciplinary Evaluation, 7(15), 99-158. https://bit.ly/3Ab9v8h
Theall, M., y Franklin, J. (2002). Creating Responsive Student Rating Systems to Improve Evaluation Practice. New Directions for Teaching and Learning, 2000(83), 95-107. https://doi.org/10.1002/tl.8308
Universidad Autónoma de Baja California. (2021a). Anexo 1: Tabla de identificación de actividades (TIA). https://bit.ly/39ZG9PD
Universidad Autónoma de Baja California. (2021b). Evaluación de la docencia de licenciatura en la UABC: Descripción general del proceso. https://bit.ly/3Aan9IG
Universidad Autónoma de Baja California. (2021c, 28 de diciembre). Formación docente. https://bit.ly/3QRPNV0
Universidad Autónoma de Baja California. (2021d, 15 de septiembre). Sistema de indicadores y estadísticas institucionales. https://bit.ly/3xWGquy
Villavicencio-Martínez, R. A., y Luna, E. (2018). Diseño y validación de un cuestionario de evaluación de la supervisión clínica. Revista Electrónica de Investigación y Evaluación Educativa, 24(1). http://doi.org/10.7203/relieve.24.1.9672
Published
How to Cite
Issue
Section
License
Copyright (c) 2023 Alma Delia Hernández , Edna Luna
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
Authors who publish in this journal accept the following conditions:
Authors conserve the copyrights and cede to the journal the right for first publication, with the work registered with the attribution licence of Creative Commons, which allows third parties to use the published work as long as they mention the authorship and the first publication in this journal.
The authors may make other independent and additional contractual agreements for the non-exclusive distribution of the version of the article published in this journal (e.g. include it an institutional repository or publish it in a book) as long as it clearly indicates that the work was first published in this journal.
Authors are allowed and indeed recommended to publish their work on the internet (for example on institutional or personal pages) before and during the revision and publication process, because it can lead to productive exchanges and greater and faster dissemination of the published work (see The Effect of Open Access).
