ChatGPT en la creación de exámenes de alemán como lengua extranjera

Celia Llabrés Llovet

doi:10.12795/mAGAzin.2024.i32.03

Authors

Celia Llabrés Llovet Universidad Pablo de Olavide https://orcid.org/0009-0002-8692-8135

DOI:

https://doi.org/10.12795/mAGAzin.2024.i32.03

Keywords:

ChatGPT, Spanish Official Language School, coherence, professors, students

Abstract

ChatGPT pretends to be a person. Therefore, the aim of this article is to prove if the chatbot can create quality exams on German as a foreign language. The main purpose of the investigation is to prove if ChatGPT is able to substitute the professors’ task of creating exams and, consequently, substitute them in this specific duty. The methodology conducted has consisted of two similar surveys sent to German professors and university students, one to each, in order to observe if they are capable of distinguishing between texts written by humans, specifically exams from the Spanish Official School of Languages, or similar texts written by ChatGPT. Aside from the personal views of the participants, ChatGPT both makes mistakes and is occasionally incoherent, which cannot be permitted in the assessment of foreign language knowledge, mainly if humans can create these same exams in a faster and more efficient manner.

Downloads

References

Alenizi, M. A. K., Mohamed, A. M., & Shaaban, T. S. (2023). Revolutionizing EFL Special Education: how ChatGPT is Transforming the Way Teachers Approach Language Learning. Innoeduca, 9(2), 5–23. https://doi.org/10.24310/innoeduca.2023.v9i2.16774

Baker, P. (2023). ChatGPT TM for Dummies. John Wiley & Sons, Inc.

Engelke, U., & Engelke, B. (2023). ChatGPT - Mit KI in ein neues Zeitalter: Wie KI-Tools unser Leben und die Gesellschaft verändern (1st ed.). mitp.

Fernández, Y. (2023, 1 junio). ChatGPT Plus: qué es, diferencias con ChatGPT normal y cuánto cuesta esta inteligencia artificial. Xataka. Recuperado el 25 de febrero de 2024, de https://www.xataka.com/basics/chatgpt-plus-que-que-caracteristicas-tiene-cuanto-cuesta-version-pago-esta-inteligencia-artificial

Fernández, Y. (2024, enero 10). ChatGPT: qué es, cómo usarlo y qué puedes hacer con este chat de inteligencia artificial GPT. Xataka. Recuperado el 25 de febrero de 2024, de https://www.xataka.com/basics/chatgpt-que-como-usarlo-que-puedes-hacer-este-chat-inteligencia-artificial

Hasanein, A. M., & Sobaih, A. E. E. (2023). Drivers and Consequences of ChatGPT Use in Higher Education: Key Stakeholder Perspectives. European Journal of Investigation in Health, Psychology and Education, 13(11), 2599–2614. https://doi.org/10.3390/ejihpe13110181

Ichbiah, D. (2023). ChatGPT : ¿quién eres? Ediciones ENI. Recuperado el 27 de diciembre de 2023, de https://www.eni-training.com/portal/client/mediabook/home

Información general de las enseñanzas de idiomas: Evaluación y Certificación (s.f.). EDUCAGOB. Portal del Sistema Educativo Español. Recuperado el 31 de diciembre de 2023, de https://educagob.educacionyfp.gob.es/ensenanzas/idiomas/informacion-general/evaluacion-certificacion.html

Kim, T. W. (2023). Application of artificial intelligence chatbots, including ChatGPT, in education, scholarly work, programming, and content generation and its prospects: a narrative review. Journal of Educational Evaluation for Health Professions, 20, 38–38. https://doi.org/10.3352/jeehp.2023.20.38

Loos, E., Gröpler, J., & Goudeau, M.-L. S. (2023). Using ChatGPT in Education: Human Reflection on ChatGPT’s Self-Reflection. Societies (Basel, Switzerland), 13(8), 196. https://doi.org/10.3390/soc13080196

Marco Común Europeo de Referencia para las Lenguas: Aprendizaje, Enseñanza, Evaluación (2000). En Centro Virtual Cervantes (NIPO: 176-02-187-X). ANAYA.

Mondal, H., Marndi, G., Behera, J., & Mondal, S. (2023). ChatGPT for Teachers: Practical Examples for Utilizing Artificial Intelligence for Educational Purposes. Indian Journal of Vascular and Endovascular Surgery, 10(3), 200–205. https://doi.org/10.4103/ijves.ijves_37_23

Ray, P. P. (2023). ChatGPT: A comprehensive review on background, applications, key challenges, bias, ethics, limitations and future scope. Internet of Things and Cyber-Physical Systems, 3, 121–154. https://doi.org/10.1016/j.iotcps.2023.04.003

Sabzalieva, E., & Valentini, A. (2023). ChatGPT e inteligencia artificial en la educación superior: guía de inicio rápido (ED/HE/IESALC/IP/2023/12). https://unesdoc.unesco.org/ark:/48223/pf0000385146_spa

We asked ChatGPT: How does artificial intelligence change teaching? (2023). En CE Noticias Financieras (English ed.). ContentEngine LLC, a Florida limited liability company.

Your German SAT questions were written by ChatGPT (2023). En CE Noticias Financieras (English ed.). ContentEngine LLC, a Florida limited liability company.

Anexo I: Examen de la EOI de La Rioja (junio, 2022) (B1)

https://drive.google.com/drive/folders/10Gk4ntYK3hAAIXZ8Vt8JUAMHjohxwLJw

Anexo II: Cuestionario al profesorado de alemán

https://docs.google.com/forms/d/e/1FAIpQLScxN0_78y6fcFLSD3W3etruLSM_TysUXWd8Cd2t49zF3FELAg/viewform?usp=pp_url

Anexo III: Cuestionario al alumnado de alemán

https://docs.google.com/forms/d/e/1FAIpQLScYmTNTSCdKRwUr6j4qlC2aL6cMunTDJJBlVAuz-PYW3Ck4Wg/viewform?usp=pp_url