Adaptation and Validation of the Perceived Classroom Assessment Environment Scale (PCAES)
DOI:
https://doi.org/10.12795/revistafuentes.2022.19232Keywords:
education, classroom assessment environment, teacher evaluation, high school students, multivariate analysis, factor analysis, psychometryAbstract
The study of classroom assessment environments constitutes a key aspect of the learning process. To analyze this construct, the Perceived Classroom Assessment Environment Scale (PCAES) is currently available. Since there is no empirical evidence of the application of this instrument in the Chilean educational context, this study aims at assessing the factor structure, internal consistency, and validity of the PCAES among Chilean students. The participants were 642 high school students, 50.9% women and 49.1% men, with an average age of 16.32 years. The exploratory structural equation modeling (ESEM) and confirmatory factor analysis (CFA) were used to assess the fit of the measurement model to the observed data. Internal consistency analysis was carried out using both McDonald Omega and Composite Reliability coefficients. Convergent and discriminant validity were assessed by the measurement of Average Variance Extracted (VME) and √VME. Findings support the two-factor structure of the original model. However, a 14 item-model was re-specified that showed adequate levels of reliability and validity. These findings suggest that the Spanish adaptation of PCAES evidences a measure model of adequate psychometric properties to assess classroom assessment environment perceptions.
Downloads
References
Abos Catalán, A., Sevil Serrano, J., Martín-Albo Lucas, J., Julián Clemente, J. A., & García-González, L. (2018). An integrative framework to validate the Need-Supportive Teaching Style Scale (NSTSS) in secondary teachers through exploratory structural equation modeling. Contemporary Educational Psychology, 52,48-60. https://doi.org/10.1016/j.cedpsych.2018.01.001
Aldás, J. (2013). La invarianza del instrumento de medida. In F. Sarabia (Ed.), Metodología para la investigación en marketing y dirección de empresas (pp. 386–410). Pirámide.
Alemán, M. J., Trías, D., & Curione, K. (2011). Orientaciones motivacionales, rendimiento académico y género en estudiantes de bachillerato. Ciencias Psicológicas, 5(2), 159-166. http://www.scielo.edu.uy/pdf/cp/v5n2/v5n2a04.pdf
Ali, M. & Mohsin, M. (2013). Test anxiety inventory (TAI): Factor analysis and psychometric properties. Journal of Humanities and Social Science, 8(1), 73-81. https://www.iosrjournals.org/iosr-jhss/papers/Vol8-issue1/K0817381.pdf
Alkharusi, H. (2011). Development and datametric properties of a Scale measuring students' perceptions of the Classroom assessment environment. International Journal of Instruction, 4(1), 105-120. https://eric.ed.gov/?id=ED522908
Alkharusi, H. (2015). An Evaluation of the Measurement of Perceived Classroom Assessment Environment. International Journal of Instruction, 8(2), 45-54. https://doi.org/10.12973/iji.2015.824a
Beaton D. E., Bombardier, C., Guillemin, F., & Ferraz, M. B. (2000). Guidelines for the process of cross-cultural adaptation of self-report measures. Spine, 25(24), 3186-3191. https://doi.org/10.1097/00007632-200012150-00014
Birenbaum, M. (1994). Toward adaptive assessment—the student’s angle. Studies in Educational Evaluation, 20, 239–255. https://doi.org/10.1016/0191-491X(94)90011-6
Brookhart, S. M., Walsh, J. M., & Zientarski, W. A. (2006). The dynamics of motivation and effort for classroom assessments in middle school science and social studies. Applied Measurement in Education, 19(2), 151–184. https://doi.org/10.1207/s15324818ame1902_5
Brown, T. (2006). Confirmatory factor analysis for applied research. The Guilford Press.
Buldur, S. & Doğan, A. (2014). Adaptation of the students' perceptions of the Science and Technology course classroom assessment environment scale into Turkish. Education & Science/Egitim ve Bilim, 39(176), 199-211. https://doi.org/10.15390/EB.2014.3729
Cheng, L., Wu, Y., & Liu, X. (2015). Chinese university students’ perceptions of assessment tasks and classroom assessment environment. Language Testing in Asia, 5 (1). https://doi.org/ 10.1186/s40468-015-0020-6
Costello, A. B., & Osborne, J. W. (2005). Best practices in exploratory factor analysis: Four recommendations for getting the most from your analysis. Practical Assessment, Research, & Evaluation, 10, 1-9. https://doi.org/10.7275/jyj1-4868
Cheung, G. W., & Rensvold, R. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling, 9(2), 233–255. https://doi.org/10.1207/S15328007SEM0902_5
Cheung, G. W., & Wang, C. (2017). Current Approaches for Assessing Convergent and Discriminant Validity with SEM. Issues and Solutions. Proceedings, 2017(1). https://doi.org/10.5465/AMBPP.2017.12706abstract
Czura, A. (2017). Adolescent learner perceptions of foreign language assessment: Critical incident analysis. Glottodidactica. An International Journal of Applied Linguistics, 44(2), 25-39. https://pressto.amu.edu.pl/index.php/gl/article/view/12092/11939
Dorman, J. P., & Knightley, W. M. (2006). Development and validation of an instrument to assess secondary school students’ perceptions of assessment tasks. Educational Studies, 32(1), 47–58. https://doi.org/10.1080/03055690500415951
Flórez Petour, M. T. (2015). Validity and equity in educational measurement: The case of SIMCE.
Psicoperspectivas, 14(3), 31-44. https://doi.org/10.5027/PSICOPERSPECTIVAS-VOL14-ISSUE3-FULLTEXT-618
Fornell, C., & Larcker, D. F. (1981). Evaluating structural equations models with unobservable variables and measurement error. Journal of Marketing Research, 18, 39-50. https://doi.org/10.2307/3151312
George, D., & Mallery, P. (2010). SPSS for Windows step by step: A simple guide and reference, 17.0 update. Allyn & Bacon
Gijbels, D., & Dochy, F. (2006). Students’ assessment preferences and approaches to learning: can formative assessment make a difference?. Educational studies, 32(4), 399-409. https://doi.org/10.1080/03055690600850354
Hair, J., Black, W., Babin, B., Anderson, R., & Tatham, R. (2010). Multivariate Data Analysis (7th ed.). Pearson Prentice Hall.
Henseler, J., Ringle, C.M. & Sarstedt, M. A. (2015). New criterion for assessing discriminant validity in variance-based structural equation modeling. J. of the Acad. Mark. Sci., 43, 115–135. https://doi.org/10.1007/s11747-014-0403-8
lhan, M., & Çetin, B. (2014). An analysis of the relationship between academic burnout and classroom assessment environment. Ted Eğitim Ve Bilim, 39 (176), 51-68.
Kane, M. T. (2016). Explicating validity, Assessment in Education. Principles, Policy & Practice, 23(2), 198-211. https://doi.org/10.1080/0969594X.2015.1060192
Kaplan, A., & Maehr, M. L. (2007). The Contributions and Prospects of Goal Orientation Theory. Educational Psychology Review, 19(2), 141-184.
Kelloway, E. K. (2015). Using Mplus for structural equation modeling. SAGE Publications, Inc. https://doi.org/10.4135/9781483381664
Kline, R. (2016). Principles and practice of structural equation modeling (4a ed.). The Guilford Press.
Moral-de la Rubia, J. (2019). Revisión de los criterios para validez convergente estimada a través de la
Varianza Media Extraída. Psychologia, 13(2), 25-41. https://doi.org/10.21500/19002386.4119
Muñoz, A., & Alvares, M. (2007). Students’ objectivity and perception of self-assessment in an EFL classroom. The Journal of Asia TEFL, 4(2), 1-25.
Mussawy, S. (2009). Assessment practices: Students’ and teachers’ perceptions of classroom assessment (Unpublished Master’s Thesis). School of Education, University of Massachusetts.
Muthén, L. K., & Muthén, B. O. (2012). Mplus User’s Guide (7th ed.). Muthén & Muthén.
Ortiz Cáceres, I. (2012). En torno a la validez del Sistema de Medición de la Calidad de la Educación en Chile. Estudios pedagógicos (Valdivia), 38(2), 355-373. https://doi.org/10.4067/S0718-07052012000200022
Rios, J., & Wells, C. (2014). Validity evidence based on internal structure. Psicothema, 26(1), 108-116. https://doi.org/10.7334/psicothema2013.260
Stiggins, R. & Conklin, N. (1992). Investigating the practices of classroom assessment. State University of New York Press.
Vavla, L., & Gokaj, R. (2013). Learner’s perceptions of assessment and testing in EFL classrooms in Albania. Mediterranean Journal of Social Sciences, 4(11), 509. https://doi.org/10.5901/mjss.2013.v4n11p509
Published
2022-09-30
How to Cite
Vergara-Morales, J., Díaz-Larenas, C. ., Tagle-Ochoa, T., & Ortiz-Navarrete, M. (2022). Adaptation and Validation of the Perceived Classroom Assessment Environment Scale (PCAES). Revista Fuentes, 24(3), 248–257. https://doi.org/10.12795/revistafuentes.2022.19232
Issue
Section
Investigaciones
License
Copyright (c) 2022 Jorge Vergara-Morales, Claudio Díaz-Larenas, Tania Tagle-Ochoa, Mabel Ortiz-Navarrete
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
Authors who publish in this journal accept the following conditions:
Authors conserve the copyrights and cede to the journal the right for first publication, with the work registered with the attribution licence of Creative Commons, which allows third parties to use the published work as long as they mention the authorship and the first publication in this journal.
The authors may make other independent and additional contractual agreements for the non-exclusive distribution of the version of the article published in this journal (e.g. include it an institutional repository or publish it in a book) as long as it clearly indicates that the work was first published in this journal.
Authors are allowed and indeed recommended to publish their work on the internet (for example on institutional or personal pages) before and during the revision and publication process, because it can lead to productive exchanges and greater and faster dissemination of the published work (see The Effect of Open Access).
Received 2021-10-06
Accepted 2022-05-04
Published 2022-09-30
Accepted 2022-05-04
Published 2022-09-30
Views
- Abstract 845
- PDF (Español (España)) 615
- HTML (Español (España)) 257
- EPUB (Español (España)) 44
