Outcome Assessment of General Education 21st Century Competency Skills: Close the Loop Efforts in the United States

Authors

  • Nhung Thi Tuyet Pham Hue University - University of Foreign Languages, Vietnam

DOI:

https://doi.org/10.52296/vje.2021.45

How to Cite

Pham, N. T. T. (2021). Outcome Assessment of General Education 21st Century Competency Skills: Close the Loop Efforts in the United States. Vietnam Journal of Education, 5(1), 52–63. https://doi.org/10.52296/vje.2021.45

Abstract

Over the past several years, various stakeholders have continued to express concerns about the quality of U.S. higher education. Under the accountability and transparency pressures, institutions must provide evidence of student learning, especially the value of general education programs upon graduation. Therefore, a case study at a U.S. comprehensive university was conducted to assess five general education competency skills (written, oral, quantitative literacy, critical thinking and information literacy). To facilitate “close the loop” conversations with faculty and committees, in addition to descriptive analysis, the university disaggregated the assessment data in a non-traditional way by examining the relationship of student factors (race, year and college) and student learning. The researcher used ANCOVA and ANOVA to identify significant differences. Results indicated year and race were related to student outcomes, except for critical thinking skills. The researcher provided suggestions for use of the study’s findings to close the loop in the general education program.

Downloads

Download data is not yet available.

References

Al-Lail, H. J., & Oudghiri, H. (2016). Assessment of student learning outcomes based on institutional core values. Urbana, IL: University of Illinois and Indiana University, National Institute for Learning Outcomes Assessment.

Allen, M. (2004). Assessing academic programs in higher education. Boltan, MA: Anker Publishing Company, Inc.

Atkinson, D., & Lim, S. (2013). Improving assessment processes in higher education: Student and teacher perceptions of the effectiveness of a rubric embedded in a LMS. Australasian Journal of Educational Technology, 29(5), 651-666. doi:10.14742/ajet.526

Bailey, S. &McDevitt, J. (2019). Palo Alto College: Faculty and Student Engagement through Assignment Design. Case Studies. Urbana, IL: National Institute for Learning Outcomes Assessment.

Banta, T. W., & Palomba, C. A. (2014). Assessment essentials: planning, implementing, and improving assessment in higher education (2nd ed.). San Francisco, CA: Jossey-Bass.

Bassis, M. (2015). A Primer on the transformation of higher education in America. Retrieved from http://www.learningoutcomeassessment.org/documents/BassisPrimer.pdf

Batini, C., Cappiello, C., Francalanci, C., & Maurino, A. (2009). Methodologies for data quality assessment and improvement. ACM Computing Surveys, 41(3), 6-20. doi:10.1145/1541880.1541883

Beauchman, M., & Waldenberger, S. (2017). Assessing general education: Identifying outcomes, data analysis, and improvements. Assessment in Practice. Urbana, IL: National Institute for Learning Outcomes Assessment.

Boyles, T. (2012). 21st century knowledge, skills, and abilities and entrepreneurial competencies: a model for undergraduate entrepreneurship education (Report). Journal of Entrepreneurship Education, 15.

Bruce. R. T. (2018), Assessment in Action: Evidence-Based discussions about teaching, learning, and curriculum, New Directions for Teaching and Learning, 10(2), 1-7.D. https://doi.org/10.1002/tl.20260

Carless, D. (2015). Exploring learning-oriented assessment processes. Higher Education, 69(6), 963-976. doi:10.1007/s10734-014-9816-z

Caspersen, J., Smeby, J‐C., & Olaf Aamodt, P. (2017). Measuring learning outcomes. European Journal of Education, 52(1), 1-11. doi:10.1111/ejed.12205

Demeter, E., Robinson, C., & Frederick, J. G. (2019). Holistically assessing critical thinking and written communication learning outcomes with direct and indirect measures. Research and Practice in Assessment, 14.

DeSantis, M. (2020). St. Edward’s University: Rethinking general education to support social justice. Urbana, IL: University of Illinois and Indiana University, National Institute for Learning Outcomes Assessment, Council for the Advancement of Standards in Higher Education, and Campus Labs. Retrieved at https://www.learningoutcomesassessment.org/wpcontent/uploads/2020/09/EquityCase_St_Edwards.pdf

Eisnaugle, E. (2018). Program evaluation of general education learning outcome assessment. ProQuest LLC, Ed.D. Dissertation, Wingate University.

Evans, C. (2013). Making Sense of Assessment Feedback in Higher Education. Review of Educational Research, 83(1), 70-120. doi:10.3102/0034654312474350

Ewell, P. (2009). Assessment, accountability, and improvement: Revisiting the tension. (Occasional Paper No.1), Urbana, IL: University of Illinois and Indiana University, National Institute for Learning Outcomes Assessment. Retrieved from http://www.learningoutcomeassessment.org/documents/PeterEwell_005.pdf

Faleski, M., & Handley-Miller, B. (2017). General education at Delta College: Guided conversations toward relevant assessment. (Assessment in Practice), Urbana, IL: University of Illinois and Indiana University, National Institute for Learning Outcomes Assessment.

Field, A. (2009). Discovering statistics using SPSS. London, England: SAGE.

Finley, A. P. (2011). How reliable are the VALUE rubrics? Peer Review, 13(4), 31-33.

Fulcher, K. H., Ames, A. J., & Hawk, W. J. (2017). Ethical reasoning: Assessing a critical thinking skill. (Assessment in Practice), Urbana, IL: National Institute for Learning Outcomes Assessment.

Galle, J. K., & Galle, J. (2010). Building an integrated student learning outcomes assessment for general education: Three case studies. New Directions for Teaching and Learning, 121. doi:10.1002/tl.390

Gray, J., Brown, M., & Connolly, J. (2017). Examining construct validity of the quantitative literacy VALUE rubric in college-level STEM assignments. Research & Practice in Assessment, 12.

Hack, C. (2015). Analytical rubrics in higher education: a repository of empirical data. British Journal of Educational Technology, 46(5), 924-927. doi:10.1111/bjet.12304

Hathcoat, J., & Penn, J. (2012). Generalizability of Student Writing across Multiple Tasks: A Challenge for Authentic Assessment. Research & Practice in Assessment, 7, 16-28.

Jones, D. A. (2009). Higher Education Assessment—Who Are We Assessing, and For What Purpose? Retrieved September 27, 2018, from https://www.aacu.org/publications-research/periodicals/higher-education-assessment%E2%80%94who-are-we-assessing-and-what-purpose

Liu, O. (2011). Outcomes Assessment in Higher Education: Challenges and Future Research in the Context of Voluntary System of Accountability, (Report). Educational Measurement: Issues and Practice, 30(3), 2-9. doi:10.1111/j.1745-3992.2011.00206.x

Liu, O. (2017). Ten Years After the Spellings Commission: From Accountability to Internal Improvement, (Report). Educational Measurement: Issues and Practice, 36(2), 34-41. doi:10.1111/emip.12139

Macdonald, S., Williams, L., Lazowski, R., Horst, S., & Barron, K. (2014). Faculty Attitudes toward General Education Assessment: A Qualitative Study about Their Motivation. Research & Practice in Assessment, 9.

Martins, M. J., Reis Marques, T., Laíns, I., & Leal, I. (2019). The National Student Survey: validation in Portuguese medical students. Assessment & Evaluation in Higher Education, 44(1), 66-79. doi:10.1080/02602938.2018.14755470

McCormick, A. C. (2010), “Here's looking at you: Transparency, institutional self-presentation, and the public interest”. Change, 42(6), 35-43, doi:10.1080/00091383.2010.523406

Montenegro, E., & Jankowski, N. A. (2017). Equity and assessment: Moving towards culturally responsive assessment. (Occasional Paper No. 29). Urbana, IL: University of Illinois and Indiana University, National Institute for Learning Outcomes Assessment.

Nelson, C. (2014). Assessing assessment. Retrieved from https://www.insidehighered.com/views/2014/11/24/essay-criticizes-state-assessment-movement-higher-education

Rear, D. (2019). One size fits all? The limitations of standardized assessment in critical thinking. Assessment & Evaluation in Higher Education, 44(5), 664-675. doi:10.1080/02602938.2018.1526255

Reddy, Y. M., & Andrade, H. (2010). A review of rubric use in higher education. Assessment & Evaluation in Higher Education, 35(4), 435-448. doi:10.1080/02602930902862859

Roohr, K., Olivera-Aguilar, M., Ling, G., Rikoon, S. (2019). A multi-level modeling approach to investigating students’ critical thinking at higher education institutions. Assessment & Evaluation in Higher Education, 44(2), 1-15. https://doi.org/10.1080/02602938.2018.

Rust, C., Price, M., & O’Donovan, B. (2003). Improving Students’ Learning by Developing their Understanding of Assessment Criteria and Processes. Assessment & Evaluation in Higher Education, 28(2), 147-164. doi:10.1080/02602930301671

Steinke, P., & Fitch, P. (2017). Minimizing Bias When Assessing Student Work. Research & Practice in Assessment, 12.

Suskie, L. (2009). Assessing student learning: A common sense guide (2nd ed.), San Francisco: Jossey-Bass.

Swaffield, S. (2011). Leading assessment for learning. International handbook of leadership for learning, 1047-1065, doi:10.1007/978-94-007-1350-5_57

Swarat, S. & Wrynn, A. M. (2017). Assessment with Benefits: Faculty engagement and community building through GE assessment. (Assessment in Practice), Urbana, IL: National Institute for Learning Outcomes Assessment.

Szafran, R. (2017). The miscalculation of interrater reliability: A case study involving the AAC&U VALUE rubrics. Practical Assessment, Research & Evaluation, 22(11), 1-7.

The HEIghten® Outcomes Assessment Suite (2021). Retrieved from https://www.ets.org/heighten

U.S. Department of Education (2006). A test of leadership: Charting the future of U.S. higher education. Washington, DC: Author, doi:10.1086/512957

Wiewiora, A., & Kowalkiewicz, A. (2019). The role of authentic assessment in developing authentic leadership identity and competencies. Assessment & Evaluation in Higher Education, 44(3), 415-430. doi:10.1080/02602938.2018.1516730

Downloads

Published

2021-03-30

How to Cite

Pham, N. T. T. (2021). Outcome Assessment of General Education 21st Century Competency Skills: Close the Loop Efforts in the United States. Vietnam Journal of Education, 5(1), 52–63. https://doi.org/10.52296/vje.2021.45

Issue

Section

Articles