Outcome Assessment of General Education 21st Century Competency Skills: Close the Loop Efforts in the United States
DOI:
https://doi.org/10.52296/vje.2021.45-
Downloads
How to Cite
Abstract
Over the past several years, various stakeholders have continued to express concerns about the quality of U.S. higher education. Under the accountability and transparency pressures, institutions must provide evidence of student learning, especially the value of general education programs upon graduation. Therefore, a case study at a U.S. comprehensive university was conducted to assess five general education competency skills (written, oral, quantitative literacy, critical thinking and information literacy). To facilitate “close the loop” conversations with faculty and committees, in addition to descriptive analysis, the university disaggregated the assessment data in a non-traditional way by examining the relationship of student factors (race, year and college) and student learning. The researcher used ANCOVA and ANOVA to identify significant differences. Results indicated year and race were related to student outcomes, except for critical thinking skills. The researcher provided suggestions for use of the study’s findings to close the loop in the general education program.
Downloads
References
Al-Lail, H. J., & Oudghiri, H. (2016). Assessment of student learning outcomes based on institutional core values. Urbana, IL: University of Illinois and Indiana University, National Institute for Learning Outcomes Assessment.
Allen, M. (2004). Assessing academic programs in higher education. Boltan, MA: Anker Publishing Company, Inc.
Atkinson, D., & Lim, S. (2013). Improving assessment processes in higher education: Student and teacher perceptions of the effectiveness of a rubric embedded in a LMS. Australasian Journal of Educational Technology, 29(5), 651-666. doi:10.14742/ajet.526
Bailey, S. &McDevitt, J. (2019). Palo Alto College: Faculty and Student Engagement through Assignment Design. Case Studies. Urbana, IL: National Institute for Learning Outcomes Assessment.
Banta, T. W., & Palomba, C. A. (2014). Assessment essentials: planning, implementing, and improving assessment in higher education (2nd ed.). San Francisco, CA: Jossey-Bass.
Bassis, M. (2015). A Primer on the transformation of higher education in America. Retrieved from http://www.learningoutcomeassessment.org/documents/BassisPrimer.pdf
Batini, C., Cappiello, C., Francalanci, C., & Maurino, A. (2009). Methodologies for data quality assessment and improvement. ACM Computing Surveys, 41(3), 6-20. doi:10.1145/1541880.1541883
Beauchman, M., & Waldenberger, S. (2017). Assessing general education: Identifying outcomes, data analysis, and improvements. Assessment in Practice. Urbana, IL: National Institute for Learning Outcomes Assessment.
Boyles, T. (2012). 21st century knowledge, skills, and abilities and entrepreneurial competencies: a model for undergraduate entrepreneurship education (Report). Journal of Entrepreneurship Education, 15.
Bruce. R. T. (2018), Assessment in Action: Evidence-Based discussions about teaching, learning, and curriculum, New Directions for Teaching and Learning, 10(2), 1-7.D. https://doi.org/10.1002/tl.20260
Carless, D. (2015). Exploring learning-oriented assessment processes. Higher Education, 69(6), 963-976. doi:10.1007/s10734-014-9816-z
Caspersen, J., Smeby, J‐C., & Olaf Aamodt, P. (2017). Measuring learning outcomes. European Journal of Education, 52(1), 1-11. doi:10.1111/ejed.12205
Demeter, E., Robinson, C., & Frederick, J. G. (2019). Holistically assessing critical thinking and written communication learning outcomes with direct and indirect measures. Research and Practice in Assessment, 14.
DeSantis, M. (2020). St. Edward’s University: Rethinking general education to support social justice. Urbana, IL: University of Illinois and Indiana University, National Institute for Learning Outcomes Assessment, Council for the Advancement of Standards in Higher Education, and Campus Labs. Retrieved at https://www.learningoutcomesassessment.org/wpcontent/uploads/2020/09/EquityCase_St_Edwards.pdf
Eisnaugle, E. (2018). Program evaluation of general education learning outcome assessment. ProQuest LLC, Ed.D. Dissertation, Wingate University.
Evans, C. (2013). Making Sense of Assessment Feedback in Higher Education. Review of Educational Research, 83(1), 70-120. doi:10.3102/0034654312474350
Ewell, P. (2009). Assessment, accountability, and improvement: Revisiting the tension. (Occasional Paper No.1), Urbana, IL: University of Illinois and Indiana University, National Institute for Learning Outcomes Assessment. Retrieved from http://www.learningoutcomeassessment.org/documents/PeterEwell_005.pdf
Faleski, M., & Handley-Miller, B. (2017). General education at Delta College: Guided conversations toward relevant assessment. (Assessment in Practice), Urbana, IL: University of Illinois and Indiana University, National Institute for Learning Outcomes Assessment.
Field, A. (2009). Discovering statistics using SPSS. London, England: SAGE.
Finley, A. P. (2011). How reliable are the VALUE rubrics? Peer Review, 13(4), 31-33.
Fulcher, K. H., Ames, A. J., & Hawk, W. J. (2017). Ethical reasoning: Assessing a critical thinking skill. (Assessment in Practice), Urbana, IL: National Institute for Learning Outcomes Assessment.
Galle, J. K., & Galle, J. (2010). Building an integrated student learning outcomes assessment for general education: Three case studies. New Directions for Teaching and Learning, 121. doi:10.1002/tl.390
Gray, J., Brown, M., & Connolly, J. (2017). Examining construct validity of the quantitative literacy VALUE rubric in college-level STEM assignments. Research & Practice in Assessment, 12.
Hack, C. (2015). Analytical rubrics in higher education: a repository of empirical data. British Journal of Educational Technology, 46(5), 924-927. doi:10.1111/bjet.12304
Hathcoat, J., & Penn, J. (2012). Generalizability of Student Writing across Multiple Tasks: A Challenge for Authentic Assessment. Research & Practice in Assessment, 7, 16-28.
Jones, D. A. (2009). Higher Education Assessment—Who Are We Assessing, and For What Purpose? Retrieved September 27, 2018, from https://www.aacu.org/publications-research/periodicals/higher-education-assessment%E2%80%94who-are-we-assessing-and-what-purpose
Liu, O. (2011). Outcomes Assessment in Higher Education: Challenges and Future Research in the Context of Voluntary System of Accountability, (Report). Educational Measurement: Issues and Practice, 30(3), 2-9. doi:10.1111/j.1745-3992.2011.00206.x
Liu, O. (2017). Ten Years After the Spellings Commission: From Accountability to Internal Improvement, (Report). Educational Measurement: Issues and Practice, 36(2), 34-41. doi:10.1111/emip.12139
Macdonald, S., Williams, L., Lazowski, R., Horst, S., & Barron, K. (2014). Faculty Attitudes toward General Education Assessment: A Qualitative Study about Their Motivation. Research & Practice in Assessment, 9.
Martins, M. J., Reis Marques, T., Laíns, I., & Leal, I. (2019). The National Student Survey: validation in Portuguese medical students. Assessment & Evaluation in Higher Education, 44(1), 66-79. doi:10.1080/02602938.2018.14755470
McCormick, A. C. (2010), “Here's looking at you: Transparency, institutional self-presentation, and the public interest”. Change, 42(6), 35-43, doi:10.1080/00091383.2010.523406
Montenegro, E., & Jankowski, N. A. (2017). Equity and assessment: Moving towards culturally responsive assessment. (Occasional Paper No. 29). Urbana, IL: University of Illinois and Indiana University, National Institute for Learning Outcomes Assessment.
Nelson, C. (2014). Assessing assessment. Retrieved from https://www.insidehighered.com/views/2014/11/24/essay-criticizes-state-assessment-movement-higher-education
Rear, D. (2019). One size fits all? The limitations of standardized assessment in critical thinking. Assessment & Evaluation in Higher Education, 44(5), 664-675. doi:10.1080/02602938.2018.1526255
Reddy, Y. M., & Andrade, H. (2010). A review of rubric use in higher education. Assessment & Evaluation in Higher Education, 35(4), 435-448. doi:10.1080/02602930902862859
Roohr, K., Olivera-Aguilar, M., Ling, G., Rikoon, S. (2019). A multi-level modeling approach to investigating students’ critical thinking at higher education institutions. Assessment & Evaluation in Higher Education, 44(2), 1-15. https://doi.org/10.1080/02602938.2018.
Rust, C., Price, M., & O’Donovan, B. (2003). Improving Students’ Learning by Developing their Understanding of Assessment Criteria and Processes. Assessment & Evaluation in Higher Education, 28(2), 147-164. doi:10.1080/02602930301671
Steinke, P., & Fitch, P. (2017). Minimizing Bias When Assessing Student Work. Research & Practice in Assessment, 12.
Suskie, L. (2009). Assessing student learning: A common sense guide (2nd ed.), San Francisco: Jossey-Bass.
Swaffield, S. (2011). Leading assessment for learning. International handbook of leadership for learning, 1047-1065, doi:10.1007/978-94-007-1350-5_57
Swarat, S. & Wrynn, A. M. (2017). Assessment with Benefits: Faculty engagement and community building through GE assessment. (Assessment in Practice), Urbana, IL: National Institute for Learning Outcomes Assessment.
Szafran, R. (2017). The miscalculation of interrater reliability: A case study involving the AAC&U VALUE rubrics. Practical Assessment, Research & Evaluation, 22(11), 1-7.
The HEIghten® Outcomes Assessment Suite (2021). Retrieved from https://www.ets.org/heighten
U.S. Department of Education (2006). A test of leadership: Charting the future of U.S. higher education. Washington, DC: Author, doi:10.1086/512957
Wiewiora, A., & Kowalkiewicz, A. (2019). The role of authentic assessment in developing authentic leadership identity and competencies. Assessment & Evaluation in Higher Education, 44(3), 415-430. doi:10.1080/02602938.2018.1516730
Downloads
Published
How to Cite
Issue
Section
