A Process for RN-BSN Program Evaluation

Abstract

Topic/Problem Statement Evaluation of a programs outcomes is necessary to support a programs curriculum. Nursing programs are accredited by various bodies, yet each accrediting body expects the nursing program to evaluate itself to ensure the students are meeting the program outcomes. The purpose of this project is to develop the process for Registered Nurses Baccalaureate of Science in Nursing (RN-BSN) program assessment through mapping of key assignments to program outcomes and assessment rubrics development to demonstrate student achievement of program outcomes. Faculty use of assessment rubrics will determine student learning and achievement of program outcomes. Context The University of Southern Indiana on-line RN-BSN program has six program outcomes. While regulatory bodies look at prelicensure programs and NCLEX pass rates, it is also essential to evaluate the effectiveness of RN-BSN programs. There was no clear data to demonstrate achieve of program outcomes. Licensed RNs are required to complete nine nursing courses. Specific courses assignments were identified with key evidence to demonstrate the students achievement of program outcomes. Grounding A search of literature using three online databases revealed limited published research related to nursing program evaluation. Literature reviews reveal much of the published evaluation research focuses on evaluation of individual courses or instructional methods rather than systematic program evaluation (Horne & Sandmann, 2012; Russell, 2015). Research related to use of rubrics in program evaluation focused on interrater reliability for grading individual student written assignments (Kilanowski & Bowers, 2017), mapping competencies to course assignments (Laux & Stoten, 2016). The lack of overall program evaluation research supports the need for study and development of effective processes for documentation of outcomes and program evaluation. Approach The project was submitted for Institutional Review Board for approval. The project was identified as a quality improvement project. Two workshops were conducted in May 2019. Day 1 was to examine the courses for key assignments and identify evidence that would demonstrate achievement of program outcomes. Day 2 was the development of the assessment rubrics with the assistance of an Assessment Consultant. Assessment rubrics were piloted in six classes in Summer 2019. Face validity of assessment rubrics were determined by two faculty not participating in the workshop. Assessment rubrics were revised based on the comments from the faculty reviewers and will be piloted in additional courses. Reflection/Discussion/Lessons Learned The piloting of the rubrics by faculty identified concerns with the provision of evidence needed to demonstrate achievement of program outcomes. The face validity reviewers provided vital feedback and suggestion on how to modify the assessment rubric ensure the measurement of identified outcomes. Assessment rubrics were revised based on feedback from the faculty participating in the pilot and face validity reviewers. Face validity review and discussion provided clarity on how the assessment rubrics needed to be modified to demonstrate the evidence of students achieving program outcomes. This was a collaborative effort between the faculty of the RN-BSN program. The face validity reviewers taught outside of the RN-BSN program. Measurement of student learning and achievement of program outcomes will begin Summer 2020. References Horne, E. M. & Sandmann, L. R. (2012). Current trends in systematic program evaluation of online graduate nursing education: An integrative literature review. Journal of Nursing Education, 51, 570-578. https://doi.org/10.3928/01484834-20120820-06 Kilanowski, J. F. & Abbott, M. B. (2017). Investigating interrater reliability in an online RN-to-BSN program: Disparate conclusions. Journal of Nursing Education, 56, 360-363. https://doi.org/10.3928/01484834-20170518-08 Laux, M. & Stoten, S. (2016). A statewide RN-BSN consortium use of the electronic portfolio to demonstrate student competency. Nurse Educator, 41, 275-277. https://doi.org/10.1097/NNE.0000000000000277 Russell, B. H. (2015). The who, what, and how of evaluation within online nursing education: State of the science. Journal of Nursing Education, 54, 13-21+sup. https://doi.org/10.3928/01484834-20141228-02