The Office of Assessment is in the midst of our freshman assessment orientations. These short workshops have proven each year to be great opportunities for the Office of Assessment to go into freshman classrooms to introduce ourselves, and what we do. They also provide us with a nice forum to introduce ExamSoft as the college’s computer-based testing software, allowing students dedicated time to ask questions about its utility while being trained. With assessment being an area that often limits us to indirect student interaction, it is always a really great start to each academic year to be able to have face-to-face time with our students. Feedback from these meetings is typically positive, and tends to leave students in a better state of understanding concerning assessment and what it means for our college.
The Office of Assessment within our college takes the faculty experience in computer-based testing through ExamSoft, very seriously. We are always working hard toward helping our faculty achieve their exam administration goals, by giving them all the information and training they need to make their exam building and administration experience go smoothly.
Once a year, we ask all faculty that have ExamSoft accounts as well as those that have shown interest in using the software, about their experience with it. Recently, we completed our annual survey, and the results continue to show that our work in this arena is paying off. We achieved a 41% response rate to the survey, receiving 48 responses out of 118 invitations sent. Below are some of the highlights:
- 87% had positive experience with Examsoft during the spring 2018 semester.
- 89% strongly/agree to using Examsoft in more courses.
- 88% used reporting tools during the Spring 2018 semester to assess student and exam performance
- 75% are interested in utilizing ExamSoft to collect documentation for accreditation by mapping curriculum and syllabus/teaching objectives to specific student learning outcomes.
- 75% are interested in attending future Examsoft workshops led by the Office of Assessment.
We continue to be motivated to work hard to push the envelope with computer-based testing in our college, as we move away from using paper in higher education. With positive survey results like those seen above, we can draw on the positive experiences and attitudes of faculty to continue on and look forward to making change not only within the realms of assessment and data analysis, but also concerning exam administration at-large.
The Office of Assessment will be presenting on the college’s IPE efforts utilizing ExamSoft this Monday, October 23rd at the SJU Faculty Tech Forum. The SJU Tech Forum is an annual opportunity for stakeholders at SJU to take a look at technologies that faculty are currently using in their classes and colleges. The forum is a wonderful opportunity for us to highlight some of what we do in terms of assessment and technology, and we look forward to sharing our future plans for ExamSoft and IPE. This presentation will particularly focus on how we are using computer-based testing software to measure, track and report our data, ultimately leading toward greater tracking of programmatic goals and outcomes.
The College of Pharmacy & Health Sciences has been utilizing the ExamSoft platform since January 2015 and has seen its use expand greatly across the College’s four programs- Pharmacy, Physician Assistant, Radiologic Sciences, and Clinical Lab Sciences. As it is adopted by more faculty and used in other courses, the Office of Assessment (OA) continues to immerse itself in computer-based testing while also adopting our own best practices to introduce initiatives that suit the unique needs of our student and faculty users.
ExamSoft recently visited New York City to host its Assessment On Tour (AOT) series and provided insightful presentations from other schools utilizing the platform. Soon after Carla Hernandez, a member of the College’s Office of Assessment, was invited to speak at October 2017’s AOT at the University of North Carolina- Charlotte campus. Carla shared St. John’s University’s College of Pharmacy & Health Sciences’ experience with ExamSoft over the last 2 ½ years. She specifically presented the benefits of analyzing student assessment data through ExamSoft’s reporting tools. The OA aims to continue working with all stakeholders to improve the long-term rollout of ExamSoft at the College.
The Assessment Team just got back from Denver, Colorado after taking part in Examsoft’s Assessment Conference 2017. The conference included an opportunity for us to present on a recent interprofessional education (IPE) project. On top of that, we also had the chance to hear from fellow universities and learn more about the upcoming release of Examsoft products.
On behalf of the Assessment Team, Carla Hernandez, Anthony Marziliano, and Dr. Marc Gillespie presented “Identifying Interprofessional Education Opportunities (IPE) Using ExamSoft Categories that Bridge Goals and Outcomes of Healthcare Programs”. In an effort to summarize our project, interprofessional education is when students from two or more professions learn about, from, and with each other to enable effective collaboration and improve health outcomes (World Health Organization, 2010). Earlier this year we began reviewing national exam blueprints from each of the College’s professional programs to identify overlapping content areas between them. We were seeking to identify content areas across all programs that are targets for IPE. Along with the expertise of our program directors and mind-mapping software, we were able to refine and ultimately identify 21 content areas ideal for IPE.
Pairing this analysis with Examsoft’s ability to categorize test items & run longitudinal analyses, we are able to assess the effectiveness of IPE activities administered through the platform. As for next steps, the Assessment Team met with the College’s IPE Committee, IPE Director, and other faculty to present our findings. We look forward to continuing discussions with key stakeholders on how we can contribute to the College’s continued efforts of expanding IPE development & assessment.
Overall, Examsoft’s Assessment Conference 2017 was well worth the trip- an invitation to share our analysis, participate in engaging sessions, and the chance to network with fellow assessment folks. We look forward to next year’s conference. #Assess2017
The Office of Assessment is proud to announce that we have been invited to deliver a 1-hour presentation titled, “Identifying Interprofessional Education Opportunities (IPE) Using ExamSoft Categories that Bridge Goals and Outcomes of Healthcare Programs” at the 2017 Examsoft Assessment Conference (EAC) in Denver, Colorado this June. For more information about the EAC sessions, please visit their site here. The College of Pharmacy and Health Science’s Assessment Team looks forward to connecting with colleagues from other universities nation-wide to discuss how their assessment efforts drive change at their institutions.