Annual Program Review

Background

Over the past year, the Program Performance Review Committee developed an Annual Program Review (APR) process that will be timelier and more meaningful, along with two complementary dashboards. The idea of standardized programs metrics surfaced in the Academic Resource Planning sub-committee of Pre-Planning work that set the foundation for the current process and plan.  The APR and dashboards will enable each unit to look at their undergraduate program portfolio more effectively and be beneficial for informing any future program review and revision that may happen as part of implementing UAC recommendations.  Longer term, the APR will become the foundation for a more comprehensive program review process that will take the place of our old PAR process. In the near term, the pilot will also serve as a complement to the current review of graduate program portfolios that we have been doing.  Along each step of the process, stakeholders will be able to provide feedback to help improve the process year to year.   An oversight committee will be developed to oversee the process in collaboration with the Office of the Provost. 

The Dashboards:

• Strategic Dashboard: A complement to the Tactical Dashboard, the Strategic Dashboard is used to determine if there is alignment to the Strategic Plan and to what extent. This rubric can be used by program directors, faculty, and individual school/college administration to discuss and develop solutions and strategic planning for programs
• Tactical Dashboard: Available to units throughout the year, the Tactical Dashboard provides data across 16 metrics.

The Process:

• Program Reports: Program representatives will utilize the two dashboards to complete a program report that will be shared with the leadership of their college or school.
• College Reports: College representatives and leadership will utilize an aggregated college level report along with the context and information provided within the program reports to create a college level report.
  
  • The colleges and schools will meet with the Provost and develop an action plan for the next year based on the college report and the meetings.
• University Report: The APR Oversight Committee will review the college level reports in order to develop a university report with aggregated trends.

• January, 2023: First meeting of Program Performance Review Committe
• June, 2023: Addition of the Strategic Dashboard to the process    
• February – April,2024: Stakeholder review and feedback   
• May - June, 2024: Feedback reviewed by committee and Provost’s Office to develop pilot year process
• June 24, 2024– September 1, 2024: Complete Program Reports
• October 7, 2024 – November 18, 2024: Complete College/School Reports
• November and December, 2024: College/School Meetings with the Provost’s Office
• December and January, 2024: University-Level Report on APR

• Justin Bittner - Associate Director of Analytics, College of Computing and Informatics
• Anna Chrulkewicz - Senior Vice Provost for Finance and Administration, Office of the Provost
• Sujoy Das - Vice Provost of Institutional Research, Assessment and Accreditation, IRAA (Co-Chair)
• Lauren Davis - Associate Director of Academic Programs, Pennoni Honors College
• Melissa Englund - Director of Academic Programs, College of Computing and Informatics
• Aroutis Foster - Interim Dean, School of Education
• Sarah Haley - Director of Academic Program Data Management & Analysis, LeBow College of Business
• Joseph Hawk - Executive Director of Assessment & Accreditation, IRAA (Co-Chair)
• Kristi LeBlanc - Senior Program Manager, Dornsife School of Public Health
• Don McEachron - Teaching Professor, School of Biomedical Engineering, Science & Health
• Kelly Quigley - Associate Director of the Undergraduate Law Program, Kline School of Law
• Jeannine Shantz - Director of Research, Assessment and Evaluation, Close School of Entrepreneurship
• Jed Shumsky - Associate Dean of Education, Graduate School of Biomedical Sciences and Professional Studies
• Michael Wagner - Department Head, Digital Media, Westphal College of Media Arts & Design
• Steven Weber - Senior Vice Provost for Undergraduate Curriculum and Education, Office of the Provost
• Chris Weyant - Associate Dean of Undergraduate Affairs and Teaching Professor, College of Engineering 
• Ann Willkomm - Assistant Dean, Graduate College

Below are resources to support the Annual Program Review Process

• April 2024 APR Presentation
  
• APR Pilot Year and Timeline
• Undergraduate Benchmark Descriptions
• APR - Program Report Collection Survey
• APR- College Report Instrument
• APR - College Report Process