Institutional Effectiveness Planning
Institutional Effectiveness (IE) is a set of ongoing and systematic processes and practices that include planning, evaluation of programs and services, the identification and measurement of outcomes across all institutional units (SACS 3.3.1 series of comprehensive standards) and the use of data and assessment results to inform decision making.
Note: Adapted from http://cpcc-cfar.com/institute-general-information/
Pitt Community College utilizes the CampusLabs "Compliance Assist" online program to coordinate campus wide assessment and IE practices (including SACS compliance reporting).
There are four steps to follow to document your assessment practices:
- Determine your Program Learning Outcomes (PLOs) and / or Operational Outcomes (OPOs)
- Determine your assessment method(s)
- Determine your benchmark(s) for performance and collect results data / information
- Describe what (if any) changes / interventions are needed derived from the results.
Following these steps will keep you current in your IE planning responsibilities and helps the College continue to develop its culture of assessment.
What are Measures of Student Learning?
Direct Measures (Tangible Evidence)- These provide evidence in the form of student products or performances and demonstrate that actual learning has occurred relating to a specific content or skill. Some examples (that would also satisfy SACS 3.3.1) are below:
- Course and homework assignments
- Examinations & quizzes
- Term papers and reports
- Research projects
- Case study analysis / analyses
- Rubric (criterion based rating scale) scores for writing, oral presentations, & performances
- Artistic performances and products
- Pass rates or scores on licensure, certification, or subject areas tests
- Capstone projects, exhibits, or performance
- Employer and internship supervisor ratings of students' performance
Indirect Measures (supports direct measures)- These reveal characteristics associated with learning, but they only imply learning has taken place.
- Course evaluations
- Number of student hours spent on homework
- Grades not based on explicit criteria related to clear learning goals.
- Focus group interviews with students, faculty members, or employers
- Job placement
- Employer or alumni surveys
- Student perception surveys
What are Outcomes?
An outcome is the desired effect of a program, service, or intervention but is more specific than a goal. It is student / participant focused. Pitt CC measures two different kinds of outcomes:
- Program Learning Outcomes (PLOs) and
- Operational Outcomes (OPOs)
A Program Learning Outcome (PLO) focuses on "how students will be different because of a learning experience, the knowledge, skills attitudes and habits of mind that students take with them from a learning experience" (Suskie, 2009, p.117).
Operational outcomes refer to the services we offer and are considered operational rather than learning outcomes. These describe the intended effect that a service has (such as retention or completion rates) instead of what a student learns by participating in a program, service or other intervention.
Reference: Suskie, L. (2009). Assessing student learning: A common sense guide. San Francisco. Jossey-Bass.