Combined Student Achievement Data
Combined Student Achievement Data Updated March, 2022
Roanoke College uses multiple measures to document student success, including data collected through the Offices of Institutional Research, the Registrar, Career Services, and academic programs. This overview of student achievement and institutional success serves to guide institutional, department, and program planning to ensure ongoing alignment with the College's mission, the nature of the students served, and the kinds of programs offered at Roanoke College.
All student achievement data is updated annually, and is reviewed and discussed regularly by appropriate campus groups.
Criteria for Student Achievement
The criteria used to measure and monitor student achievement at the institutional level are:
-
Graduation Rates,
-
Retention Rates,
-
Graduate School Attendance Rates (6 months after graduation),
-
Job Placement Rates (6 months after graduation),
-
Course Completion Rates, and
-
Graduating Student Survey questions related to student achievement.
These criteria help gauge, track, and monitor key areas related to student success including achievement during a semester, progress toward overall degree completion, and outcomes post-graduation. Additionally, these criteria and these measurements are standard measures of success and common indicators of student achievement in higher education.
Targets for Student Achievement
Due to potential year to year fluctuations in these data points, Roanoke College compares a recent five year period to an older five year period, with the older five year period defining the targets. This methodology provides a more realistic picture of long term progress in each area as opposed to simply a year to year comparison. Current outcomes are calculated by averaging the outcomes from 1-5 years ago and the target is calculated from the older five year period by averaging the outcomes from 6-10 years ago. Each year, the period of years involved moves forward one year.
In cases where ten years of comparable data are not available, a single year target is established, using an external benchmark as the target. In all cases, the annual goal is to meet or exceed the calculated target for each student achievement metric.
Retention and Graduation Rates
The most recent single year first-to-second year retention rate is 75.9% (for the class that entered in fall 2020, measured in fall 2021), resulting in a 78.8% average for the most recent five years. The most recent single year six-year graduation rate for first-time full-time freshman is 69.6% (for the class that entered in fall 2015, counting graduation through August 2021). As mentioned earlier, target levels of performance, for both retention and graduation rates are set using a rolling institutional average. The goal is for the average of the five most recent years of data to equal or exceed the average of the five years preceding that five year period (6-10 years ago). The recent five year average of six year graduation rates is determined at the end of August each year. The recent five year average of freshman to sophomore retention rate is determined in late September after the fall census date each year.
Retention Rates Percent of new freshman cohort who return for their second fall |
|||
---|---|---|---|
Academic Year |
Target (5 Older Years) |
Outcome (Average of 5 Recent Years) |
Was Target Met? |
2010-11 |
78.8% |
76.8% |
No |
2011-12 |
78.0% |
78.4% |
Yes |
2012-13 |
77.3% |
79.3% |
Yes |
2013-14 |
77.6% |
79.8% |
Yes |
2014-15 |
76.9% |
79.7% |
Yes |
2015-16 |
76.8% |
80.9% |
Yes |
2016-17 |
78.4% |
81.5% |
Yes |
2017-18 |
79.3% |
81.0% |
Yes |
2018-19 |
79.8% |
80.7% |
Yes |
2019-20 |
79.7% |
80.3% |
Yes |
2020-21 |
80.9% |
78.8% |
No |
2021-22 |
81.5% |
Avail. in Sept. 2022 |
Graduation Rates Percent of a freshman cohort who graduate within six years |
|||
---|---|---|---|
Academic Year |
Target (Average of 5 Older Years) |
Outcome (Average of 5 Recent Years) |
Was Target Met? |
2010-11 |
63.9% |
66.0% |
Yes |
2011-12 |
63.3% |
66.1% |
Yes |
2012-13 |
63.4% |
66.7% |
Yes |
2013-14 |
64.0% |
66.6% |
Yes |
2014-15 |
65.3% |
65.6% |
Yes |
2015-16 |
66.0% |
64.4% |
No |
2016-17 |
66.1% |
64.7% |
No |
2017-18 |
66.7% |
65.3% |
No |
2018-19 |
66.6% |
66.5% |
No |
2019-20 |
65.6% |
67.2% |
Yes |
2020-21 |
64.4% |
68.6% |
Yes |
2021-22 |
64.7% |
Avail. in Sept. 2022 |
Graduate School and Job Placement Rates (6 months after graduation)
The Office of Career Services provides career readiness and four-year planning for students seeking and accepting employment, and annually collects data from recent alumni (6 months after graduation) seeking information on job placement, job type, salary, and graduate school attendance. We are tracking the Knowledge Rate (percent of graduates whose outcome we know), the Job Placement Rate (percent of students employed 6 months after graduation), and the Graduate School Rate (percent of students attending graduate school six months after graduation).
The most recent class with data available six months after graduation is the class of 2020 (graduates of August 2019 through May 2020). Data for the 2019-20 graduates was clearly affected by the COVID-19 pandemic.
The College gathers information on employment and graduate/professional school attendance via a combination of tools. Information is combined from Senior Exit Interviews and surveys, research on graduate profiles on Linked-In, follow-up emails with individuals, information provided by faculty, and a direct telephone campaign in September of each year. Using the multiple data sources, information was gathered for 337 of 428 graduates, a knowledge rate of 78.7%. Six months after graduation, 52.5% of the respondents reported being employed only, 16.9% reported being in graduate school only, 1.8% reported being employed and being in graduate school, 23.4% reported having no firm commitment (much higher than usual), and 5.3% reported other activities (internship, waiting to start graduate school, traveling, etc.).
Data collection methods in this area have changed over time, and insufficient comparable data is available to use the method of comparing five recent years to five older years, as is done for other metrics. In this area, the targets are set by comparison to National Association of Colleges and Employers (NACE) data from their 2017 report: “First Destinations for the College Class of 2017: Findings and Analysis”. Single year target levels of performance for both graduate school and job placement rates are set using the national averages reported in the NACE report.
Outcome Knowledge Rate (6 months after graduation) |
|||
---|---|---|---|
Graduation Year |
Target (NACE national average) |
Outcome (% of graduates with outcomes data) |
Was Target Met? |
2015-16 |
64.5% |
89% |
Yes |
2016-17 |
64.5% |
92% |
Yes |
2017-18 |
64.5% |
99% |
Yes |
2018-19 |
64.5% |
86% |
Yes |
2019-20 |
64.5% |
79% |
Yes |
2020-21 |
64.5% |
97.6% |
Yes |
2021-22 |
64.5% |
Avail. in Feb. 2023 |
Data for 2019-20 is clearly affected by the COVID-19 pandemic.
Graduate School Rates (6 months after graduation) |
|||
---|---|---|---|
Academic Year |
Target (NACE national average) |
Outcome (% of graduates with data who attended grad school) |
Was Target Met? |
2015-16 |
17.5% |
21.0% |
Yes |
2016-17 |
17.5% |
20.3% |
Yes |
2017-18 |
17.5% |
20.3% |
Yes |
2018-19 |
17.5% |
20.1% |
Yes |
2019-20 |
17.5% |
18.7% |
Yes |
2020-21 |
17.5% |
19.6% |
Yes |
2021-22 |
17.5% |
Avail. in Feb. 2023 |
Data for 2019-20 is clearly affected by the COVID-19 pandemic.
Job Placement Rates (6 months after graduation) Percent of graduates with known outcomes who have jobs |
|||
---|---|---|---|
Academic Year |
Target (NACE national average) |
Outcome (% of graduates with data who had jobs) |
Was Target Met? |
2015-16 |
63.7% |
75.8% |
Yes |
2016-17 |
63.7% |
73.0% |
Yes |
2017-18 |
63.7% |
68.2% |
Yes |
2018-19 |
63.7% |
77.0% |
Yes |
2019-20 |
63.7% |
54.3% |
No |
2020-21 |
63.7% |
67.7% |
Yes |
2021-22 |
63.7% |
Avail. in Feb. 2023 |
Data for 2019-20 is clearly affected by the COVID-19 pandemic.
Course Completion Rates
In addition to the student learning outcomes measured in courses at the program level, Roanoke College considers other course related metrics to evaluate overall student achievement and progress to graduation. Course completion rates are monitored through grade distribution reports, which are produced at the end of every academic year. We define course completion as the percentage of students who earn credit in a course compared to the total number of students enrolled at the end of the drop/add period. Earning credit means a grade of A through D- is received, or a grade of P*. This calculation will be made for the campus as a whole, covering a fall and spring semester period (September – April). For example, the single year course completion report for academic year 2020-21 report shows that overall, 92.2% of course registrations resulted in passing grades, 2.6% yielded failing grades, and 5.2% resulted in drops/withdrawals.
Course completion and grading data are monitored by the Dean's Office and by the faculty's Academic Standards Committee.
Targets for course completion rates, which are determined by institutional history and past performance of students served at Roanoke College, are calculated in the same way that targets are calculated for other student achievement criteria. The Director of Institutional Research calculates the most recent five year period by averaging the outcomes from 1-5 years ago and calculates the older five year period by averaging the outcomes from 6-10 years ago. The average of the older five year period (6-10 years ago) becomes the target number for the current academic year. The annual goal is for the recent five year period to match or exceed the older five year period.
Course Completion Rates |
|||
---|---|---|---|
Academic Year |
Target (5 Older Years) |
Outcome (5 Recent Years) |
Was Target Met? |
2010-11 |
92.9% |
93.7% |
Yes |
2011-12 |
92.8% |
94.0% |
Yes |
2012-13 |
92.9% |
94.2% |
Yes |
2013-14 |
93.1% |
94.2% |
Yes |
2014-15 |
93.4% |
94.3% |
Yes |
2015-16 |
93.7% |
94.4% |
Yes |
2016-17 |
94.0% |
94.5% |
Yes |
2017-18 |
94.2% |
94.3% |
Yes |
2018-19 |
94.2% |
94.4% |
Yes |
2019-20 |
94.3% |
94.1% |
No |
2020-21 |
94.4% |
93.7% |
No |
2021-22 |
94.5% |
Avail. in Sept. 2022 |
Graduating Student Survey Questions
The annual Graduating Student Survey is given to all expected graduates during the exit interview with Career Services that takes place during the last semester prior to graduation and includes August, December, and May graduates of the current academic year. Response rates average better than 95%. The survey asks students about expectations, experiences, life objectives, and behavior while in College to name a few.
The survey also asks about Changes as a Result of College. For this section, the general question asked is: “How much did your experiences and education at Roanoke College contribute to your personal growth in each of the following areas?” Students can respond on a scale of “Very Much” (1) to “Very Little”
(3). Statements like “Writing in a clear, well-organized way” give students the opportunity to self-assess and reflect on their learning and growth in a variety of key areas. Results from the following statements are monitored and reviewed as criteria for student achievement at the institution level:
-
Writing in a clear, well-organized way
-
Working cooperatively in a group
-
Persisting at difficult tasks
-
Defining and solving problems
-
Developing a reasoned ethical outlook
-
Understanding Broad Goals of a Liberal Education
-
Preparation for a Responsible Life of Learning, Service, and Leadership
These questions were chosen as measures of student achievement due to their close ties to general education objectives and to the College mission.
Using the same methodology used to calculate targets for other student achievement metrics, the Director of Institutional Research calculates the most recent five year period average and compares it to the older five year period average. The average of the older five year period becomes the target number. The number of years reported below reflects the years when sufficient comparable data was available to calculate these results. The annual Goal is to meet or exceed the older five year period.
Graduating Student Survey: Writing in a clear, well-organized way Percent of students responding “very much” |
|||
---|---|---|---|
Academic Year |
Target (Average of 5 Older Years) |
Outcome (Average of 5 Recent Years) |
Was Target Met? |
2012-13 |
53.7% |
58.5% |
Yes |
2013-14 |
55.6% |
60.0% |
Yes |
2014-15 |
55.9% |
62.0% |
Yes |
2015-16 |
56.6% |
64.4% |
Yes |
2016-17 |
57.8% |
66.4% |
Yes |
2017-18 |
58.5% |
68.7% |
Yes |
2018-19 |
60.0% |
69.8% |
Yes |
2019-20 |
62.0% |
69.2% |
Yes |
2020-21 |
64.4% |
67.5% |
Yes |
2021-22 |
66.4% |
Avail. in Sept. 2022 |
Graduating Student Survey: Working cooperatively in a group Percent of students responding “very much” |
|||
---|---|---|---|
Academic Year |
Target (Average of 5 Older Years) |
Outcome (Average of 5 Recent Years) |
Was Target Met? |
2012-13 |
55.5% |
55.2% |
No |
2013-14 |
54.7% |
56.5% |
Yes |
2014-15 |
54.2% |
58.0% |
Yes |
2015-16 |
54.9% |
59.3% |
Yes |
2016-17 |
54.1% |
61.2% |
Yes |
2017-18 |
55.2% |
62.6% |
Yes |
2018-19 |
56.5% |
64.2% |
Yes |
2019-20 |
58.0% |
64.8% |
Yes |
2020-21 |
59.3% |
64.3% |
Yes |
2021-22 |
61.2% |
Avail. in Sept. 2022 |
Graduating Student Survey: Persisting at difficult tasks Percent of students responding “very much” |
|||
---|---|---|---|
Academic Year |
Target (Average of 5 Older Years) |
Outcome (Average of 5 Recent |
Was Target Met? |
2012-13 |
60.2% |
62.3% |
Yes |
2013-14 |
60.6% |
63.6% |
Yes |
2014-15 |
61.1% |
64.4% |
Yes |
2015-16 |
61.9% |
64.1% |
Yes |
2016-17 |
61.8% |
65.6% |
Yes |
2017-18 |
62.3% |
66.2% |
Yes |
2018-19 |
63.6% |
67.9% |
Yes |
2019-20 |
64.4% |
67.6% |
Yes |
2020-21 |
64.1% |
67.1% |
Yes |
2021-22 |
65.6% |
Avail. in Sept. 2022 |
Graduating Student Survey: Defining and solving problems Percent of students responding “very much” |
|||
---|---|---|---|
Academic Year |
Target (Average of 5 Older Years) |
Outcome (Average of 5 Recent Years) |
Was Target Met? |
2012-13 |
55.0% |
58.9% |
Yes |
2013-14 |
55.6% |
60.8% |
Yes |
2014-15 |
57.1% |
61.8% |
Yes |
2015-16 |
58.1% |
63.0% |
Yes |
2016-17 |
58.3% |
64.8% |
Yes |
2017-18 |
58.9% |
66.0% |
Yes |
2018-19 |
60.8% |
67.2% |
Yes |
2019-20 |
61.8% |
67.1% |
Yes |
2020-21 |
63.0% |
67.4% |
Yes |
2021-22 |
64.8% |
Avail. in Sept. 2022 |
Graduating Student Survey: Developing a reasoned ethical outlook Percent of students responding “very much” |
|||
---|---|---|---|
Academic Year |
Target (Average of 5 Older Years) |
Outcome (Average of 5 Recent Years) |
Was Target Met? |
2012-13 |
41.0% |
43.2% |
Yes |
2013-14 |
41.5% |
44.4% |
Yes |
2014-15 |
41.9% |
45.6% |
Yes |
2015-16 |
43.4% |
47.8% |
Yes |
2016-17 |
42.6% |
49.4% |
Yes |
2017-18 |
43.2% |
50.8% |
Yes |
2018-19 |
44.4% |
50.8% |
Yes |
2019-20 |
45.6% |
50.3% |
Yes |
2020-21 |
47.8% |
49.4% |
Yes |
2021-22 |
49.4% |
Avail. in Sept. 2022 |
For the last two questions reported below, the question has only been asked for the last few years. For those two questions, the target is a fixed target of 75% of students responding “Strongly Agree” or “Agree”. When a few more years of data are available, the comparison will switch to comparing 5 recent years to 5 older years.
Graduating Student Survey: Understanding Broad Goals of a Liberal Education Percent of students responding “Strongly Agree or Agree” |
|||
---|---|---|---|
Academic Year |
Target (Fixed Target) |
Outcome (Current Year) |
Was Target Met? |
2014-15 |
75% |
88.5% |
Yes |
2015-16 |
75% |
91.3% |
Yes |
2016-17 |
75% |
90.7% |
Yes |
2017-18 |
75% |
91.0% |
Yes |
2018-19 |
75% |
84.6% |
Yes |
2019-20 |
75% |
84.1% |
Yes |
2020-21 |
75% |
84.8% |
Yes |
2021-22 |
75% |
Avail. in Sept. 2022 |
Graduating Student Survey: Preparation for a Responsible Life of Learning, Service, and Leadership Percent of students responding “Strongly Agree or Agree” |
|||
---|---|---|---|
Academic Year |
Target (Fixed Target) |
Outcome (Current Year) |
Was Target Met? |
2014-15 |
75% |
89.9% |
Yes |
2015-16 |
75% |
87.3% |
Yes |
2016-17 |
75% |
88.8% |
Yes |
2017-18 |
75% |
87.3% |
Yes |
2018-19 |
75% |
86.7% |
Yes |
2019-20 |
75% |
83.3% |
Yes |
2020-21 |
75% |
84.2% |
Yes |
2021-22 |
75% |
Avail. in Sept. 2022 |
Review Schedule: Student Achievement Outcomes
Student achievement outcomes are reviewed by the appropriate groups at the College. In addition to distribution and review by various groups at the College, all criteria are reviewed annually by the President and the President’s Cabinet. When needed, these groups recommend possible actions that need to be taken related to these student achievement outcomes.
Institutional Measure of Student Achievement |
Outcomes Reviewed By and/or Distributed to |
Time of Year |
All Metrics |
Cabinet |
Summer Cabinet Retreat |
All Metrics |
Board of Trustees |
Fall Board Meeting |
Graduation Rates |
Senior Staff group* and Dean’s Council** |
Fall Semester |
Retention Rates |
Senior Staff group* and Dean’s Council** |
Fall Semester |
Graduate School Attendance Rates (6 months after graduation) |
Senior Staff group* and Dean’s Council** |
Spring Semester |
Employment Rates (6 months after graduation) |
Senior Staff group* and Dean’s Council** |
Spring Semester |
Course Completion Rates |
Academic Standards Faculty Committee |
Fall Semester |
Graduate Student Survey questions |
General Education Committee |
Fall Semester |
*Senior Staff: Chaired by the Vice President and Dean of the College, this group includes the Dean of Students, the Associate Dean for Academic Affairs and Administration, the Associate Dean for Academic Affairs & Student Engagement, the Associate Dean for Academic Affairs and General Education, the Associate Dean/Registrar, the Director of Institutional Effectiveness & Assessment, the Director of Institutional Research, the Director of the Library, and the Chief Information Officer.
**Dean’s Council: Chaired by the Vice President and Dean of the College, this group consists of 15 academic department chairs, the Associate Dean for Academic Affairs and Administration, the Associate Dean for Academic Affairs & Student Engagement, and the Associate Dean for Academic Affairs and General Education.
Questions
Questions regarding the Outcomes Data presented here can be directed to Mr. Brandon Wolfe, Director of Institutional Research, bwolfe@roanoke.edu or 540-375‐2540.