The Retention Dashboard is a CourseKey product that gives school admins, instructors and staff a real-time view of students’ performance across five critical metrics, and combines them into one risk score, with varying levels of severity, to identify students that are at risk of dropping out.
The five student performance metrics are last activity recorded (days to last activity), attendance, lateness, academics, and checklists. The five metrics are last activity recorded (days to last activity), attendance, lateness, academics, and checklists. These metrics serve as indicators of a student's performance in critical areas of their educational experience, and factors to consider when calculating a student’s risk of dropping out.
A risk score is calculated daily for active students in every school location/campus and program, which is to serve as an initial indicator, for a school admin, student advisor/coach, or instructor, of the potential risk for a given student who might be trending on or off-track in their academic journey. This information enables school staff to identify at-risk students, prioritize interventions, and optimize student retention/success activities. (Note that in the current implementation, students cannot see their risk scores, only permissioned staff).
The Retention Dashboard is available to all users who have Dashboard permissions on the CourseKey portal, and can be accessed by clicking on Retention, under Workspaces, in the left navigation menu; or the Retention tile in the Home page.
In the Retention Dashboard you can:
- Use pulldown filters to refine the selection of students shown in the dashboard.
- View a summary of Students per Risk Level, for the counts of students grouped by risk level.
- View the Students Risk Trend, for a time-based distribution of students grouped by risk level.
- View Risk Score By Student, for a list of students per the pulldown filters' selection, including their latest risk score and metric values.
- Configure the Settings for calculating students' risk scores based on a school or program's criteria, and daily alerts. (Only accessible to permissioned Admin users.)
Note that the Retention Dashboard uses the Overview and Settings pages in the Cortex’ Retention Workspace. Contact your Customer Success Manager today, to explore upgrading to the full Retention Workspace, for a richer, more compelling experience offering deeper Insights and Automations within the suite of Cortex offerings.
When first accessing the Retention Dashboard, you land on the Overview page. Within the Retention Workspace, the Overview page can be accessed any time by clicking on Overview in the top navigation bar.
The Overview page includes a set of pulldown filters, a Summary section with the Students per Risk Level visual and the Student Risk Trend visual, and the detailed Risk Score by Student table.
- Students with an active school enrollment status only (‘Active’, ‘Probation’, or ‘LOA’ for SIS-integrated institutions; and ‘Active’ for non-SIS-integrated institutions using the Skills Tracker tool), are considered for the risk score calculation, and hence, included in the Retention Dashboard.
- For non-SIS-integrated institutions using the Skills Tracker tool, students’ program enrollment/member associations can be maintained in the Program Info page, where school admins can update the status, start date and end date of a student’s program enrollment.
- If an active student does not have an enrollment/member association to a program (created from a SIS integration, or manually using the Skills Tracker tool), the student is associated with a default school program.
- When the start date of a student’s program enrollment is not known, the current date minus 365 days is set as the start date for the purpose of calculating the risk score.
- The list of programs available in the Retention Dashboard is populated by either the list of manually created programs uploaded in CourseKey (for non-SIS-integrated institutions using the Skills Tracker tool), or directly through a SIS integration. Only programs with active student enrollments/members are included in the Retention Dashboard.
- When there are no programs configured for an school, the calculation of students’ risk scores is made for a default school program.
- The student's most recent program enrollment (based on the student program enrollment’s start date, or when unknown, the student program enrollment’s creation date) is the one the risk score calculation is based on.
- If programs are available for an institution, weights & thresholds for the risk score calculation can be customized individually for each program at the school. This can be done by permissioned Admin users in Settings.
- Students’ risk scores are calculated overnight, every day, taking into account data from the start date of each student’s program enrollment until the previous day. Should data change for dates prior (for instance, an adjustment to attendance a week ago), prior days’ scores do not change, only the new daily score accounts for new/updated data.
- A student’s risk score is calculated for a given day only if the student is in an active school enrollment status, and has had an activity (per the last activity recorded) within the last 60 days.
- For the risk score to be calculated, in addition to having had an activity within the last 60 days, a student needs to have an active enrollment and attendance recorded in an active course, grades data synced from an integrated school’s LMS, and/or checklist items submissions in a Skills Tracker program.
- Students' performance data is tracked from their program enrollment's start date (or if not known, over the last 365 days).
- If a given performance metric’s value is null (because there is no student’s data for calculating it), it is ignored when calculating the student’s risk score.
- In the Overview page, students are separated into four risk levels – low, medium, high, and severe, for easier viewing and triage. (Numeric ranges for the risk levels can be configured by a permissioned Admin user in Settings.)
A set of pulldown filters can be used to refine the selection of students shown in the dashboard.
These pulldown filters are cascading, with each selection refining options for the next set of filters.
Schools: A list of all school locations/campuses for an institution.
- The selection for schools constraints the list of options for the Programs, Courses, and Instructors filters.
- Note that in the current implementation, students with records in multiple school locations/campuses are only shown for the school location/campus of their most recent program enrollment.
- Programs: A list of programs offered at the school(s) selected in the Schools filter.
- Courses: A list of courses specific to the school(s) selected in the Schools filter.
Instructors: A list of instructors for courses specific to the school(s) selected in the Schools filter.
- The Courses and Instructors pulldown filters are additive–the selection of students will include those that match any of the selected course(s) or instructor(s).
- Statuses: A list of school enrollment statuses for active students, including Active, Probation, and LOA. (For non-integrated schools, only the Active status is applicable.)
- Risk Levels: A list of the levels (severe, high, medium, low) for grouping students based on their risk score.
You can select multiple parameters and click Apply to narrow the student population you wish to look at. To start over at any time, you can click the reset icon (circular arrows) on the right.
Note that identical name values in pulldown filters (such as programs and instructors) are combined into one listing (even if the underlying IDs vary) for readability.
Students Per Risk Level
The Students Per Risk Level donut chart shows the counts and the corresponding percentages for the selection of students, grouped by risk level: low, medium, high, and severe. Note that the selection of students included in this graph matches the student population per the pulldown filters' selection, and only includes students for whom a risk score was calculated for the current date.
Students Risk Trend
The Student Risk Trend stacked area bar chart shows a time-based distribution of students (counts), grouped by risk level: low, medium, high, and severe.
- You can adjust the graph’s time interval (1 week, 1 month, 3 months, 6 months, 1 year) by clicking on the pulldown on the top right of this graph.
- The selection of students included in this graph matches the student population per the pulldown filters' selection, except for Statuses. The daily counts account for students, independently of their current school status, for which a risk score was calculated within the past 365 days.
Risk Score By Student
The Risk Score By Student table depicts the actual population of students per the pulldown filters’ selection, including their current risk score and their percentage points for the performance metrics – attendance, lateness, last activity recorded, academics, and checklists.
- The population of students in the table includes those who match the criteria for the pulldown filters’ selection, and only includes those for whom a risk score was calculated for the current date.
- If there is no data available for calculating any of the performance metrics for a student, two dashes (‘--’) are shown.
- You can use the search bar to look for students based on their first name and/or last name; or sort the list of students in ascending or descending order based on the values (percentage points) of the risk score or any of the performance metrics.
- There are controls at the bottom of the table for selecting the number of students to show per page, and to navigate across pages.
- The Export button is to download a list of the students, including all rows and columns, in .csv format.
To access the Settings page, click on Settings in the top navigation bar. This page is accessible to permissioned Admin users, to configure the Retention Dashboard such that it more closely matches parameters, weights and thresholds for calculating students’ risk score for their schools/programs.
As part of their custom configuration, each institution has the option of selecting performance metrics/risk factors to be considered for the calculation of their students’ risk scores. Permissioned Admin users can select any of the five performance metrics/risk factors available currently, to calculate daily percentage points for different aspects of a student’s performance. See our article on student performance metric and risk factor definitions to learn more.
Weights & Thresholds
The weights and thresholds are available to ensure that the calculation of students’ risk scores are adjusted based on each school or program's use cases and expected standards for student evaluation. Permisssioned Admin users can adjust the performance metrics' weights and thresholds to use for calculating students’ daily risk scores. See our article on weight and threshold definitions to learn more.
Risk levels are used to flag and group students into four categories – based on their daily risk scores, for the purpose of prioritizing communications and interventions, and optimizing student retention/success activities. Permissioned Admin users can set the minimum score for each risk level, for each school location/campus or program.
- The numeric settings describe the minimum score on a scale of 0-100 that qualifies a student for that risk level.
- Numeric levels should be set in descending order, such that the severe level’s minimum risk score is a greater number than high, high is greater than medium, and medium is greater than low (which by default is set to start at 0).
Permissioned Admin users can configure daily alerts, to send an email containing any new students at severe risk to selected staff members each morning.
- Students’ performance metrics and the risk score are calculated daily. To have staff receive updates by email overnight, with the resulting list of students who are newly elevated to the severe risk level, toggle the switch to ON, and select the staff who should receive this email.
- The available email addresses in the list are limited to CourseKey users who have at least one staff or administrative permission set (non-student users).
Please sign in to leave a comment.