top of page

Assessment reporting on student performance - driving real-time instructional decisions (CAR)

CAR Mac Final.png
CAR iPhone Final.png

The Problem

  • Teachers use formative assessments to conduct in-process evaluations of student comprehension, learning needs, and academic progress during a lesson, unit, or course. They use the results from this type of assessment to make decisions. For the longest time, Schoology LMS allowed teachers to assign formative evaluations through the platform, but teachers did not receive any kind of reporting back, only grades.

  • There are other legacy tools in the platform that provide a limited amount of reporting but those are not ideal for formative assessments. Also, the company is trying to move away from adding features to outdated tools.

  • Due to the lack of reporting and flexibility, a lot of teachers use other apps to assign formative assessments.

  • Teachers who are using other apps for formative assessments have to manually enter the grades into Schoology, which is a tedious and slow process.

CAR Legacy View.jpg

Old legacy reporting tool

My Role

I assisted in the  research and led the UI design effort  and implementation. Worked collaboratively with lead product manager, lead product designer, and development team to ensure that quality and consistency was met.

Main Responsibilities

  1. Research Assistant

  2. Interaction details development

  3. Visual Design (UI)

  4. Implementation Support

Design Toolkit

download.png

Sketch

invision logo.png

Invision

QP42w0kn.png

Optimal Workshop

Research

What we wanted to learn

  1. What is the most important information that teachers need in order to make decisions in classroom?

  2. What kind of data would make teachers use Schoology for formative assessments?

Methodologies

  • Review of support ticket

  • Remote discovery user interviews (3 total sessions)

  • Conference discovery user interviews (7 total sessions)

  • Optimal Workshop discovery and usability testing

Research Scripts.jpg

Research scripts and unmoderated usability testing questionnaire

What we learned?

  • Teachers want to know the overall performance of the class, but in most cases teachers care about the outliers, both negative and positive. This report helps teachers better understand which students need extra support or which students are ready for more advanced materials.

  • Teachers want to use formative assessments at the beginning of the class, so they can decide what to teach during the lesson or unit. Because of that, providing real-time reporting is crucial.

  • Teachers care about scores and also about the distribution of the students by learning objectives.

Concepts & Testing

Unmoderated user testing via Optimal Workshop and 7 moderated usability sessions were used to validate our concepts.

CAR concept explorations.jpg

Concept exploration and iterations

First Release

  • It was important to make sure that we provided a way for teachers to see the overall performance of the class, but more importantly to let teachers know which students were outliers, both negative and positive.

  • We also wanted to make sure there was an easy way for teachers to digest student data (sortable data table) in order to better provide support to those students either struggling, or ahead of the curve. 

  • Real-time reporting so teachers can accurately assess their classrooms knowledge of certain subject areas. This is important as it informs the areas of teaching that need to be addressed or retaught, or if they're able to move forward.

CAR Final Designs.jpg

Final design concept

Visual Design

I led the visual design exploration and final project implementation making sure to solve for all responsive breakpoints. A library was used for the box and whisker plot and styled to match the Schoology design system brand.

Box and Whisker Plot

Visual Design_Box Plot.png

Outlier Hover States

Visual Design_Hover States.png

Final Deliverables

CAR design specs 1.jpg

Design specs for development

Launched Version

CAR Mac Final.png
bottom of page