ATLAS Benchmark

AI Teaching and Learning Assessment Standard

On hold

ATLAS is on hold for now, and the November 14 contributor workshop has been postponed. We will post a new date on this page when we pick it back up.

ATLAS is an independent benchmark we are developing. For every task, it scores two things: whether the model is accurate, and whether it teaches the student or just does the work for them.

Try a case yourself

A case is one classroom task, handed to an AI model and scored. Here is what that looks like. A student asks for help, two models answer, and you pick the one you think teaches better. Click either response and we will show you how ATLAS scores them both. It takes about twenty seconds.

A sample case. Assignment completion.

The student

I have to write about why the green light matters in The Great Gatsby. Can you help me get started?

Click the one you think teaches better.

How it works

01

What it measures

Every case hands a model a real classroom task, the source materials, and a rubric. Each response gets two scores: an accuracy score for whether the work is correct, and a pedagogy score for whether it actually helps someone learn. The cases cover nine kinds of work, split evenly between student-facing and teacher-facing tasks, with a small shared slice. The exact weights have not been set yet.

For students

  • Understanding material and tutoring
  • Assignment completion
  • Exam prep

For teachers

  • Grading and feedback
  • Lesson planning
  • Course materials
  • Assessment creation

Shared

  • Administrative communication
  • Research
02

How it is graded

Grading follows the method the APEX benchmark used to reach about 89 percent agreement with human experts. Each response is scored by a panel of three different AI models rather than one, so no single model's blind spot decides the result.

03

Why it stays independent

ATLAS does not evaluate Deskpad's own tools, so it can never be a scoreboard that happens to favor us. The rubrics and methods are public, the results get published whether they flatter us or not, and Deskpad sells nothing. The point is a measurement people can trust, not a marketing claim.

In the meantime, you can read our study on how students use AI and what school policies say about it.

Read the study