COGNITION CATALYSTS / EVALS FOR ENGINEERS

See the work.
Understand the engineer.

Give engineers a real assignment. Review their code, how they used AI, and the thinking behind their solution.

Create a workspace Explore the demo

Assignments AI EngineerSample assessment

ASSIGNMENT BRIEF

Make retrieval reliable.

Build an evaluation suite for a question-answering API.

What we want to see

Catch unsupported answers and missing citations

Make the evaluation reproducible

Explain the trade-offs in your approach

Job description retrieval-api

starter-project.zipAssignment brief + project + recorderZIP

Start with the work your team actually does.Sample data

An illustrative walkthrough. Explore the demo to try the workspace.

01 Real work, in their own editor02 Context on their use of AI03 Their reasoning, in their words

FROM INVITATION TO DECISION

From the assignment
to the hiring decision.

One place to run the assignment and review what matters.

Set the assignment.

Add a role, your job description, and a task that reflects the work. Attach a starter ZIP or link a GitHub repository.

Let them work.

Share a private candidate link. Their timed session starts when they download, and they work locally in their own editor.

Review the whole story.

Read the code, inspect recorded activity, and listen to their explanation. Keep your notes and hiring decision together.

candidate / assignment

# Work in your own environment

$ node recorder.mjs start

Recording started with your consent

$ cd project

$ npm test

Check your solution as you build

$ node ../recorder.mjs submit

Package your work. Upload it on your candidate link.

Local recording. No connection needed while you work.

A FAMILIAR WAY TO WORK

Their editor.
Their approach.

Give candidates room to solve the problem with the tools they know. Then ask them to explain the choices they made.

Work locally in a preferred editor
Clear recording consent and a visible deadline
Submit code with a short audio walkthrough

Recording covers supported, configured tools. It does not monitor the whole computer.

A FEW DETAILS

Questions,
answered.

Can candidates use AI tools?

Yes. Candidates can use their preferred tools. The optional local recorder captures file snapshots, commands run through its shell, and events from supported, configured agent hooks. It does not capture every assistant or browser chat.

When does the assessment timer start?

The timer starts when the candidate chooses Start & Download, not when they open the invitation. You choose the duration. Downloading again or closing the browser does not reset the deadline.

What does the candidate submit?

A ZIP of their work and a short audio explanation recorded in the candidate portal. They review both and click Submit before the deadline. Expiry does not automatically upload their work.

Does this automatically score candidates?

No. Your team reviews the submitted evidence and makes the decision. Activity logs add context, but they are not proof of authorship or a complete record of everything a candidate did.

YOUR NEXT ENGINEERING HIRE

Start with a real problem.

Create a role, add your assignment, and invite your first candidate.

Create a workspace

Their editor.
Their approach.

Give candidates room to solve the problem with the tools they know. Then ask them to explain the choices they made.

Work locally in a preferred editor

Clear recording consent and a visible deadline

Submit code with a short audio walkthrough

Recording covers supported, configured tools. It does not monitor the whole computer.

See the work.Understand the engineer.

Make retrieval reliable.

From the assignmentto the hiring decision.

Set the assignment.

Let them work.

Review the whole story.

Their editor.Their approach.

Questions, answered.

Start with a real problem.

See the work.Understand the engineer.

Make retrieval reliable.

From the assignmentto the hiring decision.

Set the assignment.

Let them work.

Review the whole story.

Their editor.Their approach.

Questions, answered.

Start with a real problem.

See the work.
Understand the engineer.

From the assignment
to the hiring decision.

Their editor.
Their approach.

Questions,
answered.

See the work.
Understand the engineer.

From the assignment
to the hiring decision.

Their editor.
Their approach.

Questions,
answered.