Skip to main content

Assessments

Scored question banks with random draws, topics, attempts and pass routes

J
Written by Justin

An Assessment is a scored check you place between the pages of a lesson. You write a bank of questions, decide how many each learner draws from it, and set the rules for attempts, time, and passing. Mindsmith draws each learner's questions from the bank, times and scores the attempt, and can send learners down different paths depending on how they did.

Before you start

  • Your lesson needs an up-to-date theme. If the Assessment card is grayed out with "You must upgrade your theme to use assessments", upgrade the lesson's theme first.

  • Adding an Assessment turns your lesson into a branching lesson. Your existing pages stay in the same order and learners still move through them the same way. The difference is that pages are now connected by routes you can see and change on the branching canvas. See "Branching lessons" for how that works.

  • Assessments are added in the lesson's main language. In a translated copy you can edit the wording but not the questions or settings (see "Translations" below).

Adding an Assessment

  1. Open your lesson in the Editor.

  2. Select the page the Assessment should come after.

  3. Click Add Page in the page list, then choose the Assessment card.

  4. The Assessment appears in your page list right after the selected page, and its editor opens.

You can also add an Assessment from the branching canvas: open the node menu and choose Assessment. Or ask the Mindsmith Agent to create one, for example "Create an assessment with 10 questions on the safety procedures in this lesson."

To delete an Assessment, click the ... menu on its card in the page list and choose Delete.

The question bank

Each Assessment has its own question bank: every question you write for it. Learners don't answer the whole bank. Each attempt draws a set of questions from it, so you can write more questions than any one learner will see, and every retake can bring fresh questions.

Adding questions to the bank

Click Add question and pick a type:

  • Multiple Choice

  • Select Multiple

  • Short Answer

  • Ranking

  • Matching

Each question works the same way it does elsewhere in your lesson, including its feedback and, for Short Answer, its grading examples and partial credit. See "Question tiles" for the details of each type. Drag the handle to reorder questions in the bank.

The intro screen

Every Assessment opens with an intro screen. Give it a Title and an optional Description that tells learners what's coming.

Topics

Topics group the questions in your bank. Use them to guarantee each draw covers every subject, to show learners how they did on each topic, and to route learners based on a topic score.

  • Open Topics in the Assessment settings and click Add topic. Topic names must be unique.

  • Tag each question with one topic. Use Filter questions to see a topic's questions, or Untagged for ones without a topic.

  • Rename a topic by editing its name, or delete it with its trash icon. Deleting a topic removes it from every question, and you can undo it.

Assessment settings

Click the gear icon next to Assessment in the Assessment editor to open its settings. They have three sections: Grading (attempts, time, passing, and feedback), Questions (how questions are drawn from the bank and shown), and Topics.

Questions: drawing from the bank

  • Questions shown: how many questions each learner draws from the bank. Leave it at the full bank to show every question, or lower it to give each learner a random draw.

  • Including at least (appears when you show fewer than the full bank and use topics): a minimum number of questions from each topic, so every draw covers every subject. The rest of the draw comes randomly from the whole bank.

  • Randomize question order: shuffles the order of the drawn questions (on by default). Turn it off to keep the order of your bank.

  • Show questions: One at a time (the default) or All on one page. See "One at a time or all on one page" below.

How questions are drawn

When you show fewer questions than the bank holds, Mindsmith deals them like a deck of cards:

  • Each attempt draws from the questions the learner hasn't seen yet.

  • Learners only see a repeat once they've been through the whole bank (or the whole topic, for a topic's minimum). Then the deck is reshuffled.

  • Topic minimums are always met if the topic has enough questions. If a topic has fewer questions than its minimum, learners get all of them.

Grading

  • Attempts: how many times a learner can take the Assessment, from 1 attempt to 5 attempts, or Unlimited (the default).

  • Time limit: turn it on to give each attempt a limit in minutes (1 to 480; it starts at 20). The clock keeps running if the learner reloads the page. When time runs out, their answers are submitted automatically.

  • Passing score: the percentage learners need to pass, from 5% to 100%, or No passing score. Choosing a passing score here gives the Assessment separate Passed and Failed routes. Until you choose one, an Assessment that counts toward the lesson score uses the lesson's Minimum score to decide pass or fail, with a single Next exit.

  • Retry until passed: learners who fail can't move on while they still have attempts left. They must retry until they pass or run out of attempts. This needs a passing score.

  • Feedback mode: how much each question reveals after the learner answers:

    • Full feedback (default): shows whether each answer was right and your feedback.

    • Wrong answers only: only flags the questions they missed.

    • None: no per-question feedback. Learners only see their final result.

One at a time or all on one page

Show questions changes when learners get feedback, but not how the attempt is scored.

One at a time

All on one page

What learners see

"Question 2 of 10". Continue (or Finish on the last question) appears once they've answered

Every drawn question on one page, with a count of how many they've answered. Submit unlocks once every question is answered

Moving around

One question at a time, in order

Scroll freely and answer in any order

When feedback appears

After each question, following Feedback mode

Only after they Submit. With Feedback mode set to None, submitting goes straight to the results

Best for

Learning checks where feedback on each answer helps

Exam-style tests where answers shouldn't be revealed until the end

Scoring is the same either way:

  • The attempt is scored when the learner finishes or submits (or when the time limit runs out).

  • Every drawn question has the same weight. Short Answer questions (half credit) and Matching questions (per correct pair) can earn partial credit.

  • Learners must answer every question to finish. If the time limit runs out first, unanswered questions score zero.

  • The learner's score is their best attempt, and that's what passing, routing, and the lesson score use.

What learners see

The intro screen

Learners see your title and description with a summary of the rules: the number of questions, the time limit, the passing score, and how many attempts they have. They click Begin to start. Later attempts start from Retry assessment on the results screen.

Answering

  • Learners answer one question at a time or all on one page, depending on Show questions (see "One at a time or all on one page").

  • If there's a time limit, a countdown shows how much time is left. When it runs out, the attempt is submitted automatically and unanswered questions score zero.

Focus during an attempt

While an attempt is in progress, learners stay inside the Assessment:

  • The lesson sidebar is locked. Clicking a page shows "Finish the assessment before moving on."

  • Find in lesson is hidden.

  • In a course, learners can't switch lessons until they finish.

The lock applies even when the lesson uses open navigation.

Results

After finishing, learners see their score, how many questions they got right, and their attempts.

  • With a passing score, they see Passed or Failed. If they're out of attempts, they can continue with their best score.

  • With no passing score, they see Completed.

  • While they have attempts left, they can Retry assessment. It's highlighted when they failed.

  • If they were scored on two or more topics, they get a breakdown by topic, weakest first.

  • The score shown is their best attempt. When their latest attempt is lower, the best is labeled as such. The correct count and the topic breakdown are for their latest attempt.

  • Under Retry until passed, Continue stays disabled ("Pass the assessment to continue") until they pass or run out of attempts.

Coming back to an Assessment later doesn't reset it. Learners keep their attempts and best score.

Narration

If your lesson has narration, learners hear the intro and then each question as it appears (or all the drawn questions, when they're on one page). The results screen isn't narrated. Generating narration creates recordings for the title, the description, and every question in the bank.

Sending learners different ways after an Assessment

On the branching canvas, an Assessment with a passing score has two exits:

  • Passed: where learners go when their best score meets the passing score.

  • Failed: where learners go otherwise. For example, send them back to review pages, then on to the Assessment again.

If you leave one of them unconnected, it follows the Assessment's regular Next route. Without a passing score, or with Retry until passed on, there's a single Next exit.

Watch out for loops. If Failed can only lead back to the Assessment and attempts are limited, a learner who uses up their attempts without passing sees Finish lesson on the results screen, and the lesson ends there without reaching the rest of your pages. To keep those learners going, connect Failed to a path that can move on, set Attempts to Unlimited, or turn on Retry until passed. On the canvas, a line that loops back to an earlier point is highlighted.

Routing on score or topic with a logic node

For finer control, connect the Assessment to a logic node and add conditions that check its score:

  1. Add a logic node after the Assessment.

  2. Add a condition and pick the Assessment under Question or assessment.

  3. Choose Score at least or Score below, and a percentage (it starts at 70%).

  4. Optionally pick a topic in place of Overall score, to route on how the learner did in just that topic.

  5. Connect each condition to where those learners should go, and set the Default route for everyone else.

Things to know:

  • Overall score conditions use the learner's best attempt. Topic conditions use the learner's best score on that topic across all attempts.

  • The first condition that matches wins. Learners who match nothing, or haven't finished the Assessment, follow Default.

  • A topic that a learner might not be shown is marked Not always shown. If the learner was never shown that topic in any attempt, the condition doesn't match.

  • If you delete a topic that a condition uses, the condition falls back to the overall score.

Scores, completion, and reporting

The lesson score

An Assessment's best attempt counts toward the lesson score alongside your other graded questions. Every question has the same weight. Only Assessments on the learner's actual path count.

To control what the lesson score includes, open lesson Settings, go to Scoring, and use Score from. It can be All Content, or specific sections or Assessments. Minimum score sets the score learners need to pass the lesson.

Completion

In lesson Settings, under Completion, an Assessment counts as done once the learner has finished an attempt. If Retry until passed is on, they must pass or use all their attempts first.

LMS and course reporting

  • SCORM: the lesson reports its score, plus either Passed/Failed/Incomplete or Complete/Incomplete, depending on LMS Reporting Mode in Settings. If a learner retakes an Assessment after reaching the end of the lesson, the new result is reported again.

  • xAPI: a scored statement is sent when the outcome is settled and again if it changes.

  • LTI: the score is passed back to your LMS after the learner's progress is saved.

  • Courses: each lesson's score feeds the course score, with every question weighted equally.

A learner's saved progress keeps only their last three attempts, so it fits SCORM 1.2's storage limit. Their best score and attempt count are always kept.

Analytics

  • In the Engagement view, an Assessment appears under its own title. A learner counts as having completed it once they've answered the number of questions you show.

  • In a learner's detail view, pick an attempt to see the questions they were dealt and how they answered. Their best attempt is marked Best.

  • Exported learner results include the Assessment's questions.

Translations

In a translated copy of a lesson, the Assessment's structure is set by the main language. You can translate the question, answer and feedback text, the intro, and topic names. You can't add or remove questions or change settings, topics, or routes. The editor shows "Questions and settings are set in {language}. You can edit their text here."

Tips

  • Write a bigger bank than you show. A bank of 20 with 10 shown gives every retake fresh questions.

  • Use topic minimums so a random draw can't leave out a whole subject.

  • Connect both exits. If you set a passing score, decide where Passed and Failed each go. The editor warns you when one isn't connected.

  • Don't leave an Assessment empty. An Assessment with no questions lets learners continue straight past it and routes as 100%, but adds nothing to the lesson score. The editor flags it.

  • Preview the lesson to take the Assessment yourself before you share it.

Did this answer your question?