How "independent check passed" is decided
This page states how the product decides when to show "independent check passed". Its numbers are read from the product's policy settings when the page is built. It describes estimated mastery: an estimate from recorded evidence.
When "independent check passed" is shown
- A child sees the words "independent check passed" after a check answer that the server scored as correct and recorded as unaided. The server makes that decision from its own records, not the app on the child's device.
- The server counts an answer as a check when it is recorded as a transfer check, an unaided first attempt or a 1-day, 7-day or 30-day re-check, and no help was given during it. Asking for help during any of them also stops it counting, even when the request is refused.
- An answer scored as wrong, an answer the scorer could not decide, and working still waiting for a teacher are not shown as an "independent check passed".
- One check passed is one piece of evidence. A skill's stage is worked out from all the evidence recorded for it. A skill reaches Practising at an estimated mastery of 0.50 and Check ready at 0.95, on the model's scale from 0 to 1. These are settings that will be tuned, not facts of nature.
- A skill is not shown as Verified until all of these hold: an independent transfer check passed with no help; at least 6 unaided answers on the skill, 1 or more of them independent; at least 1 further independent answer, or a re-check passed at least 1 day after the transfer check; the latest verifying evidence no more than 35 days old (counted as set out under the re-checks below); no conflict with a prerequisite skill; and none of the evidence invalidated.
What makes an item new to the child
- For a check, the server draws the item itself from the question bank. It does not draw an instance it has already recorded as shown or tried to this child. An instance is matched on its skill, its type of item and its content, with some equivalent spellings treated as the same (for example a decimal and the equal fraction, or the two numbers of an addition swapped); for fraction and decimal skills the two notations are kept apart. The match does not stop the same numbers appearing in a different problem.
- A kind of question the child was shown or attempted in the last 7 days is not used for a check, so a rematch the same evening is a different problem.
- A kind of question the coach has tutored the child on, with a hint or a shown solution, is not used for a check from then on.
- Once those periods have passed, a kind of question can return for a check with new numbers.
- The draw is also screened against the 50 items most recently shown to the child on the same skill, and is refused if it looks like a near duplicate of one. That screening compares wording and structure; it is a screen, not a promise that no two items look alike.
- A check is recorded as a transfer check only when the item differs moderately from every item the child has been shown or tutored on for that skill, measured on the representation, the wording, the number of steps and similar changes, counting only differences a person has reviewed. Otherwise it is recorded as an unaided first attempt. Both can be shown as an independent check passed, but a skill is not shown as Verified without a transfer check.
- A re-check follows different rules from the ones above. It uses the same kind of question as the check it follows, with different numbers, and never an instance the child has been shown in any way. The windows above do not apply to it.
- If the coach has tutored the child on that kind of question, the re-check uses another kind of question on the same skill instead, of the same declared difficulty, that the child has never been shown in any way and that does not come from the same source problem. If there is none, the re-check is not served and its window passes as missed.
- A re-check also avoids an answer the child has already been shown on that kind of question.
Help is withheld by the server
- While a check is open, the server refuses a request from that child for the coach, a hint or an explanation of a phrase. It decides this from its own record of the open check, so it does not depend on the app.
- A refused request is recorded against the check. For a transfer check, an unaided first attempt or a 1-day, 7-day or 30-day re-check, that stops the answer counting as an "independent check passed": the check counts as neither passed nor failed. The same rule holds for every kind of check.
- A re-check that stops counting this way does not lead on to the next re-check, and a wrong answer on it does not move the skill to the refresh-due stage.
- If help does reach the child during a check, the answer is recorded as assisted work and is not counted. The parent report still lists it, marked as not counted.
- A parent who opens the coach while the child's check is running is refused too, and the child's check is not affected.
- The server can only withhold help that goes through this product. It cannot see a person, a book or a calculator beside the child.
The 1, 7 and 30-day re-checks
- After a skill reaches its highest stage, the server schedules a chain of re-checks. Each is scheduled only once the one before it has been passed.
- The 1-day re-check opens 1 day after the answer it follows and closes 2 days after it.
- The 7-day re-check opens 6 days after the answer it follows and closes 9 days after it.
- The 30-day re-check opens 27 days after the answer it follows and closes 35 days after it.
- A re-check that is not answered before its window closes is recorded as missed, not as passed.
- At most 2 ordinary re-checks wait for a child at one time. When more are due, the oldest are dropped, so a returning child never meets a wall of them.
- A failed 30-day re-check moves the skill to a refresh-due stage.
- For the highest stage, the 35-day window is counted from the latest verifying evidence: the newest of the latest qualifying transfer check and a passed, unaided re-check answered at least 1 day after a transfer check. An older transfer check therefore still counts while later passes keep that anchor inside the window. After more than 35 days with no verifying evidence the skill loses the highest stage. A passed re-check renews the window only if the other conditions still hold.
What the report does and does not claim
- The parent report shows estimated mastery for each skill: an estimate made from the answers the server recorded, with the checks behind it listed and dated. Each number expands into its evidence.
- A check where help was given is listed, marked as not counted. So is a transfer check, an unaided first attempt or a 1-day, 7-day or 30-day re-check where help was asked for and refused.
- A mark that looks wrong can be contested. A corrected mark is shown beside the original, never in place of it.
- A check passed shows that the child answered that question correctly on that day, with no help the product could see. Evidence suggests the skill is secure. It does not show that the child will answer correctly on another day, in a different form or in an exam.
- A check on a screen cannot see who or what is beside the child.
- The report is not a school grade. It is not an official assessment. It does not predict an exam result, and nothing in it is a promise of an outcome.
What this page was built from
- This page is generated, not typed: the numbers, the intervals and the version names are read from the services' policy settings in the environment where the page was built, which is the shipped defaults unless that environment overrides them. A deployment that overrides a setting is not read by this page, so the live product can differ from it until the page is rebuilt with the same settings.
- Config version: mastery-stage-policy-2 + verified-mastery-policy-2 + retention-scheduling-policy-1 + check-start-policy-1 + retention-selection-policy-2.
- Settings fingerprint: 058f283b80b9. It changes whenever any number on this page changes, even if a version name was not updated.
Versions this page was built from
- Estimated-mastery stage thresholds:
- mastery-stage-policy-2
- Highest-stage conditions:
- verified-mastery-policy-2
- Re-check schedule:
- retention-scheduling-policy-1
- Check selection:
- check-start-policy-1
- Re-check selection:
- retention-selection-policy-2