← Back to the article

Audits

Carrots help night vision if you lack vitamin A; no boost shown otherwise.

Version 3. FactHub's auditors are automated reviewers, separate from the process that writes articles. Each checks a fixed, published list of things and grades the results with its own published rule. They can be wrong; an audit is not a human expert review. All auditors

Across versions

Skeptic

3 of 5 checks passed · version 2 · claude-opus-5-5 · 12 October 2026

B: The reasoning holds, with several minor gaps, such as secondary objections left out or confidence a step high.

5 checks · 2 concerns
  1. Concern (minor) Confidence matches the evidence

    In the first objection's response, note that the 1942 study was a weak test (partly deficient subjects, imprecise equipment) instead of citing it as a clean null.

    Moderate confidence is well calibrated: the article says the well-nourished half 'rests on physiology, one old experiment and expert judgment' and found 'no modern randomized trial'. The title ('no boost shown otherwise') and answer phrase the null as absence of evidence, which is right. The one gap: the response to the first objection states 'a 1942 controlled study found no improvement in dark adaptation even at very large doses' with no caveat, while the study's own limitation says many participants showed signs of deficiency and the authors questioned whether the test was sensitive enough. A null in a partly deficient group also suggests the test may not have detected even deficiency correction, so it is close to uninformative for the well-nourished question. The conclusion and key points carry this caveat; the objection response, which readers may read alone, does not. A reader of the full article would come away with the same belief, so Minor.

    About conclusion, evidence:carrots-1942-supplement-study, limitation:carrots-1942-supplement-study The finding

  2. Concern (minor) Strongest objections answered

    Address whether extra vitamin A could speed dark adaptation (recovery after bright light) or help older adults with slowed adaptation, not just the final threshold.

    The main objections are covered well: 'more must be better' (answered with mechanism and the 1942 study), hidden marginal deficiency and malabsorption (answered with prevalence data and the cystic fibrosis report, with an honest admission that a small benefit for marginal status can't be ruled out), the radar origin story, wartime anecdotes, and supplement safety. A secondary alternative is not addressed: the article's evidence for the well-nourished case concerns the dark-adapted threshold ('changes in the nearly dark-adapted threshold were similar') and the mechanism is stated as a ceiling on pigment amount, but the article does not address whether extra vitamin A could affect the speed of rhodopsin regeneration after light exposure, or whether older adults, in whom dark adaptation is commonly slower, might benefit. These are populations and outcomes within the 'ordinary reader' scope that the article rates. Because the article's mechanism argument plausibly covers them and none of its evidence suggests a benefit, I rate this Minor rather than Material.

    About conclusion, evidence:carrots-1942-supplement-study, evidence:carrots-rhodopsin-mechanism The finding

  3. Pass Rates the real claim

    The claim 'Eating carrots helps you see in the dark' circulates as a general claim that carrots improve ordinary people's night vision, usually told to children and tied to the WWII story. The article rates exactly that reading ('The claim as most people hear it ... gives an ordinary, well-fed person better night vision') while explicitly separating out and crediting the true deficiency case, including malabsorption and the 29% of young children in low- and middle-income countries. It neither strawmans the claim (it does not rate 'carrots give super-vision') nor stretches it. The conclusion stays in scope and the editorial note states the scope boundaries (cornea, lutein/zeaxanthin excluded).

  4. Pass Rating follows from the evidence

    Before reading the finding I would have chosen Misleading: a real mechanism and a randomized trial (Nepal) support the claim only for deficient people, while for the ordinary reader there is a mechanistic ceiling ('once stores are adequate the body converts less beta-carotene'), expert judgment, and one weak null study (1942). That is the classic Misleading pattern: a true core used to imply a broader benefit. Mixed is arguable given global deficiency rates, but the article justifies its choice against both Unproven ('no line of evidence suggests a benefit beyond normal and the mechanism explains why none would be expected') and implicitly against Mixed ('accurate only under a reading ... that most people do not take'). The answer ('restore night vision lost to vitamin A deficiency but haven't been shown to sharpen it in well-nourished people') agrees with the finding.

  5. Pass Evidence is independent

    The article is candid about overlap: the mechanism item says its NIH, Harvard and NEI sources 'together ... are one line of evidence, not three', and the deficiency-prevalence item notes it shares the NIH fact sheet. Scientific American appears in three items but carries only secondary details (portion size in the Nepal item, an expert view, the RAF curator's dissent). The two halves of the conclusion each rest on distinct work: the deficient half on Dowling and Wald (1958 animal physiology) and Haskell (2005 randomized trial); the well-nourished half on Hunt and Hayden (1942) plus mechanism and expert judgment. The WWII item notes the radar account traces mainly to one historian relayed by journalists, and counters it with a separate archival record and a dissenting curator. No evidence presented as independent collapses to a single source.

Coverage: Read the full article payload of version 3 (claim, finding, answer, confidence, title, summary, context, editorial note, conclusion, key points, all five evidence items with limitations, five objections, six method steps, and source metadata). Per the Skeptic prompt, source snapshots were not read and source fidelity was not assessed. No live web was used.

Sniff Test

5 of 5 checks passed · version 2 (draft auditor) · claude-haiku-5-5 · 12 October 2026 · Benchmark run

A: Passes the sniff test: nothing obviously wrong. Minor notes may be reported as feedback without lowering the grade.

5 checks
  1. Pass Title matches the evidence

    The title 'Carrots help night vision if you lack vitamin A; no boost shown otherwise.' matches the Nepal trial (deficient women recovered), the 1942 study (no gain in adequately supplied adults), and the NIH deficiency data.

  2. Pass No obvious contradictions

    Finding 'Misleading', answer, conclusion, summary and confidence 'Moderate' are consistent with each other and with the key points; the conclusion's 'survives' refers to the deficiency reading and is not a contradiction.

  3. Pass Plausible justification

    The conclusion gives a clear reason for the rating: the mechanism has a ceiling, the only direct well-nourished test found no benefit, and no line of evidence shows a gain beyond normal.

  4. Pass Sources are relevant

    All eight sources (NIH ODS fact sheet, Haskell 2005 Nepal trial, Hunt and Hayden 1942, Dowling and Wald 1958, Scientific American, Smithsonian, AWM poster record, Norsa 2019 case report) are plausibly on topic for the claims they support.

  5. Pass Common questions answered

    Five common questions are present, and each has a response that directly addresses its question.

Coverage: Examined the auditor's five checks and the full article v3 payload (claim, finding, answer, conclusion, evidence and limitations, objections with responses, sources with names, titles, descriptions and roles, and editorial note) without reading source snapshots or the web.