Audits
Are Seattle's 911 calls for trash and open fires at a record so far in 2026?
Version 7. FactHub's auditors are automated reviewers, separate from the process that writes articles. Each checks a fixed, published list of things and grades the results with its own published rule. They can be wrong; an audit is not a human expert review. What this means · All auditors
Across versions
First Look
A: Passes the first look: nothing obviously wrong. Minor notes may be reported as feedback without lowering the grade.
- Title matches the evidence
- No obvious contradictions
- Plausible justification
- Sources are relevant
- Common questions answered
- Headline and verdict agree
6 checks
-
Pass Title matches the evidence
The title asks whether these 911 calls are at a record so far in 2026. ev-calls reports 3,809 January to October 2026 as the most since 2004, and the conclusion calls the record narrow, so the title does not overstate it.
-
Pass No obvious contradictions
Finding True, answer and conclusion agree. Figures match across sections (3,809; 2.7% and 5.7%; 4.73 vs 4.63 per 1,000; 1,617 to 830; 820 to 38; 1,426 to 2,394; 70 of 968). Key point 4's 'most of these calls are not confirmed encampment fires' is consistent with the limitation that a call is not a confirmed fire.
-
Pass Plausible justification
The conclusion explains the True rating from the counts: the most for those months since 2004, more than six times the 2015 to 2018 average, and a narrow record that is stated as a count. It also gives the per-resident and encampment-type context. The conclusion's 'must have been' inference compares full-year 2025 confirmed fires with January to October 2025 type calls, a period mismatch, but that is supporting detail and not the basis for the rating, so it is not a finding here.
-
Pass Sources are relevant
Cited sources are the Seattle Fire Department dispatch dataset and its saved analyses, the City of Seattle open data portal, the state population estimates for the per-resident rate, the city Human Services encampment reports for confirmed fires, and a 2021 KOMO report on the encampment-fire count. Each is on topic for the figure it supports.
-
Pass Common questions answered
There are seven common questions. Each response answers its question directly, including the 'Unknown' answer on backyard burning and the 'No, slightly' answer on the margin of the record.
-
Pass Headline and verdict agree
Step b sentence: 'Are Seattle's 911 calls for trash and open fires at a record so far in 2026? Yes.' Step c: calls of these types are at a record so far in 2026. Step d: the claim, finding True and answer all say the same, with no negation in the claim or title, so a Yes means the claim is true.
Coverage: Read the article JSON in full: title, claim, finding, answer, conclusion, description, key points, evidence items with limitations, the seven objections and responses, method, sources and takeaway statements and quotes, and the changelog. Did not read source snapshots, the web, or the underlying dataset, and did not re-run any counts. I checked internal consistency only: the percentages, per-1,000 rates, population change, and figures repeated across sections all reconcile with the takeaway statements. Every takeaway in the input is marked status 'not yet checked', so none is established on the record I was given. The key points are labeled established, but they rest on takeaways that are still unchecked, so I treated the numeric claims as unverified and relied on the article text only. I did not assess images, chart captions beyond their stated purpose, the related shelter node, style, or title form beyond the check 6 pairing. The 2021 KOMO quote and the city encampment-fire definitions are unverified from the sources themselves.
Skeptic
A: The rating and confidence follow from the evidence, the article rates the real claim, and the strongest objections are answered. A single minor note for the author does not lower the grade.
- Rates the real claim
- Rating follows from the evidence
- Confidence matches the evidence
- Strongest objections answered
- Evidence is independent
- Lead questions hold up
- Rating states its terms
7 checks
-
Pass Rates the real claim
The claim is about Seattle's "911 calls for trash fires and illegal open burning" being "at a record high so far in 2026." The article rates exactly that. Method step 1 defines it as calls dispatched as illegal burns, rubbish fires or encampment fires, and the data run January to October. Adding the encampment fire type could make the claim easier to satisfy. The article closes that gap: key point 1 and the conclusion say "Illegal burn and rubbish fire calls alone, 3,771, are also a record." It also tests the total with dumpster fires added (4,135). People who repeat this claim usually imply that street or camp burning is at a record. The article meets that reading too. Key point 6 says "A call is not a confirmed fire," and key point 4 notes that confirmed tent and RV fires halved. The conclusion stays citywide and within 2026 year-to-date. The two area boxes are framed as context, not as part of the claim.
-
Pass Rating follows from the evidence
Taking ev-calls as stated, the January to October 2026 count is 3,809, against 3,708 in 2025, 3,605 in 2022 and 2024, and about 440 to 640 a year from 2004 to 2018. That makes it the highest since the log began. The record holds under every alternative count the article gives: - one call per address per day: 3,731 vs 3,637 - dumpster fires added: 4,135 vs 4,035 - illegal burn and rubbish fire calls only: 3,771, above any earlier three-type total The claim concerns calls, so the per-resident result (2022 higher) and the gap between calls and confirmed fires do not make the literal claim false. I would also choose True. Mostly true is conceivable for readers who mean fires or rates, but the claim's own wording is about call counts. The answer ("3,809 ... a record") matches the finding.
-
Pass Confidence matches the evidence
High confidence rests on a complete count of the city's own dispatch log for the same months each year. This is not a sample. The record also survives de-duplication, the dumpster-fire addition and dropping the encampment type. The limitations that matter are stated in limitation:ev-calls: - a call type is what crews were sent for, not a confirmed fire - cancelled dispatches are not marked - more people calling could raise counts - the data can be revised - brush fires are excluded The conclusion also limits the confidence explicitly: "It would be lower for any claim about confirmed fires." The title is a question. The description and summary call the rise "small" and note that confirmed camp fires halved, so they do not overstate the finding. The 2.7% margin (101 calls) is narrow, but it is well disclosed and robust to the stated checks. High is supportable for a count claim.
-
Pass Strongest objections answered
The strongest challenges are answered with evidence: - Labeling or call-type changes: obj-coding and obj-label cite the type counts and the address check. They concede what cannot be ruled out ("camps move") and note that every year since 2022 used the same types. - Narrow margin and repeat dispatches: obj-margin and the de-duplicated counts. - Population growth: obj-per-resident, which concedes that 2022 was higher. - Calls are not fires: key point 6 and obj-backyard. - More people calling rather than more burning: the conclusion and limitation say plainly that the data can't separate them. These answers concede where the evidence runs out rather than dismissing the objections. Possible shifts of incidents into these types from types not checked, such as brush fires, would affect interpretation, not the truth of a claim about calls of these types. The limitation also flags that brush fires are excluded.
-
Pass Evidence is independent
ev-calls, from the city's public dispatch log, carries the rating. ev-verified uses Human Services Department reports of SFD-confirmed encampment fires. It ultimately draws on the same department, and its call figures (tk-vs) come from the same FactHub dataset. However, the article does not present ev-verified as independent support for the record. It is context, labeled "contradicts," about confirmed fires versus calls. The confidence statement rests openly on one dataset, and for a count claim that is the appropriate primary source. No overstated independence.
-
Pass Lead questions hold up
The only lead question is obj-encampment-down: "Fires the fire department confirmed at Seattle tent and RV encampments fell by about half from 2022 to 2025." with the short answer "Yes." 1. Surprising: Pass. A reader who has just seen "record" 911 fire calls would likely guess camp fires rose. 2. Not the headline: Pass. The title and answer do not mention confirmed fires. 3. Settled as worded: Pass. "Confirmed" fires is a defined count that the city reports as 1,617 and 830, and "about half" matches that. 4. Neutral: Pass. It affirms the city's figure, but the article does not use it to correct one side while sparing the other. The claim-spreaders' claim is itself rated True, and the response notes that calls did not fall. 5. Stands alone: Pass. "Yes: they fell from 1,617 in 2022 to 830 in 2025" is plain and self-contained.
-
Pass Rating states its terms
The finding is True, but a definition is in play: whether "record" means raw counts or a per-resident rate, and which call types count. Key point 5 states the reading used and the result under the other one: "The record is in raw counts ... per 1,000 residents, 2022 (4.73) was higher than 2026 (4.63)." Key point 1 gives the result for illegal burn and rubbish calls alone. Key point 6 covers readers who mean confirmed fires. Each alternative reading is answered in a key point, not only in context.
Coverage: I examined the full article payload: claim, finding, answer, confidence, description, summary, key points, context, conclusion, both evidence items with their methods and limitations, all seven objections, the lead objection (obj-encampment-down), method steps and source and takeaway statements. Every takeaway in the sources block is marked "not yet checked," none "established." Under the division of labor I took the evidence and figures as the article states them. I did not verify that the FactHub saved analyses, the OFM population figures, the city's UCT reports or the KOMO report say what the takeaways claim. Those figures should be treated as unchecked pending the Source Checker. I read no source snapshots and used no live web. Outside knowledge was used only to brainstorm objections, such as reclassification from unchecked call types like brush fires and dispatch-practice changes. I judged these to bear on interpretation rather than the rating of a claim about calls.