What was hallucinated

Fabricated: Case Law | Amended Grounds contained non-existent or incorrect case citations produced by generative AI; the Appeal Panel noted these authorities were inaccurate and unverified. || Misrepresented: Case Law | Amended Grounds included incorrect summaries and propositions attributed to real cases (misstatements of authority) generated by AI; respondent described examples as 'fraudulent' and the panel found the references unreliable.

Details

The appellant admitted using generative AI to prepare her Amended Grounds of Appeal. The Appeal Panel and respondent identified numerous incorrect or inapplicable citations and legal propositions generated by AI; the panel noted the appellant failed to verify those citations contrary to NCAT Procedural Direction 7 and treated the Amended Grounds as unreliable in parts when assessing whether questions of law were raised.

Sanction teardown · NSW, Australia · 2025-10-30

Huang v. Champion Homes Sales

What happened

In NSW, Australia, a filing relied on an unnamed/unconfirmed AI tool to help draft legal argument. The court identified the following problems with the citations in that filing:

Fabricated (Case Law)

Amended Grounds contained non-existent or incorrect case citations produced by generative AI; the Appeal Panel noted these authorities were inaccurate and unverified.
Misrepresented (Case Law)

Amended Grounds included incorrect summaries and propositions attributed to real cases (misstatements of authority) generated by AI; respondent described examples as 'fraudulent' and the panel found the references unreliable.

Which AI tool

an unnamed/unconfirmed AI tool. Note: Charlotin's public database records tool attribution only where a court order, brief, or reporting on the matter states it explicitly; "unidentified" or "implied" means the record indicates AI use but does not name a specific product — we do not guess.

Outcome

Not specified in source record.

Additional detail

The appellant admitted using generative AI to prepare her Amended Grounds of Appeal. The Appeal Panel and respondent identified numerous incorrect or inapplicable citations and legal propositions generated by AI; the panel noted the appellant failed to verify those citations contrary to NCAT Procedural Direction 7 and treated the Amended Grounds as unreliable in parts when assessing whether questions of law were raised.

How Citation Safe would have caught this

Citation Safe runs three deterministic layers before a brief is filed: (1) does the citation exist against CourtListener's database of published opinions, (2) if quoted, does that exact language appear in the source, (3) does the cited case actually support the proposition it is cited for. Fabricated case citations fail Layer 1. Fabricated or misattributed quotations fail Layer 2 even when the underlying case is real. Misrepresented holdings — a real case cited for a proposition it does not support — are the target of Layer 3. None of these checks involve asking another language model whether the citation looks right; they are lookups and text-matches against the actual source, which is why a hallucinated citation has to survive a direct lookup against the authoritative source — not another model's opinion — to earn a VERIFIED stamp; our measured false-verify rate is published live at /quality.

Check a brief before you file it → · See our live false-verify rate

Source: https://www.damiencharlotin.com/documents/1010/Huang_v_Champion_Homes_Sales_Pty_Ltd_2025_NSWCATAP_271_30_October_2025.pdf, via Damien Charlotin's public AI Hallucination Cases Database (CC0).