brianletort.ai
← Collections

Negative results

The failed and mixed results are part of the evidence.

A useful evidence base includes systems that missed cases, created harm, failed to improve the target metric, or worked only inside a bounded capability frontier. These records make the limits visible instead of selecting only favorable outcomes.

Inclusion criteria

Includes cases explicitly identified as negative, failed, or biased, plus cases whose published outcome reports no significant improvement, lower correctness, missed cases, harm, or a material adverse result.

10 cases · bundle 1.0.0 · reviewed 2026-08-23

03

Large US health system / Optum algorithm

Editorial lead

Commercial cost-proxy risk ranking

A predictable proxy can still allocate scarce care unjustly.

Current · updated

1 independent, 1 peer reviewed; publication outcomes are verified.

Canonical case →

08

TD Bank Group

Mortgage and HELOC pre-adjudication and application memo preparation

That preparing a mortgage or HELOC file for a credit decision requires a human to read the document package end to end - classifying documents, extracting figures, calculating income, checking consents and writing the summary - because borrower documents are too variable for a rules engine to handle reliably.

Current · updated

1 independent, 1 primary; publication outcomes are verified and reported.

Canonical case →

10

Be My Eyes

Conversational multimodal visual assistance through Be My AI

A blind or low-vision user can get immediate, private scene descriptions before choosing human assistance.

Watch status: verify the cited source and deployment condition before reusing this case.

Watch · updated

Watch status: verify the cited source and deployment condition before reusing this case.

1 peer reviewed; publication outcomes are verified.

Canonical case →