NOT BECAUSE OF AI, home

Measured AI benefits · as of

Not because of AI

Trials and deployments where AI was measured against something and did not help, or made things worse. They sit here under the same grades as the wins. A registry that only records successes is advertising. A clean null tells you more about what AI does than most press releases.

How sure?Showing strict entries first. 1 less certain entry is behind this switch, labelled.

7 entries

  1. Null on intention-to-treat

  2. No change in primary outcome

  3. Lower grades (RCT)

  4. Null vs active control

  5. Null on patient outcome (RCT)

  6. +7%TB cases found per camp with AI-picked sites, not significant

  7. Clinicians at Columbia who adopted Epic's AI-drafted replies to patient messages answered 8.6% more slowly afterwards, and their after-hours replying did not fall, across 983,154 responses.

    Caveat: Observational, not randomized. Messages answered with the draft were 29.5% faster, but clinicians chose which messages to use it on, likely the routine ones; for test-result queries received in working hours, after-hours replies fell, and for messages received after hours they rose.

    +8.6%message turnaround after clinicians adopted AI-drafted replies

  8. OR 1.05for major adverse kidney events, 95% CI 0.82–1.35