Development · Tue 20 Oct, Wed 21 Oct, Thu 22 Oct, Fri 23 Oct
Two FDA-cleared pulmonary embolism models fall below their clearance sensitivity across 67,869 scans as the FDA says it will write generative-AI device policyA study published in npj Digital Medicine on 21 October evaluated "two FDA-cleared AI algorithms from a single commercial platform (Aidoc Medical BriefCase)-one for PE triage on dedicated CT pulmonary angiography (CTPA; n = 30,678) and one for incidental PE (iPE) detection on routine contrast-enhanced CTs (n = 37,191), across a 17-facility academic health system". "The PE model achieved 86.8% sensitivity and 99.1% specificity, with sensitivity declining from 99.3% for saddle emboli to 72.9% for subsegmental PE, and from 89.7% for acute to 65.3% for non-acute PE." "The iPE model achieved 73.5% sensitivity and 99.8% specificity." The authors conclude that "Both models demonstrated lower sensitivity than FDA-clearance benchmarks while exceeding cleared specificity, with diminishing performance for peripheral and non-acute emboli mirroring known human reader limitations and underscoring the need for standardized post-market surveillance of AI-enabled medical devices." Reference labels were extracted from radiology reports "using a validated LLM pipeline (97% accuracy, κ = 0.94)". The abstract names the two algorithms only by function and states no clearance benchmark value for either.