News | Artificial Intelligence | April 02, 2019 | Jeff Zagoudis, Associate Editor

FDA Proposes New Review Framework for AI-based Medical Devices

Discussion paper describes need to regulate artificial intelligence that continuously learns

FDA Proposes New Review Framework for AI-based Medical Devices

April 2, 2019 — U.S. Food and Drug Administration (FDA) Commissioner Scott Gottlieb, M.D., announced Tuesday the agency is pursuing a new framework in which to review artificial intelligence (AI)-based medical software and devices to ensure ongoing effectiveness and patient safety. The agency released a 20-page discussion paper explaining the need for a new framework, the tenets of a total product lifecycle (TPLC) approach to certification, and examples of potential real-world AI software modifications that may or may not be permitted under the proposed framework. The FDA is asking for comments and feedback from all parties to inform future decisions.

Locked Versus Adaptive AI

To date, only two AI-based technologies have received full FDA approval and are in clinical use — IDx-DR, a software that detects diabetic retinopathy, and the Viz.AI Contact application that analyzes computed tomography (CT) images for potential signs of stroke. Gottlieb noted that both of these technologies can be considered “locked” algorithms. This means that the base algorithms can only be modified by the manufacturer, and must be manually verified and validated by them as well. Other AI algorithms are considered “adaptive” or “continuously learning,” and these learn from new user data acquired through real-world use.

In the statement, Gottlieb acknowledged the vast potential of such adaptive algorithms, but also insisted that these more open technologies must still adhere to the FDA’s safety and effectiveness standards.

Total Product Lifecycle Regulatory Approach

The discussion paper describes how the current 510(k) approval pathway takes a risk-based approach, requiring new premarket submissions for some software modifications. Categories of software modifications that may require a premarket submission include:

  • A change that introduces a new risk or modifies an existing risk that could result in significant harm;
  • A change to risk controls to prevent significant harm; and
  • A change that significantly affects clinical functionality or performance specifications of the device.

For today’s AI-based technologies, the discussion paper notes these considerations must be balanced with the ability for the software to “continue to learn and evolve over time to improve patient care.”

To satisfy all of these requirements, the discussion paper explores the potential of a total product lifecycle (TPLC)-based approach to certification. In this model, the FDA would “assess the culture of quality and organizational excellence of a particular company, and have reasonable assurance of the high quality of their software development, testing and performance monitoring of their products.”

One of the key elements considered in the TPLC approach will be a software’s predetermined change control plan. This plan would provide detailed information about the types of anticipated modifications based on the algorithm’s re-training and update strategy, and the associated methodology being used to implement those changes in a controlled manner that manages risks to patients. According to Gottlieb, the goal of a revised framework would to assure that ongoing algorithm changes:

  • Follow pre-specified performance objectives and change control plans;
  • Use a validation process that ensures improvements to the performance, safety and effectiveness of the AI software; and
  • Include real-world monitoring of performance once the device is on the market to ensure safety and effectiveness are maintained.

The agency is taking public comment on the contents of the discussion paper through June 3, 2019. The full discussion paper can be read here. Comments can be submitted here.

For more information: www.fda.gov

Related Content

CoronaCare is designed to help healthcare providers track COVID-19 (coronavirus) related symptoms of potentially infected patients. The platform enables communication with patients outside of facility walls and the ability to request the return of high-risk patients for more in-depth care. #COVID19 #Coronavirus #2019nCoV #Wuhanvirus #SARScov2
News | Coronavirus (COVID-19) | March 27, 2020
March 27, 2020 — PaxeraHealth has spent years building and be
AI vendor Infervision's InferRead CT Pneumonia software uses artificial intelligence-assisted diagnosis to improve the overall efficiency of the radiology department. It is being developed in China as a high sensitivity detection aid for novel coronavirus pneumonia (COVID-19). #COVID19 #coronavirus #SARScov2

AI vendor Infervision's InferRead CT Pneumonia software uses artificial intelligence-assisted diagnosis to improve the overall efficiency of the radiology department. It is being developed in China as a high sensitivity detection aid for novel coronavirus pneumonia (COVID-19).

Feature | Coronavirus (COVID-19) | March 27, 2020 | Jilian Liu, M.D., HIMSS Greater China
An older couple walked into the Hubei Provincial Hospital of Integrated Chinese and Western Medicine near their neigh
#COVID19 #Coronavirus #2019nCoV #Wuhanvirus #SARScov2
News | Artificial Intelligence | March 24, 2020
March 24, 2020 — Qure.ai, a leading healthcare...
Instant triage capability could potentially speed up diagnosis of COVID-19 individuals and ensure resources allocated properly.
News | Artificial Intelligence | March 23, 2020
March 23, 2020 — behold.ai announced that its artificial intellige
#COVID19 #Coronavirus #2019nCoV #Wuhanvirus #SARScov2

Representative examples of the attention heatmaps generated using Grad-CAM method for (a) COVID-19, (b) CAP, and (c) Non-Pneumonia. The heatmaps are standard Jet colormap and overlapped on the original image, the red color highlights the activation region associated with the predicted class. COVID-19 = coronavirus disease 2019, CAP = community acquired pneumonia. Image courtesy of the journal Radiology

News | Coronavirus (COVID-19) | March 20, 2020
March 20, 2020 — An arti...
Varian received FDA clearance for its Ethos therapy in February 2020. It is an adaptive intelligence solution that uses onboard AI in the treatment system to take the cone beam CT imaging on the system, compare it to the treatment plan and deliver an entire adaptive treatment plan in a typical 15-minute treatment time slot, from patient setup through treatment delivery.

Varian received FDA clearance for its Ethos therapy in February 2020, shown here displayed for the first time at ASTRO 2019. It is an adaptive intelligence solution that uses onboard AI in the treatment system to take the cone beam CT imaging on the system, compare it to the treatment plan and deliver an entire adaptive treatment plan in a typical 15-minute treatment time slot, from patient setup through treatment delivery.

Feature | Treatment Planning | March 19, 2020 | Dave Fornell, Editor
The traditional treatment planning process takes days to create an optimized radiation therapy delivery plan, but new