Standardizing Medical Imagery:
Opportunities and Challenges in a Multimodal Landscape

Medical imaging is central to diagnostics, treatment planning, and follow-up care in modern medicine. However, as imaging technologies have evolved, so have the complexities of managing the vast array of images generated. The need to standardize medical imagery has become increasingly apparent due to the wide variety of modalities, parameters, and clinical scenarios involved. Standardizing these images—while challenging—has far-reaching benefits for clinical workflow, medical research, and artificial intelligence (AI) applications. In this text, I will explore the importance of standardizing medical imagery, the challenges encountered at both the sequence and study levels, and how AI can help transform this critical aspect of healthcare.

Why Standardize Medical Imagery?

Standardization in medical imaging ensures that images acquired across different sites, scanners, and protocols are harmonized into a uniform format that can be easily accessed, understood, and utilized. The primary advantage is the seamless organization of these studies for internal and external purposes, including the proper indexing of images for clinicians, researchers, and AI developers. This becomes crucial in high-stakes environments such as large hospital networks, where multiple sites contribute to the imaging database.

Effective standardization facilitates study routing within the imaging inference pipeline, leading to faster and more reliable image processing and diagnostic workflows. Moreover, having standardized imagery helps develop robust display protocols in Picture Archiving and Communication Systems (PACS), ensuring that clinicians see consistent and meaningful representations of the anatomy. From a research perspective, the standardization of medical images exponentially increases the amount of data available for AI projects. AI models thrive on large datasets, and the aggregation of harmonized images across different hospitals allows for identifying new patient cohorts and patterns that can drive research and improved patient care.

The Role of Artificial Intelligence in Standardization

Artificial intelligence has shown immense potential in overcoming the challenges associated with the standardization of medical imagery. AI-based models can be trained to automatically identify and correct image artifacts, classify anatomical regions, and optimize images for specific diagnostic purposes. This capability is critical in improving the efficiency and accuracy of both clinical and research workflows.

For instance, recent studies show that AI models trained on large datasets—comprising millions of standardized images—can achieve up to 90% accuracy in identifying anatomical structures across modalities, improving classification tasks, and detecting anomalies in series that would otherwise go unnoticed. AI algorithms can also analyze vast amounts of data, identifying patterns and correlations that clinicians might miss. These insights are crucial for identifying new patient cohorts for clinical trials and research.

The scalability of AI makes it an ideal tool for large-scale imaging networks. With over 3.6 billion medical imaging procedures performed annually worldwide, the ability to standardize, index, and analyze this data in a consistent and automated manner is invaluable. AI-driven standardization protocols can also facilitate multi-institutional collaborations, enabling the sharing of standardized imaging data while ensuring compliance with data privacy regulations.

Challenges of Standardizing Medical Imagery

The high potential of Artificial Intelligence to standardize medical imagery also comes with its own challenges. The training and validation datasets that are necessary to AI development must be prepared by qualified radiologists, who must know how to tackle the inherent variability in how images are acquired and processed. The complexity arises at two levels: individual sequence (series) and study level.

1.Challenges at the Series Level:

  • Distorted Images: Artifacts such as streaking, banding, or the presence of braces or leads can render images suboptimal for analysis. Poor positioning of the patient or motion can further degrade image quality.
  • Non-Diagnostic Series: In some cases, certain images are acquired not for diagnostic purposes but for procedural guidance, such as during needle localization or intravenous contrast tracking.
  • Implanted Hardware and Devices: The presence of surgical implants or devices can obscure anatomical regions of interest, affecting the quality and usability of the series.
  • Intent Understanding and Anatomical Classification: Often, series contain adjacent anatomies that may or may not be relevant to the intended diagnosis. Understanding this intent is vital to classify the series appropriately. For example, a brain scan may include images of the skull, but depending on the window and kernel used (bone vs. soft tissue), the intent of the study changes.
  • Breathing and: For chest CTs, breathing phases (expiration vs. inspiration) are critical for interpretation.
  • Laterality: laterality is not always explicitly tagged in the metadata.
  • Image Planes and Reconstruction: Series are captured across multiple planes (axial, sagittal, coronal, etc.) and with varying reconstruction kernels (sharp for bone, smooth for soft tissue), contributing to the challenge of indexing.
  • Contrast Variations: The administration route and contrast phases (e.g., early arterial vs. late arterial) further complicate the standardization process.

2. Challenges at the Study Level:

  • Anatomical Selection: Not every anatomical region visualized in the series is relevant for the overall study. Selecting which anatomies to include in the study-level analysis can be difficult.
  • Contrast Protocols: Some studies might contain both pre-contrast and post-contrast series, which must be carefully categorized to avoid misinterpretation.
  • Study Protocols: The range of clinical protocols, from biopsy to stroke and lung screening, adds another layer of complexity. Each protocol may require a different set of sequences, and standardizing these can be challenging, especially without a universally accepted guideline.

Conclusion

The standardization of medical imagery, although complex, is a necessary endeavor to improve the organization, analysis, and diagnostic potential of imaging data. The challenges encountered at both the sequence and study levels can be addressed through AI-based solutions, which enable efficient classification, artifact reduction, and the optimization of image quality. By standardizing medical imagery, we can expand the pool of data available for AI research, improve patient outcomes through more reliable diagnostics, and facilitate groundbreaking medical research. The future of radiology lies in embracing these technological advancements to create a cohesive and standardized imaging landscape.

Written by
Jean Emmanuel Wattier
Head of Strategic Business

References:

  • Kalra, M. K., et al. “Artificial Intelligence in Radiology.” Radiology, vol. 293, no. 2, 2019, pp. 346-359.
  • McBee, M. P., et al. “Deep Learning in Radiology.” Radiology, vol. 294, no. 2, 2020, pp. 350-362.
  • Kohli, M., et al. “Medical Imaging Data and AI: Barriers and Challenges.” Journal of Digital Imaging, vol. 33, no. 1, 2020, pp. 44-52.

Related insights

Standardizing Medical Imagery

Our blog Standardizing Medical Imagery: Opportunities and Challenges in a Multimodal Landscape...

Rib Fractures on Frontal Chest X-rays

Our blog Identifying Rib Fractures on Frontal Chest X-rays: Clinical Relevance and Diagnostic...

RSVP Cocktail + RWiD Conversations

Cocktail + RWiD Conversations, hosted by Segmed and Ingedata You’re invited to Cocktail + RWiD...

Driven Microservice Architecture

Our blog Event-Driven Microservice Architecture: Why We Chose It and How We Implemented It Welcome...

Data Annotation: The Secret Sauce of AI Vision

Our blog Data Annotation: The Secret Sauce of AI Vision 🔍 Ever wondered how AI learns to...

Migration from Rhymes to Pulse: Our Journey in Building a Better ERP System

Our blog Migration from Rhymes to Pulse: Our Journey in Building a Better ERP System Hey there! I’m...