|J Pathol Inform 2018,
Digital Imaging and Communications in Medicine Whole Slide Imaging Connectathon at Digital Pathology Association Pathology Visions 2017
David Clunie1, Dan Hosseinzadeh2, Mikael Wintell3, David De Mena4, Nieves Lajara5, Marcial Garcia-Rojo4, Gloria Bueno5, Kiran Saligrama6, Aaron Stearrett6, David Toomey6, Esther Abels7, Frank Van Apeldoorn7, Stephane Langevin2, Sean Nichols2, Joachim Schmid8, Uwe Horchner8, Bruce Beckwith9, Anil Parwani10, Liron Pantanowitz11
1 Pixelmed Publishing, LLC, Bangor, USA
2 Pathcore, Toronto, Canada
3 Department of Regional Health, Region Västra Götalandsregionen, Sweden
4 Department of Pathology/UGC Anatomía Patológica, Hospital Universitario Puerta del Mar, Cádiz, Spain
5 VISILAB, Grupo de Visión y Sistemas Inteligentes, E.T.S. Ingenieros Industriales, Universidad De Castilla-La Mancha, Ciudad Real, Spain
6 Leica Biosystems, Wetzlar, Germany
7 Philips Digital Pathology Solutions, Best, The Netherlands
8 Roche-Ventana, Basel, Switzerland
9 Department of Pathology, North Shore Medical Center, Salem, MA, USA
10 Department of Pathology, Ohio State University, Columbus, OH, USA
11 Department of Pathology, University of Pittsburgh Medical Center, Pittsburgh, PA, USA
|Date of Submission||14-Jan-2018|
|Date of Acceptance||05-Feb-2018|
|Date of Web Publication||05-Mar-2018|
Dr. Liron Pantanowitz
Department of Pathology, University of Pittsburgh Medical Center, 5150 Centre Ave, Suite 201, Pittsburgh, PA 15232
Source of Support: None, Conflict of Interest: None
| Abstract|| |
As digital pathology systems for clinical diagnostic work applications become mainstream, interoperability between these systems from different vendors becomes critical. For the first time, multiple digital pathology vendors have publicly revealed the use of the digital imaging and communications in medicine (DICOM) standard file format and network protocol to communicate between separate whole slide acquisition, storage, and viewing components. Note the use of DICOM for clinical diagnostic applications is still to be validated in the United States. The successful demonstration shows that the DICOM standard is fundamentally sound, though many lessons were learned. These lessons will be incorporated as incremental improvements in the standard, provide more detailed profiles to constrain variation for specific use cases, and offer educational material for implementers. Future Connectathon events will expand the scope to include more devices and vendors, as well as more ambitious use cases including laboratory information system integration and annotation for image analysis, as well as more geographic diversity. Users should request DICOM features in all purchases and contracts. It is anticipated that the growth of DICOM-compliant manufacturers will likely also ease DICOM for pathology becoming a recognized standard and as such the regulatory pathway for digital pathology products.
Keywords: Connectivity, digital imaging and communications in medicine, digital imaging and communications in medicine web, digital imaging and communications in medicine supplement 145, digital pathology, interoperability, picture archiving and communication system, virtual microscopy, whole slide imaging
|How to cite this article:|
Clunie D, Hosseinzadeh D, Wintell M, De Mena D, Lajara N, Garcia-Rojo M, Bueno G, Saligrama K, Stearrett A, Toomey D, Abels E, Van Apeldoorn F, Langevin S, Nichols S, Schmid J, Horchner U, Beckwith B, Parwani A, Pantanowitz L. Digital Imaging and Communications in Medicine Whole Slide Imaging Connectathon at Digital Pathology Association Pathology Visions 2017. J Pathol Inform 2018;9:6
|How to cite this URL:|
Clunie D, Hosseinzadeh D, Wintell M, De Mena D, Lajara N, Garcia-Rojo M, Bueno G, Saligrama K, Stearrett A, Toomey D, Abels E, Van Apeldoorn F, Langevin S, Nichols S, Schmid J, Horchner U, Beckwith B, Parwani A, Pantanowitz L. Digital Imaging and Communications in Medicine Whole Slide Imaging Connectathon at Digital Pathology Association Pathology Visions 2017. J Pathol Inform [serial online] 2018 [cited 2020 Sep 21];9:6. Available from: http://www.jpathinformatics.org/text.asp?2018/9/1/6/226564
| Introduction|| |
The use of digital pathology for diagnostic work has been rapidly expanding in regions without major regulatory obstacles.,,,, The first clearance to market in the United States, although of a closed proprietary system, will undoubtedly accelerate this pace. Like all technologic advancements, economies of scale and commoditization are inevitable, and for digital pathology to be scalable, components need to be standardized in terms of their functionality and their interfaces. Interoperability will be a fundamental requirement. At the very least, for the referral of cases between sites with different systems, the ability to export to and import from a standard format using a standard protocol is essential.
More than three decades of experience with radiology and cardiology digital imaging systems have shown that they evolved from turnkey monolithic single vendor solutions to mature, off-the-shelf components that can be mixed and matched by the customer to produce best-of-breed solutions. Such advancement would not have been possible without the use of the digital imaging and communications in medicine (DICOM) standard.,,,, Currently, the success of DICOM is being leveraged by other specialties, particularly the so-called “visible light” specialties such as ophthalmology, dermatology, surgical and gastrointestinal endoscopy, as well as generic medical photography. This expansion is being fueled by the recognition that enterprise-wide solutions are required for affordability, scalability, robustness, reliability, security, privacy, and utility.
Digital pathology has been late to the “enterprise imaging” party for a multitude of reasons. Indeed, despite the publication of DICOM Supplement 145, in 2010, there has been a lack of motivation to implement it, and a lack of tools to support its use, as well as intellectual property barriers., These hurdles have all recently been overcome, and the confluence of need and availability resulted in the feasibility of a public demonstration.
| The Connectathon|| |
DICOM working group (WG) 26 conducted a Digital Pathology Connectathon, hosted by the Digital Pathology Association at the 2017 Pathology Visions conference. Over the course of several days, three acquisition devices (Leica-Aperio, Philips, and Roche-Ventana), one picture archiving and communication system image server (Pathcore) and two viewers (Pathcore and AidPath) revealed the use of their systems to communicate DICOM whole slide images exported from the aforementioned scanners to a server, and thence interactively viewed, exclusively using the DICOM format and protocols. The traditional DICOM C-STORE was used for transmission of images from scanners to the server. The DICOMweb query (QIDO-RS) and retrieve (WADO-RS) transactions were used between viewers and the server to retrieve images and tile metadata and to selectively fetch only those tiles needed from the appropriate resolution layer for the interactive pan and zoom functionality of the virtual microscopy viewers.
The relatively seamless experience demonstrated to attendees belied the nontrivial effort that had gone on behind the scenes leading up to the event itself. Despite exhaustive planning over many months, up to the very last moment developers were tweaking and improving their code, output, and protocols to make sure that not only was interoperability revealed but also that different manufacturer's systems that appeared to be working together were working for the right reasons. Several alternative ways of implementing the standard were explored until a consensus of what viewers needed and what scanners could produce was achieved.
While this editorial is not the place to exhaustively discuss all technical details, it is worthwhile summarizing some of the major observations and agreements attained that are necessary to achieve interoperability in the real world in order for DICOM to be used for clinical applications in the future.
- Image compression schemes used in DICOM need to be constrained. Initially, it was expected that support of the Joint Photographic Experts Group (JPEG) compressed tiles would be sufficient, but it became clear that JPEG 2000 support was also required to allow some scanners to participate. Both participating viewers achieved this
- DICOM enables but does not explicitly require, a pyramid of multiple layers of different resolution to be encoded. It is legal to only store the highest resolution layer, with the expectation that recipients will be able to down-sample as required. This proved to be a barrier for the participating viewers, and hence, a third party tool was developed at the last minute to perform down-sampling images from one scanner
- DICOM allows sparse representation of tiles, which means that the position (coordinates) of every tile on the glass slide needs to be described. The consequence of this for nonsparse representations (every tile imaged and stored, even if empty of tissue) is that the tiles can be encoded in any order since the position is explicitly defined. This position information is bulky and can be slow to transmit and interpret given that there may be hundreds of thousands of tiles. Viewers would like to assume not only a nonsparse representation but also a standard, predictable encoding order, to avoid the delay in sending and parsing the metadata. Further, scanner implementers needed to expend considerable effort getting the position coordinates correctly
- Since some DICOM whole slide image (WSI) files can be quite large, a mechanism for sending them in pieces (of a so-called “concatenation”) exists. One scanner vendor had implemented this, but the archive did not support it. There is no consensus yet on whether or not the use of this feature should be promoted or discouraged
- A required feature in DICOM is the presence of an International Color Consortium (ICC) profile  to facilitate consistent display of color on receiving systems. In other words, the colors displayed in all viewers of the same slide should appear the same, if the same calibrated monitors are used, or the viewers are shown side by side on the same monitor. The viewers used did not implement color management (i.e., ignored the ICC profiles), so color consistency was not achieved
- There was a lack of consensus about what metadata should be provided in query responses, as opposed to what is left for metadata retrieval, beyond the minimum required by the DICOM standard and supported in nonWSI archives.
After the demonstration was completed, a panel with representatives of the participants was held, that was well-attended and stimulated pertinent questions and a lively discussion [Figure 1]. A regulatory panel discussion followed at which industry and regulator representatives frankly considered the issues of opening up closed architectures by using components with standard DICOM interfaces.
|Figure 1: Dan Hosseinzadeh, co-chair of the digital imaging and communications in medicine pathology working group, presenting at the 2017 pathology visions conference|
Click here to view
| Final Thoughts|| |
Even skeptical attendees seemed pleasantly surprised by the performance and quality achieved, which is designed to be comparable to the experience of using a proprietary viewer. Many vendors that were unable to participate in the first Connectathon have expressed interest in joining for the next one. That said, the lessons learned need to be incorporated into updates to the DICOM Standard, more detailed description of the requirements is warranted for participation in future Connectathon events (probably in the form of “profiles” for specific use cases), as well educational material. Work is already in progress within WG 26 to optimize the performance of nonsparse tiles encoded in a standard order.
How should users interpret the success of the Connectathon, and how should it influence their purchasing decisions? Clearly, we have been able to demonstrate that the use of DICOM as a standard interface is feasible. However, that does not mean that a commercial product purchased today will be able to use DICOM in a high volume production setting. There is a practical difference in each product between exporting single slides as DICOM, as opposed to routinely transmitting every slide as DICOM. Only clearly articulated customer demand will motivate the vendors to invest effort in this area.
Further, such production workflows require the provision of reliable metadata for identification and description of the slides, automation of which requires as yet undefined choices of interface standards. This will be the next technical improvement to be a focus of future Connectathon events. Ongoing interactions with the appropriate Integrating the Healthcare Enterprise Pathology and Laboratory Medicine group are also necessary to address workflow issues. In the interim, it is recommended that customers include the appropriate language in their request for proposals and eventually contracts to motivate mutual investment efforts in this area even if a vendor cannot offer practical DICOM connectivity immediately.
A demonstration of the technical feasibility of interoperability does not resolve regulatory issues regarding safety and efficacy for generic diagnostic applications, particularly in the United States (US),, and presumably the European Union (EU) with the new In vitro diagnostic regulations  and medical device regulations. It remains to be seen how the US Food and Drug Administration and the EU will regulate interoperating components rather than monolithic systems.
A common question was whether or not there exists a standard format for annotations, whether this can be employed for user annotation as part of the medical record, and if the user identified hot spots can be communicated to analysis tools, or the encoding, visualization and archiving of the output of analysis tools. DICOM does provide various generic solutions for annotations, including segmentations, presentation states and structured reports, which are used in other specialties where quantitation is a requirement. Which choices, for which use cases, and how scalable the existing DICOM solutions will be for very large numbers of annotations, remains to be seen. If necessary, DICOM can add WSI-specific annotation features. This is expected to be the second priority for the expansion of future Connectathon functionality, especially when there is greater participation by analysis tool implementers. For now, analysis tools may at least benefit from the use of a standard DICOM input format for the images from all scanner vendors. Upcoming Connectathon events will also likely require color management to be implemented in viewers.
| Conclusion|| |
It is fair to say that digital pathology is here to stay, that DICOM for digital pathology is also here, and that given that the industry players are committed, the path forward is clear and unambiguous. It remains for pathologists and their support teams to come to terms with both the short- and long-term ramifications of digital pathology deployment and the vital need to demand standards-based interoperability from the very start.
The images that were produced for and during the Connectathon are available to be downloaded from “ftp://medical.nema.org/medical/dicom/datasets/WG26/WG26Demo2017/”. Note that as described in the documentation, there are various deficiencies in the DICOM encoding of some files, which will be addressed for future events.
The work done by the authors David de Mena, Marcial García-Rojo, Nieves Lajara and Gloria Bueno has been funded by the European project AIDPATH with grant agreement No 612471 (http://aidpath.eu/).
Financial support and sponsorship
Conflicts of interest
There are no conflicts of interest.
| References|| |
Stathonikos N, Veta M, Huisman A, van Diest PJ. Going fully digital: Perspective of a dutch academic pathology lab. J Pathol Inform 2013;4:15.
] [Full text]
Thorstenson S, Molin J, Lundström C. Implementation of large-scale routine diagnostics using whole slide imaging in Sweden: Digital pathology experiences 2006-2013. J Pathol Inform 2014;5:14.
] [Full text]
Cheng CL, Azhar R, Sng SH, Chua YQ, Hwang JS, Chin JP, et al.
Enabling digital pathology in the diagnostic setting: Navigating through the implementation journey in an academic medical centre. J Clin Pathol 2016;69:784-92.
Volynskaya Z, Chow H, Evans A, Wolff A, Lagmay-Traya C, Asa SL, et al.
Integrated pathology informatics enables high-quality personalized and precision medicine: Digital pathology and beyond. Arch Pathol Lab Med 2017.
Evans AJ, Salama ME, Henricks WH, Pantanowitz L. Implementation of whole slide imaging for clinical purposes: Issues to consider from the perspective of early adopters. Arch Pathol Lab Med 2017;141:944-59.
Abels E, Pantanowitz L. Current state of the regulatory trajectory for whole slide imaging devices in the USA. J Pathol Inform 2017;8:23.
] [Full text]
Clunie DA, Dennison DK, Cram D, Persons KR, Bronkalla MD, Primo HR, et al.
Technical challenges of enterprise imaging: HIMSS-SIIM collaborative white paper. J Digit Imaging 2016;29:583-614.
Pianykh OS. What is DICOM? In: Digital Imaging and Communications in Medicine (DICOM). Berlin, Heidelberg: Springer; 2012. p. 3-5.
Caffery LJ, Clunie D, Curiel-Lewandrowski C, Malvehy J, Soyer HP, Halpern AC, et al.
Transforming dermatologic imaging for the digital era: Metadata and standards. J Digit Imaging 2018.
Kuzmak PM, Dayhoff RE. The use of digital imaging and communications in medicine (DICOM) in the integration of imaging into the electronic patient record at the department of veterans affairs. J Digit Imaging 2000;13:133-7.
DICOM Standards Committee. Supplement 15: Visible Light Image for Endoscopy, Microscopy, and Photography; 1999. Available from: ftp://medical.nema.org/medical/dicom/final/sup15_ft.pdf. [Last accessed on 2018 Feb 19].
Roth CJ, Lannum LM, Persons KR. A foundation for enterprise imaging: HIMSS-SIIM collaborative white paper. J Digit Imaging 2016;29:530-8.
Hartman DJ, Pantanowitz L, McHugh JS, Piccoli AL, OLeary MJ, Lauro GR, et al.
Enterprise implementation of digital pathology: Feasibility, challenges, and opportunities. J Digit Imaging 2017;30:555-60.
Daniel C, Macary F, Rojo MG, Klossa J, Laurinavičius A, Beckwith BA, et al.
Recent advances in standards for collaborative digital anatomic pathology. Diagn Pathol 2011;6 Suppl 1:S17.
Singh R, Chubb L, Pantanowitz L, Parwani A. Standardization in digital pathology: Supplement 145 of the DICOM standards. J Pathol Inform 2011;2:23.
] [Full text]
Garcia-Rojo M. Imaging standards in digital pathology. In: Digital Pathology. Pantanowitz L, Parwani AV, editors. Chicago: ASCP Press; 2017. p. 253-86.
Cucoranu IC, Parwani AV, Vepa S, Weinstein RS, Pantanowitz L. Digital pathology: A systematic evaluation of the patent landscape. J Pathol Inform 2014;5:16.
] [Full text]
Badano A, Revie C, Casertano A, Cheng WC, Green P, Kimpe T, et al.
Consistency and standardization of color in medical imaging: A consensus report. J Digit Imaging 2015;28:41-52.
Huisman A. IHE Pathology and Laboratory Medicine – Brief Proposal – Update Digital Pathology Workflow; 2016. Available from: ftp://ftp.ihe.net/PaLM/iheyr1_2016/Brief_Proposals/APW_update_digital_pathology_Andre.docx. [Last accessed on 2018 Feb 19].
Fedorov A, Clunie D, Ulrich E, Bauer C, Wahle A, Brown B, et al.
DICOM for quantitative imaging biomarker development: A standards based approach to sharing clinical data and structured PET/CT analysis results in head and neck cancer research. PeerJ 2016;4:e2057.