|J Pathol Inform 2015,
Cytopathology whole slide images and virtual microscopy adaptive tutorials: A software pilot
Simone L Van Es1, Wendy M Pryor2, Zack Belinson3, Elizabeth L Salisbury4, Gary M Velan1
1 Department of Pathology, School of Medical Sciences, The University of New South Wales, Sydney, NSW 2052, Australia
2 Royal College of Pathologists of Australasia, Durham Hall, Albion St, Surry Hills, NSW 2010, Australia
3 Smart Sparrow, 116-122 Kippax St, Surry Hills, Sydney, NSW 2010, Australia
4 Department of Anatomical Pathology, Prince of Wales Hospital, Barker St, Randwick, NSW 2031, Australia
|Date of Submission||03-Jul-2015|
|Date of Acceptance||12-Aug-2015|
|Date of Web Publication||28-Sep-2015|
Simone L Van Es
Department of Pathology, School of Medical Sciences, The University of New South Wales, Sydney, NSW 2052
Source of Support: None, Conflict of Interest: None
| Abstract|| |
Background: The constant growth in the body of knowledge in medicine requires pathologists and pathology trainees to engage in continuing education. Providing them with equitable access to efficient and effective forms of education in pathology (especially in remote and rural settings) is important, but challenging. Methods: We developed three pilot cytopathology virtual microscopy adaptive tutorials (VMATs) to explore a novel adaptive E-learning platform (AeLP) which can incorporate whole slide images for pathology education. We collected user feedback to further develop this educational material and to subsequently deploy randomized trials in both pathology specialist trainee and also medical student cohorts. Cytopathology whole slide images were first acquired then novel VMATs teaching cytopathology were created using the AeLP, an intelligent tutoring system developed by Smart Sparrow. The pilot was run for Australian pathologists and trainees through the education section of Royal College of Pathologists of Australasia website over a period of 9 months. Feedback on the usability, impact on learning and any technical issues was obtained using 5-point Likert scale items and open-ended feedback in online questionnaires. Results: A total of 181 pathologists and pathology trainees anonymously attempted the three adaptive tutorials, a smaller proportion of whom went on to provide feedback at the end of each tutorial. VMATs were perceived as effective and efficient E-learning tools for pathology education. User feedback was positive. There were no significant technical issues. Conclusion: During this pilot, the user feedback on the educational content and interface and the lack of technical issues were helpful. Large scale trials of similar online cytopathology adaptive tutorials were planned for the future.
Keywords: Cytopathology, digital microscopy, pathology education, software, virtual microscopy, virtual microscopy adaptive tutorials, virtual slides, whole slide images, whole slide image
|How to cite this article:|
Van Es SL, Pryor WM, Belinson Z, Salisbury EL, Velan GM. Cytopathology whole slide images and virtual microscopy adaptive tutorials: A software pilot. J Pathol Inform 2015;6:54
|How to cite this URL:|
Van Es SL, Pryor WM, Belinson Z, Salisbury EL, Velan GM. Cytopathology whole slide images and virtual microscopy adaptive tutorials: A software pilot. J Pathol Inform [serial online] 2015 [cited 2020 Jan 29];6:54. Available from: http://www.jpathinformatics.org/text.asp?2015/6/1/54/166016
| Introduction|| |
The constant growth in the body of knowledge in medicine requires pathology specialists, pathology specialist trainees as well as medical students to engage in continuing education. Providing these groups with equitable access to an efficient and effective form of education is important (especially in remote and rural settings), but challenging. Virtual microscopy is just beginning to play a role in specialist pathology training, in pathology proficiency testing, ,,, and has been shown to be a very useful learning tool. ,,, However, provision of whole slide images (WSI) or virtual slides (vslides) alone for teaching may not be sufficient to convey salient diagnostic features, suggesting that additional support is needed to maximize the acquisition of information in pathology education.  Microscopic pathology, which is image-based, translates easily into an interactive E-learning environment.  Interactive virtual modules teaching pathology have been shown to result in better engagement, improved pattern recognition,  and improved performance in examinations. 
When considering the implementation of learning interactivity, feedback and flexibility are essential for engagement and learning impact. , Self-paced guided learning has also been shown to improve the accumulation of knowledge. , Virtual microscopy adaptive tutorials (VMATs) are a type of online adaptive tutorial system. They are self-guided, emphasize learning by interaction and exploration of WSI, focus on remediation of misconceptions and adaptive sequencing of questions, and activities for individual learners. , VMATs are created with the adaptive E-learning platform (AeLP), an intelligent tutoring system, which has already made significant differences to successful learning for a number of undergraduate university courses. , However, the use of VMATs to teach the difficult area of cytopathology to Australian cohorts has not been described. Consequently, prior to planning and implementation of randomized crossover studies of cytopathology WSI and VMATs in two separate cohorts (anatomical pathology trainees and also senior medical students), we developed three cytopathology VMATs to serve as a pilot study. During the pilot, we collected user feedback on the educational content, the interface, and any technical issues. This information was used in developing online cytopathology adaptive tutorials for larger scale trials.
| Methods|| |
We developed three cytopathology pilot VMATs and open access was given to all Royal College of Pathologists of Australasia (RCPA) fellows and trainees over a period of 9 months for use, feedback, and comment.
This pilot study was developed to gauge acceptance of virtual cytopathology slides and associated VMATs by trainees and specialists in pathology.
Virtual Slide Image Acquisition
Digital cytopathology images were acquired at ×40 magnification with an Aperio Scanscope XT (Leica Biosystems, Vista, CA, USA). Additional focal points were manually inserted to maximize the in-focus areas on the final WSI. Hundreds of individual adjacent high power images from each glass microscope slide were created in JPEG format and fused, "stitched" or "tiled" together, compressed into multi-resolution file format (.svs) to create one almost seamless image. Slides were scanned in two dimensions (X- and Y- axis) and the zoom was possible through the multiple magnifications that had been captured.
The virtual cytopathology slides were stored in a biomedical image database and delivered using a custom-built whole slide viewer. The image database, Slice, incorporates a server and an innovative WSI viewer developed by the BEST network (http://www.best.edu.au). It is supported by recent versions of all major web browsers and later.
Tiling script converted the digitized microscope slide into JPEG files that could be stored in the database for use with annotating (the authoring tool). The script generated sets of tiles for each "zoom level" or "magnification level" in the viewer. Image file size ranged from 800 MB to just over 2 GB. Those slides whose file size was >2 GB were reassessed and any nondiagnostic areas including those areas on the peripheral aspects of the slide were cropped manually to improve interaction with the interface.
Development of Virtual Microscopy Adaptive Tutorials
VMATs were created using the AeLP, an intelligent tutoring system developed by Smart Sparrow (http://www.smartsparrow.com/">http://www.smartsparrow.com/).
The VMAT user interface is intuitive. However, information to the side of the WSI on the first pages of each lesson provides instructions on how to navigate the adaptive tutorial and to quickly orientate the user. Continual functions include forward and back options and a "restart" button to return to the main menu button on each screen [Figure 1] and [Figure 2].
|Figure 1: Virtual microscopy adaptive tutorials interface. An example of a drag-and-drop question|
Click here to view
|Figure 2: Virtual microscopy adaptive tutorials feedback. Individualized visual and written feedback provides immediate reinforcement of correct responses|
Click here to view
The VMAT interface [Figure 1] and [Figure 2] can be accessed through the following links:
Adaptive Tutorial for Pilot Cytopathology Case 1:
Adaptive Tutorial for Pilot Cytopathology Case 2:
Adaptive Tutorial for Pilot Cytopathology Case 3:
Interactive Features of Virtual Microscopy Adaptive Tutorials
Engagement and interactivity are promoted within the adaptive tutorials by utilizing a variety of question formats (e.g., multiple-choice, drop-down lists, drag and drop type questions, fill-in-the-blank). An example of a drag and drop the question and associated feedback is seen in [Figure 1] and [Figure 2]. Immediate feedback is provided following the user's/learner's submission of responses. Feedback may contain useful educational information about the area on the slide, sometimes with the appropriate area being highlighted with different shading or arrows on the feedback screen. The screens generally do not permit progress until the question has been attempted. The author can limit the number of attempts for a question. The screen is programmed to reset after feedback is given on an incorrect answer. These tutorials allow participants to engage with the content at their individual pace.
An evaluation questionnaire can also be programmed into the conclusion of the adaptive tutorial. Immediate visual and written feedback can be provided to the individual user/learner based on their response [Figure 1] and [Figure 2]. The AeLP also allows the author to monitor patterns emerging in users' learning via analytical data available in real-time via the AeLP's web interface. The VMAT author can track the spectrum of errors related to participants' underlying misconceptions and consequently adapt the content and remedial feedback states of the tutorial.
Deployment and Evaluation
In order to gauge user experience and engagement, three pilot cytopathology VMATS and their associated WSI were placed on the RCPA website, in 2013 prior to the deployment of a randomized trial in this population.  The WSI and VMAT links were advertised through the monthly RCPA newsletter, Pathology Today.
The educational material was password-accessible to RCPA members (pathology trainees and specialist pathologists). Users were asked to complete feedback questionnaires on completion of each VMAT. The questionnaire comprised 5-point Likert scale items and enabled users to evaluate perceived impact on learning and engagement resulting from the VMATs. The items were as follows:
- The interactive questions using virtual slides were helpful
- The interactive questions using virtual slides improved my understanding
- I clearly understood what was required of me in performing the tasks
- I would like to see more interactive questions using virtual slides in other practical classes
- I learned more from interactive questions using virtual slides than from exploring virtual slides independently
- I learned more from interactive questions using virtual slides than from exploring glass slides independently.
A comment box was provided for written responses. All VMATs and questionnaires were completed anonymously.
| Results|| |
Pilot Cases 1, 2 and 3
Usage figures were automatically provided by the platform, along with the information about the average time users spent on each VMAT, and whether individual users completed the lesson. The majority of users spent a small amount of time (median 5 min) engaging with the adaptive tutorial. Thirty-one percentage of 119 users (n = 37) completed pilot Case 1, including the questionnaire. Forty-one percentage of 32 users (n = 13) completed pilot Case 2, whereas 40% of 30 users (n = 12) completed pilot Case 3. The overall completion rate was 62 out of 181 users at the point in time when the analytics page was accessed. The completion of the VMAT was contingent on submission of the survey at the end of the lesson. As the responses were anonymous, there was no indication whether the respondents were specialist pathologists or pathology trainees. Correspondingly, there was no indication as to which participants completed all three cases. Medical students were not involved in this pilot, as only fellows or trainees of the RCPA could access these tutorials. In addition, the main aim of the pilot was to gather feedback from specialist trainees and their pathologist supervisors in preparation for a larger randomized crossover trial in the specialist trainee cohort.
An analysis tab is accessible to the lesson author. It displays lesson usage, completion rates, grades, and the proportion of adaptive feedback in use. This analysis gives direction to the level of complexity of the lesson for the user/learner cohort and whether the adaptive feedback is adequate to effectively remediate errors. The average grade for each lesson is provided, which also may be an indicator of whether the complexity level needs to be modified. The analytics page also enables a heat map analysis [Figure 3] for drag and drop questions, thereby facilitating a quick visual analysis of learners' areas of weakness and strength, as well as common misconceptions.
|Figure 3: Heat map. A heat map showing responses to a drag and drop question, enabling detection of learners' strengths and weaknesses, as well as common misconceptions|
Click here to view
Anonymous responses to an online questionnaire, which could be incorporated into the lesson, were available to participants upon the completion of each pilot VMAT. Automated graphed analysis of the percentage and number of responses to each survey question for each category of strongly agree to strongly disagree was provided by the AeLP for each VMAT. It should be noted that the analytics are automatically updated on a regular basis and the responses to the survey were accessed by us from the platform at a slightly later point in time to the overview analytics. The response numbers for each category from each question were combined from all three pilot surveys. These numbers were exported into an excel document, and the results are displayed [Figure 4]a and b. There was a consistently positive perception of the VMATs [Figure 4]. Ninety-two percentage (59 out of 64) agreed that VMATs were helpful in developing diagnostic skills in cytopathology; 88% (56 out of 64) agreed that VMATs improved their understanding of cytopathology; 95% (61 out of 64) agreed that the instructions in the VMATs were clear; 91% (58 out of 64) agreed that they would like to use more VMATs; 88% (56 out of 64) agreed that they learned more from VMATs as compared to virtual slides alone; 65% (35 out of 54) agreed that they learned more from VMATs than they would have done from a glass slide alone.
|Figure 4: Likert-scaled responses to the feedback questionnaires expressed as (a) number and (b) percentage of respondents, respectively. There was strong overall agreement from users that Virtual microscopy adaptive tutorials helped understanding and development of skills. There was also broad agreement that users learned more from Virtual microscopy adaptive tutorials than traditional glass slides or virtual slides alone (virtual microscopy adaptive tutorials, virtual microscopy adaptive tutorial; vslide, virtual slides; SA: Strongly agree; A: Agree; N: Neutral; D: Disagree; SD: Strongly disagree|
Click here to view
User Perception of Virtual Microscopy Adaptive Tutorials
Open-ended feedback included positive comments on the layout of the VMATs, flexibility, usability, benefits for learning, for example, "good basic material for those starting out in cytopathology," and enjoyment reflected in comments such as "fun to do." Users also offered helpful suggestions to improve the layout and functionality of future VMATs.
| Discussion|| |
With technology constantly and rapidly advancing, pathology specialist trainees and specialists will have increasingly higher expectations about how they should be able to engage with learning and continuing educational resources. The modes of engagement in digital learning are rapidly morphing to accommodate these expectations.  Others have already shown that learning from an interactive and remediating E-learning environment is perceived to be at least as helpful as learning in a real-life laboratory. 
Preliminary findings from scaled and written anonymous feedback from this small pilot on learning with cytopathology VMATs indicated that users perceived them as useful to improve understanding of cytopathology, particularly when compared to virtual slides, or even glass slides, alone. The majority of participants were also interested in seeing more VMATs becoming available. In response to user comments during the pilot, we were subsequently clearer in our instructions in future lessons. Comments from users on the content of the tutorial also allowed improvement and correction of errors.
VMATs are novel in that they are specifically designed to "adapt" to the user's decision making process through remediation of misconceptions. Furthermore, analytics provided by the AeLP provides teachers with evidence of the effectiveness, or lack thereof, of the adaptive feedback used in the tutorial. A modest proportion of users completed any of the three VMATs. These are novel learning tools for learning histopathology and cytopathology, and interest in them from pathologists and trainees might be expected to be high. However, VMATs are quite intensive and there was no incentive offered for completion. Therefore, in this time-poor cohort, it is unsurprising that there was a substantial drop out rate.
From an educational perspective, the advantages of virtual microscopy via a large cloud-based image repository, such as the one described in this paper, are numerous. These include: (a) Rapid access; (b) relative permanence as compared to glass slides, which are prone to fading and breakage; (c) ability to provide ideal teaching cases to large and/or dispersed audiences simultaneously; (d) multi-site consultation and/or education, including using annotation , or incorporation into online tutorials;  (e) straightforward incorporation into formative and/or summative online assessments.  Educational slides are available for teaching from the repository described in this paper, https://www.best.edu.au/.
The AeLP itself is straightforward to use. However, the preparation of educational content to accompany each virtual slide within the VMAT requires diagnostic expertise and understanding of potential misconceptions and storyboarding of the proposed content and adaptive feedback contained within the lesson. The VMAT itself can be built by a nonspecialist trained in using the platform providing that they are supplied with an adequate storyboard of the proposed content. The average development time for each VMAT is between 15 and 20 h, depending on the complexity of both the educational content and the layering of interaction within the VMATs. The cost is dependent on the availability of prescanned virtual slides, or availability of local image acquisition services, and licence agreement for authoring and using the AeLP. Other VMATs developed with this software can be explored at http://www.best.edu.au/courseware/Pathology.
| Conclusions|| |
Access to large sets of instructive virtual cytopathology and histology VMATs has the potential to guarantee equity and standardization of good teaching material, as well as to promote networking and collaborative study, including for pathologists and trainees in rural or remote locations. Cytopathology VMATs developed for this preliminary pilot were well received through anonymous feedback. This highlights the importance of the development of further VMATs and subsequent organization of randomized trials comparing this education method to traditional techniques. 
Availability and Requirements for Virtual Microscopy Adaptive Tutorials
- Project name: Cytopathology whole slide images and VMATs for postgraduate and undergraduate pathology education
- Project home page: http://web.med.unsw.edu.au/Pathology/Cytopathology_Pilot_VMATs.htm
- Operating system: The AeLP is a SaaS (Software-as-a Service) cloud-based platform, accessed via the web, with support for all major operating systems, browsers software, and/or devices
- Programming language: VMATs have been created by educators using the AeLP authoring environment; an online tool programmed using Adobe Flex/Flash/AS3 technology, for the creation of adaptive, personalized, and interactive learning experiences. The AeLP can publish to the web in either Flash or HTML5 formats.
VMATs have been authored using a specialized authoring environment plugin, annotate, enabling the creation of interactive questions and screens, using high resolution virtual slides, hosted on Slice, an image repository created by BEST (http://www.best.edu.au), maintained by Smart Sparrow (http://www.smartsparrow.com)
- Other requirements: Published annotate learning experiences include a flash component (.swf file) in the webpage. As a consequence, Adobe Flash Player must be installed on the browser the learner is using to access the online activity
- The above implies that published learning experiences authored using Annotate, cannot be accessed via an Apple tablet device, such as an iPad, as Apple does not permit the Flash Player to be installed on its tablet browsers
- Other requirements: The user requires a launch link to access an AeLP learning experience. The link is automatically created upon the author publishing an activity. Links are often delivered to the user/learner via E-mail or an institution learning management system course page
- Licence: The creation, deployment, analysis and sharing of adaptive content using the AeLP requires a licence, which only applies to educators and institutions, not to learners/users.
Further, BEST resources such as slice and annotate can be freely used by BEST community members.
Any restrictions to use by nonacademic: None
Image acquisition: Dr. Maria Sarris (Histology and Microscopy Unit, UNSW); Technical Support: Mr. Jake Surman (UNSW), Mr. Peter Zarzour (UNSW), Mr. Gary Goldie (Smart Sparrow), the BEST Network, Glass Cytopathology slides: Ms. Joanne La Malfa (Anatomical Pathology Department, Prince of Wales Hospital, Sydney).
Financial Support and Sponsorship
This project was supported in part by the Royal College of Pathologists of Australasia (RCPA) which has received Australian Government funding under the Specialist Training Program (#247).
Conflicts of Interest
ZB is co-founder of Smart Sparrow and Director of Instructional Solutions, Smart Sparrow, Surry Hills, NSW 2010 Sydney, Australia.
| References|| |
Marchevsky AM, Wan Y, Thomas P, Krishnan L, Evans-Simon H, Haber H. Virtual microscopy as a tool for proficiency testing in cytopathology: A model using multiple digital images of Papanicolaou tests. Arch Pathol Lab Med 2003;127:1320-4.
Stewart J 3 rd
, Miyazaki K, Bevans-Wilkins K, Ye C, Kurtycz DF, Selvaggi SM. Virtual microscopy for cytology proficiency testing: Are we there yet? Cancer 2007;111:203-9.
Bruch LA, De Young BR, Kreiter CD, Haugen TH, Leaven TC, Dee FR. Competency assessment of residents in surgical pathology using virtual microscopy. Hum Pathol 2009;40:1122-8.
van den Tweel JG, Bosman FT. The use of virtual slides in the EUROPALS examination. Diagn Pathol 2011;6 Suppl 1:S23.
Dee FR, Donnelly A, Radio S, Leaven T, Zaleski MS, Kreiter C. Utility of 2-D and 3-D virtual microscopy in cervical cytology education and testing. Acta Cytol 2007;51:523-9.
Stewart J 3 rd
, Bevans-Wilkins K, Bhattacharya A, Ye C, Miyazaki K, Kurtycz DF. Virtual microscopy: An educator′s tool for the enhancement of cytotechnology students′ locator skills. Diagn Cytopathol 2008;36:363-8.
Weaker FJ, Herbert DC. Transition of a dental histology course from light to virtual microscopy. J Dent Educ 2009;73:1213-21.
Triola MM, Holloway WJ. Enhanced virtual microscopy for collaborative education. BMC Med Educ 2011;11:4.
Pospischil A Introduction to the Swiss way of teaching veterinary pathology in the twenty-first century: Application of E-learning modules. J Vet Med Educ 2007;34:445-9.
Bejjanki VR, Zhang R, Li R, Pouget A, Green CS, Lu ZL, et al.
Action video game play facilitates the development of better perceptual templates. Proc Natl Acad Sci U S A 2014;111:16961-6.
Kanthan R, Senger JL. The impact of specially designed digital games-based learning in undergraduate pathology and medical education. Arch Pathol Lab Med 2011;135:135-42.
Tochel C, Beggs K, Haig A, Roberts J, Scott H, Walker K, et al.
Use of web based systems to support postgraduate medical education. Postgrad Med J 2011;87:800-6.
Marcus N, Ben-Naim D, Bain M. Instructional support for teachers and guided feedback for students in an adaptive eLearning environment. 2011 Eighth International Conference on Information Technology: New Generations (ITNG). 11-13 April, 2011; Las Vegas, NV: IEEE Computer Society; 2011. p. 626-31. http://www.dl.acm.org/citation.cfm?id=2006522
. [Last cited on 2015 Jun 17].
Polly P, Marcus N, Maguire D, Belinson Z, Velan GM. Evaluation of an adaptive virtual laboratory environment using Western blotting for diagnosis of disease. BMC Med Educ 2014;14:222.
Velan GM, Ben-Naim D, Kumar RK, Bain M, Kan B, Marcus N. Adaptive tutorials using virtual slides to enhance learning of microscopic morphology. In: Richards G, editor. World Conference on E-Learning in Corporate, Government, Healthcare, and Higher Education 2009. Vancouver, Canada, Chesapeake, VA: AACE; 2009. p. 759-63. Available from: http://www.editlib.org/p/32546
Van Es SL, Kumar RK, Pryor WM, Salisbury EL, Velan GM. Cytopathology whole slide images and adaptive tutorials for postgraduate pathology trainees: A randomized crossover trial. Hum Pathol 2015;46:1297-305.
Khalbuss WE, Pantanowitz L, Parwani AV. Digital imaging in cytopathology. Patholog Res Int 2011;2011:264683.
Velan GM, Jones P, McNeil HP, Kumar RK. Integrated online formative assessments in the biomedical sciences for medical students: Benefits for learning. BMC Med Educ 2008;8:52.
[Figure 1], [Figure 2], [Figure 3], [Figure 4]