|J Pathol Inform 2010,
The pathology informatics curriculum wiki: Harnessing the power of user-generated content
Ji Yeon Kim, Thomas M Gudewicz, Anand S Dighe, John R Gilbertson
Department of Pathology, Massachusetts General Hospital and Harvard Medical School, Boston, MA, USA
|Date of Submission||24-Apr-2010|
|Date of Acceptance||30-Apr-2010|
|Date of Web Publication||13-Jul-2010|
John R Gilbertson
Department of Pathology, Massachusetts General Hospital and Harvard Medical School, Boston, MA
Source of Support: None, Conflict of Interest: None
| Abstract|| |
Background: The need for informatics training as part of pathology training has never been so critical, but pathology informatics is a wide and complex field and very few programs currently have the resources to provide comprehensive educational pathology informatics experiences to their residents. In this article, we present the "pathology informatics curriculum wiki", an open, on-line wiki that indexes the pathology informatics content in a larger public wiki, Wikipedia, (and other online content) and organizes it into educational modules based on the 2003 standard curriculum approved by the Association for Pathology Informatics (API). Methods and Results: In addition to implementing the curriculum wiki at
http://pathinformatics.wikispaces.com , we have evaluated pathology informatics content in Wikipedia. Of the 199 non-duplicate terms in the API curriculum, 90% have at least one associated Wikipedia article. Furthermore, evaluation of articles on a five-point Likert scale showed high scores for comprehensiveness (4.05), quality (4.08), currency (4.18), and utility for the beginner (3.85) and advanced (3.93) learners. These results are compelling and support the thesis that Wikipedia articles can be used as the foundation for a basic curriculum in pathology informatics. Conclusions: The pathology informatics community now has the infrastructure needed to collaboratively and openly create, maintain and distribute the pathology informatics content worldwide (Wikipedia) and also the environment (the curriculum wiki) to draw upon its own resources to index and organize this content as a sustainable basic pathology informatics educational resource. The remaining challenges are numerous, but largest by far will be to convince the pathologists to take the time and effort required to build pathology informatics content in Wikipedia and to index and organize this content for education in the curriculum wiki.
Keywords: Wikipedia, Wiki, On-line Education, Pathology Informatics Curriculum
|How to cite this article:|
Kim JY, Gudewicz TM, Dighe AS, Gilbertson JR. The pathology informatics curriculum wiki: Harnessing the power of user-generated content. J Pathol Inform 2010;1:10
|How to cite this URL:|
Kim JY, Gudewicz TM, Dighe AS, Gilbertson JR. The pathology informatics curriculum wiki: Harnessing the power of user-generated content. J Pathol Inform [serial online] 2010 [cited 2015 Aug 4];1:10. Available from: http://www.jpathinformatics.org/text.asp?2010/1/1/10/65428
| Introduction|| |
The Need for Informatics in Pathology
Information from medical laboratories and pathologists is critical to modern medicine across the entire continuum of patient care. The laboratory provides consultative services and information management in the form of reliable, reproducible, largely quantitative data that are used extensively to screen populations, diagnose disease, estimate prognosis, guide therapy and measure outcomes.  The importance of the laboratory as an information source is seen in a study which demonstrated tht 94% of requests to a clinical electronic medical record were for laboratory results alone.  It is believed that more than half of the significant medical decisions are based, at least partially, on information from the laboratory. ,
The increasingly data-intensive nature of medical practice, the critical role of pathology data to this practice, and the growing use of information systems to manage and communicate information caused visionary pathologists like Korpman  and Friedman  to recommend training in pathology informatics as an important component of preparing pathology residents to be become the "medical information specialist."
Early definitions of pathology informatics, such as that by Friedman in his seminal 1990 paper,  focused on information management, particularly, the communication and processing of laboratory data, and emphasized the strategic importance of these activities to pathology practice. Today, these activities are becoming even more important with the rise of evidence-based medicine, personalized medicine, public demand for improved quality and patient safety in healthcare, and use of electronic health records. ,,
Furthermore, the creation and processing of pathology data is changing. Laboratories are increasingly automated and are managed through data-driven management protocols such as Six Sigma ,, and LEAN. ,, Even anatomic pathology is becoming digitized, ,,,, and computer analysis and decision support is becoming more common. ,,,, Pathologists are commonly asked to manage complex, spatially distributed facilities (and point of care networks), generate standardized and coded "machine consumable" data, create "integrated" reports from data generated by multiple tests in multiple labs and communicate with multiple hospital systems. Informatics now covers the total testing cycle, from ordering to transporting, processing, testing, resulting, interpreting, integrating, communicating, advising and documenting. ,, The importance of understanding informatics and the need for informatics training as part of pathology training has never been so critical and will become increasingly important with the growing dependence on medical information systems.
The Availability of Pathology Informatics Training
Between 1993 and 2003, repeated surveys of pathology residency programs in the United States and Canada have shown that between 19 and 26% of residency programs offered "dedicated rotations" in pathology informatics, with the reported percentage actually decreasing in that time period ,, [Table 1]. The surveys also demonstrated significant variability in the scope and quality of pathology informatics training. Reported methods of teaching included computer training courses to gain proficiency with laboratory information system (LIS) applications, lecture series (from less than 1 week to periodic series spanning years), direct use (hands-on) with computers, and self-study, with most programs using more than one instructional method. A concern raised by the authors of the surveys is that many pathology residency programs view training in informatics as equivalent to use of the LIS and perhaps use of personal computers. ,,
Proposals for a standardized curriculum for pathology informatics training in residencies began as early as 1992 with recommendations by Peters and Clark  and Buffone and Beck.  In 2003, a proposal for a standardized basic pathology informatics curriculum, based largely on the publication by Henricks, Boyer, Harrison, Tuthill and Healy,  was supported by the Training and Education Committee of the Association for Pathology Informatics (API).
In 2000, the University of Pittsburgh Department of Pathology (Pittsburgh, PA, USA) established a 3-week full-time core rotation in pathology informatics , which incorporated many of the curriculum concepts proposed in the articles cited above. It included an introduction to general desktop computing applications and the use of the internet, as well as vocabularies, ontologies, imaging, interfaces, databases and laboratory information systems. The rotation included 63 hours of didactic sessions and hands-on laboratories, was taught by 19 faculty and staff (including one of the authors of this article, JRG) and was required for residents at the beginning of their second year of training.
One of the major lessons of the early Pittsburgh experience was that extensive resources and planning were required to implement a comprehensive pathology informatics curriculum in a residency program. There were far more faculty than students, and most faculty members gave more than one presentation. Only a small number of programs have expertise and resources to present such an educational experience. For example, according to the API, there are only five US medical centers (including the University of Pittsburgh) that support pathology informatics fellowships  [Table 2]. Thus, considerations of resources and expertise seem to indicate that the comprehensive teaching of informatics remains limited to a few specialized academic centers.
Another important lesson from the early University of Pittsburgh experience is the problem of sustainability. Finding 19 faculty and staff willing to dedicate 3 weeks to teach a small number of residents every year was difficult, even at a large institution such as Pittsburgh. Presently, the University of Pittsburgh still runs an outstanding course, but it is smaller and shorter than it was in 2003. A compounding burden is that a pathology informatics curriculum needs to keep pace with rapid changes in technology, standards and practices. For example, terms like "floppy disk" from the standardized curriculum of 2003 (vide supra) come across as dated, and possibly irrelevant, only a few years later. Any proposed standard training program in pathology informatics must consider that the current academic pathology informatics community is still small and the effort necessary to create and update any curriculum is substantial.
Partially in response to the issues above, the University of Pittsburgh recently created the Virtual Rotation in Pathology Informatics (VRPI).  Based on the initial proposals for a standard curriculum (vide supra), this extension of the original Pittsburgh pathology informatics rotation is available online at https://secure.opi.upmc.edu/VRPI/index.cfm. The rotation includes original lectures, video-recorded laboratory exercises and reading assignments from the textbook "Practical Pathology Informatics" by John Sinard.  Significantly, it also leverages other educational resources on the internet, including lectures in the online archives of the APIII conference (Advancing Practice, Instruction and Innovation through Informatics; http://apiii.upmc.edu/), and tutorials from the National Center for Biotechnology Information (NCBI) and PubMed.
Wikis and the Power of User Generated Content
Originally, the internet was a technology for the efficient distribution of electronic content, making it an appropriate vehicle for online curricula and web-based learning. The internet makes educational material accessible to anyone with an internet connection for "anywhere, anytime" learning. Such capabilities can reduce the need for local expertise. Because of this convenience, the internet is used by an estimated 40 million adults in the US (20% of Americans) as their primary source of news and information about science, second only to television, according to a report by the Pew Internet and American Life Project.  In addition, the same study found that the internet is a research tool for 87% of online users (about 128 million adults) and it is the first source people would turn to if they had a question on a specific scientific topic. The internet can provide more widespread accessibility to pathology informatics training materials, but the creation and maintenance of these materials in a rapidly changing, technology-heavy field like pathology informatics, with a limited number of academic experts (with limited cycles for teaching), is still problematic.
More recently, "Web 2.0" technologies are changing the internet from a distribution publication medium to a place for distributed creation and reuse of content. The term Web 2.0 became popular following the O'Reilly Media Web 2.0 Conference in 2004, and refers to collaborative information-sharing platforms that include wikis, blogs, and podcasts.  The wiki is a particularly interesting construct in the context of creating and sharing a pathology informatics curriculum. Wiki software (from the Hawaiian wiki, to hurry, swift) allows multiple users to easily collaborate as coauthors to create, distribute, edit and update content. Initially designed in 1994, it allows creation and editing of interlinked web pages via a web browser using a simplified mark-up language, or a WYSIWYG ("What You See Is What You Get") text editor. 
The use of wikis and other Web 2.0 technologies in medical education and the health sciences has been widely discussed in the literature, ,, with 45% of medical schools and 53% of nursing schools in a recent survey reporting use of blogs, wikis, videocasts, and podcasts.  Use of Web 2.0 tools has taken hold among health educators, clinicians, librarians and patients alike, with numerous articles, journal issues and conferences devoted to developments in this field. ,
At Massachusetts General Hospital, available pathology informatics resources include 12 Harvard Medical School faculty members, each independent with individual resources, areas of expertise and points of view. Our initial idea was to use a wiki as an internal tool to build a curriculum for our residents. However, we quickly realized that with or without a wiki, we did not have enough people with enough time to create and sustain a comprehensive course. We continued to focus on the scale and scope of the project to identify alternate solutions, leading us to the concept of a wiki-based course using Wikipedia as its primary reference.
Several Web traffic measuring firms report that Wikipedia (
http://wikipedia.org/ ) is the most popular educational and reference site on the internet, and is in the top ten of the most heavily visited sites overall, including search engine sites. , As of 03/06/2010, with more than 3 million English articles and 68 million monthly visitors, Wikipedia has an estimated 91,000 active contributors collectively making 10,000 edits every 6-8 weeks. , Wikipedia is a prominent source of high-quality online health-related information, even when compared with other health references such as Medline Plus.  In one study, 80 and 70% of recently trained junior physicians (2-3 years post-graduation) already use Web 2.0 tools such as Google and Wikipedia, respectively, for information-seeking activities for clinical decisions and medical education  [Figure 1]. There is even a community dedicated to improving medicine and health-related articles of Wikipedia called WikiProject Medicine (
An initial evaluation of Wikipedia identified multiple potential articles for use as the core of a pathology informatics curriculum. We then asked the following questions: 1) was the pathology informatics information represented in Wikipedia articles comprehensive, of high quality, and up-to-date; 2) what would be the best way to index and present these articles in a coherent course that would be useful to students; 3) what would be the best way to maintain the index and the lessons; 4) if Wikipedia articles important to pathology informatics did not exist or were not of high quality, how could the articles be created, improved or supplemented and 5) would such an initiative be consistent with Wikipedia's rules for fair use.
Given this background, we proposed the Pathology Informatics Curriculum Wiki (http://pathinformatics.wikispaces.com), an online public wiki, which, using the 2003 API standard curriculum as a guide, would act as an organized index to pathology informatics content on a much larger public wiki, Wikipedia, as well as other stable, well-established, community-based and continually updated online sources. The objective was not to create our own index or our own content, but to leverage the knowledge and skill of the entire pathology informatics community to create a shared educational resource for pathology training programs that would supplement or inspire development of local curricula in pathology informatics.
| Materials and Methods|| |
Evaluation of the Pathology Informatics Content in Wikipedia
To evaluate the scope of pathology informatics information in Wikipedia, we took 198 non-duplicative terms from the 2003 proposed standard curriculum (vide supra) and determined the percentage mapped to Wikipedia articles by searching each of the terms on Wikipedia (as of 03/06/2010). In our analysis, we included one curriculum section heading "Laboratory Information System" as a term, for a total of 199 terms. Where there were approximate matches (e.g. "fiber-optic cable" versus "optical fiber cable"), we included the alternative terms as a match (Appendix).
For articles that mapped to terms, we used the number and type of "tags" or "Template Messages" on each article as a proxy of completeness and/or quality. In Wikipedia, template messages are used for a variety purposes, including indentifying articles that need improvement. Typical reasons for a tag would include problems with reference or citations, redundancy, requests for expansion, addition, background information or major upgrades, disambiguation, copyright issues, etc. (
Finally, over a period of 2 days (03/05/2010-03/06/2010), the authors chose a set of 40 articles at random (from the set of articles that mapped to the 199 terms of the 2003 proposal) and evaluated each article on a five-point Likert scale (
http://en.wikipedia.org/wiki/Likert_Scale ) for completeness ("comprehensive"), quality and lack of major errors ("high-quality"), appropriateness as a beginning text for pathology resident ("appropriate for beginner"), appropriateness as a text for advanced learners ("appropriate for advanced learner"), and its state of being up-to-date ("current") with the latest knowledge. The editorial activity per year could be quantified using revision history statistics that were also included as a marker for currentness. Finally, the reviewers gave a qualitative (1 = yes, active; 0 = no, non-active) assessment of the activity of discussion and edits being made on the articles.
While the majority of terms in the 2003 curriculum had relevance/interest to pathology informatics and to the wider "IT community" (e.g. "programming language"), there was a subset which was more specific to pathology informatics itself (e.g. "laboratory information system"). Of the 40 articles selected for evaluation discussed in the previous paragraph, 10 were felt to be specific to the "pathology informatics" subset. The Likert scores from the two groups were compared using the Wilcoxon-Mann Whitney test to see if there was a statistically significant difference, with the expectation that the articles of general interest would have higher scores (one-tailed P value).
Organization and Platform
The pathology informatics curriculum wiki is currently hosted by Wikispaces (
http://www.wikispaces.com ) at http://pathinformatics.wikispaces.com. Wikispaces is used by a number of universities, including Columbia University and University of Massachusetts Lowell, for educational purposes. It is one of many very inexpensive and capable wiki hosting options available, and is very useable and flexible. It should also be noted that the entire contents of the curriculum can be easily and simply moved to another hosting option, if necessary.
The curriculum in the pathology informatics curriculum wiki is based on the previously published standardized pathology informatics curriculum.  The content on the curriculum wiki links and organizes Wikipedia articles to a series of educational "chapters" or "modules" on pathology informatics. Each module includes sections for goals, a list of terms/topics (each term/topic is linked to content in the form of Wikipedia articles and other stable online resources), a narrative section (to relate the terms/topics to each other), recommended laboratory-like activities, supplemental online resources for advanced students (vide infra), and questions [Figure 2].
Improving or Supplementing Wikipedia Articles
Toward the end of the lessons, there are links for "supplemental material" that reference advanced Wikipedia articles or Massachusetts Institute of Technology (MIT) OpenCourseWare (OCW; http://ocw.mit.edu). Through the OCW initiative, MIT makes materials used in MIT courses freely and openly available for noncommercial educational purposes, under their Creative Commons license.  Other publicly available, independently well-maintained sites are also referenced, such as the archives of the APIII (
At the end of each curriculum module, there is an "Expert Corner" where readers can comment on Wikipedia articles. The goal of the "Expert Corner" is to allow readers to identify content that, in the opinion of the reader, needs further improvements (or perhaps issues for which no Wikipedia article exists). Because the core content available on the pathology informatics curriculum wiki resides in community-created and maintained articles in Wikipedia, a user of the curriculum wiki who feels that a Wikipedia article can be improved can, and should, begin a discussion in Wikipedia about changing or extending the article (to see how this is done, go to http://en.wikipedia.org/wiki/Wikipedia:Introduction). However, if the reader does not have the confidence or knowledge needed to improve the article directly, he or she can identify the article for potential improvement by another member of the pathology informatics community. After users of the curriculum highlight or suggest Wikipedia articles relating to pathology informatics, pathology informatics "experts" across the world could easily join Wikipedia and improve, or create, the articles directly (vide infra, conclusion).
A potentially important role for the "Expert Corner" is link maintenance. The pathology informatics wiki focuses on stable, core content sources like Wikipedia and MIT, which should minimize the frequency of broken links. Having said that, broken links happen. Ideally, wiki users would fix broken links as they identify them; however, if this is not possible, the problematic links should be at least noted in "Expert Corner" so that others can effect the repair.
Brief Examination of Rules for Fair Use
The value and content in the pathology informatics curriculum wiki is in the use of links to materials on Wikipedia, MIT OCW and other third-party sites in a way that repurposes the preexisting materials to educate a new audience. Legal issues may arise when linking to third-party sites when the linking page uses copyrighted or trademark-protected text or images from the linked site. However, in this case, Wikipedia operates under the Creative Commons Attribution-ShareAlike 3.0 Unported License which allows users to copy, distribute and transmit its work freely, and its licensing policy requires content hosted on Wikipedia to be free content.  Similarly, MIT OCW uses the Creative Commons license to allow non-commercial use of its materials. 
At the same time, teaching is an activity that falls under the fair use doctrine of copyright law. Simply stated, the United States and other countries recognize fair use as being "the right to use copyrighted material without permission or payment, when the benefit to society is larger than the damage to the copyright holder".  Because the pathology informatics curriculum wiki is a non-commercial educational website, linking to third-party sites will be included under the terms of fair use. Even so, the majority of the links are to Wikipedia and other websites that are using the Creative Commons license, where this is not an issue.
| Results|| |
Evaluation of the Pathology Informatics Content in Wikipedia
From the 199 non-duplicative terms published in the 2003 standardized basic pathology informatics curriculum, including the addition of the "Laboratory Information Systems" section header as a term, 179 (90%) have at least one Wikipedia entry and 20 (10%) do not have an entry (as of 03/06/2010; Appendix). The majority of the absent terms (n = 15/20, 75%) in Wikipedia were related to components of the LIS [Table 3].
Of the 179 Wikipedia entries mapped to pathology informatics curriculum terms, 102 (57%) entries had one or more "tags" placed on them that highlighted a need for additional improvements to the article. The most common reason for the "tag" was a need for more citations in the article [Table 3].
Twenty-two percent (40 of the 179) of the 2003 curriculum terms that had Wikipedia articles were selected at random and included in a more comprehensive review. The results are shown in [Table 4]. Among the five qualities assessed on the five-point Likert scale, the Wikipedia articles scored the highest marks (4.18) for being up-to-date ("current"). This correlated with an average of 112 revisions per article over a 1-year period (02/01/2009-02/01/2010). This was followed by "quality" (4.08), "completeness" (4.05) and "appropriate for advanced learners" (3.93). The lowest marks were given in the category of "appropriate for beginners" (3.85).
As can be expected, articles that were of wider interest to the Wikipedia community (e.g. articles of importance to both the general information technology industry and pathology informatics) received higher scores in all categories when compared to articles that could be considered more specific to pathology informatics. The differences reached statistical significance in the categories of completeness ("comprehensive"; P = 0.02) and quality ("high-quality"; P = 0.046). In addition, the number of revisions per year was significantly higher in the group of articles that were of general interest than the articles specifically relevant to pathology informatics (128 versus 64, P = 0.04).
Organization of the Lessons and of the Curriculum
The current pathology informatics curriculum wiki consists of 20 chapters: Getting started, Computer basics, Data, Networks, Imaging basics, Standards, Databases, LIS (Laboratory Information System), AP LIS (Anatomic Pathology Laboratory Information System), System implementation, Digital imaging, Telepathology, Bioinformatics, Statistics, Hospital systems, Security, Regulation, Quality and Safety, Outcomes, Resources.
An example of a chapter can be seen in [Figure 2]a and b. Each chapter starts with a template that has sections for: the goals of the lesson, a list of relevant terms and topics that are linked to Wikipedia or other online, stable resources, a narrative section, recommended activities, other supplemental online resources such as didactic materials on MIT OCW, questions, and the Expert Corner where users can indicate Wikipedia articles that need additional help.
By the nature of the wiki software, users can click on the tabs at the top of each page to join a discussion on that page, look at the history of edits made on the page, or request notification any time a change to the page is made. Every page can be edited by selecting the "Edit this page" button on the top right of the page, and edits may be made anonymously or by a registered user.
| Comments|| |
Web 2.0, the Pathology Community and the Importance of Pathology Informatics on Wikipedia
For the past 15 years, the internet has provided an increasingly effective medium for the distribution of educational information from a single institution to the rest of the pathology informatics community. With the rise of Web 2.0 technologies, the internet has also become a medium for the distribution and creation of educational information from the community for the community. This is important, as the size, scale and need for informatics training in pathology is ever increasing, and is perhaps beyond what can be readily supported by local initiatives.
Wikis in particular have proven very effective in the collaborative creation and maintenance of knowledge on the web. By their nature, they actively engage teachers and learners in their construction and distribution of knowledge. They are easy to use, and the technology is widely available with open source, free or low-cost software and hosting options.
The information in public, online wikis is immediately available to every pathology informatician with an internet connection, anywhere in the world. Equally important, and more revolutionary, the privilege to create and edit this information is not reserved for specific universities or teaching institutions. This is potentially transformative and useful, as most knowledge in pathology informatics resides outside the academic pathology programs in large and small practices, reference labs, coroner's offices, the LIS, middleware and imaging industry, with engineers, scientists, technicians, histologists and others not normally involved in pathology informatics education. Leveraging the entire community is important as the size, scale and need for informatics education in pathology is larger and is growing faster than academic informaticians can be trained and supported.
Wikipedia, formally launched on 01/15/2001, is the largest wiki and has become the de facto first-line encyclopedia for a large percentage of the general population. Although not without controversy or critics, early concerns that large public wikis would be prone to vandalism, unreliability or inaccuracies due to their openness, have not materialized. Although anyone can post content that is misleading, unsuitable or wrong, major wikis have software that tracks versions of a page, allowing an administrator to recover the latest non-vandalized version. A large and active author base combined with the wiki's very openness seems to foster a "socially Darwinian process," whereby pages are subject to a selection process that favors a middle ground of generally agreed upon knowledge. Sentences and sections can be discussed, edited and replaced if not considered "fit," which eventually results in a higher quality page. A relatively recent comparison of Wikipedia and the Encyclopedia Britannica published in Nature showed similar numbers of errors in both the online encyclopedias, indicating that their accuracy may also be similar,  though these claims have been disputed by Encyclopedia Britannica.  A discussion on the reliability of Wikipedia, with references to multiple studies can be found at http://en.wikipedia.org/wiki/Reliability_of_Wikipedia.
Another important concern has been the lack of clear and complete authorship information. Especially for places of higher education, where individuals are traditionally recognized for their efforts by attributed publications, wiki anonymity and collaboration raises a number of issues. The most obvious is the issue of assigning value for the effort required to create and edit content. While the success of Wikipedia is a clear evidence that volunteer, largely anonymous collaboration can produce outstanding work, it would be ideal, and perhaps in some cases necessary, to find a mechanism to recognize effort in creating and sustaining pathology informatics articles (vide infra). The wikis themselves could perhaps address this criticism by developing user hit counters and an associated user rating systems of materials read.
The Strengths and Weaknesses of Wikipedia in Pathology Informatics
The great majority (179 of the 199) of non-duplicative terms in the 2003 API curriculum have at least one related Wikipedia article, and the great majority of these articles seem (in the opinion of the authors of this study) to be comprehensive, of high quality, current and appropriate for both beginners and advanced learners. These results are compelling and support the thesis that Wikipedia articles can be used as the foundation for a curriculum in pathology informatics.
On of the most surprising results of our analysis was the comprehensiveness of Wikipedia articles and their appropriateness for both beginners and advanced learners. In fact, the articles as a group were felt to be slightly more appropriate for advanced learners than for beginners (although the difference was very small and not statistically significant). Thinking this through, however, we should be surprised; Wikipedia articles are created and maintained by volunteers passionate about, interested in and having an expertise on the articles they create. The articles are often long and comprehensive with multiple hyperlinks and citations.
Perhaps the most concerning result in this project to date has been the relative weakness in Wikipedia articles on specific, core topics in pathology informatics. Of the 199 terms from the 2003 curriculum, 20 did not have Wikipedia entries, and of these 75% were related to components of laboratory information systems. To look at this in a slightly different way, slightly more than half of the terms associated with the LIS did not have Wikipedia articles (n = 15/27, 56%).
Furthermore, the authors of this study found that even when articles on pathology informatics specific issues such as laboratory information systems, laboratory automation, and laboratory regulatory issues existed, they were significantly weaker (in terms of completeness and quality) than articles on "general informatics and imaging" issues such as computers, software, microscopy, digital imaging, etc.
The authors do not find this discrepancy to be a fatal flaw. The quality of articles in Wikipedia is a function of the interest of the Wikipedia audience - it makes sense that articles that involve more people will be better, all else equal, than articles of interest to a smaller group. In fact, we consider this an opportunity: once weak articles are identified though projects like this, it is well within the capacity of the pathology informatics community to address them (vide infra).
Identifying (and improving) weak or nonexistent Wikipedia articles important to the teaching of pathology informatics is valuable not only for the teaching itself, but also for the appreciation and understanding of pathology informatics by the general public. Politicians, reporters, venture capitalist, medical students, administrators and our physician colleagues increasingly rely on Wikipedia as the first resource on many medical topics. The Wikipedia community is currently developing "WikiProject Medicine," a project that "aims to enable Wikipedians to cooperate, organize, make suggestions and share ideas on the improvement of medical and health-related articles of Wikipedia" (
http://en.wikipedia.org/wiki/Wikipedia:WikiProject_Medicine ). When key components of the pathology informatics infrastructure and knowledge base are not represented in the first-line encyclopedia for an increasing fraction of the population, it bodes poorly for the public understanding of, and decisions about, our field.
The Value of the Pathology Informatics Curriculum Wiki
If the core content of a pathology informatics curriculum can be found in Wikipedia (and other stable websites), what is the value of the pathology informatics curriculum wiki at http://pathinformatics.wikispaces.com? The goal of the curriculum wiki is to 1) index, organize and present the pathology informatics content (largely in Wikipedia) in the form of understandable and coherent courses, 2) supplement core content with activities and other more advanced content such as the MIT OCW and 3) help highlight areas in which the core content sources (like Wikipedia) need to be created, edited, enhanced or updated.
To this end, the curriculum wiki indexes and organizes Wikipedia articles (associated with the 2003 curriculum) into modules. It puts each term (linked to a Wikipedia article) in context in a short narrative, associates activities and additional resources and, through its "Expert Corner" section, allows readers to highlight Wikipedia content that should be improved or articles that should be included.
Importantly, the online pathology informatics curriculum wiki presented here is intended as a supplement to, not a substitute for, formal departmental support for informatics-related education. Furthermore, training in pathology must go beyond informatics didactics - it needs to involve residents in ongoing departmental activities in information operations, creation, management and communication (e.g. LIS operations, meetings on quality, imaging, electronic medical records, electronic order entry, structured data, reporting critical values, etc.).
The pathology informatics curriculum wiki is a public wiki that indexes a larger public wiki, Wikipedia, and other web content around the standard pathology informatics curriculum approved by API in 2003. Like all wikis, it seeks to harness user generated content from the entire pathology informatics community to maintain and improve the index, the modules and the content being indexed. Its success will rely heavily upon anonymous volunteerism, and the informal collaboration and vigilance supported by this approach has both strengths and weaknesses.
Given the dynamic nature of pathology informatics (and the very essence of wikis), this project will never be "finished". The curriculum is 7 years old, not all of the modules have been indexed, not all of the underlying articles are adequate and the curriculum, the index, the articles and the field itself will always be a moving target. It is the dynamic nature of pathology informatics (combined with the limited amount of academic resources) that caused us to consider opening the creation and maintenance of educational content to the entire pathology informatics community through "a public pathology informatics wiki that indexes Wikipedia."
The Partners Healthcare System Fellowship in Pathology Informatics, which currently includes the Massachusetts General Hospital, the Brigham and Women's Hospital and Northshore Medical Center will continue to develop the wiki as a core part of its fellowship program. However, the ultimate success of the pathology informatics curriculum wiki depends on whether it will be accepted by the pathology informatics community outside of Boston, which means that it must become associated with a more national or international entity, organization, society or conference.
It also needs to deal with the fundamental issues of collaboration, credit and value in academia. When a faculty member, fellow or resident writes a paper or develops a local course, this work is credited in curriculum vitae and becomes real currency when it comes time for promotion or recruitment. Work on a wiki does not currently have such value.
In their 2009 paper "Improving Wikipedia: educational opportunities and professional responsibility," Callis, Christ and Resasco  suggest that volunteering to improve Wikipedia (and by extension, other wikis) may be considered a part of professionalism. On the other hand, in other scientific disciplines (such as physics), it is not uncommon to have tens or hundreds of authors on a paper, especially when communicating results of complex and expensive experiments or initiatives. The pathology informatics curriculum wiki (as opposed to Wikipedia) could be considered as such an initiative. Every department of pathology needs to teach pathology informatics as part of its educational and clinical missions. While the wiki to date has been largely the work of a single person (JYK), 18 others have contributed and their contribution is documented in the wiki's history logs. It may be possible, through future publications, to credit the contributors of the curriculum wiki in a way more consistent with academic practice and value.
| Competing Interests|| |
The author(s) declare that they have no competing interests.
| Authors' Contributions|| |
JYK was responsible for the first draft of this manuscript, the initial design of the pathology informatics curriculum wiki and the implementation of the system. JYK and JRG collaborated in the development of the concept and were actively involved in later versions of the draft. All the authors helped evaluate the system and have reviewed and commented on successive drafts of the manuscript and have provided the first author with approval of the final manuscript.
| Acknowledgments|| |
The authors thank the Members of the API for their advice and support of the project.
| References|| |
|1.||Price CP. Application of the principles of evidence-based medicine to laboratory medicine. Clin Chim Acta 2003;333:147-54. |
|2.||Forsman R. The electronic medical record: Implications for the laboratory. Clin Leadersh Manag Rev 2000;14:292-5. |
|3.||Becich MJ. Information management: Moving from test results to clinical information. Clin Leadersh Manag Rev 2000;14:296-300. |
|4.||Forsman RW. Why is the laboratory an afterthought for managed care organizations? Clin Chem 1996;42:813-6. |
|5.||Korpman RA. Using the computer to optimize human performance in health care delivery: The pathologist as medical information specialist. Arch Pathol Lab Med 1987;111:637-45. |
|6.||Friedman BA. Informatics as a separate section within a department of pathology. Am J Clin Pathol 1990;94:S2-6. |
|7.||Elstein AS. On the origins and development of evidence-based medicine and medical decision making. Inflamm Res 2004;53:S184-9. |
|8.||Leape LL. Errors in medicine. Clin Chim Acta 2009;404:2-5. |
|9.||Blumenthal D. Stimulating the adoption of health information technology. N Engl J Med 2009;360:1477-9. |
|10.||Becich MJ, Gilbertson JR, Gupta D, Patel A, Grzybicki DM, Raab SS. Pathology and patient safety: The critical role of pathology informatics in error reduction and quality initiatives. Clin Lab Med 2004;24:913-43. |
|11.||Gras JM, Philippe M. Application of the Six Sigma concept in clinical laboratories: A review. Clin Chem Lab Med 2007;45:789-96. |
|12.||Nevalainen D, Berte L, Kraft C, Leigh E, Picaso L, Morgan T. Evaluating laboratory performance on quality indicators with the six sigma scale. Arch Pathol Lab Med 2000;124:516-9. |
|13.||Persoon TJ, Zaleski S, Frerichs J. Improving preanalytic processes using the principles of lean production (Toyota Production System). Am J Clin Pathol 2006;125:16-25. |
|14.||Napoles L, Quintana M. Developing a lean culture in the laboratory. Clin Leadersh Manag Rev 2006;20:E4. |
|15.||Rutledge J, Xu M, Simpson J. Application of the Toyota Production System improves core laboratory operations. Am J Clin Pathol 2010;133:24-31. |
|16.||Gilbertson J, Yagi Y. Histology, imaging and new diagnostic work-flows in pathology. Diagn Pathol 2008;3:S14. |
|17.||Gilbertson JR, Ho J, Anthony L, Jukic DM, Yagi Y, Parwani AV. Primary histologic diagnosis using automated whole slide imaging: A validation study. BMC Clin Pathol 2006;6:4. |
|18.||Ho J, Parwani AV, Jukic DM, Yagi Y, Anthony L, Gilbertson JR: Use of whole slide imaging in surgical pathology quality assurance: Design and pilot validation studies. Hum Pathol 2006;37:322-31. |
|19.||Zarbo RJ, Tuthill JM, D'Angelo R, Varney R, Mahar B, Neuman C, et al. The Henry Ford Production System: Reduction of surgical pathology in-process misidentification defects by bar code-specified work process standardization. Am J Clin Pathol 2009;131:468-77. |
|20.||Bouma BE, Yun SH, Vakoc BJ, Suter MJ, Tearney GJ. Fourier-domain optical coherence tomography: Recent advances toward clinical utility. Curr Opin Biotechnol 2009;20:111-8. |
|21.||Pantanowitz L, Hornish M, Goulart RA. Informatics applied to cytology. Cytojournal 2008;5:16. [PUBMED] |
|22.||Donovan MJ, Costa J, Cordon-Cardo C. Systems pathology: A paradigm shift in the practice of diagnostic and predictive pathology. Cancer 2009;115:3078-84. |
|23.||Marchevsky AM, Shah S, Patel S. Reasoning with uncertainty in pathology: Artificial neural networks and logistic regression as tools for prediction of lymph node status in breast cancer patients. Mod Pathol 1999;12:505-13. |
|24.||Singson RP, Alsabeh R, Geller SA, Marchevsky A. Estimation of tumor stage and lymph node status in patients with colorectal adenocarcinoma using probabilistic neural networks and logistic regression. Mod Pathol 1999;12:479-84. |
|25.||Marchevsky AM, Wick MR. Evidence-based medicine, medical decision analysis, and pathology. Hum Pathol 2004;35:1179-88. |
|26.||Dighe AS, Rao A, Coakley AB, Lewandrowski KB. Analysis of laboratory critical value reporting at a large academic medical center. Am J Clin Pathol 2006;125:758-64. |
|27.||Blechner M, Kish J, Chadaga V, Dighe AS. Analysis of search in an online clinical laboratory manual. Am J Clin Pathol 2006;126:208-14. |
|28.||Laposata ME, Laposata M, Van Cott EM, Buchner DS, Kashalo MS, Dighe AS. Physician survey of a laboratory medicine interpretive service and evaluation of the influence of interpretations on laboratory test ordering. Arch Pathol Lab Med 2004;128:1424-7. |
|29.||Balis UJ, Aller RD, Ashwood ER. Informatics training in U.S. pathology residency programs: Results of a survey. Am J Clin Pathol 1993;100:S44-7. |
|30.||Goldberg-Kahn B, Healy JC. Medical informatics training in pathology residency programs. Am J Clin Pathol 1997;107:122-7. |
|31.||Henricks WH, Healy JC. Informatics training in pathology residency programs. Am J Clin Pathol 2002;118:172-8. |
|32.||Peters M, Clark IR. Pathologists and training in information technology. J Clin Pathol 1992;45:185-7. |
|33.||Buffone GJ, Beck JR. Informatics: A subspecialty in pathology. Am J Clin Pathol 1993:100:75-81. |
|34.||Henricks WH, Boyer PJ, Harrison JH, Tuthill JM, Healy JC. Informatics training in pathology residency programs: Proposed learning objectives and skill sets for the new millennium. Arch Pathol Lab Med 2003;127:1009-18. |
|35.||Harrison JH Jr, Stewart J 3rd. Training in pathology informatics: Implementation at the University of Pittsburgh. Arch Pathol Lab Med 2003;127:1019-25. |
|36.||Harrison JH Jr. Pathology informatics questions and answers from the University of Pittsburgh pathology residency informatics rotation. Arch Pathol Lab Med 2004;128:71-83. |
|37.||Training Opportunities in Pathology Informatics Available from:
http://www.pathologyinformatics.org/InformaticsTrainingPrograms.htm . [last accessed on 2010 Apr 8]. |
|38.||Kang HP, Hagenkord JM, Monzon FA, Parwani AV. Residency training in pathology informatics: A virtual rotation solution. Am J Clin Pathol 2009;132:404-8. |
|39.||Sinard JH. Practical pathology informatics: Demystifying informatics for the practicing anatomic pathologist. New York: Springer Science+Business Media; 2006. |
|40.||Horrigan JB. The Internet as a Resource for News and Information about Science. Washington, DC: Pew Internet and American Life Project; i-32. Available from: http://www.pewinternet.org/Reports/2006/The-Internet-as-a-Resource-for-News-and-Information-about-Science.aspx [last accessed on 2006]. |
|41.||What is Web 2.0. Available from: http://oreilly.com/web2/archive/what-is-web-20.html. [last accessed on 2010 Apr 8]. |
|42.||Ebersbach A. Wiki: Web collaboration. 2 nd ed. Berlin, New York: Springer; 2008. |
|43.||Alikhan A, Kaur RR, Feldman SR. Podcasting in dermatology education. J Dermatolog Treat 2009:1-7. |
|44.||Kamel Boulos MN, Wheeler S. The emerging Web 2.0 social software: An enabling suite of sociable technologies in health and health care education. Health Info Libr J 2007;24:2-23. |
|45.||Boulos MN, Maramba I, Wheeler S. Wikis, blogs and podcasts: A new generation of Web-based tools for virtual collaborative clinical practice and education. BMC Med Educ 2006;6:41. |
|46.||Santoro E: [Podcasts, wikis and blogs: The web 2.0 tools for medical and health education]. Recenti Prog Med 2007;98:484-94. |
|47.||Abreu DV, Tamura TK, Sipp JA, Keamy DG Jr, Eavey RD. Podcasting: Contemporary patient education. Ear Nose Throat J 2008;87:210-1. |
|48.||Elkind MS. Teaching the next generation of neurologists. Neurology 2009;72:657-63. |
|49.||Mongkolwat P, Kogan A, Koh J, Channin DS. Blogging your PACS. J Digit Imaging 2005;18:326-32. |
|50.||Chou WY, Hunt YM, Beckjord EB, Moser RP, Hesse BW. Social media use in the United States: Implications for health communication. J Med Internet Res 2009;11:e48. |
|51.||Goldman RH, Cohen AP, Sheahan F. Using seminar blogs to enhance student participation and learning in public health school classes. Am J Public Health 2008;98:1658-63. |
|52.||Chesanow N. Doctors and "blogs". Med Econ 2004;81:33, 37. |
|53.||Mohammed S, Orabi A, Fiaidhi J, Orabi M. Developing a Web 2.0 telemedical education system: The AJAX-Cocoon portal. Int J Electron Healthc 2008;4:24-42. |
|54.||Chu LF, Young C, Zamora A, Kurup V, Macario A. Anesthesia 2.0: Internet-based information resources and Web 2.0 applications in anesthesia education. Curr Opin Anaesthesiol 2010;23:218-27. |
|55.||McGee JB, Begg M. What medical educators need to know about "Web 2.0". Med Teach 2008;30:164-9. |
|56.||Lemley T, Burnham JF. Web 2.0 tools in medical and nursing school curricula. J Med Libr Assoc 2009;97:50-2. |
|57.||Eysenbach G. Medicine 2.0: Social networking, collaboration, participation, apomediation, and openness. J Med Internet Res 2008;10:e22. |
|58.||WikiSym: The international symposium on wikis and open collaboration. Available from:
http://www.wikisym.org/ . [last accessed on 2010 Apr 8]. |
|59.||Rainie L, Tancer B. Wikipedia: When in doubt, multitudes seek it out. pew research center. Available from: http://pewresearch.org/pubs/460/wikipedia. [last accessed on 2007]. |
|60.||Alexa: the web information company. Top sites. Available from:
http://www.alexa.com/topsites . [last accessed on 2010 Apr 8]. |
|61.||Wikipedia statistics Available from:
http://en.wikipedia.org/wiki/Wikipedia:Statistics . [last accessed on 2010 Apr 8]. |
|62.||Wikipedia. Available from:
http://en.wikipedia.org/wiki/Main_Page . [last accessed on 2010 Apr 8]. |
|63.||Laurent MR, Vickers TJ. Seeking health information online: Does Wikipedia matter? J Am Med Inform Assoc 2009;16:471-9. |
|64.||Hughes B, Joshi I, Lemonade H, Wareham J. Junior physician's use of Web 2.0 for information seeking and medical education: A qualitative study. Int J Med Inform 2009;78:645-55. |
|65.||Margulies AH. A new model for open sharing: Massachusetts Institute of Technology's opencourseware initiative makes a difference. PLoS Biol 2004;2:E200. |
|66.||Text of Creative Commons Attribution-ShareAlike 3.0 Unported License Available from:
http://en.wikipedia.org/wiki/Wikipedia:Text_of_Creative_Commons_Attribution-ShareAlike_3.0_Unported_License . [last accessed on 2010 Apr 8]. |
|68.||Bays T, Carchidi D, Carter-Galvan S, Chambers P, Fons G, Gooding I, et al. Code of best practices in fair use for open courseware. Center for Social Media, School of Communication, American University. Available from:
http://www.centerforsocialmedia.org/resources/publications/code_of_best_practices_in_fair_use_for_opencourseware1 . [last accessed on 2009]. |
|69.||Giles J. Internet encyclopaedias go head to head. Nature 2005;438:900-1. |
|70.||Fatally Flawed: Refuting the recent study on encyclopedic accuracy by the journal Nature Available from:
http://corporate.britannica.com/britannica_nature_response.pdf . [last accessed on 2010 Apr 8]. |
|71.||Callis KL, Christ LR, Resasco J, Armitage DW, Ash JD, Caughlin TT, et al. Improving Wikipedia: Educational opportunity and professional responsibility. Trends Ecol Evol 2009;24:177-9. |
[Figure 1], [Figure 2]
[Table 1], [Table 2], [Table 3], [Table 4]
|This article has been cited by|
||Presencia y adecuación de los principios activos farmacológicos en la edición española de la Wikipedia
| ||Paula López Marcos,Javier Sanz-Valero |
| ||Atención Primaria. 2013; 45(2): 101 |
||Wikis and Collaborative Writing Applications in Health Care: A Scoping Review
| ||Patrick M Archambault,Tom H van de Belt,Francisco J Grajales III,Marjan J Faber,Craig E Kuziemsky,Susie Gagnon,Andrea Bilodeau,Simon Rioux,Willianne LDM Nelen,Marie-Pierre Gagnon,Alexis F Turgeon,Karine Aubin,Irving Gold,Julien Poitras,Gunther Eysenbach,Jan AM Kremer,France Légaré |
| ||Journal of Medical Internet Research. 2013; 15(10): e210 |
||An Evaluation of Wikipedia as a Resource for Patient Education in Nephrology
| ||Garry R. Thomas,Lawson Eng,Jacob F. de Wolff,Samir C. Grover |
| ||Seminars in Dialysis. 2013; 26(2): 159 |
||Toward a wiki guide for obstetrics and gynecology trainees in Ireland
| ||Ruaidhrí M. McVey,Eric Clarke,Pauline Joyce,Michael Turner,Michael J. Gannon |
| ||International Journal of Gynecology & Obstetrics. 2013; 120(3): 301 |
||The application of wiki technology in medical education
| ||Andrew Rasmussen,Melanie Lewis,Jonathan White |
| ||Medical Teacher. 2013; 35(2): 109 |
||Wikis and Collaborative Writing Applications in Health Care: A Scoping Review Protocol
| ||Patrick Michel Archambault,Tom H van de Belt,Francisco J Grajales III,Gunther Eysenbach,Karine Aubin,Irving Gold,Marie-Pierre Gagnon,Craig E Kuziemsky,Alexis F Turgeon,Julien Poitras,Marjan J Faber,Jan A.M Kremer,Marcel Heldoorn,Andrea Bilodeau,France Légaré |
| ||JMIR Research Protocols. 2012; 1(1): e1 |
||Quality of information sources about mental disorders: a comparison of Wikipedia with centrally controlled web and printed sources
| ||N. J. Reavley,A. J. Mackinnon,A. J. Morgan,M. Alvarez-Jimenez,S. E. Hetrick,E. Killackey,B. Nelson,R. Purcell,M. B. H. Yap,A. F. Jorm |
| ||Psychological Medicine. 2012; 42(08): 1753 |
||Wikis and Collaborative Writing Applications in Health Care: A Scoping Review Protocol
| ||Patrick Michel Archambault,Tom H van de Belt,Francisco J Grajales III,Gunther Eysenbach,Karine Aubin,Irving Gold,Marie-Pierre Gagnon,Craig E Kuziemsky,Alexis F Turgeon,Julien Poitras,Marjan J Faber,Jan A.M Kremer,Marcel Heldoorn,Andrea Bilodeau,France Légaré |
| ||JMIR Research Protocols. 2012; 1(1): e1 |
||Wikipedia: A Key Tool for Global Public Health Promotion
| ||James M Heilman,Eckhard Kemmann,Michael Bonert,Anwesh Chatterjee,Brent Ragar,Graham M Beards,David J Iberri,Matthew Harvey,Brendan Thomas,Wouter Stomp,Michael F Martone,Daniel J Lodge,Andrea Vondracek,Jacob F de Wolff,Casimir Liber,Samir C Grover,Tim J Vickers,Bertalan Meskó,Michaël R Laurent |
| ||Journal of Medical Internet Research. 2011; 13(1): e14 |
||The pathology informatics curriculum wiki: Harnessing the power of user-generated content.
| ||Kim JY, Gudewicz TM, Dighe AS, Gilbertson JR |
| ||Journal of pathology informatics. 2010; 1 |
||Variations in mothersæ self-esteem in daily life.
| ||Wells AJ |
| ||Journal of personality and social psychology. 1988; 55(4): 661-8 |
||Defective white blood cell function in Hirschsprungæs disease: a possible predisposing factor to enterocolitis.
| ||Wilson-Storey D, Scobie WG, Raeburn JA |
| ||Journal of the Royal College of Surgeons of Edinburgh. 1988; 33(4): 185-8 |
||[Anti-thyroid antibodies and thyroglobulin in the serum of patients with hyperthyroidism treated with methylthiouracil].
| ||Junik R, Lacka K, Sowinski J, Horst-Sikorska W, Gembicki M |
| ||Polski tygodnik lekarski (Warsaw, Poland : 1960). 1987; 42(36): 1120-3 |
||[Immunogold methods for forensic medical examinations--1. Species identification of biological materials by agglutination and agglutination-inhibition tests].
| ||Suzuki H, Kimura H, Itoh F, Matsuzawa S |
| ||Nihon hoigaku zasshi = The Japanese journal of legal medicine. 1987; 41(2): 79-87 |
||Microfilaria in the cornea in onchocerciasis.
| ||Taylor HR, George T |
| ||Transactions of the Royal Society of Tropical Medicine and Hygiene. 1987; 81(1): 148-148 |
||Effect of different saline solutions on the cercaricidal activity of normal human sera.
| ||Chamone M, Melo AL, Pereira LH |
| ||Transactions of the Royal Society of Tropical Medicine and Hygiene. 1987; 81(1): 147-147 |
||Chlorproguanil and chlorcycloguanil concentrations in human plasma and urine after Lapudrine administration.
| ||Edstein MD, Veenendaal JR |
| ||Transactions of the Royal Society of Tropical Medicine and Hygiene. 1987; 81(1): 136-9 |
||Improved results in the operative management of ventricular tachycardia related to inferior wall infarction. Importance of the annular isthmus.
| ||Hargrove WC, Miller JM, Vassallo JA, Josephson ME |
| ||The Journal of thoracic and cardiovascular surgery. 1986; 92(4): 726-32 |
||Daily check instrument for photon and electron beam quality assurance of medical linacs.
| ||Lutz WR, Maddox BJ, Kase KR |
| ||Medical physics. 1985 Jul-Aug; 12(4): 462-5 |
||Bovine thyroid gangliosides: distribution pattern after differential pelleting.
| ||Lagrou A, Hilderson HJ, de Wolf M, Dierick W |
| ||Archives internationales de physiologie et de biochimie. 1974; 82(4): 733-6 |
||[Round table talk on psychiatry in Scandinavia. After care needs reinforcement. More mentally disturbed in new "risk milieus"].
| || |
| ||Nordisk medicin. 1974; 89(8): 244-8 |
||Immunoradiometric assay of human growth hormone.
| ||Miles LE, Hales CN |
| ||Lancet (London, England). 1968; 2(7566): 492-3 |