Enhancing Navigation in Biomedical Databases by Community Voting and Database-Driven Text Classification

DSpace/Manakin Repository

Enhancing Navigation in Biomedical Databases by Community Voting and Database-Driven Text Classification

Citable link to this page


Title: Enhancing Navigation in Biomedical Databases by Community Voting and Database-Driven Text Classification
Author: Duchrow, Timo; Shtatland, Timur; Guettler, Daniel; Kramer, Stefan; Pivovarov, Misha; Weissleder, Ralph

Note: Order does not necessarily reflect citation order of authors.

Citation: Duchrow, Timo, Timur Shtatland, Daniel Guettler, Misha Pivovarov, Stefan Kramer, and Ralph Weissleder. 2009. Enhancing navigation in biomedical databases by community voting and database-driven text classification. BMC Bioinformatics 10:317.
Full Text & Related Files:
Abstract: Background: The breadth of biological databases and their information content continues to increase exponentially. Unfortunately, our ability to query such sources is still often suboptimal. Here, we introduce and apply community voting, database-driven text classification, and visual aids as a means to incorporate distributed expert knowledge, to automatically classify database entries and to efficiently retrieve them. Results: Using a previously developed peptide database as an example, we compared several machine learning algorithms in their ability to classify abstracts of published literature results into categories relevant to peptide research, such as related or not related to cancer, angiogenesis, molecular imaging, etc. Ensembles of bagged decision trees met the requirements of our application best. No other algorithm consistently performed better in comparative testing. Moreover, we show that the algorithm produces meaningful class probability estimates, which can be used to visualize the confidence of automatic classification during the retrieval process. To allow viewing long lists of search results enriched by automatic classifications, we added a dynamic heat map to the web interface. We take advantage of community knowledge by enabling users to cast votes in Web 2.0 style in order to correct automated classification errors, which triggers reclassification of all entries. We used a novel framework in which the database "drives" the entire vote aggregation and reclassification process to increase speed while conserving computational resources and keeping the method scalable. In our experiments, we simulate community voting by adding various levels of noise to nearly perfectly labelled instances, and show that, under such conditions, classification can be improved significantly. Conclusion: Using PepBank as a model database, we show how to build a classification-aided retrieval system that gathers training data from the community, is completely controlled by the database, scales well with concurrent change events, and can be adapted to add text classification capability to other biomedical databases. The system can be accessed at .
Published Version: doi:10.1186/1471-2105-10-317
Other Sources: http://www.ncbi.nlm.nih.gov/pmc/articles/PMC2768718/pdf/
Terms of Use: This article is made available under the terms and conditions applicable to Other Posted Material, as set forth at http://nrs.harvard.edu/urn-3:HUL.InstRepos:dash.current.terms-of-use#LAA
Citable link to this page: http://nrs.harvard.edu/urn-3:HUL.InstRepos:4633725
Downloads of this work:

Show full Dublin Core record

This item appears in the following Collection(s)


Search DASH

Advanced Search