Document Type
Article
Publication Date
7-12-2021
Publication Title
Bioinformatics (Oxford, England)
Keywords
JMG, Biomedical Research, Databases, Factual
JAX Source
Bioinformatics 2021 Jul 12; 37(Suppl 1):i468-i476
Volume
37
Issue
Suppl_1
First Page
468
Last Page
468
ISSN
1367-4811
PMID
34252939
DOI
https://doi.org/10.1093/bioinformatics/btab331
Abstract
MOTIVATION: Biomedical research findings are typically disseminated through publications. To simplify access to domain-specific knowledge while supporting the research community, several biomedical databases devote significant effort to manual curation of the literature-a labor intensive process. The first step toward biocuration requires identifying articles relevant to the specific area on which the database focuses. Thus, automatically identifying publications relevant to a specific topic within a large volume of publications is an important task toward expediting the biocuration process and, in turn, biomedical research. Current methods focus on textual contents, typically extracted from the title-and-abstract. Notably, images and captions are often used in publications to convey pivotal evidence about processes, experiments and results.
RESULTS: We present a new document classification scheme, using both image and caption information, in addition to titles-and-abstracts. To use the image information, we introduce a new image representation, namely Figure-word, based on class labels of subfigures. We use word embeddings for representing captions and titles-and-abstracts. To utilize all three types of information, we introduce two information integration methods. The first combines Figure-words and textual features obtained from captions and titles-and-abstracts into a single larger vector for document representation; the second employs a meta-classification scheme. Our experiments and results demonstrate the usefulness of the newly proposed Figure-words for representing images. Moreover, the results showcase the value of Figure-words, captions and titles-and-abstracts in providing complementary information for document classification; these three sources of information when combined, lead to an overall improved classification performance.
AVAILABILITY AND IMPLEMENTATION: Source code and the list of PMIDs of the publications in our datasets are available upon request.
Recommended Citation
Li, Pengyuan; Jiang, Xiangying; Zhang, Gongbo; Trabucco, Juan Trelles; Raciti, Daniela; Smith, Cynthia; Ringwald, Martin; Marai, G Elisabeta; Arighi, Cecilia; and Shatkay, Hagit, "Utilizing image and caption information for biomedical document classification." (2021). Faculty Research 2021. 158.
https://mouseion.jax.org/stfb2021/158
Comments
This is an Open Access article distributed under the terms of the Creative Commons Attribution License.