- Author
-
A. Koroleva
- Title
- Assisted authoring for avoiding inadequate claims in scientific reporting
- Supervisors
-
P.M.M. Bossuyt
P. Paroubek - Award date
- 22 January 2020
- Number of pages
- 215
- ISBN
- 9789083037646
- Document type
- PhD thesis
- Faculty
- Faculty of Medicine (AMC-UvA)
- Abstract
-
In this thesis, we report on our work on developing Natural Language Processing (NLP) algorithms to aid readers and authors of biomedical articles in detecting spin (distorted presentation of research results). We focused on spin in abstracts of articles reporting Randomized Controlled Trials (RCTs). We conducted a linguistic study of spin and created a description of its textual features. We annotated a set of corpora for the key tasks of our spin detection pipeline: extraction of declared (primary) and reported outcomes, assessment of semantic similarity of pairs of trial outcomes, and extraction of relations between reported outcomes and their statistical significance levels. We annotated two smaller corpora for identification of statements of similarity between treatments and of within-group comparisons. We developed a number of rule-based and machine learning algorithms for the key tasks (outcome extraction, outcome similarity assessment, and outcome-significance relation extraction). The best performance was shown by a deep learning approach that consists in fine-tuning deep pre-trained domain-specific language representations (BioBERT and SciBERT models) for downstream tasks. This approach was implemented in our spin detection prototype system, called DeSpin, released as open source code. Our prototype includes some other algorithms, such as text structure analysis (identification of the abstract of an article, identification of sections within the abstract), detection of statements of similarity between treatments and of within-group comparisons, extraction of data from trial registries. Our prototype system includes a simple annotation and visualization interface.
- Persistent Identifier
- https://hdl.handle.net/11245.1/f25c8dc7-3bf3-4fb9-be2d-c456681b4291
- Downloads
Disclaimer/Complaints regulations
If you believe that digital publication of certain material infringes any of your rights or (privacy) interests, please let the Library know, stating your reasons. In case of a legitimate complaint, the Library will make the material inaccessible and/or remove it from the website. Please Ask the Library, or send a letter to: Library of the University of Amsterdam, Secretariat, Singel 425, 1012 WP Amsterdam, The Netherlands. You will be contacted as soon as possible.