The Method of Primary Processing of Poorly Structured Medical Data

: pp. 1 - 10
Sumy State University, Department of Computer Science
Sumy State University, Department of Computer Science
Sumy State University, Department of Computer Science

The article deals with the approach to the primary processing of poorly structured medical protocol textual data stored and disseminated as pdf files. The relevance of this work is due to the lack of a universal structure for the presentation of medical protocols and methods of their processing. In the course of the work, the problem of primary processing of clinical protocol data was solved by the example of a unified clinical protocol of primary, secondary (specialized) and tertiary (highly specialized) medical care. The method of primary data processing was developed to create a clear structure of the symptoms of the disease. The first step in structuring clinical protocol data is to divide the protocol information into four basic parts, which allows it to be quickly converted to other formats. This process is implemented using an algorithm developed in C # programming language. The proposed algorithm parses the information from a pdf file and converts it to a txt file. After that, the received information is processed, which consists in the syntactic analysis of the text of the protocol and selection of the structural parts of the protocol corresponding to the headings of the sections: title page; introduction; a list of abbreviations used in the protocol; the main part of the protocol; list of literary sources. The identification of the disease name in the medical protocol is performed by comparing the protocol data and the list of disease names, presented in the world classification MKH-10. The headings “Introduction”, “List of abbreviations used in the protocol” and the main part of the protocol were analyzed and the algorithm for removing uninformed sections from the beginning of the protocol, for example, literature sources, was proposed. An algorithm for finding information in the main part of the medical protocol by processing input data by: tables, diagrams, headings, words, phrases and special symbols are also proposed. As a result of the clinical protocol processing algorithms, a new clinical protocol file is generated, which is three times smaller than the original file. It contains only meaningful information from clinical protocols that will speed up further work on this file, namely its use in medical decision support. The disease card based on a medical protocol in JSON format is presented.

  1. Jensen, K., Soguero-Ruiz, C., Oyvind Mikalsen, K., Lindsetmo, R., Kouskoumvekaki, I., Girolami, M., Augestad, K. M. (2017). Analysis of free text in electronic health records for identification of cancer patient trajectories. Scientific Reports, 7(1). doi:10.1038/srep46226
  2. Kung, R., Ma, A., Dever, J. B., Vadivelu, J., Cherk, E., Koola, J. D., Ho, S. B. (2015). Mo1043 a natural language processing Alogrithm for identification of patients with cirrhosis from electronic medical records. Gastroenterology, 148(4), S-1071-S-1072. doi:10.1016/s0016-5085(15)33662-3
  3. Li, D., Azoulay, P., & Sampat, B. N. (2017). The applied value of public investments in biomedical research. Science, 356(6333), 78-81. doi:10.1126/science.aal0010
  4. Patel, R., Lloyd, T., Jackson, R., Ball, M., Shetty, H., Broadbent, M., Taylor, M. (2015). Mood instability is a common feature of mental health disorders and is associated with poor clinical outcomes. BMJ Open, 5(5), e007504-e007504. doi:10.1136/bmjopen-2014-007504
  5. Wi, C., Sohn, S., Rolfes, M. C., Seabright, A., Ryu, E., Voge, G., Juhn, Y. J. (2017). Application of a natural language processing algorithm to asthma ascertainment. An automated chart review. American Journal of Respiratory and Critical Care Medicine, 196(4), 430-437. doi:10.1164/rccm.201610-2006oc
  6. Afzal, N., Sohn, S., Abram, S., Scott, C. G., Chaudhry, R., Liu, H., Arruda-Olson, A. M. (2017). Mining peripheral arterial disease cases from narrative clinical notes using natural language processing. Journal of Vascular Surgery, 65(6), 1753-1761. doi:10.1016/j.jvs.2016.11.031
  7. O365devx. (n.d.). Working with XML Schemas in InfoPath. Technical documentation, API, and code examples | Microsoft Docs.
  8. The Latest MML (Medical Markup Language) Version 2.3 - XML-Based Standard for Medical Data Exchange/Storage. (n.d.). ResearchGate.
  9. Parsing PDF Files using iTextSharp (C#, .NET). (n.d.). Square PDF .NET.