Application of multimodal data fusion and intelligent classification in medical coding with the MCoder-T model
Yisheng Li, Jie Zhao, Xinmei Li, Shanxiong Liang, Yihui Tang

TL;DR
The MCoder-T model improves medical coding by combining text, images, and structured data, leading to better accuracy and automation.
Contribution
The novel MCoder-T model introduces causal-to-mask attention mechanisms and multi-task learning for enhanced medical coding.
Findings
MCoder-T outperforms traditional methods in case coding accuracy and productivity.
The model integrates multimodal data effectively, showing reliable adaptability.
It achieves a productivity improvement of 7% to 18% in medical coding tasks.
Abstract
Assigning case codes is a complex problem in medical data processing, which includes multimodal data fusion and intellectual classification. Traditional case coding methods often have difficulties in managing different data sources and the complexity of the content of cases. This limits their effectiveness in actual application. To solve this problem, we propose the MCoder-T model, an intelligent case coding model, causal-to-mask attention mechanisms, integrated multimodal integration, and multi-task learning optimization. MCoder-T effectively improves case coding automation and classification accuracy by integrating text, medical images, and structured data. Experimental results show that the MCoder-T model outperforms traditional methods and other progressive models by several evaluation indicators, with an overall productivity improvement of 7% to 18%. The MCoder-T model enhances the…
Genes, proteins, chemicals, diseases, species, mutations and cell lines named across the full text — each resolved to its canonical identifier and authoritative record.
Click any figure to enlarge with its caption.
Figure 1
Figure 2
Figure 3
Figure 4
Figure 5
Figure 6
Figure 7
Figure 8
Figure 9
Figure 10
Figure 11
Figure 12
Figure 13
Figure 14
Figure 15
Figure 16
Figure 17
Figure 18
Figure 19
Figure 20
Figure 21
Figure 22
Figure 23
Figure 24
Figure 25
Figure 26
Figure 27
Figure 28
Figure 29
Figure 30
Figure 31
Figure 32
Figure 33
Figure 34
Figure 35
Figure 36
Figure 37
Figure 38
Figure 39Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsMachine Learning in Healthcare · Machine Learning and Data Classification · Advanced Data and IoT Technologies
