法医学杂志

法医学杂志 ›› 2026, Vol. 42 ›› Issue (2): 102-111.DOI: 10.12116/j.issn.1004-5619.2025.451106

• 论著 • 上一篇    下一篇

法医病理多模态数据库构建与模型增强式检索的实现

秦豪杰1(), 付恩浩1,2, 杨永超1,2, 刘雅雯2,3, 贾明珠2,4, 田志岭2, 郑哲1, 郭思云5(), 刘宁国2()   

  1. 1.河南科技大学基础医学与法医学院 特种医学研究院 司法鉴定中心，河南 洛阳 471000
    2.司法鉴定科学研究院 上海市法医学重点实验室 司法部司法鉴定重点实验室 上海市司法鉴定专业技术服务平台，上海 200063
    3.山西医科大学法医学院，山西 晋中 030600
    4.郑州大学基础医学院病理学与法医学系，河南 郑州 450001
    5.广东南天司法鉴定所，广东 深圳 518033
  • 收稿日期:2025-11-16 发布日期:2026-07-08 出版日期:2026-04-25
  • 通讯作者: 郭思云,刘宁国
  • 作者简介:秦豪杰（1978—），男，副教授，硕士研究生导师，主要从事法医病理学、法医临床学教学、科研和鉴定；E-mail：herochin@ haust.edu.cn
  • 基金资助:
    广东省证据材料司法鉴定（南天）工程技术研究中心2025年度开放课题基金项目(ETRC202502);中央级公益性科研院所专项(GY2024D-1);中央级公益性科研院所专项(GY2024Z-1);上海市法医学重点实验室资助项目(21DZ2270800);河南省自然科学基金项目(252300420591)

Construction of a Multimodal Forensic Pathology Database and Implementation of Model-Augmented Retrieval

Haojie QIN1(), Enhao FU1,2, Yongchao YANG1,2, Yawen LIU2,3, Mingzhu JIA2,4, Zhiling TIAN2, Zhe ZHENG1, Siyun GUO5(), Ningguo LIU2()   

  1. 1.College of Basic Medicine and Forensic Medicine, Henan University of Science and Technology, Institute of Medical Aspects of Specific Environments, Judicial Expertise Center, Luoyang 471000, Henan Province, China
    2.Shanghai Key Laboratory of Forensic Medicine, Key Laboratory of Forensic Science, Ministry of Justice, Shanghai Forensic Service Platform, Academy of Forensic Science, Shanghai 200063, China
    3.School of Forensic Medicine, Shanxi Medical University, Jinzhong 030600, Shanxi Province, China
    4.Department of Pathology and Forensic Medicine, School of Basic Medical Sciences, Zhengzhou University, Zhengzhou 450001, China
    5.Guangdong Nantian Institute of Forensic Science, Shenzhen 518003, Guangdong Province, China
  • Received:2025-11-16 Online:2026-07-08 Published:2026-04-25
  • Contact: Siyun GUO, Ningguo LIU

RichHTML

2

PDF (PC)

83

补充材料

1

摘要：

目的 基于人工智能技术构建法医病理多模态数据库系统，并探索预训练模型在多模态数据库中集成的应用方法。 方法 系统采用MySQL、Redis和OSS的混合式存储架构管理经脱敏处理后的多模态数据。通过光学字符识别（optical character recognition，OCR）和自然语言处理（natural language processing，NLP）技术对数据录入过程进行优化，根据余弦距离、字符错误率和词错误率评估并优化OCR性能以满足实际业务需求。基于ChatGLM3-6B模型和检索增强生成（retrieval-augmented generation，RAG）技术构建智能检索模型，并采用精确率（Precision@K）、召回率（Recall@K）、折损累积增益（discounted cumulative gain，DCG）和归一化折损累积增益（normalized discounted cumulative gain，NDCG）等排名指标评估模型性能。 结果 数据库基准性能良好，单个查询条件的响应时间控制在150 ms内，多个查询条件在2 s内，平均磁盘读取吞吐量为950 MB/s，并发性能测试中数据库吞吐量最高可达1 200每秒查询率（queries per second，QPS），能够承担多模态数据管理的需求。OCR结果显示，系统识别精度较高；在文档质量较高时，余弦距离、字符错误率和词错误率分别达到0.02、1.5%、3.2%。智能检索结果显示，Precision@K维持在较高水平（0.69~1.00），NDCG值均保持在0.87以上；K=100时，所有查询的NDCG均超过0.95，达到预期要求。 结论 所构建的法医病理多模态数据库具有较好的稳定性和运行效率，能够满足法医日常工作中对多模态数据存储和管理分析的需求。基于预训练的大语言模型的智能检索功能可用于鉴定文书的对话式信息检索，为多模态数据库的管理分析提供新的途径。

关键词: 法医病理学, 多模态数据, 数据库, 人工智能, 大语言模型, 信息检索

Abstract:

Objective To construct a multimodal forensic pathology database based on artificial intelligence （AI） technology and explore methods for integrating pre-trained models into multimodal databases. Methods A hybrid storage architecture consisting of MySQL, Redis and OSS was employed to manage desensitized multimodal data. Data entry was optimized using optical character recognition （OCR） and natural language processing （NLP） technologies. OCR performance was evaluated and optimized using cosine distance, character error rate （CER）, and word error rate （WER） to meet practical operational requirements. An intelligent retrieval model was developed using the ChatGLM3-6B model and retrieval-augmented generation （RAG） technology. Model performance was evaluated using ranking metrics including Precision@K, Recall@K, discounted cumulative gain （DCG）, and normalized discounted cumulative gain （NDCG）. Results The database demonstrated satisfactory baseline performance. The response times were maintained within 150 ms for single-query condition and within 2 s for multiple-query conditions. The average disk read throughput reached 950 MB/s. In concurrent performance tests, the database achieved a maximum throughput of 1 200 queries per second （QPS）, meeting multimodal data management demands. OCR evaluation showed high recognition accuracy; for high-quality documents, the cosine distance, CER, and WER achieved 0.02, 1.5%, and 3.2%, respectively. Intelligent retrieval results indicated that Precision@K remained consistently high （0.69-1.00）, while NDCG values remained above 0.87 for all evaluations. When K=100, the NDCG surpassed 0.95 for all queries, meeting expected performance requirements. Conclusion The multimodal forensic pathology database constructed in this study demonstrates good stability and operational efficiency and can meet the requirements of routine forensic practice for multimodal data storage, management, and analysis. The intelligent retrieval capabilities, based on pre-trained large language models （LLMs）, can be applied to conversational information retrieval from forensic reports and related documents, providing a novel approach to the management and analysis of multimodal databases.

Key words: forensic pathology, multimodal data, database, artificial intelligence （AI）, large language model （LLM）, information retrieval

中图分类号: