基于扩张残差注意力网络的颞下颌关节区多模态影像融合
DOI:
作者:
作者单位:

1.北京科技大学自动化学院仪器系;2.中日友好医院口腔中心;3.北京科技大学北京市工业波谱成像工程技术研究中心·

作者简介:

通讯作者:

中图分类号:

基金项目:

面向颞下颌关节病临床诊疗的多模态影像混合现实技术及装备研发


Multimodal Image Fusion of Temporomandibular Joint Area Based on Dilated Residual Attention Network
Author:
Affiliation:

1.Department of Instrument , School of Automation, University of Science and Technology Beijing;2.China-Japan Friendship Hospital Stomatology Center

Fund Project:

Research and development of multi-modal image mixed reality technology and equipment for clinical diagnosis and treatment of temporomandibular joint disease

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    目的: 探讨应用扩张残差注意力网络方法,构建颞下颌关节区多模态融合影像,为提高口腔颞下颌关节多模态融合影像下的综合诊疗能力提供可行性分析。方法: 使用扩张残差注意力网络提取MRI和CBCT的影像特征,使用“softmax加权策略”融合特征,再通过影像重建模块将对应的两种模态的影像融合在一起。结果: 融合图像可呈现出髁状突皮质骨、髁状突髓质骨、髁状突附丽的肌肉、关节盘四个部位的形态,在峰值信噪比和结构相似度两个评价指标上均表现良好,峰值信噪比范围是[10,15],结构相似度范围是[0.4,0.6]。结论: 该方法能做到实时影像融合,最终融合图像可反映出清晰的解剖形态特征,避免多模态影像切换,为口腔专家术前术后临床诊断提供有效的指导。

    Abstract:

    Objective: This paper explores the application of the extended residual attention network method to construct multi-modal fusion images of the mandibular joint area, and provides inspiratory analysis to improve the comprehensive diagnosis and treatment capabilities of multi-modal fusion images of the oral and mandibular joint areas. Methods: Use the dilated residual attention network to extract image features of MRI and CBCT, use the "softmax weighting strategy" to fuse the features, and then use the image reconstruction module to fuse the corresponding images of the two modalities together. Results: The final fusion image can show the shape of condylar cortical bone, condylar medullary bone, condylar attached muscles and articular disc. In terms of the two evaluation indicators of peak signal-to-noise ratio and structural similarity, it performed well, with the peak signal-to-noise ratio range being [10,15] and the structural similarity range being [0.4,0.6]. Conclusion: This method can achieve real-time image fusion, the final fused image can reflect clear anatomical morphological features, avoid multi-modal image switching, and provide effective guidance for dental experts in preoperative and postoperative clinical diagnosis.

    参考文献
    相似文献
    引证文献
引用本文
分享
文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:2024-01-31
  • 最后修改日期:2024-03-21
  • 录用日期:2024-06-05
  • 在线发布日期:
  • 出版日期:
通知关闭
郑重声明