BrainNetDiff: Generative AI Empowers Brain Network Construction Via Multimodal Diffusion

อื่นๆ

ผู้เขียน/บรรณาธิการ

กลุ่มสาขาการวิจัยเชิงกลยุทธ์

รายละเอียดสำหรับงานพิมพ์

รายชื่อผู้แต่ง: Zong Y.; Jing C.; Chan J.H.; Wang S.

ผู้เผยแพร่: IEEE Computer Society

ปีที่เผยแพร่ (ค.ศ.): 2024

ISBN: 979-835031333-8

นอก: 1945-7928

URL: https://www.scopus.com/inward/record.uri?eid=2-s2.0-85203336536&doi=10.1109%2fISBI56570.2024.10635395&partnerID=40&md5=0c3e05c2ceb2c149241a04d6c6dd786b

ภาษา: English-Great Britain (EN-GB)

ดูบนเว็บไซต์ของสำนักพิมพ์

บทคัดย่อ

Brain network analysis has emerged as a pivotal technology for gaining a deeper understanding of brain functions and disease mechanisms. However, existing network construction methods still have shortcomings in the learning of correlations between structural and functional brain imaging. In view of this, we introduce a novel method called BrainNetDiff, which combines a multi-head Transformer encoder to extract relevant features from fMRI and integrates a conditional latent diffusion model for brain network construction. By utilizing the conditional prompt and the attention mechanism, this method improves the accuracy and stability of brain network construction. To our knowledge, this represents the first work that employs diffusion for the fusion of multimodal brain imaging and brain network construction. We validate this framework by constructing brain networks on the public dataset ADNI. Experimental results demonstrate the effectiveness of the proposed method across the downstream disease classification tasks. This research provides a valuable reference for the processing of multimodal brain imaging and introduces a novel solution for brain network construction. © 2024 IEEE.

คำสำคัญ

Attention mechanisms, Diffusion models, Feature extraction, Functional magnetic resonance imaging, Network analyzers, Neuroimaging, Transformers