发表于: 2018/12/03 21:16 | 作者: NICA

NICA课题组1篇论文被国际顶级期刊IEEE  Transactions on Neural Networks and Learning Systems  (TNNLS,JCR一区,IF=7.982) 录用。

此次被接受论文的第一作者为杜长德同学, 论文标题为《Reconstructing Perceived Images from Human Brain Activities with Bayesian Deep Multi-view Learning》。

针对基于fMRI数据的视觉神经信息编解码问题, 作者提出了统一的多视图深度生成式模型,为基于大脑信号的视觉图像重建问题提供了有效的解决方案。以下为论文摘要:

Neural decoding, which aims to predict external visual stimuli information from evoked brain activities, plays an important role in understanding human visual system. Many existing methods are based on linear models, and most of them only focus on either the brain activity pattern classification or visual stimuli identification. Accurate reconstruction of the perceived images from the measured human brain activities still remains challenging. In this paper, we propose a novel deep generative multi-view model (DGMM) for the accurate visual image reconstruction from the human brain activities  measured by functional magnetic resonance imaging (fMRI). Specifically, we model the statistical relationships between two views (i.e., the visual stimuli and the evoked fMRI) by using two view-specific generators with a shared latent space. On the one hand, we adopt a deep neural network architecture for visual image generation, which mimics the stages of human visual processing. On the other hand, we design a sparse Bayesian linear model for fMRI activity generation, which can effectively capture voxel correlations, suppress data noise and avoid overfitting. Furthermore, we devise an efficient mean-field variational inference method to train the proposed model. The proposed method can accurately reconstruct visual images via Bayesian inference. In particular, we exploit a posterior regularization technique in the Bayesian inference to regularize the model posterior. The quantitative and qualitative evaluations conducted on multiple fMRI datasets demonstrate the proposed method can reconstruct visual images more accurately than the state-of-the-art.

论文链接:https://ieeexplore.ieee.org/document/8574054