real-time decision fusion for multimodal neural prosthetic devices实时决策融合多通道神经假体设备.pdfVIP

Real-Time Decision Fusion for Multimodal Neural Prosthetic Devices 1 2 2 2 James Robert White *, Todd Levy , William Bishop , James D. Beaty 1 Applied Mathematics and Scientific Computation Program, University of Maryland – College Park, College Park, Maryland, United States of America, 2 The Johns Hopkins University Applied Physics Laboratory, Laurel, Maryland, United States of America Abstract Background: The field of neural prosthetics aims to develop prosthetic limbs with a brain-computer interface (BCI) through which neural activity is decoded into movements. A natural extension of current research is the incorporation of neural activity from multiple modalities to more accurately estimate the user’s intent. The challenge remains how to appropriately combine this information in real-time for a neural prosthetic device. Methodology/Principal Findings: Here we propose a framework based on decision fusion, i.e., fusing predictions from several single-modality decoders to produce a more accurate device state estimate. We examine two algorithms for continuous variable decision fusion: the Kalman filter and artificial neural networks (ANNs). Using simulated cortical neural spike signals, we implemented several successful individual neural decoding algorithms, and tested the capabilities of each fusion method in the context of decoding 2-dimensional endpoint trajectories of a neural prosthetic arm. Extensively testing these methods on random trajectories, we find that on average both the Kalman filter and ANNs successfully fuse the individual decoder estimates to produce more accurate predictions. Conclusions: Our results reveal that a fusion-based approach has the potential to improve prediction accuracy over individual