Brain Computer Interfaces (BCIs) use information of brain activity for communication and control. Pure BCIs often suffer from lack of accuracy in control, long training period in adaptability and other shortcomings. Hybrid systems that incorporate other sensing modalities for better robot control have been studied to solve these problems. We designed a hybrid BCI system by gathering neural, behavioral and contextual cues, and combining them according to a statistical model. Different cues are integrated to predict the subject’s intention. With the extracted environmental information by a camera-robot system, the decision derived by the hybrid BCI is used to control a robot to perform goal-oriented tasks. Experiments are performed both in both a virtual test environment and using a real...[ Read more ]

Brain Computer Interfaces (BCIs) use information of brain activity for communication and control. Pure BCIs often suffer from lack of accuracy in control, long training period in adaptability and other shortcomings. Hybrid systems that incorporate other sensing modalities for better robot control have been studied to solve these problems. We designed a hybrid BCI system by gathering neural, behavioral and contextual cues, and combining them according to a statistical model. Different cues are integrated to predict the subject’s intention. With the extracted environmental information by a camera-robot system, the decision derived by the hybrid BCI is used to control a robot to perform goal-oriented tasks. Experiments are performed both in both a virtual test environment and using a real robot. The hybrid model improves the task completion accuracy, reduces task completion time and makes better predictions on the subject’s intent. In comparison to other hybrid BCI systems, where gaze information was used to determine high level control tasks, in our BCI system, gaze information modulates the probability that different low level motion commands will be selected. This enables subjects to exert more precise control over the motion trajectory.

Keywords: Hybrid Brain Computer Interface, contextual cues, Bayesian inference, intent