Hello. I am working on a project to control a Blender game with an EEG device. Our long term solution is to implement a VRPN client working inside the Blender application so that we can capture input accurately.
However, we need a quick and dirty solution for the time being. An idea we are kicking around is taking the OpenVibe VRPN server output and converting it into keyboard input, which Blender can detect natively.
Does anyone know of a keyboard emulator that can connect to an VRPN server, or how would one go about creating one?
The OS we are working on is Linux.
Keyboard emulator that supports VRPN
Re: Keyboard emulator that supports VRPN
Hi, Jose
I think you have provided too little info
You need to clarify step by step how you imagine the workflow of your application.
Where is the BCI part exactly
Is it a game or more of a practical application? What is your target group?
One possible workflow for EEG speller could be:
1) you use P300 or SSVEP by flashing different parts of the virtual keyboard in Blender
2) then you send to OpenVibe what you flashed and the exact timing (this communication could be in VRPN in general) while you record the EEG in the same time
3) OpenVibe uses the combined data: stimulation data from 2) and the recorded EEG to make decision (using DSP + classification)
4) OpenVibe returns a result through VRPN to Blender. Blender outputs the result in a text field or performs a desired action (opens a door, shoots right, etc)
In my lab we have a game that does that using Ogre 3D. Let me know if you are interested.
Or maybe you mean something much more simple?
There are several tutorials on vrpn in Openvibe:
http://openvibe.inria.fr/vrpn-tutorial- ... o-openvibe
http://openvibe.inria.fr/vrpn-tutorial- ... pplication
I think you have provided too little info
You need to clarify step by step how you imagine the workflow of your application.Where is the BCI part exactly
Is it a game or more of a practical application? What is your target group? One possible workflow for EEG speller could be:
1) you use P300 or SSVEP by flashing different parts of the virtual keyboard in Blender
2) then you send to OpenVibe what you flashed and the exact timing (this communication could be in VRPN in general) while you record the EEG in the same time
3) OpenVibe uses the combined data: stimulation data from 2) and the recorded EEG to make decision (using DSP + classification)
4) OpenVibe returns a result through VRPN to Blender. Blender outputs the result in a text field or performs a desired action (opens a door, shoots right, etc)
In my lab we have a game that does that using Ogre 3D. Let me know if you are interested.
Or maybe you mean something much more simple?
There are several tutorials on vrpn in Openvibe:
http://openvibe.inria.fr/vrpn-tutorial- ... o-openvibe
http://openvibe.inria.fr/vrpn-tutorial- ... pplication
Re: Keyboard emulator that supports VRPN
Hello Jose,
I do not know about a method to convert VRPN to keyboard stimulations, however I am aware that VRPN interface with blender engine was already implemented. ( here is a demo : http://www.youtube.com/watch?v=qr6XfbeYDFA ). I do not know whether the developers of this software are still active though.
You could try an utility like xdotool to send keyboard input to an application (I have never used it but it is worth a shot) : http://stackoverflow.com/questions/3792 ... mmand-line
Cheers
Jozef
I do not know about a method to convert VRPN to keyboard stimulations, however I am aware that VRPN interface with blender engine was already implemented. ( here is a demo : http://www.youtube.com/watch?v=qr6XfbeYDFA ). I do not know whether the developers of this software are still active though.
You could try an utility like xdotool to send keyboard input to an application (I have never used it but it is worth a shot) : http://stackoverflow.com/questions/3792 ... mmand-line
Cheers
Jozef