Image Reconstruction From Human Brain Waves


Hello, hello!


This one's going to sound like it's from a sci-fi movie, if you haven't already heard about it. It's about reconstructing images by reading signals from the human brain! And it is non-invasive!

The study of signals in the human brain (brain waves) using fMRI (functional Magnetic Resonance Imaging or EEG (Electroencephalogram) has been around for some time now. For the first time, image reconstruction from brain waves using A.I techniques is producing decent results. 

The brain-computer interface (BCI) developed by MIPT (Moscow Institute of Physics and Technology) and Neurobotics relies on artificial neural networks and electroencephalography, or EEG, a technique for recording brain waves via electrodes placed noninvasively on the scalp. By analysing brain activity, the system reconstructs the images seen by a person undergoing EEG in real time.

Feel free to skip this bit if you don't need the technicals. The BCI Operation Algorithm laid out in this research performs the following steps: The raw EEG is fed into Feature Extraction module to generate a feature vector. This is sent for EEG feature encoding and after noise modulation, the reconstructed image is generated using Image Decoder. The Image Decoder is part of image-to-image convolutional autoencoder model, based on a pre-trained VGG-11 model.

Operation algorithm of the brain-computer interface (BCI) system. Credit: Anatoly Bobe/Neurobotics, and @tsarcyanide/MIPT Press Office


Take a look at how well the system currently performs. It is a long way from HD resolutions but it does look promising.




My own thoughts on this: While this advancement can help in applications such as post-stroke rehabilitation, one can also imagine a variety of other applications, some scary: mind-reading and telepathy, anyone?

It should be possible, with further refinements, to train a model tailored specifically to an individual and should be possible to record everything they see for later playback! Your eyes become your camera. Is the future going to be camera-less?!


If you would like to know more about this research advancement, please click here.


Comments

Post a Comment

Please let us know what you think!

Popular posts from this blog

Introduction

 Hello Fellow Internet User! How has your day been? If you're like me, you're thinking "Um...good or bad or something in between. It is still a great time to be alive!" Welcome to this blog!  Data Science is everywhere! Because data is everywhere! Data Science is fascinating as it is our very human yearning to know  what all of this data tells us . If not out of curiosity then to find out how those stories can help us in various endeavours. Science and Engineering can also benefit from Data Science, maybe even recursively ;-) This blog is meant to bring together a curated set of advancements on how Data Science has been used to further science and engineering endeavours. Apart from drawing your attention to the substance of these advancements, I shall add my own commentary. Should be a fun ride! Hope you enjoy it! Joie de vivre pour toi! Rahul PS: I am open to comments and suggestions. Please let me know what you think of this blog, its posts or anything else of relev...
Read more

Crater Detection

Image
Courtesy: James Stuby (NASA) / Wikimedia Commons A crater is a structure or geological formation that is produced as a result of impact of a smaller body upon a larger heavenly body. Craters are found on all solid heavenly bodies such as Earth, the Moon, Mars, Mercury, Venus etc.  Studying craters is important because they are time capsules to how our Solar System evolved and gives us clues to the past, present and future of the evolution of planetary bodies without humans setting foot on them. Crater densities have been correlated with surface age and crater counts have been used used to estimate the relative age of the lunar surface. There are many other uses to studying craters, so it is important to be able to detect craters quickly in an automated fashion. This research uses a novel method of detecting craters by using multiple co-registered data sources: optical images, digital elevation maps (DEMs) and slope maps of the lunar surface. The method uses a deep learning architec...
Read more

AI can help predict Skin Cancer Recurrence

  Hello! Today we have an entry in the field of medicine. What is skin cancer recurrence? An early-stage skin cancer type called  melanoma  is treatable if diagnosed early enough. Most melanoma deaths in the US occur because of recurrence of the disease which was early stage at the time of diagnosis. However, recurrence is not detected until the cancer starts to spread; called symptomatic metastatic progression. This is where prognostic tools can be helpful for regular surveillance and quick action to stave off mortality and ensure health. Also, identifying high-risk patients can help in determining who should receive special therapies and treatments. Enter Machine Learning. A team led by investigators at Massachusetts General Hospital performed two types Machine Learning prediction with nine different models: Melanoma Recurrence Classification: Where the prediction would be a probability that melanoma recurrence would occur. Time-To-Event Melanoma Recurrence Risk Predict...
Read more

Contact Me!

Name

Email *

Message *

Search Wikipedia For Anything!

Search results