Image Reconstruction From Human Brain Waves


Hello, hello!


This one's going to sound like it's from a sci-fi movie, if you haven't already heard about it. It's about reconstructing images by reading signals from the human brain! And it is non-invasive!

The study of signals in the human brain (brain waves) using fMRI (functional Magnetic Resonance Imaging or EEG (Electroencephalogram) has been around for some time now. For the first time, image reconstruction from brain waves using A.I techniques is producing decent results. 

The brain-computer interface (BCI) developed by MIPT (Moscow Institute of Physics and Technology) and Neurobotics relies on artificial neural networks and electroencephalography, or EEG, a technique for recording brain waves via electrodes placed noninvasively on the scalp. By analysing brain activity, the system reconstructs the images seen by a person undergoing EEG in real time.

Feel free to skip this bit if you don't need the technicals. The BCI Operation Algorithm laid out in this research performs the following steps: The raw EEG is fed into Feature Extraction module to generate a feature vector. This is sent for EEG feature encoding and after noise modulation, the reconstructed image is generated using Image Decoder. The Image Decoder is part of image-to-image convolutional autoencoder model, based on a pre-trained VGG-11 model.

Operation algorithm of the brain-computer interface (BCI) system. Credit: Anatoly Bobe/Neurobotics, and @tsarcyanide/MIPT Press Office


Take a look at how well the system currently performs. It is a long way from HD resolutions but it does look promising.




My own thoughts on this: While this advancement can help in applications such as post-stroke rehabilitation, one can also imagine a variety of other applications, some scary: mind-reading and telepathy, anyone?

It should be possible, with further refinements, to train a model tailored specifically to an individual and should be possible to record everything they see for later playback! Your eyes become your camera. Is the future going to be camera-less?!


If you would like to know more about this research advancement, please click here.


Comments

Post a Comment

Please let us know what you think!

Popular posts from this blog

Introduction

 Hello Fellow Internet User! How has your day been? If you're like me, you're thinking "Um...good or bad or something in between. It is still a great time to be alive!" Welcome to this blog!  Data Science is everywhere! Because data is everywhere! Data Science is fascinating as it is our very human yearning to know  what all of this data tells us . If not out of curiosity then to find out how those stories can help us in various endeavours. Science and Engineering can also benefit from Data Science, maybe even recursively ;-) This blog is meant to bring together a curated set of advancements on how Data Science has been used to further science and engineering endeavours. Apart from drawing your attention to the substance of these advancements, I shall add my own commentary. Should be a fun ride! Hope you enjoy it! Joie de vivre pour toi! Rahul PS: I am open to comments and suggestions. Please let me know what you think of this blog, its posts or anything else of relev
Read more

Crater Detection

Image
Courtesy: James Stuby (NASA) / Wikimedia Commons A crater is a structure or geological formation that is produced as a result of impact of a smaller body upon a larger heavenly body. Craters are found on all solid heavenly bodies such as Earth, the Moon, Mars, Mercury, Venus etc.  Studying craters is important because they are time capsules to how our Solar System evolved and gives us clues to the past, present and future of the evolution of planetary bodies without humans setting foot on them. Crater densities have been correlated with surface age and crater counts have been used used to estimate the relative age of the lunar surface. There are many other uses to studying craters, so it is important to be able to detect craters quickly in an automated fashion. This research uses a novel method of detecting craters by using multiple co-registered data sources: optical images, digital elevation maps (DEMs) and slope maps of the lunar surface. The method uses a deep learning architecture
Read more

AI Helps find Earth-like Habitable Exo-planets

Image
    (Photo credit: BBC) Are We Alone?  It is a question that humans have had ever since we realized there are other worlds, other planets out there in the cosmos. The implications of the answer to this question are staggering no matter what that answer is. In pursuit of an answer scientists have been searching for planets that could potentially harbor life. Planets that are outside of our solar system are termed Exoplanets. The exploratory pursuit is to find "earth-like" exoplanets because these would have the greatest chance of harboring life as we know it. Determining the habitability of exoplanets is not an easy task. Existing ML methods such as Metric-based quantification (using metrics like surface temperature) or Supervised Learning (based mainly on estimated surface temperature) are not reliable enough.  Astronomers from the Indian Institute of Astrophysics along with astronomers from BITS Pilani and Goa campus designed an anomaly detection method to identify potential
Read more

Contact Me!

Name

Email *

Message *

Search Wikipedia For Anything!

Search results