Deep learning is a type of machine learning methods that mimic the way the human brain processes information. The result of deep learning is machines accomplishing things that previously required human intelligence, such as translation between foreign languages, driving a vehicle and facial recognition. Things like Netflix® suggesting what to watch next, an iPhone® unlocking upon sight of its owner's face and Alexa® responding to a vocal request are all results of deep learning. "All missions beyond Earth have a host of instruments that have been designed with specific capabilities to answer specific scientific questions," Muñoz-Jaramillo said. "When we combine them into virtual super instruments, we can produce more cost-effective missions with higher scientific impact or use measurements by one instrument to help answer the science questions of another."
The First Head-Mounted Displays – The Telesphere Mask and the Headsight. You might think that strapping a display on a person’s head is a relatively new idea, but it is not. The first head-mounted displays were developed as early as the 1960s. The Telesphere Mask was the first example of a head-mounted display, which provided 3D stereoscopic and wide vision with stereo sound. However, the device lacked certain immersion, because of it being a non-interactive medium. In 1961 two Philco Corporation engineers, Comeau and Bryan, came up with the Headsight. A head-mounted display, much like the Telesphere Mask, the Headsight featured magnetic motion tracking technology, which was connected to a close circuit camera. While the goggles can be named a precursor to modern virtual reality technology, they were not developed for entertainment purposes. Instead, they were developed for the military with the idea that a person would be able to immerse themselves in the remote viewing of dangerous situations.
Muñoz-Jaramillo stresses in the study that these virtual super instruments will not make hardware obsolete. They will always require a spacecraft to collect the necessary data for virtualization."Deep learning instruments cannot make something out of nothing, but they can significantly enhance the capabilities of existing technology," he said.
Their virtual super instrument is already in use as part of a Frontier Development Laboratory project for forecasting ionospheric disturbances. Muñoz-Jaramillo is currently working on additional super instruments that combine other capabilities.
How VR is empowering disabled musicians
"In essence, deep learning involves sophisticated transformation of data," he said. "We can make these transformations into scientifically useful data and modernize the way we view not just the Sun, but a great number of scientific questions."