Programmable synthetic hallucinations : towards a boundless mixed reality

Thesis: Ph. D., Massachusetts Institute of Technology, School of Architecture and Planning, Program in Media Arts and Sciences, 2019 === Cataloged from PDF version of thesis. "June 2019." Vita. === Includes bibliographical references (pages 118-122). === Programmable Synthetic Hallucinatio...

Full description

Bibliographic Details
Main Author: Novy, Daniel E.(Daniel Edward)
Other Authors: V. Michael Bove, Jr.
Format: Others
Language:English
Published: Massachusetts Institute of Technology 2020
Subjects:
Online Access:https://hdl.handle.net/1721.1/123629
id ndltd-MIT-oai-dspace.mit.edu-1721.1-123629
record_format oai_dc
spelling ndltd-MIT-oai-dspace.mit.edu-1721.1-1236292020-01-25T03:13:37Z Programmable synthetic hallucinations : towards a boundless mixed reality Novy, Daniel E.(Daniel Edward) V. Michael Bove, Jr. Program in Media Arts and Sciences (Massachusetts Institute of Technology) Program in Media Arts and Sciences (Massachusetts Institute of Technology) Program in Media Arts and Sciences Thesis: Ph. D., Massachusetts Institute of Technology, School of Architecture and Planning, Program in Media Arts and Sciences, 2019 Cataloged from PDF version of thesis. "June 2019." Vita. Includes bibliographical references (pages 118-122). Programmable Synthetic Hallucinations describe the utilization of the bio-physiological mechanics of hallucination generated in the human brain to display virtual information directly in the visual field. Science fiction films, television shows, and video games have trained audiences to think of holograms as luminous volumetric images that float registered in the viewer's 3D space and require no special glasses or optics to see or interact with them. The ability of users to interact with a floating aerial lightfield without the use of face-worn binocular optics is a difficult challenge and one in which a hallucinatory experience offers a solution. While we do not have the ability to activate individual neurons to recreate an neuro-electrical pattern indiscernible from the perception of reality, this dissertation shows that creating phosphenes within the visual field via the magnetic stimulation of neurons in the visual cortex is a viable first step. By electrically stimulating the cells in the hypercolumns of V1, one can induce the perception of a pixel of light within the visual field of a user. These magnetophosphenes are visual perceptions described as luminous shapes, which can be created by time-varying magnetic fields. These change the membrane potential and trigger an action potential directly in neurons of the visual cortex. Previous TMS studies have shown evocation of phosphenes in a binary manner, with subjects reporting the presence or absence of a phosphene but not targeted to a specific location. However, to date, no information or example has been found indicating the use of cortical phosphenes, induced magnetically or otherwise, in performance or public display. Presently, commercial transcranial magnetic stimulators can only be focused to an area approaching one square centimeter, a single output channel, and require manual placement of the coil apparatus. Novel coil designs became a central focus of this research. Further work increased the number of output channels, embedding them in a wearable apparatus with a multichannel array of induction coils. Clinical trials were undertaken at MIT's Clinical Research Center. We were able to evoke visual phenomena in 11 out of 16 test subjects in a known, targeted location. The induced magnetophosphenes were noted above the noise floor of naturally occurring retinal phosphenes and were statistically verified to be a result of the system being tested. by Daniel Edward Novy. Ph. D. Ph.D. Massachusetts Institute of Technology, School of Architecture and Planning, Program in Media Arts and Sciences 2020-01-23T17:01:30Z 2020-01-23T17:01:30Z 2019 Thesis https://hdl.handle.net/1721.1/123629 1136158784 eng MIT theses are protected by copyright. They may be viewed, downloaded, or printed from this source but further reproduction or distribution in any format is prohibited without written permission. http://dspace.mit.edu/handle/1721.1/7582 157 pages application/pdf Massachusetts Institute of Technology
collection NDLTD
language English
format Others
sources NDLTD
topic Program in Media Arts and Sciences
spellingShingle Program in Media Arts and Sciences
Novy, Daniel E.(Daniel Edward)
Programmable synthetic hallucinations : towards a boundless mixed reality
description Thesis: Ph. D., Massachusetts Institute of Technology, School of Architecture and Planning, Program in Media Arts and Sciences, 2019 === Cataloged from PDF version of thesis. "June 2019." Vita. === Includes bibliographical references (pages 118-122). === Programmable Synthetic Hallucinations describe the utilization of the bio-physiological mechanics of hallucination generated in the human brain to display virtual information directly in the visual field. Science fiction films, television shows, and video games have trained audiences to think of holograms as luminous volumetric images that float registered in the viewer's 3D space and require no special glasses or optics to see or interact with them. The ability of users to interact with a floating aerial lightfield without the use of face-worn binocular optics is a difficult challenge and one in which a hallucinatory experience offers a solution. While we do not have the ability to activate individual neurons to recreate an neuro-electrical pattern indiscernible from the perception of reality, this dissertation shows that creating phosphenes within the visual field via the magnetic stimulation of neurons in the visual cortex is a viable first step. === By electrically stimulating the cells in the hypercolumns of V1, one can induce the perception of a pixel of light within the visual field of a user. These magnetophosphenes are visual perceptions described as luminous shapes, which can be created by time-varying magnetic fields. These change the membrane potential and trigger an action potential directly in neurons of the visual cortex. Previous TMS studies have shown evocation of phosphenes in a binary manner, with subjects reporting the presence or absence of a phosphene but not targeted to a specific location. However, to date, no information or example has been found indicating the use of cortical phosphenes, induced magnetically or otherwise, in performance or public display. Presently, commercial transcranial magnetic stimulators can only be focused to an area approaching one square centimeter, a single output channel, and require manual placement of the coil apparatus. === Novel coil designs became a central focus of this research. Further work increased the number of output channels, embedding them in a wearable apparatus with a multichannel array of induction coils. Clinical trials were undertaken at MIT's Clinical Research Center. We were able to evoke visual phenomena in 11 out of 16 test subjects in a known, targeted location. The induced magnetophosphenes were noted above the noise floor of naturally occurring retinal phosphenes and were statistically verified to be a result of the system being tested. === by Daniel Edward Novy. === Ph. D. === Ph.D. Massachusetts Institute of Technology, School of Architecture and Planning, Program in Media Arts and Sciences
author2 V. Michael Bove, Jr.
author_facet V. Michael Bove, Jr.
Novy, Daniel E.(Daniel Edward)
author Novy, Daniel E.(Daniel Edward)
author_sort Novy, Daniel E.(Daniel Edward)
title Programmable synthetic hallucinations : towards a boundless mixed reality
title_short Programmable synthetic hallucinations : towards a boundless mixed reality
title_full Programmable synthetic hallucinations : towards a boundless mixed reality
title_fullStr Programmable synthetic hallucinations : towards a boundless mixed reality
title_full_unstemmed Programmable synthetic hallucinations : towards a boundless mixed reality
title_sort programmable synthetic hallucinations : towards a boundless mixed reality
publisher Massachusetts Institute of Technology
publishDate 2020
url https://hdl.handle.net/1721.1/123629
work_keys_str_mv AT novydanieledanieledward programmablesynthetichallucinationstowardsaboundlessmixedreality
_version_ 1719309418666917888