Advancing Attention Control Using VR-Induced Multimodal Artificial Synesthesia

This paper is an interdisciplinary study of novel applications of techniques and tools of an area of brain science, known as Synesthesia (involving associations and/or confusion between distinct senses), to area of Computer Science known as Immersive Virtual Reality (VR), that makes the subject’s awareness of physical self be diminished by being surrounded in an engrossing artificial environment. Natural Synesthesia has for the last decade been an important emerging area in brain science but is present in only a small proportion of the population. For example a person with Natural Synesthesia, when viewing a grapheme, may perceive a color additionally to be associated to the grapheme. In contrast, Artificial synesthesia (also known as virtual synesthesia or synthetic synesthesia) has been defined as the sensory joining due a cross-modal mapping device, where information of one sense is accompanied by an induced perception in another sense. In particular, we propose use of a multimodal manner of displaying information in VR to increase and concentrate attention. Artificial Synesthesia to synthetically create induced associations between senses, allowing Artificial Synesthesia to be experienced by anyone using a VR system. The paper describes the enhancement of immersive VR by use of Artificial Synesthesia to improve the system’s performance at steering and directing the attention of the user. We describe techniques for an enhanced immersive VR that displays associations between a variety of senses: between colors and characters, also between colors and sounds, and between sounds and the position of tactile sensations. The sense association provided by Artificial Synesthesia allows the system to better capture the user’s attention and better direct that attention. A major application of our work in VR-induced Artificial Synesthesia is to provide an enhanced methodology for controlling the attention of the subject, and to improve the direction of attention of subjects undergoing guided imagery therapies for pain relief. Other potential high-impact applications include improved immersive VR, more programmable human/computer interfaces and other medical therapies.

certain patterns or objects, due to the sensory associations (e.g., colored graphemes) that highlight the objects.Hence Natural Synesthesia provides a unique opportunity for enhancing certain perceptions.
However Natural Synesthesia is present in only a small proportion of the population.
Our work is motivated by some interesting properties of Natural Synesthesia: (a) It appears in some cases to initially occur early in the maturation process, (b) It appears to be affected by certain drugs and hormones, (c) It appears to have a genetic component.
Neural plasticity is a general term for the ability of the Brain to change dynamically.These properties (a)-(c) point to the possibility that Natural Synesthesia might be actually a byproduct of neural plasticity.The enhanced neural plasticity that is known to occur during maturation, appears to sometimes cause Synesthesia.Also the neural plasticity induced by various drugs and hormones can induce Synesthesia.

I.6 Artificial Synesthesia generated by VR: Inducing Synesthesia in Mature Individuals without the use of Drugs or Harmones
Neural plasticity is now known to occur in fully mature individuals as well, even without use of drugs or hormone.A small number of studies have demonstrated that one can induce Synesthesia via training, perhaps this is due to the subjects' neural plasticity.
Artificial Synesthesia (also known as Synthetic Synesthesia) is associations between senses created synthetically, for example use of VR to display Synesthesia associations between distinct senses.Natural Synesthesia has for the last decade been an important emerging area in brain science; we feel Artificial Synesthesia could have similarly important applications to VR.
While Natural Synesthesia is present in only a small proportion of the population, in contrast Artificial Synesthesia can be potentially experienced by anyone using a VR system.
A few prior demonstrations of Synthetic Synesthesia exist and are described in the section on prior research; this lists a small but emerging body of prior works on the use of Artificial Synesthesia to enhance VR, for example to color particular objects in a visual scene to enhance the subject's attention to those objects.However, these prior works in Artificial Synesthesia in VR have not exploited the underlying structure of the senses involved.
The main thrust of our paper is to enhance immersive VR by use of Artificial Synesthesia.Our paper describes an enhanced Immersive VR that induces, in the subjects' brain, associations between a variety of senses: between colors and characters, also between colors and sounds, and between sounds and the position of tactile sensations.These induced sensory associations appear to be associated with increased attention by the user; hence they potentially provide a method for improving the system's control of the user's attention, to direct the users attention to intended states of the mind (e.g., to states of the mind without pain).
We also exploit the known underlying structure of various senses, as described in the next section.

The Advantage of Training of Artificial Synesthesia to Enhance Control of Subjects Attention:
Once training of Artificial Synesthesia is done, then we conjecture that this training can be exploited to allow for enhanced control of the human subject's attention: (a)Enhanced Attention Control via Increased Intensity of Perception of a Synesthesia-Grouped set of Senses: We conjecture that if all of a Synesthesia-grouped set of senses are simultaneously experienced by a subject the subject's attention will shift so that the subject will be much more attentive to that Synesthesia-grouped stimuli as compared to the conventional case where only one sensory perception may be used to attempt to control the subject's attention.

(b) Enhanced Attention Control via Increased Attention Directed to other Synesthesia-Grouped set of Senses:
We also conjecture that if only one of a given sensations of a Synesthesia-grouped set of senses is initially perceived by a subject, the subject's attention will shift so that the subject will be much more attentive to the other Synesthesia-grouped set of senses that might also be present but not previously perceived by the subject.Hence if the subject only initially notices one of a given Synesthesia-grouped set of senses, then the subject is much more likely to perceive the other sensations of a Synesthesiagrouped set of senses, if they are also present.Hence the direction of the attention of the subject may be much more effectively controlled by presenting the subject with Synesthesia-grouped set of senses.In layman terms, we conjecture that the Synesthesia-grouping of senses acts like a searchlight to highlight perception and attention by the subject.

I.8 Structured Artificial Synesthesia generated by VR
Each of the various senses such as color, character visual processing, sound pitch and spatial tactile sensations appear to have an underlying structure, modeled in prior works by a spatial representation (a continuous 2D maps) which we call a sense-map.For example, (a) colors can be arranged in perceived similarity around a wheel to form a color-map, (b) tones can be arranged in an array (sometimes called call a tone-map) that reflects similarity of frequency as well as tonal patterns of groups of sounds such as chords, and (c) the sensory homunculus is a one-to-one correspondence of an area of the body to a specific position on the brain.(See the section III. 4  A further highly innovative goal of our paper is to also exploit the rich underlying structure of the senses.The various senses such as color, character visual processing, sound pitch and spatial tactile sensations each are known to have an underlying complex structure, generally modeled in prior works by a spatial representation (a continuous 2D map) which we term a sense-map (e.g., color maps for visual perception, tone and chord maps for sounds, etc.).We discuss enhancing immersive VR by first known use of what we call Structured Artificial Synesthesia, where the coupling between senses also couples the structure of the various senses by a mapping between the corresponding sense-maps.To do this, we choose mappings between sense-maps of distinct senses (for example transfer of pleasant harmonic chords to pleasantly perceived groupings of another sense such as of colors).

I.9 Potential High-Impact Applications VR-induced Artificial Synesthesia
The enhanced ability provided by Artificial Synesthesia for controlling the subject's attention, and for detection patterns or objects has many potential applications.Potential applications of VR-induced Artificial Synesthesia include improved immersive VR, more programmable human/computer interfaces and medical therapies.In particular, a major application is for subjects suffering pain; this paper develops improved methods for directing the attention of subjects away from pain.Other potential high-impact applications of this research include improved immersive VR, more programmable human/computer interfaces and other medical therapies.

II Use of Virtual Reality (VR) for Pain Therapy
II.1 Prior Literature on Use of Virtual Reality (VR) for Pain Therapy: Pain Distraction Therapy: Relief of severe pain is a major problem in the field of Medicine.Fortunately and according to extensive prior literature, all sorts of pain can be distracted via controlled sensory stimuli.Considerable prior work by the coauthor (e.g.[1]) and many others (e.g., [2], [3]) has demonstrated the use of Virtual Reality (VR) for distracting attention for patients experiencing pain, and thus reducing the pain they experience.This is sometimes known as VR distraction therapy for pain.VR distraction therapy for pain does not completely eliminate pain, but can provide considerable relief from the perception of the degree of pain.The degree of success of distraction therapy depends on the degree the patient is distracted by the sensory stimuli provided by the VR system.Using Immersive VR for Pain Distraction Therapy: Pain Distraction Therapy is one of the most important applications of Immersive VR in medical applications.[4] have proved that virtual reality can be used as an alternative effective nonpharmacologic analgesia to reduce dental pain and discomfort.Thus it allows patients to tolerate painful dental procedures safely.[5] proved that VR has a huge effect on reducing heart pulse rates during dental procedures, especially in children.[6] studied the use of virtual reality as a distraction tool to connect patients to a virtual environment.With fifty participants undergoing routine gastric laboratory procedures, 86% of them testified to the effectiveness of the system.We may look at the example provided by Dr Hoffman and Dr Patterson [2] at the University of Washington, as illustrated in Figure 1A.The team created an immersive VR environment called Snow World, which is designed to reduce pain during the burn therapy by distracting attention.To experience Snow World during physical therapy sessions, patients wear a helmet hooked up to the virtual world configured as an icy 3D canyon, where patients can throw snowballs on snowmen, igloos, and penguins, providing physical therapy to stretch the newly healed skin.It was more effective and worked by distracting attention away from pain to the 3D world, decreasing Pain dx by 40%-50% [2].In [7] a study was conducted on patients were each patient was treated for three minutes of physiotherapy without diverting their attention.Another three minutes using virtual reality games, and used the visual analog scale to measure the pain intensity.The result shows a reduction in the treatment time from 60 minutes to 14 minutes.

II.1B Pain Reduction by Imagery Therapy using Immersive VR:
Imagery therapy is a particular type of methods for pain distraction where images are presented to achieve the desigered paid distraction.The co-author Alhalabi and his team have in prior work made considerable contributions to pain reduction via both VR diversion as well in particular imagery therapy to control pain and to help patients of many diseases including rheumatoid arthritis [8], post-stroke paralysis [9], [10], dentist [12], and cancer [13], [14], and pain in general [11].[15] reported that virtual reality system has been used with imagery therapy to distract patients' attention away from the painful real world to a positive virtual environment which helps in alleviating pain in numerous diseases including leukemia, breast cancer, burns, phobia, and many others.From prior data and scientific evidences, we can infer that the percentage of imagery therapy methods using virtual reality techniques which have been successfully implemented in controlling pain associated with rheumatoid arthritis is very high.It is been demonstrated that distracting attention is critical to success of therapy.Pain Distraction using Unguided Image Therapy: In some of this Image Therapy work, the patient is provided with controls to freely wonder through the virtual world.As an example, the co-author developed [11] a system using imagery therapy via virtual reality to relieve pain using his system "Arrival Dream".This system immerses patients in the environment, to attract their attention away from the clinic environment to the forest environment.Arrival Dream is introduced to drive burn patients into relaxation and adventure.It allows patients to control the movement using joystick and other input devices.Patients walk between grass and trees, and are exposed to other natural animals and live such as frogs, lakes, wood bridges, rivers and caves enjoying the sound and color of nature.Guided Imagery therapy (IT): Another related method for relief of severe pain is to use the VR system to guide the patient through a series of mental states.This is one of the most effective therapies in the United States for pain relief as explained in a study published by a medical research team led by Wolsko [16].The process of guided imagery is illustrated in Figure 1B.In a (three-step) Guided Imagery therapy:  The initial mental state of the patient is one where the patient experiences severe pain. By presenting imagery that catches the patient's attention, the system changes the patient's mental state to a next state where the patient experiences only moderate pain. Again by presenting imagery that again catches the patient's attention, the system further changes the patient's mental state to a final state where the patient experiences only little or no pain.

Figure 1B: A Diagram of Mental States of Guided Imagery from High Pain to without Pain
The process of guided imagery has a long history, and may have used for example by native Americans for reduction of pain prior to the modern era.
As an interesting example of the prior use of Guided Imagery therapy using immersive VR, the co-author and his team developed virtual reality software "Imagery Way" to enhance the immune system and reduce pain [17].It is designed for women suffering from breast cancer."Imagery way" immerses patients in the environment to attract their attentions and dives into deep relaxation in the treatment of breast cancer includes course of chemotherapy, radiation therapy or surgery.When chemotherapy is used, different kind of side effects are reflected on patients such as anxiety, nausea, depression and vomiting.Imagery way immerses patients into nature with a natural green environment, sustainable water flow and pleasant bird whispering.Silence and relaxation helps patient to hear the sound of nature, waterfalls, birds and bugs.The movements of insects rendered via virtual reality effects attract the attention of the patient and release its pain.The co-author's "Imagery Way" is thus a clear illustration of the power of VR-guided imagery for pain therapy.The Challenge: In this Guided Imagery therapy, the system's control of the subject's attention is critical.The next section considers novel ways to increase the system's control of the subject's attention.

III.2 Prior Literature on Artificial Synesthesia and Prior Demonstrations
There is a small but emerging body of prior works on the use of Artificial Synesthesia to enhance VR, for example to color particular objects in a visual scene to enhance the subject's attention to those objects.Prior Demonstrations of Synthetic Synesthesia include: (a) The Synthetic Synesthesia system developed by the Eagleman Lab (Laboratory for Perception and Action, Departments of Neuroscience and Psychiatry, Baylor College of Medicine, Houston, TX): displays Artificial Synesthesia associations between various senses, including color and sound.(b) [33] and [34] developed a Synesthetic Music Experience Communicator which provided visual display in response to music to the goal of illustrating the experience of visual Synesthesia in response to musical sound.(c) Thórisson and Donoghue [35] at the The Media Laboratory, MIT developed a interface to mix distinct sound sources (e.g., the flute, guitar and organ) called the Geometric Sound Mixer (GSM), that displays the sound sources on a 2D plane and allows the user to mix these by selecting positions on the plane between the positions of the sound sources on the 2D plane.(d) Addison's Project (at CAVE, San Diego Supercomputer Center, CA) is an immersive VR room that provides visual perception of body sensors for breathing, heart rate, etc. (e) [36], [37], and [38] developed scoreLight which is a musical instrument that generate sound from lasar-scanning of the lines of drawings and from the contours of three-dimensional objects.(f) Plouznikoff et al [65] demonstrated artificial grapheme-color synesthesia using a wearable display.
Limitations of Prior Demonstrations of Artificial Synesthesia: These prior works in Artificial Synesthesia in VR were mostly motivated by a desire to allow the subject experience Natural Synesthesia, rather than improve the performance or control the attention of the subject.

III.3 Novel Use of Artificial Synesthesia for Pain Therapy
There appears to be little or no prior literature on use of artificial synesthesia for pain therapy.Since artificial synesthesia has the effect of combining sensory stimuli from distinct senses, it appears very likely be effective in enhancing the control of a person's attention.Therefore the use of artificial synesthesia in VR has the potential of improving and directing sensory distraction to provide improved pain reduction.It is not reasonable to expect that application of VR-trained artificial synesthesia attention control in VR allows us to completely switch ON/OFF the pain sensation, but expect it to reduce the perceived pain in a degree measurable.

III.4 Exploiting the Underlying Structure of Sensory Perception to Further Control & Direct the Subject's Attention
Our work in Artificial Synesthesia in VR is also exploiting the underlying structure of the senses involved, to further capture the attention of the subject and so better control and direct the subject's attention.
Each of the various senses such as color, character visual processing, sound pitch and spatial tactile sensations appear to have an underlying structure, modeled in prior works by a spatial representation (a continuous 2D maps) which we call a sense-map.(a) For example, colors can be arranged in perceived similarity around a wheel to form a color-map (this idea dates to Newton's book Optics [39]), whose angular position is color frequency, and radial coordinate provides for hue intensity.This was later refined by an artist Munsell, who provided a geometric model (which is two dimensional if grey value tones are not modeled) for hue spacing from judgments of relative color similarity, such as illustrated below: (b) As a further example, characters can be arranged in spatial maps where proximity implies similar geometric properties.(c) Also, tones can be arranged in an array (a tone-map) that reflects similarity of frequency as well as tonal patterns of groups of sounds such as chords, as investigated by Dmitri Tymoczko [40] in his work on the geometry of musical chords.(d) Somatotopy is a one-to-one correspondence of an area of the body to a specific position on the brain.The sensory homunculus [65] (an idea due to Wilder Penfield) is a nonuniform 2D map of this somatotopy, describing how the tactile and other sensory information from parts of the body are mapped to corresponding cortical sites in the brain.Considerable prior research has been done on the mechanisms for Natural Synesthesia involving auditory-tactile somatosensory associations [41], [42], including feeling sounds after thalamic lesions [43], [44] and other multisensory interplay between "sensory-specific" brain regions [45], [46].By underlying structure of the senses involved, to further capture the attention of the subject and so better control and direct the subject's attention.We are working to enhance immersive VR by first known use of what we call Structured Artificial Synesthesia, where the coupling between senses also couples the structure of the various senses by a mapping between the corresponding sense-maps.To do this, we choose mappings between sense-maps of distinct senses (for example transfer of pleasant harmonic chords to pleasantly perceived groupings of another sense such as of colors).

III.5 Possible Use of Neural Plasticity
Recall that neural plasticity is a general term for the ability of the Brain to change dynamically, as discussed in section 1.5.In the last decades it was shown that neural plasticity could also occur in mature, uninjured individuals by various types of training or external stimuli.Perhaps the most dramatic demonstrations of neural plasticity has been the work of Vilayanur Ramachandran, who [24] made experiments which made ingenious use of mirrors in demonstrating the neural plasticity of these displaced somatotopic brain maps.In particular, for amputees with perception (this is known as a phantom limb) of the missing arm, he used an arrangement of mirrors to mirror the visual perception of the movement of the existing arm with a perceived identical movement of the missing arm, inducing a change in the patient's somatotopic brain map to decrease lost limb pain.Subsequent investigations by [48], [49], [65], [50] have extended this work.Also, [51] demonstrated physiologically impossible movement of their amputees' phantom limbs.[52] demonstrated motor control training for uninjured mature individuals.Applications of neural plasticity to brain-machine interfaces have been discussed [53], [54], and [55] demonstrated adaptive training of control of actuation across a brain-machine interface.[56] demonstrated the use of training as therapies for elder adults.Potentially, our work in Artificial Synesthesia using VR could also also exploit neural plasticity, by adaptive training of the attention (e.g., direction of the eyes) of subject to particular types of movement of a particular captivating object in view; this training could improve the control and direction of the subject's attention.

IV.1. A Prototype VR System for Demonstration of Artificial Synesthesia
Recall a grapheme is a character, symbol or number.Graphemes are generally far easier to introduce or detect in a graphic scene than general objects, and so are used in our prototype system rather than general graphic objects.
We are developing a VR system that introduces Artificial Synesthesia associations in the VR system's (visual, sound, and tactile) output associated with specific graphemes.These Artificial Synesthesia associations include: • coloring specific graphemes with specific colors • coloring specific graphemes where the specific graphemes emit specific sounds • • producing specific sounds in association with specific graphemes • producing specific tactile sensations in response to specific graphemes • producing specific tactile sensations in response to specific colors This work involves insertion and/or detection of specific graphenes, colors, or sounds, and insertion of the associated specific graphene, color, sound, or tactile sensation.
After achieving training of pair-wise Artificial Synesthesia, we are also attempting to train triplets of associations between three distinct senses (triplet Artificial Synesthesia).

IV.2. Investigation of Structured Artificial Synesthesia
Recall, as described in detail in our introduction, that sense-maps are continuous 2D maps of the senses such as color, character visual processing, sound pitch and spatial tactile sensations.
We are exploiting this rich underlying structure of the senses, to investigate Structured Artificial Synesthesia, where the coupling between senses also couples the structure of the various senses by a mapping between the corresponding sense-maps.A key challenge is determine how to map between two sensory classes (visual graphene, sound, tactile) is such a way as to make use of the known sense-map of these sensory classes.To do this, we choose mappings between sense-maps of distinct senses, and test what mappings provide for better performance.
We are using two approaches: (1) It is known that individual senses such as sound (or color) have pairings and groupings that are naturally harmoniousthese are for example chords -or can be to various degrees inharmonious.These groupings have been spatially mapped on 2 dimensional charts.We are experimenting the transfer of pleasant harmonic chords to pleasantly perceived groupings of another sense such as a set of "harmonious" colors.
(2) Further, we are utilizing and further refining network models of each of the distinct sense-maps (e.g., Munsell Hue spacing as a simple network model for colors and Tymoczko's 2D diagram of Tones and Chords as a simple network model for sounds).Then we determine mappings between these of the distinct sense-maps that preserve locality or other properties such as complementarity within each of the sensory class that we wish to associate via Artificial Synesthesia.

IV.3. Tests and Applications of our VR System for Artificial Synesthesia:
A key challenge here is to develop performance metrics that can be rigorously tested.These performance metrics which we are developing are related to the degree the subject has enhanced response to the introduction of graphemes, colors, sounds and/or tactile simulations, when these are augmented with the Artificial Synesthesia sensory stimuli.
A further challenge is to test and verify (using rigorous statistical methods as used in experimental psychology), that VR system that introduces Artificial Synesthesia associations actually provided improved performance in the metrics we define.Here we are intending to apply techniques already developed in experimental psychology, for example for demonstrating Natural Synesthesia associations between specific colors and sounds.between specific colors and tactile sensations [57].For example, to test whether we have successfully introduces Artificial Synesthesia associations between specific pairs of colors and graphemes, we plan to apply the technique developed by Vilayanur Ramachandran in his work on verifying existing Natural Synesthesia associations between specific pairs of colors and graphemes (e.g., visual perceived characters and numbers), by showing that color/character pairing results in much faster recognition of spatial patterns of graphemes which have synesthesicia pairings with distinctive colors.(also see [58], [59], [60], [61], [62]).As described in more detail in section II, Alhalabi and number of other investigators have previously used VR to distract patients from pain and/or discomfort, and demonstrated considerable success in this task.We are planning to test applications of our VR System for Artificial Synesthesia to influence pain perception.IV.4.Inducing Subliminal Synesthesia: A by-product of our main work on Immersive VR) is to induce via Immersive VR a subliminal form of Synesthesia that is not perceived by the subject but provides enhanced ability at various perception tasks.To this end, we are attempting to induce via training a Natural Synesthesia that is not consciously perceived by a subject.
Training of induced Subliminal Synesthesia can be used to probe the transfer of underlying structure of distinct senses.In particular, these VR trained induced synesthesia associations may also induce a mapping between the structural organizations involving these senses.

V Conclusions
This paper provided an interdisciplinary study of novel applications of techniques and tools of an emerging topic of brain science known as Synesthesia to the area of computer science generally known as Immersive Virtual Reality, that makes the subject's awareness of physical self be diminished by being surrounded in an engrossing artificial environment.Synesthesia is associations between distinct senses, e.g., perception of particular colors associated with particular graphemes, sounds, tactile sensations, taste or smells.In Natural Synesthesia, the sensory associations that the subject perceives appear to be real perceptions, but are actually created within the brain, whereas in Artificial Synesthesia induced associations between senses created synthetically, for example via VR, rather than created by the subjects brain.While Natural Synesthesia is present in only a small proportion of the population, potentially Artificial Synesthesia can be experienced by anyone using a VR system.Natural Synesthesia has for the last decade been an important emerging area in brain science; we feel Artificial Synesthesia could have similarly important applications to VR.The paper describes the enhancement of immersive VR by use of Artificial Synesthesia to improve the system's performance at steering and directing the attention of the user.We describe techniques for an enhanced Immersive VR that displays associations between a variety of senses: between colors and characters, also between colors and sounds, and between sounds and the position of tactile sensations.The sense association provided by Artificial Synesthesia allows the system to better capture the user's attention and better direct that attention.Our paper mentions that a small but emerging body of prior works on the use of Artificial Synesthesia to enhance VR, in particular to color particular objects in a visual scene to enhance the subject's attention to those objects.However, this prior works in Artificial Synesthesia in VR has been limited mostly to coloring objects, and more over has not exploited the underlying structure of the senses involved.A further innovative topic described by this paper is to also exploit the rich underlying structure of the senses.The various senses such as color, character visual processing, sound pitch and spatial tactile sensations each are known to have an underlying complex structure, generally modeled in prior works by a spatial representation (a continuous 2D map) which we term a sense-map (e.g., color maps for visual perception, tone and chord maps for sounds, etc.).We described how we may further enhance immersive VR by the first known use of what we call Structured Artificial Synesthesia, where the coupling between senses also couples the structure of the various senses by a mapping between the corresponding sense-maps.To do this, we described the technique of choosing mappings between sense-maps of distinct senses (for example transfer of a pleasant harmonic chords to pleasantly perceived groupings of another sense such as of colors).We discussed a very high-impact medical application of this basic research in Artificial Synesthesia to medical science: pain relief.Immersive VR has been extensively applied for pain therapies, by using VR to distract the patient from painful sensations and redirect attention to mental states associated with less pain (this often involves techniques of guided imagery, where the attention of patient is directed through a series of mental states where the patient experiences progressively less pain).In spite of the power of these pain distraction and guided imagery techniques, a critical challenge is to control and redirect the attention of the patient.We argued that a major application of this work in VR-induced Artificial Synesthesia is to provide an enhanced methodology for controlling the attention of the subject, and to improve the direction of attention of subjects undergoing guided imagery pain therapies, so providing improved methods for directing the attention of subjects away from pain.Other potential high-impact applications of this research include improved immersive VR, more programmable human/computer interfaces and other medical therapies.

Figure 1A
Figure 1A Using Immersive VR for Pain Distraction Therapy (from [2] Hoffman H.G., Patterson D.R., Carrougher G.J., & Sharar S.(2001).The Effectiveness of Virtual Reality Based Pain Control with Multiple Treatments, Clinical Journal of Pain, 17, 229-235)We may look at the example provided by Dr Hoffman and Dr Patterson[2] at the University of Washington, as illustrated in Figure1A.The team created an immersive VR environment called Snow World, which is designed to reduce pain during the burn therapy by distracting attention.To experience Snow World during physical therapy sessions, patients wear a helmet hooked up to the virtual world configured as an icy 3D canyon, where patients can throw snowballs on snowmen, igloos, and penguins, providing physical therapy to stretch the newly healed skin.It was more effective and worked by distracting attention away from pain to the 3D world, decreasing Pain dx by 40%-50%[2].In[7] a study was conducted on patients were each patient was treated for three minutes of physiotherapy without diverting their attention.Another three minutes using virtual reality games, and used the visual analog scale to measure the pain intensity.The result shows a reduction in the treatment time from 60 minutes to 14 minutes.II.1BPain Reduction by Imagery Therapy using Immersive VR: (www.preprints.org)| NOT PEER-REVIEWED | Posted: 7 August 2018 doi:10.20944/preprints201808.0134.v1

Figure 5 :
Figure 5: Spatial Patterns of Graphemes asassociated by Color: If the character 2 is associated with the color red, then the triangle of 2s in the right figure is quickly recognized by detection of the red triangle shape (from [58] Hubbard EM, Arman AC, Ramachandran VS, Boynton GM (March 2005)."Individual differences among grapheme-color synesthetes: brain-behavior correlations" Neuron 45 (6): 975-85.doi:10.1016/j.neuron.2005.02.008)IV.4.Application of our VR System for Artificial Synesthesia to influence pain perception:As described in more detail in section II, Alhalabi and number of other investigators have previously used VR to distract patients from pain and/or discomfort, and demonstrated considerable success in this task.We are planning to test applications of our VR System for Artificial Synesthesia to influence pain perception.IV.4.Inducing Subliminal Synesthesia:A by-product of our main work on Immersive VR) is to induce via Immersive VR a subliminal form of Synesthesia that is not perceived by the subject but provides enhanced ability at various perception tasks.To this end, we are attempting to induce via training a Natural Synesthesia that is not consciously perceived by a subject.Training of induced Subliminal Synesthesia can be used to probe the transfer of underlying structure of distinct senses.In particular, these VR trained induced synesthesia associations may also induce a mapping between the structural organizations involving these senses.