Using the senses is essential to interact with objects in real-world environments. However, not all the senses are available when interacting with virtual objects in virtual environments. This paper presents a diamond methodology to fuse two technologies to represent the senses of sight and touch when interacting with a virtual object. The sense of sight is represented through augmented reality, and the sense of touch is represented through kinesthetic haptics. The diamond methodology is centered on the user experience and comprises five general stages: Experience design, Sensory representation, Development, Display, and Fusion. The first stage comes from the expected, proposed, or needed user experience. Then, each technology takes its homologous activities from the second to the fourth stage, diverging from each other along their development. Finally, the technologies converge to the fifth and final stage for fusion in the user experience. The diamond methodology was tested by generating a user's dual sensation when interacting with the elasticity of a tension virtual spring. The user can simultaneously perceive the visual and tactile change of the virtual spring during the interaction, representing the object's deformation. The experimental results demonstrated that an interactive experience can be felt and seen in augmented reality following the diamond methodology.

Supermedia streams transfer video, audio, haptic and other sensory data. Real -time transfering of supermedia streams over the Internet is quite challenging. This paper outlines the proposed protocols for transferring supermedia streams over the Internet. Moreover, it describes the Quality of Service (QoS) requirements for supermedia applications that a network has to fulfill. Extensive simulations and experiments for the performance evaluation of transport protocols for real time transferring HEVC streams with supermedia data are carried out. Complements, differences and relevancies between simulation and real world experiments are discussed. The metrics that are measured for the performance evaluation are delay, jitter, throughput, efficiency, packet loss and one proposed by the authors, packet arrival deviation. The simulation tests reveal which protocols could be used for the transfer of real-time supermedia data with a HEVC video stream.

Human-Computer Interaction, including technology-aided instruction, is beginning to focus on virtual reality (VR) technology due to its ability to support immersive learning, teaching through simulation, and gamification of learning. These systems can deliver high-level multisensory learning experiences that are important in the teaching of many subjects, especially those involving abstract concepts or requiring spatial skills, such as organic chemistry. Haptic experiences with VR, however, remain a challenge. In addition, development have focused on general entertainment/gaming; VR systems in chemistry implement simulations of the chemistry laboratory and other advanced systems whereas those that support safe, game-like, immersive and multisensory learning of organic chemistry with haptics at pre-university education levels are scarce. We developed the VR Multisensory Classroom (VRMC) as an immersive learning environment within a VR head-mounted display, where learners employ hand movements to build hydrocarbon molecules and experience haptic feedback through gloves with built-in sensors and hand-tracking with the Leap Motion system. We report here the evaluation of the first prototype by learners from diverse backgrounds who reported on the ability of the VRMC to support high engagement, motivation, interest and organic chemistry learning as well as diverse learning styles. The VRMC is a novel VR classroom that supports immersive learning in molecular organic chemistry with haptics for multisensory learning.