Generation of Virtual Environment for Haptic (VR) Application

Download Full-Text PDF Cite this Publication

Text Only Version

Generation of Virtual Environment for Haptic (VR) Application

Abhijit M

Kiran K

Vasudev P

M. Tech IT, Dept. of ISE,

B.Tech IT, Dept. of IT

Asso. Prof., Dept. of ISE,

SDMCET, Dharwad

BVBCET, Hubli

SDMCET, Dharwad

Abstract:- Virtual Reality [VR] is first step in connecting a human and virtual environment to give feel of Adventure or exposure to landscape of imagination. It prominences the digital world and produce immersion or half immersion. Virtual reality, Where Design, Dexterity, Science, Art meets to create a radical inventions/ experience. It can cover or combine feel, presence and touch. Haptics includes software simulation and hardware accessories, where human haptic glove with FSR sensors controls and interacts with robotic arm with Flex sensor as a result, producing vibration or motion in hand. Flex sensor covert the motion of hand to signals and transfers it to the FSR sensor, which converts the signals back to motion (feel). The application of Virtual reality is in the field of Defense related and Medical application.

Keywords: Virtual Reality, Haptics, Blender, Unity, FSR sensor, FLEX sensors.

  1. INTRODUCTION

    The object creation [5] is a way to simulate the behavior and characteristics of real world object. Objects in virtual worlds behave just as induced by the programmer or input supplied. This means, the objects in virtual world have no restriction.

    The object doesnt hold the forces as in real world object forces, such as gravity, friction and collisions. These produce an external/opposite force that inculcates the applied force. The virtual reality[1] uses both 2d and 3d interfaced for creating and virtual environment. We also say, we can fool the brain by producing a virtual environment in which the person can feel the objects exist in real world. The graphical tools such as Blender 3D, 3D Max are used to create and objects. This Technology can be applied to the environment or work that is not familiar or not suitable and it can be simulated using VR. This technology can be used in showing the open heart surgeries, and also in simulating the driving of a car for learners from beginning, making education fun for students using VR concepts.

    The organization of paper is Section I, introduces the Virtual reality domain and it brief idea about the objects and devices that are interacting with the user. Section 2, literature survey gives the research work in Virtual reality application in field such as gaming, education. Section 3, proposed work depicts the idea that can be applied using

    haptics into different fields such as medical, defense related applications. The next Section 4, Experimental results describe the results achieved so far from the project and the work will be continued as a part of the idea.

  2. LITERATURE SURVEY Some of the works carried out in the field of Virtual Reality

    The research work carried by Megha Goyal [1]gives idea about the differentiation between human haptics [10] and machine haptics. Human part has control over the location of the hand, while on the other side the machine part has exerts a force from hand to react or contact with the virtual object. The computer takes a part as brain and makes all kind of the sense as the muscles do in our body by means of sensing device.

    According to the work in [2] All Gamers want is just to have fun and good experience, Touch feedback are very crucial information that cannot be left out , Rumble is best when its very carefully designed and very closely tied to the players actions or movement or to onscreen events and/or sounds produced. Gamers say its great when its realistic or best of all time when a machine gun doesnt sound purr like a kitten but instead rattles your teeth giving the feel of it.

  3. PROPOSED WORK

    Application

    This section of a paper explains briefly about the idea of the project. Since, there is no conventional way or algorithm to achieve this. The present work proposes an algorithm or a rule as depicted below in the Fig 1,2 and 3.

    Objects

    Data

    Fig. 1 Object and VR system

    The diagram [Fig. 3] shown below the process of designing of an object, it looks similar to the software engineering process. Considering each point while creating an object, gives how its behavior can be showed up.

    Software environment

    The proposed work describes of 2 modules Haptic Glove and Robotic arm with a virtual environment. Robotic arm is mounted with FLEX sensors, which touches the object in Environment and produces sensory signals. These signals are transferred to the Haptic [8] glove, where the voltage received is been converted to resistance. FSR sensor converts the resistance to vibrational tactile feedback using actuators.

    The objects are designed and rendered into unity virtual environment. Unity tool supports all the virtual reality based sensory library supports. Hence it behave as robotic arm (computer software) that producing signals.

    Component depicts the graphical / texture analysis of the interface of the object that must be created.

    The Behavior component depicts, there are 2 types of behavior of objects namely, Physical behavior of objects, observed as any changes in the state of an object in real world. Such as movement of ball, pen etc. Magical behavior of objects are observed as there is no change or rarely seen change, that to not in real world.

    The Interaction component, provides the input value and decodes the value/ behavior and decide where and when to imply the behavior to the object in the VR environment. Which in turn communicate with the behavioral component to update the interaction of objects. We need some implicit interaction which needs to be interpreting the value or input for e.g. robotic arm, hand etc.

  4. EXPERIMENTAL RESULTS

    The experimental results, object and its environment has been created using Blender 3d tool and rendered to Unity software environment. Blender provides an ease to design an object and Unity provides virtual environment for proposing the interacting with the other objects.

    Identifying data elements

    Identifying Objects

    Modelling objects

    Interactions

    Behaviours

    Graphics

    Fig. 3 Designing an Object

    The process of the Virtual Reality as shown in the Fig 3, objects mean the functional model or part in VR [8], Data refers to the script or behavior to be imposed on the objects for animation or interaction with other objects. Once the data is feed to the VR, The application can perform the specified task.

    The Process [Fig. 3] starts with primary objects such as cube, sphere etc. these object take a complex structure in later stages as we apply 3 techniques namely, Transformation, Rotation and Scaling [6]. These help in creating3D models required for VR environments. Identifying the data elements, it is the environment in which the objects behavior can be observed. The scene developed for the user to look around and interact with the objects.

    Identifying the object component depicts the number of objects that are present and interacting with each other. The objects here can be divided into interactive and non-interactive objects. [Fig.3]. Modeling the objects Component [7] depicts the rough sketch of the object, before imposing or designing it into environment and gives details about how the object can be utilized. The Graphics

    Designing of a object refers to basic structures of geometry such as cone, cylinder, plane, cube. The basic objects are transformed into required structure using 3 techniques titled Transformation, Rotation, and Scaling. Translation helps in rotating an object from its axis to counter clockwise. Rotation about a center point of an axis or object. And rotating it in clockwise direction for placing an object as per required. Scaling stretches or shrinks the size of an object in environment. The object is placed at center or origin of (0,0). As the Object is used in environment, it can be positioned using scaling.

    Fig. 4 Translating, rotating, scaling applied to the basic cylindrical

    object

    The Fig. 5 describes the game development scenario for a player. The object is animated in virtual environment using C# script and functions. In the Game development Scene the person is holding the Bow and arrow trying to hit targets. The Movement of hand with bow and arrow provides a feel of vibro-tactile feedback to the real time player using FSR sensors.

    Fig 5. The Player Module Designed to render in Unity

    The Fig 6. Shows complete camera view of Virtual environment.The VE scene describe the PULL, FIRE, SPACE from acutators library support from Unity software tools. The PULL and FIRE action need activation of Functions written in the C# scripts.

    Fig 6.The Game Designed Module rendered into Virtual environment.

  5. CONCLUSION

The Proposed work helps in the defense application in embodying the life of aspirant or life savers. It helps in experiencing the feel of unstipulated object in VR, real time. The current proposed work has depicted in the form of software-hardware interaction, future work of the proposed application will be hardware to hardware interaction for higher experience of virtual reality. Virtual Reality is enhancing the experience of Gaming development field, Medical related applications such as open surgeries, also in military field for protection of man force.

The future scope is to build an robotic arm that help in ensuring safety of person, as an entertainment in terms of gaming etc, such that can enhance the sense of movement created as vibration.

REFERENCES

  1. Megha Goyal, Dimple Saproo, Asha Bagashra, Kumar Rahul Dev Haptics: Technology Based on Touch (IJSRET) Volume 2 Issue 8 pp 468-471 November 2013

  2. Best Practices for Use of Vibration Feedback in VideoConsole Games Immersion TouchSense Technology,www.immersion.com/console.php, 30 October 2006

  3. Ahmed R. J. Almusawi, L. Canan Dülger,Sadettin Kapucu, Robotic arm dynamicand simulation with Virtual Reality Model(VRM), IEEE 20 October 2016.

  4. Olga De Troyer, Frederic Kleinermann,Bram Pellens, and Wesley Bille, Conceptual Modeling for Virtual Reality CRPIT, conference paper on virtual reality.

  5. Daniel G. Aliaga, Virtual Objects in theReal World , Communications of theACM (CACM) Vol. 40. No. 3., pp. 49- 54,March, 1997.

  6. Vildan Tanriverdi and Robert J.K. JacobVRID: A Design Model and Methodology for Developing VirtualReality Interfaces

  7. GabrielRobles-De-La-Torre. "International Society for Haptics: Haptic technology,an animated explanation". Isfh.org.Retrieved 2010-02-26.

  8. White Paper Haptic Devices Mimic Technologies Inc. 5/5/2003.

  9. Seth Shapiro and Andriy Pishchalenko, Virtual and Augmented Reality: A State ofthe Industry Overview March 9, 2016.

  10. Stephen Brewster The Impact of Haptic Touching Technology on Cultural Applications.

Leave a Reply

Your email address will not be published. Required fields are marked *