VirtuGrasp: Real-time visual and haptic feedback of grasping movements in virtual reality
The aims of this project are to understand how the brain integrates vision and touch to control hand movements, and to explore haptic control of hand movements using virtual reality technology. The methods we use are building on first (Nadine Aburumman) and second supervisor's (Marco Davare) research studying avatars, animation and human movements in virtual reality (Computer Science), and Davare’s work on the neuroscience of human hand function and neurorehabilitation (Clinical Sciences). The project we propose is multidisciplinary, combining research into 3D graphics, physics, AI, virtual reality techniques from computer science with new advances in brain mechanisms underlying perception and action, and multisensory integration from cognitive neuroscience.
To achieve the aims of this project, we will explore how the brain processes sensory signals for controlling movements online and generate a perception of the environment, while multisensory information will be experimentally manipulated in a virtual reality setup. We aim to simulate the forces produced during hand-object interaction in order to render a highly realistic feedback of grasping movements.
The successful applicants will join the internationally recognised researchers in the Department of Computer Science. This project is multidisciplinary: grasping and hand movements are actively being studied across robotics, AI, human computer interaction, cognitive neuroscience and physiotherapy. This research is focused on modelling grasping movements and feedback in immersive environments and producing a sense of ownership and agency over a virtual hand. Hand movements and object interactions are crucial features for training/simulation applications (e.g. flight, driving, medical simulators, robotics), where the ability to interact with simulated environments is paramount to an immersive experience.
Applicants will have or be expected to receive a first or upper-second class honours degree in an Engineering, Computer Science, Design, Mathematics, Physics or a similar discipline. A Postgraduate Masters degree is not required but may be an advantage. We encourage applicants with a strong background in programming C/C++/C# (preferably using UE4 or Unity) to apply. In addition, they should be highly motivated, able to work in a team, collaborate with others and have good communication skills.
- Dangxiao WANG, Yuan GUO, Shiyi LIU, Yuru ZHANG, Weiliang XU, Jing XIAO, "Haptic Display for Virtual Reality: Progress and Challenges", Virtual Reality & Intelligent Hardware, Volume 1, Issue 2, 2019.
- Y. Ban and Y. Ujitoko, "Enhancing the Pseudo-Haptic effect on the touch panel using the virtual string," 2018 IEEE Haptics Symposium (HAPTICS), San Francisco, CA, 2018.
- Kim M, Jeon C, Kim J. "A Study on Immersion and Presence of a Portable Hand Haptic System for Immersive Virtual Reality", Sensors, Basel, 2017.
How to apply
If you are interested in applying for the above PhD topic please follow the steps below:
- Contact the supervisor by email or phone to discuss your interest and find out if you woold be suitable. Supervisor details can be found on this topic page. The supervisor will guide you in developing the topic-specific research proposal, which will form part of your application.
- Click on the 'Apply here' button on this page and you will be taken to the relevant PhD course page, where you can apply using an online application.
- Complete the online application indicating your selected supervisor and include the research proposal for the topic you have selected.
This is a self funded topic
Brunel offers a number of funding options to research students that help cover the cost of their tuition fees, contribute to living expenses or both. See more information here: https://www.brunel.ac.uk/research/Research-degrees/Research-degree-funding. The UK Government is also offering Doctoral Student Loans for eligible students, and there is some funding available through the Research Councils. Many of our international students benefit from funding provided by their governments or employers. Brunel alumni enjoy tuition fee discounts of 15%.
Meet the Supervisor(s)