Microsoft is working on a touchscreen that lets users manipulate and even ‘feel’ 3D objects, using haptic technology which could have many future applications for the likes of web browsing, gaming, design and medical research. Watch this video from the Independent illustrating how the technology works below: The project, called Actuated 3-D Display with Haptic […]
Microsoft is working on a touchscreen that lets users manipulate and even ‘feel’ 3D objects, using haptic technology which could have many future applications for the likes of web browsing, gaming, design and medical research.
Watch this video from the Independent illustrating how the technology works below:
The project, called Actuated 3-D Display with Haptic Feedback, controls how much resistance there is to a user’s fingertip to simulate the shape and weight of objects shown on screen.
How it works
When a person touches the prototype it pushes back with a light force to ensure one of their fingers stays in contact with the screen.
If they then press against it the robotic arm instantly pulls the screen backwards in a matching smooth movement. If they start to retract their finger, it moves it back towards them.
Meanwhile a computer adjusts the size and perspective of the on-screen graphics to create a 3D effect.
The trick to simulating a physical sense of touch is to adjust the amount of force-feedback resistance.
For example, graphics representing different square blocks on a wall, a “stone” one requires a relatively large amount of force to push it off the ledge and a “sponge” one less.
In addition, the kit can be used to provide a sense of shape by adjusting the screen’s position to match a virtual object’s contours as a person drags their finger over its surface.
“As your finger pushes on the touchscreen and the senses merge with stereo vision, if we do the convergence correctly and update the visuals constantly so that they correspond to your finger’s depth perception, this is enough for your brain to accept the virtual world as real,” said senior researcher Michael Pahud.
His team have used the technique to allow users to feel the shape of a virtual cup and ball, among other objects, while viewing them using special glasses to get a stereo-vision effect.
Alonside helping doctors conduct medical research of human body scans, California-based Tactus, for example, has developed a screen with tiny channels of fluid which allows bumps to pop up to simulate the feel of buttons.
Watch this video from the BBC looking at how the Tactus technology works below:
