Skip to main content
Part of complete coverage on

Computer display that lets you touch the real world

STORY HIGHLIGHTS
  • The inFORM Dynamic Shape Display is a table that can render 3D content physically
  • Using a Kinect sensor, users can create a 3D likeness of their hands
  • The display can also be used as a controller

(CNN) -- Picture this scene: an iPad resting on a table with the familiar 2D image from a video call on the screen.

The flat display shows your caller's upper body, talking away. But below this their hands and arms reach up out of the tabletop into the physical world, gently lifting a small red ball off the table and passing it from one digitally-recreated hand to the other.

It can already happen.

It's the work of the inFORM Dynamic Shape Display: a tabletop covered in miniature white squares that rise up like towers, to turn digital content into physical objects. Used in conjunction with a 3D sensor, like Microsoft's Kinect, it can capture a person's physical appearance and reproduce it in tiny skyscraper-like "pixel" blocks -- on-the-fly, anywhere in the world.

Essentially it's very similar to those kind of pin toys that you might know from museum novelty stores
Daniel Leithinger, MIT

"Essentially it's very similar to those kind of pin toys that you might know from museum novelty stores," explains MIT's Daniel Leithinger, part of the Tangible Media Group behind the inFORM.

Similar -- yes -- just a lot more impressive.

Read: Apple buys 3D company that helped make Kinect

To add color to the block shapes, a projector on the ceiling beams down light, turning the towers psychedelic hues as Leithinger demonstrates the table's capabilities.

It also has a deeper purpose -- communicating an extra layer of information from the sender to the receiver on the other end: "When you move your hands, not only do you have the shape of the hands, but you also see the color, the texture of the hands," says Leithinger.

ATF test shows 3-D gun in action
Man uses 3-D printer to make duck's foot

Leithinger shows off a couple of the table's party tricks: sculpting a model car from the blocks, coloring it in, and video-chatting about it with a colleague -- allowing them both to get hands-on with the model, regardless of physical distance.

The display doubles as an active controller, allowing a user to interact with 3D menus constructed by the table by moving the little red ball.

Read: Report: Next iPhone could have curved screen

"It's not real 3D because we can only push up and down each one of these pins," says Leithinger. "We can't push them sideways or have any other control over them at the moment -- we usually call this affect '2.5D'"

A lot of comments we get are like: 'Oh, it's like a super power'
Daniel Leithinger, MIT

Even so, the inFORM's remarkable capabilities seem to given some users big ideas. "A lot of comments we get are like -- 'Oh, it's like a super power'," he laughs.

They say it feels like being X-Men nemesis Magneto, he explains -- suddenly having the power to manipulate the world at a distance, just with a wave of your hand.

For Leithinger, his ambitions are a little more down to earth.

"In the future, where we hope to get is something like, say, a phone that you could have in your pocket, and as you interact with things on the phone you can actually touch them."

It remains to be seen whether or not users will be excited about a smartphone that can poke them back. Leithinger, for one, has a good feeling about it.

ADVERTISEMENT
Part of complete coverage on
updated 7:48 AM EDT, Wed October 1, 2014
Imagine if going through airport security was just a matter of walking past a stretch of wall.
updated 9:03 AM EDT, Fri September 26, 2014
From spotting allergens to counting calories, technology can lend a smart hand in the kitchen.
updated 9:26 AM EDT, Fri September 19, 2014
Meet the 'Flavour Conductor', a magical instrument that took 10,000 hours to build and can change the taste of your drink through the power of sound.
updated 12:09 PM EDT, Wed September 3, 2014
Mogees is a technology that turns any object into a musical instrument, by converting the vibrations you make when you touch it into sound.
updated 9:06 AM EDT, Thu September 11, 2014
Scientists are attempting to harness the power of a star by mirroring how the sun produces heat and light. CNN's Nick Glass reports.
updated 7:37 AM EDT, Fri September 5, 2014
Neil Harbisson is the world's first legally recognized cyborg. He has an antenna implanted into his skull that gives him the ability to perceive color.
updated 12:18 PM EDT, Fri August 29, 2014
Move over, hoverboard: new technologies promise to make everything float free through levitation.
updated 12:45 PM EDT, Fri August 22, 2014
Getting a foothold on the property ladder can be a challenge, and the prospects for many of us have been battered by the global recession.
updated 8:37 AM EDT, Thu August 21, 2014
It's like a chair that isn't there, but magically appears whenever you need it. It's called the Chairless Chair. Find out how it works.
updated 5:39 AM EDT, Fri August 8, 2014
Engineer Alan Bond has been developing a new concept for space travel for over 30 years -- and his creation is now on the verge of lift off.
updated 8:10 AM EDT, Fri July 25, 2014
Crumbling buildings, burnt-out PCs, and cracked screens -- a new generation of "self-healing" technologies could soon consign them to history.
updated 5:09 AM EDT, Tue June 24, 2014
Discover a dancing cactus field, basketball on the Hudson River, and mind-bending 3D projections on robotic screens.
updated 1:07 PM EDT, Fri May 23, 2014
Would you live there? Design student Peter Trimble says it's actually a surprisingly good idea.
updated 10:50 AM EDT, Wed May 14, 2014
Alpha Sphere
Singing Tesla coils, musical ice cream, vegetables on drums... and this ball? Find out how "hackers" have created a new generation of instruments.
updated 12:43 PM EDT, Wed May 28, 2014
Technology has long learned from nature, but now it's going micro. "Cellular biomimicry" sees designers take inspiration from plant and animal cells.
updated 1:08 PM EDT, Wed April 9, 2014
Forget wearable tech, embeddable implants are here. Learn more about the pioneers who are implanting devices into their bodies.
updated 6:26 AM EDT, Wed May 7, 2014
A visitor of the 'NEXT Berlin' conference tries out Google Glass, a wearable computer that responds to voice commands and displays information before your eyes. It is expected to go to market in late 2013.
We know how wearable tech can enhance our fitness lives but there's evidence that its most significant application is yet to come: the workplace.
updated 4:13 AM EDT, Thu April 10, 2014
Samsung's research unit announces new way to synthesize graphene, potentially opening the door to commercial production.
updated 8:15 AM EDT, Mon March 31, 2014
iRobot, creators of vacuuming robot Roomba reveal how they learned from secret experiments -- in space travel, minefields, and toys.
updated 12:23 PM EDT, Fri March 28, 2014
A light-bulb glowing in middle of a room with no wires attached. "It's the future," says Dr Katie Hall.
updated 11:26 AM EST, Mon March 3, 2014
Knee replacements that encourage cells to regrow could soon be manufactured -- by spiders. Find out how.
updated 9:03 AM EST, Fri February 14, 2014
Meet Chuck Hull: the humble American engineer who changed the world of manufacturing.
updated 9:48 AM EST, Thu February 6, 2014
The key to self-knowledge? Or just the return of the phony "mood ring"? Check out our top mood-sensing technology in development.
ADVERTISEMENT