Software that automatically stitches together hundreds of photographs to create a virtual world that can be explored using a computer is to be released by Microsoft.
Called Photosynth, the software takes individual images and performs careful analyses to find matching sections. It then "stitches" overlapping pictures together to create a three-dimensional landscape composed of many different snaps.
The software was developed by Noah Snavely and Steven Seitz at the University of Washington, in Seattle, US, in collaboration with Microsoft researcher Richard Szeliski.
"It’s like a hybrid of a slide show and a gaming experience," says Szeliski, manager of the Interactive Visual Media Group at Microsoft Research in Washington, US. "This is a revolutionary way for people to interact with photos in a 3D context that more closely resembles the place where the images were captured."
Zoom in
Photosynth first finds distinctive features of each image. It then creates a "web" representing the relationships between different pictures. From this, the software can determine where the camera was positioned for each picture. It can then produce a "3D pointcloud" which looks as if each picture has been projected from its original camera position in three dimensions.
If a user, for example, uploads a series of holiday images featuring the same landmark they should be able explore it virtually in three dimensions and zoom in to see more features in close up.
The programmers behind the software say it could eventually be used to link up different photo collections. The research will be demonstrated at the SIGGRAPH computer graphics conference in Boston, US, on Tuesday. Microsoft has produced a video at http://labs.live.com/photosynth/videodemo.html
"It sounds very clever," says John Carter, an expert in computer vision at the University of Southampton in the UK, but he notes that its usefulness will only be proven over time.
From: NewsScientist