Innovation in Software

For a couple of years now, I’ve been fascinated by the possibilities of a field known as Augmented Reality. In a nutshell, AR allows a digital device to “overlay” digital information onto the physical world. This is quite cool stuff. Watch:

So, that’s nice and everything. We can take a digital device, and through the multitude of sensory input, we can start to use it as a viewfinder. We can even start coming up with zany ways of manipulating the image we’re seeing, which people with very little expertise are starting to play with:

What’s intrigued me though, is can we find more interesting ways to interact with the device. It’s great that I can point my iPhone at a piece of paper with a special block printed on it, and a wind farm comes out, or I can point it at the environment I’m stood in and get extra information that isn’t otherwise easily found. What else can I do? Well, thanks to the same technologies developed for those applications I can suddenly create a virtual reality headset (either to augment my environment or to travel to another distant one):

Again, pretty and interesting and opens all sorts of possibilities. But how much further can we go? I have no doubt we’re just seeing the early adopter stuff here, and that with time lots more interesting applications will become available utilising these technologies. Watch that space carefully.

One of the issues raised by this technology though, is our addiction to it and the fact we become chained to the device. All of us have suffered that weird syndrome that happens when out with friends and suddenly all of you in a group are staring at small boxes of plastic and metal, interacting with virtual worlds rather than the one you’re physically in. If we start to augment reality through this technology, do we lose something about the sense of place and interaction with the real physical World? Do we start to become machines ourselves?

Thankfully, a rather interesting prospect is on the horizon. Even better, it’s open source and achievable with cheapish hardware. It might take a moment for this to “click” with you, but this will likely be the most valuable 10 minutes you’ll spend this year on understanding the future of human interfaces with technology in the next few years. Trust me. If you haven’t clicked that link, do so before going on, or if you want to skip the background and just see it in action, here’s a demo clip with cheesy music for you:

The idea that the device disappears is not all that new – we have seen devices getting smaller and denser for years with that goal in mind – but the way this has been done fascinates me. This technology once developed a little more into something more consumable eradicates the need for a high-end smartphone, multi-touch technology like the $40,000 Microsoft Surface, portable media players, the lot.

What you need: a camera, a projector, a data connection and a pair of headphones, all plugged into something that can understand all of them. Right now, the hardware looks cumbersome, but that’s just a hardware engineering problem: there are already smaller projection devices and cameras coming to market that will make this technology nearly invisible when worn.

What you can do with it: anything a camera, mp3 player, iPhone, desktop PC, laptop, mobile phone, projector, surface table, AR application, in fact anything you can do with any digital device, all in one go. And all of it with the device being near invisible.

What you use it with: ordinary pieces of paper, walls, tables, your hands, the objects and people around you. Instead of staring at pieces of plastic, suddenly you are encouraged to look up at the World.

When something interesting happens you don’t fumble around, open a shutter, focus, click, crop, tag and post. You just make a shape with your hands, and there’s your photo. When you want a flight-time update you don’t fumble, open an app, type, click, read: you just look at your boarding pass. You’re in a bookshop and you wonder if the book in your hands is any good so you fumble, type (or perhaps photo the barcode), click and read, perhaps clicking around a few stores on a small screen. With this, you just hold the book. That’s it.

You might think this is sci-fi, that nobody would ever use all of this or that the “back-end” needed would be too bulky. I would disagree. I would say it’s one of the most interesting developments in technology this decade. I will be watching for the release of the source code due soon with some interest. Pranav’s site is a good place to keep your ear to the ground.