Innovation in Software

A friend just forwarded to me an article called “The Outsourced Brain” over at the New York Times. A sample:

” Until that moment, I had thought that the magic of the information age was that it allowed us to know more, but then I realized the magic of the information age is that it allows us to know less. It provides us with external cognitive servants — silicon memory systems, collaborative online filters, consumer preference algorithms and networked knowledge. We can burden these servants and liberate ourselves.

Musical taste? I have externalized it. Now I just log on to iTunes and it tells me what I like.”

This is going to gradually become a debate over the next few years as we pass more and more of our thinking and life over to algorithms. Stroustrup once said “Software runs civilisation”. I think we’re approaching the point where we can say “Software runs civilians”. There are obviously issues with this that need to be explored.

About a year ago I developed a hypothesis of what humanity would broadly look like 100 years from now. Some friends found my synopsis of this vision a little ridiculous: “You know the borg in Star Trek? That’ll be us”.

What I mean is that we are slowly moving our thinking out into the cloud and acting as one. Individualism is being lost, group-think is being encouraged. If that sounds a little Orwellian, can I just point out that we’re the ones encouraging it on ourselves – from CCTV cameras to collaborative filtering on Amazon – it is not being imposed on us.

The irony is that for all the menace of Borg assimilation and Orwellian dystopia in fiction, we are shaping parts of our society into something that mimics it in the hope it will lead to peace and harmony within society. Maybe it will, I don’t know.

The hope we have is that if we spend less time thinking about what music to buy, which directions to use to get somewhere, and trying to remember things we can get out of Google and Wikipedia anyway, we’ll have time for more important things. The question is what things are we doing with that time? Are we just filling that brain capacity with other trivia we don’t need?

Not for the first time, I feel that those of us styled “Software Engineers” have a responsibility to ask some questions here.

Whilst social photo sites like Flickr have grown over the last few years, many developers have been asking “now we have the resource, what do we do with it”. The first interesting application was tag clouds – it allowed you to see from the metadata in the system what was there and get an idea of how ‘heavy’ some concepts were. But what to do with the imaging itself? All those photos, and no easy way of making use of all the data they contained.

I’ve been ploughing through TED talks (no surprise that my favourite section is the What’s Next in Tech area), and have been meaning to post up lots of the talks, but one being discussed on a mailing list I’m on this morning is the demo of Photo Synth. Here’s the official video:

There are a couple of interesting things about this. Firstly, whilst the first half of the demo – a demo of Sea Dragon, a resolution independent image library – is interesting, there’s nothing truly novel about it. The only limitation stopping that system from being produced in the past is processing power. Every Computer Science/Software Engineering undergrad I knew had that idea whilst in the labs at University.

The second half though – the demo of Photo Synth – is what really grabs people’s attention. By computing vanishing points and common overlaps in images, it becomes possible to build a 3D representation of the object being photographed (in this case, Notre Dame) that you can take a virtual tour through. The applications are fascinating, not least because it takes mapping to a whole new level, and starts answering questions about what we’re going to start doing with all this social media.

One thing I noticed about that application, is if you upload a photo into a set that this software is processing, the software has to ultimately work out where you were in relation to the object. If just one photo in the set is geo-tagged (and many camera phones coming onto the market have in-built PS), I can work out your precise location. Now, let’s suppose you go on a tour of Paris. You take lots of photos all over the city. I now know your location when you were taking each of them. What’s more, the image will have within its metadata the exact date and time. I can, from that, construct a complete trace of where you spent your day from morning until night, with GPS-accurate location data, even though you didn’t have a GPS unit on you. Intelligence agencies are going to love this stuff…

Another interesting thought, is how this is being called a “Microsoft technology”. It wasn’t developed at Microsoft – they bought it in, and have worked out how to bring it to market. Well, when I say bring it to market, I mean do what Microsoft always do: make it available for Windows machines, but pretend the rest of the World doesn’t exist – the tech preview doesn’t work on Linux and OS X at the moment. This is a typical “flat World mentatility” prevailing at Microsoft I hope they’re going to change soon.

Microsoft are buying in a lot of innovation at the moment. They know they have a shortfall in innovative thinking (that’s what happens when your revenue is made up of sales of operating system software you can’t radically change and Office software everybody hates), but they have a big pile of money in the bank. By buying up the ideas and then pushing it out there, Microsoft are getting a lot of credibility within the geek community, and hopefully the idea-hungry culture will start to infect the rest of the company. I suspect a lot of people at Microsoft got a slight kick in the stomach when they saw Surface all over the web last month, simply because it’s such a radical change in how Microsoft looks at itself and answers the question “what is it we do?”

I have absolutely no respect for Microsoft, its software, or its business practices – I genuinely hope that for the sake of humanity the OSS community gets their act together and puts them out of business – but I’m starting to warm to some of the ideas and their employees.