Recently, I talked to Ori Inbar (above), formerly senior vice- president at SAP.  Ori is on a mission to make augmented reality commercially successful not in 5, 10, or 15 years, but now. Ori is the founder of Pookatak Games – a video game company, “with a vision to upgrade the way people experience the world.” Ori will be participating May 20th, in O’Reilly’s Where 2.0 panel, “Mobile Reality” -  an event not to be missed IMO.

The taste for computing anywhere anytime has entered human culture via the iphone and is spreading like chocolate cake and pizza at a preschool party (see why the iPhone changed everything).  And while the full flowering of the next step is yet to come – computing anywhere, anytime by anyone and anything (“the internet of things”), our love for these first devices capable of being mediating artifacts for ubiquitous computing (Adam Greenfield) is a vital first step to free us from our tethers to computer screens, and fulfill the promise of augmented reality.

If you need more convincing on the pivotal role augmented reality will play as the web moves into the world, check out Tim O’Reilly’s recent comments in this video clip posted on Augmented Times and here early last year.

From another perspective, the gloomy specter of economic and environmental catastrophe  is driving a movement to “infuse intelligence into the way the world work’s.” But the challenge for a smart planet is not just about making environments smart, it is about using smart environments to enable people to act smarter (see my interview with Adam Greenfield).

We need a rapid upgrade in both the way the world works, and the way we experience the world.

((Note:  It is time to read (if you haven’t already) Bruce Sterling’s Caryatids (Cory Doctorow’s book of the year for 2009) “as a software design manual” (see Julian Bleeker) because Caryatids reveals the Gordian knots of human folly, greed, compassion and desire entwined in near future designs for technologies to save the world.))

Ori Inbar, worked with Shai Agassi (Shai is now leading the world changing Better Place ) driving Netweaver from a mere concept to a “major, major business for SAP.” So Ori has already been through the cycle of working in a very small startup and growing it into a billion dollar business.  He has both the experience and the passion to realize his vision for augmented reality.

At Pookatak, he explains :

“We design “reality experiences” that make users’ immediate environments more significant to them. We wish to free young and old from getting lost in front of the screen. By delivering the world’s information to people’s field of view, and by weaving real world objects into interactive narratives, we help people rediscover the real world.”

Pookatak will release their first game this summer. Currently it is under wraps. But Ori gives us some glimpses of what is to come in the interview below.

In addition to founding Pookatak, Ori is involved in a broader effort to move augmented reality forward. On his blog, Games Alfresco – he recently welcomed a new partner, Rouli Nir, Ori has focused his eye of wisdom on every significant recent advance in Augmented Reality (check out this essence of Ori’s thinking in a fast paced video presentation for WARM ‘09).

Also Ori is one of the organizers of the interactive media track at ISMAR 2009.  At ISMAR this year, Ori explained, “we are trying to bring in people that develop interactive experiences for consumers, beyond the traditional attendees coming from a research perspective.”

In the interview below, Ori explains much of his thinking on how augmented reality will become commercially successful.  Enjoy it, think about it, and share it. And most importantly, if you can, get involved with ISMAR 2009.

Ori  has inspired me to participate in ISMAR this year.  Ori pointed out:

The call for papers is on, and this year it targets well beyond the typical research papers audience and into interactive media and art folks.

There are plenty of opportunities such as:

Art Gallery

Demonstrations

Tutorial

Workshops

It’s a huge opportunity to shape the emergence of augmented reality.

Interview With Ori Inbar

Making Augmented Reality Commercially Successful

Tish Shute: You are considered a key trail blazer in AR and you have the go to blog for augmented reality!  What are the most important lessons you have learned researching, writing, and developing AR in the last couple of years?

Ori Inbar: You need to have a vision. You need to know where this is going to go in ten or fifteen or twenty years. But you’ve got to start with something really simple that makes use of the technology you have on hand. And do something that is practical, that people will like, and something they would actually want to buy. Its as simple as that. I’m currently looking at what we could do with existing technology. First of all, you have to put it in front of people. Right now most people have never heard about the term augmented reality. Go into the street, and ask 100 people about it, maybe 2 would know about it. So you need to put it in front of people because most people think it’s still science fiction or a special effect you see in movies, not something you can experience in real life.

Tish: It seems to me to that for augmented reality applications to become popular with existing technology the key breakthrough would be getting people to hold up their phones. What are the obstacles to getting people to use their mobile devices like this?

Ori: There’s a really nice cartoon by Tonchidot (below) – the Japanese company behind the Sekai Camera. It’s an illustration showing the evolution of man, from ape to man (holding a cell phone looking down), to the developed man holding a device like a camera – in front of its eyes.

Which is exactly what you’re talking about. People ask, “are people going to walk with this like that all day long?” Probably not. I mean you have to build it in a way that doesn’t require them to hold it like that all the time. People are used to this gesture with the ubiquitous digital cameras. I tested one of my prototypes on a two and a half year old girl. She had no problem holding it just like she holds a camera.

Tish: Blair MacIntyre mentioned, “The problem with the mobile phone as a AR device is a problem of awareness,” i.e., you have to have a way of letting people know when there’s something interesting wherever they are. One of the issues regarding this is if you get too many alerts, then you tune them out.

Ori: First of all Blair is one of the people in academia that get it. Because he looks at it from an experience perspective. Not just as an interesting technical problem to solve. Let’s start with getting people to enjoy this new experience. The AR demos so far were mostly eye candies, and mostly for advertising – the GE AR ad created a lot of buzz; but you look at it for 10 seconds and you forget about it.  You need to build something that people would want to experience over time and would be willing to pay for. I think that’s the big test, right?

Now in terms of having a ubiquitous experience where you’re continously connected, it doesn’t have to be an overwhelming experience. Just like some of the social media tools we’re using today, we decide when to connect, and we filter out the trash. You could get alerts only for things that really matter to you, not for everything that happens in your immediate environment.

There will be many layers of information, and it’ll be up to you to pick the ones you want to experience. The real benefit is that you get the information in your own field of view and in context of where you are or what you do.

Tish: So what are you working on these days?

Ori: We are working on a little app that targets a very different audience than what you’d expect: pre schoolers. We think we can encourage them to get away from a PC or TV screen and learn something while playing – in the real world. You’ll hear more about it as soon as this summer. Nuff said.

But, it is a small application that will run on the iPhone. People ask how many pre-schoolers own iPhones? Well, their parents do.

Tish: Yes there are certainly many New York kids with iPhones – my kid now has my old iphone.  He has pretty much switched from playing games on his DS to the iPhone. I noticed in your WARM video you place a big emphasis on AR as something that will get kids away from screens and engaged with reality.  This is something parents will approve of!

Ori: Yes I saw something really interesting at my kids’ party one day; they were all sitting around the room – looking down at their own DS screens.  You could play the DS anywhere, but kids would usually play it on the sofa, looking at the screen, isolated from the world. With an iPhone and a camera, and the application we’re producing, reality becomes part of the game. Yes that makes it all of a sudden much more interesting for parents. Because kids are spending so much time in front of the screen, all of a sudden they’re something that will encourage them to interact with real objects, real things. Every parent I’ve talked to loves that idea.

Tish: Yes that is what is cool about the work of Kati London – I think I saw someone say this on Twitter, “Kati puts the computer in the game not the game in the computer.”

Ori: Yes, kids are spending more time in front of games and the computer because it’s more interesting. It captivates them with “game pleasures ” that tap into their brain’s dopamine circuitry – constantly seeking reward and satisfaction. So you’re not going to be able to tell them to go back to playing in reality without these pleasures. We have to study these mechanics from games and bring them into reality. It’s about programming real life; and augmented reality helps you achieve that.

Here’s an example: cause and effect; in a game when you do something you always get an immediate effect. You’re good, you get a reward. You’re not good, you get a cue to improve. In real life you do things and you could wait 2 or 3 years until you actually get feedback (if you’re lucky). Augmented Reality allows you to bring these mechanics into the real world. I think that’s going to help kids rediscover reality, in a new sense, which is what every parent is dreaming about.

Tish: I don’t know how much you can say about your app. But in regard to doing augmented reality on the iPhone.. there’s no compass. Is this a limitation?

Ori: True, no compass yet. But the camera gives you a lot of information that you can interact with. When you run the application, you see the world in front of you, and if the app can recognize real life objects – it can put virtual elements on top of it.

Tish: But not with any accuracy unless you’re using markers. Are you using markers?

Ori: We’re using natural feature recognition. It doesn’t have to be an ugly looking marker. It can be any image.

Tish: So you’re using image recognition. Are you working with one of these image recognition startup companies (list here )?

Ori: We’re working with one of those. What’s unique about it is it runs very nicely on any cell phone, and on the iPhone it works the best. For this first app, it doesn’t really matter where you are physically; the geolocation is not part of the experience.

Tish: For a truly engaging AR experience we will need more of a backend than is currently available?

Ori: I call the backend the cloud, where you have all this information and ways to access it from anywhere. Actually I think it’s become pretty mature today. If you look at the different elements required to enable an augmented reality experience to work, you have – first – the user whose always in the center. Then you have the lens. The lens can be an iPhone, or glasses, even a projector. The lens allows you to watch, sense and track information in the real world: people, places, things. Then in the backend you have the cloud where you store and retrieve information.

So if you look at the maturity of these different elements, I think the cloud is in pretty good shape. Because there’s so much information we’re collecting and storing. Anything from Google, Wikipedia, Facebook, all that kind of stuff, it’s a lot of useful information you can access from anywhere using APIs. And a lot of it is also starting to include geolocation information. Take Loopt or Google’s friends service that allows you to see where your friends are and what they’re doing. There’s tons of information out there and it’s pretty easy to access it. Now what do you do with it is the question?

Wikitude is such a simple and brilliant application and nobody thought about doing it until this guy from Salzburg did. It doesn’t have any sophisticated visual tracking. It knows your position and it’s simply looking at the angle you’re pointing to. Based on these parameters it brings information from Wikipedia that pertains to your field of view. So most of it was already there. It’s just a matter of connecting the pieces in an experience that is valuable for people.

Tish: It is the uptake of even a very simple technology that puts the magic in it.

Ori:  Yes, take Twitter. If you go to its homepage it looks like a very simple boring app but it is something that is both enjoyable and very useful to people.

Why you should participate in ISMAR 2009

Tish: I know that you are involved in organizing  ISMAR (picture above from Ori’s post on “ISMAR 2009: The World’s Best Augmented Reality Event…,“) and there is a call out for papers and for volunteers, can you tell me more about it?

Ori: Yes, we hope to have the first ISMAR where we practice what we have just discussed: let’s build on all the research invested so far and instead of thinking only about 5-10 years from now, let’s see what we can do today. So we are bringing people in from other disciplines – artists, interactive media developers and people from the entertainment industry.  The goal is to use the technology to make something interesting for people – again, something that people would buy, and making it commercially successful.  Many people either don’t know about ISMAR because in the past it was a pure engineering-orientated event and people  from a commercial perspective of AR weren’t attracted to it.  The Chair of the Event this year is based in Florida and he is going to bring in a lot of people from the entertainment industry such as Disney. I think this will transform this event into something more like SIGGRAPH – more of an industry event.  As one of the organizers of the interactive media track we are trying to bring in people that want to build applications for consumers.

Tish: In terms of AR applications what are the flagships today?

Ori: There are very few because it’s just the beginning. There’s one tiny studio in France called Int 13 . They’ve created maybe the first commercial game running on a mobile device using AR technology. It’s called Kweekies. It was one of the contenders for the Nokia Mobile innovation awards. They were one of the ten finalists, but they didn’t win it. It’s looks really cool. It’s somethng that runs on your desk, with a marker. Many AR folks say markers are the past, markers are ugly. But it’s still a cool experience. I think people will go for it.

Tish: Yes I think we will have to look to small companies that are free to think creatively to lead the way.  It seems many games companies are tied up pulling off huge big budget projects and enterprise is still catching up on how to use social media!

Ori: Yes, last year I was in the game development conference (GDC); there was no mention of augmented reality – not on the exhibition floor, none of the sessions, nobody talked about it. I was stunned. Then this year, there was a little a change. There were like three demos on the exhibition floor, Metaio, Vuzix and a Dutch company called Beyond Reality.  And then there was Blair’s talk, which was very very cool. The room was packed with people. And after the talk there were dozens of people lining up to talk with him about the topic. There was definitely interest, but still on the very edge. The video game industry is still a hit driven business and publishers spend upward of 20-30 million dollar to create the best AAA game possible. They just can’t take the risk. So it’s going to come from smaller companies, from outsiders coming in with a vision and understanding on how to put the AR pieces together to create a totally new experience.

Tish: But the basic tool set is there isn’t it?

Ori: I talked to some folks at the games developer conference, many folks with MMO background, and they have great ideas about AR. It’s great to see different people with different views on what’s needed first. “Joe the Programmer” had this idea of creating a small piece of hardware that you can put in every house and provide accurate geospatial information in your home. That could  open up many opportunities for AR experiences in homes.

Tish: Don’t you think we have enormous resources in terms of image databases that provide a great basis for augmented reality.  I was talking to Aaron Cope at ETech about The Shape of Alpha – Flickr’s vernacular mapping project using all the geotagged photos in Flickr. That is such cool project. Aaron will be speaking at Where 2.0 also.

Ori: Think of Google Earth. Google Earth leveraged communities to basically map all the major cities around the world into 3D models. And that is an essential step to be able to do augmented reality outdoors. Because if you had to model everything from scratch, it wouldn’t be realistic.

Augmented Reality and Becoming Greener.

Tish: I am really interested in how AR interfaces might be useful to some of the emerging energy identity/metering projects like AMEE and WATTZON because I think it is very important that people have very intuitive, immediate, and enjoyable ways to relate to energy data so they can make greener choices.

Ori: Back in the day I had an idea to build an Augmented Reality application to become greener. You look at things around your home with the camera and it  recognizes its green gas footprint and makes recommendations to reduce it.  I guess it was a bit too early to do that based on visual recognition alone…you’d need  additional sensors that would provide related information about what you are looking at.

Tish: Well as there is more interest in Green technology do you think we may see VC interest in some green AR projects now?

Ori: I talked to some of the investment folks, Angels as well as VC’s about AR and they had no clue what it is. There’s a need for a whole lot of education. And there are no proof points (as in successful investments in this domain), and counter to popular belief – they don’t like risk so much…

Tish: And consumer adoption must lead the way, right?

Ori: Just like with every emerging technology in history, people never bought the technology, they bought the content, the apps, the benefits that came on top of the technology. Whether it was VHS winning over Beta Max, or BluRay winning over HD. It’s always because of more/better content. Look at the video game console war: Xbox, and Nintendo did better than Sony just because they had more and better games. Even Windows was a success thanks to its applications. People bought it for the applications not the OS. The content is the first to drive demand.

Tish: One of the challenges to giving people new ways to relate to their energy consumption is that you can just have them looking at graphs of how bad they have been in the past you – that may make them feel bad but that doesn’t necessarily give them ways or motivation to change. There perhaps needs to be more immediate relationship to the data to facilitate change. I think the mantra for optimization of anything from energy usage to supply chains is timely, actionable data?

Ori: There are a lot of ideas about measuring information and displaying it to people. For example, the Prius hybrid car, one of its interesting features – which is kind of game like – is a constant display of your current fuel consumption. That alone changes how people drive because they try to beat the “Score” and as a result conserve more fuel. That model can be applied to our homes…

Tish: Yes that is something I am very interested in. I have been following several projects in this area – one of my favorites is the Arduino, Current Cost/Tweetawatt, Pachube integrations I saw at Homecamp.

You joined a start up with Shai Agassi which was bought out by SAP right? He has a brilliant approach with Better Place.

Ori:  I think what’s really unique about Better Place’s approach is that he doesn’t require people to change their behavior. People are still going to have their own cars. They’ll be able to drive as far as they want, and for the same (or lower cost). Its not necessarily about a new technology, electric cars have been around for a long time but there was no way people were going to be limited by the 50 or 70 mile range and Better Place is solving that problem. With its infrastructure of charging spots and battery switching stations, drivers are going to be able to drive anywhere. And it’ll be similar to having to stop once in a while to refuel your car. The price maybe even lower than what you pay today for your transportation needs – and you’ll stop generating green gas. It’s a clever way of taking technology to a whole new level without changing the behavior of people.

Tish: Better Place is a classic example of things as a service isn’t it?  It is basically a utility company.

Ori: It is similar to a phone carrier model.  You pay for a membership that gives you access to the car (equivalent to the phone) and electricity (equivalent to the phone line) for the same price of fuel cost today. And as bonus you get to save the world.

How the iphone changed the game for AR – and the iphone versus Android

Picture from Ori’s post, “GDC 2009: Why the iphone changed everything”

Ori: And back to AR, you have to take the same approach, because nobody’s wants to don those huge head mounted displays or backpacks. You have to take advantage of people’s current behavior: they already carry their iPhones or similar devices.

Tish: As we discussed, you just have to get people raising up their phones and looking through them when that is a useful thing to do. Both Wikitude and Nathan Freitas’s graffiti app were enough to get me interested in the evolutionary step of raising my phone! Nathan’s graffiti app is nice. You leave a marker for your graffiti so other people can find view/add their own – a nice primal experience like pissing on the lamp post to let your pack know where you’ve been.  Also the graffiti app taps into a long history of  NYC street culture around tagging and graffiti art (see my interview, “Is it OMG finally for Augmented Reality?”).

Ori: The app store has fundamentally changed the mobile gaming industry. Last year they were in shambles. There was no growth. Everybody was complaining, “we can’t handle it, there’s a million phones, and you have to test it on each phone. And carriers suck, they don’t care about sharing and promoting your content. Everything was bad. This year mobile gaming is the hottest thing. And it’s all because of the iPhone. It changed the game.

Tish: How do you think Android is going to get traction against the iphone?

Ori: Well the number one thing is the form factor – the iPhone is just much cooler than the G1. Its OK but it doesn’t have the same feel. People thought it was going to be easy to clone the iPhone but none of the attempts succeeded so far.

Tish: How much does it matter for AR not being able to runs things persistently in the background on the iphone?

Ori: Actually they have add a such a capability in OS 3.  You can now make use of a background service.

Tish: OS 3 will open up new possibilities for AR?

Ori: The access to the video API is still not public.  But there is a new Microsoft application – Microsoft Tag that makes use of that API which means it is probably OK to use it.

Tish: (I ask Ori for his card and he shows me how to read it with my iphone.) Oh nice you have an AR card, of course!

In Search of Pong for Augmented Reality

Tish: So how will AR begin to, as Blair’s friend put’s it, “facilitate a killer existence,” particularly as we are probably looking at some new and perhaps pricey hardware?

Ori: You could take the Better Place approach. We’re going to give you a great experience and we’ll include the devices as part of that experience for the same price. Let’s say you subscribe to an AR experience  which offers access to multiuser, support, and all the information you need wherever you go – exactly according to the vision. You pay for a subscription on a monthly basis and included in that cost we give you a better device that offers a  better AR experience. It’s following the phone carrier approach, but in a good way.

But first of all we do need our Pong! I was sitting with a couple of AR game enthusiasts at the GDC and we were asking ourselves, “how do we create the first pong for AR?”

Was Pong a multiplayer game? Not necessarily! Did it connect to the network? No! We have to create the first dot in a long line of dots that will bring us to our destination.

Tish: You haven’t seen a Pong yet have you?

Ori: Not yet. I mean there’s maybe a handful of games and apps out there, but I don’t think any of them is a Pong yet. Still, it’s getting closer.

Tish: Kati London is doing some very interesting work on bringing games into reality, isn’t she?

Ori: Yes, she works with Frank Lanz at Area/Code. He teaches at NYU and has designed games for the “Come Out and Play” festival here in Manhattan. And a lot of these games are actually low tech.

Tish: Yes I have a big alternate reality game blog brewing that I haven’t had time to write yet!

Ori: The city is the gameboard is their slogan. It’s going to be a great playground for AR games. The city becomes a theme park. The city could become an even bigger touristic attraction. People will come to the city to be part of these games. So you’re having thousands of people running around the city playing all sorts of games from laser-tag style to history adventures, to treasure hunts.

Composing Reality

Tish: So why haven’t you focused on one of these kinds of games with your company?

Ori: We have a couple of scenarios along these lines that we’re planning for 2010-11. But first focus on what’s possible today.

Tish: And what’s stopping you from doing those kind of games today?

Ori: Many things. The devices are not there yet, location services are not accurate enough, ubiquitous sensors are not  there yet.

Tish: You think alternate reality gaming needs more “ubiquity” than is currently available?

Ori: Not necessarily. People are doing alternate reality games with no “ubiquity” at all. But my interest is to add the visual aspect. I believe humans are mostly driven visually.

Jane McGonigal said in a talk at GDC, that AR would allow us to program reality, which is exactly how I look at it. Once you can recognize things, some of it with WiFi and RFID and all sorts of sensors. But visual sensors is always going to be the ultimate way to recognize things. And once you recognize things and know what they are, and can pull information about those things (or people and places) from the internet, you can program it (visually). You could program it to be fictional, like in a video game, or it could be programmed as non-fictional, like a documentary. And that allows you to do things that before were unimaginable.

Tish: But you can’t forget the visual, it is primary the connection to peoples’ primary sensory relationships.

Ori: Yes, it’s like you go to a grocery store and you pick your vegetables, a lot of it is by sight and by touch. And what if you could also see just by looking at it that it’s from a local store, and that it’s organic?

Tish: It goes beyond overlays really?

Ori: By the way, I don’t like the term ‘overlay’. I know that’s how it looks: you either overlay or superimpose, but I’m still searching for a better term. A term I prefer to use is “composing reality”. Just like painters, they use brushstrokes and colors and compose a painting. We need to take the real element and the virtual element and compose them into something new. It’s not just about slapping one on top of the other.

Tish: yes I think the idea of dashboards is not so appealing.

Pookatak Games

Tish: Do you want to explain the evolution of your company? You have an interesting history of success with high end enterprise applications.

Ori: Since I was a kid I wanted to invent and create things. When I discovered software, that was a really cool way of actually creating things from nothing. From thin air; and you can do it very quickly. That’s what brought me into software. But I was always looking for the intersection between technology and art. Looking for ways to bring these things together. In the early nineties virtual reality was doing it. It had the appeal of cutting edge technology that can be combined with art. But then, as we all know, it crashed. So I joined Shai Agassi’s startup (who is now doing Better Place) back in the early nineties. I was one of the first employees in his startup which was developing multimedia products. I was leading the development of one of its flagship product. At some point we realized the technology could be great for an enterprise environment.

It was a really great experience. First going through this cycle from a very small startup and growing into this multi billion dollar business. I was responsible for defining and marketing SAP’s platform, which was called Netweaver. It was just an idea when we joined SAP and by the time I left it was a major, major business for SAP. I learned about the challenges of building a platform. No matter what purpose you’re building it for, it typically has similar rules. It’s definitely not just about the technology; the content that comes with it is really key to making a platform successful.

The third part of this platform trifecta is the community. If you don’t build a community, you won’t get the critical mass required for adoption. It may be your own platform but it’s not necessarily the people’s platform. That experience is very key to what we’re doing today. Now, a new industry is being born on the basis of a remarkable technology. But to drive adoption, first we’ll need good content. The content will be created using today’s technology with internal tools developed to simplify the process. Next step would be to make the tools used internally – available to other developers. Help scale the industry, enable innovation on a larger scale. That way we have a chance to create a platform. So it isn’t really just about my company. I’m so passionate about augmented reality, I want to it to become a healthy and successful industry for the next 5, 10, 15 years.

Tish: Yes I am so ready to be liberated from the sitting behind a computing screen! And I know that all this hardware is murdering the environment.

Ori: There’s ‘s the book by Rolf Hainich which is called “The End Of Hardware. ” It’s about hardware for augmented-reality. Once you use goggles or other AR interfaces you eliminate the need for screens, laptops, etc. It’s going to be great for the environment. You have read Rainbow’s End, right? According to the book in few years there will barely be any (visible) hardware. At least it’ll have a much smaller footprint for the environment. And it’ll touch every aspect of life, everything you do. It’ll change the way you interact with the world.

The Illusive Eyewear for Immersive AR.

Friend of Ori’s in San Francisco wearing retro AR goggles (from Games Alfresco, Ori’s roundup of GDC 2009)

Tish:OK lets talk about goggles.

Ori: Goggles are going to happen, we want to be hands free.

It’s going to happen because it’s just a more intuitive way to use this technology. But above all it has to look cool. Because if it’s not, if it’s a big headset, then maybe a small percent of the population might use it, but most people won’t. It has to look like an accessory, like new cool eyeglasses that you just must wear.

I recently talked to a friend, who runs an industrial design firm, and has experience in designing such glasses for companies like Microvision and Lumux. He says that when you try to bring the images so close to our eyes – there are some really hard problems to solve. Otherwise it can become really annoying and cause dizzyness.

But I’m optimistic. I believe it’s going to happen 3 to 5 years from now. It’s already starting now: Vuzix announced goggles that will be available this year. Some AR apps that are going to take advantage of next year. Initially only a fraction of the population will use it. And that’s going to help advance it and make it better and better. But it’s going to take time until it reaches the mass market.

Tish: In virtual worlds we have seen, I think, a lot of mistakes in terms of reinventing the wheel and producing too many proprietary versions of the same thing and not enough concerted effort on standards and open platforms that could create a vibrant ecosystem.  How can augmented reality not make the same mistakes?

Ori: There are some early AR open source efforts ARTookit, ARtag but it is not a movement yet.  One of the things we’re trying to do at ISMAR this year is to put together  discussions around key industry issues, such as standards. Some people say it’s too early, you have to have a defacto standard to start from. But pretty soon it’s going to be too late. Just like with virtual worlds, all of a sudden you have all these islands that don’t talk to each other. Why get to that point if we can plan to avoid it? Let’s start thinking about it right now. On the other front there are devices. There are pockets of people working on adapting devices for AR, second guessing the hardware companies. Why not get them together with the Intels and Nvidias of the world, and discuss what this device should be able to do. And then compete to make it happen.

Tish: How much luck are you having with this discussion part?

Ori: People are very interested in doing this. We proposed these panels for ISMAR. And I’ve got some key people already on board. They have tons of input, they want to get involved. We’ll see how much we can actually get out of it.

Tish: In virtual worlds it was a while before vibrant opensource communities developed.  OpenSim has I think been the breakthrough community in this regard.

Ori: You have to think about the elements up front. The dream job is to architect the industry. Say we agree on the required pieces. Then we could help the right companies succeed in delivering the pieces. Next, we have to collaborate so that these pieces talk to each other. And eventually these communication methods will become defacto standards and most developers will adopt it.

Tish: So I’m going to put you in the role. You’ve got your dream job. You’re going to architect this community. So what are the key pieces and where would you like to see the open source communities take hold first?

Ori: Open source will not be exclusive. It’s going to live side by side with proprietary technology.

The key pieces? You have the user at the center. And the user interacts with a lens. The lens includes both the hardware and the software. And then the lens senses and interacts with the world, which includes people, things and places. And these people-things-places emit information – about who they are, where they are, what they’re doing, etc  – which is then stored in the cloud.

And then you have the content providers, the people and companies, composers who weave AR experiences through the pieces we mentioned before. These composers need a platform that glues these pieces together. Pieces of the platform will be on the lens, and in the world, and in the cloud. If you manage to remove the frictions, and connect these pieces into an experience that people like – then you have a platform. What the platform does it reduces the overhead and accelerates innovation.

Tish: Another problem virtual worlds faced in their development was their isolation from the world wide web.  Will augmented reality avoid this plight?

Ori:  Yes, I believe the key, like you said before, is not to reinvent the wheel. The cloud is already there.  Take Wikitude for example, all Mobilizy had to do is build  a relatively simple client app, connected to wikipedia, and all of a sudden it offered a wealth of information in your field of view.

I think we can learn a lot from web 2.0. For example, in order to have a ubiquitous experience like Robert Rice and others are striving for, you’ll need to 3d map the world. Google earth like apps are going to help but it is not going to be sufficient. So let’s leverage people. Google became successful in part by making people work with them.  Each time you create a link from your blog to my blog their search engines learn from it.  So let’s find ways to make people create information that can be used for AR.

Ori Inbar directed Wiki Mouse – a WIKI Film co-created by a swarm of movie makers around the world.

HomeCamp is a home hacking, automation and green technology community that will be gathering in London tomorrow, Saturday 25th April 2009, 10am until 6pm BST (GMT + 1), and in an OpenSim event running alongside for virtual participation, to brainstorm new possibilities for distributed sustainability, creative smart meters, monitoring, graphing and visulaizing energy usage.

More details and videos on the blog. The wiki, which includes signup, is the main portal to all the online activity.

As James Governor notes here:

there has been a huge amount of code and applications released focused purely on using technology for home energy monitoring and automation.  We have an active google group and quite a few videos and content showcasing the various applications and hardware currently being used by geeks to save money and live greener.

Now the challenge is to see how this seedling home energy management movement can really grow into widely adopted distributed sustainability solutions that everyone can use, and participate in.

Both Chris Dalby (see here), Andy Piper, James Governor of Monkchips (see here),  and Tom Raftery of GreenMonk (see here), have posted on tomorrow’s HomeCamp event. So I am just going to add some quick notes, especially to highlight some of what will be going on virtually for those of you, like me, who can’t make it to London.

You can tune in either on the live video ustream, or sign up on ReactionGrid and join the OpenSim event. Also, you can keep up on what is happening on Twitter #homecamp. I highly recommend that you catch Tom Raftery’s talk which will be streamed from Spain live into the London meeting, the OpenSim event on ReactionGrid, and Ustream. Tom Raftery, a leading Green technology analyst at RedMonk (see also GreenMonk), will be picking up, in depth, on some themes raised in his brilliant ETech 2009 presentation, “Electricity 2.0: Applying the Lessons of the Web to Our Energy Networks.”

There will be homecampers dropping in to virtual homecamp in ReactionGrid throughout the day, including Chris Hart (the awesome “girl-geek”@dstrawberrygirl), MiketheBee, and Cminion, who has a number of cool projects to demo, including his energy turbines.  Dave Pentecost (pictured above with his Tweetawatt, Pachube Orb) and I (see our presentation for EarthWeek SL here) plan to be at Virtual Homecamp on ReactionGrid between 9am and 10.30am EST. Dave has done a number of cool energy monitoring hacks including a Pachube link to and from OpenSim.

Also keep your eye on Dave’s blog, The Daily Glyph, for what’s new in distributed sustainability. Dave just posted some great links on Sustainable Interaction, design and work by ITP researchers and others in sustainable use of technology.

Sustainable Interaction | Main / Papers

Sustainable interaction design | Sustainable Minds

Design For the Other 90% | Cooper-Hewitt, National Design Museum

If you are in London, look out for Oliver Goh of Shaspa as Oliver will be at Homecamp in London. As I mentioned in my previous post, Oliver will soon be launching both Shaspa commmunity and enterprise hardware and software packages for “Intelligent Energy Management.”

For a bit of homecamp history, James Governor (picture below from Chinposin), recaps  some of the successes of  the first HomeCamp here.

And last but not least, a big thanks to sponsors, CurrentCost, Greenmonk, Pachube, Onzo, and ReactionGrid,  and media partner theattick.tv who are making the London and virtual homecamp events possible.

]]> http://www.ugotrade.com/2009/04/24/homecamp-2-home-energy-management-and-distributed-sustainability/feed/ 2 http://www.ugotrade.com/2009/04/19/sensor-networks-and-sustainability-connecting-real-virtual-mobile-and-augmented-reality/ http://www.ugotrade.com/2009/04/19/sensor-networks-and-sustainability-connecting-real-virtual-mobile-and-augmented-reality/#comments Sun, 19 Apr 2009 06:32:59 +0000 http://www.ugotrade.com/?p=3381

Today, I did a presentation, on connecting real, virtual, mobile, and augmented spaces to support sustainability, for Earth Week SL, with Dave Pentecost and Jim Purbrick, who presented on Carbon Goggles.

Dave and I focused on sensor networks, open data, Pachube, OpenSim, and sustainability from perspective of, “hack local, think global.”  Dave and I will be picking up on some of these themes of sensor networks and sustainability next week in our presentation with Dimitri Darras at ITP,  NYU, Aprl 24th, 6.30 pm to 8 pm – details here.  If you are in New York City, I hope to see you there.

We got some interesting insights into augmented reality from Jim Purbrick whose Carbon Goggles project prototypes how we can use augmented reality to read carbon identity and to combine well organized, verified data from AMEE – a neutral aggregation platform to measure the “carbon footprint” of everything on earth, with crowd sourced tagging and linking.

Shaspa – “the sensor network system that has it all”

We also discussed, recently launched, Shaspa. Shaspa’s energy management packages connect spaces – real, virtual, mobile and augmented.  Shaspa has been blogged  by Maxping and Virtual World News, so you can read all about it, but the Shaspa device kit won’t be available until next week. Some key features of the Home Energy  package are listed on the slide above.  However, this evening, Dave Pentecost and I got a sneak preview of both the Shaspa commmunity and enterprise hardware and software packages from Shaspa founder Oliver Goh. We were pretty impressed.

Dave: “It’s the ultimate hackable device for energy management!”

Oliver: “Bring us any sensor device – with documentation, and within three days we will put a driver into Shaspa.”

Oliver is on the right and Dave on the left in the picture above. The picture below shows Shaspa in OpenSim. Oliver and I will be attending the 3D Training, Learning and Collaboration Conference in Washington, DC, next week.

Links

Here are some of the links that came up in the presentation as many people asked for them to be published. Dave also has them on his blog.

SLIDES on GOOGLE DOCS:
Earth Week SL Presentation, April 18th, 2009 – Google Docs

Pachube, sensor networks

Dave’s blog covering Maya archaeology, jungle ecology, and technology

Maya Frontier, Usumacinta River videos

Collapse

Arduino

Pachube – tutorials

Pachube Apps -

Arduino-SL-Pachube data site

SL to Pachube site

Dave’s Danger Shield – Pachube tutorial

TweetaWatt site (LadyAda)

Dave’s post on TweetaWatt to Opensim/SL

Peter Quirk’s post on Importing Sketchup into RealXtend

Opensim

RealXtend

ReactionGrid

homecamp

cminion -wind turbines in OpenSim

MiketheBee

Is it “OMG finally” for Augmented Reality?

Smart Planet: Interview with Andy Stanford-Clark

Orange Cone – Information Shadows and Things as Services

Usman Haque (architect and director, Haque Design + Research) and founder of Pachube pointed me to this image from T.R. Oke’s book, “Boundary Layer Climates” (original photo source Prof. L. E. Mount’s The Climatic Physiology of the Pig) to explain his approach to the “software” of space.

My focus as an architect has always been to consider what I’ve called the “software” of space (sounds, smell, light, temperature, electromagnetic fields, social relationships, etc.) rather than the “hardware” (floors, walls, roof, etc.) as it has traditionally been considered. The image (above) really sums up why I think this is important.

It’s the same piglets, in the same box, but on the right hand side the temperature has been increased. This small change in how the space is “programmed” has dramatically changed the way the ‘inhabitants’ relate to each other and how they relate to their space. This approach to architecture became my challenge: how to translate such strategies into the general architectural discourse and how to bring into reality such possibilities for the construction industry.

“Connecting Environments, Patching the Planet”

Pachube is the culmination of 12 years of work.

“It is now occupying pretty much all my time and will do for the foreseeable future,” Usman told me.

Haque Design + Research is not foregrounded on the Pachube site. And I did not make the connection at first. But when I followed a small link at the bottom, I was soon delving into the work of Usman Haque.  Then the penny dropped and I realized that Pachube is not only:

A web service that enables people to tag and share real time sensor data from objects, devices and spaces around the world, facilitating interaction between remote environments, both physical and virtual.

Pachube is also a really big idea.

Ubicomp and the “Software of Space?”

Usman suggested that, if I really wanted to go back to the beginning of the Pachube vision, I should check out the work of Dutch architect Constant Nieuwenhuys and his 1956 proposal for a visionary society, New Babylon

Usman explained:

Constant Nieuwenhuys is certainly an inspiration for Pachube. He envisages a globally connected architecture, built by its inhabitants – configured, reconfigured, reappropriated…

For a more contemporary reference, Usman noted there are lots of overlapping concepts with Adam Greenfield’s work. Adam is head of design direction for service and user-interface design at Nokia. see Everyware: The dawning age of ubiquitous computing, and Urban Computing and its Discontents to understand more about the vision Adam Greenfield has been developing.

Pachube is right in the zone with the ideas outlined in The project description for Adam Greenfield’s upcoming book, The City Is Here For You To Use:

The City… takes everything explored in Everyware as a given, and a point of departure.

It assumes that emergent technologies like RFID, mesh networking and shape-memory actuators…will simply be part of how cities will be made from now on…

The Pachube Team

The Pachube Team – Usman Haque (creative director), Chris Leung (EEML developer), photoshopped laptop: Chris Burman (“example-maker”. e.g. SL code and Google SketchUp plugin), Ai Hasegawa (graphic designer), Sam Mulube (technical producer and website development).

Also, with Bruce Sterling as a “visionary” adviser and other luminaries involved, Pachube has some brilliant guiding lights.  Usman pointed that many people have “have helped, prodded, nudged and advised along the way!”

Along the way I became interested at times in what an “operating system” might mean in the context of architecture (paper,  Hardspace, Softspace and the possibilities of open source architecture, 2002 (PDF), particularly an “open source” operating system (Urban Versioning System, http://uvs.propositions.org.uk/ ). I was also interested in developing tools for supposedly “non-technical” people to start building their own interactive systems or environments, hence the release of The “Low Tech Sensors & Actuators for Artists and Architects” pamphlet , co-authored with an old friend, Adam Somlai-Fischer, back in 2005.

An off-shoot of this has been an obsession with trying to rescue the concept of “interaction” from oblivion – I say oblivion because I think the really exciting possibilities of the concept of interaction are being lost because we’re being sold a billion so-called “interactive” devices and gadgets that are, in fact, merely “reactive”. In this, I turn often to the work of cybernetician Gordon Pask, particularly active in the 50s, 60s and 70s in the development of truly interactive systems. (And also a collaborator with Cedric Price, one of my favourite architects).

Which brings me to Pachube, which is now occupying pretty much all my time and will do for the foreseeable future. (Haque Design + Research still continues, and has a separate team — it will be involved mostly in the kinds of things it has in the past, but also in pushing development of things that *use* Pachube, such as the project Natural Fuse ).

Pachube came about as a direct attempt to enable the production of dynamic, responsive, conversant ‘environments’. It basically evolved out of three strands of thought.

The first was the notion of the geographical non-specificity of architecture these days. By this I mean that, for many of us now, “home” is an idea constructed from several places –we live and work in environments composited by networked technology from fragments that bridge huge geographical distances. These environments are resolutely “human” (in the sense of being inhabited, designed and determined by people) yet context-free (because they do not privilege geographical location). I wanted to find a way to “connect” up remote spaces, much like Remote Home and a whole range of other projects had done, but in a generalized way so that it would be possible to keep adding to the ecosystem of connected environments on an ad hoc basis; a global architecture if you will.

The second strand of thought came from the desire to open up the production process of “smart homes.” I’m concerned by developments in ubiquitous computing whereby “making technology invisible” equates to placing the design and construction process solely in the hands of knowledgeable others. Whereas it’s still possible more or less to do DIY on your home, if many ubicomp technologists had their way it would become less and less possible simply because of the complexity of reverse-engineering such closed-systems. It’s already a problem with larger buildings: service companies go out of business, proprietary skills or tools disappear and complex lighting and sensor systems remain unused. So, with Pachube I wanted to help foster a more open way of developing the discipline: to embrace the concept of the maker, and to help people negotiate their technological future.

Reconfigurable House, an environment constructed from thousands of low tech components that can be “reconfigured” by its occupants.

The final strand of thought relates to Pachube’s emphasis on “environments” rather than “sensors.” I believe that one of the major failings of the usual ubicomp approach is to consider the connectivity and technology at the object-level, rather than at the environment-level. It’s built into much of contemporary Western culture to be object-centric, but at the level of “environment” we talk more about context, about disposition and subjective experience. An ‘environment’ has dynamic frames of reference, all of which are excluded when simply focusing on devices, objects or mere sensors. If one really studies deeply what an ‘environment’ is (by this I mean more than simply saying that “it’s what things exist in”), one begins to understand that an environment is a construction process and not a medium; nor is it a state or an entity. In this I would refer to Gordon Pask’s phenomenally important text “Aspects of Machine Intelligence” in Nicholas Negroponte’s Soft Architecture Machine though it makes for extremely tough reading (Negroponte compared it in importance to Alan Turing’s contributions to the computer science discipline).

Ultimately, though, Pachube is here to make it easier to participate in what I expect to be a vast ‘eco-system’ of conversant devices, buildings & virtual environments. Pachube will facilitate the development of a huge range of new products and services that will arise from extreme connectivity. It’s relatively easy for large technology companies like Nike and Apple to transition into the Internet of Things, but Pachube will be particularly helpful for that huge portion of smaller scale industry players that *want* to become part of it, but which are only now waking up to the potentials of the internet — small and medium scale designers, manufacturers and developers who are very good at developing their products but don’t have the resources to develop in-house a massive infrastructure for their newly web-enabled offerings. Basically, having built a generalized data-brokering backend to connect physical (and virtual) entities to the web, others can now start to build the applications that make the connections really useful.

Tish Shute: You mentioned that both Bruce Sterling and Gavin Starks (AMEE) have given input on Pachube.  Can you describe any specific ways they (and others?) have influenced the evolution of Pachube? You mentioned the concept of “engaged responsible spime wrangling” when we talked on skype?

Usman Haque: Yes, I am very grateful to a whole bunch of people who have helped, prodded, nudged and advised along the way!

I asked Bruce to be a “visionary” adviser because he was one of the people early on to envisage the concepts and ramifications of “spimes”  (his neologism for ‘space-time objects’). While I agree that “spimes” are directly relevant, what I found most important from his conception was the concept of “wrangling” – being actively and productively engaged and responsible in the development of spimed environments. I think it was a crucial leap: to talk about “wranglers” rather than “end-users”. So the kinds of questions I’ve turned to him for regard how to nudge people away from being “end users” and towards being “wranglers”; and about how to transition from being a “hacker toy” to “major infrastructure”. He had some great (and invaluable) responses, of which one of the most important to me was something he said in email: “…I think total openness is fatal.  It’s like lying in a blazing sun under a sky full of vultures, naked. It’s also rather rude, like babbling anything or anything that flies into your head and still expecting people to pay attention.”

Gavin Starks and also Dopplr’s Matt Biddulph have been sort of “friendly neighbours” to Pachube: they’ve made some great introductions and I turn to them often for advice on being a London start-up. What’s been really useful for me is that they are active in a related area and have directly useful advice: Gavin, of course, since he’s involved in metering the world’s energy; and Matt perhaps less tangibly in his day job as Dopplr’s CTO but more so in his active Arduino-enabled social life!

One very important Pachube advisor has been Dr. Paul Pangaro, who has previously been CTO at a number of technology startups, and brings vital experience from his time at Sun Microsystems as Senior Director and Distinguished Market Strategist. (Oh, and he’s also a former student and collaborator of Gordon Pask’s!) He has been very helpful in developing a viable business model in conjunction with my brother Yusuf Haque, who, with his experience in raising capital for startups, has led the fundraising process.

Of course, direct daily input from the Pachube team has been vital to the development of the project, and without Chris Leung (EEML development) and Sam Mulube (backend development) it would be a very different thing indeed!

Tish Shute: Now the emerging internet is the world as a networked, enhanced virtual/reality environment – sorry about the inadequate terminology, but as you said “the distinction between real and virtual is becoming as quaint as the distinction between mind and body”. You are participating in the Sentient City exhibition organized by the Architectural League of New York for September 2009.

Could you explain more about the Sentient City project and what your contribution Natural Fuse which uses common house plants, energy-monitoring sensors, and Pachube to create “a city-wide network of electronically-assisted plants that act as carbon-cycle circuit-breakers in much the same way as conventional electrical circuit-breakers do…..” is about?

Usman Haque: Situtated Technologies, founded to explore the impact of “situated” technologies (i.e. locative media, etc.) in urban spaces, kicked off with a symposium organised by Mark Shepard, Omar Khan and Trebor Scholz and supported by the Architecture League of New York a couple of years ago, and continued through a series of pamphlets (the first by Adam Greenfield & Mark Shepard; the second by me and Matthew Fuller; the third and fourth by Benjamin Bratton & Natalie Jeremijenko and Laura Forlano & Dharma Dailey). This is now culminating in an exhibition, “Toward the Sentient City”, opening in September 2009, as a public manifestation of many of the concepts raised over the years.

Natural Fuse, a project funded by the Architecture League to be part of that exhibtion, is really a Haque Design + Research project rather than Pachube project alone. It came about for two reasons. The first was because we had been investigating for several months many different ways to use plants and vegetation in interactive architectural design: as living walls, as responsive systems, as visual and olfactory indicators, as passive ventilation — fantastic research undertaken predominantly by my invaluable production assistant Barbara Jasinowicz. We were particularly interested in energy creation and monitoring and had made a number of (unsuccessful) proposals to develop building systems based on plant interaction. The second was because I wanted to have a good demonstration project for Pachube: a system that was not just end-to-end single-point communication, but one in which the system increased its efficiency over time through more and more geographically-dispersed connections. So Natural Fuse developed through a series of conversations with a very intelligent and witty designer Nitipak (Dot) Samsen who was then an intern and who will now lead design work along with Cesar Harada (similarly intelligent and witty!).

Briefly, the point of Natural Fuse is to use networked plants, based on the Arduino ethernet platform, to harness the carbon-sinking capabilities of plants to create a city-wide network of electronically-assisted plants that act both as energy providers and as shared “carbon sink” circuit breakers. By sharing resources and information between the plants, energy expenditure can be collectively monitored and managed. The purpose is to create a collective “carbon sink”, that offsets the amount of energy consumed by the plant owners – a natural “circuit breaker”. If people cooperate on their energy expenditure then the plants thrive (and they can all use more energy); but if they don’t then the network starts to kill plants, thus diminishing the network’s energy capacity. Of course, the network functionality is enabled by Pachube. The plan is to distribute these to some households in New York and offer plans and downloads for people to build their own as well.

Tish Shute: You describe Pachube as linking environments not just sensor to sensor (as sensorbase.org does) – an environment for Pachube could be a web page. An essential concept in Pachube is the concept that anything could be an environment and such environments are treated equivalently with EEML. You describe EEML as a protocol that sits comfortably with existing building protocols “what it brings to the picture is the ability to describe buildings that change.”

How will EEML change our understanding of architecture and enable the view of architecture that “includes smells, sounds, light, electromagnetic fields – buildings as dynamic and changing?” (Prasad Passive House?)

You describe EEML as straddling and designed to work alongside IFC construction industry format. Who is involved in the creation of EEML?  Could you explain a little bit how it is different from SensorEML? You mentioned little has been done re post-construction evaluation of buildings. How will EEML enable buildings to share strategies (for example on energy consumption) as you put it?

Usman Haque: The Extended Environments Markup Language (EEML) (which is the protocol around which much of Pachube is based) is being developed to make the idea of “dynamic, responsive and conversant environments” a reality. It works with existing construction standards like Industry Foundation Classes (IFCs), but exists to extend them to account for dynamic, responsive and, dare I say it, conversant buildings. In the perhaps prosaic world of construction, this helps to facilitate a number of architectural requirements such as post-occupancy evaluation, realtime site-based environmental feedback at the design phase and simulations that synchronise with realworld installation. With EEML and Pachube you’ll be able to start working with, say, an Autocad model at the design phase, and include *real time* environmental data from the site, as well as to model expected sensor and assumed energy consumption data of the design; use the same model during the construction phase (because it will translate fine to standard modelling descriptions), and keep working with the same set of information even after the building is occupied and running — making it a whole lot easier to learn from the design and maintenance processes than it is currently.

At the same time this does not exclude the possiblity of talking about “sensors” (as SensorML wants to), but we are more easily able to consider, say, the dozens of different ways that different clients will want to address, access or search for those sensors; the changing contextual motivations for actually processing sensor information; and the capacity for flexible sensor ontologies — where you don’t need to know from the beginning everything you’ll be looking for once you’ve recorded mountains of data.

We can consider, equally as ‘environments’ a mountainside, the interior a building, the context of a webpage, the internal status and external context of a mobile device, the interactions within something like Second Life.

As a result of this conception of “environment” we remove the need for a distinction between “real” and “virtual”. We can consider, equally as ‘environments’ a mountainside, the interior a building, the context of a webpage, the internal status and external context of a mobile device, the interactions within something like Second Life — all these are environments and can communicate with each other on equivalent terms. More importantly a single “environment” can be expressed as a snapshot in time; or it can be expressed as a sequence of many snap shots over several years.

One very important thing we’re looking at now is how to transition the protocol from something that is status-based, to something that can express transactions, goals and processes. We’ve just started looking at how RDF and machine tags might help in this, largely spurred on by perceptive comments from one of my favourite designers, Toxi, a.k.a. Karsten Schmidt.

Tish Shute: You mentioned that you see “smart” buildings and “smart” cities as environments not just a collection of devices? On the Pachube web page there is a chart describing potential interactions between entities (one to one, one to many, etc.) but you do not give many pointers to how two unrelated objects that are connected would derive any value out of the connection…could you give me some examples of the kinds of use cases (Natural Fuse is one of course!) and interesting new opportunities to create shared value that Pachube will enable?

Usman Haque: Yes, I recognize that the Pachube website information leaves a lot to be desired…! Apart from a whole lot of conceptual information that’s missing, there are a number of undocumented API features that nobody has yet uncovered!

Well, in answer to your question: much of it is intuition – I don’t know exactly _how_ it will be valuable but I do expect the community to find ways to make such seemingly disparate interoperability valuable.

To make a prosaic example: say, (once privacy options are introduced) that a manufacturer creates a Pachube input application, like an electricity meter that automatically charts on Pachube. There is a certain benefit to its customers in being able to monitor their usage over time and to compare their usage to the aggregation of others in a similar class, but anonymised. Say that someone else has produced a Pachube output application like a mobile phone Pachube viewer. Now the electricity meter users can use this new output application as an extension to be able to monitor their consumption on a mobile phone. Now, imagine if someone else develops a new product, a networked lamp — it would now be very easy for that designer to write a little app to make the networked lamp switch on (or change brightness) according to the electricity consumption, even remotely. The point is that the more input and output apps are added the more valuable they each become.

Scattered House, like Reconfigurable House, but spread throughout various cities in the world to demonstrate the implications of designing environments and buildings in the context of family diasporas and ubiquitous ad hoc networked connectivity.

Part of Pachube’s emphasis, in not making specific connections more important than others, is that the community can develop new types of connection. So, while of course it makes it relatively simple to create remote control connections between seemingly unrelated entities (like mobile phones and houses; or web pages and furniture); and it makes it relatively simple to connect up environmental conditions from the physical world to seemingly distant Second Life (or, more interestingly to me, OpenSim ) which can make it a more viable interactive environment; and it makes data aggregation and comparison possible between wide ranges of energy consumers to facilitate aggregation analysis; but, the point really is to make it easy for people and companies to build in this kind of connectivity and invent new uses.

Through my close association with The Bartlett, University College London’s architecture school, I hope to develop some particularly relevant use-case scenarios for the architectural industry. I think we’ve really not even begun to imagine the kinds of applications that will be important, though I guess Natural Fuse exemplifies the kind of approach I would like to see in Pachube-enabled applictations: one in which the collective/hive experience contributes towards some end goal, to make it possible to create a “wikipedia of environments” as opposed to a web-based Wikipedia – it’s not that I necessarily want to create these things myself, but rather I want to make it possible to create such things.

Tish Shute: You mentioned that you hope Pachube to be the place to connect smart products – product to product communication?  Also you mentioned that you would like to have a way that smart products can self register with Pachube. While all feeds are public now, you are going to create groups with different levels of privacy. Both of the aforementioned features would enable more business applications for Pachube.  But could you describe the business model for Pachube?

Usman Haque: Essentially, there are three facets to the business model. The first takes a cue from Flickr in recognising that there are those who would like a more sophisticated set of services as “professional” accounts. The second is to be able to provide a set of tools and applications for medium scale manufacturers and developers who want to web-enable their offerings, who will be able to take advantage of the growing repository of Pachube.Apps and add-ons, and who want the convenience, security and economy that Pachube will be able to offer. The third approach is to become more directly involved in large-scale urban infrastructure projects. There is a fourth facet, but we consider it the killer so I’m keeping quiet for the moment….

So yes, in order to make all these things more useful we’ll soon be introducing a range of privacy options on feeds, the ability to create “aggregates” from collections of feeds, and the possibility of groups, organised around feeds. Another thing we’re hoping to introduce soon is open environment-level tagging, so that anyone will be able to tag environments, though there will be a way of evaluating the importance of any given tag.

Tish Shute: I know you mentioned that you are trying to find ways to find tools that allow people to contribute to their environment. There are a number of projects aimed at providing tools that will help people/business to reduce their carbon footprint  – The Carbon Account, AMEE, Wattzon, Onzo Is Pachube working with any of these projects and how?

What are the most interesting ideas in this area of changing our relationship to energy consumption emerging from Pachube?

Usman Haque: The carbon footprint calculating industry is getting quite crowded…! So far I’ve particularly appreciated AMEE’s API (which is also used by the Carbon Account, I believe). So one thing we have just released a Pachube.App ‘plugout’ which will take a feed from an electricity meter tagged “watts” or “kilowatts” and convert it into a realtime carbon footprint calculation (driven by AMEE’s international and region- and supplier-specific carbon conversion factors). So it should be really easy to discover how many kilograms of CO2 you generated in the last 15 minutes…. that last hour… the last 24 hours. Here’s a list of some of the feeds that are already making use of this: http://www.pachube.com/tag/co2_last_15_mins

Tish Shute: I know the Aduino community has really taken and interest in Pachube. Who are the early adopters on Pachube?  What are the most prevalent use cases you have seen so far?

Usman Haque: It has actually been more difficult than I thought it would be getting the Arduino community interested. This has partly been due to the difficulty of internet-enabling Arduino (until recently adding ethernet access has been a bit of a tough chore). Now that it’s easier to connect up Arduinos, some of the early adopters have been interfacing Arduino to Current Cost meters (alleviating the need for a computer in between); and others have been doing things like tracking temperature, humidity and light level in their homes and offices. Pachube user C4C has been pretty active from early on: http://www.pachube.com/feeds/1284

Tish Shute: Pachube is input heavy at the moment – you mentioned not many accuators are plugged into Pachube yet.  You said this is in part because you have focused on making the backend robust and stable before taking a lot of hits. What new directions for Pachube will emerge from enabling the dynamic relationship between sensors and accuators?

Usman Haque: This will be a crucial evolution in Pachube, when we make actuators more evident. It’s input heavy at the moment, basically in the sense of being easy to see the inputs — you add “inputs” rather than “outputs”, so at the moment we have no idea of what’s actually plugged into the outputs unless people tell us! However, we know that there are plenty of outputs because they’re making API requests, we just don’t know what they’re being used for! Once the concept of actuators and output environments get built in to the system then I think we’ll know a lot more about how people are using the system.

To make this easier in the meantime we recently announce the Pachube.apps site, where people can start contributing Pachube ‘plugins’ and ‘plugouts’ — things that can be used by others without needing to code or hack, to create, generate or modulate Pachube inputs and outputs. One of these was Status2Pachube, which turns the online status of AIM, MSN Messenger, Skype or Yahoo! Messenger users into a Pachube input feed (to make it easy to create “remote presence” orbs and such); another was the CurrentCost2Pachube app to make it easy to connect up Current Cost electricity meters as input feeds; all of which can then be used by Pachube output apps, like the G1 Android phone Pachube viewer by Pachube user N4Spd or in the soon-to-launch Pachube2SketchUp plugout which will direct Pachube outputs into Google SketchUp (and by extension Google Earth) in order to generate or modulate 3-d models in response to realtime environmental/sensor data. (Pachube2SketchUp is pretty much finished for Mac OS X — but we’re having difficulty getting it to work on Windows, because of its sometimes pigheaded security measures… we’ll probably release it for Mac OS X alone soon anyway).

Tish Shute: Do you and Haque design expect to go beyond just providing a platform? Will you be producing more interesting applications like Natural Fuse on Pachube?  If so, can you tell me more about what you have in mind?

Usman Haque: I keep a clear distinction between my work as creative director of Pachube.com and my work as director of Haque Design + Research. Basically, while Pachube.com continue development of the platform in general, I hope that Haque Design + Research will separately continue creating pioneering interactive experiences, some using Pachube and others not. We have some things in mind, such as the idea of creating an open source building management platform, but that’s all to come later…

Tish Shute: One very interesting project you have been involved in is the creation of “Urban Versioning System 1.0″ which asks “What lessons can architecture learn from software development, and more specifically, from the Free, Libre, and Open Source Software (FLOSS) movement?” Can you tell me more about this project, its goals, and its progress? How Does UVS 1.0 relate to Pachube?

Usman Haque: The Urban Versioning System was essentially an attempt to understand what lessons the “open source” approach in software might provide to the collaborative development of environments and cities. It’s a sort of quasi-license — not yet quite ready to have the status of something like Creative Commons (which nicely suits media and software based creations, but doesn’t suit quite so well hardware and physical things beyond their design files). It’s more of a challenge, a series of constraints that might be applied. It has a link to Pachube, in the sense of encouraging conception at the environment and systemic level — you might call it the manifesto that connects Constant’s New Babylon hypothesis to the reality of Pachube!

Tish Shute: I know that you imagine Pachube scaling up to millions (billions???) of users. But scaling the real time web has proved a challenge (e.g the frequent surfacings of the Twitter failwhale during big events). What are the key points of Pachube’s architecture and design that will enable successful scaling?

How do you see Pachube itself fitting into the FLOSS movement?

Usman Haque: This is a really important question. There are a couple of things we are doing. The first is constantly to assume that we have 20 to 50 times more connections than we actually have… I put a lot of pressure on Sam about making sure about this, so he’s constantly developing, thinking about and testing little things for weeks in advance while at the same time fighting the usual daily little fires that arise The second is that we’re trying to learn from strategies being developed by Vlad Trifa and his group at the Institute for Pervasive Computing at ETH Zurich in Switzerland regarding the development of infrastructures for millions or more entities.

Regarding the connection to the FLOSS movement, there is no specific technical part of Pachube that is currently open source (apart from all the example apps and tutorials of course). However, I find the approach taken by OpenSim and Hypergrid really fascinating: I haven’t given this enough thought to how it might be implemented but I find quite appealing the idea of a multitude of open source and geographically dispersed Pachube-enabled servers with seamless transfer of data connections between them as necessary…..

Tish Shute: I know you have an Android Viewer for Pachube.  Android is a landmark for extended/augmented reality, as Wikitude proved, because with its compass mode Android brings together the essential ingredients for extended/augmented reality – knowing who YOU are, WHERE you are, WHAT you are doing, WHAT is around you.  It seems Pachube could be a powerful backend to a number of multi-user, mobile augmented/enhanced reality android applications?  Do you have any ideas/thoughts on this?

Usman Haque: That’s right — the Android viewer was created by rcreations.com/ a Pachube user — this new platform brings amazing opportunities to mobile devices. I would be really interested to see what I would consider the obvious next step: an app that becomes both a Pachube input and an output feed, one that overlays existing Pachube data, with new context-based, site specific data.

If I was to make a parallel to a Japanese anime, I’m fascinated by Dennou Coil a Japanese anime set 20 years in the future where children take for granted the overlay of the digital world with the physical world. BUT, I’d say that Pachube somehow relates more closely to Furi Kuri in its pataphysical stance and because one of the main characters has a portal to another galaxy in his head…….

Tish Shute: Do you do you see Haque design picking up on the challenge of creating some cool next generation interfaces/GUIs for extended/enhanced/augmented (sorry no perfect term) reality?

Usman Haque: Actually, no, I don’t see this as Haque Design + Research’s core focus going forward. We did some of this early on, getting involved in, for example, the development of a 3d smell interface; and exploring the role of electromagnetic fields on perception of haunted spaces. But these days, in the context of HDR, I’m less interested in making seamless interfaces and more interested in exploring what authentic interaction actually is (whether technologically based or not). I think it’s challenge enough for me to make a light-switch engaging, dynamic and conversant before getting to the perceptual infrastructure that goes on top of it all! HDR will also spend more time exploring passive systems, phase-change materials and plants in the context of the built environment.

Tish Shute: I know there has been some interesting integrations with Pachube lately – Andy Stanford-Clark’s mentioned using MQTT as the feed to get EML data into and out of Pachube rather than over HTTP. He said that’s interesting because MQTT is a much more lightweight protocol, designed for small sensors and low bandwidth / expensive (e.g. cellular) networks… and it’s also true push.. i.e. data is pushed to you directly from the broker (the hub in the middle), rather than you having to ask for it constantly (polling).

Have you opted for MQTT over HTTP polling?

Usman Haque: We haven’t yet implemented an MQTT bridge in part because it has proved pretty difficult. HTTP is quite important for us right now because there’s a whole universe out there using it; from your average web browser, to mobile devices, to ethernet devices and a whole range of languages and platforms — they all work, pretty much out of the box with HTTP. However, what we are exploring instead is being able to interface with Oliver Goh‘s Shaspa project — they’re already in the middle of solving the MQTT-Pachube bridge problem, and so that should hopefully provide Pachube access to and from MQTT devices.

Tish Shute: Chris Dalby just released Pachube Air. Have you had a chance to play with that yet?

Usman Haque: I have indeed! It’s still early days yet, and I know he did it partly just to test the AIR development process rather than solely solving a desperate Pachube need but I’m looking forward to future iterations!

Tish Shute: Peter Quirk felt the Pachube web page positions Pachube as a social networking site focused on data exchange, inviting anyone with an interest in sharing environmental or other data to publish data or construct interesting uses for the data.

What is your response to that?

Usman Haque: Hmm… I don’t really see Pachube as a social networking site. Yes, it perhaps enables the creation of social-networking objects and environments, but in itself and in terms of networking of people that has barely begun yet. Certainly Pachube exists quite comfortably in facilitating mashups and visualisations and other web 2.0 based social applications but I don’t see that as a driving force. I think it would be a mistake also to conceive of Pachube solely as being the storage of machine communication that then gets experienced by people; rather, it can transition quite easily to being solely useful for machine-to-machine communication.

In fact, with recent API releases (which as it happens as of this writing we haven’t announced… it’s now possible to use most of Pachube’s features without ever going to the website: i.e. your Arduino can create feeds, search feeds, edit feeds, delete feeds. Over time, as direct machine-to-machine communication becomes more prominent, it’s quite likely that the website itself becomes less and less important, while the backend becomes the focus of everything.

Tish Shute: I am interested in some of the differences between SensorBase.org’s project and Pachube. Is Sensorbase as more of a data repository (environmental data in particular)?

Usman Haque: The difference I see between Pachube and SensorBase is that while (from what I know) SensorBase is mostly about “write” operations, with later “read” operations (i.e. it’s about being a data repository), Pachube is really “read-write” (i.e. it’s about being both a data repository _and_ a quasi-realtime proxy). Pachube will be able to handle potentially millions of connections, both incoming and outgoing, and as we’ll soon start storing every data point ever recorded, so of course the data repository aspect will be crucial. However, the fact that it *also* facilitates one-to-many realtime broadcasts of that data (and facilitates conversion to a number of different formats: EEML, CSV and JSON now, more in the future) means that the two-way connectivity aspect of it is just as important.

Tish Shute: I know you mentioned something that sounding a lot like Pachube would facilitate buildings and products ability to benchmark and optimize themselves against/with each other?

Usman Haque: Further down the line, I would like to see Pachube able to help two particular processes:

1) to make it straightforward for developers and manufacturers to web-enabled their products and services; and 2) to help building and environment designers create their buildings (by providing access to realtime site data) and also help in the post-occupancy evaluation process — where buildings will be able to talk with each other, share information on energy consumption, resource management or occupancy rates and even “learn” from each others’ strategies. This type of approach has a parallel at the level of individuals (for example, networked electricity meter users who are able to compare and contrast their usage and strategies for conservation). I don’t want Pachube to become the application; rather I want to make it easier for other people and companies to create such applications. So in that sense, yes, perhaps Pachube can be considered an enabler of social networking applications…!

Google Street View Hacking

This Google Street View Hack (via @timoreilly) will get my nomination for a Hacking the World Award this year, if there is such an award.

A parade (the screenshot opening this post), a marathon, a mad-scientists laboratory, a sword fight, and more (see The Infonaut Blog) were staged all along the route of the Google Street View truck by artists Robin Hewlett and Ben Kinsley working in conjunction with the local community and Google Street View.

The Google Street View Hack suggests at a myriad of possibilities for anyone with their eye on the prize for a great world hack for 2009.  In my mind’s eye, I imagine the Google Street View truck’s trek across the planet triggering local environmental street action carnivals wherever it goes.

Local energy conservationists, “passive house” architects, retrofitters, could turn the arrival of  Google Street View into an occasion to create projects for a sustainable future – a traveling StreetCamp (see my post on HomeCamp ’08 here).  As Google Street View intends, surely, to go everywhere,  this would be a global hack for sustainable living that crossed the bounds of the physical and the virtual.  And the vast public record of Google Street View would became a generative engine and global resource for sustainable living.

Working together on the noble aim of sustainable living

- this is my (and many other people’s) big theme for 2009.

A Hacking the World award should also go to  Pachube – “patching the planet” – for demonstrating that instrumenting the world is not merely a Sci Fi  fantasy anymore.  By facilitating “interaction between remote environments, both physical and virtual,”  Pachube demonstrates (see diagram here) how we have only just begun to dip our toes into the many new opportunities we have to work together to save energy, rethink our culture of consumption, and to reboot our failing economy under a new sustainable operating system.

Energy awareness unlike the glut of information we have in entertainment and games suffers from a dearth of information. We really have very little idea about what we are consuming and the waste we are producing.  So more Hacking the World Awards should go to projects like AMEE – creating the world’s energy meter, and Wattzon – your personal energy meter, for giving us new ways to understand and work with energy data.

Many people and organizations, given the information, will change their behaviours. But the cultural changes necessary for sustainable living are deep and old habits die hard (see this disturbing report on the recent return to SUV buying in November as soon as gas prices fell!).

A  Small Community of Volunteers Can Bring Change on a Global Scale

Picture above by Benjamin Ellis, “HomeCamp – The Throng,” from his Flickr stream.

One of my favorite “instrumenting the world” projects to date and another top contender for a Hacking the World Award is HomeCamp ‘08 (see my previous post).  HomeCamp brings together a community of creators and enthusiasts of  “smart stuff,” creating a wikiculture for the noble cause of sustainable living.

The key to whether “instrumenting the world” empowers people and changes our lives for the better will be the capacity our systems of instrumentation have for what Jonathan Zittrain in “The Future of the Internet: And How To Stop It:,” defines as generativity, i.e.:  “the system’s capacity to produce unanticipated change through unfiltered contributions from broad and varied audiences” ( Zittrain, 2008).

Generativity is the “secret sauce” that makes the difference between, for example, Wikipedia and its all but forgotten predecessor – the “written by experts” Nupedia.

Jonathan Zittrain writes:

Wikipedia stands for more than the ability of people to craft their own knowledge and culture.  It stands for the idea that people of diverse backgrounds can work together on a common project with, whatever its other weaknesses, a noble aim - bringing such knowledge to the world. (p.147)

At Web 2.0 Summit, Jonathan Hochman (Known as Jehochman on Wikipedia), shared with me his insider perspective as a Wikipedia administrator. The full interview with Jonathan is later in this post.

Jonathan comments on the role of wikiculture in sustainable living:

“Sustainable Living requires everything to become more efficient. Incentives need to line up with conservation priorities. This requires a radical change to the way we govern ourselves. Command economies, whether commanded by politicians or capital, lead to huge inefficiencies.”

And surely, if we have learned anything in 2008, we have learned that very bad things happen when the complex systems of modern life are left in the hands of a few people motivated solely by the urge to make profit.

Hacking Design and Planning Processes for Real Estate and Transportation with Virtual Worlds

This great machinima by Azwaldo Vilotta shows the progress so far on the Wikitecture 4.0 project, ‘Re-Inventing the Virtual Classroom’ for the University of Alabama.

Though still a niche market Virtual Worlds are growing at a steady pace.  As I mentioned in my previous post, energy hungry avatars themselves will be a target for optimization in 2009.  But as my personal power usage breakdown from Wattzon shows, cutting down the amount of flying I do in 2009 would be far more effective in reducing my carbon footprint than deciding not to log into Virtual Worlds!

Note: Read Write Web’s recent post, “Report Enterprise Virtual Worlds More Effective Than Web Conferencing.  Also check out Web.Alive, and Immersive WorkSpaces and Dusan Writer’s post on “ThinkBalm,The Immersive Internet and Collaborative culture,”

My friend Melanie Swan points out in her Top Ten Computing Trends for 2009, that Virtual Worlds not only have the power of the 3 Cs (communication, collaboration and commerce) but they are fast expanding into rapid prototyping, simulation and data visualization.

My Hacking the World, 2008, Awards for Virtual World innovation would go to three potentially world changing projects for sustainable living:

1) Studio Wikitecture, (see “Reinventing the Virtual Classroom” for The University of Alabama).

2) Oliver Goh’s work on “The Path to Sustainable Real Estate.”

3) Encitra, a company recently co-founded by Crista Lopes and Christer Lindstrom focused on improving urban planning processes, starting with transportation, using virtual worlds (see my previous post here for more).

The latter two projects are being developed in OpenSim – the open source project that should also get a Hacking The World Award for creating an open modular architecture for virtual worlds that is unleashing all these new possibilites for integrating physical and virtual worlds.

The 2008 code contributions to OpenSim of special note re world hacking are Crista Lopes’ OpenSim Hypergrid – see Justin CC’s blog for full details on “What is the hypergrid?,” and David Levine’s work (IBM), in collaboration with Linden Lab (see Architecture Working Group), on interoperability (see my earlier post here).

Both these projects expand the frontiers of interoperability for virtual worlds although they “slice the problem from different ends,” as David Levine put it.  The emphasis in the LL/IBM approach is on security so assets are not moving yet.  In Crista’s solution you can have assets but the security issues are not addressed yet. But this work is vital to expanding the usefulness of virtual worlds and both projects should get Hacking the World Awards IMHO.

I asked Jon Brouchoud (full interview upcoming) what he thought were Studio Wikitecture’s most important successes to date:

“I think the greatest success has been in proving, on some level, that everyone has important knowledge that can inform and improve the design of a building, not just architects.  If we can continue building on that success, I hope we can eventually start to hack the traditional design process, and find ways to harness the wealth of knowledge held by the general public, instead of ignoring or avoiding it, as is most often the case.”

Harnessing the “Smart Stuff” to the Noble Cause of Sustainable Living

Robert Scoble’s, The Interview of the Year: Tim O’Reilly, is not to be missed. Tim O’Reilly discusses the key trends for 2009 that are bubbling up at O’Reilly Media.  And, Yes, Tim O’Reilly, as the guru of Hacking the World, gets the “Distinguished Thinker – Hacking The World Award of 2008!”

Tim O’Reilly’s trend list includes:

1) big data- vast peer produced data bases in the cloud accessible by mobile devices

2) “smart stuff” – sensors and robotics and hacking on stuff for fun and not for profit

3) Green Tech

4) Advances in Biological/Life Sciences.

And, in Robert Scoble’s interview, there is a nice titbit of history re his attendance of early Foo Camps.  Foo Camp is the wiki of O’Reilly conferences and a lineage holder to my favorite Hacking the World event of 2008, HomeCamp ‘08.

But what will be the “secret sauce” for these big ideas  – the generative engines that harness to the noble cause of sustainable living these vast peer produced data bases and all the creative “smart stuff” hackers across the globe are creating?  What will motivate the mass adoption of Green Tech and sustainable living?

What can Wikipedia teach us about how generative systems and bottom up approaches can change the world?

Jimmy Wales (interview coming soon!)  writes in his recent personal appeal for support for Wikipedia.

At its core, Wikipedia is driven by a global community of more than 150,000 volunteers – all dedicated to sharing knowledge freely. Over almost eight years, these volunteers have contributed more than 11 million articles in 265 languages. More than 275 million people come to our website every month to access information, free of charge and free of advertising.

To answer questions on a how to create a successful wikiculture for sustainable living, an insider’s view of Wikipedia may be a good place to start.

Interview With Jonathan Hochman on Wikipedia.

The picture on the left is from the Wikipedia article, Gamma-ray Burst, that Jonathan Hochman is currently working on.  It is a drawing of a massive star collapsing to form a black hole. Energy released as jets along the axis of rotation forms a gamma-ray burst. Credit: Nicolle Rager Fuller/NSF

The picture on the right, Jonathan at Web 2.0 Summit, is taken by me. Jonathan was part of the, Defending Web 2.0 from Virtual Blight, panel.

Known as Jehochman on Wikipedia, he serves as an administrator and as a leader in addressing online harassment, disruption and sock puppetry. He is also the founder of Hochman Consultants, an Internet marketing consultancy, and the director of Search Engine Marketing New England, a regional conference series.

Tish: Second Life and Wikipedia are the two great experiments in collaborative co-creation what do they have to teach us about the future of the internet?

Jonathan: Yes, Wikipedia and Second Life are key social spaces.  Some people have been seeing Second Life as the beginning of Web 3.0 – a wrap around environment where you can almost experience another life. Wikipedia is sort of another example of this.

All the problems that exist in the real world are mirrored right into that little universe.  For example, the Armenians and the Turks are at each others throats and the Japanese and the Koreans are going at it, the Palestinians and the Israelis, and the “Troubles”  … all the conflicts are imported into Wikipedia.  People are fighting over the content of these articles. They want to have it their way because these are first ranked in Google and they have a big impact in public opinion.

There was a huge fight on the waterboarding article a while back. Some guys from Little Green Footballs – they are a very conservative reactionary type of media. They are trying to change the article to say that water boarding might not be torture – change it to say it is probably not so bad.  Crazy stuff. They were trying to water it down.  And it is very clear, from every source out there, that waterboarding is torture.  We did a study and there are 115 sources that say waterboarding is torture. You simulate drowning – you simulate killing someone – that is a violation of the Geneva Convention and everything else. People were fighting, fighting, fighting!

One of the things I did was to try and clear people out who were being disruptive.  We actually had to go to arbitration over that article. It is like the supreme court of Wikipedia. There is a panel of 15 arbitrators.  They hear the case. There is evidence, arguments and decisions. It is really like a simulated law suit. You get all the experience of a simulated law suit with the real threat that you could be banned. If they don’t like what you are doing they can actually ban you or restrict you from topics.

So it is really fascinating how this social space Wikipedia becomes a very real platform though it is in a virtual world for real world disputes.  Most disputes are over the definition of things.  If you have a you suit most disputes are about how things are defined. And Wikipedia has become the defacto definition of things in the real world.  People want to know what are “The Troubles.”  If you go to Wikipedia you find out  The Troubles are a dispute over Northern Ireland.  What the article says has a profound impact on public opinion.

Tish: So who is on the court of Wikipedia?

Jonathan: They are volunteers. these people work two or three hours a day to run this court.  There are all kinds of projects.  There is a WikiProject Spam which has people who can write computer programs to statistically analyze Wikipedia projects – not only Wikipedia. But all of them are looking at the links and reporting them and banning those people who are abusing or gaming the system.

Tish: You were on the Stopping Virtual Blight Panel at Web 2.0 Summit – what are the most important things to think about on this topic?

Jonathan: Yes we were talking about how to defend the web against virtual blight. The thing I find interesting about Wikipedia is that because it is the eighth largest web site and possibly the second largest web site comprised of user generated content after YouTube. The problems that exist in Wikipedia are larger and more detailed than any other site.  For whatever problem someone has for their social media site or their Web 2.0 site these problems already exist in Wikipedia and the solutions are there and they are transparent. You can actually see the history of what’s been done.

If there is, for example, a problem on Digg – some problem with sock puppetry or vote stacking – it happens, it goes away.  You don’t get full disclosure.  With Wikipedia you can actually go in and look at a dispute and watch it unfold.  You can watch the arbitration cases that are filed, the arguments, the decisions, the logic, the rationale.  You can see the successes and the failures and the different things people have tried to control blight. For example, we tried to resolve this dispute one way but it was a disaster, so we have tried something else and that worked.

Wikipedia is a large laboratory for social media. Wikipedia and the large universe around it Wiki and WikiMedia projects that individuals, enterprises and put together like Commons.  Wikimedia Commons is a repository of publicly licensed images that anyone can take and reuse. They have sound and they have video, and all of this stuff is being stitched together now.

So if you go to the article on Obama  you can probably now hear his acceptance speech because that is public domain – its been stitched into the article.  If you go to the article on Richard Nixon – his resignation speech – you may even hear his conversation with the astronauts when they landed on the moon.  So this becomes a giant repository of all our culture and knowledge.  When I design a website, a lot of times I go to Commons to find images I use for free.  I don’t want to pay for an image I can get for free. 

Tish: And the Commons images get contextualized in Wikipedia too.

Jonathan: Some of these articles are fascinatingly detailed. If you want a quick summary of the Dr. Strangelove, the article is fantastic.  It is enjoyable, a pleasure to read.  I was reading about S.A. Andree’s North Pole balloon expedition of 1897. Some guys from Sweden decided to fly a balloon over the North pole.  They managed to get aloft then they flew over the icepack for 24 hrs then they crashed.

They unloaded their stuff and hiked back across the ice toward the island they had launched from. They ended up being on the ice pack for three months before they finally holed up in an ice cave and starved to death.  There weren’t found until thirty years later!  There was a camera with these guys and the frozen pictures taken 30 yrs earlier.  They developed the film and those pictures are now on Wikipedia.  It is just a fascinating thing!

Tish: Do you see real time collaboration beginning to play more of a role in Wikipedia – whether virtual worlds or just voice/IM — how could real time collaboration change the wikipedia editing process?

Jonathan:  The Presidential candidate articles were being edited very rapidly yesterday. There are certain real time problems.  Some of the more interesting problems are when you get two administrators who “get into it.” One administrator says I am blocking this user and the other one says I am unblocking him, and the other one “NO I am blocking him!” And so on…… And everyone says, “Stop fighting. You are not allowed to do that!” And they both get their powers stripped. People do get very heated over the silliest things. Wikipedia does have some mailing lists attached and there are some IRC channels. So there are some real time elements.

Tish: What is the role of avatars in Wikipedia?

Jonathan: In Wikipedia you have a user page and many users are anonymous.  They create an avatar and they personalize it and show themselves in ways they want to show themselves through an avatar. In many ways it is a lot like Second Life.

Some users have created second accounts – or a humerous second account. Bishzilla – a Swedish lady who is in tremendous command of the English language and has a razor sharp wit.  She has created this secondary account – almost like in a baby language.  Her avatar is a dinosaur that is not very bright that goes around frying people. Bizarre what people do! People may be editing a topic like an interest they have – e.g. Pokemon that they don’t want associated with their professional avatar. Or people may be editing a topic about hot political issues.  There have actually been some death threats issued to people over stuff they have been putting into the encyclopedia.

Tish: So avatars are important in Wikipedia.

Jonathan: Absolutely because people may be going in and editing articles that they may not want their friends and family to know they are editing.  One editor may say to another, “Stop putting stuff in or I will come and kill you!” Well then we have to ban them.  We have to call the police.

Tish: Can you build reputations on multiple avatars?

Jonathan: You are allowed to use multiple avatars as long as they don’t cross paths.  You can’t have two avatars editing in the same area beacuse you are going to be giving yourself double weight commenting on a discussion.


Tish: How do you know when this is happening?

Jonathan: You can watch the style of a users editing.  You have to watch behavior.  And if you have enough evidence through behavior that suggests accounts are controlled by one person you can go and request a technical check.

There are some uses who are called Checkusers who are able to access information desired from the server logs and check the technical characteristics of these accounts to see if they are using the same IP address.

Tish: So if you want to understand avatar interaction on the web it helps to understand Wikipedia.

Jonathan: Yes it is a fantastic way to understand how avatars work in some aspects, and also how to deal with community dynamics.  We have some very strong willed people – people in their 40s, 50s, and 60s – who are very successful in business.  They have plenty of money and spare time and they are doing this as a hobby. And some of these people can really butt heads.  You can have a problem when you have an editor who has been writing fantastic articles but also happens to be rude and chew other people out and tell them to f**k off if they are not behaving. What do you do?

Tish: Sounds a bit like Second Life!

Jonathan: The person is a great contributor to the community but they are telling noobies to f**k off, so you can’t allow that.

What do you do?  Vested contributors are a major problem to some of these sites. They are vested in the community but they start misbehaving. You can’t block them, because if you block them there is a huge upsroar from all their friends and it causes a cataclysm.  It requires very careful diplomacy to deal with some of these situations.

Tish: How many Wikipedia volunteers are there now?

Jonathan: Think of a Venn Diagram – a big circle. The total number of contributors are about one million different people that contribute.  But there are probably about 5,000 active editors  that are consistently and regularly contributing.  And within that kernel there are fifteen hundred people that have administrator access and probably only eight hundred of them are active.  People have a natural life span with the community.  People come an typically stay for 6 months to 3 years.  Usually after that they become bored, disillusioned or get into a conflict with someone.  There is a natural tendency for people to stay for a while and move on. Some people stay longer, a few, but the majority will move on at some point.  So it is a lot of fresh faces moving in.

Tish: What lessons of trust does Wkipedia have to teach us about new projects like AMEE that aims to aggregate the world’s energy data?

Jonathan: Well you have to know who is releasing the data. Who is creating the data? The beauty of Wikipedia is that you have an edit history so you can see exactly who has done what.  So you can judge whether this person is trustworthy or not.  That’s a huge problem on the web today.  We don’t have enough identification information.  When you see a web page you don’t necessarily know when that page was created and by whom, or how many revisions it has had.  Sometimes you can glean information by checking it.  If you see typos and errors you may decide that that page probably didn’t receive as much attention as it should have, and probably it is not that good.

Typos are an interesting thing.  People always try to figure out how Google ranks web pages. Matt Cutts was here from Google today.  And he was talking about spam.  But Matt also did a blog post about how he was in an airport once, and how he has a policy – when you are reading a document as soon as you come to the first error just stop because if the author hasn’t taken the care to make everything correct, you don’t need to read it. So he was in the airport, there was a sign, he came to a typo and stopped reading it. Somehow he got in trouble for not reading the sign and not having the information.  But it is interesting to think whether Goggle is looking for for typos, misspellings, broken links and using that as a signal of quality to rank pages.

Tish: Aaaagh typos might bring down your page rank!!!  That certainly is a scary thought for a blogger like me who likes to write impossibly long posts that are hard to check………

“Smart Planet: Andy Stanford-Clark’s time has really come. His career of work in lightweight brokers and sensors is now going to pay off,” twittered James Governor (@monkchips), Redmonk, recently.

The picture opening this post (from Andy Piper’s Flickr stream} was taken during Andy Stanford-Clark’s talk at The Inaugural HomeCamp (for more photos see Flickr “homecamp08″).

HomeCamp ’08 was organized by Chris Dalby and Dale Lane and sponsored by Current Cost and Redmonk. A video of Andy Stanford-Clark’s talk, by Andy Piper, is up on Viddler. Also see Andy Piper’s post abut CurrentCost meters and most recently about running his CurrentCost meter’s graphs on his iphone.

Ambient displays were a hot topic at HomeCamp see here and here for some good examples.

I first wrote about IBM Master Inventor Andy Stanford-Clark’s Home Automation project June of 2007.  At that time relatively few people were playing with home monitoring. But now the lynch pin of Andy’s work - MQTT and RSMB – Really Small Message Broker, is available free on IBM AlphaWorks for anyone to download and play with.

This puts a key tool into the hands of developers and mashup artists ready to explore the possibilities of home automation as a generative technology that can bring the power of participatory culture to the urgent task of creating sustainable living.  Andy points out:

“Lots of people can start playing with home energy monitoring, social aspects of the data sharing, home automation, ambient displays, etc. The powerful thing about messaging middleware like MQTT, is that you don’t have to worry about how to get the messages from A to B: you can focus on how to capture the data, and what to do with it when it gets to the other end.”

The full interview, that I did with Andy last week, is later in this post.

Also recently, I did an interview with Gavin Starks, founder of AMEE. As a neutral data aggregation platform, “AMEE’s vision is to enable the measurement of the “Carbon Footprint” of everything on Earth.”  A press release last week announced that a “collaboration between O’Reilly Alphatech Ventures (OATV), Union Square Ventures (USV) and The Accelerator Group (TAG) will enable AMEE to expand its reach by enhancing its data, and extend globally.”

The combination of a neutral aggregation platform and MQTT and RSMB can enable new forms of data sharing to meet broader sustainability goals (see my interview with Gavin for AMEE’s direction re privacy and data sharing), and the kind of ecological intelligence that Larry Brilliant, Google.org,  talked about at Web 2.0 Summit.  Dan Goleman’s new book: “Ecological Intelligence: How Knowing the Hidden Impacts of What We Buy Can Change Everything,” will come out in April, 2009. (see my previous post).

There is already a virtual worlds integration to AMEE by Jim Purbrick of Linden Lab!

Links For HomeCamp ’08

Chris Dalby has a list of blog posts about homecamp in his HomeCamp Review.

Homecamp by Dale Lane
Home Camp Unconference – inspired me by the thoughts
The Inaugural Homecamp
Home Camp Deman Shifting
Homecamp from Phoebe Bright
Homecamp ’08
HomeCamp Event: Andy Stanford-Clark’s View

Virtual HomeCamp

In 2007, I published the picture below (thanks Annie Ok as Destroy Television for SL pics) which shows:

On the right the virtualization of Andy’s RL house which is part of a Second Life Real Life Home Automation project. The pictures in the bottom row shows Mrs Stanford-Clark’s Real Life Llamas on the left and their virtual counterparts on Second Life on the right. Real and Virtual Llamas are linked through GPS and MQTT so people can “track the trek” when the llamas are out on a walk (see this IBM podcast).

I am currently working on a Virtual HomeCamp which will probably be nomadic from meetup to meetup but will kick off in Andy’s virtual house in Second Life. Andy Stanford-Clark, Adam Frisby (one of the founders of OpenSim ), and Chris Dalby have all agreed to talk (more presenters to come!) at the first Virtual HomeCamp.

Charles Crinke, OpenSim has offered Virtual HomeCamp a patch of land on OSGrid, and to give a talk on interesting home automation projects to get started in OpenSim. Charles has a cornucopia of great ideas!

And Kyle Gomboy (avatar G2 Proto) of the Microsoft Developer Community has set up an OpenSim on ReactionGrid that virtual HomeCampers can use to develop projects related to participatory culture and sustainable living.

The interview with Andy Stanford-Clark in this post gives Virtual HomeCampers some great ideas for good projects “that matter” to work on.

If you have a Second Life or OpenSim venue and you would like to offer your sim for a meetup – please let me know! Meetups will need to be streamed to the web as there is already a dynamic and rapidly growing HomeCamp community. See:

HomeCamp Wiki

HomeCamp Blog

HomeCamp on Upcoming

HomeCamp on Facebook

Google Group Discussion

FriendFeed Room

Reducing the Carbon Footprint of Avatars and Getting Energy Awareness to the Masses

As Andy notes:

“We need to get energy awareness and energy saving to the masses; and by saying “you can reduce energy by interacting in a virtual 3D world”, just isn’t going to cut it for all but a very small fraction of the people we need to get to.”

But, perhaps, some of our phenomenal OpenSim developers will push the envelope and produce the code that will make open source virtual worlds one of the most important future contributors to sustainable living. And, hopefully, Virtual HomeCamp will leverage both the collective intelligence of the web and the real time presence plus rapid prototyping capabilities unique to immersive 3D virtual worlds, to explore new ways to get energy awareness and energy saving to the masses in the short term as well as the long term.

And yes we will have to address the topic of those energy-hogging avatars!!!

Adam Frisby has been doing some interesting work with OpenSim that has the potential to reduce the energy consumption of VWs. And Michael Osias, IBM, told me:

“We operate the IBM grid [100 OpenSims] on almost all virtual machines with Xen. Recently, we migrated the opensim appliance into the IBM Research cloud appliance catalog.”

So I will definitely be calling on Michael and Adam to present on how server virtualization and cloud computing can reduce the carbon footprint of avatars.

Setting Up Your Own Home Automation Hub

There is an amazing choice of home automation technology becoming available now. Recently Nokia announced their home automation ecosystem – available in late 2009. And I recently saw The Apple Macintosh Z – Wave Home Automation System. If you don’t already, start checking out Automated Home for lots of good ideas and smart devices.

In the interview below, Andy describes how he achieves some impressive energy consumption reduction with some very affordable and readily available hardware, a little detective work, and a tip from his son to examine the energy consumption of the home automation set-up itself. And with the newly “available for free download” Really Small Message Broker from IBM AlphaWorks, IBM has made available a cool way to give creative home automators a free vehicle to broker and share their data and integrate home automation in all the exciting ways we can come up with.

The pictures below (see here for enlargements) are the before and after shots of a streamlining effort Andy made on his own home automation setup.

Andy said:

“I’ve moved my entire home automation system from the pile of equipment shown in the first photo, to a single Viglen MPC-L with a load of USB serial connections (second photo).

The pile of equipment I replaced is: A Cisco wireless access point, an IBM ThinkPad, a  Linksys NSLU2 SLUG, an Arcom Viper, and an Arcom Field Sentry I/O box.

Moving to the Viglen and turning off all that lot, has replaced 50W of always-on standby power with 10W, i.e. 40W less, or about £40 a year!”

See Chris Dalby’s post, Viglen MPC-L Useful Commands and Tips.

Interview With Andy Stanford-Clark

Tish Shute: I just got a good question for you from Gavin Starks AMEE, “if the Stern report is going to be out by 100% by 2020, and we have to start seeing an actual reduction of 10% per annum starting next year: What would you do, personally?” (See The Climate Safety report, backed by IPCC).

Andy Stanford-Clark: Oh, man! Now you’re asking the tough questions!

We have to change attitudes, otherwise just a few people making a noise about this stuff isn’t going to make any significant difference – and the way to change attitudes is by starting to make people aware of just how much energy various things we have, and things we do, take. But it needs to be something in each person’s home, that’s not “in your face”… something more subtle – “ambient”… otherwise people reject it out of hand.

Also, people are suspicious of the power companies asking us to use less power: “what, give you less money?? Surely there’s a catch?” This is a real problem. Someone phoned one of the power companies here and accused them of sending her an energy monitor that would suck electricity out of the wall socket at night, to INCREASE her bill! If that’s the kind of thing we’re up against, it’s going to be a long journey!

Tish: So what it the best way to change attitudes  – have you seen projects like Wattzon?

Andy SC: Yes, projects like Wattzon are exactly the kind of thing that start to make people realise the true cost of wasting energy.

Personally, my family has reduced our home electricity bill by 30%, which is great! But my neighbours didn’t, nor the other 4 billion or so people who have electricity.

Tish: How did you reduce your consumption so much?

Andy SC: We reduced our home electricity bill when we got a currentcost meter – a plug-in energy monitor which gives a total for the whole house.  When we got it, it showed up really quickly a couple of things…. that our “standby power” was really high (i.e. in the middle of the night, when everyone’s asleep, you creep up to the meter with a torch (flashlight <grin>) and see what it’s showing).

That was about 500 Watts before we started paying attention to it. The other thing was the lights.. I had no idea the lights in the kitchen used 480 Watts.. we just used to leave them on all the time when we were in the house. A simple change, once I realised: turn them off when you leave the room!

Our standby power was really high because I had a load of geeky home automation stuff running, and my first-generation, homebrew, energy monitoring solution (how ironic!)… which included 3 laptops doing various things (monitoring data and displaying information round the house). I just didn’t think about the cost.

So one weekend we went round the house making an inventory in each room of things that were on (the children were keen to help!). That enabled me to pretty much track down the whole 500 W… there were a few things that took some sleuthing, like the alarm system and the central heating controller. We used a plug-in meter to see what individual appliances were using.. a really useful diagnostic aid.

It’s worth having a look at AutomatedHome’s review of these energy monitoring products, by the way.

So I turned off a load of things that were sitting there on standby.. things like stereo, microwave, scanner, Wii, power bricks… each taking 4-6 Watts just doing nothing – each one small, but it all adds up. The big hitters were the PCs… turned off 3 of those, and consolidated onto a low power (10W) Linux server (Viglen MPC-L)…so that got our standby power down to 180 watts. And that, combined with being proactive about turning off lights, reduced our power usage from 900 KWH a month to 600… i.e. 30% and it has been at that for 4 months now.

Tish: Interesting that your home automation was one of the power issues as I am an aspiring home automator myself!

Andy SC: Yes, you have to strike a balance of using energy to save energy, and make sure you know what your standby power is. There are a number of home energy monitors available – there’s a review on the AutomatedHome blog. The CurrentCost meter has a handy serial port so you can plug it into a computer to download history data or make it live on the internet.

Tish: That is interesting because it opens the door to having a social energy network, doesn’t it?

Andy SC: Yes.. absolutely… you should watch my intro talk at HomeCamp! About 50 of us at IBM in the UK (and one in Australia!) have put our home energy graphs online using a currentcost meter plus a cheap low power Linux server like the Viglen MPC-L or Linksys NSLU2 (SLUG) type devices.

And a community has formed around the graphs (I described this in my HomeCamp talk at some point).. so people ask what’s that spike, or why’s yours so high in the morning, or how do you get your standby power so low.. and people talk about it and exchange ideas. There’s a facebook group (currentcost) too, with people talking about this.

And there’s some peer pressure too.. if my power is really high compared with everyone else, I feel bad about it and see what I can do to reduce it.. or if not reduce it, at least know why it’s high, and have been through a process to justify that to myself.

Tish: You mentioned earlier that it was important to have ambient solutions, not “in your face” messages from Big Brother like “turn your lights off now!” What kind of “ambient” solutions have you been working on?

Andy SC: Ok – ambient devices … so an “orb” is a good example.. wired up to the home automation system, or the energy monitor.. or maybe even controlled by the power company…

It glows different colours (e.g. blue through red, or red/amber/green) to tell me how “healthy” the house is from an energy point of view. So I don’t have to open a browser and pull up a geeky graph and analyse it.. it just lets me know subconsciously how we’re doing.

Tish: But it doesn’t necessarily help you find out what your problems is, right?

Andy SC: In our house, it’s in my study, so when I go to bed, for example, I glance in to see it, and if it’s green, all is good… but if it’s still amber or red(!), then I think.. hmm – what’s still on.. oh, the dishwasher.. ok – that will finish soon… or.. oh, I left the heater on .. I’ll go and turn it off.

Tish: What do you have to help you troubleshoot the problem?

Andy SC: If the orb doesn’t jog your memory, then you can pull up the graph to give more information, or a dashboard which shows various things that are turned on, both of which help with knowing what’s going on.

Tish: And how to fix it?

Andy SC: Yes, so if things are on X10 or other appliance control systems like Bye Bye Standby, for example, and under computer control, then you can have a dashboard of what’s on so you can see.

Tish: Good interfaces to home automation seem to be a problem yet to be solved?

Andy SC: There’s at least one company which has technology to analyze your power usage (voltage and current together) to “learn” which appliance has which profile on the graph, so you can see what’s on that’s using lots of power and also get a pie chart view of the whole house with slices showing different appliances – so many % for the TV, so many for freezer, etc. that’s Onzo.com . Their product isn’t out yet, but will give a much finer grain understanding of what’s using the power in your home.

There are also some “IAM’s”.. Individual Appliance Monitors, which are like the plug-in meter I showed you, but with a (usually wireless) link back to a base station to tell you how much power is flowing through each of them. So by knowing what appliances you plugged into your IAMs round the house, you can break out the usage by appliance. And if they’re 2-way, which some of them will be, you can have the computer turn them off if you tell it, say from the web, or your mobile phone, etc. Or maybe the home automation system will make an autonomous decision to turn it off for you!

Back to interfaces to home automation: there are two typical approaches – PLC (power line carrier) like X10, and wireless (like Bye Bye Standby, etc)… there are computer interfaces to both, but it’s all still quite expensive (in UK at least – cheaper in the US because X10 is more ubiquitous)…  but the cheaper ones don’t tell you that they definitely turned the device on or off – all you know is that the command was sent out. It might not have got there, so you don’t really know if the heater got turned off.. unless you monitor it by some secondary means, like seeing if the temperature goes down, or if the power usage goes down, or (for a light) if the room goes dark, or whatever.

BTW, my standby is now down to 120 watts

Tish: Yes!

Andy SC: I consolidated some more home automation stuff into one device.. there are two photos on this page – my “before” and “after” shots. It gets a mention in the podcast. They did a promotion on the low power Viglen servers.. £80 instead of £150… bargain! Loads of people have bought them for home automation.. you can’t have failed to see the #viglen references on twitter over the past few months!

Tish: I think there is a lot of enthusiasm for virtual worlds as a good interface for home automation. But we need to come up with something simple enough for everyone?

Andy SC: Yes, virtual worlds are very interesting.. though let’s not mention the carbon cost of running a VW!

So you know already, I think, that I can control my home automation stuff from SL… if I turn on my lights in SL, my FL (first life, i.e. here!) lights turn on, and also meter reading.. my live electricity and water meter readings are displayed on virtual meters in my virtual house so the meter reader doesn’t even need to drive to my house <grin> and the orb is there too, so I can see how healthy the house is, energy-wise, in-world.

Imagine a row of houses each glowing blue through red according to its power use – peer pressure again. If you have local generation.. the power hogs could be made to feel guilty for using all the town’s energy from the wind farm or gas turbine generator.

Tish: So every one would see if you have a Bad House eeek!

Andy SC: right!

The picture above shows Andy Stanford-Clark’s electricity meter in Second Life.

Tish: Yes and the great thing about a VW is you get a sense of confidence your controls are working and how to adjust them. But yes the carbon cost is one of the obstacles.

Do you think the power hogging sims of Virtual Worlds could be improved by server virtualization techniques and clouds – I know there is an IBMer here in US who is working on server virtualization integrated into OpenSim?

Andy SC: Yes, cloud technologies have a lot to offer in terms of making best use of a set of machines to run a set of applications, rather than one machine per application as often tends to be the case.

And with dynamic load balancing, like we do for our sporting event on-demand server farms for things like Wimbledon, as the load ramps up, we squeeze out the other apps that are using the farm to give extra capacity (as Wimbledon takes priority in that instance!)

But there was a popular statistic when SL became really popular – over a year ago now, that was something like to have an avatar in SL for a year was the same carbon footprint as driving an SUV from NY to SF or something – don’t quote me on that till we check it … here it is – 2000 miles

Tish: Yes I remember Judge telling me about some of the interesting load balancing you do at Wimbledon.

Many of my friends are thinking ahead to AR solutions now too.

Andy SC: Yeah – AR very interesting too.. you have to read Halting State by Charles Stross

Tish: Yes loved it!

Andy SC: So “Halting State is to 15 years’ time as SnowCrash was to NOW, 15 years ago”

SnowCrash is effectively a history book now.

Yeah, I think AR with glasses and overlays is going to be really cool! In cars too.. heads up satnav..

Tish: Also could you tell me the role of the messaging technology you developed in all this?

Andy SC: using MQTT of course.. which is the area I have been working on with my team for the past 10 years: the IBM messaging technology which underpins all this cool stuff we’re doing for home automation, energy monitoring, inter-world messaging.. all that stuff.. all using MQTT and WebSphere messaging technology.

Tish: I would be interested to know more about how you see VR and AR with what we have available today producing a cool interface for home automation that could get some mass traction.

Andy SC: So I think the AR/VR thing.. at the moment, far too few people are using these technologies.. we need to get energy awareness and energy saving to the masses (looping back round to the original Gavin Starks question!)… and by saying “you can reduce energy by interacting in a virtual 3D world”, just isn’t going to cut it for all but a very small fraction of the people we need to get to.”

Tish: Yes in basic ambient ways first.  How does the messaging technology you have developed open up possibilities for leveraging network effects and creating new forms of participatory culture around reducing consumption?

Andy SC: It is important because the messaging allows the real-time interaction that can be used to give dynamic feedback, and it’s that immediacy which makes people react to changes.

And, with MQTT and RSMB – Really Small Message Broker, which is now available free on IBM AlphaWorks for anyone to download and play with, lots of people can start playing with home energy monitoring, social aspects of the data sharing, home automation, ambient displays, etc. without having to worry about how to get the messages from A to B.. that bit’s done for you.. you can just focus on the interesting stuff. Folks at HomeCamp got quite excited about it! And for those who care (e.g. if you want to link your home in to infrastructure like the power company or distributed building management, or whatever) then the MQTT and RSMB technology is compatible with IBM’s WebSphere enterprise messaging products, and so can link right in.

Tish: So people could use this to build some interfaces with projects like AMEE say? For example letting you know when your light bulb went out which was the most energy efficient one to replace it with?

Andy SC: Yes, indeed.. was talking to Pachube this morning, as another example.

Tish: What did you discuss with Pachube?

Andy SC: using MQTT as the feed to get EML data into and out of Pachube rather than over HTTP. That’s interesting because MQTT is a much more lightweight protocol, designed for small sensors and low bandwidth / expensive (e.g. cellular) networks… and it’s also true push.. i.e. data is pushed to you directly from the broker (the hub in the middle), rather than you having to ask for it constantly (polling). It is an easy way to interface existing MQTT/RSMB home automation or energy monitoring systems into Pachube and it’s scalable publish/subscribe.. so one data feed in, many data feeds out.  This opens up lots of new possibilities for Pachube feeds. Here is one Pachube feed coming from MQTT.

Tish: Ah yes, no polling! That is a killer in HTTP

Andy SC: Absolutely!!!

Tish: And other examples of interfaces using MQTT with potential applications in the sustainability area are …

Andy SC: The power graphs (as described in my talk) are a good example. Also when people start generating their own power with PV or wind, they’ll want to monitor the contribution their power plant is making to their power usage, and compare it with spot prices on the grid, weather data, etc, etc. These are exactly the kinds of data feeds that MQTT is great for.

Tish: As you said the most important aspect of MQTT is that it frees people up from having to worry about  getting messages from A to B so they can “start playing with home energy monitoring, social aspects of the data sharing, home automation, ambient displays, etc. …..How to capture the data.. and what to do with it when it gets to the other end of the comms link.”

Andy SC: Yes, exactly – the incremental cost of adding new devices and applications is very low, once you’ve got the messging infrastructure in place. So once you’ve got your home RSMB hub set up, it become easy to integrate new data sources and play with new applications which use that data in interesting ways!

I’m fascinated by the social aspects of energy saving – the way communities have formed around the graphs we’re generating from the currentcost data. I’m sure that’s only the tip of an iceberg – it’s still quite geeky, but if you start to bring in some kind of gaming or competitive element, then I think harnessing the peer pressure and competitive spirit in people will be a powerful way to encourage change in people’s energy-using habits.

Ambient displays are another area of interest – the orb is just one way of doing it. Using twitter to keep you ambiently aware of what’s going on is another, and there are other media like sound and images, which can tell you things in a subtle way. Lots of scope for more experiments