HomeCamp is a home hacking, automation and green technology community that will be gathering in London tomorrow, Saturday 25th April 2009, 10am until 6pm BST (GMT + 1), and in an OpenSim event running alongside for virtual participation, to brainstorm new possibilities for distributed sustainability, creative smart meters, monitoring, graphing and visulaizing energy usage.

More details and videos on the blog. The wiki, which includes signup, is the main portal to all the online activity.

As James Governor notes here:

there has been a huge amount of code and applications released focused purely on using technology for home energy monitoring and automation.  We have an active google group and quite a few videos and content showcasing the various applications and hardware currently being used by geeks to save money and live greener.

Now the challenge is to see how this seedling home energy management movement can really grow into widely adopted distributed sustainability solutions that everyone can use, and participate in.

Both Chris Dalby (see here), Andy Piper, James Governor of Monkchips (see here),  and Tom Raftery of GreenMonk (see here), have posted on tomorrow’s HomeCamp event. So I am just going to add some quick notes, especially to highlight some of what will be going on virtually for those of you, like me, who can’t make it to London.

You can tune in either on the live video ustream, or sign up on ReactionGrid and join the OpenSim event. Also, you can keep up on what is happening on Twitter #homecamp. I highly recommend that you catch Tom Raftery’s talk which will be streamed from Spain live into the London meeting, the OpenSim event on ReactionGrid, and Ustream. Tom Raftery, a leading Green technology analyst at RedMonk (see also GreenMonk), will be picking up, in depth, on some themes raised in his brilliant ETech 2009 presentation, “Electricity 2.0: Applying the Lessons of the Web to Our Energy Networks.”

There will be homecampers dropping in to virtual homecamp in ReactionGrid throughout the day, including Chris Hart (the awesome “girl-geek”@dstrawberrygirl), MiketheBee, and Cminion, who has a number of cool projects to demo, including his energy turbines.  Dave Pentecost (pictured above with his Tweetawatt, Pachube Orb) and I (see our presentation for EarthWeek SL here) plan to be at Virtual Homecamp on ReactionGrid between 9am and 10.30am EST. Dave has done a number of cool energy monitoring hacks including a Pachube link to and from OpenSim.

Also keep your eye on Dave’s blog, The Daily Glyph, for what’s new in distributed sustainability. Dave just posted some great links on Sustainable Interaction, design and work by ITP researchers and others in sustainable use of technology.

Sustainable Interaction | Main / Papers

Sustainable interaction design | Sustainable Minds

Design For the Other 90% | Cooper-Hewitt, National Design Museum

If you are in London, look out for Oliver Goh of Shaspa as Oliver will be at Homecamp in London. As I mentioned in my previous post, Oliver will soon be launching both Shaspa commmunity and enterprise hardware and software packages for “Intelligent Energy Management.”

For a bit of homecamp history, James Governor (picture below from Chinposin), recaps  some of the successes of  the first HomeCamp here.

And last but not least, a big thanks to sponsors, CurrentCost, Greenmonk, Pachube, Onzo, and ReactionGrid,  and media partner theattick.tv who are making the London and virtual homecamp events possible.

]]> http://www.ugotrade.com/2009/04/24/homecamp-2-home-energy-management-and-distributed-sustainability/feed/ 2 http://www.ugotrade.com/2009/04/19/sensor-networks-and-sustainability-connecting-real-virtual-mobile-and-augmented-reality/ http://www.ugotrade.com/2009/04/19/sensor-networks-and-sustainability-connecting-real-virtual-mobile-and-augmented-reality/#comments Sun, 19 Apr 2009 06:32:59 +0000 http://www.ugotrade.com/?p=3381

Today, I did a presentation, on connecting real, virtual, mobile, and augmented spaces to support sustainability, for Earth Week SL, with Dave Pentecost and Jim Purbrick, who presented on Carbon Goggles.

Dave and I focused on sensor networks, open data, Pachube, OpenSim, and sustainability from perspective of, “hack local, think global.”  Dave and I will be picking up on some of these themes of sensor networks and sustainability next week in our presentation with Dimitri Darras at ITP,  NYU, Aprl 24th, 6.30 pm to 8 pm – details here.  If you are in New York City, I hope to see you there.

We got some interesting insights into augmented reality from Jim Purbrick whose Carbon Goggles project prototypes how we can use augmented reality to read carbon identity and to combine well organized, verified data from AMEE – a neutral aggregation platform to measure the “carbon footprint” of everything on earth, with crowd sourced tagging and linking.

Shaspa – “the sensor network system that has it all”

We also discussed, recently launched, Shaspa. Shaspa’s energy management packages connect spaces – real, virtual, mobile and augmented.  Shaspa has been blogged  by Maxping and Virtual World News, so you can read all about it, but the Shaspa device kit won’t be available until next week. Some key features of the Home Energy  package are listed on the slide above.  However, this evening, Dave Pentecost and I got a sneak preview of both the Shaspa commmunity and enterprise hardware and software packages from Shaspa founder Oliver Goh. We were pretty impressed.

Dave: “It’s the ultimate hackable device for energy management!”

Oliver: “Bring us any sensor device – with documentation, and within three days we will put a driver into Shaspa.”

Oliver is on the right and Dave on the left in the picture above. The picture below shows Shaspa in OpenSim. Oliver and I will be attending the 3D Training, Learning and Collaboration Conference in Washington, DC, next week.

Links

Here are some of the links that came up in the presentation as many people asked for them to be published. Dave also has them on his blog.

SLIDES on GOOGLE DOCS:
Earth Week SL Presentation, April 18th, 2009 – Google Docs

Pachube, sensor networks

Dave’s blog covering Maya archaeology, jungle ecology, and technology

Maya Frontier, Usumacinta River videos

Collapse

Arduino

Pachube – tutorials

Pachube Apps -

Arduino-SL-Pachube data site

SL to Pachube site

Dave’s Danger Shield – Pachube tutorial

TweetaWatt site (LadyAda)

Dave’s post on TweetaWatt to Opensim/SL

Peter Quirk’s post on Importing Sketchup into RealXtend

Opensim

RealXtend

ReactionGrid

homecamp

cminion -wind turbines in OpenSim

MiketheBee

Is it “OMG finally” for Augmented Reality?

Smart Planet: Interview with Andy Stanford-Clark

Orange Cone – Information Shadows and Things as Services

Wilfred Pinfold, Director, Extreme Scale Programs for Intel, and the Supercomputing Conference general chair, is working with some Intel colleagues to make a project called ScienceSim the centerpiece of a special workshop event at the SC09 conference (see Supercomputing Conference, an ACM and IEEE Computer society sponsored event).

Recently, I interviewed Wilf Pinfold (see interview below), Mic Bowman (also see my previous interview here), and John A. Hengeveld (see interview below). I wanted to find out what are the underlying goals of this SC conference program?  Why are members of the SC community being encouraged to participate with the ScienceSim environment? What projects are beginning to emerge? And, what are Intel’s goals in giving infrastructure support to further the conversation between high performance computing and collaborative virtual worlds?

The vision of creating new ways to collaborate and interact with big data does seem to be one of the more significant steps we can take at a time when we find many of our most complex systems roiling and threatening total collapse. As Tim O’Reilly has pointed out – from financial markets to the climate, the complex systems we depend on for our survival seem to be reaching their limits.

But,  how can we get from the place we are now – see this example of an n-body simulation in OpenSim, to the point where we can collaboratively steer from our visualizations big data simulations of climate change, financial markets, or the depths of the universe.  The picture opening this post is a:

Frame from a 3D simulation of gravitational waves produced by merging black holes, representing the largest astrophysical calculation ever performed on a NASA supercomputer. The honeycomb structures are the contours of the strong gravitational field near the black holes. Credit: C. Henze, NASA

Wilf Pinfold explained to me part of the reason to begin a dialogue on collaborative visualization at SC ’09 is that super computing communities (that tend to be highly skilled and visionary) have played key roles in internet development in the past. Wilf pointed out,  key browser technology  developed out of these communities in the early days of the internet – see this wikipedia entry that gives  a background on the role of NCSA (National Center for Supercomputer Applications).

The hope is, while there are many obstacles to overcome, the super computing community has both the skills and motivation to find solutions to creating collaborative environments capable of the kind of rapid data movement that scientific/big data visualization needs. Solving the problems of realtime collaborative interaction with big data will  have many ramifications for the way we understand virtual reality, the metaverse, virtual worlds (all these terms are becoming increasingly inadequate for cyberspace in the age of ubiquitous computing, an argument I will make in another post!).

There have already been a number of blogs on ScienceSim (see Virtual World News, New World Notes, Vint Falken, and Daneel Ariantho). There have also been Intel blogs – see this post by John A. Hengeveld (a senior business strategist working with Intel planners and researchers to accelerate the adoption of Immersive Connected Experiences). And Intel CTO Justin Rattner’s post announcing the project this November.

But to blow my own horn a little, I think i was the first to blog the encounter between OpenSim and Supercomputing (an encounter I to some degree provoked by making the introductions) see this post.  So I have been following the ScienceSim initiative with great interest.

Very shortly after N-Body astrophysicicsts Piet Hut and Jun Makino, creators of  – GRAPE (an acronym for “gravity pipeline” and an intended pun on the Apple line of computers) – a super computer that will become one of the fastest super computers in the world (again), met Genkii – a Tokyo based strategic company working with OpenSim, the first N-body simulation appeared in OpenSim.  And in a matter of weeks  this video went up on YouTube – the result of a collaboration between MICA and Genkii.  But the nirvana of being able to create visualizations using real time data from super computers that can be steered from a collaborative environment is still a ways off.

Super computing communities tend to be geographically very dispersed and researchers often find themselves far from simulation facilities so there is both the motivation and skills to pioneer new tools for collaborative visualization. I know that astrophysicists certainly see their value (Piet Hut has some profound ideas on this). Astrophysicist Piet Hut and others  (see here for more) have been pioneering the use of VWs for collaboration.  There are two Virtual World organizations, both founded by Piet Hut and collaborators, that are currently exploring the use of OpenSim for scientific visualizations.  One is specifically aimed at astrophysics, MICA, the Meta Institute for Computational Astrophysics, and the other is aimed broadly at interdisciplinary collaborations in and beyond science, Kira, a 12-year old organization focused on `science in context’.  As of last week, there are two weekly workshops sponsored jointly by Kira and MICA that explore the use of OpenSim, ScienceSim, and other virtual worlds.  One of them is “Stellar Dynamics in a Virtual Universe Workshop” and the other is “ReLaM: Relocatable Laboratories in the Metaverse.”

MICA was founded two years ago by Piet Hut within the virtual world of Qwaq Forums (see the paper “Virtual Laboratories and Virtual Worlds”). The Kira Institute is much older: it was founded in 1997.  Later this month, on February 24, Kira will celebrate its 12th anniversary with a presentation of talks, a panel discussion, and a series of workshops.  See the Kira Calendar for the main event, and the Kira Japan branch for a special mixed RL/SL event in Tokyo.  During both events, Junichi Ushiba will give a talk about his research in which he let paralyzed patients steer avatars using only brain waves.

Other early adopters of ScienceSim include Tom Murphy, who teaches computer science at a Contra Costa College. Prior to teaching, Tom spent 35+ years working for supercomputer manufacturers. Tom said:

it is very natural for me to find significantly new ways to visualize and interact with scientific mathematical models via ScienceSim and the OpenSim software behind it. ScienceSim also allows us to interact with each other and teach students in new ways.

Also Charlie Peck, chair of the SC09 Education Program, (his day job is teaching computer science at Earlham College in Richmond, IN), is working with Wilf Pinfold, Tom Murphy and others “to explore how 3D Internet/metaverse technology can be used to support science education and outreach.”

Cristina Videira Lopes, University of Irvine, is doing very interesting work  on road and pedestrian traffic simulations. Crista is also the creator of hypergrid in OpenSim,

People Meet People Meet Data: A Conversation With Mic Bowman

Screenshot of ScienceSim from Daneel Ariantho

Tish: How does this work on ScienceSim  fit into a wider dialogue on linked data? Where people meet people meet data, and where data meets data?

Mic: Yeah… that’s hard by the way.  Open integration of data (and more interestingly the functions on data) is very hard if it comes from multiple, independent sources.

That’s the people part. For example, if Crista can build a model of the UCI campus somebody else builds an accurate model of several cars and another expert provides the simulation that computes the pollution generated by those cars in that environment…its bringing people together to solve real problems, no matter how far apart physically.

Tish: You mention three different simulations here. Could you explain why it is difficult to integrate data from multiple sources?

Mic: integrating data from multiple sources has always been one of understanding & interpreting both the syntax & semantics of the data. Even relatively simple things like multiple date formats require explicit translation. More complex formats, like the many formats data is represented for urban planning, are barely computable independently let alone in conjunction with data from other sources (each with its own representation for data). Its often the expertise & the collaboration of bringing people (and their bag of tools) together that solves these problems.

Tish: and in this case the bag of tools is high performance modeling..?

Mic: high performance modeling, rich visualizations and data. Its the three that matter… data, function, and interface.

Tish: Some people have a very hard time wrapping their head aropund the fact that anything that seems related to Second Life can do this.  Can you explain more about the difference between SL and OpenSim?

Mic: OpenSim potentially improves data & function because it can be extended through region modules. Region modules hook directly into the simulator to provide additional functionality. For example, a region module could be implemented to drive the behavior of objects in a virtual world according based on a protein folding model.

We need to work on additional viewer capabilities to address the user interface limitations.

Tish: Yes Rob Smart’s (IBM) recent data integrations with OpenSim (see here) are impressive. Re viewers one of the biggest objections to virtual worlds is the mouse pushing and pc tied interface.

Mic: There are great opportunities for improving the interface

Tish: Yes I really like where the Andy Piper’s experiments with Haptic Interfaces for OpenSim lead, see Haptic Fantastic! And I think that we will have cyberspace ubiquitous in our environment, not just stuck on a pc screen, sooner than we think.

Mic: Mic’s opinion (not Intel): until we get souped up sunglasses with HD screens embedded (or writing directly into the eye) there will always be a role for the PC/Console/TV).  But, it isn’t about the device… its about the services projected through the device… sometimes you’ll want a very rich experience… sometimes you’ll want an experience NOW wherever you are.

Tish: I think people are only just realizing that VWs will be a now and wherever you are experience very soon.

Mic: That’s the critical observation the virtual world is not an application you run… its a “place”… and you interact with it where you are or maybe interact through it. Speaking for Intel… it is the spectrum of experiences that are critical to support.

Interview with Wilfred Pinfold

Picture from National Science Foundation – “Climate Computer Modeling Heats Up.”

Tish Shute: I know your day job for Intel is in High Performance computing. Could you explain to me a little bit more about what you are working on in this regard – a mini state of play for high performance computing from your perspective?

Wilfred Pinfold: My title is Director, Extreme Scale Programs. This program drives a research agenda that will put in place the technologies required to make an Exa (10^18) scale systems by 2015. The current generation of high performance computers are Peta (10^15) scale so this is a 1000x increase in performance and this increase will require significant improvements in power efficiency, reliability, scalability and new techniques for dealing with locality and parallelism.

Tish: The nirvana in terms of linking supercomputers to the collaborative spaces of immersive virtual worlds is to be able to create visualizations using real time data from super computers in collaborative VW environments, and ultimately for researchers to be able to collaborate and steer their simulations from their visualizations.  Where are we at now in terms of scientific data visualization in VWs? And what are the current obstacles to using realtime data from super computers?

Wilf: Being able to steer a simulation from a visualization requires both a visualization interface that allows interaction and a simulation that operates at a speed that is responsive in interactive timeframes. For example a weather model that predicts the path of a hurricane would need to operate at something close to 1000x real time. This would run through a day in ~1.5 minutes allowing an operator to run the simulation over several days multiple times with different parameters in a single sitting to understand the likelyhood of certain outcomes?

Tish: Do you see a networked online collaborative virtual world being capable of being a visualization interface that allows meaningful interaction with the hurricane scenario you describe in the near future (next 6 to 18 months)?

Wilf: I was using the hurricane example to explain the usage model not an imminent capability. Hurricane Simulation: Accurate hurricane simulations require multiscale models able to resolve the global forces working on the storm as well as the microforces that define precipitation. We can build useful weather models today that run faster than real time (anything slower is not useful for prediction) but we are a long way from the ideal.
Visualization: There are excellent visualizations of weather systems but I have not yet seen a virtual world that can track a simulation and allow the scientist or team of scientists to see what is going on at both the macro scale and zoom in to see precipitation conditions. Today’s supercomputers are much better at this than they were a few years ago but they are a long way from ideal.

Tish: Open Source Virtual World technologies are pretty diverse in their approaches, Croquet, Sun’s Wonderland and OpenSim are quite different and have different strengths and weaknesses. As you have become more familiar with OpenSim, what have you found about the technology that particularly lends itself to this project – ScienceSim (Mic mentioned Crista’s hypergrid code for example, modularity is another feature often cited).

Wilf: We have found OpenSim’s client server model is well suited to the visualization model and the ability to put the server next to the supercomputer producing the visualization data is critical. We are however very interested in other environments and encourage papers, demonstrations and research on any of these platforms at the conference.

Interview with John A. Hengeveld

Tish Shute: OpenSim’s dependence on Second Life based viewers is sometimes cited as a limitation, and sometimes as a strength. What are your views on this?  What would a strong open viewer project directed at science applications bring to the picture?

John Hengeveld: There may be more than one strong open viewer project required for opensim compatible experiences.  The strength of the Hippo viewer, for example, is availability and its weakness is the size of the client.  We would love a ubiquitous, client.. that runs on all platforms, but each hardware platform brings tradeoff and restrictions of its own.  Today, probably all of the folks innovating in the space can deal with the size of a very fat rich client ap.. they have big computers anyway.  But as we get into more 3D entertainment and augmented reality applications.. virtual mall, collaboration apps.. etc… there is a great deal of room to optimize for the specific experience.  Balancing visual experience with bandwidth and compute performance available .. tying into standard browsers, etc… people have done some of this work.. and I think all of it adds to the usefulness of these worlds.

Tish: Integrating highend game engines and OpenSim opens up new possibilities. But licensing issues have been an obstacle. Could a project like ScienceSim get a non-commercial license on a high end game engine?  What would that bring to the picture?

John: Anything is possible. Game engines can give a great deal of design power for high value experiences, but the programming of these experiences must be simplified.  Mainstream adoption in enterprise can’t be premised on the programming model of studio games… that’s a big step to get over I think.  There are very interesting possibilities when we take that step tho.  Simulation, training, agents of various types (I just finished watching “The Matrix” for like the billionth time… I think agents are cool…)

Tish: Where does Larabee fit into the picture of ScienceSim and next generation virtual worlds?

John: We are all very excited about the Larrabee architecture and its application to work loads like next generation virtual worlds, both in the client.. delivering immersive reality.. and someday potentially in a distributed architecture simulating and producing these worlds.  For Intel CVC is an all play.  Atom will be used in strong mobile clients.  Core will be used in Enterprise PCs, Laptops and Desktops   Xeon will be simulating these environments and handling the data communication, and Whatever we brand Larrabee… will be enabling compelling visual experiences. Oh.. and our software products (Havoc, tools and others) will be building blocks in knitting all this together.  Larrabee is a part, but there are a lot of other pieces in our vision…

Tish: If the kind of rapid data movement that scientific visualization needs is achieved in virtual worlds, this will be quite a game changer for business applications of VWs too. Also it will blurr the boundaries between what we call virtual worlds and mirror worlds. It seems to me this kind of rapid data movement is a vital step towards what Mic described to me as Intel’s vision of CVC: “Connected Visual Computing is the union of three application domains: mmog, metaverse, and paraverse (or augmented reality).” It almost seems to me that if you achieve your goals for ScienceSim you will change how we think about virtual worlds in general? What do you think?

John: I certainly hope so..  Part of our goal is to stimulate innovation in the technology and usage models that will enable broad mainstream adoption of CVC based applications (what we categorize as immersive connected experiences).   By tackling the scientific visualization problem, we hope to find the key technology barriers and encourage the ecosystem to solve them.

Tish: To me virtual worlds and augmented reality should be complimentary and connected experiences. How do you see this connection evolving?

John: We certainly see them as related.  In the long term, there are many common building blocks.. but they aren’t united per se.  Its about the user experience, and in some usages these two are almost identical…  in some.. they don’t look or feel at all alike… the viewer is distinct by a lot.  Our approach is to enable building blocks that people can quickly build out usages that are robust.

Tish: What is Intel’s vision for ubiquitous mobile computing and an internet of objects?  How can high performance computing be an enabler for this vision?

John: Mobile computing is a central part of our life, culture and community in economically enabled economies.  It feeds the data of our decisions, it connects us to entertainment, it is the access point to our soapboxes, pulpits, economy and families.  This creates a massive increase in data, a massive increase in interactions, transactions and visualizations.  While many HPC applications will be behind the scenes (finance, health, energy, visual analytics and others), HPC will emerge as a part of a scale solution to serving some of this increase… particularly that part where interactions and visualizations are complex or compelling.. or where scale enables the usage per se .. I talked about my love of agents earlier.. and some of that comes in here.  Compute working behind the scenes to help managed the data complexity, manage some of the base interactions between ourselves and technology.  The other thing we talk internally about the “Hannah Montana usage” where millions of people use their mobile devices to access and participate (using the sensors in the device) with an interactive live concert.  When Mylie hears the applause of a virtual interactive audience… and can scream back at them.. we’re there.  Access to ubiquitous compute will be mobile, and interactive experiences will be complex.. and HPC can help make that real.  Watch out for the mental trap that HPC is always high end super compute clusters tho… the “mainstream HPC”.. smaller clusters… high threads, etc… will play a key part in all of this as well.

Interesting that John ended on this point as this just came in from Wired.

Usman Haque (architect and director, Haque Design + Research) and founder of Pachube pointed me to this image from T.R. Oke’s book, “Boundary Layer Climates” (original photo source Prof. L. E. Mount’s The Climatic Physiology of the Pig) to explain his approach to the “software” of space.

My focus as an architect has always been to consider what I’ve called the “software” of space (sounds, smell, light, temperature, electromagnetic fields, social relationships, etc.) rather than the “hardware” (floors, walls, roof, etc.) as it has traditionally been considered. The image (above) really sums up why I think this is important.

It’s the same piglets, in the same box, but on the right hand side the temperature has been increased. This small change in how the space is “programmed” has dramatically changed the way the ‘inhabitants’ relate to each other and how they relate to their space. This approach to architecture became my challenge: how to translate such strategies into the general architectural discourse and how to bring into reality such possibilities for the construction industry.

“Connecting Environments, Patching the Planet”

Pachube is the culmination of 12 years of work.

“It is now occupying pretty much all my time and will do for the foreseeable future,” Usman told me.

Haque Design + Research is not foregrounded on the Pachube site. And I did not make the connection at first. But when I followed a small link at the bottom, I was soon delving into the work of Usman Haque.  Then the penny dropped and I realized that Pachube is not only:

A web service that enables people to tag and share real time sensor data from objects, devices and spaces around the world, facilitating interaction between remote environments, both physical and virtual.

Pachube is also a really big idea.

Ubicomp and the “Software of Space?”

Usman suggested that, if I really wanted to go back to the beginning of the Pachube vision, I should check out the work of Dutch architect Constant Nieuwenhuys and his 1956 proposal for a visionary society, New Babylon

Usman explained:

Constant Nieuwenhuys is certainly an inspiration for Pachube. He envisages a globally connected architecture, built by its inhabitants – configured, reconfigured, reappropriated…

For a more contemporary reference, Usman noted there are lots of overlapping concepts with Adam Greenfield’s work. Adam is head of design direction for service and user-interface design at Nokia. see Everyware: The dawning age of ubiquitous computing, and Urban Computing and its Discontents to understand more about the vision Adam Greenfield has been developing.

Pachube is right in the zone with the ideas outlined in The project description for Adam Greenfield’s upcoming book, The City Is Here For You To Use:

The City… takes everything explored in Everyware as a given, and a point of departure.

It assumes that emergent technologies like RFID, mesh networking and shape-memory actuators…will simply be part of how cities will be made from now on…

The Pachube Team

The Pachube Team – Usman Haque (creative director), Chris Leung (EEML developer), photoshopped laptop: Chris Burman (“example-maker”. e.g. SL code and Google SketchUp plugin), Ai Hasegawa (graphic designer), Sam Mulube (technical producer and website development).

Also, with Bruce Sterling as a “visionary” adviser and other luminaries involved, Pachube has some brilliant guiding lights.  Usman pointed that many people have “have helped, prodded, nudged and advised along the way!”

Along the way I became interested at times in what an “operating system” might mean in the context of architecture (paper,  Hardspace, Softspace and the possibilities of open source architecture, 2002 (PDF), particularly an “open source” operating system (Urban Versioning System, http://uvs.propositions.org.uk/ ). I was also interested in developing tools for supposedly “non-technical” people to start building their own interactive systems or environments, hence the release of The “Low Tech Sensors & Actuators for Artists and Architects” pamphlet , co-authored with an old friend, Adam Somlai-Fischer, back in 2005.

An off-shoot of this has been an obsession with trying to rescue the concept of “interaction” from oblivion – I say oblivion because I think the really exciting possibilities of the concept of interaction are being lost because we’re being sold a billion so-called “interactive” devices and gadgets that are, in fact, merely “reactive”. In this, I turn often to the work of cybernetician Gordon Pask, particularly active in the 50s, 60s and 70s in the development of truly interactive systems. (And also a collaborator with Cedric Price, one of my favourite architects).

Which brings me to Pachube, which is now occupying pretty much all my time and will do for the foreseeable future. (Haque Design + Research still continues, and has a separate team — it will be involved mostly in the kinds of things it has in the past, but also in pushing development of things that *use* Pachube, such as the project Natural Fuse ).

Pachube came about as a direct attempt to enable the production of dynamic, responsive, conversant ‘environments’. It basically evolved out of three strands of thought.

The first was the notion of the geographical non-specificity of architecture these days. By this I mean that, for many of us now, “home” is an idea constructed from several places –we live and work in environments composited by networked technology from fragments that bridge huge geographical distances. These environments are resolutely “human” (in the sense of being inhabited, designed and determined by people) yet context-free (because they do not privilege geographical location). I wanted to find a way to “connect” up remote spaces, much like Remote Home and a whole range of other projects had done, but in a generalized way so that it would be possible to keep adding to the ecosystem of connected environments on an ad hoc basis; a global architecture if you will.

The second strand of thought came from the desire to open up the production process of “smart homes.” I’m concerned by developments in ubiquitous computing whereby “making technology invisible” equates to placing the design and construction process solely in the hands of knowledgeable others. Whereas it’s still possible more or less to do DIY on your home, if many ubicomp technologists had their way it would become less and less possible simply because of the complexity of reverse-engineering such closed-systems. It’s already a problem with larger buildings: service companies go out of business, proprietary skills or tools disappear and complex lighting and sensor systems remain unused. So, with Pachube I wanted to help foster a more open way of developing the discipline: to embrace the concept of the maker, and to help people negotiate their technological future.

Reconfigurable House, an environment constructed from thousands of low tech components that can be “reconfigured” by its occupants.

The final strand of thought relates to Pachube’s emphasis on “environments” rather than “sensors.” I believe that one of the major failings of the usual ubicomp approach is to consider the connectivity and technology at the object-level, rather than at the environment-level. It’s built into much of contemporary Western culture to be object-centric, but at the level of “environment” we talk more about context, about disposition and subjective experience. An ‘environment’ has dynamic frames of reference, all of which are excluded when simply focusing on devices, objects or mere sensors. If one really studies deeply what an ‘environment’ is (by this I mean more than simply saying that “it’s what things exist in”), one begins to understand that an environment is a construction process and not a medium; nor is it a state or an entity. In this I would refer to Gordon Pask’s phenomenally important text “Aspects of Machine Intelligence” in Nicholas Negroponte’s Soft Architecture Machine though it makes for extremely tough reading (Negroponte compared it in importance to Alan Turing’s contributions to the computer science discipline).

Ultimately, though, Pachube is here to make it easier to participate in what I expect to be a vast ‘eco-system’ of conversant devices, buildings & virtual environments. Pachube will facilitate the development of a huge range of new products and services that will arise from extreme connectivity. It’s relatively easy for large technology companies like Nike and Apple to transition into the Internet of Things, but Pachube will be particularly helpful for that huge portion of smaller scale industry players that *want* to become part of it, but which are only now waking up to the potentials of the internet — small and medium scale designers, manufacturers and developers who are very good at developing their products but don’t have the resources to develop in-house a massive infrastructure for their newly web-enabled offerings. Basically, having built a generalized data-brokering backend to connect physical (and virtual) entities to the web, others can now start to build the applications that make the connections really useful.

Tish Shute: You mentioned that both Bruce Sterling and Gavin Starks (AMEE) have given input on Pachube.  Can you describe any specific ways they (and others?) have influenced the evolution of Pachube? You mentioned the concept of “engaged responsible spime wrangling” when we talked on skype?

Usman Haque: Yes, I am very grateful to a whole bunch of people who have helped, prodded, nudged and advised along the way!

I asked Bruce to be a “visionary” adviser because he was one of the people early on to envisage the concepts and ramifications of “spimes”  (his neologism for ‘space-time objects’). While I agree that “spimes” are directly relevant, what I found most important from his conception was the concept of “wrangling” – being actively and productively engaged and responsible in the development of spimed environments. I think it was a crucial leap: to talk about “wranglers” rather than “end-users”. So the kinds of questions I’ve turned to him for regard how to nudge people away from being “end users” and towards being “wranglers”; and about how to transition from being a “hacker toy” to “major infrastructure”. He had some great (and invaluable) responses, of which one of the most important to me was something he said in email: “…I think total openness is fatal.  It’s like lying in a blazing sun under a sky full of vultures, naked. It’s also rather rude, like babbling anything or anything that flies into your head and still expecting people to pay attention.”

Gavin Starks and also Dopplr’s Matt Biddulph have been sort of “friendly neighbours” to Pachube: they’ve made some great introductions and I turn to them often for advice on being a London start-up. What’s been really useful for me is that they are active in a related area and have directly useful advice: Gavin, of course, since he’s involved in metering the world’s energy; and Matt perhaps less tangibly in his day job as Dopplr’s CTO but more so in his active Arduino-enabled social life!

One very important Pachube advisor has been Dr. Paul Pangaro, who has previously been CTO at a number of technology startups, and brings vital experience from his time at Sun Microsystems as Senior Director and Distinguished Market Strategist. (Oh, and he’s also a former student and collaborator of Gordon Pask’s!) He has been very helpful in developing a viable business model in conjunction with my brother Yusuf Haque, who, with his experience in raising capital for startups, has led the fundraising process.

Of course, direct daily input from the Pachube team has been vital to the development of the project, and without Chris Leung (EEML development) and Sam Mulube (backend development) it would be a very different thing indeed!

Tish Shute: Now the emerging internet is the world as a networked, enhanced virtual/reality environment – sorry about the inadequate terminology, but as you said “the distinction between real and virtual is becoming as quaint as the distinction between mind and body”. You are participating in the Sentient City exhibition organized by the Architectural League of New York for September 2009.

Could you explain more about the Sentient City project and what your contribution Natural Fuse which uses common house plants, energy-monitoring sensors, and Pachube to create “a city-wide network of electronically-assisted plants that act as carbon-cycle circuit-breakers in much the same way as conventional electrical circuit-breakers do…..” is about?

Usman Haque: Situtated Technologies, founded to explore the impact of “situated” technologies (i.e. locative media, etc.) in urban spaces, kicked off with a symposium organised by Mark Shepard, Omar Khan and Trebor Scholz and supported by the Architecture League of New York a couple of years ago, and continued through a series of pamphlets (the first by Adam Greenfield & Mark Shepard; the second by me and Matthew Fuller; the third and fourth by Benjamin Bratton & Natalie Jeremijenko and Laura Forlano & Dharma Dailey). This is now culminating in an exhibition, “Toward the Sentient City”, opening in September 2009, as a public manifestation of many of the concepts raised over the years.

Natural Fuse, a project funded by the Architecture League to be part of that exhibtion, is really a Haque Design + Research project rather than Pachube project alone. It came about for two reasons. The first was because we had been investigating for several months many different ways to use plants and vegetation in interactive architectural design: as living walls, as responsive systems, as visual and olfactory indicators, as passive ventilation — fantastic research undertaken predominantly by my invaluable production assistant Barbara Jasinowicz. We were particularly interested in energy creation and monitoring and had made a number of (unsuccessful) proposals to develop building systems based on plant interaction. The second was because I wanted to have a good demonstration project for Pachube: a system that was not just end-to-end single-point communication, but one in which the system increased its efficiency over time through more and more geographically-dispersed connections. So Natural Fuse developed through a series of conversations with a very intelligent and witty designer Nitipak (Dot) Samsen who was then an intern and who will now lead design work along with Cesar Harada (similarly intelligent and witty!).

Briefly, the point of Natural Fuse is to use networked plants, based on the Arduino ethernet platform, to harness the carbon-sinking capabilities of plants to create a city-wide network of electronically-assisted plants that act both as energy providers and as shared “carbon sink” circuit breakers. By sharing resources and information between the plants, energy expenditure can be collectively monitored and managed. The purpose is to create a collective “carbon sink”, that offsets the amount of energy consumed by the plant owners – a natural “circuit breaker”. If people cooperate on their energy expenditure then the plants thrive (and they can all use more energy); but if they don’t then the network starts to kill plants, thus diminishing the network’s energy capacity. Of course, the network functionality is enabled by Pachube. The plan is to distribute these to some households in New York and offer plans and downloads for people to build their own as well.

Tish Shute: You describe Pachube as linking environments not just sensor to sensor (as sensorbase.org does) – an environment for Pachube could be a web page. An essential concept in Pachube is the concept that anything could be an environment and such environments are treated equivalently with EEML. You describe EEML as a protocol that sits comfortably with existing building protocols “what it brings to the picture is the ability to describe buildings that change.”

How will EEML change our understanding of architecture and enable the view of architecture that “includes smells, sounds, light, electromagnetic fields – buildings as dynamic and changing?” (Prasad Passive House?)

You describe EEML as straddling and designed to work alongside IFC construction industry format. Who is involved in the creation of EEML?  Could you explain a little bit how it is different from SensorEML? You mentioned little has been done re post-construction evaluation of buildings. How will EEML enable buildings to share strategies (for example on energy consumption) as you put it?

Usman Haque: The Extended Environments Markup Language (EEML) (which is the protocol around which much of Pachube is based) is being developed to make the idea of “dynamic, responsive and conversant environments” a reality. It works with existing construction standards like Industry Foundation Classes (IFCs), but exists to extend them to account for dynamic, responsive and, dare I say it, conversant buildings. In the perhaps prosaic world of construction, this helps to facilitate a number of architectural requirements such as post-occupancy evaluation, realtime site-based environmental feedback at the design phase and simulations that synchronise with realworld installation. With EEML and Pachube you’ll be able to start working with, say, an Autocad model at the design phase, and include *real time* environmental data from the site, as well as to model expected sensor and assumed energy consumption data of the design; use the same model during the construction phase (because it will translate fine to standard modelling descriptions), and keep working with the same set of information even after the building is occupied and running — making it a whole lot easier to learn from the design and maintenance processes than it is currently.

At the same time this does not exclude the possiblity of talking about “sensors” (as SensorML wants to), but we are more easily able to consider, say, the dozens of different ways that different clients will want to address, access or search for those sensors; the changing contextual motivations for actually processing sensor information; and the capacity for flexible sensor ontologies — where you don’t need to know from the beginning everything you’ll be looking for once you’ve recorded mountains of data.

We can consider, equally as ‘environments’ a mountainside, the interior a building, the context of a webpage, the internal status and external context of a mobile device, the interactions within something like Second Life.

As a result of this conception of “environment” we remove the need for a distinction between “real” and “virtual”. We can consider, equally as ‘environments’ a mountainside, the interior a building, the context of a webpage, the internal status and external context of a mobile device, the interactions within something like Second Life — all these are environments and can communicate with each other on equivalent terms. More importantly a single “environment” can be expressed as a snapshot in time; or it can be expressed as a sequence of many snap shots over several years.

One very important thing we’re looking at now is how to transition the protocol from something that is status-based, to something that can express transactions, goals and processes. We’ve just started looking at how RDF and machine tags might help in this, largely spurred on by perceptive comments from one of my favourite designers, Toxi, a.k.a. Karsten Schmidt.

Tish Shute: You mentioned that you see “smart” buildings and “smart” cities as environments not just a collection of devices? On the Pachube web page there is a chart describing potential interactions between entities (one to one, one to many, etc.) but you do not give many pointers to how two unrelated objects that are connected would derive any value out of the connection…could you give me some examples of the kinds of use cases (Natural Fuse is one of course!) and interesting new opportunities to create shared value that Pachube will enable?

Usman Haque: Yes, I recognize that the Pachube website information leaves a lot to be desired…! Apart from a whole lot of conceptual information that’s missing, there are a number of undocumented API features that nobody has yet uncovered!

Well, in answer to your question: much of it is intuition – I don’t know exactly _how_ it will be valuable but I do expect the community to find ways to make such seemingly disparate interoperability valuable.

To make a prosaic example: say, (once privacy options are introduced) that a manufacturer creates a Pachube input application, like an electricity meter that automatically charts on Pachube. There is a certain benefit to its customers in being able to monitor their usage over time and to compare their usage to the aggregation of others in a similar class, but anonymised. Say that someone else has produced a Pachube output application like a mobile phone Pachube viewer. Now the electricity meter users can use this new output application as an extension to be able to monitor their consumption on a mobile phone. Now, imagine if someone else develops a new product, a networked lamp — it would now be very easy for that designer to write a little app to make the networked lamp switch on (or change brightness) according to the electricity consumption, even remotely. The point is that the more input and output apps are added the more valuable they each become.

Scattered House, like Reconfigurable House, but spread throughout various cities in the world to demonstrate the implications of designing environments and buildings in the context of family diasporas and ubiquitous ad hoc networked connectivity.

Part of Pachube’s emphasis, in not making specific connections more important than others, is that the community can develop new types of connection. So, while of course it makes it relatively simple to create remote control connections between seemingly unrelated entities (like mobile phones and houses; or web pages and furniture); and it makes it relatively simple to connect up environmental conditions from the physical world to seemingly distant Second Life (or, more interestingly to me, OpenSim ) which can make it a more viable interactive environment; and it makes data aggregation and comparison possible between wide ranges of energy consumers to facilitate aggregation analysis; but, the point really is to make it easy for people and companies to build in this kind of connectivity and invent new uses.

Through my close association with The Bartlett, University College London’s architecture school, I hope to develop some particularly relevant use-case scenarios for the architectural industry. I think we’ve really not even begun to imagine the kinds of applications that will be important, though I guess Natural Fuse exemplifies the kind of approach I would like to see in Pachube-enabled applictations: one in which the collective/hive experience contributes towards some end goal, to make it possible to create a “wikipedia of environments” as opposed to a web-based Wikipedia – it’s not that I necessarily want to create these things myself, but rather I want to make it possible to create such things.

Tish Shute: You mentioned that you hope Pachube to be the place to connect smart products – product to product communication?  Also you mentioned that you would like to have a way that smart products can self register with Pachube. While all feeds are public now, you are going to create groups with different levels of privacy. Both of the aforementioned features would enable more business applications for Pachube.  But could you describe the business model for Pachube?

Usman Haque: Essentially, there are three facets to the business model. The first takes a cue from Flickr in recognising that there are those who would like a more sophisticated set of services as “professional” accounts. The second is to be able to provide a set of tools and applications for medium scale manufacturers and developers who want to web-enable their offerings, who will be able to take advantage of the growing repository of Pachube.Apps and add-ons, and who want the convenience, security and economy that Pachube will be able to offer. The third approach is to become more directly involved in large-scale urban infrastructure projects. There is a fourth facet, but we consider it the killer so I’m keeping quiet for the moment….

So yes, in order to make all these things more useful we’ll soon be introducing a range of privacy options on feeds, the ability to create “aggregates” from collections of feeds, and the possibility of groups, organised around feeds. Another thing we’re hoping to introduce soon is open environment-level tagging, so that anyone will be able to tag environments, though there will be a way of evaluating the importance of any given tag.

Tish Shute: I know you mentioned that you are trying to find ways to find tools that allow people to contribute to their environment. There are a number of projects aimed at providing tools that will help people/business to reduce their carbon footprint  – The Carbon Account, AMEE, Wattzon, Onzo Is Pachube working with any of these projects and how?

What are the most interesting ideas in this area of changing our relationship to energy consumption emerging from Pachube?

Usman Haque: The carbon footprint calculating industry is getting quite crowded…! So far I’ve particularly appreciated AMEE’s API (which is also used by the Carbon Account, I believe). So one thing we have just released a Pachube.App ‘plugout’ which will take a feed from an electricity meter tagged “watts” or “kilowatts” and convert it into a realtime carbon footprint calculation (driven by AMEE’s international and region- and supplier-specific carbon conversion factors). So it should be really easy to discover how many kilograms of CO2 you generated in the last 15 minutes…. that last hour… the last 24 hours. Here’s a list of some of the feeds that are already making use of this: http://www.pachube.com/tag/co2_last_15_mins

Tish Shute: I know the Aduino community has really taken and interest in Pachube. Who are the early adopters on Pachube?  What are the most prevalent use cases you have seen so far?

Usman Haque: It has actually been more difficult than I thought it would be getting the Arduino community interested. This has partly been due to the difficulty of internet-enabling Arduino (until recently adding ethernet access has been a bit of a tough chore). Now that it’s easier to connect up Arduinos, some of the early adopters have been interfacing Arduino to Current Cost meters (alleviating the need for a computer in between); and others have been doing things like tracking temperature, humidity and light level in their homes and offices. Pachube user C4C has been pretty active from early on: http://www.pachube.com/feeds/1284

Tish Shute: Pachube is input heavy at the moment – you mentioned not many accuators are plugged into Pachube yet.  You said this is in part because you have focused on making the backend robust and stable before taking a lot of hits. What new directions for Pachube will emerge from enabling the dynamic relationship between sensors and accuators?

Usman Haque: This will be a crucial evolution in Pachube, when we make actuators more evident. It’s input heavy at the moment, basically in the sense of being easy to see the inputs — you add “inputs” rather than “outputs”, so at the moment we have no idea of what’s actually plugged into the outputs unless people tell us! However, we know that there are plenty of outputs because they’re making API requests, we just don’t know what they’re being used for! Once the concept of actuators and output environments get built in to the system then I think we’ll know a lot more about how people are using the system.

To make this easier in the meantime we recently announce the Pachube.apps site, where people can start contributing Pachube ‘plugins’ and ‘plugouts’ — things that can be used by others without needing to code or hack, to create, generate or modulate Pachube inputs and outputs. One of these was Status2Pachube, which turns the online status of AIM, MSN Messenger, Skype or Yahoo! Messenger users into a Pachube input feed (to make it easy to create “remote presence” orbs and such); another was the CurrentCost2Pachube app to make it easy to connect up Current Cost electricity meters as input feeds; all of which can then be used by Pachube output apps, like the G1 Android phone Pachube viewer by Pachube user N4Spd or in the soon-to-launch Pachube2SketchUp plugout which will direct Pachube outputs into Google SketchUp (and by extension Google Earth) in order to generate or modulate 3-d models in response to realtime environmental/sensor data. (Pachube2SketchUp is pretty much finished for Mac OS X — but we’re having difficulty getting it to work on Windows, because of its sometimes pigheaded security measures… we’ll probably release it for Mac OS X alone soon anyway).

Tish Shute: Do you and Haque design expect to go beyond just providing a platform? Will you be producing more interesting applications like Natural Fuse on Pachube?  If so, can you tell me more about what you have in mind?

Usman Haque: I keep a clear distinction between my work as creative director of Pachube.com and my work as director of Haque Design + Research. Basically, while Pachube.com continue development of the platform in general, I hope that Haque Design + Research will separately continue creating pioneering interactive experiences, some using Pachube and others not. We have some things in mind, such as the idea of creating an open source building management platform, but that’s all to come later…

Tish Shute: One very interesting project you have been involved in is the creation of “Urban Versioning System 1.0″ which asks “What lessons can architecture learn from software development, and more specifically, from the Free, Libre, and Open Source Software (FLOSS) movement?” Can you tell me more about this project, its goals, and its progress? How Does UVS 1.0 relate to Pachube?

Usman Haque: The Urban Versioning System was essentially an attempt to understand what lessons the “open source” approach in software might provide to the collaborative development of environments and cities. It’s a sort of quasi-license — not yet quite ready to have the status of something like Creative Commons (which nicely suits media and software based creations, but doesn’t suit quite so well hardware and physical things beyond their design files). It’s more of a challenge, a series of constraints that might be applied. It has a link to Pachube, in the sense of encouraging conception at the environment and systemic level — you might call it the manifesto that connects Constant’s New Babylon hypothesis to the reality of Pachube!

Tish Shute: I know that you imagine Pachube scaling up to millions (billions???) of users. But scaling the real time web has proved a challenge (e.g the frequent surfacings of the Twitter failwhale during big events). What are the key points of Pachube’s architecture and design that will enable successful scaling?

How do you see Pachube itself fitting into the FLOSS movement?

Usman Haque: This is a really important question. There are a couple of things we are doing. The first is constantly to assume that we have 20 to 50 times more connections than we actually have… I put a lot of pressure on Sam about making sure about this, so he’s constantly developing, thinking about and testing little things for weeks in advance while at the same time fighting the usual daily little fires that arise The second is that we’re trying to learn from strategies being developed by Vlad Trifa and his group at the Institute for Pervasive Computing at ETH Zurich in Switzerland regarding the development of infrastructures for millions or more entities.

Regarding the connection to the FLOSS movement, there is no specific technical part of Pachube that is currently open source (apart from all the example apps and tutorials of course). However, I find the approach taken by OpenSim and Hypergrid really fascinating: I haven’t given this enough thought to how it might be implemented but I find quite appealing the idea of a multitude of open source and geographically dispersed Pachube-enabled servers with seamless transfer of data connections between them as necessary…..

Tish Shute: I know you have an Android Viewer for Pachube.  Android is a landmark for extended/augmented reality, as Wikitude proved, because with its compass mode Android brings together the essential ingredients for extended/augmented reality – knowing who YOU are, WHERE you are, WHAT you are doing, WHAT is around you.  It seems Pachube could be a powerful backend to a number of multi-user, mobile augmented/enhanced reality android applications?  Do you have any ideas/thoughts on this?

Usman Haque: That’s right — the Android viewer was created by rcreations.com/ a Pachube user — this new platform brings amazing opportunities to mobile devices. I would be really interested to see what I would consider the obvious next step: an app that becomes both a Pachube input and an output feed, one that overlays existing Pachube data, with new context-based, site specific data.

If I was to make a parallel to a Japanese anime, I’m fascinated by Dennou Coil a Japanese anime set 20 years in the future where children take for granted the overlay of the digital world with the physical world. BUT, I’d say that Pachube somehow relates more closely to Furi Kuri in its pataphysical stance and because one of the main characters has a portal to another galaxy in his head…….

Tish Shute: Do you do you see Haque design picking up on the challenge of creating some cool next generation interfaces/GUIs for extended/enhanced/augmented (sorry no perfect term) reality?

Usman Haque: Actually, no, I don’t see this as Haque Design + Research’s core focus going forward. We did some of this early on, getting involved in, for example, the development of a 3d smell interface; and exploring the role of electromagnetic fields on perception of haunted spaces. But these days, in the context of HDR, I’m less interested in making seamless interfaces and more interested in exploring what authentic interaction actually is (whether technologically based or not). I think it’s challenge enough for me to make a light-switch engaging, dynamic and conversant before getting to the perceptual infrastructure that goes on top of it all! HDR will also spend more time exploring passive systems, phase-change materials and plants in the context of the built environment.

Tish Shute: I know there has been some interesting integrations with Pachube lately – Andy Stanford-Clark’s mentioned using MQTT as the feed to get EML data into and out of Pachube rather than over HTTP. He said that’s interesting because MQTT is a much more lightweight protocol, designed for small sensors and low bandwidth / expensive (e.g. cellular) networks… and it’s also true push.. i.e. data is pushed to you directly from the broker (the hub in the middle), rather than you having to ask for it constantly (polling).

Have you opted for MQTT over HTTP polling?

Usman Haque: We haven’t yet implemented an MQTT bridge in part because it has proved pretty difficult. HTTP is quite important for us right now because there’s a whole universe out there using it; from your average web browser, to mobile devices, to ethernet devices and a whole range of languages and platforms — they all work, pretty much out of the box with HTTP. However, what we are exploring instead is being able to interface with Oliver Goh‘s Shaspa project — they’re already in the middle of solving the MQTT-Pachube bridge problem, and so that should hopefully provide Pachube access to and from MQTT devices.

Tish Shute: Chris Dalby just released Pachube Air. Have you had a chance to play with that yet?

Usman Haque: I have indeed! It’s still early days yet, and I know he did it partly just to test the AIR development process rather than solely solving a desperate Pachube need but I’m looking forward to future iterations!

Tish Shute: Peter Quirk felt the Pachube web page positions Pachube as a social networking site focused on data exchange, inviting anyone with an interest in sharing environmental or other data to publish data or construct interesting uses for the data.

What is your response to that?

Usman Haque: Hmm… I don’t really see Pachube as a social networking site. Yes, it perhaps enables the creation of social-networking objects and environments, but in itself and in terms of networking of people that has barely begun yet. Certainly Pachube exists quite comfortably in facilitating mashups and visualisations and other web 2.0 based social applications but I don’t see that as a driving force. I think it would be a mistake also to conceive of Pachube solely as being the storage of machine communication that then gets experienced by people; rather, it can transition quite easily to being solely useful for machine-to-machine communication.

In fact, with recent API releases (which as it happens as of this writing we haven’t announced… it’s now possible to use most of Pachube’s features without ever going to the website: i.e. your Arduino can create feeds, search feeds, edit feeds, delete feeds. Over time, as direct machine-to-machine communication becomes more prominent, it’s quite likely that the website itself becomes less and less important, while the backend becomes the focus of everything.

Tish Shute: I am interested in some of the differences between SensorBase.org’s project and Pachube. Is Sensorbase as more of a data repository (environmental data in particular)?

Usman Haque: The difference I see between Pachube and SensorBase is that while (from what I know) SensorBase is mostly about “write” operations, with later “read” operations (i.e. it’s about being a data repository), Pachube is really “read-write” (i.e. it’s about being both a data repository _and_ a quasi-realtime proxy). Pachube will be able to handle potentially millions of connections, both incoming and outgoing, and as we’ll soon start storing every data point ever recorded, so of course the data repository aspect will be crucial. However, the fact that it *also* facilitates one-to-many realtime broadcasts of that data (and facilitates conversion to a number of different formats: EEML, CSV and JSON now, more in the future) means that the two-way connectivity aspect of it is just as important.

Tish Shute: I know you mentioned something that sounding a lot like Pachube would facilitate buildings and products ability to benchmark and optimize themselves against/with each other?

Usman Haque: Further down the line, I would like to see Pachube able to help two particular processes:

1) to make it straightforward for developers and manufacturers to web-enabled their products and services; and 2) to help building and environment designers create their buildings (by providing access to realtime site data) and also help in the post-occupancy evaluation process — where buildings will be able to talk with each other, share information on energy consumption, resource management or occupancy rates and even “learn” from each others’ strategies. This type of approach has a parallel at the level of individuals (for example, networked electricity meter users who are able to compare and contrast their usage and strategies for conservation). I don’t want Pachube to become the application; rather I want to make it easier for other people and companies to create such applications. So in that sense, yes, perhaps Pachube can be considered an enabler of social networking applications…!

Neogence is on stealth mode with an immersive mobile augmented reality platform – “tools, sdk, and infrastructure plus some applications.” They are probably six months away from YouTubing anything according to CEO, Robert Rice.  But Robert rustled up this pic for me – a Google street view of Neogence R&D labs: “the patio on the lower left is where I do a lot of pacing and smoking my pipe and the porch and office upstairs is where  a lot of  meetings have been held.”

Robert Rice (@RobertRice ), CEO of Neogence, recently tweeted:

I’m changing my name to Robert Mobile Ubiquitous Geospatial Augmented Rice. I’m betting on radical changes in next 18 months.

Although Robert’s new AR platform is still under wraps, I think you will get a good idea of what direction he is going in from this interview (full text at end of  this post). Robert is the author of “MMO Evolution” and is a key developer and thought leader in persistent immersive environments, simulations, virtual worlds and massively multiplayer games as well as large scale communities and social networking.

It is OMG finally, at least, for minimally immersive but truly useful AR.

Since the launch of Android a new generation of useful augmented reality applications like Wikitude are emerging.

After the last NYC Tech Meetup, my  friend Nathan Freitas,  (@NatDefreitas),  or rather Nathan Mobile Meets Social Freitas, demoed for me a cool graffiti app  he has developed on Android.   You leave a marker for your graffiti so other people can find view/add their own – a nice primal experience like pissing on the lamp post to let your pack know where you’ve been.  Also the graffiti app taps into a long history of  NYC street culture around tagging and graffiti art.  For more cool mobile projects Nathan is working on – Vote Report and data collection for mass events, a guide to pubs and nightlife in New York City, and more, see his blog, “Nathan’s OpenIdeals. With Camera, GPS, compass, and accelerometer, and APIs on Android for temperature, light meters, (no hardware yet), Nathan says Android:

“seems to be the platform most likely to socialize the idea that sensor data could be a piece of every application.”

As Nathan is fond of saying:

The compass is a killer app enabler!

Also see OpenIntents for some interesting Android Sensor projects.

Wikitude was one of Thomas Wrobel’s two top AR milestones for 2008 (see Gamesalfreso):

Wikitude I think. Seems the first released, useful, AR software.

AR Geisha doll is also a remarkable breakout for AR – but useful, nah.

I asked Robert if he also thought Wikitude and AR Geisha doll as  significant breakthroughs:

Yes,  these are among the first attempts to get away from the novelty of simply rendering a 3D object based on a marker and making it interesting.

Remember, one of the biggest risks that AR has, is being branded as “novelty”, which means “cool for five minutes but ultimately a waste of time.” I think we have a ways to go before something is truly useful, but as 2009 progresses we should start seeing some effort here. I’d guess 2010 before something really useful comes out…at least something practical.

Now, having said that, I should say that I expect entertainment and games to take the lead (as usual), although there are a few companies really trying to leverage AR and video/graphics compositing for marketing (brochures) and location based methods (kiosks, large screen projections, etc.)

So when is it “OMG finally!” for massively multiuser augmented reality?

The picture above is from benjapo’s portfolio on istockphoto – also see the istock video here.

Alex Soojung-Kim Pang (who weighed in recently on the twitter-baby debates – see my KickBee Posterous blog) challenges design assumptions for augmented reality that take as a given the user’s desire for numerous private enhancements to their reality.

Alex points out less will probably be more so that enhancements do not impinge on shared experience.  See his write up of a talk he gave at the Royal College of Art, “and the end of my own private Shibuya.” Photo below by Stéfan, “Karaoke in Shibuya“

Part of the pleasure of these streetscapes is precisely that they’re collectively experienced, rather than individual visions: for even a brief period, we share with other postmodern, globe-hopping flaneurs and expatriates and temporary natives the light of the ABC-Mart sign and storefront.

It is collective experience of enhanced, augmented, virtual or real experiences that interests me too. This is one of the reasons I find Pachube and the EEML project of Haque Design and Research so interesting.

Extended Environments Markup Language (EEML), a protocol for sharing sensor data between remote responsive environments, both physical and virtual. It can be used to facilitate direct connections between any two environments; it can also be used to facilitate many-to-many connections as implemented by the web service Pachube, which enables people to tag and share real time sensor data from objects, devices and spaces around the world.

“Distinctions between virtual and real are as quaint and outmoded as distinctions between mind and body” (Usman Haque)

Usman Haque (founder of Pachube and Haque Design and Research) points out this is an underlying premise of his work – and augmented reality (full interview coming up soon!).

The pictures above show the Haque Design project, Remote:

‘Remote’ connects together two spaces, one in Boston the other in Second Life, and treats them as a single contiguous environment, bound together by the internet so that things that occur in one space affect things that happen in the other and vice versa – remotely controlling each other.

There was a discussion in twitter recently about how the terms like Second Life, Exit Reality, Virtual Worlds are misleading and outmoded. As Robert pointed out we need:

one word please…that sums up virtual and/or augmented reality, interactive, immersive, virtual worlds, mmorpgs, simulations, etc… also, I really don’t like the term “augmented reality” or “mixed reality”. Neither is all that great. And NO “matrix” or “metaverse” please

Robert argues strongly that there is a stultification both in virtual world technology – much of what we call virtual world technology was already, basically, where it is now in the mid 90’s. And MMOGs have devolved into gameplay design “that emphasizes the single player experience and does nothing to take advantage of the potential of the massively connected internet.”

Robert suggested I take a cruise through a new Virtual Space -  CoolIris to find some good pictures for this post (note the partnership between CoolIris and Seesmic to Streamline Video Blogging. I added the Cooliris Plugin to Firefox and typed Augmented Reality into search and soon I was cruising a highway of images and links. The Road Map image grabbed my attention (see below). It shows the continua that the Metaverse RoadMap authors thought are likely to influence the ways in which the Metaverse unfolds. It is “a map of the spectrum of technologies and applications ranging from augmentation to simulation; and the spectrum ranging from intimate (identity-focused)external (world-focused)”

Quite to my surprise, when I clicked out of CoolIris to the source for the image, I found it had been drawn from a post I wrote in May 2007, Hybridized Digital/Physical Worlds: Where Pop and Corporate Cultures Mingle. My post talks about a number of hybridization experiments that were bringing together lifelogging, sensors everywhere, simulation, virtual worlds, and augmentation.

The striking difference from 2007 to now is that we have definitely moved on from mere experimentation. And the poles of the continua intimate/extimate, augmentation/simulation as expressed in the Metaverse Roadmap are now becoming entwined (note the picture above seems to be slightly different to the one used in the road map as published here – perhaps I had an early version?)

“Augmented Reality is not just about overlaying data…” (Robert Rice)

The screenshot above is from TotalImmersions video demoing Augmented Reality with 3D Cell Phones. Also see video of their immersive games, and FutureScope kiosks here and here.

Gamesalfreso noted that Will Wright, delivered the best augmented reality quote of the year. When describing AR as the way of the future for games, Will Wright said:

“Games could increase our awareness of our immediate environment, rather than distract us from it”.

Robert points out in this interview the term Augmented Reality itself has become associated with a very limited understanding of what “enhancing your specific reality,” is really about. Robert notes:

it is inherently about who YOU are, WHERE you are, WHAT you are doing, WHAT is around you, etc.

When I talk about AR, I try to expand the definition a little bit. Usually, when you talk to someone about augmented reality, the first thing that comes to mind is overlaying 3D graphics on a video stream. I think though, that it should more properly be any media that is specific to your location and the context of what you are doing (or want to do)…augmenting or enhancing your specific reality.

In this sense, anything that at least knows who you are (your ID, mobile phone #, etc.), where you are (GPS coord or a specific place like a cafe), and gives you relevant data, information, or media = augmented reality. Sure, you can make things more interactive or immersive, but that is the minimum.

So, in this case, yes, I think there will be networked applications in the next 18 months…mostly things that are enhanced by friends lists (you are here, your friend is over there). These will be *application specific*. My team at Neogence is already going beyond this, building a platform and infrastructure for other applications to be developed on…all networked through the same backbone. Now, in this context (the science fiction AR that we all dream about), no I do not see anyone else trying to leap a generation or two ahead of the industry to build a massively multiuser shared AR space. Expect to see things like multi-user AR games, virtual pets, kiosk marketing, magic book, “gee whiz” presentations (tradeshow booths, entertainment parks, etc.), and so forth.

Goggle’s Are Not The Secret Sauce…

AR Cat left and Robert Rice right

What has come to be associated with the term Augmented Reality, in the popular imagination – an idea of 3D graphics projected over markers that has been forever waiting for the advent of “wicked next generation transparent wearable displays” – nirvana for augmented reality. While such displays may be nirvana for AR (and they could be with us in less than twenty four months), Goggles are not the “secret sauce” of AR as Robert points out.

All the glasses are, is another display device. At the end of the day, it doesn’t matter if you are looking at an LCD monitor, an IPhone, a head mounted display, or a pair of wicked next generation transparent wearable displays that magically draw directly on your retinas.

The real tricky stuff is what happens on the backend…making it all persistent, massively multiuser, intelligent, interoperable, realistic, etc. etc.

There has been quite a buzz going around about the new Vuzix Eyewear, and recently Robert talked with Vuzix and checked The Wrap 920AV eyewear out:

Vuzix is not alone in pursuing the ultimate in hardware, at least as far as wearable displays. However, I think they are much farther than the rest of the pack in vision, roadmap, and execution. They have put together a team that has a sense of urgency and ambition that will blow the industry away. After talking to them, I got the feeling that they really know what they are doing and there is a lot of mind blowing stuff in their pipeline. I’m sure they are one of the few companies that really gets it and has a clear vision of the future. Definitely my first choice to work with.

Hybrid Augmented/Virtual Reality

Cory Ondrejka posted this picture of the anybots telepresence robot and “congrats to Trevor Blackwell and the rest of the Anybots team on the launch of QA at CES.”  Cory (one of the founders and former CTO of Second Life) also made some predictions for Virtual Worlds, some optimistic and some less so, including “the increasing need to be able to diversify the Second Life product offering to begin truly rebuilding the code base.”

Robert is unabashedly irritated with the state of play in Virtual Worlds and MMOGS:

Unless both industries (Virtual Worlds and MMOGs) have some serious upheaval or radical new approaches, they will quickly be eclipsed by AR, which will eventually evolve into something hybrid..AR/VR depending on your level of access and hardware.

I’d like to see someone grab an engine like Offset, Crytek, HERO, or Unreal 3, and smack on a fat MMO server infrastructure (Eve or Bigworld)…toss in the right tools, and you would see a revolution and renaissance occur at the same time in the virtual world space. All the puzzle pieces are there, just no one is putting them together the right way.

I did just find out that Nortel’s WebAlive is powered by the Unreal 3 engine. You can try WebAlive out here.

Robert points out how rare it has become to see people really push virtual worlds technology and MMOGs into entirely new directions.  Although, of course, there are exceptions.  I managed to engage some interest from Robert in the possibilities the opensource modular architecture of OpenSim opens up, and the augmented reality experiments from Georgia Tech with Second Life (screenshot below) got praise from Robert for trying to do something new. (Georgia tech have also put out a virtual pet app for the iphone ).

But while Robert clearly has zero patience for virtual world technology which he sees stuck in the mid nineties, he notes:

the innovative and wonderful stuff about SL isn’t SL, it is what people are doing and creating on their own with terrible tools *IN* SL [Second Life].

The immersive mobile augmented reality platform Robert is building, he hopes, will generate this kind of user creativity but with 21st century tools.

So is it “OMG” finally for the Augmented Reality we have dreamed about?

According to Robert:

It really boils down to a markerless solution and a good application.

In the interview below we cover a number of topics including business models for Augmented Reality, e.g., how business models based on micro-transactions and virtual goods will translate to Augmented Reality.

Many of the challenges to becoming mainstream faced by virtual worlds  are similar to the challenges AR must overcome. Robert discusses these including the interface/gui that is a critical element for AR, solving the riddle of one world or many, patent wars in Virtual Worlds and Augmented Reality, the role of Augmented Reality in the future of sustainable computing, and what interoperability is about.

The Back Story for AR/VR…

In case you want to get up to speed on the required background reading for  Augmented Reality. This is Robert’s required reading list and Denno Coil is an absolute must see (feel free to add to this list in the comments, please).

“If you want to see the things that have inspired our vision of what we want to build, check out:

* Dream Park by Larry Niven and Steven Barnes
* Rainbows End by Vernor Vinge
* Spook Country by William Gibson
* Halting State by Charles Stross
* The Diamond Age by Neal Stephenson
* Donnerjack by Roger Zelazny and Jane Lindskold
* Otherland by Tad Williams
* Neuromancer by William Gibson
* Idoru by Wiliam Gibson
* Cryptonomicon by Neal Stephenson

and watch the whole anime of Denno Coil (subbed NOT dubbed!)”

Screenshot from Denno Coil from Concrete Badger.

Interview With Robert Rice

Tish Shute: I am glad to hear that you are working on this [an immersive mobile augmented reality platform]!

Robert Rice: We switched gears from MMO stuff about a year ago and we are finally getting some traction. It is very hard doing anything in this economy right now, but we found an opportunity to take AR to a new level beyond what you see on youtube. AR is still too “cute” and novelty. We don’t want to play around.

Tish Shute: I like Wikitude ‘cos it even manages to do something useful!

Robert Rice: Yeah, useful = traction. Now that we are getting near a prototype we are starting to get a lot of interest even though we are still technically way under the radar.

Tish Shute: r u funded?

Robert Rice: privately funded, some revenues from an early license, and ongoing discussions with several institutional investors. So, we have some funding, but nothing spectacular just yet.

Tish Shute: are you just developing an AR platform?

Robert Rice: hrm, sort of, but not just that. By platform I mean tools, sdk, and infrastructure plus some applications. The idea is to build something that facilitates everyone else making cool things and useful applications for different industries/sectors

Tish Shute: Yes that is the cool thing to do but isn’t that hard to fund!

(Robert grins) Well, that depends on the business model. We’ve got that figured out. I’d be absolutely happy if everyone and their brother were making applications on our stuff that gives us an edge on market penetration/saturation. There are plenty examples that prove the model. If you give people free and easy to use tools, they will run with it. ARtoolkit for example, has tons of people making nifty things and posting videos on youtube that has pushed them to the forefront as THE AR middleware to use right now, or heck, look at youtube free service, and they dominate video sharing.  Sure there will be a lot of “noise”, but there will also be a lot of “signal” that will rise to the top, facilitating and enabling is creating value in its own right.

Tish Shute: But how do you expect to monetize?

Robert Rice: There are a good half a dozen ways to monetize AR or an AR platform.

Tish Shute: What are your top 3?

Robert Rice: hrm, microtransactions, localized mobile advertising, and enterprise solutions (visualization)

Tish Shute: Do you think the consumer market will give the lead?

Robert Rice: I’m not sure. We are getting people from academia, intelligence, defense, border security, and some corporate types knocking on our door already, and pretty aggressively. It may be that those sectors push AR before consumer entertainment really kicks off.

But going back to a discussion we had earlier – yes working with “no markers” is a big deal.

Tish Shute: Can you talk about what you are doing there or is it still under wraps?

Robert Rice: I can say that between some university tech transfer and some of our own proprietary stuff, we are using some fairly common visual tracking technology. if you are really plugged into the AR scene, you will know there are probably half a dozen visual tracking methods out there. We just looked for the best one, licensed it for commercial use, and then started working our magic. This is a very small piece of the overall effort, but worth noting.

The downside with working with university tech is that it is usually based on research, incomplete, and not wrapped up in a nice commercial package on the upside, it can be a good start to build on.

Tish Shute: As you know I am very interested in “technology that matters” in particular tech that can help us accomplish the urgent goal of sustainable living.

Robert Rice:: oh, I’m pretty keen on sustainable living as well…after I sell off a few companies and have money of my own, I’m going to get into arcologies
❦
Robert grins

The interesting thing with the visual stuff combined with our other tech, is that we can make things multiuser, persistent, dynamic, and mobile.
The markers (fiducials) are really really limiting outside of basic applications. You can’t really plaster everyone and everything with a marker.  And they are, by nature, static (even if they are animated or whatever).

Also… our stuff works indoors and outdoors even without a GPS connection.
❦
Robert grins

Tish Shute: Now that does sound interesting!

Robert Rice: Yeah, with visual, you don’t need a compass or accelerometers either. Less hardware : )

You start with wifi triangulation or gps coord to get a “brute” location, and then you use the visual stuff for down to the meter accuracy and that by nature, gives you your orientation and positioning.

Tish Shute: Wow this is beginning to sound very interesting!

Robert Rice: Once you have that, it doesn’t matter where you go, it continues to track and continually refines areas you have been before. We’ve spent the last year figuring all this out. There are so many problems and obstacles that are going to be developing in the future for anyone trying to do what we are, but we have already discovered solutions.

oh, visual tracking = gesture based interfaces too that’s going to take some work, but its doable.  The real pain in the ass there isn’t the actual tracking, it is in the interface design.

That’s something that almost every AR company, venture, and research program is missing out on entirely. They are so focused on making cute things with markers.  They are missing the larger problems of AR Spam, interface, iconography, GUI, metaphor, interoperability, privacy, identity.

Tish Shute: So how are you dealing with all that!!

Robert Rice: We took the backwards approach of trying to think where we want things to be in ten years (and we read all the cool books…Vinge, Stephenson, Gibson, etc.) and then we spent time trying to think of what the potential problems are….like AR spam. Its bad enough when a giant penis flies by in second life, we don’t want that to happen in a global wireless AR platform.

Tish Shute: Do you have a prototype yet?

Robert Rice: hrm, 6 months away from youtubing something. Problem has been slow funding, which equals slow development. We also don’t want to show our cards too soon…too many potential competitors out there.

❦
Robert grins

Tish Shute: when you say microtransactions what is the business potential there?

Robert Rice: hrm last year I think, $1.5B was spent on virtual items. That’s games and virtual worlds. That should hit $5B in a couple of years. That’s basically people buying and selling things like WoW gold or items in SL or whatever. microtransactions, is basically the same thing, but in AR space.

Why couldn’t a 3D artist make a wicked animated 3D dragon, and then sell it to someone else? With AR, you could sit it on your shoulder. With a good scripting engine, you could train it to do stuff. Thats what I want to enable.

tools + sdk + platform = enabling people to make and create. Add in a commerce level (microtransactions) and wala.

Tish Shute: At the moment all of these virtual goods are very platform specific, is that a problem for you?

Robert Rice: Not at all. This is at a higher level. You have to switch mental models when you talk about what AR could or should be. For example, lets contrast the web and virtual worlds. For every virtual world you go to, you have to download a whole new client. Imagine if that model was applied to the web… you would need a brand new browser for every website you went to. That is just so…wrong.

It’s the same thing for AR…people are thinking about it with the same mental and business models and development philosophies as virtual worlds or web.  There are some things and aspects that work fine, but not everything.

Virtual worlds, are, by nature, necessarily different and walled gardens. The idea of 100% open and interoperable virtual worlds is a red herring…it sounds good but in practice it is a really dumb idea.

Tish Shute: I was wondering if you had a way to leverage all the 3D content already created ‘cos that would jump start things in AR wouldn’t it?

Robert Rice: Oh yeah, that’s easy. They all use the same polygons. Any virtual item in any game or virtual world is likely created with 3D studio or maya or something similar would be easy to convert and use.

Tish Shute: So people could bring their WoW weapons into your system?

Robert Rice: Not legally, but sure. Its just a 3D model with a texture.  It doesn’t matter if you use corel draw or photoshop or paintshop pro….or one screwdriver or another. Part of my team’s advantage, is that we are all experienced in MMORPG and virtual world design and development. We know the tools, the tech, and what works and what doesn’t.

Tish Shute: But some of the 3D content created in the social worlds is what has most value to people.

Robert Rice: Right, and that can be exported out easily.

Tish Shute: But back to “real” life applications. Is you platform really markerless?

Robert Rice: Yes.  marker = printed icon or glyph, also known as a fiducial

Tish Shute: But u must have some marker?

Robert Rice: hrm, more accurately, you need a point of reference.

Visual tracking has been around for more than a decade.  Lots of work for robots and other sectors.

Robert Rice: But isn’t the specificity of reference n terms of RL applications a vital key, for example, for a database of things?

Robert grin That is a different problem…tracking, registration, mapping, positioning, etc. That question has to do with mapping which is related to visual tracking, but not the same thing. We have a rather unique approach to some of this that I can’t discuss (patent pending).

Tish Shute: But for example, to create an augmented natural history of food – say I want to point at the slab of meat on my plate and know where that cow came from, what feed lot how it was treated etc

Robert Rice: That is not possible without ubiquitous nanotechnology. Shall I explain?

Tish Shute: Yes please!

Robert Rice: Ok, lets step back a minute and turn that burger back into a cow… the first problem (of this particular situation) is differentiating from one cow to another since most cows look alike, you can either attempt to discriminate visually (cow patterns) or use a much simpler option, like giving each cow a rfid chip in their bell, or hoof

Now, most people would try to figure out how to jam all sorts of info in the rfid chip, which sounds like a good idea, but isn’t, the trick would be to simply use the rfid to store a unique identifier with is then linked to a database elsewhere, or hoof.

That database should continually be updated with whatever relevant information you need so as you get close with your AR laptop, wearable displays, or embedded brain chip, you get the identifier broadcast, then you get the info downloaded to you, and it “sticks” to the cow with the generic visual tracking (object following, even simple bounding box is sufficient for a slow moving cow)

So, up to that point, you can get tons of information about that specific cow, that cow population (remember, AR is not just about overlaying data…it is inherently about who YOU are, WHERE you are, WHAT you are doing, WHAT is around you, etc.) Tie in data visualisation and some farmer tools and all sorts of other things happen. Now, lets move the timeline ahead a bit.

The butcher gets the cow and does his handiwork…because we know all the info about the cow, all of the meat can be properly labeled and marked. Ideally, with a UPC code or a unique glyph (somewhat problematic depending on how many unique glyphs you can create) so, while you are in the grocery store, you can access the relevant shopping data…age of cow, state of origin, type of feed, how many spots, how much body fat, which butcher, whatever not because of what is inside the package, but the package itself.

Getting back to your hamburger, the problem is that it is a burger…there is nothing to distinguish that burger from another one at the table…unless you stuck a rfid chip in it or splattered it with ink and a unique glyph, or maybe a special one of a kind plate.

However, a properly designed AR system could say “hey! that/s a hamburger! and I know I am at Fat Daddy’s Burger Joint in Raleigh North Carolina on Glenwood Avenue, and I know that they cook their burgers this particular way, and their meat supplier is those guys over there, and they usually get their cow meat from a farm out in Utah”

With ubiquitous nanomites or whatever, then its not that far out to consider edible nanos that are in the meat and that broad cast info so a slab of meat can tell you about itself and broadcast that to the general public.

Tish Shute: What useful scenarios can we create without the nanomites?

Robert Rice: If it wasn’t a burger or a consumable organic, the scenario changes.

Tish Shute: What is the time scale on nanomites?

Robert Rice: ehhhhhhh 20 years minimum if we are lucky. They sound good on paper, but there is a whole book worth of problems and why they are so far off…as consumer grade, all over the place, type of stuff.

Tish Shute: Did you see the Nokia Home Control center?

Robert Rice: Yes, I saw the Nokia stuff.

AR for sensors, like security systems, temperature control, etc. all become “sources of data” that a AR system can visualize. So yes, thats easily doable. You could do that in a short period of time with some half decent engineers.

The trick of what Nokia is doing is aggregating sensor data from a building/home/facility, mashing it together, and sending the mobile device alerts and data visualization conceptually rather simple, but no one has done it right or well yet.

It wouldn’t surprise me if Nokia pulled it off.

Tish Shute: yes and if they do and someone does an AR interface to it that would be an inflection point for AR?

Robert Rice: In a roundabout way, yes. You could get data directly from your house, or get it through your mobile device and in either case, use the AR for visualization and control.

The interface/gui is a critical element for AR. That is one of the areas where it, as an industry, risks doing a bad job and turning into just a fad or another novelty like VR.  Virtual worlds have been struggling with that for a while, but MMORPGs have had the effect of extending their life cycle

Tish Shute: Yes VWs have not solved the interface problem.

Robert Rice: The interface is one of their problems yes. Most virtual worlds are stuck in 1996/98

Tish Shute: If AR  is inherently about who YOU are, WHERE you are, WHAT you are doing, WHAT is around you, etc. seems that it is the ideal interface for home control?

Robert Rice: Well for home control, you must know:

1) Who am I? Am I authorized to know this information? Am I a guest?

2) Where am I? Is this my house? or someone elses?

3) What am I doing? Do I want to make all the doors lock? Turn on or off lights? Open the garage door? Trigger the security alarm?

So the same questions apply

I’d say that all virtual worlds are stuck in the mid 90s. They are at least a decade behind the game worlds…in technology, design, implementation, architecture, etc. etc. In my opinion, things like Second Life are shameful in how they are presented as state of the art, innovative, ground breaking, new, wonderful, and world changing.

But thats another topic of conversation : )

Tish Shute: Well for me the contribution of VWs is the presence enabled real time interaction with application (as 3D info machine) and context with other people.

Robert Rice: Oh,there is no doubt that they are greatly useful and have a phenomenal amount of potential.

They *could* be all those things I just said that SL isn’t…the problem is that they are either just existing, or they are meandering around without any real focus or direction. They aren’t evolving.

Even MMORPGs are losing their way and beginning to stagnate terribly

Tish Shute: yes I agree

Robert Rice: But, AR has the potential to change a lot of things.

Im sure you have seen the yellowbook commercials? The technologies you are seeing here are doable in hrm, a year or less maybe. The tricky part is the interactivity and AI…that is, the content. Everything else isn’t a problem. The avatar there could be photorealistic or stylized like a WoW character.

You could do that to some degree with markers for registration but dynamically changing the content linked to those markers is a little weird

(by the way, for the record, I like markers just fine, I just don’t think they are useful for real-world mobile applications)

I also think that the guys that want to dust the planet with miniature rfid chips are on crack and are going about it the wrong way

Tish Shute: A high level of interactivity is hard though. Isn’t it? Even in VWs it is very limited.

Robert Rice: it depends if you can track what the user is doing, and interpret that properly. Interactive is also a very lose term.

Clicking a button and making a light blink could be considered interactive.

Tish Shute: In VWs a high level of interactivity would  be to wield a virtual hammer and have a real nail go in! is physics part of the problem?

Robert Rice: physics aren’t difficult, plenty of middleware out there for it. The problem with that isnt so much the physics as much as it is the scale and purpose

Tish Shute: well for robotics?

Robert Rice: that gets into a conversation about meshes, textures, and volumetric collision detection and stuff

Tish Shute: virtual robotics?

Robert Rice: You mean teleremote/telepresence of real robots?

Tish Shute: yes!

Robert Rice: ah, for that, you need some tactile feedback and some other stuff – doable, but insanely difficult. That’s why you don’t see a whole lot of remote controlled surgery robots all over the place.

They do exist…

Tish Shute: Will AR contribute to sustainable living by freeing us from some of our energy hogging devices?

Robert Rice: AR will ultimately encourage energy saving and recycling. where did I leave a light on at? where is the nearest trash can? what is the UV index outside today?

Yes, computers are energy hogs, but as we start seeing larger SSD drives, more efficient CPUs (even if the number of cores increases in multiples), and so on, the power will go down.

Also, think about this…wearable displays potentially use less energy than LCD monitors on your desk.

Tish Shute: Yes I should pick the brains of my intel chums on energy saving!

Robert Rice: Getting rid of the monitor and switching to solid state drives will save an assload of power. Yes, I said assload.

Tell your intel chums to quit screwing around with single core mobile CPUs. We need multiple cores, that are smaller, faster, and use less power.

Tish Shute: Is AR is the sustainable future of VW and MMOGs?

Robert Rice: The fun stuff will happen when they are both integrated in some fashion.

Tish Shute: So perhaps this is why the Georgia guys are thinking in trying to combine AR and SL (see video here).

Robert Rice: That first video was pretty damn cool. It just pains me that they are using SL for it. And omg, all those markers on the table.

Although, I could care less about seeing my SL avatar on my coffee table. I would rather see an avatar representing ME in the real world, moving around in a virtual world that is a “to scale” replica of the real world. That is MUCH more interesting and innovative.

But even if I don’t like where they are going, or that they are using SL, the important thing is that they are doing something and forging ahead. I have a massive amount of respect for anyone, private, government, or academic, that is doing that.

And yes, the door (or window, or looking glass) has to work both ways for maximum potential, at least, that’s what Id like to see. They don’t *have* to, but it would be rather cool.

And going back to sustainability, AR has the potential to make monitors generally obsolete, laptops too. That’s a lot of power hungry devices with all sorts of metals and batteries inside.

But, even if the tech was absolutely crazy awesome right this minute, it would take a little while for consumer adoption.

Tish Shute: But AR unleashes the mobile device?

Robert Rice: Yes, AR is going to be built on powerful mobile devices for the near future, eventually embedded comps in clothing and whatnot. But that is a ways off

Entertainment is going to be the first huge driver.

Tish Shute: So people will get used to having a pet virtual dragon on their shoulder first?

Robert Rice: Yes, virtual dragon is way cool, easy tech for games, and can eventually be leveraged into a smart agent which becomes a practical application…agent based contextual search, etc. Yes, entertainment will also drive people to get used to the tech

Tish Shute: Oh thanks for turning me on to gamesalfresco!

Robert Rice: Ive noticed that the good stuff usually gets linked to there. They don’t list my blog, but that’s what I get for staying under the radar and not posting often. But anyway, gamesalfresco is the first place I send people that need a crash course in AR. Great site, great owner.

Tish Shute: So are you in agreement with Thomas Wrobel’s positioning of  Wikitude and AR Geisha doll as being significant milestones for AR?

Robert Rice: Yes,  these are among the first attempts to get away from the novelty of simply rendering a 3D object based on a marker and making it interesting.

Remember, one of the biggest risks that AR has, is being branded as “novelty”, which means “cool for five minutes but ultimately a waste of time.” I think we have a ways to go before something is truly useful, but as 2009 progresses we should start seeing some effort here. I’d guess 2010 before something really useful comes out…at least something practical.

Now, having said that, I should say that I expect entertainment and games to take the lead (as usual), although there are a few companies really trying to leverage AR and video/graphics compositing for marketing (brochures) and location based methods (kiosks, large screen projections, etc.)

Tish Shute: Many people would say SnowCrash (metaverse) is now and Halting State (AR) is ten years from now. But you are seeing a development timeline for some popular AR apps in the next 18 months?

Robert Rice: Anyone that says SnowCrash is -now- is living in a box. Virtual Worlds, Virtual Reality, and immersive tech in general stopped innovating in the mid 90s. I’m continually flabbergasted at the number of people that think that things like Second Life are state-of-the-art or innovative. You might as well try to market a walkman as cutting edge, even though we have IPods out there.

Id like to see someone grab an engine like offset, crytek, hero, or unreal 3, and smack on a fat mmo server infrastructure (eve or big world)…toss in the right tools, and you would see a revolution and renaissance occur at the same time in the virtual world space. All the puzzle pieces are there, just no one is putting them together the right way.

Tish Shute: Why doesn’t anyone do that?

Robert Rice: Its not cheap, people will only fund a copy of something that exists already, people fear change and innovation, etc, The list goes on. The right money goes to the wrong people all the time.

Alternatively stated, there is a lot of “right idea, wrong implementation”

MMORPGs carried the torch and have made huge strides on the technology front, but have devolved in design. More often than not the gameplay emphasizes the single player experience and does nothing to take advantage of the potential of the massively connected internet.

Unless both industries have some serious upheaval or radical new approaches, they will quickly be eclipsed by AR, which will eventually evolve into something hybrid..AR/VR depending on your level of access and hardware.

But yes, I’d say that the next 18 months are going to be very interesting with a lot of money being thrown around, new ventures, and plenty of content/applications. I expect most of this will be centered on single user AR experienced through a mobile device with a screen (iphone, android, etc.). I expect that there will be a significant boost after Vuzix releases some of their wearable *transparent* displays, putting Microvision back into the “has potential but is too quiet” position.

Tish Shute: AR conjurs an image in many people’s minds of dreadful head gear!

Robert Rice: Yes, it is either transparent wearable displays (in eyeglass formfactor) or nothing. HMDs with miniature LCD or OLED displays are good for streaming video, but for the mobile ubiquitous AR we all dream about, it has to be something that looks and feels like a pair of Oakleys.

I should also mention that several different types and modes of AR are going to find themselves being defined and refined over the next two years as we continue to blaze new trails, establish a lexicon (we keep borrowing terms from games, VR, virtual worlds, mmorpgs), and really work out the how as well as the why.

Even though the idea of AR has been around for a long time, the technology is just beginning to emerge, and very few people are even looking far enough ahead to figure out the problems and solutions that the tech creates. Really, who is thinking about how to deal with AR spam right now?

Tish Shute: Do you see any successful networked AR applications emerging in the next 18 months?

Robert Rice: Yes and no.

When I talk about AR, I try to expand the definition a little bit. Usually, when you talk to someone about augmented reality, the first thing that comes to mind is overlaying 3D graphics on a video stream. I think though, that it should more properly be any media that is specific to your location and the context of what you are doing (or want to do)…augmenting or enhancing your specific reality.

In this sense, anything that at least knows who you are (your ID, mobile phone #, etc.), where you are (GPS coord or a specific place like a cafe), and gives you relevant data, information, or media = augmented reality. Sure, you can make things more interactive or immersive, but that is the minimum.

So, in this case, yes, I think there will be networked applications in the next 18 months…mostly things that are enhanced by friends lists (you are here, your friend is over there). These will be *application specific*. My team at Neogence is already going beyond this, building a platform and infrastructure for other applications to be developed on…all networked through the same backbone. Now, in this context (the science fiction AR that we all dream about), no I do not see anyone else trying to leap a generation or two ahead of the industry to build a massively multiuser shared AR space. Expect to see things like multi-user AR games, virtual pets, kiosk marketing, magic book, “gee whiz” presentations (tradeshow booths, entertainment parks, etc.), and so forth.

The big thing I’m worried about is AR becoming the next silicon valley trend…once they realize the potential, an enormous amount of capital will flow to a bunch of startups with half baked ideas, weak business models, ten year old tech, and a lot of overhyped marketing. That is the very thing that will kill this technology as something that has true power and potential to literally change the way we interact with each other, our surroundings, information, and media.

Tish Shute: Do you think AR has value for a project like Pachube that helps us connect dtat from lots of different environments and sensor actuator data?

Robert Rice: I think that AR has value as an interface to this data (essentially data visualization based on information streaming from a sensor or source that is interpreted in some dynamic graphical manner that has meaning). This is one of the “big areas” where ubiquitous augmented reality and wearable computing will really shine. I’ll definitely be keeping an eye on Pachube .

Tish Shute: I can’t help it! I am really interested to hear more about the Vuzix glasses?

Robert Rice: Yeah, everyone is getting hung up on the glasses as the end-all be all and having markers everywhere too.

All the glasses are, is another display device. At the end of the day, it doesnt matter if you are looking at a lcd monitor, a iphone, a head mounted display, or a pair of wicked next generation transparent wearable displays that magically draw directly on your retinas.

The real tricky stuff is what happens on the backend…making it all persistent, massively multiuser, intelligent, interoperable, realistic, etc. etc.

I think that we are within 24 months of the magic wearables (these new ones by vuzix are probably the real first generation attempt at doing it right). They wont be perfect, but I expect they will be functional…and once we have functional, we can start doing the good stuff.

Tish Shute: You mentioned you disappointement with VWs and MMORPGs earlier.  Could you tell me more about that?

Robert Rice: Yeah, there was an evolutionary divergence between virtual worlds and mmorpgs a while back. One stagnated almost completely, and the other leapt ahead in one sense and devolved horribly in the other sense. Neither is where the state of the art should be.  That is a whole other conversation, and probably a second book.

Tish Shute: So making AR persistent, massively multiuser, intelligent, interoperable, realistic, etc. etc. that is where your efforts are going?

Robert Rice: Yes. I fully expect that the hardware is almost ready for it. You can cobble together some amazing things in the lab right now, and I think commercial viability is imminent. The real value (as far as I’m concerned) is in making it mobile, wireless, persistent, and massively multiuser. You could argue that augmented reality will take over where virtual reality failed and become internet 3, internet one being the internet, internet two being the web…

mmorpgs are nothing more than single player games in a multiuser environment these days. I’m more than a bit bitter about it. All the right money went to the wrong people, and the best games we have are barely shadows of what we could have had by now.

Tish Shute: Are there any open source AR platform dev projects?

Robert Rice: open source? hrm, Im sure there are multiple ones out there

if not entirely open source, there are plenty of things to experiment with that are generally free if you aren’t trying to sell something, DART and ARTOOLKIT come to mind as very accessible applications.

Marker based AR is very important right now…it is easy, low tech, understandable, highly customizable, and most importantly, accessible to the average joe. Ultimately though, we need a method of pure tracking…no markers glued to everything on the planet, no “billions of RFIDs” embedded in every square inch of every object on the planet, etc.

Tish Shute: What do you mean by interoperability in AR? And what do you think about the development of standards?

Robert Rice: Ooh, good question.

Ok, so the internet is basically computers communicating with computers, and the web is mostly pages linking to other pages (I’m greatly oversimplifying here). Hold this thought for a minute.

Switch over to MMORPGs. If you want to play in one (or a virtual world), you need to download a client that is specific to that world. One client does not work with another world. There are plenty of efforts to change this, but they are all barking up the wrong tree. The specific uniqueness of each world defeats the need and purpose of true interoperability, unless you completely reinvent the whole thing with a common backbone, features, functionality, etc. The very nature of virtual worlds and mmorpgs rebels against this.You absolutely do not want an avatar from second life running around in world of warcraft (for reasons that should be obvious).

On the other hand, with the web, you can use just about any client (browser) to access nearly any website (some requiring plugins or whatever).

The thing with augmented reality, is how do we go about making this? I’ve seen a few people thinking about this from the wrong perspective. There was a question at the last techcrunch to the Sekai Camera guys (a conceptual AR application for the iphone) where someone on the panel wanted to know how website owners would convert their content for augmented reality. BZZZZZT! That is a fundamental misunderstanding of what AR is, or could be, and it falls into the same trap I see a lot of people doing…and that is looking at AR through the web 2.0 lens or the virtual world lens. It is absolutely fundamentally different at the core…sure there are similarities: it has social networking/media applications and properties, and it has 3D graphics, but it stops there.

Ubiquitous augmented reality will be dramatically different depending on which standards, approaches, and philosophies get the most traction first. Will you walk down the street with your AR glasses and have a pop up every 30 feet asking you if you want to access the AR content on another server? Will you then have to register, subscribe, or whatever?

Or will all AR content be mediated by one sole master control server deep in the bowels of google? What about some other option? Will you need different sets of glasses to access different features and content from multiple sources?

At the end of the day, it should not matter what brand of glasses you are wearing, you should never have to deal with AR server popups to join/subscribe, and so forth.

Interoperability, in the context of what I was saying earlier, is the sense of how to build the infrastructure so all of this is seamless to the end user, but still maintaining the features/functionality necessary for all of what augmented reality promises us…I dont want to see everything in AR space, I want to be able to tune in or filter out some things, and I want to customize the snot out of what I see (perhaps changing metaphors or “holoscapes”), and so on. It all has to work together and simplify the end-user experience or it won’t get anywhere

Tish Shute: So what caused the stagnation of new development and devolution of MMOGs in you opinion?

Robert Rice: yes, look at all the hope and hype for the mmorpgs released in the last 12 months really, what is different or better? Now, what is worse?

I bet any decent mmorpg gamer could give you a list of 2 or 3 things for the first question and 20-30 things for the second.

And, VWs seem to be stuck in a feedback loop

Tish Shute: feedback loop?

Robert Rice: Imagine nailing one of your feet to the ground and then trying to run ’round and ’round and ’round.

Tish Shute: Why do you think this happened to VWs?

Robert Rice: Men in suits and flashy watches.

actually, hang on…..

I saw a video clip the other day from a conference about using various virtual and game technologies for simulations and other real world applications several people were talking about “avatar technology” and how theirs was better than their competitions and what not.

Now, can you tell me what “avatar technology” is? Avatar technology is a red herring. Avatar technology is the same thing as calling a toaster a new “fire technology.”

Robert Rice: The problem is that a lot of people that don’t have a clue about what they are doing are selling the tech to other people that have no clue what they are buying, but they feel like the should for some unknown reason.

That is happening all over the government, academic, and industrial sectors now with a few companies selling virtual worlds (again, mid 90-s tech) as the ultimate solution to all problems.

Anyway, getting back to your question

Once virtual reality started getting some buzz, some people got greedy and jumped into the avatar/virtual world thing and tried making it commercial too soon half of the 3D chat worlds were being jammed into platforms for virtual shopping malls.

Most of the money funding tech R&D started funneling towards VRML, and doing 3D in web pages, etc.

Tish Shute: yes horrible idea trying make web pages 3D IMHO

Robert Rice: The money people got involved too soon, and then the greedy people jumped in and tried patenting everything possible. Take a look at the worlds.com patent for 3D worlds.

They filed it back in 2000 or so and it was awarded in 07 (it shouldnt have been in my opinion) now they are suing everyone they can.

Tish Shute: Will there be patent wars in AR?

Robert Rice: Yes, the AR patent wars will be legendary once people start waking up to the real potential here.

The only solution is for everyone to band together and pre-emptively patent or make public domain every possible patentable concept, technology, or implementation for AR otherwise, you haven’t seen anything yet.

Tish Shute: Is the AR community organized enough to do that yet?

Robert Rice: That depends on how my company fares in the next six months.

Tish Shute: Will you patent or make your tech public domain?

Robert Rice: I plan on patenting the snot out of everything we can possibly think of, and then giving away our content creation tools and SDK stuff for free. The whole goal of what we are trying to build is to empower the end user and facilitate the creation of a wonderful world of augmented reality.

There are some things we will make public domain for sure, on top of that

Tish Shute: So back to my question on networked real time experience. Will we have networked Real time AR experiences in the next 18 months

Robert Rice: It is possible, yes. Other than what we are doing, I am not aware of anyone else taking the same approach we are, but the potential for an “under the radar venture” (much like my own company) is definitely there.

Tish Shute: Will you use cloud computing?

Robert Rice: I think that’s overrated and probably another attempt at the whole “thin client” model that some companies have been pushing for the last 20 years.

It sounds good on paper, but ultimately takes power and control away from the end user.

Tish Shute: cloud computing?

Robert Rice: Yes. You know, we aren’t playing around, We are totally building “THE AR” that everyone keeps dreaming about. None of this cute stuff you see on youtube. Actually, if you want to see the things that have inspired our vision of what we want to build, check out:

* Dream Park by Larry Niven and Steven Barnes
* Rainbows End by Vernor Vinge
* Spook Country by William Gibson
* Halting State by Charles Stross
* The Diamond Age by Neal Stephenson
* Donnerjack by Roger Zelazny and Jane Lindskold
* Otherland by Tad Williams
* Neuromancer by William Gibson
* Idoru by Wiliam Gibson
* Cryptonomicon by Neal Stephenson

and watch the whole anime of Denno Coil (subbed NOT dubbed!).

Tish Shute: So scaling the real time experience won’t be a problem in your project hehe

Cos no sharding allowed in AR right

And if you have lots of API calls?

Robert Rice:: haha, sharding is one of the dumbest things to happen to the VW/MMO industry

It is a solution to a technical problem that was relevant 15 years ago.

Tish Shute: so why did it stick (i know men in suits)

Robert Rice: it stuck because “thats what the other guys did” and the mmo designers are too lazy to reconcile gameplay for PvP and RP gamers

However, there is a curious problem between dealing with “one world” and “anyone can start their own custom AR server”

Tish Shute: Now that is a very interesting problem the one world and own AR server

Robert Rice: It took me a few weeks of not sleeping to figure that one out. It gets back to the interoperability issue

Tish Shute: What did you come up with?

Robert Rice: a solution. Thats all I can say for now on that.

Tish Shute: eeextra seeekrit!

Well I will definitely have to bug you on that.

The problem has produced some creativity in OpenSim with people coming up with hybrids of p2p and oneworld

Robert Rice: As far as virtual worlds are concerned, they need to look at the problem from a different perspective. They are trying to make all virtual worlds interoperable intead of creating a new model for interoperable worlds that new ones will be created to adhere to.

Tish Shute: well some people are. I would say most OpenSim developers see their modular approach doing this.  And you choose to interoperate based on what modules you have activated and then social agreements…

Robert Rice: hrm, thats a start, but that only works on a functional and social level – doesn’t account for content (story, mythos, game rules), unique data (my +3 sword), or the concepts of commerce, inherent value, and intellectual property

Enabling my WoW avatar to run around in SL and vice versa creates more problems than it solves.

Its like two alien races working hard to make sure that their two spaceships can dock but no one is paying any attention to the fact that race A breathes nitrogen and race B breathes sulpher.

Its technically possible, but they are missing the boat on the content side of the problem.

Tish Shute: Yes but don’t you think when a modular open source tech for virtual worlds  becomes pervasive, what will happen is that those interested in a similar genre will increasingly use the module in ways that allows their content to interoperate if they want it too

Robert Rice: everyone has to use the same backend tech, and the front end clients need to adhere to the same standards. Bu I have to admit, I haven’t been paying much attention to the vw space in the last 9 months or so.

Oh I have to run now.  But download and install cooliris. I promise you will be blown away and will start using it to search for images and videos

Its frigging awesome.

Tish Shute: Will do!  Thanks so much great talking to you. I can’t wait for your launch.

Google Street View Hacking

This Google Street View Hack (via @timoreilly) will get my nomination for a Hacking the World Award this year, if there is such an award.

A parade (the screenshot opening this post), a marathon, a mad-scientists laboratory, a sword fight, and more (see The Infonaut Blog) were staged all along the route of the Google Street View truck by artists Robin Hewlett and Ben Kinsley working in conjunction with the local community and Google Street View.

The Google Street View Hack suggests at a myriad of possibilities for anyone with their eye on the prize for a great world hack for 2009.  In my mind’s eye, I imagine the Google Street View truck’s trek across the planet triggering local environmental street action carnivals wherever it goes.

Local energy conservationists, “passive house” architects, retrofitters, could turn the arrival of  Google Street View into an occasion to create projects for a sustainable future – a traveling StreetCamp (see my post on HomeCamp ’08 here).  As Google Street View intends, surely, to go everywhere,  this would be a global hack for sustainable living that crossed the bounds of the physical and the virtual.  And the vast public record of Google Street View would became a generative engine and global resource for sustainable living.

Working together on the noble aim of sustainable living

- this is my (and many other people’s) big theme for 2009.

A Hacking the World award should also go to  Pachube – “patching the planet” – for demonstrating that instrumenting the world is not merely a Sci Fi  fantasy anymore.  By facilitating “interaction between remote environments, both physical and virtual,”  Pachube demonstrates (see diagram here) how we have only just begun to dip our toes into the many new opportunities we have to work together to save energy, rethink our culture of consumption, and to reboot our failing economy under a new sustainable operating system.

Energy awareness unlike the glut of information we have in entertainment and games suffers from a dearth of information. We really have very little idea about what we are consuming and the waste we are producing.  So more Hacking the World Awards should go to projects like AMEE – creating the world’s energy meter, and Wattzon – your personal energy meter, for giving us new ways to understand and work with energy data.

Many people and organizations, given the information, will change their behaviours. But the cultural changes necessary for sustainable living are deep and old habits die hard (see this disturbing report on the recent return to SUV buying in November as soon as gas prices fell!).

A  Small Community of Volunteers Can Bring Change on a Global Scale

Picture above by Benjamin Ellis, “HomeCamp – The Throng,” from his Flickr stream.

One of my favorite “instrumenting the world” projects to date and another top contender for a Hacking the World Award is HomeCamp ‘08 (see my previous post).  HomeCamp brings together a community of creators and enthusiasts of  “smart stuff,” creating a wikiculture for the noble cause of sustainable living.

The key to whether “instrumenting the world” empowers people and changes our lives for the better will be the capacity our systems of instrumentation have for what Jonathan Zittrain in “The Future of the Internet: And How To Stop It:,” defines as generativity, i.e.:  “the system’s capacity to produce unanticipated change through unfiltered contributions from broad and varied audiences” ( Zittrain, 2008).

Generativity is the “secret sauce” that makes the difference between, for example, Wikipedia and its all but forgotten predecessor – the “written by experts” Nupedia.

Jonathan Zittrain writes:

Wikipedia stands for more than the ability of people to craft their own knowledge and culture.  It stands for the idea that people of diverse backgrounds can work together on a common project with, whatever its other weaknesses, a noble aim - bringing such knowledge to the world. (p.147)

At Web 2.0 Summit, Jonathan Hochman (Known as Jehochman on Wikipedia), shared with me his insider perspective as a Wikipedia administrator. The full interview with Jonathan is later in this post.

Jonathan comments on the role of wikiculture in sustainable living:

“Sustainable Living requires everything to become more efficient. Incentives need to line up with conservation priorities. This requires a radical change to the way we govern ourselves. Command economies, whether commanded by politicians or capital, lead to huge inefficiencies.”

And surely, if we have learned anything in 2008, we have learned that very bad things happen when the complex systems of modern life are left in the hands of a few people motivated solely by the urge to make profit.

Hacking Design and Planning Processes for Real Estate and Transportation with Virtual Worlds

This great machinima by Azwaldo Vilotta shows the progress so far on the Wikitecture 4.0 project, ‘Re-Inventing the Virtual Classroom’ for the University of Alabama.

Though still a niche market Virtual Worlds are growing at a steady pace.  As I mentioned in my previous post, energy hungry avatars themselves will be a target for optimization in 2009.  But as my personal power usage breakdown from Wattzon shows, cutting down the amount of flying I do in 2009 would be far more effective in reducing my carbon footprint than deciding not to log into Virtual Worlds!

Note: Read Write Web’s recent post, “Report Enterprise Virtual Worlds More Effective Than Web Conferencing.  Also check out Web.Alive, and Immersive WorkSpaces and Dusan Writer’s post on “ThinkBalm,The Immersive Internet and Collaborative culture,”

My friend Melanie Swan points out in her Top Ten Computing Trends for 2009, that Virtual Worlds not only have the power of the 3 Cs (communication, collaboration and commerce) but they are fast expanding into rapid prototyping, simulation and data visualization.

My Hacking the World, 2008, Awards for Virtual World innovation would go to three potentially world changing projects for sustainable living:

1) Studio Wikitecture, (see “Reinventing the Virtual Classroom” for The University of Alabama).

2) Oliver Goh’s work on “The Path to Sustainable Real Estate.”

3) Encitra, a company recently co-founded by Crista Lopes and Christer Lindstrom focused on improving urban planning processes, starting with transportation, using virtual worlds (see my previous post here for more).

The latter two projects are being developed in OpenSim – the open source project that should also get a Hacking The World Award for creating an open modular architecture for virtual worlds that is unleashing all these new possibilites for integrating physical and virtual worlds.

The 2008 code contributions to OpenSim of special note re world hacking are Crista Lopes’ OpenSim Hypergrid – see Justin CC’s blog for full details on “What is the hypergrid?,” and David Levine’s work (IBM), in collaboration with Linden Lab (see Architecture Working Group), on interoperability (see my earlier post here).

Both these projects expand the frontiers of interoperability for virtual worlds although they “slice the problem from different ends,” as David Levine put it.  The emphasis in the LL/IBM approach is on security so assets are not moving yet.  In Crista’s solution you can have assets but the security issues are not addressed yet. But this work is vital to expanding the usefulness of virtual worlds and both projects should get Hacking the World Awards IMHO.

I asked Jon Brouchoud (full interview upcoming) what he thought were Studio Wikitecture’s most important successes to date:

“I think the greatest success has been in proving, on some level, that everyone has important knowledge that can inform and improve the design of a building, not just architects.  If we can continue building on that success, I hope we can eventually start to hack the traditional design process, and find ways to harness the wealth of knowledge held by the general public, instead of ignoring or avoiding it, as is most often the case.”

Harnessing the “Smart Stuff” to the Noble Cause of Sustainable Living

Robert Scoble’s, The Interview of the Year: Tim O’Reilly, is not to be missed. Tim O’Reilly discusses the key trends for 2009 that are bubbling up at O’Reilly Media.  And, Yes, Tim O’Reilly, as the guru of Hacking the World, gets the “Distinguished Thinker – Hacking The World Award of 2008!”

Tim O’Reilly’s trend list includes:

1) big data- vast peer produced data bases in the cloud accessible by mobile devices

2) “smart stuff” – sensors and robotics and hacking on stuff for fun and not for profit

3) Green Tech

4) Advances in Biological/Life Sciences.

And, in Robert Scoble’s interview, there is a nice titbit of history re his attendance of early Foo Camps.  Foo Camp is the wiki of O’Reilly conferences and a lineage holder to my favorite Hacking the World event of 2008, HomeCamp ‘08.

But what will be the “secret sauce” for these big ideas  – the generative engines that harness to the noble cause of sustainable living these vast peer produced data bases and all the creative “smart stuff” hackers across the globe are creating?  What will motivate the mass adoption of Green Tech and sustainable living?

What can Wikipedia teach us about how generative systems and bottom up approaches can change the world?

Jimmy Wales (interview coming soon!)  writes in his recent personal appeal for support for Wikipedia.

At its core, Wikipedia is driven by a global community of more than 150,000 volunteers – all dedicated to sharing knowledge freely. Over almost eight years, these volunteers have contributed more than 11 million articles in 265 languages. More than 275 million people come to our website every month to access information, free of charge and free of advertising.

To answer questions on a how to create a successful wikiculture for sustainable living, an insider’s view of Wikipedia may be a good place to start.

Interview With Jonathan Hochman on Wikipedia.

The picture on the left is from the Wikipedia article, Gamma-ray Burst, that Jonathan Hochman is currently working on.  It is a drawing of a massive star collapsing to form a black hole. Energy released as jets along the axis of rotation forms a gamma-ray burst. Credit: Nicolle Rager Fuller/NSF

The picture on the right, Jonathan at Web 2.0 Summit, is taken by me. Jonathan was part of the, Defending Web 2.0 from Virtual Blight, panel.

Known as Jehochman on Wikipedia, he serves as an administrator and as a leader in addressing online harassment, disruption and sock puppetry. He is also the founder of Hochman Consultants, an Internet marketing consultancy, and the director of Search Engine Marketing New England, a regional conference series.

Tish: Second Life and Wikipedia are the two great experiments in collaborative co-creation what do they have to teach us about the future of the internet?

Jonathan: Yes, Wikipedia and Second Life are key social spaces.  Some people have been seeing Second Life as the beginning of Web 3.0 – a wrap around environment where you can almost experience another life. Wikipedia is sort of another example of this.

All the problems that exist in the real world are mirrored right into that little universe.  For example, the Armenians and the Turks are at each others throats and the Japanese and the Koreans are going at it, the Palestinians and the Israelis, and the “Troubles”  … all the conflicts are imported into Wikipedia.  People are fighting over the content of these articles. They want to have it their way because these are first ranked in Google and they have a big impact in public opinion.

There was a huge fight on the waterboarding article a while back. Some guys from Little Green Footballs – they are a very conservative reactionary type of media. They are trying to change the article to say that water boarding might not be torture – change it to say it is probably not so bad.  Crazy stuff. They were trying to water it down.  And it is very clear, from every source out there, that waterboarding is torture.  We did a study and there are 115 sources that say waterboarding is torture. You simulate drowning – you simulate killing someone – that is a violation of the Geneva Convention and everything else. People were fighting, fighting, fighting!

One of the things I did was to try and clear people out who were being disruptive.  We actually had to go to arbitration over that article. It is like the supreme court of Wikipedia. There is a panel of 15 arbitrators.  They hear the case. There is evidence, arguments and decisions. It is really like a simulated law suit. You get all the experience of a simulated law suit with the real threat that you could be banned. If they don’t like what you are doing they can actually ban you or restrict you from topics.

So it is really fascinating how this social space Wikipedia becomes a very real platform though it is in a virtual world for real world disputes.  Most disputes are over the definition of things.  If you have a you suit most disputes are about how things are defined. And Wikipedia has become the defacto definition of things in the real world.  People want to know what are “The Troubles.”  If you go to Wikipedia you find out  The Troubles are a dispute over Northern Ireland.  What the article says has a profound impact on public opinion.

Tish: So who is on the court of Wikipedia?

Jonathan: They are volunteers. these people work two or three hours a day to run this court.  There are all kinds of projects.  There is a WikiProject Spam which has people who can write computer programs to statistically analyze Wikipedia projects – not only Wikipedia. But all of them are looking at the links and reporting them and banning those people who are abusing or gaming the system.

Tish: You were on the Stopping Virtual Blight Panel at Web 2.0 Summit – what are the most important things to think about on this topic?

Jonathan: Yes we were talking about how to defend the web against virtual blight. The thing I find interesting about Wikipedia is that because it is the eighth largest web site and possibly the second largest web site comprised of user generated content after YouTube. The problems that exist in Wikipedia are larger and more detailed than any other site.  For whatever problem someone has for their social media site or their Web 2.0 site these problems already exist in Wikipedia and the solutions are there and they are transparent. You can actually see the history of what’s been done.

If there is, for example, a problem on Digg – some problem with sock puppetry or vote stacking – it happens, it goes away.  You don’t get full disclosure.  With Wikipedia you can actually go in and look at a dispute and watch it unfold.  You can watch the arbitration cases that are filed, the arguments, the decisions, the logic, the rationale.  You can see the successes and the failures and the different things people have tried to control blight. For example, we tried to resolve this dispute one way but it was a disaster, so we have tried something else and that worked.

Wikipedia is a large laboratory for social media. Wikipedia and the large universe around it Wiki and WikiMedia projects that individuals, enterprises and put together like Commons.  Wikimedia Commons is a repository of publicly licensed images that anyone can take and reuse. They have sound and they have video, and all of this stuff is being stitched together now.

So if you go to the article on Obama  you can probably now hear his acceptance speech because that is public domain – its been stitched into the article.  If you go to the article on Richard Nixon – his resignation speech – you may even hear his conversation with the astronauts when they landed on the moon.  So this becomes a giant repository of all our culture and knowledge.  When I design a website, a lot of times I go to Commons to find images I use for free.  I don’t want to pay for an image I can get for free. 

Tish: And the Commons images get contextualized in Wikipedia too.

Jonathan: Some of these articles are fascinatingly detailed. If you want a quick summary of the Dr. Strangelove, the article is fantastic.  It is enjoyable, a pleasure to read.  I was reading about S.A. Andree’s North Pole balloon expedition of 1897. Some guys from Sweden decided to fly a balloon over the North pole.  They managed to get aloft then they flew over the icepack for 24 hrs then they crashed.

They unloaded their stuff and hiked back across the ice toward the island they had launched from. They ended up being on the ice pack for three months before they finally holed up in an ice cave and starved to death.  There weren’t found until thirty years later!  There was a camera with these guys and the frozen pictures taken 30 yrs earlier.  They developed the film and those pictures are now on Wikipedia.  It is just a fascinating thing!

Tish: Do you see real time collaboration beginning to play more of a role in Wikipedia – whether virtual worlds or just voice/IM — how could real time collaboration change the wikipedia editing process?

Jonathan:  The Presidential candidate articles were being edited very rapidly yesterday. There are certain real time problems.  Some of the more interesting problems are when you get two administrators who “get into it.” One administrator says I am blocking this user and the other one says I am unblocking him, and the other one “NO I am blocking him!” And so on…… And everyone says, “Stop fighting. You are not allowed to do that!” And they both get their powers stripped. People do get very heated over the silliest things. Wikipedia does have some mailing lists attached and there are some IRC channels. So there are some real time elements.

Tish: What is the role of avatars in Wikipedia?

Jonathan: In Wikipedia you have a user page and many users are anonymous.  They create an avatar and they personalize it and show themselves in ways they want to show themselves through an avatar. In many ways it is a lot like Second Life.

Some users have created second accounts – or a humerous second account. Bishzilla – a Swedish lady who is in tremendous command of the English language and has a razor sharp wit.  She has created this secondary account – almost like in a baby language.  Her avatar is a dinosaur that is not very bright that goes around frying people. Bizarre what people do! People may be editing a topic like an interest they have – e.g. Pokemon that they don’t want associated with their professional avatar. Or people may be editing a topic about hot political issues.  There have actually been some death threats issued to people over stuff they have been putting into the encyclopedia.

Tish: So avatars are important in Wikipedia.

Jonathan: Absolutely because people may be going in and editing articles that they may not want their friends and family to know they are editing.  One editor may say to another, “Stop putting stuff in or I will come and kill you!” Well then we have to ban them.  We have to call the police.

Tish: Can you build reputations on multiple avatars?

Jonathan: You are allowed to use multiple avatars as long as they don’t cross paths.  You can’t have two avatars editing in the same area beacuse you are going to be giving yourself double weight commenting on a discussion.


Tish: How do you know when this is happening?

Jonathan: You can watch the style of a users editing.  You have to watch behavior.  And if you have enough evidence through behavior that suggests accounts are controlled by one person you can go and request a technical check.

There are some uses who are called Checkusers who are able to access information desired from the server logs and check the technical characteristics of these accounts to see if they are using the same IP address.

Tish: So if you want to understand avatar interaction on the web it helps to understand Wikipedia.

Jonathan: Yes it is a fantastic way to understand how avatars work in some aspects, and also how to deal with community dynamics.  We have some very strong willed people – people in their 40s, 50s, and 60s – who are very successful in business.  They have plenty of money and spare time and they are doing this as a hobby. And some of these people can really butt heads.  You can have a problem when you have an editor who has been writing fantastic articles but also happens to be rude and chew other people out and tell them to f**k off if they are not behaving. What do you do?

Tish: Sounds a bit like Second Life!

Jonathan: The person is a great contributor to the community but they are telling noobies to f**k off, so you can’t allow that.

What do you do?  Vested contributors are a major problem to some of these sites. They are vested in the community but they start misbehaving. You can’t block them, because if you block them there is a huge upsroar from all their friends and it causes a cataclysm.  It requires very careful diplomacy to deal with some of these situations.

Tish: How many Wikipedia volunteers are there now?

Jonathan: Think of a Venn Diagram – a big circle. The total number of contributors are about one million different people that contribute.  But there are probably about 5,000 active editors  that are consistently and regularly contributing.  And within that kernel there are fifteen hundred people that have administrator access and probably only eight hundred of them are active.  People have a natural life span with the community.  People come an typically stay for 6 months to 3 years.  Usually after that they become bored, disillusioned or get into a conflict with someone.  There is a natural tendency for people to stay for a while and move on. Some people stay longer, a few, but the majority will move on at some point.  So it is a lot of fresh faces moving in.

Tish: What lessons of trust does Wkipedia have to teach us about new projects like AMEE that aims to aggregate the world’s energy data?

Jonathan: Well you have to know who is releasing the data. Who is creating the data? The beauty of Wikipedia is that you have an edit history so you can see exactly who has done what.  So you can judge whether this person is trustworthy or not.  That’s a huge problem on the web today.  We don’t have enough identification information.  When you see a web page you don’t necessarily know when that page was created and by whom, or how many revisions it has had.  Sometimes you can glean information by checking it.  If you see typos and errors you may decide that that page probably didn’t receive as much attention as it should have, and probably it is not that good.

Typos are an interesting thing.  People always try to figure out how Google ranks web pages. Matt Cutts was here from Google today.  And he was talking about spam.  But Matt also did a blog post about how he was in an airport once, and how he has a policy – when you are reading a document as soon as you come to the first error just stop because if the author hasn’t taken the care to make everything correct, you don’t need to read it. So he was in the airport, there was a sign, he came to a typo and stopped reading it. Somehow he got in trouble for not reading the sign and not having the information.  But it is interesting to think whether Goggle is looking for for typos, misspellings, broken links and using that as a signal of quality to rank pages.

Tish: Aaaagh typos might bring down your page rank!!!  That certainly is a scary thought for a blogger like me who likes to write impossibly long posts that are hard to check………

In a conversation with Tim O’Reilly and John Battelle (Federated Media Publishing) at Web 2.0 Summit 2008, Al Gore suggested that only the aggregate bandwidth of the internet could supply us with the kind of emotional intelligence we need to respond with appropriate urgency to the challenges of our times, for example, the CO2 targets necessary to avert catastrophe.

“People hear these things, and there are many other similar signals, and then the next day it’s gone. Now the neuroscientists have explanations for why that is ….. The urgency center of the brain is geared to snakes, spiders and fire and things that evolution posed as tests to our species…

But when we have to use our neo cortex to connect dots in an abstract pattern and then push that down to the urgency and fear center – that’s just a little footpath.

Its  like the internet, mostly, it’s an asynchronous connection.  There is a big connection going from the fear center to the reasoning process but just a very small pathway coming back.

It needs to be stored in the cloud. It is the aggregate bandwidth than counts. We need to have the truth – the inconvenient truth, forgive me, of this challenge stored in the cloud so that people don’t have to rely on that process and so that we can respond to it collectively.”

Tim O’Reilly responded: “Who knew you were the guru of Web 2.0 as well as global warming. You have totally outlined our premise here.”

(Photograph opening this post of the Former Vice President Al Gore on stage with Tim O’Reilly and John Battelle at  Web 2.0 Summit 2008, co-presented by O’Reilly Media and TechWeb. Produced by Good Company Communications. Photograph copyright James Duncan Davidson – see Duncan Davidson’s Flickr stream for a complete photo essay of the event.)

I was trying to find a word to express how powerfully  Al Gore addressed the Summit audience.  And I was discussing this with a legendary serial entrepreneur, Richard Titus, who is also a great admirer of Al Gore, at the closing party. Richard came up with the phrase I was seeking.  “He was totally naked,” Richard said.

Al Gore described himself as a recovering politician.  And yes, he seems totally recovered from the “woodeness” of politics and utterly at home with the “nakedness” of participatory culture.

Al Gore made clear that to change the world we have to change ourselves (he did).

Bertrand Russell is often attributed with the following quote:

The mark of a civilized human being is the ability to read a column of numbers and then weep.

Gore’s exhortation that the internet needs to be a puppy with a purpose resonated with his audience.  From climate change, global issues of health care, to rethinking global economies we desperately need to optimize our collective and individual intelligence.

Instrumenting the World: Life on the Cloud

Kevin Kelly’s  High Order Bit – a brilliant impressionist view of the internet’s next 6537 days describes what “Life on the cloud” will be like.

“If you are producing some information and it is not webized, i.e., it is online and not related and shared to everything else, it doesn’t count.”

This is already the case to some degree. And the challenge of understanding where our networked identities begin and end is with us. But Kevin Kelly points out, “life on the cloud” will heighten our dilemmas.

Nat Torkington’s presentation to the Privacy Forum in Auckland , New Zealand, “Web Meets World: Privacy and the Future of the Cloud” looks at our changing idea of identity through the lens of privacy – both “the nature of privacy” and “how expectations change over time.”  Nat cites William Gibson (interviewed by Rolling Stone on their 40th Anniversary):

“One of the things our grandchildren will find quaintest about us is that we distinguish the digital from the real, the virtual from the real.  In the future that will likely become impossible.”

The critical layer between this database of things and the ultra, mega cloud (see Kevin Kelly’s slide below) is the web of shared intelligence. This is where the transformation will emerge with its dangers and opportunities.

Brian Solis, in his excellent post, “Barack Obama, The Social Web, and the Future of User Generated Government,” proposes Zappos and their “public and transparent customer-focused culture” is a good model for how government can use the internet not only to push out its message but to create a whole new culture of participation.

Far fetched?  Watch Tony Hsieh’s High Order Bit for yourself. The idea that every interaction at Zappos has relevance to the value exchange between consumers and producers is a very interesting idea to apply to the relationship between government and citizens.

“Ecological Intelligence”

Instrumenting the World requires new models of data sharing. Last year, Cory Doctorow described to me an instrumentation model of data.

An Instrumentation model for data differs from a surveillance model of data sharing.  Instrumentation is “when you know a lot about the world,” in contrast to surveillance – “when people in authority know a lot about you”.

(Note: Mashable has an interesting post on the theme of a “instrumentation,” see:  Seventeen Killers Apps for Taking Control of Your Government:“Government is increasingly putting much of its public records online, creating opportunities for developers to build useful applications for citizens.”)

But corporate culture and governments around the world have embraced the surveillance model of data up to now.  I was fortunate to have the opportunity to ask Larry Brilliant, Google.org, a question about how the tables might get turned.  After his conversation with Tim O’Reilly,  I asked:

“What would motivate corporations and governments to participate in the kind of data sharing and transparency that could produce the changes that our world needs, particularly in the area of health and climate change? For example, why would corporations reveal the aspects of products we use and the food we eat that have negative effects on our health and our planet?” (This is more succinctly phrased than my original question!)

Larry Brilliant replied:

“I don’t know how many of you know Dan Goleman? He created emotional intelligence [quotient] – EQ. He is coming out with a book which I have just had the pleasure of reading in draft form which deals specifically with what you are talking about.

How we can have commercial intelligence. How we use the power of corporations and their various different stakeholders, including their customers to drive corporations to do the morally right thing by losing the commercial support of customers who won’t support them unless they are more green, fairer to women, respect gay and lesbian rights, do the things you would like them to do whatever that happens to be, so that you can vote with your dollars.

It is really a fascinating book:  “The Application of Ecological Intelligence to the Commercial World.”  I don’t know what the final title will wind up being but I recommend it to you.

Dan Goleman’s new book: “Ecological Intelligence: How Knowing the Hidden Impacts of What We Buy Can Change Everything,” will come out in April, 2009.

An Extraordinary Gathering At An Historic Time

Web 2.0 Summit was a brilliantly orchestrated gathering of many of the thought/business leaders and entrepreneurs who have shaped the internet as we know it today.

As my friend Jonathan Hochman, Wikipedia, said on Day 1:

“If everyone here [Web 2.0 Summit] shut down their website it would be the end of the internet!.” (See my upcoming interview with Jonathan on Wikipedia and Jon Brouchard on Wikitecture and what these projects can teach us about participatory culture).

But also in this elite crowd of “C” level execs were the next generation of entrepreneurs who are working on a hunch and prayer to create the future Web.

And this year, as the Web 2.0 Summit architects explained in their intro, the decision was made to extend the scope of the Summit even further:

“….our world is fraught with problems that engineers might charitably classify as NP hard—from roiling financial markets to global warming, failing healthcare systems to intractable religious wars. In short, it seems as if many of our most complex systems are reaching their limits.

It strikes us that the Web might teach us new ways to address these limits. From harnessing collective intelligence to a bias toward open systems, the Web’s greatest inventions are, at their core, social movements. To that end, we’re expanding our program this year to include leaders in the fields of healthcare, genetics, finance, global business, and yes, even politics.”

Truly an extraordinary gathering at an historic time – commencing the day after Barak Obama became President Elect, it seemed the causes and conditions for participatory culture and sustainable living were coming together at last!

Virtual Worlds and “The Web Beyond The Web:” Creating “A Supple Approach to Sharing Identity”

Virtual Worlds were not on the schedule.  But this is not surprising as their potential contributions to the very big problems at the heart of the Summit’s theme are only just beginning to emerge.

But new forms of  participatory culture were a recurrent theme of the Summit.  And Virtual Worlds at the high bandwidth tip of the pyramid of global connectedness and SMS at the bottom of the pyramid have a lot to teach us about participatory culture.

Crista Lopes recently co-founded with Christer Lindstrom a company, Encitra, that is focused on improving urban planning processes, starting with transportation, using virtual worlds. Christer Lindstrom has been a key evangelizer of PRT (personal rapid transit – see photo above).

Crista Lopes is Associate Professor at the University of California, Irvine, in the Department of Informatics (full interview coming soon).  Crista is using the dynamic shared viewpoint of virtual world technology to offer a way for the many stakeholders involved in a city scale transportation infrastructure change to participate in the process of planning. Crista is working with OpenSim – see the video of  “Encitra – Creating Immersive Worlds.”

There are a number of use cases for Virtual Worlds in sustainable living being developed. I have written several posts on Oliver Goh’s work,  “The Path to Sustainable Real Estate.” See my earlier posts here, and here, and IBM’s Virtual Network Operation Centers.“

Also see the recent announcement from Intel Research to create ScienceSim using OpenSim (more on this soon). Justin Rattner writes:

“Wilfred Pinfold (an Intel colleague and general chair of Supercomputing 2009) announced to the Supercomputing 2008 conference attendees plans to create a new virtual world called “ScienceSim.” Supported by Intel and the conference committee, this collaboration aims to use these immersive, connected environments to further cutting edge scientific research.”

George Jobi, Intel, writes in his post on ScienceSim: “Intel is one of the founding members of OpenSim and had been building its vision of open standards based 3D web architecture around OpenSim.”

The Achilles Heel of Web 2.0…….?

As Crista pointed out:

“The  Achilles Heel of Web 2.0 is trying to build the concept of person in a platform that doesn’t have people, at the center of the architecture. With Web 2.0 we go through a lot of hoops trying to integrate basics concepts of identity and storage onto a platform that wasn’t designed for it.”

Most of us have bits of our identity scattered all over the web, e.g., partial friends list here, there and everywhere. Some of us have literally hundreds of different log ins and profiles. Our list of applications with pieces of our identity locked up in them might look something like the slide below from the High Order Bit of Beerud Sheth, Webaroo Inc.

In contrast, Crista noted:

“The key component that a Virtual World offers you is that you can take your identity from place to place and the presence of people is at the center of the whole thing.”

Crista has already submitted code that introduces hyperlinks to OpenSim (see here). Crista is computer scientist of many accomplishments including being the co-inventor of Aspect-Oriented Programming.

There is a long conversation in the comments on my interview with Tim O’Reilly about whether the concept of avatar is the Achilles Heel of Virtual Worlds. So I asked Crista:

“Are avatars the Achilles Heel of Virtual Worlds?”

Crista explained why she thinks this is not the case in the modular open source architecture of OpenSim at least.

“The concept of people is not tied to the concept of avatar in OpenSim: One of the important parts of the OpenSim architecture is that the concept of user is very different from the concept of avatar.”

In OpenSim, Crista noted:

User = identity +storage

When I asked David Levine, IBM, what Web 2.0 could learn from virtual worlds re sharing identity, David, who works on interoperability and protocols in the Architecture Working Group, said:

Immersive spaces, are the real time, multi-user online component of Web 2.0, and identity is deeply part of that……..virtual Worlds teach us, as they expose more resources to Web 2.0, that there needs to be increasingly “supple” ways of sharing identity that go beyond simply anchoring it on gmail or openID, or such.

Social media has been one of Web 2.0′s success stories – giving the impression that Web 2.0 has people at the core of its architecture. But, as Crista pointed out, this is not the case.

There is no way in Web 2.0 to do identity at the level of platform, at the moment. As soon as you want to create identity on the Web there is a big mess.”

Participatory Culture at the Bottom of the Pyramid: “The Web Beyond The Web”

The “Web Beyond the Web,” Beerud Sheth, Webaroo Inc quipped, is not his announcement of Web 3.0. Rather, Beerud is describing the parallel innovation at the bottom of the pyramid where lower prices on mobile devices rather than new features drives adoption and voice and SMS (short messaging service) rule.

SMS is the web of the people for most of the world.  The current ratio is 10:1 with 10 people using text messaging to every 1 that has web access and the SMS population is growing at a much higher rate than web users. The  innovation at the top of the pyramid, where a plethora of Web 2.0 apps are built on top of  http, looks like the unreadable slide above with a forest of applications.

In contrast innovation at the bottom of the pyramid, until recently, has been limited to ringtones, wall papers, and voice response mechanisms.  So Beerud introduced a new service GupShup.

Gup Shup = Chit Chat

“Think of GupShup as another cool word from the language that gave you yoga, nirvana and karma sutra,” Beerud said.

GupShup is a “Twitter for India” but on a vastly bigger scale (only 18 months from launch they are up to 12 million users).

But, Beerud points out, don’t just file away GupShup as another twitter clone.  While they have Web and WAP site, they are deeply intergated into SMS as the lowest common denominator. GupShup can be used entirely from mobile which is vital as they have more users already than the total number of web users in India.

This idea of fully integrating into the lowest common denominator medium, SMS, has allowed GupShup to grow extremely rapidly. And, interestingly, when you look at the use cases you see the end users are deploying many of the uses cases that are familiar from the web,

Beerud left the audience with the take away that all the use cases are surprisingly similar to the web as are the ways of monetizing them,  This is creating enormous opportunity for creativity and entrepreneurship in building out this web beyond the web.

He invited those who already know the possibilities of the web to come and join this new adventure.  The enormous scale of the “web beyond the web,” and the fact people are connected almost continuously, creates vast opportunities for participatory culture to expand beyond the small triangle at the top of the pyramid.

On the “web beyond the web” the potential of 160 characters is explored on a scale unimaginable on Web 2.0 where Twitter, for example, is just one app in a vast ocean of other possibilities.

Crossing the Chasm Between The Top and the Bottom of the Pyramid

This total separation between the top and the bottom of the pyramid is, in part at least, constructed through the current web culture of web exclusive subscriptions.

It is perfectly possible to write an app that would accept SMS text and post it on a web page without ever requiring a web visit from the SMS subscriber. The same app could also accept text input from a web page and send it out as SMS to one or many subscribers that have never visited a web page, thus enabling communication across this gap.

Oxygenating the System: Monetizing Doing the Right Thing

The VCs, business leaders and  entrepreneurs at Web 2.0 Summit had their entrepreneurial Spidy Senses (as John Battelle calls them) tuned to the challenges and opportunities of Web Meets World.  Some of the winners of the Web 2.0 Launch Pad Competition explored the premise that doing the right thing can be monetized.

Danny Kennedy’ Sungevity was the overall winner.  Sungevity’s aim is to “scale solar electricity as a solution to climate change.”  Their use of a Virtual Earth feed to streamline the installation of solar panels and ambition to be the SalesForce.com for the solar industry was a very winning combo.

Good Guide, a really excellent service (also available as an iphone app) providing a guide to all products from the perspective of their healthfullness, greeness and other socially valuable criteria clearly scored a 10 on doing the right thing.  But Good Guide’s ability to succeed on the monetizing side of the equation was questioned by one of the VC’s on the Launch Pad panel.

Carbon Networks pitched with the mantra “do the right thing and enhance the balance sheets in the process.” But the difficulty there, it seems to me, is that there are many questions re the benefits, or lack of them, of global carbon trading markets.

Carbon Networks argued that carbon markets, which are already a giant industry, present enormous opportunity for companies to monetize doing the right thing.

I asked Gavin Starks (who I interviewed recently about his venture AMEE – a BIG project to aggregate the world’s energy data) about the problems of carbon markets.

“They have high levels of inappropriate use even for a new market area,” he commented, noting:

“There are some superb projects out there, but it would be fair to say there has been good dose of snake oil in the space – which has certainly not helped to build consumer confidence. However, markets are necessary to engage with the scale of investment that is needed to address the issue – it’s the use of funds that needs more scrutiny and greater transparency needs to be given to the whole process.”

There are projects working with Voluntary Emissions Reduction which aren’t tradable on proper carbon cap-and-trade markets, “though in theory the step up to CERs (certified emissions reductions) isn’t too great a thing,” Gavin noted.

MicroEnergy Credits the  initiative presented on the Track Me panel by April Allderdice, co-founder and CEO, is a good example of this.

Gavin pointed me to CheatNeutral and their YouTube video for a hilarious and razor sharp look at the problems of carbon offsetting. The text below is from the CheatNeutral site.

Gavin also explained a new initiative Sandbag (beta). Sandbag aims to take the permits that allow polluters to pollute out of the system.

“Thanks to policy makers in the UN and Europe levels of pollution are now controlled. Permits must be bought by polluters to let them keep polluting. But there is a finite number of them in circulation and the good news is anyone can buy them. So by taking a permit out of the system we can reduce the amount of pollution taking place and force industry to invest in cleaner technologies. One less permit means one less tonne of greenhouse gas in the atmosphere.”

AMEE is working with  Sandbag

Consuming Less and Redefining Prosperity

This picture is from the Sustainable Mobility Panel at the ASPO-USA Peak Oil Conference.

Perhaps nowhere is it more clear than when we look at the reports that link catastrophic climate change to the assumption of growth that what is really at stake in terms of averting catastrophe is not just retooling our energy infrastructure, but fundamental changes at the level of culture and identity.

Consuming less may be the single biggest thing you can do to save Carbon Emissions, Tim O’Reilly said, in his Tweet on “Why politicians dare not limit economic growth.”

A growing band of experts are looking at figures like these and arguing that personal carbon virtue and collective environmentalism are futile as long as our economic system is built on the assumption of growth. (New Scientist)

But few of us are willing to contemplate what a sustainable economy and averting the catastrophe of climate change require – redefining prosperity and reducing consumption (see Redefining Prosperity).

Web 2.0 Summit took on the challenge of reimagining giant industries like energy, food and transportation and how we might  be able to shift away from a culture of food and energy consumption that is basically killing us and our world (see Michael Pollan’s brilliant High Order Bit on the culture of food in the US).

The Summit gurus urged that taking risks and tackling very big problems has always been what Web 2.0 is about and indeed cultural shifts of the magnitude needed would be hard to imagine without a Web 2.0 perspective

Shai Agassi, Better Place, explained how paradigm shifts require new business models. See Shai’s High Order Bit here on the evolution of “Better Place,” -  by giving away free electric cars he is creating a new business venture that will bring clean cars into the mass market.  New business models not just new technology are required to drive change.

Breaking News From Reuben Steiger’s blog

First Israel.  Then Denmark.  A few weeks ago, Australia.  Today,  Mayor Newsom along with Governor Schwartznegger and the Mayors of San Jose and Oakland, announced that they would be making a major move towards bringing electric vehicles and the Better Place network to the Bay Area.

Please, visit Planet Better Place to sign the petition,  join the movement and bring Better Place to your town or country.

To motivate yourself and others how important it is to change patterns of consumption see Saul Griffith’s High Order Bit here and Project Wattzon

“…..from flying, driving, powering a home, eating, shopping, working and even one’s share of the energy necessary to make our society function. WattzOn helps users understand their personal impact on the environment and how they rate compared to others WattzOn users, as well as global averages.”

“The Secret Sauce”: New Business Models for Web Meets World

I spent some time talking to Don Dodge, Director of Business Development, Microsoft’s Emerging Business Division, about the future of  virtual worlds and what technologies he thought would play an important role in developing the participatory architecture of the web (full interview coming soon!).

“The question is how do you apply these technologies? Where is the best use for them? And this is the hard part.  When you look at social media and social networks and things like Wikipedia, don’t look so much at the technology because that is fairly simple.

Look at the rules of social interaction and how people interact, and how you put protections in there so that people don’t game the system or do bad things.  Look at the processes because that’s really the secret sauce of how it all works.  The technology is simple. It looks easy from a distance, when you start getting into how it really works from a social perspective that’s the secret sauce.”

(screenshot above from Threadless )

Also I caught up with John Battelle, Federated Media Publishing (see his Data Bill of Rights here), and Jennifer Pahlka, TechWeb, at a small press conference. I managed to squeeze in a couple of questions!

Tish Shute: If marketing has been the oxygen of the system up to now, what will oxygenate the system of the new participatory culture of Web meets World”

John Battelle: I don’t think marketing ever stops being one of the most significant pieces of the economy -  because it is, of the whole economy. So what I do think will happen, and this is the company that I run, I do think marketing will shift very dramatically in terms of its approach and how it is a part of the value exchange that occurs around goods.

One of the reasons that I had Tony Tsieh from Zappos was to show that.   Tony shows how every single human being in his organization is a marketer and sees every interaction they have as marketing.  Can you imagine  a company as big as Intel that has that kind of an approach?  That’s when we will have a real shift. Business models based on that idea are emerging.  I run a company that is involved in that. I don’t try to push it on the stage ..but I do it is right there Federated Media!  And now I am pushing it [laughs]

Its an idea that comes from all this staring at this. I do think marketing is going to shift quite dramatically. So we may see in 10 yrs that we don’t have a big media budget  pushing adds at people. But will there always be budgets for creation of value exchange between consumers and producers? yes! There will just be new models for how that money is distributed and spent and new services and intermediaries for that value exchange.

Tish Shute: But who controls definition of data will remain key right?

John Battelle: There is a reason why Yahoo, AOL, Facebook, MySpace, all of whom are here, and Google, are all about the data….all about the data….sorry I have to go!

Jennifer Pahlka: I think in addition to the enormous changes that John was just talking about in marketing, and I think these are very significant – the way marketing will be seen completely differently 5 years from now.  There is also the shift in Web 2 away from an over identification with  Web 2.0 as being primarily about and driven by advertising  because of these models that are emerging for Web 2 that are driven by data, driven by services, subscription.  There are a whole bunch of other business models for Web 2 start ups and for enterprise that really don’t have anything to do with that at all.

Tish Shute: And in terms of participatory culture and sharing data?

Jennifer Pahlka: And even on a simpler level than the data.  Think of a company like Threadless [see screenshot above]. Their co-founders are keynoting at our Spring event.  They have taken some of the other principles of the architecture of participation and the creativity of the community and built a whole difference around that.  And all they do is sell T-Shirts.

“A Billion One-Person Enterprises”

New York Times writer, Saul Hansell, in his article, “Web 2.0 Gets Big and Corporate,” writes, “the best minds of our generation are turning to the Web for solutions.”  …..the big companies that make very complicated systems are reworking them using the principles of Web 2.0 companies.”

But “big companies” themselves may soon be a thing of the past.  One of the potential futures many my friends in virtual worlds have been looking at is, “if the future consisted of a billion one-person enterprises.”

Tony O’Driscoll described some of his thinking re the role virtual worlds will play in this potential future.  See Tony’s presentation, “A brief history of a potential future” on SlideShare. Tony’s research provides a window onto the new participatory architecture of business, government and the economy and the ways the individual and the collective will have new dynamic relationships based on “co-creation.”

Second Life and Wikipedia are the two great experiments in collaborative co-creation. They show us how co-creation can be one of the keys to a participatory global culture and sustainable living – part of creating an alternative to this economy of escalating consumption that has us in its death grip today.

Tim O’Reilly has outlined some of the world’s big problems in his talks, and urged technologists to “work on stuff that matters.” I was one of O’Reilly’s listeners at the Web 2.0 Expo in NYC (see my post here).

But, I found out at the Head Conference in London, recently, that O’Reilly is doing more than just talking about solving the world’s problems. The O’Reilly VC company is investing in technologies that tackle these big problems, for example, a very interesting startup, AMEE.

AMEE is a new company with a VERY big, world changing idea – “to create  a neutral technology platform to aggregate all the energy consumption data in world ” – “to be the world’s energy meter.”

I was fortunate, when I was in London, to get an opportunity to chat with Tim O’Reilly about AMEE, Web 2.0, and the role of virtual worlds in positive global development. Also, I met the CEO of AMEE, Gavin Starks.

We are still, just, in the pre “Internet of Things” era.  But, soon, as Bruce Sterling puts it, we will be able to “Google our shoes” or find out which super market shelves are out of sandwiches at any particular point in time! But for now, it can still be very hard to find a sandwich, even in central London. So, I had plenty of time to talk to Tim O’Reilly whilst searching for a hand held bite to eat.

We journeyed past several sandwichless restaurants (Tim picked up the Financial Times under his arm in the picture above in one of them), and super markets with shelves stripped bare except for some end of the day sushi (it looked scary so we passed on that).

Finally, McDonalds came through for us with the sandwich in the top left corner of the photo above.  The full interview is later in this post.

First, more about AMEE.

Tim O’Reilly says he doesn’t like predicting the future. But the future comes to Tim O’Reilly in very powerful ways.  And AMEE asks us to play a new proactive role in our own future. AMEE’s call to action is:

“If all the energy data in the world were accessible, what would you build?”

AMEE, to me, is a quintessential example of an effort to harness the key paradigm shifts of Web 2.0 (see O’Reilly, “What is Web 2.0?“) to tackle some of the world’s most pressing problems.

AMEE’s mission is to be a neutral technology platform, using open source and standards, and an architecture of participation, to address the need to standardize measurement, encourage collaborative development, and create a market place for energy data.

AMEE’s goal is to enable us to understand energy consumption from the level of the individual to the scale of whole countries.

This would address the need O’Reilly notes here his son-in-law Saul Griffith argued at Emerging Technology Conference earlier this year:  “to pick a target CO2 concentration and work backwards to get to an energy policy, rather than guessing at an energy policy with fingers crossed, hoping for a climate outcome that is tolerable.” AMEE is also involved in Saul’s Wattzon initiative.

Gavin Starks, CEO, AMEE, (pictured above standing under the Head Conference banner – a recording of his talk is here), explained:

AMEE’s vision is to aggregate all the energy data on Earth. By energy I include electricity, gas and all types of fuel, water, waste, you name it: everything we do is energy consumption, which means really building towards our sustainability footprint rather than just our carbon footprint. The initial thing we’ve focused on is Carbon and CO2, because that’s the most pressing issue we have to face: but it’s quite a thin layer on top of the whole sustainability question.

AMEE is not building the front-end applications to harness this energy data. Gavin noted:

We’re aggregating all the standards. This is a massively complex area, so we’ve got a science team whose job is to harvest all the scientific research and methodologies. That’s not something developers tend to want to go anywhere near: it unpacks itself into enormous amounts of complexity very quickly (e.g. building methodologies that have 700 data points).  Our Chief Scientific Officer, Dr Andrew Conway, is ex-NASA and has worked on massive scientific data analysis.

We aggregate government standards and other international standards, so that you know when you’re integrating with us, that you’re working to those standards. But much more than that we actually publish those standards on an open Wiki (the Wiki and the API actually talk to each other). As these standards emerge and evolve, we’ll be tracking them, ensuring that we are up to date, and granularity is added as needed.

We were very fortunate that one of our first clients was Defra which UK’s Department for Environment, Food and Rural Affairs. Defra is currently restructuring into DEC – the Department for Energy and Climate Change. So in the UK they’re actually fusing Energy and Climate Change into a single government department. I think this is quite remarkable: a giant step forward.

We were contracted by them because they were building a national campaign to raise the awareness of every citizen’s personal and household footprint, and they were looking for an Open Source solution – which AMEE is. Defra/DEC now use AMEE for two purposes: they make their standards available through the AMEE platform, so that everybody else can use them, and as the back-end solution to their national campaign, “Act on CO2″.

AMEE is SaaS – a web-service API – we’re not trying to compete with anyone on the front-end development and delivery. Because we aggregate two moving targets: standards and consumption, we enable those integrated with us to be current at all times.

Who Owns the Data?

But, if AMEE hopes to harness global network effects as a neutral aggregator of energy consumption data from individuals, businesses, and governments, one of the key questions that AMEE must answer (also a key question for Web 2.0 in general) is: Who owns the data?  I have delved into this question before on Ugotrade. See David Levine’s conversation with Eben Moglen on privacy here.

Gavin told me that this is a question AMEE has given a lot of thought to.

How AMEE answers this question, Who owns the data?, will probably determine the success of their mission as an ethical endeavor,  and their ability to scale and leverage the network effects of the internet as a platform while still allowing ” a very granular level of energy activity to be tracked.”

Gavin explained where AMEE is going re their approach to this issue. And, how this relates to AMEE’s business model – software as a service (SaaS).

We’ve spent a lot of time thinking about the best way to approach this, from both a commercial perspective and an ethical perspective.

We’re in a position where we’re aggregating vast amounts of personal and business information, on an ongoing basis. If we were to integrate with your credit cards, your smart meter, your supermarket, and your vehicles: we actually know everything about your life. Aside from the Data Protection issues we felt, “How could we protect everybody around ‘excessive’ exploitation of that data and ensure the user has long-term control?”.

As the saying goes, “we don’t know what we don’t know”: when it comes to predicting what our privacy issues will be, and as the data around our physical lives becomes digitally available, we wanted to err on the side of caution. Danny O’Brien, the EFF and MySociety have certainly helped to shape our thinking in this respect.

So if you’re a Google user and you go into the Google and you kick off a calculation, all your answers to the questions are stored in AMEE – but we don’t know who you are. We’ve got an anonymous key, Google’s got the anonymous key. Google will have your user name and so on and so forth. In AMEE we’ve got the aggregate of the responses to the questions. It’s up to Google’s Privacy Policy to determine what they and their user’s can do.

However, this doesn’t preclude us from enabling data-portability on behalf of the user. The anonymous key is not dissimilar to an OpenID, but applied to a specific data set. We are heading towards allowing you to control your data’s portability, as an individual.

It’s a fragile space. We want to give you the opportunity to glue together your AMEE IDs with your OpenID, or whatever login you choose, so that you’re in control. We aim to enable this to be both cloud and edge-based, which while fragile, is in the interest of the user. The more value we can provide, we believe, the stronger the value of our proposition.

But, because were dealing with a range of different massive organizations … imagine credit card companies sharing data with energy companies sharing data with petrol companies, sharing data with airlines etc. That’s a massive challenge from a business and political perspective – almost impossible to navigate.

We can enable people to collaborate, by making it opt-in all the way through the chain. We don’t undermine peoples existing databases: we can actually add value to them, or we aim to add value to them. We think this has got a huge amount of potential to stimulate new business for our clients.

It’s very “web” in its execution: we are part of an ecosystem. Part of our imperative is to be commercially enabling to everybody else. If we’re not being commercially enabling to other people, we’re not going to get the kind of scale of change that we need.

This was another design feature. We felt, “how could we create something which other people could build businesses or platforms on top of”?  And, how could that scale incredibly quickly? If we’d gone beyond our boundaries as an API, we would have been competing with people we want to work with.

While many services have taken similar strategic approaches, most seem to start with a form of lock-in, or evolve quickly to the point of lock-in, which satisfies a current trend in their valuations. We believe this trend will change and adapt to a more “privacy-based” intelligence, which has substantial value.

Tim O’Reilly in The Magic Circle

The motto of The Magic Circle where the Head Conference was held, “Indocilis Privata Loqui,” can be roughly translated as “not apt to disclose secrets.”  One of the wonderful displays of memorabila there was Robert Houdin’s Mystery Clock (picture below).  Luckily, for me, I was was treated to a full explanation of the “Mystery Clock” by another attendee during the Head Conference cocktail party.

As Tim O’Reilly pointed out, in his interview with Aral Balkan, he felt it was a privilege to be talking in this theater and center of magic.  Capturing the magic, spreading the magic, and sharing the magic is at the heart of what he has spent his career doing.  He explained:

I guess this is kind of a root idea for O’Reilly…… When I look back on my career….What did we really do?  Find cool people who were doing cool shit. They didn’t really need any help from us. But then there were a bunch of people who were saying, “How did they do that”? Those are the people we help.

We find the people who are doing what appears to be magic. The Arthur C. Clarke kind of magic you know…. We document – we teach people how to do it.

It is such a great  privilege to be here in a theater devoted to magic – The Magic Circle. This is really what we try to do.  We try to capture the magic, spread the magic, share it with other people.

Interview With Tim O’Reilly

Tish Shute: I was interested in your comment on Chris Brogan’s blog post the other day.

Tim O’Reilly: Actually it wasn’t Chris Brogan’s post. Dennis Howlett was a guest blogger. I was reacting to him saying there is nothing new in Web 2.0. My reaction was: “Well gosh it’s very easy to make a straw man out of Web 2.0 and say, ‘What’s new?’”

Howlett was specifically reacting to the Web 2.0 start ups that are superficial and not really what the trend is all about.  For me, Web 2.0 is about the internet becoming a platform. Does he think that is over?

And, it is about understanding that the rules of business change when the internet is a platform. I think a lot of people do that with Web 2.0 [make it a straw man].

They don’t like the term Web 2.0 and they attach ideas to it that reflect the most superficial elements. And then, they say these aren’t interesting. And, what he was saying was that there is a lot of superficial social media stuff – consumer apps, and what really matters is what will bring ROI to business.

I just said that he is totally missing the point because learning how to use the network as a platform matters very much to business. The same rules that apply to everyone else apply to businesses.

So, for example, I have made the point in my talk in New York, just a few months ago, that in many ways you can think of Walmart as a Web 2.0 company. They are infused with IP – they are taking the data that the users give them by buying things and making themselves a more responsive organization by using that data.

That is the heart of Web 2.0 in the enterprise. Not, do they use social media or not, or the social media buzz words.

Tish Shute: I am going to do an interview with Gavin Starks, CEO of AMEE. Could you tell me about your role in this project?

Tim O’Reilly: My role is as an investor. Our venture firm, O’Reilly AlphaTech Ventures, has just finished closing on investment in AMEE. We think global warming is a really important issue to come to grips with. And, a big part of it is actually keeping track of all the carbon we’re emitting. AMEE helps with that problem.

Tish Shute: What is the potential, now we are beginning to break virtual world technologies down into basic open source building blocks, to create useful mashups with sensor technology, Web 2.0 and Virtual Worlds? Could Virtual Worlds play a key role in this work of instrumenting the world?

Tim O’Reilly: First of all, I don’t think that Virtual Worlds in the Second Life style will have this role …while I like the concept of Second Life, in that we have a Second Life in a virtual world, I am not sure that 3D avatars are [the way to go]…. at least they are certainly not my Second Life.  My Second Life is in other types of media.

But, when I look at this idea of instrumenting the world, one of the things that is very, very clear is that we are turning all the millions of consumer cameras into sensors.

For example, Microsoft’s Photosynth demonstrates how these consumer sensors can be used to build 3D models. We are starting to build a 3D representation of the real world, not a separate virtual world. And, we are all going to be part of that world. So I think that the real Second Life will be ………..well I think the first layer is going to be….to get the 3D models of the world as it is, and then we will have doorways into additional rooms and additional spaces.

That’s when its going to take off because people are going to get used to it through navigating the real physical world with maps – with 3D imagery of buildings and spaces.

And, another piece of this… I talked recently with Carl Bass, CEO of Autodesk……and he was talking about how much even the Autodesk workflow is shifting to scanning things first.

He was describing how they have built this new demo center in an old building.  The first thing they did was photographs and measure it exactly. Then they go and make stuff that fits in the exact space.

Also, he was talking about how in his own hobbyist work, he found this shark’s jaw and he loved the curve of it.  So he scanned it and made it into the arms of a chair.

Tish Shute: I think the two important pieces that might come out of virtual worlds technology are the real time interactions where people can view the same application or context as and when you do, and the rapid prototyping.

Tim O’Reilly: Yes rapid prototyping, no question. But, as I said, the idea of moving an avatar around isn’t very compelling to be quite honest.

Tish Shute: But the web doesn’t do real time interaction very well does it?

Tim O’Reilly: Well Twitter is doing a pretty good job!

Tish Shute: Yes I love Twitter. But, in terms of if you want to get a 10,000 foot view and gather around and interact with data with other people…..what about that?

Tim O’Reilly: Well that’s true. I am using that example of the Squeak based virtual world that Fidelity is using. And, that is exactly what they are using it for – business interaction.

Tish Shute: What about the role Virtual Worlds might play, for example, in instrumenting the world through facilities management?

Tim O’Reilly: Yes, SAP did a very interesting project on property management – and that is interesting.

Tish Shute: Yes, on my way back to New York City tomorrow, I am going to stop off in Zurich and visit Oliver Goh who worked with Denis Browne, SAP, on that project. In fact you showed a picture of Oliver’s Goh’s avatar demoing the virtual counterpart to his instrumented Playmobile house in Second Life in your post, “SAP as a Web 2.0 Company?” (see the picture below).

Tim O’Reilly: I make no attempt at predicting the future.  So you could well be right that Virtual Worlds will be a very powerful tool.  But, I think with the pace that other technologies are progressing, we will get there with photorealism and video, etc.  I think the fundamental problem in most virtual world stuff is the idea of the avatar.

Tish Shute: Why do you say that?

Tim O’Reilly: Well just imagine if when interacting with people in the real world you had to look at yourself interacting with someone else.  First person point of view is our fundamental experience.  And, you are being forced to see yourself in the third person.

Tish Shute: I have always been more interested in avataring the world than in my avatar identity.

Tim O’Reilly: There is something very interesting in having an avatar that you don’t ever see.

[At this point there were less than ten minutes before Tim's interview for the Head Conference, so it was time to concentrate on eating!]

Virtual Worlds: Where Web Meets World

As Ian Hughes, IBM, notes in a recent post on Eightbar:

The last few days have seen a plethora of virtual world pitches, reports, articles and blog posts around certain types of virtual world platform. The first was over at @monkchips a.k.a James Governor analyst blog around a visit to Microsoft to see about the ESP platform. This appears to be a high fidelity simulation platform and toolkit. The second was widely reported. But Wagner’s New World Notes is the one most of the metarati will have read on the matter. This centres around some statments by Craig Mundie that avatar based interaction was of limited interest and really it was photosynth that was the way forward, modelling the real world from photos…….

I agree with Ian when he says:

the interesting thing here is that all the discussion is not about why would anyone want a virtual world, but instead what sort is best.

Tim O’Reilly was not questioning, in my view, that we are moving towards new understandings of virtual spaces or virtual worlds but whether avatar based virtual worlds will be the most useful model.

I began my questions to Tim O’Reilly by bringing up his comment on Dennis Howlett’s post not only because he succinctly states there what is really important about Web 2.0, i.e., “internet as platform, and the rise of applications that harness network effects to get better the more people use them.”

But also, this comment caught my attention because Tim used virtual worlds as one of the examples of the value of Web 2.0 to enterprise.  He wrote:

Guess what : they [SAP] understand that harnessing users is good for their business. At O’Reilly, our InPractice division is working with them to actually turn their documentation into an open source, crowdsourced project. They are doing fascinating experiments at SAP Labs with how to integrate virtual worlds into property management. They have built a great internal social network for employees that has already affected their HR practices.

It is Oliver Goh’s instrumented virtual house in Second Life that Tim mentions in his post “SAP as a Web 2.0 Company?” to make the point that:

This prototype is also very on trend with one of the big ideas we have about where Web 2.0 is going, towards Web 2.0 applications that are fed directly by sensors, so that “participation” no longer just means typing on a keyboard, but the accidental information we create “merely in living as and where we live.”

I have been blogging Oliver’s work prototyping various use cases for virtual worlds in facilities management and energy optimization, e.g., virtual operations centers, in Second Life and OpenSim, since its inception (see here and here).

Now, Oliver has developed a complete solution for sustainabililty in the real estate industry that optimizes energy consumption through the entire life cycle of properties - see here for more.

Also, look out for some interesting intersections between AMEE’s mission – ” to create the world’s energy meter,” and Oliver’s mission to “optimize the world’s energy usage” in the future!

I visited Oliver in Zurich on my way back to NYC from the Head Conference.  In the picture below, Oliver is standing by the Playmobile house that is RL counterpart to the virtual control center house pictured above!

The ability of virtual worlds to play a role in solving the world’s pressing problems is, in my view, linked both to their ability to fully integrate in Web 2.0 and “real” world  data.

I have been blogging a lot on these issues!  Rob Smart, IBM, (see my recent interviews with Rob here and here – “Web 2.0 to OpenSim Made Easy”) has been doing some very interesting work recently integrating JSON support to OpenSim. This is one of the recent important steps forward in virtual world to real world communication.  See this cool video, “OpenSim Meets MQTT jedi mind numbers.”

The powerful value add that virtual worlds, even in a basic form, have shown in the realm of social media that “the people with you can view the changing states of that application or context as and when you do” can also play an important role in the front end applications for projects like AMEE and Oliver’s work.

This is not to discount the role of social media virtual worlds in the participatory work of instrumenting our planet. There is already  a nice integration of AMEE  with Second Life. See Jim Purbrick’s Carbon Goggle’s for Second Life here.

Carbon Goggles from Jim Purbrick on Vimeo

But, if virtual world technology is going be part of the evolving power of the internet to help us solve the big problems facing humanity, there must be an evolving vision for virtual worlds and their relationship with the “real” world.

Most likely, many of the dichotomies, e.g., the notion of avatar based or non avatar based, or simulation versus augmentation, and mirror worlds versus virtual worlds, will increasingly dissolve as all these aspects of virtual reality are woven together into the fabric of everday computing to form new digital/physical realities. And, while I’m not trying to predict the future, perhaps, this will happen sooner than we think!

I have just got back from attending two conferences in the UK, the Head Conference, and Virtual Worlds London.  I was on a mission at both the events to ask questions about how Virtual World technology will answer the call Tim O’Reilly made at the Web 2.0 Expo in New York City to “create more value than you extract” and do something worthy and useful with the internet.

The Head Conference was an ambitious, timely, and much needed creative exploration of the potential for “green” conferencing using Adobe Connect Pro, Second Life and  local conference hubs in various cities. For more on the conference organization see this pre-conference interview with Aral Balkan.

Head will be the focus of my next post, so more on Head soon!  One of my main goals in attending the London Hub of Head was to interview the CEO and founder of AMEE, “Avoiding Mass Extinctions Engine,” Gavin Starks. AMEE aims to be “the energy meter of the world.”

AMEE is a neutral aggregation platform designed to measure and track all the energy data on Earth.”

AMEE is a project with the kind of big goals that O’Reilly talked about in his keynote at Web 2.0 Expo, NYC.  Tim O’Reilly is an investor in AMEE. He announced, at Head, that the O’Reilly VC company has just closed a deal with AMEE.

I had an extraordinary opportunity to spend time some time talking with Tim O’Reilly while looking for a sandwich in Euston Square.  More on this sandwich adventure and my interview with Tim O’Reilly, and my long talk with Gavin Starks about AMEE, in my next post!

Tim kept saying in London that he doesn’t like predicting the future. But the future comes to Tim O’Reilly!

And, after talking with Tim and Gavin, I felt I had a very exciting glimpse of what is emerging from the tech’s burning issues. George F. Colony, Forrester, summarized these issues nicely in his post, “Why This Tech recession Will Be Different.” Colony noted, “Virtualization, social computing, mobile computing, Green IT, SOA, extended Internet (connecting the physical world to the digital world) are front and center on the agendas of large companies.”

And, yes, this is supposed to be a little bit of a teaser for my next post on AMEE!

Virtual Worlds Road Map.

The final keynote at the Virtual Worlds London was what Ian Hughes in his post on the conference for Eightbar, aptly described as a call to arms for the Virtual Worlds Roadmap. As Ian pointed out: “This needs a post in its own right as we all need to get on board with this across the industry and help.” Ian Hughes’ (IBM) own presentation on “Business Process Management” was one of the best I attended in conference.  Yes, amazingly, he made this topic very interesting and fresh!

The pictures opening this post are the Virtual Worlds Road Map presenters. Victoria Coleman (Samsung) -seated at center, Sibley Verbeck (Electric Sheep Company) – in trademark hat, Jeffrey Pope 3Di – far left, and  Bruce Damer – close up in the picture on the right.

I am delighted to join Bruce Damer, later today, for a FastCompany.com Technology Group Call-in: “Next Generation Interaction: Are Virtual Worlds Waiting in the Wings?” with Donald Schwartz (October 28th at 4:00 PM EST).

I will also be in Second Life at Train 4 Success (SLURL) on Thursday, October 30 (starting at 9AM PST) with Peter Quirk, EMC, and Jani Pirkola, realXtend talking about OpenSim and realXtend for an event organized by Eilif Trondsen of the Stanford Research Institute and the Gronstedt Group.

John Hengeveld (Intel) – was off screen for this group picture (above). But, Intel is doing some very interesting work in Virtual Worlds see my earlier post here.  And, John is  “helping NASA work out how to deflect extinction level event asteriods from Earth!).”

As Ian noted, the main aim of Virtual Worlds Road Map, “is to gather together and cut through use cases to understand and help people come to terms with which applications need to be built for which case.”

For more great coverage of Virtual Worlds London check out Ian’s post on Eightbar. And, check out Roo Reynolds’, live blogging here and here. Also see Roo’s post on his panel on “ARGs [Alternative Reality Games] and Virtual Worlds.” which includes slides and audio. Picture below is Roo in action live blogging. Roo is Portfolio Executive for Social Media at BBC Vision.

Tribal Media: A Teacher Training Intranet For The Swedish Government on OpenSim

One of the more interesting developments I saw at Virtual Worlds London was a highly customized training intranet for 50,000 teachers being developed for the Swedish Government by Tribal Media. The flexibility of OpenSim to provide cost effective custom intranet solutions was nicely demoed by Darren Guard, Tribal Media R&D (pictured above). Darren is one of the more reclusive founders and phenom developers of OpenSim.

Virtual Worlds and Web 2.0

In my earlier interviews with Rob Smart here, and Teravus Ousley here, we discussed the work to integrate OpenSim with Web 2.0.

To meet the O’Reilly challenge – to do something useful with the internet and help solve some of the world’s big problems, in my view, Virtual World technologies must engage more fully with the power of the internet-as-a-platform – “a system without an owner, tied together by a set of protocols, open standards and agreements for cooperation.” (see O’Reilly, “What Is Web 2.0?” ).

Unfortunately the worst presentation at Virtual Worlds London was purportedly on standards for virtual worlds.  I do not want to waste energy rehashing the misinformed and misguided presentation on the MPEG-V’s archaic blunderbuss approach to standards in this post.  I completely concur with Jim Purbrick of Linden Lab’s characterization of this talk as “the worst talk I’ve heard in a long time.” (Also, see Jim’s post for an astute commentary on other aspects of Virtual Worlds London.)  Luckily, there is much productive work from quarters aimed at leading to standards for Virtual Worlds. And, some of these efforts I have blogged here on Ugotrade.

Because there is confusion, sometimes, in Virtual World discussions about how business models work on a “system without an owner,” here is the concluding quote from, “What is Web 2.0.”

This is not to say that there are not opportunities for lock-in and competitive advantage, but we believe they are not to be found via control over software APIs and protocols. There is a new game afoot. The companies that succeed in the Web 2.0 era will be those that understand the rules of that game, rather than trying to go back to the rules of the PC software era.

What is the Killer App. for Virtual Worlds?

“The killer is that any app you do create is automatically presence enabled.
The people with you can view the changing states of that application or context as and  when you do.” Rob Smart, IBM.

The picture above are the presenters for the “Platform Integration Considerations for Enterprise Virtual Worlds” panel. From left to right: Jean Miller, German Market Development Manager, Linden Lab, Matt Furman, Software Engineer, Northrop Grumman, Rob Smart, Emerging Technology Specialist, IBM Hursley,

Interview with Rob Smart, IBM: Part 2.

Tish Shute: Up to now, Virtual Worlds have been relatively isolated from Web 2.0, living somewhere between the gaming world and the Web 2.0 world. How are the curtains lifting and virtual worlds becoming the linking the space between social media, and online gaming?

Rob Smart: Virtual Worlds that allow user created content and the association of behaviour to that content via scripting put themselves forward as the ideal platform to combine realtime social interaction with existing Web 2.0 tools. The data and function out there currently on Web sites can serve to augment the real-time social interactions. For example enhancing/enabling cross cultural communication with chat translation (example my translation HUD from wayback in 2006).

Another example is augmenting personal spaces with flickr images, video etc. In many flash room based Virtual Worlds this level of integration exists. However without the ability of the users to create their own gadgets and gizmos the pressure is on the development team to innovate and give users what they want, tough to do in the long term. A blended approach is to open APIs and content creation to registered developers.

Rob Smart: When you’re integrating any system with another it becomes so much simpler if the creators have provided,  services and APIs for external systems to interact with. It becomes even easier if those system entry accept/give inputs and outputs in a common way e.g. xml/json. The same goes for both data and media.

By using common existing standards we shorten the development time taken, because if a standard is widely adopted there will be a multitude of programming language libraries for it. The existence of which means the developer can get straight onto the important task of creating the logic for their application/gadget rather than messing around trying to understand some weird data encoding method you’ve invented.

Having an Open Source platform spreads the work load around, as long as the method under which the OS software is licenced isnt too prohibitive then developers from all walks of life will contribute. Spreading that workload also leads to an increase of innovative features as people always bring their experience and interests to bear, the features they create can be shared back and others build on top of them.

If a company chooses to implement a feature they specialize in or integrate with their existing products they can sell this as an add-on, this creates a market where the base product can improve through contributions from companies making a living of the OS product, it also introduces some competition and financial incentive to the platforms well being.

People keep talking about killer apps within Virtual Worlds, the killer is that any app you do create is automatically presence enabled. The people with you can view the changing states of that application or context as and  when you do.

Rob Smart: I still think Virtual Worlds is a good term, though it is very fuzzy. If we’re talking about VWs that can be extended and integrated with web 2.0 then maybe we need to talk about Immersive Application Platforms. Yep not very catchy but probably something more people in the enterprise world would say out loud in front of their boss In addition another term that could be used is 3D Internet it conjures more of a picture of integration between the different parts of what is a vast networked system.

Tish Shute: The  original metaverse roadmap had four distinct segments Augmented Reality, and Life Logging at the pole of augmentation, and Mirror worlds and Virtual worlds at opposite corners of the pole of simulation. How are these areas coming together?

Rob Smart: There’s no reason these need to be separated, its all down to the use of the VW platform these four segments are just applications of a virtual world platform. A platform like OpenSim can merge several of these together if neccessary. For example the Publish Subscribe messaging module written about on eightbar that I created lets me do things like bring in Realtime Flight data and show planes positions etc. across a region I could at the same time call an API that gives me more details on that flight. I could even search for blogs that mention that flight number and bring them into the same space. I could add additional script functions to the plane objects so that when a visitor clicks on a plane it thereafter sends them messages about its position.

Tish Shute: Virtual worlds are being broken down to open source basics building blocks and modules that can be mixed and matched and mashed up with Web 2.0 to create a new ecosystem that enriches both what has been know as virtual worlds and traditional web environments. What kind of innovation do you see coming out of these new opportunities to mashup virtual worlds with Web 2.0?

Rob Smart: I’m hoping to see as a number one priority an increase of accessibility, despite a number of people saying that browser based virtual worlds aren’t worth the effort they certainly are. The ability to just send a friend a URL or Instant Message etc.. and pull them in with you is an important step to adoption. As are simplified interfaces that don’t scare off those unfamiliar with gaming. An example of this is the Lotus Sametime 3D work with OpenSim that lets you invite a friend or colleague in via an instant message.

Virtual Worlds For Enterprise: A Coming of Age Party?

As Ian mentioned I did think that the London Conference was a coming of age party for enterprise virtual worlds. In the picture below there are just some of the Lindens who were there, many to promote the Linden Lab collaboration with Rivers Run Red on “Immersive Work Spaces” which was written up in Wall Street Journal. Also see this post yesterday on Silicon.com, “Virtual Worlds Set For Second Coming.”

Someone please help me with the all the names of the Lindens in the picture below!  Matt Furman from Northrop Grumman is center and Joey Seiler from Virtual World News is on the right.

Justin Bovington said to me that this conference was in his view: “the enterprise virtual worlds coming out party – an acceptance that this is a tangible solution- about selling relevant tools and relevant ROI – rather than talk about virtual worlds it is about relevant tool sets.”

And, while the conference was small, I think the engagement level of the enterprise attendees did back up this assertion of Justin’s. Matt Furman, Software Engineer, Northrop Grumman was asked by more than one attendee how he was dealing with scaling up the behind the firewall virtual world he is developing for Northrup Grumman with Linden Lab to meet a big demand internally to start using virtual worlds for collaboration.  Apparently some attendees were seeing so much interest in virtual world solutions for internal collaboration in their own companies, they were concerned about meeting the needs of thousands of employees in short order.

Immersive Work Spaces

I asked Justin a few questions about Immersive Work Spaces while waiting for an elevator!

Tish Shute: And what are the relevant tool sets from your point of you?

Justin Bovington: Collaboration, sharing, integration of existing backend systems and applications.  For example, we have developed seamless ways to share powerpoint or share screens. And, also going back down to the ROI models as well,  tangible ROI based on subscription based system where basically in four or five usages it has paid for itself. We have never had that with Virtual Worlds. It has always been in the bounds of experimentation or the bounds of isn’t it cool technology. Now we are seeing this become a serious collaboration tool.

And as I have said before that argueably the twentieth century ended two weeks ago and the twenty first century is now with us.  And that is about companies rengineering their thinking particularly in the financial sector they have to restart again. And that is going to be about  using additional tools and additional guide lines to do that. This is the change over and I have said this in the panel as well. This show in particularly is enterprise virtual worlds coming out party.

And again we see a massive change between the last three shows – there is a level of interest we have never seen before and also an acceptance that this is a tangible solution not just something that is cool…

We have hundreds of users in out product and it will go  to thousands and tens of thousands in the next year.

And we know where it is going – data visualization is going to be the next big thing and getting this 10,000 ft view of your company. We are using this term called snow globing which lets you pick up a snow globe and shake it and let you see exactly what a company is about and this is exactly what virtual worlds are about.

It’s about having a ten thousand foot view of your company because that’s when it becomes powerful because then it becomes a broadcast medium. And I think it will change people’s perception of data. And it is also moving to beyond just having the avatar as the main presence. The environment itself becomes an essence or a kind of dynamic level that is inside there. We are working on stuff at the moment that allows you have direct influence on data or the environment you are in which on a massive collaboration scale could actually give you a huge amount of input and ideas around company. And there is a genuine need to have this kind of collective intelligence.

Sine Wave Dinner!

The grand finale for me was the excellent Indian meal very generously hosted by Rohan Freeman of Sine Wave Company. Standing on the left is Chris Collins, Linden Lab, seated left front is, Steve Spangaro, bigpipemedia, and on the right Ren Reynolds of the Virtual Policy Network. Many other metarati were there including Bruce Joy, Vast Park, Corey Bridges, Multiverse, Dave Taylor, Imperial College, Gia Rossini, Sloodle, Peter Haik, Metaversality, Adam Frisby, OpenSim, Mal Burns, and many more – please help me out with the name tagging!

The curtains are lifting between Virtual Worlds, Web 2.0, and online gaming. There are many indications of this in the news including, the rebranding of the Virtual Worlds Conf. and Expo in New York City as “Engage! Expo – 3D Web, Virtual Worlds, and Virtual Goods,” and Google’s Lively opening up an API for game development.

And, If you have been reading Ugotrade recently, you will know I have been up late several nights trying to keep up with the pace of the  OpenSim, Architecture Working Group and OpenGrid Protocol teams that are proceeding at a fast clip with their work on Web 2.0 integration for immersive Virtual Worlds (and there is still much more to write on this!).

Also, this week, there was the preview launch (the full launch is scheduled for November) of a new collaboration, “SHASPA,” between EOLUS^® One and The Serious Games Institute.  SHASPA was unveiled to a select audience of business decision makers at the Globe Theater, London on Wednesday.

SHASPA- making a “smart” world with “shared spaces.”

Oliver Goh said, “SHASPA” is a unique cooperation to bring together Virtual Worlds (OpenSim, Second Life^®), Web 2.0 Applications and the world of mobile applications….”

The pictures above show Oliver speaking (far left) and David Wortley, Director of the Serious Games Institute (SGI) at Coventry (far right), and some of the audience (center). I recognize several very important virtual world pioneers and innovators in the midst of the frey – Rohan Freeman (CEO of the Sine Wave Company), Prof Jeremy Watson (Arup), Dr Anthony Dennis (infoterra),  and Dave Taylor, Programme Lead, Virtual Worlds and Medical Media at Imperial College London.

EOLUS^® One initially started as an innovation project with the focus to develop new service oriented offerings for the real estate industry. Oliver explained to me:

The focus is on sustainable real estate, enhancing the structural and technical performance of properties which will be the first use case for SHASPA. SHASPA uses the combined power of the work done by the SGI and EOLUS One to create Smart Shared Spaces for various industries. The first use case will be in the Real Estate industry to revolutionize approaches to facilities/property performance optimization and energy management.

RealXtend harnesses OpenSim as engine for their server side development

Adam Frisby sent me the picture opening this post today.  Adam pointed out It shows:

…Realxtend just running under OpenSim rather than the forked version of OpenSim realXtend did. It’s been converted to a set of OpenSim plugins – we’re still at a semi-preliminary stage, however, we’ve got Rex avatars and a few other features now working.

Realxtend is now able to leverage the OpenSim core, and OpenSim developers can work with realXtend innovation as plugins. For more details on this modular integration see my previous post.  This modular architecture will create many new opportunities for mashups.  And the Web 2.0 integration and interoperability work that is central to the OpenSim vision will be aligned with the advanced 3D Internet layer realXtend has been building on top of it.

On their diverse and multifaceted team, RealXtend has a number of world class game developers  who have in a very short time progressed rapidly towards the goals Tony Manninen, Ludocraft, described to me back in February, “making sure the realXtend development reaches the required quality and performance standards you would expect from MMOGs.”

And as Jani Pirkola, Project Manager for RealXtend, points out:

For realXtend it means that we can have all the OpenSim development directly benefit realXtend, whether it is Web 2.0 or other features.

Web Friendly Standards for Virtual Worlds

I am off to London next week to the Virtual Worlds Conf an Expo.  But, while I am very excited to meet old and new friends there, it is disappointing to note that the open source developer communities and the interoperability and open protocol efforts of OpenSim and Linden Lab are sadly unrepresented in London.

Making virtual worlds part of the fabric of the internet and everyday computing will not happen because some arbitrary standards body pontificates on elaborate requirements and then tries to get the backing of big business to implement their standards from top down. There are many white papers on why this old fashioned way of developing standards is not applicable to the fast moving internet environment.   As David Levine, IBM, so nicely put it a while back, interoperability and standards for virtual worlds:

will emerge battered byte by battered byte from the hands of grubbie techies each with an agenda. Except on Second Life some of us are blonde, with a pert smile but yeah….

It is, in my view, unfortunate that Dr Yesha Y Sivian, Metaverse1, in his talk “Virtual Worlds State of Standards (SOS): MPEG-V, Metaverse1, Open-SIM and more” has put OpenSim in his title (and Architecture Working Group in the body of his abstract) when he does not seem to have (yet) invited anyone from OpenSim or Architecture Working Group or OGP to represent their own work.  Again, unfortunately, a panel including key industry leaders and representatives from OpenSim and Architecture Working Group did not get the opportunity to present in London because Dr Sivian’s proposal gave the conference organizers the impression there was already a “similar panel.”

MPEG-V and Metaverse 1 are Dr Yesha Sivian’s projects and they are at a very early stage of development (basically an effort to define a set of requirments and garner business support for the notion of creating so called MPEG-V standards). To have credibility, in my view, these projects need to engage with other groups that are working on standards and actually have working code, as  Architecture Working Group and OpenGrid Protocol (OGP) do.

There are some common misunderstandings about the approach of the Architecture Working Group that should be cleared up.

As key architects of OpenGrid Protocol (OGP), and the Architecture Working Group, frequently stress, OGP is a point of departure.  While its focused on the existing code of OpenSim and Second Life, the overall framework is as broad, or broader than the meteverse work.  The goal is to create a fully described set of web based protocols and formats which will do anything MPEG-V wants to do, but meshed far more fully into the web.

Metaverse1 needs to be in dialogue with the standards work that has already produced code, if they are serious about creating good standards.

Out of the Trough of Disillusionment onto the Slope of Enlightenment

It seems Virtual Worlds may have started onto the Slope of Enlightenment (see Gartner Hype Cycle).  Virtual Worlds, and immersive Virtual Worlds (in particular Second Life^® and OpenSim), continue to garner broad consumer interest. And, the ability of Virtual Worlds to deliver added value in key areas of collaboration and energy conservation is fueling a a lot of interest from education and enterprise.

While worries of depression and recession in the global economy abound, and the internet is abuzz with discussion of Joe The Plumber (as Mitch Kapor noted in Twitter: “Not since Nixon have we heard so much about plumbers”).

Nevertheless, there has been quite a steady flow of positive news from Virtual Worlds. See Caleb Booker’s roundup and  Virtual World News and check for yourself. And just in, Forbes.com post, “A ‘virtual’ Escape from Economic Pain,” After scanning my reader I checked my perception in Twitter and quickly got replies from Mitch Wagner of Information Week.

@MitchWagner – while you didn’t find any negative stories have you seen an increase in positive stories in mainstream media? about 13 hours ago from web in reply to MitchWagner

Recents News Events of Note

The coming of age of Open Source Virtual worlds is attracting some mainstream attention now.  One of the leading authorities on Open Source Software and Services,  OStactic has several recent posts on OpenSim and Open Source Virtual Worlds. And, of course, I was thrilled that Ugotrade got a mention in the most recent one, Open Source Virtual Reality Spreads Out.