Google Street View Hacking

This Google Street View Hack (via @timoreilly) will get my nomination for a Hacking the World Award this year, if there is such an award.

A parade (the screenshot opening this post), a marathon, a mad-scientists laboratory, a sword fight, and more (see The Infonaut Blog) were staged all along the route of the Google Street View truck by artists Robin Hewlett and Ben Kinsley working in conjunction with the local community and Google Street View.

The Google Street View Hack suggests at a myriad of possibilities for anyone with their eye on the prize for a great world hack for 2009.  In my mind’s eye, I imagine the Google Street View truck’s trek across the planet triggering local environmental street action carnivals wherever it goes.

Local energy conservationists, “passive house” architects, retrofitters, could turn the arrival of  Google Street View into an occasion to create projects for a sustainable future – a traveling StreetCamp (see my post on HomeCamp ’08 here).  As Google Street View intends, surely, to go everywhere,  this would be a global hack for sustainable living that crossed the bounds of the physical and the virtual.  And the vast public record of Google Street View would became a generative engine and global resource for sustainable living.

Working together on the noble aim of sustainable living

- this is my (and many other people’s) big theme for 2009.

A Hacking the World award should also go to  Pachube – “patching the planet” – for demonstrating that instrumenting the world is not merely a Sci Fi  fantasy anymore.  By facilitating “interaction between remote environments, both physical and virtual,”  Pachube demonstrates (see diagram here) how we have only just begun to dip our toes into the many new opportunities we have to work together to save energy, rethink our culture of consumption, and to reboot our failing economy under a new sustainable operating system.

Energy awareness unlike the glut of information we have in entertainment and games suffers from a dearth of information. We really have very little idea about what we are consuming and the waste we are producing.  So more Hacking the World Awards should go to projects like AMEE – creating the world’s energy meter, and Wattzon – your personal energy meter, for giving us new ways to understand and work with energy data.

Many people and organizations, given the information, will change their behaviours. But the cultural changes necessary for sustainable living are deep and old habits die hard (see this disturbing report on the recent return to SUV buying in November as soon as gas prices fell!).

A  Small Community of Volunteers Can Bring Change on a Global Scale

Picture above by Benjamin Ellis, “HomeCamp – The Throng,” from his Flickr stream.

One of my favorite “instrumenting the world” projects to date and another top contender for a Hacking the World Award is HomeCamp ‘08 (see my previous post).  HomeCamp brings together a community of creators and enthusiasts of  “smart stuff,” creating a wikiculture for the noble cause of sustainable living.

The key to whether “instrumenting the world” empowers people and changes our lives for the better will be the capacity our systems of instrumentation have for what Jonathan Zittrain in “The Future of the Internet: And How To Stop It:,” defines as generativity, i.e.:  “the system’s capacity to produce unanticipated change through unfiltered contributions from broad and varied audiences” ( Zittrain, 2008).

Generativity is the “secret sauce” that makes the difference between, for example, Wikipedia and its all but forgotten predecessor – the “written by experts” Nupedia.

Jonathan Zittrain writes:

Wikipedia stands for more than the ability of people to craft their own knowledge and culture.  It stands for the idea that people of diverse backgrounds can work together on a common project with, whatever its other weaknesses, a noble aim - bringing such knowledge to the world. (p.147)

At Web 2.0 Summit, Jonathan Hochman (Known as Jehochman on Wikipedia), shared with me his insider perspective as a Wikipedia administrator. The full interview with Jonathan is later in this post.

Jonathan comments on the role of wikiculture in sustainable living:

“Sustainable Living requires everything to become more efficient. Incentives need to line up with conservation priorities. This requires a radical change to the way we govern ourselves. Command economies, whether commanded by politicians or capital, lead to huge inefficiencies.”

And surely, if we have learned anything in 2008, we have learned that very bad things happen when the complex systems of modern life are left in the hands of a few people motivated solely by the urge to make profit.

Hacking Design and Planning Processes for Real Estate and Transportation with Virtual Worlds

This great machinima by Azwaldo Vilotta shows the progress so far on the Wikitecture 4.0 project, ‘Re-Inventing the Virtual Classroom’ for the University of Alabama.

Though still a niche market Virtual Worlds are growing at a steady pace.  As I mentioned in my previous post, energy hungry avatars themselves will be a target for optimization in 2009.  But as my personal power usage breakdown from Wattzon shows, cutting down the amount of flying I do in 2009 would be far more effective in reducing my carbon footprint than deciding not to log into Virtual Worlds!

Note: Read Write Web’s recent post, “Report Enterprise Virtual Worlds More Effective Than Web Conferencing.  Also check out Web.Alive, and Immersive WorkSpaces and Dusan Writer’s post on “ThinkBalm,The Immersive Internet and Collaborative culture,”

My friend Melanie Swan points out in her Top Ten Computing Trends for 2009, that Virtual Worlds not only have the power of the 3 Cs (communication, collaboration and commerce) but they are fast expanding into rapid prototyping, simulation and data visualization.

My Hacking the World, 2008, Awards for Virtual World innovation would go to three potentially world changing projects for sustainable living:

1) Studio Wikitecture, (see “Reinventing the Virtual Classroom” for The University of Alabama).

2) Oliver Goh’s work on “The Path to Sustainable Real Estate.”

3) Encitra, a company recently co-founded by Crista Lopes and Christer Lindstrom focused on improving urban planning processes, starting with transportation, using virtual worlds (see my previous post here for more).

The latter two projects are being developed in OpenSim – the open source project that should also get a Hacking The World Award for creating an open modular architecture for virtual worlds that is unleashing all these new possibilites for integrating physical and virtual worlds.

The 2008 code contributions to OpenSim of special note re world hacking are Crista Lopes’ OpenSim Hypergrid – see Justin CC’s blog for full details on “What is the hypergrid?,” and David Levine’s work (IBM), in collaboration with Linden Lab (see Architecture Working Group), on interoperability (see my earlier post here).

Both these projects expand the frontiers of interoperability for virtual worlds although they “slice the problem from different ends,” as David Levine put it.  The emphasis in the LL/IBM approach is on security so assets are not moving yet.  In Crista’s solution you can have assets but the security issues are not addressed yet. But this work is vital to expanding the usefulness of virtual worlds and both projects should get Hacking the World Awards IMHO.

I asked Jon Brouchoud (full interview upcoming) what he thought were Studio Wikitecture’s most important successes to date:

“I think the greatest success has been in proving, on some level, that everyone has important knowledge that can inform and improve the design of a building, not just architects.  If we can continue building on that success, I hope we can eventually start to hack the traditional design process, and find ways to harness the wealth of knowledge held by the general public, instead of ignoring or avoiding it, as is most often the case.”

Harnessing the “Smart Stuff” to the Noble Cause of Sustainable Living

Robert Scoble’s, The Interview of the Year: Tim O’Reilly, is not to be missed. Tim O’Reilly discusses the key trends for 2009 that are bubbling up at O’Reilly Media.  And, Yes, Tim O’Reilly, as the guru of Hacking the World, gets the “Distinguished Thinker – Hacking The World Award of 2008!”

Tim O’Reilly’s trend list includes:

1) big data- vast peer produced data bases in the cloud accessible by mobile devices

2) “smart stuff” – sensors and robotics and hacking on stuff for fun and not for profit

3) Green Tech

4) Advances in Biological/Life Sciences.

And, in Robert Scoble’s interview, there is a nice titbit of history re his attendance of early Foo Camps.  Foo Camp is the wiki of O’Reilly conferences and a lineage holder to my favorite Hacking the World event of 2008, HomeCamp ‘08.

But what will be the “secret sauce” for these big ideas  – the generative engines that harness to the noble cause of sustainable living these vast peer produced data bases and all the creative “smart stuff” hackers across the globe are creating?  What will motivate the mass adoption of Green Tech and sustainable living?

What can Wikipedia teach us about how generative systems and bottom up approaches can change the world?

Jimmy Wales (interview coming soon!)  writes in his recent personal appeal for support for Wikipedia.

At its core, Wikipedia is driven by a global community of more than 150,000 volunteers – all dedicated to sharing knowledge freely. Over almost eight years, these volunteers have contributed more than 11 million articles in 265 languages. More than 275 million people come to our website every month to access information, free of charge and free of advertising.

To answer questions on a how to create a successful wikiculture for sustainable living, an insider’s view of Wikipedia may be a good place to start.

Interview With Jonathan Hochman on Wikipedia.

The picture on the left is from the Wikipedia article, Gamma-ray Burst, that Jonathan Hochman is currently working on.  It is a drawing of a massive star collapsing to form a black hole. Energy released as jets along the axis of rotation forms a gamma-ray burst. Credit: Nicolle Rager Fuller/NSF

The picture on the right, Jonathan at Web 2.0 Summit, is taken by me. Jonathan was part of the, Defending Web 2.0 from Virtual Blight, panel.

Known as Jehochman on Wikipedia, he serves as an administrator and as a leader in addressing online harassment, disruption and sock puppetry. He is also the founder of Hochman Consultants, an Internet marketing consultancy, and the director of Search Engine Marketing New England, a regional conference series.

Tish: Second Life and Wikipedia are the two great experiments in collaborative co-creation what do they have to teach us about the future of the internet?

Jonathan: Yes, Wikipedia and Second Life are key social spaces.  Some people have been seeing Second Life as the beginning of Web 3.0 – a wrap around environment where you can almost experience another life. Wikipedia is sort of another example of this.

All the problems that exist in the real world are mirrored right into that little universe.  For example, the Armenians and the Turks are at each others throats and the Japanese and the Koreans are going at it, the Palestinians and the Israelis, and the “Troubles”  … all the conflicts are imported into Wikipedia.  People are fighting over the content of these articles. They want to have it their way because these are first ranked in Google and they have a big impact in public opinion.

There was a huge fight on the waterboarding article a while back. Some guys from Little Green Footballs – they are a very conservative reactionary type of media. They are trying to change the article to say that water boarding might not be torture – change it to say it is probably not so bad.  Crazy stuff. They were trying to water it down.  And it is very clear, from every source out there, that waterboarding is torture.  We did a study and there are 115 sources that say waterboarding is torture. You simulate drowning – you simulate killing someone – that is a violation of the Geneva Convention and everything else. People were fighting, fighting, fighting!

One of the things I did was to try and clear people out who were being disruptive.  We actually had to go to arbitration over that article. It is like the supreme court of Wikipedia. There is a panel of 15 arbitrators.  They hear the case. There is evidence, arguments and decisions. It is really like a simulated law suit. You get all the experience of a simulated law suit with the real threat that you could be banned. If they don’t like what you are doing they can actually ban you or restrict you from topics.

So it is really fascinating how this social space Wikipedia becomes a very real platform though it is in a virtual world for real world disputes.  Most disputes are over the definition of things.  If you have a you suit most disputes are about how things are defined. And Wikipedia has become the defacto definition of things in the real world.  People want to know what are “The Troubles.”  If you go to Wikipedia you find out  The Troubles are a dispute over Northern Ireland.  What the article says has a profound impact on public opinion.

Tish: So who is on the court of Wikipedia?

Jonathan: They are volunteers. these people work two or three hours a day to run this court.  There are all kinds of projects.  There is a WikiProject Spam which has people who can write computer programs to statistically analyze Wikipedia projects – not only Wikipedia. But all of them are looking at the links and reporting them and banning those people who are abusing or gaming the system.

Tish: You were on the Stopping Virtual Blight Panel at Web 2.0 Summit – what are the most important things to think about on this topic?

Jonathan: Yes we were talking about how to defend the web against virtual blight. The thing I find interesting about Wikipedia is that because it is the eighth largest web site and possibly the second largest web site comprised of user generated content after YouTube. The problems that exist in Wikipedia are larger and more detailed than any other site.  For whatever problem someone has for their social media site or their Web 2.0 site these problems already exist in Wikipedia and the solutions are there and they are transparent. You can actually see the history of what’s been done.

If there is, for example, a problem on Digg – some problem with sock puppetry or vote stacking – it happens, it goes away.  You don’t get full disclosure.  With Wikipedia you can actually go in and look at a dispute and watch it unfold.  You can watch the arbitration cases that are filed, the arguments, the decisions, the logic, the rationale.  You can see the successes and the failures and the different things people have tried to control blight. For example, we tried to resolve this dispute one way but it was a disaster, so we have tried something else and that worked.

Wikipedia is a large laboratory for social media. Wikipedia and the large universe around it Wiki and WikiMedia projects that individuals, enterprises and put together like Commons.  Wikimedia Commons is a repository of publicly licensed images that anyone can take and reuse. They have sound and they have video, and all of this stuff is being stitched together now.

So if you go to the article on Obama  you can probably now hear his acceptance speech because that is public domain – its been stitched into the article.  If you go to the article on Richard Nixon – his resignation speech – you may even hear his conversation with the astronauts when they landed on the moon.  So this becomes a giant repository of all our culture and knowledge.  When I design a website, a lot of times I go to Commons to find images I use for free.  I don’t want to pay for an image I can get for free. 

Tish: And the Commons images get contextualized in Wikipedia too.

Jonathan: Some of these articles are fascinatingly detailed. If you want a quick summary of the Dr. Strangelove, the article is fantastic.  It is enjoyable, a pleasure to read.  I was reading about S.A. Andree’s North Pole balloon expedition of 1897. Some guys from Sweden decided to fly a balloon over the North pole.  They managed to get aloft then they flew over the icepack for 24 hrs then they crashed.

They unloaded their stuff and hiked back across the ice toward the island they had launched from. They ended up being on the ice pack for three months before they finally holed up in an ice cave and starved to death.  There weren’t found until thirty years later!  There was a camera with these guys and the frozen pictures taken 30 yrs earlier.  They developed the film and those pictures are now on Wikipedia.  It is just a fascinating thing!

Tish: Do you see real time collaboration beginning to play more of a role in Wikipedia – whether virtual worlds or just voice/IM — how could real time collaboration change the wikipedia editing process?

Jonathan:  The Presidential candidate articles were being edited very rapidly yesterday. There are certain real time problems.  Some of the more interesting problems are when you get two administrators who “get into it.” One administrator says I am blocking this user and the other one says I am unblocking him, and the other one “NO I am blocking him!” And so on…… And everyone says, “Stop fighting. You are not allowed to do that!” And they both get their powers stripped. People do get very heated over the silliest things. Wikipedia does have some mailing lists attached and there are some IRC channels. So there are some real time elements.

Tish: What is the role of avatars in Wikipedia?

Jonathan: In Wikipedia you have a user page and many users are anonymous.  They create an avatar and they personalize it and show themselves in ways they want to show themselves through an avatar. In many ways it is a lot like Second Life.

Some users have created second accounts – or a humerous second account. Bishzilla – a Swedish lady who is in tremendous command of the English language and has a razor sharp wit.  She has created this secondary account – almost like in a baby language.  Her avatar is a dinosaur that is not very bright that goes around frying people. Bizarre what people do! People may be editing a topic like an interest they have – e.g. Pokemon that they don’t want associated with their professional avatar. Or people may be editing a topic about hot political issues.  There have actually been some death threats issued to people over stuff they have been putting into the encyclopedia.

Tish: So avatars are important in Wikipedia.

Jonathan: Absolutely because people may be going in and editing articles that they may not want their friends and family to know they are editing.  One editor may say to another, “Stop putting stuff in or I will come and kill you!” Well then we have to ban them.  We have to call the police.

Tish: Can you build reputations on multiple avatars?

Jonathan: You are allowed to use multiple avatars as long as they don’t cross paths.  You can’t have two avatars editing in the same area beacuse you are going to be giving yourself double weight commenting on a discussion.


Tish: How do you know when this is happening?

Jonathan: You can watch the style of a users editing.  You have to watch behavior.  And if you have enough evidence through behavior that suggests accounts are controlled by one person you can go and request a technical check.

There are some uses who are called Checkusers who are able to access information desired from the server logs and check the technical characteristics of these accounts to see if they are using the same IP address.

Tish: So if you want to understand avatar interaction on the web it helps to understand Wikipedia.

Jonathan: Yes it is a fantastic way to understand how avatars work in some aspects, and also how to deal with community dynamics.  We have some very strong willed people – people in their 40s, 50s, and 60s – who are very successful in business.  They have plenty of money and spare time and they are doing this as a hobby. And some of these people can really butt heads.  You can have a problem when you have an editor who has been writing fantastic articles but also happens to be rude and chew other people out and tell them to f**k off if they are not behaving. What do you do?

Tish: Sounds a bit like Second Life!

Jonathan: The person is a great contributor to the community but they are telling noobies to f**k off, so you can’t allow that.

What do you do?  Vested contributors are a major problem to some of these sites. They are vested in the community but they start misbehaving. You can’t block them, because if you block them there is a huge upsroar from all their friends and it causes a cataclysm.  It requires very careful diplomacy to deal with some of these situations.

Tish: How many Wikipedia volunteers are there now?

Jonathan: Think of a Venn Diagram – a big circle. The total number of contributors are about one million different people that contribute.  But there are probably about 5,000 active editors  that are consistently and regularly contributing.  And within that kernel there are fifteen hundred people that have administrator access and probably only eight hundred of them are active.  People have a natural life span with the community.  People come an typically stay for 6 months to 3 years.  Usually after that they become bored, disillusioned or get into a conflict with someone.  There is a natural tendency for people to stay for a while and move on. Some people stay longer, a few, but the majority will move on at some point.  So it is a lot of fresh faces moving in.

Tish: What lessons of trust does Wkipedia have to teach us about new projects like AMEE that aims to aggregate the world’s energy data?

Jonathan: Well you have to know who is releasing the data. Who is creating the data? The beauty of Wikipedia is that you have an edit history so you can see exactly who has done what.  So you can judge whether this person is trustworthy or not.  That’s a huge problem on the web today.  We don’t have enough identification information.  When you see a web page you don’t necessarily know when that page was created and by whom, or how many revisions it has had.  Sometimes you can glean information by checking it.  If you see typos and errors you may decide that that page probably didn’t receive as much attention as it should have, and probably it is not that good.

Typos are an interesting thing.  People always try to figure out how Google ranks web pages. Matt Cutts was here from Google today.  And he was talking about spam.  But Matt also did a blog post about how he was in an airport once, and how he has a policy – when you are reading a document as soon as you come to the first error just stop because if the author hasn’t taken the care to make everything correct, you don’t need to read it. So he was in the airport, there was a sign, he came to a typo and stopped reading it. Somehow he got in trouble for not reading the sign and not having the information.  But it is interesting to think whether Goggle is looking for for typos, misspellings, broken links and using that as a signal of quality to rank pages.

Tish: Aaaagh typos might bring down your page rank!!!  That certainly is a scary thought for a blogger like me who likes to write impossibly long posts that are hard to check………

The curtains are lifting between Virtual Worlds, Web 2.0, and online gaming. There are many indications of this in the news including, the rebranding of the Virtual Worlds Conf. and Expo in New York City as “Engage! Expo – 3D Web, Virtual Worlds, and Virtual Goods,” and Google’s Lively opening up an API for game development.

And, If you have been reading Ugotrade recently, you will know I have been up late several nights trying to keep up with the pace of the  OpenSim, Architecture Working Group and OpenGrid Protocol teams that are proceeding at a fast clip with their work on Web 2.0 integration for immersive Virtual Worlds (and there is still much more to write on this!).

Also, this week, there was the preview launch (the full launch is scheduled for November) of a new collaboration, “SHASPA,” between EOLUS^® One and The Serious Games Institute.  SHASPA was unveiled to a select audience of business decision makers at the Globe Theater, London on Wednesday.

SHASPA- making a “smart” world with “shared spaces.”

Oliver Goh said, “SHASPA” is a unique cooperation to bring together Virtual Worlds (OpenSim, Second Life^®), Web 2.0 Applications and the world of mobile applications….”

The pictures above show Oliver speaking (far left) and David Wortley, Director of the Serious Games Institute (SGI) at Coventry (far right), and some of the audience (center). I recognize several very important virtual world pioneers and innovators in the midst of the frey – Rohan Freeman (CEO of the Sine Wave Company), Prof Jeremy Watson (Arup), Dr Anthony Dennis (infoterra),  and Dave Taylor, Programme Lead, Virtual Worlds and Medical Media at Imperial College London.

EOLUS^® One initially started as an innovation project with the focus to develop new service oriented offerings for the real estate industry. Oliver explained to me:

The focus is on sustainable real estate, enhancing the structural and technical performance of properties which will be the first use case for SHASPA. SHASPA uses the combined power of the work done by the SGI and EOLUS One to create Smart Shared Spaces for various industries. The first use case will be in the Real Estate industry to revolutionize approaches to facilities/property performance optimization and energy management.

RealXtend harnesses OpenSim as engine for their server side development

Adam Frisby sent me the picture opening this post today.  Adam pointed out It shows:

…Realxtend just running under OpenSim rather than the forked version of OpenSim realXtend did. It’s been converted to a set of OpenSim plugins – we’re still at a semi-preliminary stage, however, we’ve got Rex avatars and a few other features now working.

Realxtend is now able to leverage the OpenSim core, and OpenSim developers can work with realXtend innovation as plugins. For more details on this modular integration see my previous post.  This modular architecture will create many new opportunities for mashups.  And the Web 2.0 integration and interoperability work that is central to the OpenSim vision will be aligned with the advanced 3D Internet layer realXtend has been building on top of it.

On their diverse and multifaceted team, RealXtend has a number of world class game developers  who have in a very short time progressed rapidly towards the goals Tony Manninen, Ludocraft, described to me back in February, “making sure the realXtend development reaches the required quality and performance standards you would expect from MMOGs.”

And as Jani Pirkola, Project Manager for RealXtend, points out:

For realXtend it means that we can have all the OpenSim development directly benefit realXtend, whether it is Web 2.0 or other features.

Web Friendly Standards for Virtual Worlds

I am off to London next week to the Virtual Worlds Conf an Expo.  But, while I am very excited to meet old and new friends there, it is disappointing to note that the open source developer communities and the interoperability and open protocol efforts of OpenSim and Linden Lab are sadly unrepresented in London.

Making virtual worlds part of the fabric of the internet and everyday computing will not happen because some arbitrary standards body pontificates on elaborate requirements and then tries to get the backing of big business to implement their standards from top down. There are many white papers on why this old fashioned way of developing standards is not applicable to the fast moving internet environment.   As David Levine, IBM, so nicely put it a while back, interoperability and standards for virtual worlds:

will emerge battered byte by battered byte from the hands of grubbie techies each with an agenda. Except on Second Life some of us are blonde, with a pert smile but yeah….

It is, in my view, unfortunate that Dr Yesha Y Sivian, Metaverse1, in his talk “Virtual Worlds State of Standards (SOS): MPEG-V, Metaverse1, Open-SIM and more” has put OpenSim in his title (and Architecture Working Group in the body of his abstract) when he does not seem to have (yet) invited anyone from OpenSim or Architecture Working Group or OGP to represent their own work.  Again, unfortunately, a panel including key industry leaders and representatives from OpenSim and Architecture Working Group did not get the opportunity to present in London because Dr Sivian’s proposal gave the conference organizers the impression there was already a “similar panel.”

MPEG-V and Metaverse 1 are Dr Yesha Sivian’s projects and they are at a very early stage of development (basically an effort to define a set of requirments and garner business support for the notion of creating so called MPEG-V standards). To have credibility, in my view, these projects need to engage with other groups that are working on standards and actually have working code, as  Architecture Working Group and OpenGrid Protocol (OGP) do.

There are some common misunderstandings about the approach of the Architecture Working Group that should be cleared up.

As key architects of OpenGrid Protocol (OGP), and the Architecture Working Group, frequently stress, OGP is a point of departure.  While its focused on the existing code of OpenSim and Second Life, the overall framework is as broad, or broader than the meteverse work.  The goal is to create a fully described set of web based protocols and formats which will do anything MPEG-V wants to do, but meshed far more fully into the web.

Metaverse1 needs to be in dialogue with the standards work that has already produced code, if they are serious about creating good standards.

Out of the Trough of Disillusionment onto the Slope of Enlightenment

It seems Virtual Worlds may have started onto the Slope of Enlightenment (see Gartner Hype Cycle).  Virtual Worlds, and immersive Virtual Worlds (in particular Second Life^® and OpenSim), continue to garner broad consumer interest. And, the ability of Virtual Worlds to deliver added value in key areas of collaboration and energy conservation is fueling a a lot of interest from education and enterprise.

While worries of depression and recession in the global economy abound, and the internet is abuzz with discussion of Joe The Plumber (as Mitch Kapor noted in Twitter: “Not since Nixon have we heard so much about plumbers”).

Nevertheless, there has been quite a steady flow of positive news from Virtual Worlds. See Caleb Booker’s roundup and  Virtual World News and check for yourself. And just in, Forbes.com post, “A ‘virtual’ Escape from Economic Pain,” After scanning my reader I checked my perception in Twitter and quickly got replies from Mitch Wagner of Information Week.

@MitchWagner – while you didn’t find any negative stories have you seen an increase in positive stories in mainstream media? about 13 hours ago from web in reply to MitchWagner

Recents News Events of Note

The coming of age of Open Source Virtual worlds is attracting some mainstream attention now.  One of the leading authorities on Open Source Software and Services,  OStactic has several recent posts on OpenSim and Open Source Virtual Worlds. And, of course, I was thrilled that Ugotrade got a mention in the most recent one, Open Source Virtual Reality Spreads Out.

This post, and my previous post about integration of OpenSim into Web 2.0, explore how immersive virtual worlds, through a full architectural integration into Web 2.0, will become part of the fabric of everyday computing.

The diagram above shows where OpenSim sits in Web 2.0 (click on the diagram to see a readable enlarged version!). The following interview with OpenSim developer, Teravus Ousley, describes some of the work being done to create documented protocols that will make OpenSim fit seamlessly into Web 2.0 architecture.

OpenSim is in the news a lot these days, explicitly as in the case of the announcement last week by 3Di of their “3Di OpenSim” Standard (for more see here and here), and implicitly with the launch of ChinaQ.  Adam Frisby, OpenSim, pointed out to me if you download the ChinaQ client that it is based on OpenSim, it connects nicely to OSGrid too. There is speculation the client is a rebranded version of the realXtend viewer (which is based on the open source Second Life viewer) as all the version numbers are the same.

So OpenSim is not only attracting the interest of business giants like IBM, Microsoft and Intel, it is becoming the architecture of choice for virtual world initiatives from Chinese and Japanese telecoms (see here and here for more). Also, see the press release about Nokia and the City of Oulu, Finland, joining as supporters of realXtend.

But, as Raph Koster in his post commenting on 3Di’s OpenSim announcement notes, the question how immersive virtual worlds can go from strong niche or enterprise markets to mass adoption in consumer markets must be answered.  As Raph points out, Lively, Whirled, SmallWorlds, Vivaty, and yes, Metaplace have a very different architecture that they hope will attract broad consumer markets.  (I did a long interview with Raph on this at The Virtual Worlds Conference and Expo in LA which I will post as soon as it is transcribed, so more on this soon!).

Architectural integration into the heart of Web 2.0, I would argue, is the key to mass adoption for immersive virtual worlds. While architecture alone will not guarantee the necessary breakthroughs in usability for widespread consumer adoption, it will create the ideal conditions for the innovation through which usability obstacles will be overcome, and the enormous potential for immersive, real time interaction over the internet will be realized.

Interview with Teravus Ousley

Tish: What has been  the most fundamental problem re virtual world architecture that has kept immersive virtual worlds isolated from web 2.0 to date? 

Teravus: a lack of standardization, licensing issues, and the difficulty of entry into the industry.

1) Standardization

Tish: In order of importance what in your view are the priorities for standardization?

Teravus: Probably the same order that OpenSimulator was tackled in, basic connect (current state of OGP – Open Grid Protocol).  Basic Service (interaction standards).  Advanced connect/mashup/aggregate extensions.   Preferably people will have working code in the various spaces there to use freely under various licenses..

Tish: Can you show me where OpenSim will fit in this drawing of Web 2.0 architecture? [Teravus makes some modifications on the drawing I send him from Dion Hinchcliffe’s presentation from his Web 2.0 Expo workshop, see original here]

Teravus: The modified diagram [now opening this post] is a great view of how it will look.

Tish: Why is the TCP stream left out of the original drawing? [For more about Transmission Control Protocol (TCP) is one of the core protocols of the Internet Protocol Suite see here.

Teravus: It is left out because the person who made this diagram had web pages in mind.  Static large files, or small changing files. In the the drawing the fact that TCP streams are smaller then HTTP is on purpose.

Tish: I have heard different opinions on the percentage of the communications for virtual worlds that can be done over HTTP?

Teravus: The fact is that the biggest usage of communications in virtual worlds is transmitting images that’s the number one bandwidth usage. So, if we’re counting by ‘usage’ I say 91%.   If we’re counting by services that use http.   I say probably 75%  I definitely think that http should be evaluated for use on new things ‘first’. But, there are a few places where HTTP doesn’t shine.

I am skeptical about replacing things in the UDP with HTTP  thinking that they’ll ‘perform better. [For more about User Datagram Protocol (UDP) another of the core protocols of the Internet Protocol Suite see here.]

I think there’s been a huge test going on now and for the last 5 or six years with regards to the UDP protocol and it really has performed admirably.   In the last year and a half, I’ve seen attempts to convert several things to HTTP that have failed, and failed somewhat spectacularly sometimes.  In the end the items get reverted back to the UDP protocol. One such item that sticks out in my mind is CAPS(HTTP) based inventory retrieval. The capability to do that in the client has been available since before February. And, it’s been turned on and off on ‘Agni’ at least once in the process. Additionally, we (OpenSimulator) enabled http inventory, and, the  inventory failures rose pretty steeply.

I think some services are really just not ‘right’ for HTTP.. . particularly where a ‘poll’ methodology is used, or, the data is significantly dynamic enough that it makes caching useless.

Anyway, as far as the future is concerned, I do want to see some services over HTTP. Other services, it would be more appropriate to have a TCP stream. Stock market data, for example, uses a TCP stream. The Scalability of the stock market, is just one example of a scalable TCP stream.

Tish: So you see TCP  as the communications protocol that would do the work for the parts of virtual worlds not suitable for HTTP. At least that is how you have shown it in our Web 2.0 architecture drawing. But should there also be a UDP stream?

Teravus: For the virtual world of tomorrow? .. probably not.

Tish: Why not?

Teravus: You have less control over the quality of service when it’s delivered over UDP then TCP.

Tish: What is the exact relation between TCP and UDP.  My understanding is UDP a lower level protocol.

Teravus: TCP offers guaranteed delivery through flow control, while UDP does not.  One of the failures of UDP, is the ‘resend’ technology we’ve put on top of it to try and make it reliable.   TCP does this automatically and better then we could at a lower level but it does also cost up to twice the bandwidth depending on what is being sent. HTTP is a layer on top of TCP.

Tish: So just like the HTTP/TCP discussion there has to be a TCP/UDP boundary discussion …so it is HTTP then TCP then UDP and the boundaries have to be worked on.

Teravus: Those are the orderings in my mind…  probably if UDP uses any..  it should use less then 0.5%.

Tish: And the current Second Life architecture what does it use if it isn’t using HTTP? [to see the work of the Architecture Working Group on the future Second Life architecture here]

Teravus: UDP or HTTP

Tish: and TCP?

Teravus: Well, TCP is a layer under HTTP.  As far as I know, SL doesn’t use TCP streams directly

Teravus: Instead, it uses HTTP polling.  This is one of the places, that I’ve highlighted where it doesn’t shine.

Tish: Polling does sound slow?

Teravus: Polling is essentially..     (connect) Got any data for me? No?(disconnect), (connect) Got any data for me?  No?(disconnect).

Tish: So what is the path to standards for this then?

Teravus: Distilling what we know works and what we actually intend on supporting as far as adoption under these standards.

Tish: Where does MPEG-V fit in?  Have you read their document yet?

Tervavus: MPEG-V is interesting reading…     but is there any working example? I have just the overview. But I’ll read it over to have a better determination of how to ‘keep it in mind’ for the future. It looks like they’ve only really defined the requirements of the MPEG-V spec. The MPEG-V spec looks quite far reaching..  but  the documents so far are requirements and marketing talk aimed toward business people – obviously intended to get more people interested in working on them.

But I have a feeling that any format with MPEG before it will be onerous to support. ..for me it’s too early to tell. It’s quite far reaching…it isn’t anything like ’signal processing’ which the MPEG group is most famous for.

Tish: The whole top down approach of the MPEG-V initiative seems counter to Web 2.0 principles to me.

Teravus: Well, remember..  that even if there’s a virtual world format war (reference to DVD-HD vs BlueRay) we still need to win over the rest of the web.

Tish: Yes and don’t you think the way to win over the web is to use as many existing standards as possible?

Teravus: Well, it’s to use as many existing standards as ‘fit’ though.. KISS, as always (K)eep (I)t (S)imple (S)tupid if we have 30 different internet standards..     people looking at it will @.@

Tish: But it is just lack of documented protocols that has created isolation from Web 2.0?  And really doesn’t it boil down to standardizing that small percentage that is outside HTTP – the TCP and UDP stream that we talked about earlier where the real time stuff that virtual worlds bring to the web happens?

Teravus: no..  actually the HTTP standardization is just as important.

Tish: You mean even though SL used HTTP it isn’t standardized?

Teravus: Not documented specifically.

Tish: And OpenSim is that documented?

Teravus: Not well enough probably to define a standard.

Tish: Is AWG (Architecture Working Group) doing the documentation?

Teravus: working on it..

2) Licensing Issues

Tish: It sounds like some of this work has to go on across client and server.  Are we running into the issue of BSD for OpenSim and GPL for the Second Life viewer?

Tervaus: Well, some of the issue here is license choice.  One of the reasons that libOMV was able to achieve what they did was they did it /before/ the client was open sourced.

Tish: So open sourcing the client actually became an obstacle!!???

Teravus: I don’t think so in a whole.  I think it was great for the community.  I do, however think that C++ UDP stacks will be scrutinized more for GPL license violations because, of course, the client is GPL and C++ .

Tish: It is my understanding that Linden Lab is open to discussions on making the licensing more efficient for the open source community?

Teravus: Well, the client, in a whole, should not be changed as far as the license.   JUST the things that they expect people to adopt should be made more open. If they expect people to adopt PRIMs, then there should be an efficient implementation available for anyone to use..   at the very least, in LGPL format. Otherwise, the die hards are forced to re-implement them from scratch, and most people will just choose something more open.

Tish: Has anyone ever put together a list of the parts that need to be LGPLed?

Teravus: Well, I think it’s there in a few places.  There is at least one jira open on it.

Teravus: A few that come to mind for me..   is the UDP stack and the prim to mesh/UV code.   I think there are some things that can definitely be improved about the UDP Stack.  There are some things, (images come to mind), that would be better over HTTP

Tish: Do you think if the UDP stack were L GPLed that would be a significant help to integrating OpenSim better with the web?

Teravus: Well, it would certainly be adopted by more clients. GPL + (your own code) = GPL Licensed client. LGPL linked library + (your own code) = Your own license.
You still need to mention that you used LL’s UDP stack, and provide the source code for it at request.

The general client itself should remain GPL, it’s better for LL that way.  Just the items that they want people to ’standardize’ on. It would help..   if it was at least LGPL

Tish: And the value to  LL on LGPLing these parts is it helped spread their basic technology while protecting the rest of their viewer?

Teravus: It furthers their goal of standardization on their systems because it allows more people to adopt it for their own uses without worrying about GPL-ing their own client.

Tish: It is hard to standardize without access to the low level parts of the client right?

Teravus: The general population of Developers..     will want a libX that they can plug into their application for communicating.. .  libY to deal with object data..

Tish: Hence your requests for LGPL were  UDP stack and  the prim->mesh/UV

Teravus nods

Tish: and at the moment they only have openmv?

Teravus: That’s the only ‘truly’ open standard right now as far as the LL technology is concerned. OpenSimulator’s use of that data..   could also be seen as a standard..

Teravus: But we have not published anything beyond code..   neither have they  really..  technically..  but their organization of the way things work is very very clear

Tish: What are the most significant limitations of openmv?

Teravus: Probably..  just it not being in c++.   c++ has it’s benefits and it’s pitfalls.  Changes in c++ usually take longer then ones in C#.  But, of course c++ is always faster.  With libOMV It isn’t always clear about what packet is used when.  However, with some experimentation, you can figure it out in 30 minutes or less..

Usability

We didn’t spend much time discussing some of the innovation in usability that this architectural integration into Web 2.0 will enable (more to come on that!). But, Teravus mentioned one interesting use case he is working on.

Teravus: You might also stick a ‘cloud renderer’ into the graphic [Tervaus was looking at the diagram (from Dion Hinchcliffe) that opened my previous post on “Web 2.0 to OpenSim Made easy”  click on the thumbnail below].

Some people have discussed having a ‘video stream’ that’s rendered on the cloud and providing that to flash clients would be the best solution to it for them.

The cloud renderer is for organizations that have large pools of servers with GPUs so would allow for very powerful rendering. The servers can render the scenes and stream them to the low end browsers. It would allow extremely high quality rendering for really low end browsers..  such as ‘cell phones.’

Tish: Is that possible now on OpenSim?

Teravus: Nope.  But it’s something that in the future, I intend on working on. It would essentially be a video [streamed to low end browsers].

Tish: Is that different from what Vollee is doing? The mobile client for SL?

Teravus:  It appears that they are, indeed, pre-rendering the client’s view and streaming it to the mobile device