In a conversation with Tim O’Reilly and John Battelle (Federated Media Publishing) at Web 2.0 Summit 2008, Al Gore suggested that only the aggregate bandwidth of the internet could supply us with the kind of emotional intelligence we need to respond with appropriate urgency to the challenges of our times, for example, the CO2 targets necessary to avert catastrophe.

“People hear these things, and there are many other similar signals, and then the next day it’s gone. Now the neuroscientists have explanations for why that is ….. The urgency center of the brain is geared to snakes, spiders and fire and things that evolution posed as tests to our species…

But when we have to use our neo cortex to connect dots in an abstract pattern and then push that down to the urgency and fear center – that’s just a little footpath.

Its  like the internet, mostly, it’s an asynchronous connection.  There is a big connection going from the fear center to the reasoning process but just a very small pathway coming back.

It needs to be stored in the cloud. It is the aggregate bandwidth than counts. We need to have the truth – the inconvenient truth, forgive me, of this challenge stored in the cloud so that people don’t have to rely on that process and so that we can respond to it collectively.”

Tim O’Reilly responded: “Who knew you were the guru of Web 2.0 as well as global warming. You have totally outlined our premise here.”

(Photograph opening this post of the Former Vice President Al Gore on stage with Tim O’Reilly and John Battelle at  Web 2.0 Summit 2008, co-presented by O’Reilly Media and TechWeb. Produced by Good Company Communications. Photograph copyright James Duncan Davidson – see Duncan Davidson’s Flickr stream for a complete photo essay of the event.)

I was trying to find a word to express how powerfully  Al Gore addressed the Summit audience.  And I was discussing this with a legendary serial entrepreneur, Richard Titus, who is also a great admirer of Al Gore, at the closing party. Richard came up with the phrase I was seeking.  “He was totally naked,” Richard said.

Al Gore described himself as a recovering politician.  And yes, he seems totally recovered from the “woodeness” of politics and utterly at home with the “nakedness” of participatory culture.

Al Gore made clear that to change the world we have to change ourselves (he did).

Bertrand Russell is often attributed with the following quote:

The mark of a civilized human being is the ability to read a column of numbers and then weep.

Gore’s exhortation that the internet needs to be a puppy with a purpose resonated with his audience.  From climate change, global issues of health care, to rethinking global economies we desperately need to optimize our collective and individual intelligence.

Instrumenting the World: Life on the Cloud

Kevin Kelly’s  High Order Bit – a brilliant impressionist view of the internet’s next 6537 days describes what “Life on the cloud” will be like.

“If you are producing some information and it is not webized, i.e., it is online and not related and shared to everything else, it doesn’t count.”

This is already the case to some degree. And the challenge of understanding where our networked identities begin and end is with us. But Kevin Kelly points out, “life on the cloud” will heighten our dilemmas.

Nat Torkington’s presentation to the Privacy Forum in Auckland , New Zealand, “Web Meets World: Privacy and the Future of the Cloud” looks at our changing idea of identity through the lens of privacy – both “the nature of privacy” and “how expectations change over time.”  Nat cites William Gibson (interviewed by Rolling Stone on their 40th Anniversary):

“One of the things our grandchildren will find quaintest about us is that we distinguish the digital from the real, the virtual from the real.  In the future that will likely become impossible.”

The critical layer between this database of things and the ultra, mega cloud (see Kevin Kelly’s slide below) is the web of shared intelligence. This is where the transformation will emerge with its dangers and opportunities.

Brian Solis, in his excellent post, “Barack Obama, The Social Web, and the Future of User Generated Government,” proposes Zappos and their “public and transparent customer-focused culture” is a good model for how government can use the internet not only to push out its message but to create a whole new culture of participation.

Far fetched?  Watch Tony Hsieh’s High Order Bit for yourself. The idea that every interaction at Zappos has relevance to the value exchange between consumers and producers is a very interesting idea to apply to the relationship between government and citizens.

“Ecological Intelligence”

Instrumenting the World requires new models of data sharing. Last year, Cory Doctorow described to me an instrumentation model of data.

An Instrumentation model for data differs from a surveillance model of data sharing.  Instrumentation is “when you know a lot about the world,” in contrast to surveillance – “when people in authority know a lot about you”.

(Note: Mashable has an interesting post on the theme of a “instrumentation,” see:  Seventeen Killers Apps for Taking Control of Your Government:“Government is increasingly putting much of its public records online, creating opportunities for developers to build useful applications for citizens.”)

But corporate culture and governments around the world have embraced the surveillance model of data up to now.  I was fortunate to have the opportunity to ask Larry Brilliant, Google.org, a question about how the tables might get turned.  After his conversation with Tim O’Reilly,  I asked:

“What would motivate corporations and governments to participate in the kind of data sharing and transparency that could produce the changes that our world needs, particularly in the area of health and climate change? For example, why would corporations reveal the aspects of products we use and the food we eat that have negative effects on our health and our planet?” (This is more succinctly phrased than my original question!)

Larry Brilliant replied:

“I don’t know how many of you know Dan Goleman? He created emotional intelligence [quotient] – EQ. He is coming out with a book which I have just had the pleasure of reading in draft form which deals specifically with what you are talking about.

How we can have commercial intelligence. How we use the power of corporations and their various different stakeholders, including their customers to drive corporations to do the morally right thing by losing the commercial support of customers who won’t support them unless they are more green, fairer to women, respect gay and lesbian rights, do the things you would like them to do whatever that happens to be, so that you can vote with your dollars.

It is really a fascinating book:  “The Application of Ecological Intelligence to the Commercial World.”  I don’t know what the final title will wind up being but I recommend it to you.

Dan Goleman’s new book: “Ecological Intelligence: How Knowing the Hidden Impacts of What We Buy Can Change Everything,” will come out in April, 2009.

An Extraordinary Gathering At An Historic Time

Web 2.0 Summit was a brilliantly orchestrated gathering of many of the thought/business leaders and entrepreneurs who have shaped the internet as we know it today.

As my friend Jonathan Hochman, Wikipedia, said on Day 1:

“If everyone here [Web 2.0 Summit] shut down their website it would be the end of the internet!.” (See my upcoming interview with Jonathan on Wikipedia and Jon Brouchard on Wikitecture and what these projects can teach us about participatory culture).

But also in this elite crowd of “C” level execs were the next generation of entrepreneurs who are working on a hunch and prayer to create the future Web.

And this year, as the Web 2.0 Summit architects explained in their intro, the decision was made to extend the scope of the Summit even further:

“….our world is fraught with problems that engineers might charitably classify as NP hard—from roiling financial markets to global warming, failing healthcare systems to intractable religious wars. In short, it seems as if many of our most complex systems are reaching their limits.

It strikes us that the Web might teach us new ways to address these limits. From harnessing collective intelligence to a bias toward open systems, the Web’s greatest inventions are, at their core, social movements. To that end, we’re expanding our program this year to include leaders in the fields of healthcare, genetics, finance, global business, and yes, even politics.”

Truly an extraordinary gathering at an historic time – commencing the day after Barak Obama became President Elect, it seemed the causes and conditions for participatory culture and sustainable living were coming together at last!

Virtual Worlds and “The Web Beyond The Web:” Creating “A Supple Approach to Sharing Identity”

Virtual Worlds were not on the schedule.  But this is not surprising as their potential contributions to the very big problems at the heart of the Summit’s theme are only just beginning to emerge.

But new forms of  participatory culture were a recurrent theme of the Summit.  And Virtual Worlds at the high bandwidth tip of the pyramid of global connectedness and SMS at the bottom of the pyramid have a lot to teach us about participatory culture.

Crista Lopes recently co-founded with Christer Lindstrom a company, Encitra, that is focused on improving urban planning processes, starting with transportation, using virtual worlds. Christer Lindstrom has been a key evangelizer of PRT (personal rapid transit – see photo above).

Crista Lopes is Associate Professor at the University of California, Irvine, in the Department of Informatics (full interview coming soon).  Crista is using the dynamic shared viewpoint of virtual world technology to offer a way for the many stakeholders involved in a city scale transportation infrastructure change to participate in the process of planning. Crista is working with OpenSim – see the video of  “Encitra – Creating Immersive Worlds.”

There are a number of use cases for Virtual Worlds in sustainable living being developed. I have written several posts on Oliver Goh’s work,  “The Path to Sustainable Real Estate.” See my earlier posts here, and here, and IBM’s Virtual Network Operation Centers.“

Also see the recent announcement from Intel Research to create ScienceSim using OpenSim (more on this soon). Justin Rattner writes:

“Wilfred Pinfold (an Intel colleague and general chair of Supercomputing 2009) announced to the Supercomputing 2008 conference attendees plans to create a new virtual world called “ScienceSim.” Supported by Intel and the conference committee, this collaboration aims to use these immersive, connected environments to further cutting edge scientific research.”

George Jobi, Intel, writes in his post on ScienceSim: “Intel is one of the founding members of OpenSim and had been building its vision of open standards based 3D web architecture around OpenSim.”

The Achilles Heel of Web 2.0…….?

As Crista pointed out:

“The  Achilles Heel of Web 2.0 is trying to build the concept of person in a platform that doesn’t have people, at the center of the architecture. With Web 2.0 we go through a lot of hoops trying to integrate basics concepts of identity and storage onto a platform that wasn’t designed for it.”

Most of us have bits of our identity scattered all over the web, e.g., partial friends list here, there and everywhere. Some of us have literally hundreds of different log ins and profiles. Our list of applications with pieces of our identity locked up in them might look something like the slide below from the High Order Bit of Beerud Sheth, Webaroo Inc.

In contrast, Crista noted:

“The key component that a Virtual World offers you is that you can take your identity from place to place and the presence of people is at the center of the whole thing.”

Crista has already submitted code that introduces hyperlinks to OpenSim (see here). Crista is computer scientist of many accomplishments including being the co-inventor of Aspect-Oriented Programming.

There is a long conversation in the comments on my interview with Tim O’Reilly about whether the concept of avatar is the Achilles Heel of Virtual Worlds. So I asked Crista:

“Are avatars the Achilles Heel of Virtual Worlds?”

Crista explained why she thinks this is not the case in the modular open source architecture of OpenSim at least.

“The concept of people is not tied to the concept of avatar in OpenSim: One of the important parts of the OpenSim architecture is that the concept of user is very different from the concept of avatar.”

In OpenSim, Crista noted:

User = identity +storage

When I asked David Levine, IBM, what Web 2.0 could learn from virtual worlds re sharing identity, David, who works on interoperability and protocols in the Architecture Working Group, said:

Immersive spaces, are the real time, multi-user online component of Web 2.0, and identity is deeply part of that……..virtual Worlds teach us, as they expose more resources to Web 2.0, that there needs to be increasingly “supple” ways of sharing identity that go beyond simply anchoring it on gmail or openID, or such.

Social media has been one of Web 2.0′s success stories – giving the impression that Web 2.0 has people at the core of its architecture. But, as Crista pointed out, this is not the case.

There is no way in Web 2.0 to do identity at the level of platform, at the moment. As soon as you want to create identity on the Web there is a big mess.”

Participatory Culture at the Bottom of the Pyramid: “The Web Beyond The Web”

The “Web Beyond the Web,” Beerud Sheth, Webaroo Inc quipped, is not his announcement of Web 3.0. Rather, Beerud is describing the parallel innovation at the bottom of the pyramid where lower prices on mobile devices rather than new features drives adoption and voice and SMS (short messaging service) rule.

SMS is the web of the people for most of the world.  The current ratio is 10:1 with 10 people using text messaging to every 1 that has web access and the SMS population is growing at a much higher rate than web users. The  innovation at the top of the pyramid, where a plethora of Web 2.0 apps are built on top of  http, looks like the unreadable slide above with a forest of applications.

In contrast innovation at the bottom of the pyramid, until recently, has been limited to ringtones, wall papers, and voice response mechanisms.  So Beerud introduced a new service GupShup.

Gup Shup = Chit Chat

“Think of GupShup as another cool word from the language that gave you yoga, nirvana and karma sutra,” Beerud said.

GupShup is a “Twitter for India” but on a vastly bigger scale (only 18 months from launch they are up to 12 million users).

But, Beerud points out, don’t just file away GupShup as another twitter clone.  While they have Web and WAP site, they are deeply intergated into SMS as the lowest common denominator. GupShup can be used entirely from mobile which is vital as they have more users already than the total number of web users in India.

This idea of fully integrating into the lowest common denominator medium, SMS, has allowed GupShup to grow extremely rapidly. And, interestingly, when you look at the use cases you see the end users are deploying many of the uses cases that are familiar from the web,

Beerud left the audience with the take away that all the use cases are surprisingly similar to the web as are the ways of monetizing them,  This is creating enormous opportunity for creativity and entrepreneurship in building out this web beyond the web.

He invited those who already know the possibilities of the web to come and join this new adventure.  The enormous scale of the “web beyond the web,” and the fact people are connected almost continuously, creates vast opportunities for participatory culture to expand beyond the small triangle at the top of the pyramid.

On the “web beyond the web” the potential of 160 characters is explored on a scale unimaginable on Web 2.0 where Twitter, for example, is just one app in a vast ocean of other possibilities.

Crossing the Chasm Between The Top and the Bottom of the Pyramid

This total separation between the top and the bottom of the pyramid is, in part at least, constructed through the current web culture of web exclusive subscriptions.

It is perfectly possible to write an app that would accept SMS text and post it on a web page without ever requiring a web visit from the SMS subscriber. The same app could also accept text input from a web page and send it out as SMS to one or many subscribers that have never visited a web page, thus enabling communication across this gap.

Oxygenating the System: Monetizing Doing the Right Thing

The VCs, business leaders and  entrepreneurs at Web 2.0 Summit had their entrepreneurial Spidy Senses (as John Battelle calls them) tuned to the challenges and opportunities of Web Meets World.  Some of the winners of the Web 2.0 Launch Pad Competition explored the premise that doing the right thing can be monetized.

Danny Kennedy’ Sungevity was the overall winner.  Sungevity’s aim is to “scale solar electricity as a solution to climate change.”  Their use of a Virtual Earth feed to streamline the installation of solar panels and ambition to be the SalesForce.com for the solar industry was a very winning combo.

Good Guide, a really excellent service (also available as an iphone app) providing a guide to all products from the perspective of their healthfullness, greeness and other socially valuable criteria clearly scored a 10 on doing the right thing.  But Good Guide’s ability to succeed on the monetizing side of the equation was questioned by one of the VC’s on the Launch Pad panel.

Carbon Networks pitched with the mantra “do the right thing and enhance the balance sheets in the process.” But the difficulty there, it seems to me, is that there are many questions re the benefits, or lack of them, of global carbon trading markets.

Carbon Networks argued that carbon markets, which are already a giant industry, present enormous opportunity for companies to monetize doing the right thing.

I asked Gavin Starks (who I interviewed recently about his venture AMEE – a BIG project to aggregate the world’s energy data) about the problems of carbon markets.

“They have high levels of inappropriate use even for a new market area,” he commented, noting:

“There are some superb projects out there, but it would be fair to say there has been good dose of snake oil in the space – which has certainly not helped to build consumer confidence. However, markets are necessary to engage with the scale of investment that is needed to address the issue – it’s the use of funds that needs more scrutiny and greater transparency needs to be given to the whole process.”

There are projects working with Voluntary Emissions Reduction which aren’t tradable on proper carbon cap-and-trade markets, “though in theory the step up to CERs (certified emissions reductions) isn’t too great a thing,” Gavin noted.

MicroEnergy Credits the  initiative presented on the Track Me panel by April Allderdice, co-founder and CEO, is a good example of this.

Gavin pointed me to CheatNeutral and their YouTube video for a hilarious and razor sharp look at the problems of carbon offsetting. The text below is from the CheatNeutral site.

Gavin also explained a new initiative Sandbag (beta). Sandbag aims to take the permits that allow polluters to pollute out of the system.

“Thanks to policy makers in the UN and Europe levels of pollution are now controlled. Permits must be bought by polluters to let them keep polluting. But there is a finite number of them in circulation and the good news is anyone can buy them. So by taking a permit out of the system we can reduce the amount of pollution taking place and force industry to invest in cleaner technologies. One less permit means one less tonne of greenhouse gas in the atmosphere.”

AMEE is working with  Sandbag

Consuming Less and Redefining Prosperity

This picture is from the Sustainable Mobility Panel at the ASPO-USA Peak Oil Conference.

Perhaps nowhere is it more clear than when we look at the reports that link catastrophic climate change to the assumption of growth that what is really at stake in terms of averting catastrophe is not just retooling our energy infrastructure, but fundamental changes at the level of culture and identity.

Consuming less may be the single biggest thing you can do to save Carbon Emissions, Tim O’Reilly said, in his Tweet on “Why politicians dare not limit economic growth.”

A growing band of experts are looking at figures like these and arguing that personal carbon virtue and collective environmentalism are futile as long as our economic system is built on the assumption of growth. (New Scientist)

But few of us are willing to contemplate what a sustainable economy and averting the catastrophe of climate change require – redefining prosperity and reducing consumption (see Redefining Prosperity).

Web 2.0 Summit took on the challenge of reimagining giant industries like energy, food and transportation and how we might  be able to shift away from a culture of food and energy consumption that is basically killing us and our world (see Michael Pollan’s brilliant High Order Bit on the culture of food in the US).

The Summit gurus urged that taking risks and tackling very big problems has always been what Web 2.0 is about and indeed cultural shifts of the magnitude needed would be hard to imagine without a Web 2.0 perspective

Shai Agassi, Better Place, explained how paradigm shifts require new business models. See Shai’s High Order Bit here on the evolution of “Better Place,” -  by giving away free electric cars he is creating a new business venture that will bring clean cars into the mass market.  New business models not just new technology are required to drive change.

Breaking News From Reuben Steiger’s blog

First Israel.  Then Denmark.  A few weeks ago, Australia.  Today,  Mayor Newsom along with Governor Schwartznegger and the Mayors of San Jose and Oakland, announced that they would be making a major move towards bringing electric vehicles and the Better Place network to the Bay Area.

Please, visit Planet Better Place to sign the petition,  join the movement and bring Better Place to your town or country.

To motivate yourself and others how important it is to change patterns of consumption see Saul Griffith’s High Order Bit here and Project Wattzon

“…..from flying, driving, powering a home, eating, shopping, working and even one’s share of the energy necessary to make our society function. WattzOn helps users understand their personal impact on the environment and how they rate compared to others WattzOn users, as well as global averages.”

“The Secret Sauce”: New Business Models for Web Meets World

I spent some time talking to Don Dodge, Director of Business Development, Microsoft’s Emerging Business Division, about the future of  virtual worlds and what technologies he thought would play an important role in developing the participatory architecture of the web (full interview coming soon!).

“The question is how do you apply these technologies? Where is the best use for them? And this is the hard part.  When you look at social media and social networks and things like Wikipedia, don’t look so much at the technology because that is fairly simple.

Look at the rules of social interaction and how people interact, and how you put protections in there so that people don’t game the system or do bad things.  Look at the processes because that’s really the secret sauce of how it all works.  The technology is simple. It looks easy from a distance, when you start getting into how it really works from a social perspective that’s the secret sauce.”

(screenshot above from Threadless )

Also I caught up with John Battelle, Federated Media Publishing (see his Data Bill of Rights here), and Jennifer Pahlka, TechWeb, at a small press conference. I managed to squeeze in a couple of questions!

Tish Shute: If marketing has been the oxygen of the system up to now, what will oxygenate the system of the new participatory culture of Web meets World”

John Battelle: I don’t think marketing ever stops being one of the most significant pieces of the economy -  because it is, of the whole economy. So what I do think will happen, and this is the company that I run, I do think marketing will shift very dramatically in terms of its approach and how it is a part of the value exchange that occurs around goods.

One of the reasons that I had Tony Tsieh from Zappos was to show that.   Tony shows how every single human being in his organization is a marketer and sees every interaction they have as marketing.  Can you imagine  a company as big as Intel that has that kind of an approach?  That’s when we will have a real shift. Business models based on that idea are emerging.  I run a company that is involved in that. I don’t try to push it on the stage ..but I do it is right there Federated Media!  And now I am pushing it [laughs]

Its an idea that comes from all this staring at this. I do think marketing is going to shift quite dramatically. So we may see in 10 yrs that we don’t have a big media budget  pushing adds at people. But will there always be budgets for creation of value exchange between consumers and producers? yes! There will just be new models for how that money is distributed and spent and new services and intermediaries for that value exchange.

Tish Shute: But who controls definition of data will remain key right?

John Battelle: There is a reason why Yahoo, AOL, Facebook, MySpace, all of whom are here, and Google, are all about the data….all about the data….sorry I have to go!

Jennifer Pahlka: I think in addition to the enormous changes that John was just talking about in marketing, and I think these are very significant – the way marketing will be seen completely differently 5 years from now.  There is also the shift in Web 2 away from an over identification with  Web 2.0 as being primarily about and driven by advertising  because of these models that are emerging for Web 2 that are driven by data, driven by services, subscription.  There are a whole bunch of other business models for Web 2 start ups and for enterprise that really don’t have anything to do with that at all.

Tish Shute: And in terms of participatory culture and sharing data?

Jennifer Pahlka: And even on a simpler level than the data.  Think of a company like Threadless [see screenshot above]. Their co-founders are keynoting at our Spring event.  They have taken some of the other principles of the architecture of participation and the creativity of the community and built a whole difference around that.  And all they do is sell T-Shirts.

“A Billion One-Person Enterprises”

New York Times writer, Saul Hansell, in his article, “Web 2.0 Gets Big and Corporate,” writes, “the best minds of our generation are turning to the Web for solutions.”  …..the big companies that make very complicated systems are reworking them using the principles of Web 2.0 companies.”

But “big companies” themselves may soon be a thing of the past.  One of the potential futures many my friends in virtual worlds have been looking at is, “if the future consisted of a billion one-person enterprises.”

Tony O’Driscoll described some of his thinking re the role virtual worlds will play in this potential future.  See Tony’s presentation, “A brief history of a potential future” on SlideShare. Tony’s research provides a window onto the new participatory architecture of business, government and the economy and the ways the individual and the collective will have new dynamic relationships based on “co-creation.”

Second Life and Wikipedia are the two great experiments in collaborative co-creation. They show us how co-creation can be one of the keys to a participatory global culture and sustainable living – part of creating an alternative to this economy of escalating consumption that has us in its death grip today.

I have just got back from attending two conferences in the UK, the Head Conference, and Virtual Worlds London.  I was on a mission at both the events to ask questions about how Virtual World technology will answer the call Tim O’Reilly made at the Web 2.0 Expo in New York City to “create more value than you extract” and do something worthy and useful with the internet.

The Head Conference was an ambitious, timely, and much needed creative exploration of the potential for “green” conferencing using Adobe Connect Pro, Second Life and  local conference hubs in various cities. For more on the conference organization see this pre-conference interview with Aral Balkan.

Head will be the focus of my next post, so more on Head soon!  One of my main goals in attending the London Hub of Head was to interview the CEO and founder of AMEE, “Avoiding Mass Extinctions Engine,” Gavin Starks. AMEE aims to be “the energy meter of the world.”

AMEE is a neutral aggregation platform designed to measure and track all the energy data on Earth.”

AMEE is a project with the kind of big goals that O’Reilly talked about in his keynote at Web 2.0 Expo, NYC.  Tim O’Reilly is an investor in AMEE. He announced, at Head, that the O’Reilly VC company has just closed a deal with AMEE.

I had an extraordinary opportunity to spend time some time talking with Tim O’Reilly while looking for a sandwich in Euston Square.  More on this sandwich adventure and my interview with Tim O’Reilly, and my long talk with Gavin Starks about AMEE, in my next post!

Tim kept saying in London that he doesn’t like predicting the future. But the future comes to Tim O’Reilly!

And, after talking with Tim and Gavin, I felt I had a very exciting glimpse of what is emerging from the tech’s burning issues. George F. Colony, Forrester, summarized these issues nicely in his post, “Why This Tech recession Will Be Different.” Colony noted, “Virtualization, social computing, mobile computing, Green IT, SOA, extended Internet (connecting the physical world to the digital world) are front and center on the agendas of large companies.”

And, yes, this is supposed to be a little bit of a teaser for my next post on AMEE!

Virtual Worlds Road Map.

The final keynote at the Virtual Worlds London was what Ian Hughes in his post on the conference for Eightbar, aptly described as a call to arms for the Virtual Worlds Roadmap. As Ian pointed out: “This needs a post in its own right as we all need to get on board with this across the industry and help.” Ian Hughes’ (IBM) own presentation on “Business Process Management” was one of the best I attended in conference.  Yes, amazingly, he made this topic very interesting and fresh!

The pictures opening this post are the Virtual Worlds Road Map presenters. Victoria Coleman (Samsung) -seated at center, Sibley Verbeck (Electric Sheep Company) – in trademark hat, Jeffrey Pope 3Di – far left, and  Bruce Damer – close up in the picture on the right.

I am delighted to join Bruce Damer, later today, for a FastCompany.com Technology Group Call-in: “Next Generation Interaction: Are Virtual Worlds Waiting in the Wings?” with Donald Schwartz (October 28th at 4:00 PM EST).

I will also be in Second Life at Train 4 Success (SLURL) on Thursday, October 30 (starting at 9AM PST) with Peter Quirk, EMC, and Jani Pirkola, realXtend talking about OpenSim and realXtend for an event organized by Eilif Trondsen of the Stanford Research Institute and the Gronstedt Group.

John Hengeveld (Intel) – was off screen for this group picture (above). But, Intel is doing some very interesting work in Virtual Worlds see my earlier post here.  And, John is  “helping NASA work out how to deflect extinction level event asteriods from Earth!).”

As Ian noted, the main aim of Virtual Worlds Road Map, “is to gather together and cut through use cases to understand and help people come to terms with which applications need to be built for which case.”

For more great coverage of Virtual Worlds London check out Ian’s post on Eightbar. And, check out Roo Reynolds’, live blogging here and here. Also see Roo’s post on his panel on “ARGs [Alternative Reality Games] and Virtual Worlds.” which includes slides and audio. Picture below is Roo in action live blogging. Roo is Portfolio Executive for Social Media at BBC Vision.

Tribal Media: A Teacher Training Intranet For The Swedish Government on OpenSim

One of the more interesting developments I saw at Virtual Worlds London was a highly customized training intranet for 50,000 teachers being developed for the Swedish Government by Tribal Media. The flexibility of OpenSim to provide cost effective custom intranet solutions was nicely demoed by Darren Guard, Tribal Media R&D (pictured above). Darren is one of the more reclusive founders and phenom developers of OpenSim.

Virtual Worlds and Web 2.0

In my earlier interviews with Rob Smart here, and Teravus Ousley here, we discussed the work to integrate OpenSim with Web 2.0.

To meet the O’Reilly challenge – to do something useful with the internet and help solve some of the world’s big problems, in my view, Virtual World technologies must engage more fully with the power of the internet-as-a-platform – “a system without an owner, tied together by a set of protocols, open standards and agreements for cooperation.” (see O’Reilly, “What Is Web 2.0?” ).

Unfortunately the worst presentation at Virtual Worlds London was purportedly on standards for virtual worlds.  I do not want to waste energy rehashing the misinformed and misguided presentation on the MPEG-V’s archaic blunderbuss approach to standards in this post.  I completely concur with Jim Purbrick of Linden Lab’s characterization of this talk as “the worst talk I’ve heard in a long time.” (Also, see Jim’s post for an astute commentary on other aspects of Virtual Worlds London.)  Luckily, there is much productive work from quarters aimed at leading to standards for Virtual Worlds. And, some of these efforts I have blogged here on Ugotrade.

Because there is confusion, sometimes, in Virtual World discussions about how business models work on a “system without an owner,” here is the concluding quote from, “What is Web 2.0.”

This is not to say that there are not opportunities for lock-in and competitive advantage, but we believe they are not to be found via control over software APIs and protocols. There is a new game afoot. The companies that succeed in the Web 2.0 era will be those that understand the rules of that game, rather than trying to go back to the rules of the PC software era.

What is the Killer App. for Virtual Worlds?

“The killer is that any app you do create is automatically presence enabled.
The people with you can view the changing states of that application or context as and  when you do.” Rob Smart, IBM.

The picture above are the presenters for the “Platform Integration Considerations for Enterprise Virtual Worlds” panel. From left to right: Jean Miller, German Market Development Manager, Linden Lab, Matt Furman, Software Engineer, Northrop Grumman, Rob Smart, Emerging Technology Specialist, IBM Hursley,

Interview with Rob Smart, IBM: Part 2.

Tish Shute: Up to now, Virtual Worlds have been relatively isolated from Web 2.0, living somewhere between the gaming world and the Web 2.0 world. How are the curtains lifting and virtual worlds becoming the linking the space between social media, and online gaming?

Rob Smart: Virtual Worlds that allow user created content and the association of behaviour to that content via scripting put themselves forward as the ideal platform to combine realtime social interaction with existing Web 2.0 tools. The data and function out there currently on Web sites can serve to augment the real-time social interactions. For example enhancing/enabling cross cultural communication with chat translation (example my translation HUD from wayback in 2006).

Another example is augmenting personal spaces with flickr images, video etc. In many flash room based Virtual Worlds this level of integration exists. However without the ability of the users to create their own gadgets and gizmos the pressure is on the development team to innovate and give users what they want, tough to do in the long term. A blended approach is to open APIs and content creation to registered developers.

Rob Smart: When you’re integrating any system with another it becomes so much simpler if the creators have provided,  services and APIs for external systems to interact with. It becomes even easier if those system entry accept/give inputs and outputs in a common way e.g. xml/json. The same goes for both data and media.

By using common existing standards we shorten the development time taken, because if a standard is widely adopted there will be a multitude of programming language libraries for it. The existence of which means the developer can get straight onto the important task of creating the logic for their application/gadget rather than messing around trying to understand some weird data encoding method you’ve invented.

Having an Open Source platform spreads the work load around, as long as the method under which the OS software is licenced isnt too prohibitive then developers from all walks of life will contribute. Spreading that workload also leads to an increase of innovative features as people always bring their experience and interests to bear, the features they create can be shared back and others build on top of them.

If a company chooses to implement a feature they specialize in or integrate with their existing products they can sell this as an add-on, this creates a market where the base product can improve through contributions from companies making a living of the OS product, it also introduces some competition and financial incentive to the platforms well being.

People keep talking about killer apps within Virtual Worlds, the killer is that any app you do create is automatically presence enabled. The people with you can view the changing states of that application or context as and  when you do.

Rob Smart: I still think Virtual Worlds is a good term, though it is very fuzzy. If we’re talking about VWs that can be extended and integrated with web 2.0 then maybe we need to talk about Immersive Application Platforms. Yep not very catchy but probably something more people in the enterprise world would say out loud in front of their boss In addition another term that could be used is 3D Internet it conjures more of a picture of integration between the different parts of what is a vast networked system.

Tish Shute: The  original metaverse roadmap had four distinct segments Augmented Reality, and Life Logging at the pole of augmentation, and Mirror worlds and Virtual worlds at opposite corners of the pole of simulation. How are these areas coming together?

Rob Smart: There’s no reason these need to be separated, its all down to the use of the VW platform these four segments are just applications of a virtual world platform. A platform like OpenSim can merge several of these together if neccessary. For example the Publish Subscribe messaging module written about on eightbar that I created lets me do things like bring in Realtime Flight data and show planes positions etc. across a region I could at the same time call an API that gives me more details on that flight. I could even search for blogs that mention that flight number and bring them into the same space. I could add additional script functions to the plane objects so that when a visitor clicks on a plane it thereafter sends them messages about its position.

Tish Shute: Virtual worlds are being broken down to open source basics building blocks and modules that can be mixed and matched and mashed up with Web 2.0 to create a new ecosystem that enriches both what has been know as virtual worlds and traditional web environments. What kind of innovation do you see coming out of these new opportunities to mashup virtual worlds with Web 2.0?

Rob Smart: I’m hoping to see as a number one priority an increase of accessibility, despite a number of people saying that browser based virtual worlds aren’t worth the effort they certainly are. The ability to just send a friend a URL or Instant Message etc.. and pull them in with you is an important step to adoption. As are simplified interfaces that don’t scare off those unfamiliar with gaming. An example of this is the Lotus Sametime 3D work with OpenSim that lets you invite a friend or colleague in via an instant message.

Virtual Worlds For Enterprise: A Coming of Age Party?

As Ian mentioned I did think that the London Conference was a coming of age party for enterprise virtual worlds. In the picture below there are just some of the Lindens who were there, many to promote the Linden Lab collaboration with Rivers Run Red on “Immersive Work Spaces” which was written up in Wall Street Journal. Also see this post yesterday on Silicon.com, “Virtual Worlds Set For Second Coming.”

Someone please help me with the all the names of the Lindens in the picture below!  Matt Furman from Northrop Grumman is center and Joey Seiler from Virtual World News is on the right.

Justin Bovington said to me that this conference was in his view: “the enterprise virtual worlds coming out party – an acceptance that this is a tangible solution- about selling relevant tools and relevant ROI – rather than talk about virtual worlds it is about relevant tool sets.”

And, while the conference was small, I think the engagement level of the enterprise attendees did back up this assertion of Justin’s. Matt Furman, Software Engineer, Northrop Grumman was asked by more than one attendee how he was dealing with scaling up the behind the firewall virtual world he is developing for Northrup Grumman with Linden Lab to meet a big demand internally to start using virtual worlds for collaboration.  Apparently some attendees were seeing so much interest in virtual world solutions for internal collaboration in their own companies, they were concerned about meeting the needs of thousands of employees in short order.

Immersive Work Spaces

I asked Justin a few questions about Immersive Work Spaces while waiting for an elevator!

Tish Shute: And what are the relevant tool sets from your point of you?

Justin Bovington: Collaboration, sharing, integration of existing backend systems and applications.  For example, we have developed seamless ways to share powerpoint or share screens. And, also going back down to the ROI models as well,  tangible ROI based on subscription based system where basically in four or five usages it has paid for itself. We have never had that with Virtual Worlds. It has always been in the bounds of experimentation or the bounds of isn’t it cool technology. Now we are seeing this become a serious collaboration tool.

And as I have said before that argueably the twentieth century ended two weeks ago and the twenty first century is now with us.  And that is about companies rengineering their thinking particularly in the financial sector they have to restart again. And that is going to be about  using additional tools and additional guide lines to do that. This is the change over and I have said this in the panel as well. This show in particularly is enterprise virtual worlds coming out party.

And again we see a massive change between the last three shows – there is a level of interest we have never seen before and also an acceptance that this is a tangible solution not just something that is cool…

We have hundreds of users in out product and it will go  to thousands and tens of thousands in the next year.

And we know where it is going – data visualization is going to be the next big thing and getting this 10,000 ft view of your company. We are using this term called snow globing which lets you pick up a snow globe and shake it and let you see exactly what a company is about and this is exactly what virtual worlds are about.

It’s about having a ten thousand foot view of your company because that’s when it becomes powerful because then it becomes a broadcast medium. And I think it will change people’s perception of data. And it is also moving to beyond just having the avatar as the main presence. The environment itself becomes an essence or a kind of dynamic level that is inside there. We are working on stuff at the moment that allows you have direct influence on data or the environment you are in which on a massive collaboration scale could actually give you a huge amount of input and ideas around company. And there is a genuine need to have this kind of collective intelligence.

Sine Wave Dinner!

The grand finale for me was the excellent Indian meal very generously hosted by Rohan Freeman of Sine Wave Company. Standing on the left is Chris Collins, Linden Lab, seated left front is, Steve Spangaro, bigpipemedia, and on the right Ren Reynolds of the Virtual Policy Network. Many other metarati were there including Bruce Joy, Vast Park, Corey Bridges, Multiverse, Dave Taylor, Imperial College, Gia Rossini, Sloodle, Peter Haik, Metaversality, Adam Frisby, OpenSim, Mal Burns, and many more – please help me out with the name tagging!

Intel obviously benefits from broad adoption of applications that drive significant compute so it is hardly surprising that they had been paying attention to the early adopters of the Gaming & Visual Computing market.  But, in a recent post the Intel blog states, “going forward the bigger growth will be coming from the other two segments Metaverse and Paraverse (for more on the future of the paraverse see the recording of the Augmented reality panel in LA in my previous post.)

(Thanks Joshua Meadows (Joshua Nightshade in SL), Abstract Avatars, for the picture of the Linden Lab booth at the Virtual Worlds Conference and Expo, LA 2008.  Those giant avatars from Second Life (TM) are very cool. That is John Lester (Pathfinder Linden) in the striped shirt helping give us an idea of their scale.)

Intel is also in a powerful position to facilitate mass adoption of rich, immersive virtual worlds  where there is a direct connection between more compute and better user experience.  As Christian Renaud pointed out in, The Techology Intelligence Group’s Virtual Worlds Industry Outlook, 2008 -2009 (written with Sean F. Kane Esq.), the “ability for the computer’s graphics subsystems to render the data as quickly as required” has been an obstacle for mainstream adoption of virtual worlds. But, Renaud goes on to note, Intel’s new Larrabee architecture may be a game changer for virtual worlds.

Recent announcements may change the landscape.  At the SIGGRAPH trade show in August 2008, Intel announced their Larrabee architecture, slated for product release in the late 2009-2010 timeframe.  This would take what has typically been a separate Graphical Processing Unit (GPU)  function and relocate it into the processor architecture on the motherboard of a computer.
Although the early stages of this technology will undoubtably be prone to compatibility issues with legacy graphics drivers, the assimilation of this function on to the main motherboard should streamline the graphics performance and compatibility issues that virtual worlds have been susceptible to.

Jobi George, on the Intel blog explains how Intel sees three segments, gaming, metaverse, and paraverse as driving “the next logical evolution of web, where “connectedness” and “immersion” (not just richness) come together to bring us to an era of  “Connected Visual Computing” (see the press coverage of CVC here, here, and here).

Getting from here (gaming, metaverse, paraverse) to there (connected visual computing)

Mic Bowman, Intel, was on two panels at the Virtual Worlds Conference and Expo in LA last week. I wrote up and posted the recording of the panel I facilitated, “Open Source, Interoperable Virtual Worlds” in my previous post. On our panel, Mic explained in detail some of the work Intel is doing to help us get from here (gaming, metaverse, paraverse) to there (connected visual computing). Mic also spoke on the Virtual World Road Map session with keynote speaker, Sibley Verbeck, Electric Sheep Company, (see Sibley’s blog). This panel focused more on cross industry cooperation.

Mic’s message for our panel on “OpenSource and Interoperable Virtual Worlds,” in a nutshell was:

To achieve a thriving, growing, broadly adopted CVC ecosystem, we believe the industry must come to some agreement on common building block technologies. Open source technologies represent a critical element in the discovery and development of these technologies, and foster innovative usages that drive adoption.

To give you a taste of how deeply (err yes we were a panel of unbridled geekiness to some)  we discussed the work being done to research and create these common building blocks. Here is a short transcription of a portion of Mic’s contribution to our panel, lightly edited.

The creation of common building blocks for virtual worlds similar to what HTML and HTTP did for the internet is a vital step, in Mic’s view, for the transition to connected visual computing and for the experience of virtual worlds to become ubiquitous and transparent in the way that when we say “browse the web,” i.e., we take the “web” for granted it is the applications YouTube, Flickr etc that gets our attention

The Evolution of the Web Into Connected Visual Computing

In 1995 we talked about surfing the web, nobody uses that phrase any more. Today we talk about updating our blogs or adding something to twitter, or I want to go off and buy something from E-Bay or Amazon. The web has become essentially a fundamental part of the fabric. It’s the applications that it enables that are important. Right now we think about virtual world technologies generally as an application. Ultimately we would like to figure out how to get that kind of technology into the basic fabric. So that we think about collaboration as an application, we think about a conference, and attending the conference, as the thing we do, not as a platform on which we do that. And to accomplish that, what we envision at Intel is a set of building blocks that are created or emerge out of the various platforms, as being consistent technologies.

And so we looked at a variety of different approaches to understanding what those technologies could be, what those common technologies were, and how they are created and adopted. What we saw in OpenSim’s modular architecture, was an opportunity to start articulating boundaries between the various pieces of technology in a way that allowed us to disaggregate the architecture so that we could start thinking about how to pull the pieces apart and think about how the interfaces could be made consistent across those pieces. For example, there’s a set of types for the basic building blocks that exist across the Second Life and OpenSim protocols.

One of the people we just hired John Hurliman has been working libopenmv for awhile, and as one of the things we were having a discussion about is how to capture that consistency of types. And so John’s going off and pulling the set of modules out of the openmv project, in order to give us a basic set of types that can be applied across multiple applications, that can be re-used in many different ways.  And so it’s useful to the OpenSim community, and its useful for building out some new test servers and clients that can allow us to actually try out different types of load, and potentially allows us a way of extracting out the set of protocols that implement those types so that we can start looking at new ways of building more efficient protocols.

Another example of that would be the meshing code, the code that actually takes the basic conceptual level of object that is being represented in the world and turns it into something that can actually be sent to a GPU in order to be put on a screen. And so that basic meshing component that breaks it down seems to be something that we see as a consistent piece of technology that occurs in  several places that’s useful both in sort of mapping the representation into the physics engine and on the client mapping it into the graphics engine. And so that’s another example of the basic technology that seems to be appearing to consistently in many locations.

And so, what we like about OpenSim in particular, and again this is just a tool and framework for us for understanding what these basic building blocks are, but what we like about it is we can experiment with these new boundaries in the framework of a complete and functioning system. And so it gives us a framework for testing out what these interfaces should be and what the basic building blocks are.

Mic pointed out some of the key points of OpenSim architecture and ecosystem at the Intel Developer Forum. The slide below is from his presentation there.

(The Genkii team created the OpenSim N-Body demonstration with astrophysicists Piet Hut and Junichiro Makino, see here for more).

Interview with Mic Bowman:  “The Future of Connected Visual Computing.”

1) First could you define what you mean by, “Connected visual computing?”

Connected Visual Computing is the union of three application domains: mmog, metaverse, and paraverse (or augmented reality). These application domains are united through common technologies, especially 3D content creation, and common properties such as persistence, social interaction, rich presentation, and user-generated content with potentially complex behaviors.

2) One of the key aspects of fostering innovation in a new technology  is recognizing the important paradigm shifts that it fosters.  New forms of collaboration are one  potentially most disruptive contributions of  virtual worlds.  However, I know you have gone a little further than most on thinking how virtual worlds create new opportunities for non-linear, asynchronous collaboration.  Could you explain some of your thinking on this? And, why developing thinking about the applications of virtual worlds is something you and thus Intel has got involved with?

This slide is from Mic Bowman’s presentation “Non-Linear Presentation: or how to use virtual worlds for asynchronous collaboration.”

Although Intel’s research agenda focuses on the hard ware platform impact of CVC applications, it is necessary to understand the different usages that CVC enables. To that end, we built an experimental tool in OpenSim where we could explore new modes of collaboration designed exclusively for virtual worlds. That is, we didn’t want to look for ways to just translate our real world collaborative culture into the virtual world, we wanted to find out what unique forms of collaboration are enabled by virtual worlds. The first result is a tool we call non-linear presentations.

In addition, Intel actively collaborates with Qwaq/Croquet to integrate information space visualization into their enterprise collaboration tool “Qwaq Forums”.

3) Why did Intel choose to engage with OpenSim?

We like OpenSim because it has the best logo. Go Hippos!

Seriously… a year ago we started to look at open source platforms for virtual worlds. Open source platforms provide a completely functional framework that enables researchers to focus on specific innovations. My group wanted to look at scalability limitations in the distributed systems software architecture of CVC applications. We considered four candidate platforms (OpenSim, Croquet, Ogoglio, and Wonderland). We chose OpenSim because it was the most complete implementation of a persistent world. In addition, the development community was most active. Further, the modular architecture makes it easier to experiment with new functionality.

4) I know you have contributed code to OpenSim,  will Intel be putting more developers into OpenSim in the future?

Our focus is on investigating general technologies to support broad adoption of scalable CVC applications. That is, we want to understand the general problems that limit scalability across multiple CVC applications. However, it is important to validate general principles through specific implementations (even better, implementations with real end users). As a result, we expect to continue our collaboration with the OpenSim development community and with the emerging end-user community.

5) You mentioned you were doing some testing on OpenSim.  Have you found specific areas in Intel’s domain  that could be significantly improve OpenSim performance?

Our research is still very early stage. In one area, however, we have some very promising early results. Script execution in CVC applications creates unique stress on the platform with potentially thousands of concurrently executing scripts. One method we are investigating appears to improve performance and scales to the number of hardware threads on the CPU.

6) Everyone I think agrees that OpenSim and a next generation browser/viewer would be killer.  And when we talked last you mentioned interest in the OpenViewer project.  What do you see as being the best way forward on this very big task?

Clearly, experimentation with new communication protocols requires that we modify both the client and server. Licensing issues with existing viewers certainly complicate any effort to modify the viewer.

7) And, what about the user experience in virtual worlds?  What might be the contribution of browser-based views?  What are your thoughts on this?

Browser-based viewers are a reflection of deployment challenges. Broad adoption of CVC applications requires that the industry address the problem of simplified deployment, whether through stand-alone viewer (or viewer platform) consolidation or through browser-based viewers.

Software as a service is one approach that could address the deployment problem. Limitations in browser-based sandboxes must be addressed to deliver appropriate client performance and experience.

9) Intel has Havok and a software ray tracing engine that scales to cores.  The latter would really make for a completely new generation of  virtual world viewers.  Can you explain some of the innovations you see coming from this ray tracing engine?  And will there be a special license offered to bring Havok into reach of the open source community? What role / impact will Larrabee have?

Ray tracing is particularly helpful in making user-created content look good. Let me give you a concrete example… In a professionally authored 3D environment, objects can be placed with complete understanding of the lighting requirements. In any virtual world where users can create or customize content (including simple customizations like changing the placement of objects), lighting cannot be predicted (and as a result it is very difficult to create the appropriate shading for objects). Ray tracing (both as a runtime component and as an offline tool) can dynmically compute appropriate lighting, shadows and reflections.

Havok is a fully owned subsidiary of Intel with an independent business model. Questions of Havok’s license should be directed to Havok. (see the link to the Havok evaluation and developers licenses)

As a compute engine, Larrabee is designed for compute loads that frequently occur in CVC applications including physics (collision detection), spatialization of audio, and ray tracing. In usages where rich immersion, ie accurate physical simulation and photorealistic content, determines the quality of user experience, Larrabee can certainly improve the user’s experience.

10) How do you see the landscape for virtual worlds five years out?

Obviously any predictions on the future of an industry as immature as virtual worlds must be considered highly speculative. That being said, Intel’s vision is that the industry, as it matures, forms around a relatively small set of basic common building block technologies that are sufficiently general to enable many different usages. Examples we see emerging include identity, presence, text and voice communication, and asset/object management/storage. These basic building blocks can be put together with physics, game engines, and other tools to address the needs of a particular usage.

OpenSim was in the spotlight at Virtual Worlds Conference and Expo, LA 2008. OpenSim won a conference Innovation Award and the OpenSim booth was a hub of activity.

At one time I saw conference attendees from Microsoft, Intel, and IBM all in conversation at the OpenSim table. A video of the OpenSim integration with Lotus SameTime was a centerpiece to Colin Pariss’, IBM,  keynote interview with Erica Driver of Think Balm. And, just to back up what might seem my own seriously partisan opinion, I will note Wagner James Au made OpenSim the first of his top three picks from the conference for GigaOM

And, if you want to know why OpenSim is sizzling hot these days and you can manage some serious gearhead discussion here is an audio recording of our “Open Source, Interoperable Virtual Worlds” panel.

I was facilitator for a stellar group of  virtual world uber geeks/phenom developers from OpenSim: Adam Frisby, OpenSim/SineWave, Mic Bowman, Intel, Justin Clark-Casey, Fashion Research Institute, Mike Mazur, 3Di and David Levine, IBM.  See Dusan Writer’s blog for more on the heights of geekdom that were reached in the discussion, and for some interesting thoughts on the intersection of code, standards and social policy.

I open this post with a picture of Adam Frisby, Joshua Meadows, myself and Tess Linden enjoying some pre-conference Venice Beach time. Thanks Tess for showing us that you can be a phenom developer and get beach attire right!

But, the heart of our panel’s message was straightforward and powerful (yes I am obviously caught up in campaign season and on a message kick) . But in case you missed the LA Virtual Worlds conference here is the essence/message of our panel again, from my perspective, and in my words, and in short (relatively!!).

Open Source and Interoperability are the Basis for Innovation in Virtual Worlds.

This picture is from Adam Frisby’s blog of OpenSim “booth babes”  with the  Innovation Award.  They were dubbed “booth babes” by Dusan Writer in counterpoint to David Levine’s comment on seeing this photo, “What a bunch of nerds!”  David is in the center. And from the left Justin Clark-Casey (justincc), Adam Frisby (afrisby), Charles Krinke (ckrinke), David Levine (zha ewry), Adam Johnson (adjohn), Mike Mazur (mikem), Jeff Ames (chil1ken)

Basic building blocks and interoperability work will make Virtual Worlds part of the fabric of everyday computing

Big players like IBM and Intel are often asked why so much interest in OpenSim, in particular, when their goals obviously reach well beyond one platform. The answer to this, panelists explained, is that OpenSim is providing the best environment currently available to explore what will be the basic building blocks similar to http that will enable virtual worlds to emerge as a mainstream phenomena.

In conjunction with the open source Second Life viewer (despite the need for licensing changes and a new modular architecture which was discussed) OpenSim is the virtual world test kit supreme. The modular open source architecture allows for components to be disaggregated and reaggregated into new formations easily and rapidly. As I have mentioned before,  Stefan Andersson, Tribal Media AB,  has a catchy way of putting this,  “OpenSim is a rapid prototyping testbench for wannabe paradigm shifters.”  Stefan, one of OpenSim’s founders, notes this has been the heart of OpenSim from the start.

Interoperability work is the path to achieving virtual world standards

Achieving standards will take virtual world innovation mainstream.  The innovation emerging from open source to produce basic building blocks, and the standards emerging from interoperability efforts, panelists explained, will be the magic brew that transform virtual worlds into part of the fabric of everyday computing.  As Mic Bowman, Intel, describes it (interview upcoming in Ugotrade). The goal is that virtual worlds will ultimately be taken for granted much as when say “browse the web” – we take the “web” for granted (it is the applications YouTube, Flickr etc that gets our attention).

Our panel argued strongly that achieving virtual world standards will emerge from a combination of “rough consensus and working code” rather than “Vapor standards” – worked out by committees in the abstract. Both David Levine, IBM, and Adam Frisby noted “vapor standards” have been lost causes in the history of the internet.

Interoperability work allows for these basic building blocks of virtual worlds to be expressed across various computational fabrics which creates an environment for what David Levine describes as “parallel innovation.” David explains:

The point about parallel innovation is that there are several ways to evolve things. Open Source, tends to foster the addition of features, in common to the main trunk of development. Its very much about everyone building together. Sometimes, we need to or want to build stuff which works with that main trunk of development, but doesn’t share code, or has to fork. That’s where standards come into play.

While the OpenGrid beta has begun with Linden Lab and OpenSim, OpenGrid is just the beginning of much more extensive efforts to test and create protocols across different computational environments that will include increasingly different models of virtual worlds from OpenSim and LL’s model.

So another key message from our panel is: “Heterogenity fosters the creation of standards and more innovation.”

Metaplace and Second Life TM/OpenSim in Dialogue: Play Metaplace on a Prim!

One of the highlights of Virtual Worlds, 2008, LA, for me, was a forty minute conversation between Raph Koster, Tess Linden and myself about Metaplace (the pictures from the Metaplace blog are screenshots from worlds Metaplace testers have made.

I will have a more detailed post on this interesting dialogue soon.  I think Raph illuminates some of the subtleties of what, Dusan Writer noted, came across as somewhat of a Metaplace v Linden Lab debate on the Future of Virtual Worlds panel. As Raph explained, one of the the things they like to say at Metaplace is that, “virtual places are going to be first class citizens of the web next to tags, audio, video, images….that’s a very different kind of picture of where this kind of stuff is headed”  (see Raph’s comments on the panel here).  But as a little warm up to more on Metaplace soon, here are some of the remarks Raph made about integrating OpenSim with Metaplace hehe!

If somebody took an OpenSim server and made it speak the tag language out.  Then every Metaplace client would be able to talk to the OpenSim one. And visa versa, if OpenSim can open a  bog standard gpt socket, because we don’t even use a binary protocol. We use absolutely bare bones of the web. If you can connect by telnet you can connect to Metaplace. So that means an OpenSim client could become a Metaplace client, parse the tags, and play them on a prim.

RealXtend bring a cool new demo to LA

In the picture above Ryan McDougall now senior software developer with RealXtend, Tomi Kujanpää (LudoCraft/realXtend Art Director & Avatar Specialist), Hannu Hollström (ADMINO technologies) have a drink with Gene Yoon (Ginsu Linden), VP of Business Affairs, Linden Lab at The Metaverse Mixer Meetup at the Hotel Figueroa.  Cheers!

Kudos  to Linden Lab for their big picture thinking demonstrated in the work they did open sourcing their viewer at a time when few other companies would have made such a move.  And, more recently, for their efforts on interoperability with the OpenGrid initiative.

And, congratulations to RealXtend who have pushed the envelope on innovation with the open source Second Life TM viewer and OpenSim server this year. RealXtend showed up in LA with another awesome “undersea” demo that will be public on September 23rd (screenshot below from Ludocraft Ltd.)

Also more exciting news from RealXtend this week. Mac’s Virtual World reports:  “OpenLife will be the first grid based on the OpenSim technology to use RealXTend features as far as I am aware of.”

Augmented Reality will bring Virtual Worlds out to the mainstream.

For an important look at how instead of more people going into virtual worlds, virtual worlds will be coming out to meet the people soon, see the Augmented Reality Panel video above. For more see Roo Reynolds and David Orban’s blogs.

The video above (see here on YouTube) of an OpenSim integration with Facebook was posted today by Stefan Andersson of Tribal Media also see his blog here. This is the third in a series of videos that introduces Tribal’s new concept for 3D/web integration.

The picture above shows the in the left pane fetched pictures from Stefan’s Facebook photos. As Stefan explains a hybrid web app is talking to the region to change the picture accordingly and pull the photos into frames on the wall (for a more detailed technical explanation see here).

These videos (see the first here) from Stefan and his partner at Tribal Media, Darren Guard, Stefan explained, demonstrate as proof of concept how a “3D web architecture” could look and feel.

This concept has quite far reaching implications to many or our current notions of how inventory, virtual economy and content will work in virtual worlds. Stefan explained:

Sufficient to say is that Tribal One was an experiment, showing some concepts – much like realXtend is introducing some innovative new concepts. For example: Who creates your ‘inventory’ and what are you supposed to do with that? In our concept, the ‘inventory’ is a set of services that I can use to interact with the world, i.e, I have a “pictureFrame” in my inventory that, when I drag it onto a wall, the act of dragging it onto the wall instructs the region with the wall to use that url to fetch the definition of that pictureFrame, as well as showing that pictureFrames application web page to me. And, when I interact with that web page, that web page interacts with the region to change the picture in the frame. Contrast that with the notion of an ‘inventory’ that contains a set list of stored objects that I can ‘rez’.

The next video Stefan noted will demo a ‘friends’ tab and you can choose to ‘join’ or ‘visit’ them. “The point there being not having to run, fly or teleport just click. Also, the clip shows ‘snapping.’ the picture frames ‘snap’ to compatible surfaces something you’d like in Second Life.”

Interview with Stefan Andersson

Tish Shute: What are the goals of Tribal One?

Stefan Andersson: One of the central goals with the Tribal Server platform is actually about cost-efficiently adding 3D to existing communities or intranets. We did the Tribal One to:

1) show how easy it is to build what we call a “Community Provider” which basically is a connector between an OpenSim-based server and any given community or intranet – the ‘provider’ is just a small piece of code that provides authentication and profile data for the 3D region.

2) show how a hybrid web/2d interface could look, and address those very questions that we discussed would be interesting to ask Avi Bar-Zeev (see full interview here).

3) show our concept of 3D web applications, where a user works with an application trhu a seamless mix of 2D and 3D interactions, all resulting in http methods on a simple web application in the background.

We wanted to show how third-parties could create 3D-aware applications without coding anything but web services, for example in php. This has two great benefits; a) you can let web-coders (of which there are plenty) do the work of 3d-coders (of which there are few) and b) you can utilize existing web service contracts and security solutions when passing over trust boundaries, which would let a 3D-host securely interact with public web services, instead of letting a hosted region have direct database access.

Tish: Is it correct to say while your experiment here provides a nice solution to identity management between 2D and 3D spaces but it does not approach the issues that OGP and AWG (Architecture Working Group) are dealing with re trust management now, where the real meat on the table is now inventory and permissions and economy?

Stefan: That would be correct; in our model, the inventory actually consists of url references to web applicatons; for example – the picture frame that is visible in the clip I’m uploading, is in the inventory as a url to a web application that creates the xml definition for the 3D object

We are aiming for something a bit more ‘active’ than a static collection of statically stored assets.

We wanted to proof-of-concept an approach where you had an application generating the inventory and the objects in the inventory, as opposed to having a static databse listing of statically stored items.

So, the inventory is generated on-the-fly for the user, depending on what services he or she has subscribed to, and how those services are configured – not just by how stuff has been given/taken.

So, if you had an Phat wardrobe node in your inventory, for example, Phat could add items to that node depending on what you did on their web site

Tish: And that would be assuming they offered virtual clothing right?

Stefan: Yes, exactly.

Okay, take some virtual clothing company – the point is that the inventory, in this case, could be modified ‘from the outside’. Of course, in an SL-centric world view, that’s outrageous, but if you thought of this from a service-centric view, it would make sense.

Tish: But protocols could be worked out to extend this beyond Tribal to other OpenSim worlds and even Second Life assuming those other worlds wanted to participate?

Stefan:Yes, definitively – we did this to show how a 3D web architecture could look and feel.

Tish: Server centric is like Tribal where you are basically running your sim on your own PC

Stefan: Yes – we actually based all this on very simple web protocols; the ‘web viewport’ concept is just an extension of the existing OpenSim object exchange xml ‘standard’.

Tish: And while this idea would have no place in the old SL grid – would it be more feasable to integrate it in the new Linden Lab Open Grid with the agent domains?

Could agent domains say choose to opt in and opt out of these kind of web services?

Stefan: To be honest, I’m waiting for the AWG (Architecture Working Group) to solve the ‘inventory’ issue before I would venture using the term ‘agent domain’.

Tish: So when there is inventory sharing that is when the agent domain comes of age in your view?

Stefan: Well the question is: Who creates your ‘inventory’ and what are you supposed to do with that?

In our concept, the ‘inventory’ is a set of services that I can use to interact with the world.

Ie, I have a “pictureFrame” in my inventory that, when I drag it onto a wall, the act of dragging it onto the wall instructs the region with the wall to use that url to fetch the definition of that pictureFrame, as well as showing that pictureFrames application web page to me.

And, when I interact with that web page, that web page interacts with the region to change the picture in the frame.

Contrast that with the notion of an ‘inventory’ that contains a set list of stored objects that I can ‘rez’.

Tish: And at the moment in AWG discussions ideas are limited to Second Life models of inventory?

Stefan: That is my understanding

Again, Tribal One is not a ready-made product – it’s a vision of how future 3D/Web applications could function.

We just need somebody to pay us to finish it! *laughs*

Tish: Is there any reason why assuming AWG figure out how to manage the conventional notion on inventory this concept couldn’t be layered into extended protocols and options?

Stefan: I would assume the AWG solution would be able to fit our concepts – since we’ve already done this with the existing SL protocol.

Tish: Do you see this new notion of inventory offering new oppoertunities to content creators to be rewarded for their work?

Stefan: Well, with this prototype we were more looking at how the web works; we were more concerned with generating and distributing content from a service point of view.

This concept is more oriented towards users utilizing a business service, like a web site.

In our scenario, content is created by server-side services written in for example php.

imagine, if you will, if the SL model was based on scripts that were able to create objects, instead of objects having scripts.

Tish: Won’t this involve the development of lots of new tools for content creation?

Stefan: Well, yes and no; it’s like with the web you need people to do the designing, and then people to do the scripting, but you also need people to do the server side coding.

We are not addressing the current SL paradigms of content creation we are addressing what we felt was missing; a platform for organisations to make dynamically created content, like the difference between a static html page and a php page. Both can have client-side scripting on them, but the php page can pull data out of databases – any kind of databases – existing databses.

Take the example with the “where I’ve been” application in Facebook: You add that app, then you can fill in where you’ve been, and you get a nice map of where you been, and you can compare that to that of your friends

Now, that’s a database creating those images out of the data that you and your friends entered.

What we did, was an api, so that the author of that facebook app could add a set of php pages, which would let users share in inventory item, that was an url to an web app that returned the definition for a map of where I’ve been, so I could have that same map on the wall in my 3d living room.

Tish: So this implies a completely different model of content creation and economy to the one Second Life uses?

Stefan: Well, in these kinds of business scenarios, the content in itself would probably have little value, but the service that generated the customized content would have great value.

Tish: So this will raise the bar for people making a living from content creation? right?

Stefan: Most definitively. But that is how it should be.

Tish: I’m not sure everyone will agree with that!

Stefan: Oh? That’s the back side of progress; the ‘advanced’ part of ‘advancement’ if you will. That’s why it has value.

Tish: Well one of the things that made SL popular was the fact that a non professional developer, just someone with talent, could make a few Lindens creating content.

But, don’t you think the two models of content production will work together?

Stefan: They still will be able to. Most definitively in SL.

Again, it’s like with the web; in the beginning, people could make money out of just being able to notepad some html and ftp it to a server.

Today we have .NET server side database programmers doing the server bits, and educated professional graphical designers doing the ui and design bits.

Tish: Won’t the web services model have to rest in some way on a template understanding of content?

Stefan: Of course it has. You’re very right about that.

But then again, it’s not an ‘either-or’ – it’s a ‘both’.

And with that, a whole new spectrum of utility.

Tish: Perhaps, the two models will find interesting ways to interact in the end? They already do to some degree?

Stefan: Yes, you know these malls with 10 packs of skins, where the only difference is the combination of skin and makeup?

Or hair variations?

A good designer teams up with a good programmer and creates one good app that just delivers that exact combination.

There is good design and bad design, good design will always be coveted.

Tish: So do you have any summarizing remarks?

Stefan: Social games and technical innovation aside, what is needed to bring forth the 3D web revolution are good examples of business and user value – applications reaching beyond social networking bubbles and into the intranets and databases of organizations – and I believe Tribal Media has shown that we are very well suited to help bring those applications to life.

Today it is official, “The IBM and Linden Lab Interoperability Announcement” – see also, Torley Linden’s video here (screenshot above).

Hamilton Linden and Inifinty Linden visited OpenSim office hours in Wright’s Plaza, OSGrid, last week with some big news (screenshot below). 25 avatars gathered to discuss with great enthusiasm Hamilton Linden’s proposal that Linden Lab would provide an Open Beta for the Open Grid Protocol for login and teleport between OpenSim and the Linden Lab Public Open Grid Beta.

This interoperability work has been pioneered by David Levine (IBM researcher, Zha Ewry in Second Life) in conjunction with Linden Lab’s Architecture Working Group. Zha has personally coded the patch and she blogged her progress on this last month. Zha’s interop patch can be viewed here.

Later in this post for Zha’s gives an outline of the steps that could lead to the advent of much anticipated and hotly debated content interoperability.

Why is this Interoperability Initiative so important?

While, in Zha’s words, “this is a proof of concept of protocol.” It is an important first step, not only toward realizing Linden Lab’s dream of expanding the influence of their technology, but for consolidating a heterogenous mix of applications for virtual worlds in an interoperable environment.

Notably, it will allow corporations to deploy private and exploratory grids on OpenSim technology while remaining interoperable with the largest virtual world community to date, Linden Lab’s Second Life.

But it is not only interoperability between Second Life and OpenSim which will unleash the power of virtual worlds, it is interoperability between OpenSim grids. New OpenSim grids like Tribal Net and innovative projects like realXtend are beginning to discuss consolidating their influence through interoperability.

Both Tribal Net and realXtend have led the way re innovation with OpenSim technology (see my posts here, here, here for realXtend and here for Tribal Net). And, both are now in early discussions with OSGrid re interoperability. Charles Krinke, a developer and very excellent open source community organizer, runs OSGrid. He gave me a some background on OSGrid (see an upcoming post for more).

OSGrid is the second oldest OpenSim grid and was created in July, 2007. I began running it in August with 150 users and a dozen regions. Others were brought in as managers, most notably “Nebadon Izumi”, “Hiro Protagonist”, “Paulie Flomar” and more in the fall. We now have 3200 users and nearly 400 regions attached as of early July, 2008.

There are two goals for OSGrid. One is to test the OpenSim releases on a daily basis and the other is to build a healthy community.

Interoperability and consolidation of virtual worlds is vital to their development not only because Metcalfe’s law states that “the value of a telecommunications network is proportional to the square of the number of users of the system” but because Second Life has demonstrated that one of the key contributions of Virtual Worlds so far is their potential to collapse geography (as Cory Ondrejka put it).

Open Virtual Worlds must continue to create new and richer forms of networked interaction, enabling the communication not only of personal identities, but of community identities and cultures in ways not possible or imagined before. This potential cannot be fulfilled by small isolated worlds.

A New Era for Virtual Worlds Begins!

The excitement was palable today in meetings held in Second Life and OpenSim that discussed moving the interoperability initiative forward.

Interoperability is a big deal. This much was clear. And the press were on it! Eric Reuters showed up in the OpenSim IRC today asking questions about IP and virtual economies in the Open Metaverse. And, there are many posts already including TechCrunch, Information Week, Virtual World News, Gamasutra, and Dusan Writer‘s.

In the IBM press release, Colin Parris, Vice President, Digital Convergence, IBM said. “Developing this protocol is a key milestone and has the potential to push virtual worlds into the next stage of their evolution.”

The screenshot above is from OpenSim office hours today, Wright’s Plaza, OSGrid. There were 31 avatars present including Zha Ewry, avatar of David Levine, IBM, and at least four Lindens – Hamilton Linden, Tess Linden, Whump Linden, and Periapse Linden (Whump and Periapse are running the Linden Lab Public Open Beta Grid).

Also, there were many of the key OpenSim developers, Adam Johnson and Jeff Ames dropped in from Genkii, Japan (see here for more). There were several avatars from IBM in addition to Zha, and members of the Microsoft Development Community in OpenSim, notably G2 Proto, were there.

In the foreground of the screenshot above you can see the OpenSim avatar of Mic Bowman, Principal Engineer from Intel, Finrod Meriman. Mic is an important advocate for Interoperable Virtual Worlds and active member of the OpenSim development community. This was a power house gathering signalling interoperability as the future of virtual worlds has arrived.

Hamilton announced the link for the Public Open Grid Beta, and told the gathering:

You just need to contact Periapse or Whump Linden and they’ll get you setup. Although, we’re are officially committing to July 31st to start. But we’d obviously like to do it sooner. When it starts they’ll give you the info for the downloadable viewer and access to the Agent Domain Host.

Steps Towards Content Interoperability: Interview with Zha Ewry.

Interoperability will raise many new social/business questions for virtual worlds (particularly re content and business models). However, because this proof of concept is between the Linden Lab Public Open Grid Beta, which is not part of the Second Life economy, and OpenSim there is time for some of these questions to be explored.

This exploratory process began at a large meeting held by Zero Linden last week that focused on some of the community concerns about interoperability (see transcript here).

I asked Zha Ewry what she saw as the steps that would lead to content traveling back and forth between Second Life and OpenSim. The movement of content is where most of the thorny social/legal/business questions around interoperability emerge.

Zha outlined what the technical steps would be while noting that the social questions were just beginning to be explored:

Zha: There are a series of about four technical/social/legal steps.

First, we need a protocol for establishing proof of identity between
the components. ie for the sims and services to cross prove they are
who they claim to be, which is peer to having a trusted identity for
the users.

Second, we need a way of expressing policy This is orthogonal to one,
but pretty much requires the proof of identity in order to be useful.
In particular, we want to be able to express what the content creator
desires, including whether they wish it to be restricted to a grid, or
set of grids, copy and use and so on.

Third, we need an agreed public protocol for asset fetch including
both copy, and ACID fetch, and a reliable way of managing no-copy
assets. This is the brute work of moving the digital assets around,
and would exploit one and two to determine if assets should be movable
at all.

Fourth you would want the legal and social framework for using the
technical capabilities. This would be akin to a Terms of Service for
connecting stuff together, which would spell out what policies were in
place. effectively, these become the specific agreements which couple
the first three together, so that we have a safe, agreed way of moving
only the publically accessible assets (we can in fact, do parts of
this, in parallel, so we could work on 3) with public domain assets,
on a set of sims, that only had public assets) while working on 1 and
2.

A lot of this takes on a flavor of building up a layered set of
abilities, and then allowing people to compose a range of possible
solutions. At the protocol level, we want to allow a lot of
flexibility so different grids and communities can explore different
strategies. This is not about a one size fits all approach, or about
having a good enough crystal ball to pick an approach. An open source
community, with open protocols has the luxury of encouraging
experimentation.

Tish: So have the proof of identity protocols been published in any
current AWG docs or worked on?

Zha: It has been discussed, but not in any detail

Tish: So on the agenda?

Zha: Oh, very much so!

For an in depth and somewhat technical discussion of how issues of IP, trust, and managing permissions, licenses etc. might be managed with interoperable virtual worlds see the chatlog from todays Architectural Working Group Groupies discussion.

Content is already on the move in the Open Metaverse

Tribal Net announced this week that Second Inventory is now working on Tribal:

This software lets you backup and restore content to and from different grids, like for example the Second Life(tm) grid, and Tribal Net – which makes Tribal Net an excellent tool to work in private or offline with content, or to make and transfer objects thru e-mail or the web. (You can now distribute your Second Life(tm) object thru your blog – literally!)

Also Tribal annoinced they have 200 members, “and 150 of those has published their own islands. We now have a small core of dedicated 3D pioneers.”

They have also started a community micro-blogosphere that you might want to check out.

Ron Andrade of Common.Sensible has been checking Tribal out and has written a nice post about what he has found. He also notes re the integration of Tribal with Second Inventory that this is not opened the door to all kinds of content transfer or theft.

Now don’t panic, all you against-theft-aggregations and I. P. advocates. You can only copy your inventory and you must be using the same avatar name on Tribal Net as you are using in Second Life. All the permissions remain the same. So, creators, fear not: your hard work is safe. Well, every bit as safe as it currently is in Second Life. Although it is unknown how scripts and other things will react. But hey, if you are the adventurous type with the resources and time, give it a shot.

Stefan Andersson of Tribal noted we should remember “the pioneering and experimental aspect of inter-grid content transfer, and that people should expect some bumps in the road.”

The realXtend 0.3 release is out with a bunch of exciting new features! Click here or on the screenshot above to see the reX video.

Also, RealXtend launched a public avatar service – avatar.realXtend.net If you are interested you should sign up soon. Jani Pirkola, Project Manager for realXtend, told me:

We will get 100 first in to test our worlds and systems and give feedback for us. The limit is because we don’t want to drown if there are too many people.

I signed up on Friday and tried out a number of the innovations including the avatar generator and the teleport that allows your avatar to move between different reX worlds. Also, I used the inworld skype to chat with the reX team. The friend list is now global, meaning that regardless which realXtend world you are in, you can see the online status of your friends. And, if you already have skype installed on your pc you can call other people from the world. Just right click them and select “call” from the menu. realXtend also have their own voice application in development. Jani explained some more about the Skype integration:

If the other person wants, he can also define his real phone number as his contact info, then your skype call will be routed to his mobile phone, for example. realXtend welcomes all millions of skype users to virtual worlds!

In the picture below I am creating Tish Shute (my avatar in reX) in the avatar generator. There is a selection clothes that are real 3D meshes and they adjust to your body. Also reX has added new male and female models and a lot of skins and clothes for them. You can adjust their muscularity and body “fat” and create really nice looking characters.

The speed at which relXtend has been bringing out new features has already begun to attract a lot of interest. Many reX innovations do not exist yet in other virtual worlds, and a dynamic community of developers is beginning to gather in the realXtend Google discussion group. As the content creation tools improve, the new features will, I suspect, begin to catch the attention of content providers.

Jani noted:

The workflow to make more clothes is still quite painful, you need to use a handful of tools to accomplish a good cloth. We will put instructions on how to make clothes on our website when they are ready. I think some content providers should get interested. Making the skins is easier. And if you use Facegen, you can get really nice looking faces and heads for an avatar. It is still possible to use the bone system to scale parts of avatars bigger or smaller and to create something totally different, like godzilla sized avatars. They are awesome!

You can also download the Facegen software on the rex site and after you have generated your 3D likeness use it in the avatar generator. There will be a “how to” on the site soon. But obviously the reX team have been using FaceGen already and Peter Quirk figured it out himself. The picture above is of reX founder Juha Hulkko. I met Juha in reX, Friday, chatting with the reX team just prior to the launch.

Realxtend are using the IKAN (“Inverse Kinematics Using Analytical Methods” from the University of Pennsylvania. Jani Pirkola, Project Manager for realXtend commented:

IKAN was by the time we found it licensed “free for non-commercial use” which is incompatible with GPL license we use because of the Linden Viewer. However, they were very nice and provided the IKAN for us (and thus for everyone) as GPL. So big thanks to IKAN!

There is future development planned for the Inverse Kinematics as on its own it doesn’t deliver very natural movement:

IK movements look a bit awkward as they are but if you could use IK to partly control the keyframe animation that would be good. That is something we don’t have. But now that the IK system is in place, it is the natural next step. Did you see our task list for 2H 2008? I think there was something said about making IK feature complete.

Virtual worlds pioneer, Peter Quirk of No There There has done an extensive exploration of the new release including “how to exploit the Google 3D warehouse to find models and create Ogre meshes from them. As Peter notes the version is marked alpha code so the reX team are looking for feedback and making improvements all the time.

I did successfully teleport over to the ENSAD sim (being developed by Professor François Garnier and students of Ecole Nationale Supérieur des Arts Décoratifs de Paris) with a couple of the reX team members during my visit!

Modular Integration of realXtend Innovation into OpenSim

There has been some concern (see Justin Clark-Casey and Dusan Writer) about the integration of reX code into OpenSim.

Jani Pirkola told me that the idea for modular integration originally came when chatting with Adam Frisby about OpenSim philosophy, “that it could be a generic engine for any kind of viewer.”

Jani explained:

The idea of the modules came up because originally realXtend did many of the changes directly to OpenSim core, which is not a good way to do changes. Instead it is much cleaner to do them into modules that can be loaded on demand.

For example, the realXtend viewer could have its own protocol plugin called clientstack at OpenSim and that way it won’t interfere with SL Viewer.

I was interested to know some more about whether the idea of a build tree and mix and match plugins was already a part of OpenSim’s design. This kind of flexibilty to add or drop different features to builds according to different applications is necessary to accommodate the vast amount of innovation that needs to go on to figure out which are going to be killer apps in the future

I talked to Adam Frisby (one of the founders of OpenSim and CTO of Deep Think), Zha Ewry (IBM) and Justin Clark-Casey (IBM), about the integration of realXtend’s innovations as modules/plugins. OpenSim architecture is pretty good already for implementing mix and match plugins and “to make plugins deeper and richer” is one of the key goals. Adam pointed out OpenSim “is already doing core functionality as plugins – teleports are handled as plugins, and instant messaging and chat certainly are.”

Adam noted there many exciting possibilities that mix and match builds could create for OpenSim:

Adam Frisby: It would nice say to take the meshes from reX and say the set up and easy way to get a sim on line from Tribal, and you mix that with plain OpenSim and you have a fantastic combination.

Zha Ewry: And it is going to be that kind of evolution – we are going to cherry pick from the fifty or sixty creative things the four of five things which turn out to be killer apps. This is how open source projects win or die.

Zha Ewry: Increasingly there is no good reason why everything you do shouldn’t sit into either region code or the modular plug in code. Occasionally we are going to find that you can’t factor a bit of code out because there is some piece of the core that hasn’t been exposed right and then we are going to have to go and do that.

Tish Shute: And how does this model work for interoperability?

Zha Ewry: The Interoperability is almost entirely plugable. There are two or three bits that aren’t at the moment because of the way they entwine deep in… some of that is a matter of figuring out how to do it right and some of it requires a discussion on how we want to manage a couple of messy issues, e.g. what does it mean to host an avatar that is not authenticated by a local authentication? How do we want to handle that data structure? But there is absolutely no reason why the ability to inter operate wouldn’t be done as regions and plug code.

Just to give one example, when we figure out how we are going to fetch assets from off of Linden Lab’s asset server that is going to look like something that plugs in to the asset framework. ie. instead of gong to MySQL, we have a plugin that goes and fetches assets stored on a remote grid.

All of this functionality needs to be done in a way that can be factored as much as possible. So that you can say, I want this from this tree, this from this tree, I want to be able to fetch assets, I want to use the currency module from this tree, and that so that can produce an OpenSim with this set of features. You may be only able to get it with say these three clients but that is what you need and those are the clients that can work with what you need.

Adam explained that the goal is to put the entire realXtend functionality as plug ins on top of OpenSim as very discrete modules, e.g, a module for doing the meshes, a module for their voice chat, their avatar logins, but the goal is to be able to take these and mix and match them with everything else.

I asked Justin to comment when I saw him in the OpenSim Office Hours meeting in Wright’s Plaza, OSGrid, a packed meeting that included Hamilton and Tess Linden and a dynamic discussion on interoperability between the Linden Lab grid and OpenSIm. See Zha Ewry’s blog post, “Happy Jumping Ruths…..Interop takes a step,” to see just how far this work on interoperability between OpenSim and the Linden Lab grid has come!

Justin Clark-Casey: I think that when OpenSim and realXtend first met, there was an intention that realXtend would be integrating all the features and fixes they produced directly into OpenSim.

My motivation for writing my original post was really as an update to the situation as it had started out in February. Though it did prove too difficult, in the end, to integrate their code, I still think they could have spent some development time extracting basic core bug fixes and sending them to us – we really have received no code from them.

This is fine in itself – there’s a very good argument that value-add code should exist as external plugins and shouldn’t make it into the OpenSim core. It just frustrates me somewhat that people talk about doing stability fixes (as realXtend did in one of your interviews) and then don’t spend time to contribute them back them back.

Regarding modularity, this has been one of the core aims of OpenSim for a long time. We want to produce a generally useful platform and not just a Second Life server. I think the vision that Adam has outlined is workable, though I think our module code has quite a lot of evolution to go through yet. But it’s good that realXtend have contracted Adam’s company to do this – Adam certainly knows what he’s doing and the requirements that realXtend have should mean that some time will be spent on developing the module system within OpenSim. In this way, realXtend will be (albeit indirectly) contributing to OpenSim.

Just to be clear, from my understanding of what Adam has said, the new realXtend modules themselves will not be distributed with OpenSim. I’m assuming that instead realXtend will make a seperate distribution of OpenSim core + their modules.

Adam concurred that the Rex code will be not be merged with OpenSim and on the opensim tracker, only the improvements to OpenSim core will be. The Rex modules will be distributed by Rex themselves only.

Much of the coding for the integration of realXtend’s new code with OpenSim will be done in Deep Think’s new Shanghai office. But Adam will handle the integration plug ins to the OpenSim trunk personally. Plugins into different build options will enable, for example, taking a piece from RealXtend, taking a piece from Tribal, taking a piece from DeepThink, mashing it together with OpenSim-Core, and producing a usable result.

Adam noted:

The code we’re doing for Rex makes that possible with their components, and hopefully lets us improve the core at the same time to make it support other peoples work in the same manner.

It is jaw dropping the number of new features that realXtend has brought to the Second Life â„¢ (A registered Trademark of Linden Lab) open source client and OpenSim server tech in only a few short months. Last week the Rex team posted a video showing inverse kinematics, character morph controls, and clothing physics- see here. And, this week they have revealed their latest feature – the integration of Facegen (see the video here or click on the screenshot above).

I attended realXtend’s recent open meeting in Second Life. The Rex team answered questions to an eager crowd that included, the Second Life avatar, G2 Proto, of Kyle “G” the lead developer from G2 (see here for more on their hardware and networking division). Kyle “G” is currently involved in a collaborative effort with Microsoft to explore the abilities of the C#/.NET based OpenSim software. He is spearheading efforts with the Second Life Microsoft .Net User Group to create the Microsoft’s new developer community OpenSim grid – Project Manhattan. Kyle seemed very interested in the work of realXtend! I have an in depth interview with Kyle from G2 and Zain from Microsoft that details their vision for Virtual World Developer and Platform Evangelism on Open Sim. I am transcribing this and will post soon!

Interview with Jani Pirkola

Jani Pirkola, Rex’s Project Manager, kindly took some time to answer a few questions in the middle of this very busy and exciting time for Rex. The new Rex video showing the Facegen integration has just been posted on the Rex media page. Jani said:

It is almost scary as it is so real! I really start to see that we are approaching something so real as in Snowcrash or Otherland series of books. You can also make yourself look younger or older, different gender or race.

Tish: Wow!! Congratulations to the realXtend team you really have shown the world what can be done with the open source Second Life client and achieved what many considered impossible at this stage! These two new avatar tech videos are awesome!

Jani: Well, the main focus of our work at the moment is on Avatar. We have integrated Facegen so that you can use photos from your own face to create your own avatar.
We are just about to release new versions of viewer and server, and we start to host public avatar storage and authentication services to promote the future internet and avatar portability.
Now we have a lot of work to do on planning. But we are going to focus on three tracks:

1) a base track to fix stability issues.

2) a user experience track to make it look extremely good.

3) a collaboration track to do all the document sharing stuff.
In the new software release we have some cool new features. For example, you can have friends list working no matter where you and your friends are, so it works across realXtend grids and worlds. The same is true for your personal inventory, you can have that too with you when you teleport to different worlds.

Tish: One of the great things Rex has done is to offer so many new and great features so fast that you have for the first time created a situation where content developers have a significant new incentive to start working in an OpenSim grid. Are you beginning to see interest from content developers?

Jani: Yes, I have received many contacts for example from architects, they see the value of using real 3D models in virtual worlds. Professor François Garnier of Ecole Nationale Supérieur des Arts Décoratifs de Paris is one of the early adopters of realXtend platform in their art productions.

Tish: Obviously SL has a huge lead on content production and will probably offer licensing to open grids that want to share content at some point? But, what new models for content production do you see emerging in the Open Metaverse?

Jani: From Second Life users we have heard some complaining about the IP rights issue. They would die to have that feature on realXtend. But we have a plan for this; We could make an object rights server, that keeps SHA1 hash values of all the assets and licenses how to use that asset plus information about which users are allowed to use that asset.

Then it is possible to build a feature to the viewer that users can check if someone is using stolen or bought jacket. That creates a social pressure instead of trying to technically prevent copying. Technical prevention is always going to fail in the end, so we need to use social pressure instead. For example, If everyone could check whether an asset is owned or stolen, someone who is representing a company would not want to use anything stolen on them.

Ben Goertzel, Novamente, said that if someone steals his AI pet dog, it is a dead dog without the AI that runs on his server. Philip Rosedale was in agreement on this point also. Philip said much the same thing when he attended our Open Source Virtual Worlds panel at VW 2008.

If you really want to protect some content, you need to have server side functionality attached to it. This combined with our idea of using asset hash on a server, we think would boost the content creation.

realXtend offers possibility to use OGRE meshes and world is full of ready made 3D models that you can convert to that format. So that solves at least part of the initial egg-chicken content problem for realXtend.

Tish: Some people are proclaiming the notion of a virtual economy is dead, others say that virtual economies still have legs. What is your view on this?

Jani: First of all, I am an engineer, so economics is not my cup of tea. Still it seems that virtual money is successful in many games and virtual worlds. If it can be tied to RL money, that can be a source of many problems, like money laundering. I am not ready to say it is dead, but we might have to wait to see what future brings in this area.

Tish: There is a lot of work on interoperability going on right now. I even heard that Qwaq is considering working on interoperability with OpenSim! And I heard Rex is in talks with Solipsis. What are Rex’s goals for interoperability? I know in order to develop some of the super cool features of Rex you are not currently integrated with the OS trunk. But Adam Frisby mentioned to me a way you could remain integrated with OpenSim but still have the freedom to be the trail blazers of the future. Could you tell me more about your plans for compatibility with OpenSim in the future?

Jani: Yes, right now we are in warm talks with Solipsis to figure out how to co-operate the best possible way. Lets see what comes out from that. Their technological ideology is the best I can think of, combination of both client-server and peer-to-peer to get best of both of the worlds.

The focus in realXtend is to lead the development. There is a secondary goal to be interoperable whenever it makes sense. I just heard from Adam that the latest OpenSim is rock solid, so that is a big incentive for us to continue our efforts to modify realXtend code to be compatible with them. The goal here is to make realXtend as modules for OpenSim for easy integration.

Tish: Rex has blazed the trail with facilitating the import/export of meshes! But large meshes from programs like 3D max, while they create totally new opportunities for applications and content development, can be time consuming to work in and often require a lot of time on the import /export work, and they can be difficult to fine tune in world. One of the dreams for the future might be prim meshes that would bring the best of both worlds together (prim and mesh) do you see this as a possibility? I have heard many obstacles from bandwidth to graphic card inadequacies. But as Rex now has a reputation for doing the impossible I am asking your view on whether prim meshes are on the horizon? If not what are you doing to make meshes more flexible and easy to work with in world?

Jani: That is an interesting idea, and we have toyed ourselves with it already. It is definitely not impossible, though we have not made any decisions whether we will implement it or not.
We are going to do a lot of improvements to world building tools and add new possibilities like projectors, and things that are familiar from game level editing tools. Mesh selection is going to be fixed, for example. So you can expect much more in the area of world building. We are doing a lot of world building ourselves and have found it too cumbersome at the moment.

Tish: OpenSim is definitely the fastest forward moving kid on the metaverse block. I know that the Rex avatar server is out and the Rex grid open. But, as I have a Mac I have no first hand experience, so I am interested to know how well things are progressing re stability, concurrency and ability to scale?

Jani: Those are currently the weak points we have, but we are going to attack also these in the near future. The stability is number one, it is a must for every application out there.

Tish: OpenSim is beginning to get a lot of interest from major corporate players. IBM, Microsoft, Intel, are three of the big ones. How do you think this will effect Rex and the developing ecosystem of OpenSim?

Jani: I think you could compare OpenSim and realXtend to operating system and a windowing system. realXtend is built on OpenSim, so every big company who starts to use OpenSim, will consider using realXtend as well. By using realXtend, you actually use OpenSim server plus some modifications we have done to enable all the new features.
I am sure that OpenSim and realXtend benefit each other as the whole ecosystem looks richer that way.

Tish: Recently I talked to several key metaverse developers in Japan and the integration of 3D immersive and mobile tech is very much part of their vision. But Japanese cell phone habits make the possibilities for interesting integration very rich. In Europe and the US what interesting directions do you think this integration with 3D immersive and mobile could take?

Jani: That is something we have given a lot of thought to, but we haven’t found a clear answer yet. One idea is that there could be communication application that you can use to have presence in the virtual world even when you are on the move.

Only a two weeks after debuting their first Hands Free 3D video showing the possibilities for navigating Second Life “hands free” without a mouse or keyboard, Mitch Kapor (MitchK Linden in Second Life) and Philippe Bossut have a new demo out – Hands Free Object Editing in Second Life.

Philippe points out on the Hands Free 3D blog that they have already seen a lot of interest in their “hands free” project even from the main press (see this article from the NYT). Hands Free 3D, a project of Kapor Enterprises, is creating a prototypical interface using the 3D Camera designed by 3DV Systems to control virtual worlds like Second Life.

Mitch Kapor told me, they are now working “so that avatars can directly mirror body language and facial expression.”

Mitch very generously gave me an interview in which he not only describes his project to explore how:

the camera could be a central device to a whole new kind of interface the way the mouse became the central piece of hardware that enabled the whole graphical user interface and it enabled the transition from character based computing DOS to the GUI.

But also, Mitch shares some of his thoughts on the future of Second Life. A full transcription follows in this post.

“Moving From Science Fiction to Science”

Mitch explained to me he began to get excited with the idea of Hands Free 3D when he realized:

we had a shot at moving from science fiction to science as it were actually making some of this stuff work that people have been talking about for a long time

As Gwyneth Llewelyn points out much of the so called virtual worlds industry has backed off the bigger vision of a unified metaverse and is retreating into a more limited vision of a multitude of closed and controlled virtual worlds (see Digado’s post Raising Kids in Virtual Worlds and this video from fastcompany.tv to see how this controlled/controlling vision for virtual worlds plays from Disney’s point of view).

But while a bigger vision for virtual environments with a revolutionary role in adult life may not not be interesting to marketeers at the moment, it has a momentum that cannot be stopped. Mitch Kapor made a prediction during the interview that I wholeheartedly agree with:

the big vision of 3D is in the process of happening. It will be very transformative and anybody who is not counting on that happening, is likely to be run over by it.

I got very excited when I heard about the Hands Free 3D project because developing a natural interaction between people and virtual environments to me is one of the “it” projects for immersive 3D.

The dialogue between science fiction and science is of course the ongoing story of the metaverse. And seeing Iron Man which is alive with new possibilities for “seamless interfaces between people bits and atoms” made me think of how very exciting this new chapter in metaverse development is.

The Tangible Media Group, MIT, founded by Hiroshi Ishii has pioneered new couplings of the physical and the virtual. And, alumni John Underkoffler’s vision is definitely in play in Iron Man. Underkoffler’s exact credit flew by me too quickly – but he was clearly a futurist for Iron Man. Matt McGann points out that there is a very cool article about his work on Minority Report here.

Oh I cannot mention Iron Man without noting Iron Man in Second Life (see Massively) and Annie Ok’s latest great machinima!

And, Click on the screen shot below or here to watch the “Hands Free 3D: Second Life Object Editing Demo”

Interview with Mitch Kapor

Tish Shute: How did you get the idea to focus on Hands Free 3D out of all the possible areas you could have begun R&D in?

Mitch Kapor: You were asking me where did the idea come from? It originated in the fact that this kind of difficulty – of creating a natural, easier user interface – that we’ve had is characteristic of virtual world interactions.

There are things to be done about that at every conceivable level. From fixing all the little bugs to a bigger initiative. I was doing a thought experiment about what would really make a virtual world fundamentally easier to use.

I didn’t have an answer, but somebody had mentioned to me – one of the other investors in Second Life – that there are two Israeli companies working on 3D cameras. I had read about and heard about lots of things but this caught my attention. And I started to ask some questions about it. I had seen the video that Johnny Lee shot with the Wii on YouTube.

That had begun to prepare my mind to think about how you could use new types of input devices to control virtual worlds. So when I heard about the cameras I said this is really interesting and I started to make some phone calls and inquire. The Idea came to me that you could use the camera … the camera could be a central device to a whole new kind of interface the way the mouse became the central piece of hardware that enabled the whole graphical user interface and it enabled the transition from character based computing DOS to the GUI.

One of the other things is that I’ve now been around long enough, 30 years – active and professional – that I’ve seen many things come and go and I have a feeling for patterns. So I was fortunate in actually being able to get hold of a prototype of one of the cameras to do some experiments with it.

Tish Shute:
They’re not yet released generally are they, later this Summer, right?

Mitch Kapor:
Well .. it’s unclear. Sometime in 2008 or 2009. There will be multiple manufacturers. They have somewhat different approaches as to how they’re going to go to market. I’d say it’s all being sorted out soon. Everybody I’ve talked to is quite certain that by Christmas season of 2009 at the latest, they’ll be available in high volume at low cost.

Tish Shute:
I just got so excited when I saw you doing this because I think, basically, in terms of free form 3D programmable space which is how I’ve come to see Second Life now, it’s the future. Everyone’s been complaining that the problem with free form 3d programmable space for a mass audience is the difficulty of the interface. So there seems to have been this big retreat back into 2.5D, 3D chat rooms – plugins to Facebook etc. It seems like a step backward to me.

Mitch Kapor:
I think it’s inevitable that we’re going to get fully interactive 3D. It’s all a question of how we’re going to get there and how long it takes. It’s understandable why, for commercial reasons, people do more incremental things, but those are only going to get you so far.

Tish Shute:
Well it seems to me ideas about the evolution of 3D are to some degree being driven by marketing on the web forces at the minute. I suppose the thinking is that you can get these 3D chatrooms up easily and they are more amenable to marketing than a freeform 3D space like Second Life.

But my question is why you didn’t decide to go to game controllers? I suppose this is where a lot of thinking goes because all the kids have already a high level of skill with these?

Mitch Kapor:
Well, I’m not a gamer. It seemed to me that the possibilities with a camera to do the imaging and to be able in real time, to extract out a 3D model of the scene and the objects in it, is fundamentally just incredibly powerful. It feels like the right direction if you can develop it. What I was pleasantly surprised by was actually creating the first demo was pretty straightforward.

Tish Shute:
How did you prevent every random motion being sucked into the program?

Mitch Kapor:
It turns out that the cameras are pretty sensitive. They can detect relatively small motions like the resolution at a distance of 5 to 10 feet is a half a centimeter. That would be one part in several hundreds. maybe one part in a thousand. So it can detect slight motions. I don’t know the details of the software that the camera came with and that Philippe wrote. One of the other advantages is that Philippe, who is the engineer that did the work, has a PhD in computer graphics. And, he has been around the block quite a few times, and had a whole bag of tricks. I know that he spent some of the time writing filtering code to filter out noise in the signal and so on.

Tish Shute:
Do you have to be particular about where you stand at the minute? Can you smoothly go back and forth between when you have to type and things like that?

Mitch Kapor:
No, I’m not anticipating problems. We have another video coming up very shortly where we show object editing. The object editing isn’t as sexy as we would like it because it has to use the existing interface. They’re having to emulate keyboard and mouse. The point is that we have the concept of a control plane, a vertical plane, in front of you, that if you put your hand out so it crosses that imaginary plane, then it interprets what you do as controlling the mouse.

If you push through to the far side than pull it back it doesn’t. That actually works quite well as a gesture. And you get visual feedback when you’re in the control plane, it lights something up, so you can see – OK. It’s sort of like when you’re using the mouse to target an object you can tell tell when a mouse is inside a clickable button. Similarly there’ll be some kind of control zones. When your hand or other body part is in that you’ll get some feedback in the same way that a button highlights to indicate I’m clickable, or you’re over me. It’ll be a similar kind of thing.

Tish Shute:
But you have to avoid ending up with a mapping that’s more difficult to learn than the original one, don’t you?

Mitch Kapor:
I agree with you, but on the navigation and flying, we’ve had people learn to use this in less than 30 seconds. We just stand them up and say lean forward, lean back, stand up, lean to the side, raise your arms, and they’re moving, they’re flying, they’re walking.

Tish Shute:
And you don’t get a problem with the casual motion?

Mitch Kapor:
No. And this was just our first shot at this.

Tish Shute:
I know! I was really impressed that you could actually have done that in 3 weeks.

Mitch Kapor:
I think the start to finish time was a couple of months including the fact that Philippe had never seen the Second Life viewer code. So, he started like any other developer, just downloading and building the Second Life client. And, we never had a camera before! Ha!

Tish Shute:
But this is the great beauty of Second Life – the power that people have to do so many amazing things so rapidly.

Mitch Kapor:
He’s already re-written the code once. We’re totally prepared to give the code to Linden. It’s a little premature because the cameras’ aren’t available, but if the cameras’ were available, we would just donate the code. The nice thing is it’s actually pretty clean. It interfaces to the client at just a couple of points. We’ve isolated the dependencies.

Tish Shute:
But that’s my other question. If you donate the code will it be open source so that other developers could get involved? I know lots of people …

Mitch Kapor:
This stuff, the demonstration stuff, absolutely. That’s the intent. The purpose of this whole phase was just to test what we could do and to promote or evangelize the use of the camera. Get people excited. We’re thinking about what we might do with it.

I’m actually incredibly excited about the thing Philippe is working on now which is to use the camera so that avatars can directly mirror body language and facial expression. So that if I’m sitting in my chair and I have my arms crossed, my avatar will cross it’s arms. If I tilt my head to the side or smile or frown, the avatar will do the same thing. We’re quite optimistic that we can do something compelling in pretty short order, like less than a month.

Tish Shute:
Wow! That is really, really exciting. I think that has just been something people have been talking about a lot recently – to have gesturing and expressions transmitted to the avatar ..

Mitch Kapor:
The reason I get so excited is cause when I started believing we had a shot at moving from science fiction to science as it were actually making some of this stuff work that people have been talking about for a long time.

Tish Shute:
So the plan is to make your work part of the open source community and …

Mitch Kapor:
I don’t have a plan yet. I would say anything we’re doing in this phase we’re happy to give away. At some point I think things are going to become clearer as to the availability of the cameras, what Linden is going to build in, and then businesses that might be built off of what we’re doing.

But I’m very confident that the kinds of things we’re doing now and in the short term are just going to become part of the standard repertoire of things you can do in Second Life in code that’s available to developers.

I don’t have the exact road map.

Tish Shute:
I heard your recent talks in Second Life and how you were very interested in seeing how Second Life could become more of a business tool. I’ve talked about what Second Life and its “cousins” offers in comparison to other open source platforms like SUN’s Project Wonderland and the Croquet platform Quaq. For example, Second Life is a free form 3D programmable space that’s really accessible and easy to develop in.

But in Qwaq you can drag and drop documents in from 2D applications easily, and Wonderland has some great telephony/audio development. I’m totally psyched by what you’re doing because it has the potential to make the free form programmable space of Second Life more widely useful, and it could be bring much innovation to business communications.

I see a future in interactive data visualization, for example, the idea that Ben Lindquist of Green Phosphor has been developing, i.e., that you can actually model business processes dynamically in a collaborative environment. What are your thoughts on Second Life’s potential in business applications?

Mitch Kapor:
One thought is that a more general platform, more general purpose, more open, in the long run, all other things being equal, will be superior to more limited, less capable, more closed platforms, for building any kind of application.

And at the moment, Second Life is the most general and most open platform. So all other things being equal, which usually they’re not, Second Life should be viewed as superior by people who are building a variety of applications.

But there are clearly some things that need to happen. Well let me put it this way some of the other platforms have temporarily at least moved further ahead in enterprise related applications by developing collaboration capabilities.

So the imperative is for Second Life to provide comparable capabilities. It has to do that, in terms of fundamental stability, reliability, in all respects. If it does that then it’s actually going to win on it’s own merits.

Tish Shute:
I absolutely agree with you because in terms of ease of use, it’s the only dynamic networked general simulation platform around. There’s no one else close.

Mitch Kapor:
It’s also I think highly scalable in ways that some other things aren’t. Even though it doesn’t have as many 9′s in uptime as it needs to have, there have been recent signs of more progress. I guess the HTML on the prim stuff is rolling out finally or at least the first version of it.

I think it’s ended in beta now.

It’s not the full thing. But it’s a huge step. That’s going to help a lot.

Tish Shute:
Plus the fact it seems Linden Labs moving towards a more heterogeneous idea of a grid where there’ll be the potential to connect behind the firewall worlds with the main grid .

Mitch Kapor:
I also know that there are some third parties that have done that. They’ve sworn me temporarily to confidentiality. But they have done some very impressive stuff with integrating the web with Second Life in ways that you can for instance in a web interface just go and grab a PowerPoint. In your Second Life window. The power point will just show up. So there is a kind of work around to using the familiar web to get your intercollaboration stuff working. There’s progress. It’s going to be some time before it all sorts itself out.

But to come back to the camera as a more natural interface, I think for personal interaction, is important. It’s going to be a breakthrough.

Tish Shute:
It’s a huge breakthrough also to have the avatar related to your real life gestures. It’s a huge leap forward. When you introduced it at metaverse meetup that really got people’s attention. I have a question. Have you thought about going even further with the thought driven game controllers?

Mitch Kapor:
At some point I intend to take another look at that. I have the feeling that your not doing anything highly profound. Kind of a cute hack.

Tish Shute:
Again they’re not available, I would guess they would give some to you though.

Mitch Kapor:
From looking at earlier incarnations of this stuff I think what they can pick up on is very superficial. So I’m not sure that they’re going to be that interesting cause we really don’t know how to do, without some invasive type of surgery,

Tish Shute:
You can do it with very very complicated brain scanning you can do a lot more, but I agree. Although I did see the Japanese University was using them for severely disabled people. Looked like they were doing some interesting things.

My question is, this is something you mentioned in one of your talks in Second Life, you thought some of the steps forward to make Second Life truly a player in the business world, would be changes on the server level. Were you thinking more about the moves that are going on towards open source and making a heterogeneous grid?

Mitch Kapor:
Yes. I was thinking about letting people run it behind the firewall, and also it’s not just putting it behind the firewall, anytime you’re talking about an enterprise application, the enterprises want to integrate all of their existing IT systems. They already have these very sophisticated systems for managing say identity, and having easy integration of those thing with Second Life identity management is not glamorous but very important.

Tish Shute:
This brings to mind another question. I know I have some ideas about what Second Life really brings to the table for business. No one else has taken on working with dynamic melded states on the internet in 3D to the degree Second Life has. That’s sort of, to me, the essence of it – having groups of people working around 3D objects that can be updated on the fly and modeled on the fly.

Mitch Kapor:

If we do things well there will be a good level of interoperability and all of the open source work and the reverse engineered clones will actually be a good thing.

Second Life is, and I’ve probably used this line, faced with insurmountable opportunities on all sides.

Let me ask you a question. I’ve read your blog, or some of it, but what do you actually do?

Tish Shute:
I spend a lot of time on my blog at the minute!!! You can tell I have kids and dogs driving me crazy [dog is barking in the background], which is exactly why I took this up a year ago. I worked in film and special effects for the early part of my career.

When I had my kids and dogs and all of that it got to be just too much to do 24/7 film production. My son’s nearly 9 now. I tried academia for a while, then I just said forget it..too hard to be in a medieval guild as a second career!

And I actually a year ago when I started looking at this (Second Life) I thought my goodness this is what we sat around and talked about every night when we were doing multiple pass motion control photography in the eighties. And so I started writing about it and that took a life of it’s own. And now it’s become a little ridiculous because it’s an excessively time consuming hobby!

Mitch Kapor:
Are you in New York or the UK?

Tish Shute:
Yes. I’m in Manhattan.

Mitch Kapor:
The reason Second Life has gotten as far as it’s gotten is because of people like you who have become inspired and become obsessed and feel the possibilities and feel them to be so utterly compelling to cause some rearrangement of life priorities.

Tish Shute:
It’s interesting cause it’s like every week I say “Oh I really can’t spend all this time writing!” Then I see something, like this week I saw all the new wave of 3D chat rooms coming out. And it just got me going again! I just can’t bear to not to have a voice because when you see the big picture you want the really innovative stuff to move forward. That’s why when I saw your work on hands free 3D, I said: “Oh my goodness, someone’s taking it the next step. And as you say there isn’t a path that’s clear. There’s no guarantees. But its a path worth traveling, in my view!

Mitch Kapor:
I firmly believe, I have complete conviction, that all of the 3D, the big vision of 3D is in the process of happening. It will be very transformative and anybody who is not counting on that happening, is likely to be run over by it.

Tish Shute:
Right. Of course you’re much more knowledgeable of this aspect of it but in terms of business applications, has anything interesting happened in a long long while?

Mitch Kapor:
There are some interesting things that are happening, I just learned this by accident, that are being kept under very close wraps. There’s at least one consultancy that is doing extremely well with very large prestigious global corporations. They have done a lot of development of this integration of web with Second Life. Their clients are shy. They do not want public exposure at the moment because of the backlash against the overhyping of Second Life that happened last year. I was very heartened to hear about this. I think it’s going to start coming out in the next few months what some of these companies are doing.

Tish Shute:
I agree. Many of the interesting things I know about I can’t write about either because there’s no interest for people developing business applications to have a lot of web publicity about it in the early stages.

Mitch Kapor:
Right. I think we’ll be in this phase for a while. But then we’ll get out of it.

Tish Shute:
In terms of specifics about business application, do you have any dreams for Second Life?

Mitch Kapor:
I would like to just personally have a really good meeting application. Just simple like when you and I want to get together and meet in world, I would like that to be easy, bullet proof, convenient, natural. I’m imagining that we both have cameras, so that we can see each other and you get body language and you get a sense something like what you would get in a face to face meeting. And I want people to have the ability to easily get more realistic avatars, if that’s what they want. And actually there’s a lot of good technology around that now. Where you can just basically take a picture or two with an ordinary digital camera, upload it and get back something that pretty much looks like you.

Tish Shute:
What do you think are the biggest obstacles to this kind of free form 3D programmable space?

Mitch Kapor:
There’s a lot of software that has to be written to bring out its full potential. And not just by Linden or any one company. It’s really a collective effort that is the work of a whole generation.

It’s comparable to all of the work that went into making the ecosystem of the personal computer. Or for that matter the ecosystem of the internet. It requires having the right architecture, it has to stay open. If that can happen I think it’s mostly just a matter of time and some patience.

It is going to happen. There are lots of individual challenges. Tons of problems to solve. I’m not a technological determinist, but at this point I don’t think anything can hold it back.

In a way though having lived through the onset of the internet, while it has changed things a lot, and in certain ways it would be very difficult to imagine life without it, it also has left things the same. I mean people bring all of themselves and their issues into every technological medium. The drama gets played out in a different ways, but it’s neither going to be a good thing or a bad thing. It’s going to be some of both. And so the question is, to me, how people of good will who want to make the world a better place are going to use whatever new things get created in a positive way.

Tish Shute:
I know Mark (Zero Linden) heads up a lot of interoperability work in his office hours and other meetings. But I got a couple of emails this week saying that all these groups that are working off of either clones or reverse engineered, and there are so many of them, and some are under wraps too, need to actually meet on an even more regular basis?

Mitch Kapor:
That’s true. I guess it’s much more desirable for people to meet and talk, and if they don’t for awhile, you get more noise in the system. It just will take longer to put things back together.

Tish Shute:
That’s what I was thinking, that it’s become pretty clear to me that cooperation, if it is going to happen, has to happen around the clones and the reverse engineered versions of Second Life because other platforms are not prioritizing interoperability at the moment, that I know of.

Mitch Kapor:
People will call – this and that should be happening but my view is that the ecosystem is still sufficiently underdeveloped that there is a risk of attempted premature standardization.

If you look at the history of things, It’s very important for there to be working instances before anybody attempts to standardize anything.

There’s a lot to be learned in the early history of the internet. pre-history, from the 60′s up through the 80′s — when the basic protocols were being developed. There’s some very smart people working on that and a certain amount of looseness is actually quite important now.

There’ll be people who want to prematurely standardize and get everybody together and all you’ll wind up with is a massive crud.

I thinks that the power of the open systems is so much greater than the walled gardens Also the open source ethic is so deeply established in large parts of the development community, even in enterprises, that overall I’m not too worried about it.

When the functionality of whatever it is, is that well known and well understood, that’s the period in which the open source alternatives can really flourish. When there’s still a lot of evolution in functionality, and design in the user experience, open source techniques can become too slow.

So it’s going to be somewhat chaotic. I think we have to embrace or at least make peace with a certain amount of chaos right now and the understanding that it’s likely to settle down. The chaos is not the last word.

This week I received several requests to write a post reviewing the recent upsurge of OpenSim based projects. I am in England for a week, so there is no way I can do this before I leave. However there is a good opportunity to learn more about realXtend and meet the realxtend team this week on Wednesday April 23rd, in Second Life. I have reprinted the notice from the realXtend website at the end of this post.

And, as LifeRain points out, “one way to get to know more about OpenSim is to visit a public grid.” There is a complete list of these grids here. OSGrid, OpenlifeGrid and DeepGrid are goods ones to try to start with. The picture above is from Wright Plaza the orientation area for OSGrid below is OpenlifeGrid.

Or You Can “Do it yourself” – I did!

You can also download OpenSim directly from opensimulator.org. I did! And I set it up on a CariNet on a dedicated server for only $100 per month. In the picture above my eight year old son was excited to meet Adam Frisby, one of the core developers on the UgoSim, just minutes after logging in for the first time. Ugotrade Jr. is now enjoying (and so am I) learning to build in a “cost free” environment – no file upload charges! Also, you can get a Ready-To-Run version of OpenSim from OpenlifeGrid.

OpenSim Blogs

There is a OpenSimulator group blog which some of the developers contribute to, and also a Planet OpenSim which agreggates feeds from opensim-related blogs and developers

• Daltonic Gin
• Darb Dabney’s SIMGIS Blog » OpenSim
• Dave’s Educational Blog
• OpenSimulator Project
• Sean’s Mental Walkabout » opensim
• Shengri La: Utopian Micronation
• Tedd Maa
• The Word of Chaos » OpenSim
• VintFalken.com » OpenSim
• artiphys
• justincc’s opensim blog
• nebadon2025.com
• xyzzy xyzzy… » opensi

Meet the realXtenders!