Adam Greenfield’s new book, The City Is Here For You To Use, is coming soon (photo above by Pepe Makkonen is from Adam Greenfield’s Flickr stream). Adam told me:

“I’m aiming at a free v1.0 PDF release on 05 June 2009, with the book shipping as quickly thereafter as humanly possible. There will be a version zero or public alpha in about six weeks.”

I am not good at waiting for books I really want to read to arrive. But, on the upside, it brings out my already pretty highly developed investigative instinct. So when Adam very generously agreed to do an interview, impatience turned into delight in tasting what is to come. And Adam is encouraging this kind of engaged anticipation. He writes (see post) that The City Is Here For You To Use, is shaping up:

“as something of an unbook avant la lettre. It’s why we’ve [Nurri Kim and Adam Greenfield] always insisted on keeping you in the loop as to the book’s fitful progress, it’s why I take every opportunity to test its ideas here, it’s why I make explicit the fact that your response to those ideas is crucial to their evolution and expression. And it’s why, even though the process is inevitably going to result in a static, physical document as one of its manifestations – and hopefully a very nice one indeed – we’ve committed to offering a free and freely-downloadable Creative Commons-licensed PDF of every numbered version of The City, from zero onward.

You buy the book if you want the object. The ideas are free.”

I found the opportunity to ask Adam questions about some of his subtle renderings of technology, culture, and being in urban environments challenging and very illuminating.  Although I definitely get the feeling I am asleep at the wheel on some of the critical areas he is thinking and writing on.

Knowing the depth and range of Adam’s thought in his seminal book, Everyware, and his blog, Speedbird, before I began the conversation I asked Adam to point me to some of his posts that reflect key ideas he is working on at the moment (Adam has recently posted The City Is Here: Table of contents).  Adam directed me to these three posts.

Antisocial networking

More songs about context and mood

Messenger, space, messenger body, messenger mesh

I may ramble and diverge, as is my nature, but these posts inspired many of the questions I ask.

Adam is currently head of design direction for service and user-interface design at Nokia and living in Helsinki, so I did not have the opportunity to do the interview in person. But I have glimpsed Adam’s world through his Flickr stream and some of these images have found their way into this post. But I suggest you browse Adam’s photography for yourself. I cannot do justice to the thousands of nuanced perceptions of cities, networks and publics you will find there. In the meantime, here are three glyphs of Adam Greenfield that I liked a lot.

“My favorite shoes,” “My favorite chair” and photo by Adam Greenfield, “Favoriteplace”

A Conversation (in gdoc) with Adam Greenfield

Tish Shute: Could you explain a little about the evolution of your thoughts on urban environments, ubicomp and interaction design? What shifts in your thinking have taken place over the last few years re the dawning of the age of ubiquitous computing? It is a couple of years now since Everyware, what aspects of the uptake of Everyware have most surprised, disappointed or inspired you? Which of the many thesis you discuss in Everyware have become the most crucial for The City Is Here For You To Use?

Adam Greenfield: You know, there’s a little passage in the liner notes to the second Throbbing Gristle album that I always think of when I’m asked questions along these lines. As part of their stance, they’d adopted the dry tone of a corporate annual report, and the preamble began by saying, “Since our last report to you, many things have changed. Indeed, it would be foolish to assume that it could be otherwise.” And I think that’s just exactly right: the world keeps moving, and the positions we’d staked ourselves to not so long ago may no longer be correct, or even relevant, to the one we find ourselves inhabiting now.

So, first, I think it’s important to cop to all the places in Everyware where I just outright got things wrong. There’s a passage in Thesis 50, for example, where I unaccountably mock the idea that “the mobile phone…will do splendidly as a mediating artifact for the delivery of [ubiquitous] services.” OK, this was admittedly written in a pre-iPhone world – and was correct for that world – but you can really see my parochialism showing here. It took the iPhone to make the proposition as blazingly self-evident to me in North America as it had been for quite some time to folks in Europe and Asia.

Having said that, though, I think I’m justified in taking a little pride in what the book got right. The broader trends the book set out to discuss – the colonization of everyday life by information processing – well, take a good look around you. And so one of the points of departure for the new book is taking everything posited in Everyware as a given: the urban environment, and most everything in it as well, has been provisioned with the kind of abilities you mention. So what now?

How do you go about designing informatic systems so they don’t undermine the wonderful things about cities? How do you design cities so they can incorporate networked informatics to greatest advantage? How, especially, do you accomplish these things when the disciplinary communities involved barely speak the same language? And how do you keep everyone’s eyes on the prize, which is the ordinary human being asked to make sense of these new propositions? These are the questions The City Is Here For You To Use sets out to address.

Adam talking about the “Le Long Ici” in Paris (also see Adam’s post, “The long here and the big now”)

TS: You mention that the hardest parts of  producing The City Is Here For You To Use wasn’t “keeping on top of all the emergent manifestations of urban informatics, or even developing a satisfying spinal argument about their significance” but getting the voice right.  It seems that now is the perfect time for a book that would really speak to a wide audience.  But also it seems that the city that is here for you to use is manifesting quite differently in different parts of the world?  You seem to be somewhat of a nomad, Japan to NYC to Helsinki.  Can putting together different views of urban informatics give us more depth perception on the emergence of ubiquitous computing?

AG: There’s no question in my mind that the long-term experience of everyday life in Tokyo, New York, and now Helsinki has been an invaluable asset to me, as I imagine it would be to anybody interested in thinking or writing about the networked city. It’s given me a certain amount of parallax, you know? And that, in turn, throws a really interesting light onto how the selfsame technology can appear in substantially different guises in different social contexts.

But explaining those things – those complicated, delicate negotiations – getting them right, doing them justice, doing so in a way that doesn’t dumb anything down, and still remaining accessible? It’s a challenge, let me tell you. You want to remain approachable and humane, but you also want to explain things like different jurisprudential takes on property, or how advocates of RESTful architectures think that REST is the reason why Internet adoption spread as rapidly as it did. If you want to enjoy even one chance in a hundred of getting your message across, you’ve got to start with an understanding that those subjects are MEGO territory for most people – whether they hail from Shibuya, Shoreditch or San Pedro.

Everyware icons: Information processing dissolving into behavior (Icons inspired by Timo Arnall; design by Adam Greenfield and Nurri Kim).  [Adam notes on his Flickr page that he tweaked these icons as section headers for Everyware]

TS: Could you explain more about what you term “onto” and “ontome” and how this differs from spimes and spime wrangling?

AG: You know, I never did get to develop that idea as much as I would have liked. In my mind, at least, “ontome” referred to the totality – the global environment of addressable, queryable, scriptable objects. (An “onto,” then, would be any given such object.) I guess I was looking for words that would do two things: allow us to distinguish between the instantiation and the class, and leave us with a better word than “spime.”

TS: When you say better word than spime this is this because….

AG: Euphony, primarily. : . )

TS: When I first used the Android app,  Wikitude, on Broadway, NYC – a street I have traveled thousands and thousands of times, and it offered up new information about itself, it was definitely an “OMG this is big!” moment for me. Like the first time I clicked on a screen and Amazon sent out a book in the early nineties (something so ordinary now it seems impossible that it was exciting but I remember it was to me!). But if I understand your post here correctly, isn’t Android with compass the first easy-to-use context-aware mediator for wrangling onto, ontome and spimes?

AG: Wikitude sure looks pretty impressive, and maybe even useful. But I would never, ever call it “context-aware.”

To my mind, at least two more things would need to happen before we could comfortably think of it a “context-aware spime wrangler.” First, the buildings and other public objects around you would actually have to be spimy – they’d have to report something of their past and current state to the network. And then, some application running on your phone would somehow have to cross-reference that state information with some fact about your current state of being, and deliver you relevant information.

So, let’s take your Wikitude example. You’re walking down Broadway and you pass an unfamiliar building, and for whatever reason you want to know more about it. Your phone pings the building’s dynamic self-description, and it replies to the effect that Andy Warhol had his Factory there between 1973 and 1984. If Wikitude chooses to share this particular piece of information with you, and not some other potentially germane factoid from the building’s history, on the strength of the fact that “The Velvet Underground and Nico” was in your last.fm playlist? That would constitute some small measure of context-awareness.

But you see how hard we had to try just to come up with an example, how forced it is, how so-what. And I have to say that – short of some infinitely supple system that really could model your innermost desires ahead of real time, and present appropriate responses to them – most so-called “context-aware” applications and services are like this. They’re either trivial, or wildly overambitious.

Maybe we don’t need for things to be context-aware for them to be useful, anyway. Certainly a great many objects in the world are starting to report their own status, and many more will do so in the fullness of time. And for the most part, all you’ll need to avail yourself of them is a Web browser running on a device that knows where it is in the world. An iPhone or an Android device will work splendidly – I called the iPhone “the first real everyware device” the day it came out and I was able to play with it for the first time – and in that way, the answer to your question is “yes.” Not to be longwinded or anything. ; . )

This Object has imperceptible properties. [Adam notes on his Flickr page: "This is a custom RFID-enabled transit pass that Timo Arnall had made up for me here in Seoul. I've (clumsily) tagged it with the icon that Nurri and I developed to represent just such emergent situations as this in the everyware milieu - that there's no way for anyone to understand that this object has puissance beyond the obvious simply by examining it."]

TS: It seems that  we are just at the beginning of understanding how to create networks of spimes (e.g. Pachube). Gavin Starks of AMEE (”the world’s energy meter”) once suggested to me that AMEE could be described as a facilitator of networked spimes (everything will have an energy identity). I think you may be familiar with AMEE because you keynoted next to Gavin at Xtech 2007.

I would be interested to hear your thoughts on AMEE?

When you discussed onto and ontome in this post, you noted:

“The greater part of the places and things we find in the world will be provided with the ability to speak and account for themselves. That they’ll constitute a coherent environment, an ontome of self-describing networked objects, and that we’ll find having some means of handling the information flowing off of them very useful indeed.”

Is the idea of “energy identity” that AMEE proposes an ontome? 

AG: See below for a précis of my feelings regarding environmental/sustainability initiatives, AMEE included. Uh…is AMEE an ontome? No. There’s just one ontome, and it’s coextensive with what folks now call the Internet of Things. It sounds like individual AMEE sensors would be “ontos.”

But I think the difficulty we’re having is a pretty good indicator that the terminology is more trouble than it’s worth. Sometimes a coinage, as satisfying as it may be lexically, just doesn’t work for people. These days I’m trying to get out of the neologism trade.

TS: I know when Usman Haque talks about Pachube he talks about spimes and spime wrangling. I asked Usman for his thoughts on spimes and onto/ontome and he gave me some comments.

Usman Haque: I think I had somehow missed the conversation about onto and ontome but backtracked through blog posts to piece it together (unfortunately some posts at v-2 and Studies & Observations no longer exist!). There are a couple of things that have made me uncomfortable about the word ’spime’: (a) the fact that it might be too easy to confuse with an “object”. A ’spime’ should also encompass relationships between things, and not just the “thingness” itself. (b) the sound of it (as Adam noted above). But then I am reminded of that horrible gooey interface used to plug into people in eXistenZ – it somehow seems appropriate that it should be a horrible gooey word, and not something that can disappear politely… So I like onto/ontome because it speaks to my first concern about ’spime’; but my second concern, it turns out, is not the problem I thought it was, and so onto/ontome might be… ahem… too euphonic! On the question of this thing people are calling the “Internet of Things”, I’ve tried in lectures to reframe it as the “Ecosystem of Environments”. Further, Vlad Trifa makes a delicious point that just as ‘web’ is different from ‘internet’, so too should we consider the “Web of Things” rather than the “Internet of Things”, something I agree with.

TS: It seems like this point about the difference between “the web of things” and the “internet of things” is pretty important?

AG: The parallel distinction between Web and Internet sure is! They’re two completely different things, right? And http is far from the only protocol that runs over the Internet. Now, as to what Vlad means by extending this particular distinction to the domain of networked objects, I don’t yet know, I haven’t had time to check it out. But sure, in principle I’d totally be willing to go along with the idea that there’s a meaningful distinction between two environments named that way.

No information is collected here; network dead zone

TS: I was just going over Greenfield’s principles of ubiquitous computing.  I am not sure that I see any current manifestations of ubicomp that hold to these priniciples yet?

AG: Oh, sure there are. Look at the work Tom Coates has done on Yahoo!’s Fire Eagle; look at Dopplr. And look at some of the steps other, less compassionate developers (e.g. Facebook) have been forced to take by their own users.

Look, those principles are just codifications of common sense and basic neighborly virtues, expressed in language appropriate to the domain of application. The best, smartest and most ethical developers have never needed guidelines to do the right thing. But especially inside companies and other complex organizations, people who want to implement compassion in their design of a technical system may occasionally find it useful to have some color of authority to invoke in their struggles. That’s all those five principles are there for, and I’m well satisfied that people have been able to use them that way.

Boffi’s take on the smart home- photo by Adam Greenfield

TS: In your post, More Songs About Context And Mood, you suggest a direction for interaction design that you point out is not far from Yvonne Rogers’ ideas in “Moving on from Weiser” about a switch in goal of ubicomp from Weiser’s vision of calm living (”computers appearing when needed and disappearing when not”) to engaged living – ubicomp technologies not designed to to do things for people but to help people engage more actively in things that they do (ensembles, ecologies of resources).

You also suggest interaction designers should be:

“parsimonious about the interaction design challenges our organizations do take on, with an eye toward reducing the complications of context (and the attendant opportunities for default, misunderstanding, misfire, time-wasting, and humiliation) to some manageable minimum.”

As you have pointed out, “we don’t do “smart” very well yet.” But paradoxically smart grids, smart homes, smart products etc. etc. are ubiquitously coming to market right now.

Yvonne Rogers suggests interaction designers should be:

moving from a mindset that wants to make the environment smart and proactive to one that enables people, themselves, to be smarter and proactive in their everyday and working practices

What areas might interaction designers most productively direct their attention towards?

AG: You note that things called “smart homes” and “smart products” are coming onto the market, and that sure would seem to be the case. But as to whether or not these things are genuinely smart, we don’t have anything more to go on than the marketing department’s word. I think you can already see that I tend to take language very seriously, and I really don’t uses like the “smart” here, or the “aware” in “context-aware.” They overpromise, they cannot help to set us up for failure and disappointment.

You know what I’d really like to see interaction design wrestle with? I would love to see a rigorous, no-holds-barred examination of the complexities of the self and its performance in everyday life, and how these condition our use of public space (and personal media in public space). I would love to see the development of ostensibly “social” platforms informed by some kind of reckoning with issues like vulnerability, dishonesty, the fact of power dynamics. In other words, before we deign to go about “helping” people, wouldn’t it be lovely if we understood what they perceived themselves as needing help with, and why?

I’d also pay good money to see talented interaction designers turn their efforts toward tools for the support of deliberative democracy, for the navigation of complex multivariate decision spaces, and for conflict resolution.

Locative is a mood – photo by Adam Greenfield

TS: I know you said this would take too long to explain but I couldn’t help noticing that you seem to be, perhaps, skeptical about the role of everyware can play in sustainable living and yet, it seems at the moment, in the hacker and business communities at least, the role of everyware in reducing carbon footprint/energy management etc, is the great green hope?

Will everyware enable or hinder fundamental changes at the level of culture and identity necessary to support the urgent global need – “to consume less and redefine prosperity?”

AG: I’m not skeptical about the potential of ubiquitous systems to meter energy use, and maybe even incentivize some reduction in that use – not at all. I’m simply not convinced that anything we do will make any difference.

Look, I think we really, seriously screwed the pooch on this. We have fouled the nest so thoroughly and in so many ways that I would be absolutely shocked if humanity comes out the other end of this century with any level of organization above that of clans and villages. It’s not just carbon emissions and global warming, it’s depleted soil fertility, it’s synthetic estrogens bioaccumulating in the aquatic food chain, it’s our inability to stop using antibiotics in a way that gives rise to multi-drug-resistance in microbes.

Any one of these threats in isolation would pose a challenge to our ability to collectively identify and respond to it, as it’s clear anthropogenic global warming already does. Put all of these things together, assess the total threat they pose in the light of our societies’ willingness and/or capacity to reckon with them, and I think any moderately knowledgeable and intellectually honest person has to conclude that it’s more or less “game over, man” – that sometime in the next sixty years or so a convergence of Extremely Bad Circumstances is going to put an effective end to our ability to conduct highly ordered and highly energy-intensive civilization on this planet, for something on the order of thousands of years to come.

So (sorry again, Bruce) I just don’t buy the idea that we’re going to consume our way to Ecotopia. Nor is any symbolic act of abjection on my part going to postpone the inevitable by so much as a second, nor would such a sacrifice do anything meaningful to improve anybody else’s outcomes. I’d rather live comfortably – hopefully not obscenely so – in the years we have remaining to us, use my skills as they are most valuable to people, and cherish each moment for what it uniquely offers.

Maybe some people would find that prospect morbid, or nihilistic, but I find it kind of inspiring. It becomes even more crucial that we not waste the little time we do have on broken systems, broken ways of doing things. The primary question for the designers of urban informatics under such circumstances is to design systems that underwrite autonomy, that allow people to make the best and wisest and most resonant use of whatever time they have left on the planet. And who knows? That effort may bear fruit in ways we have no way of anticipating at the moment. As it says in the Qu’ran, gorgeously: “At the end of the world, plant a tree.”

Biowall! - photo by Adam Greenfield

TS: In your post “Antisocial Networking,” you make some telling comments on the sorry state of social networking systems.

But you do also state:

Which of your concerns is social networking more central to than you might wish and why?

AG: Well, you know I’m interested in social interaction, interpersonal behavior, and in how these things play out in networked environments. There’s virtually no way for me to avoid dealing with Facebook, as wretched as I think it is.

Facebook is pretty hegemonic, in that its reach and influence extend further than the universe of people who use it. I bump up against it constantly, in a few different ways. People send me links I can’t access, because I’m not on Facebook. People spend time and energy trying to convince me that I’m really missing out, because I’m not on Facebook. The last few months, there’s even been a few people who feel justified in expressing some kind of exasperation, that they’re really pissed off…because they can’t find me on Facebook. It’s become the sovereign interface to any kind of life in public, and as a result a great many people don’t question its modes, tropes and metaphors.

So when it comes time to build some kind of situated interpersonal mediation framework, some kind of intervention in the fabric of the city, those are the tropes they reach for: accounts, profiles, friend counts, friendings and unfriendings, nudges and pokes. And as a member of a team tasked with the design of such systems, as a potential user of them, and certainly as someone exposed to the social rhetoric flowing downstream from their use, you bet these tropes become central to my concerns.

But what if we admitted that Facebook and the whole paradigm it’s built on are broken? What would things look like if we started from a more sensitive understanding of the interaction between self and others? Say, the understanding Erving Goffman was offering us as far back as the late 1950s? Then you’d understand the need for provisions like a “backstage,” a place to swap out one mask for another, the ability to present oneself differently to different communities and networks. That’s what I’m interested in exploring.

TS: Social networking systems in their current form are crude and express a very narrow bandwidth of human relationship. But already people are connecting everyware’s networked social acts to existing social networking systems. At the ITP winter show there was kickbee – networked fetal communication (and tweetmobile which used twitter as an acctuator for an ambient display) and green everyware (energy monitoring) is showing up in a number forms on existing social networks. But rather than just hooking up everyware to these existing flawed social network systems, does everyware require a reimagining of networked social interactions and social networking systems?

AG: That’s a great question, and I think the answer is clearly “yes.” It’s one thing to confine the consequences of that brokenness to the Web, and entirely another to let it bleed out into the world.

Does that mean any such reimagining is going to happen, that people will somehow refrain from plugging real-world outputs into these terribly flawed frameworks? Not a chance in hell. It’s too late to put a fence on that particular cliff. But maybe there’s still time to park an ambulance in the valley below.

“A graphic representation of a portion of the Earth’s surface, as seen from above” – photo by Adam Greenfield

TS: I saw you tweet that you met Usman Haque from Pachube recently. What do you find most interesting about Pachube and EEML? Will you design a project for Pachube to push the conversation further?  Did Usman ask you to take a role in the future of Pachube. How does Pachube enable the vision of The City Is Here For You To Use? I could go on for ever with questions,  so please do tell!

AG: OK, I should probably reiterate that my fundamental interest is in people, and in what they choose to make and do with technology, not the technology itself. For the last few years, I’ve particularly been trying to understand how people interact with each other and with the urban environments around them when those environments have been provisioned with the ability to gather, process and take action on data. And this is how I come about my interest in what Usman is up to with Pachube, because those “gather,” “process” and “take action upon” functions are generally accomplished by different systems, designed by different groups of people, at different times and to different ends. What Pachube aims to do is make the difficult and not-particularly-glamorous work of connecting these pieces a whole lot easier.

Think of it as a step toward enabling the ontome, this so-called Internet of Things we’ve been talking about, the same way basic protocols like HTTP and HTML enabled the wildfire spread of the Internet we’re familiar with. What Pachube offers is a way – a relatively straightforward and self-explanatory way – to plug any given compatible input into a similarly compatible output. So if you’ve got an air-quality sensor or a soil-pH sensor or a personal biometric monitor, you can plug it into Pachube, and someone else can grab the data those things generate and use it to drive a visualization, or the state of a physical system like a window, or whatever else they can imagine. It’s as close as anyone’s yet come to providing a plug-and-play backbone for the creation of responsive environments.

And I think it’s absolutely brilliant that it’s designed to work with Arduino and Processing, two lightweight, open-source frameworks that hobbyists and researchers (and even one or two more serious developers) around the world are already using to build things. (Arduino’s a kit of parts for doing basic physical computing – using data to drive lights, motors, and other actuators that have effect out here in the world – while Processing is a very accessible language to do dynamic and interactive graphics for screen-based media). Given both its openness and modularity, and its willingness to build on top of the very popular frameworks that already exist, I’m very excited to see what people make of and with Pachube.

I have to be honest and admit that personally, I couldn’t really care less about the environmental angle, for reasons that I went into at embarrassing length above. What I’m engaged by in Usman’s work is the idea that Pachube is helping to create an open platform for people to share data more readily. And while, no, he hasn’t explicitly asked me to take any particular stake in things, I’m always happy to lend a hand in whatever way would be most useful. I think it’s a project worth supporting.

As to how Pachube enables some of the ideas in The City Is Here, the answer has to do with the book’s call for every “public object” – every lamppost, bus shelter, commercial façade, and so forth – to support an open API. Something’s got to string all those objects together, present them to people as resources to be taken up and used, and Usman’s offered us a critical first step in that direction.

TS: Usman suggested, it might be interesting to ask you about “the tension between ‘could’ and ’should.’

Usman Haque: There are a whole bunch of things that we “can” do, technologically speaking; how do we decide what we ’should’ do, as we find ourselves in an age where we can build almost anything we can imagine…? particularly with reference to technology/privacy/security triumvirate. e.g., leaving aside that the majority of the world is *not* in the technology ‘paradise’ that we’re in, here in the west, only a small fraction of people are currently producing the technology that the rest of us use; one aim is to get people more engaged in the productive process, but, in a sense that will also mean the whole wide ecosystem of technology will be even bigger, both “good” stuff and “bad” (that qualification firmly placed on how it’s used), as opposed to now when we can focus on quite specific things that government & industry are doing and saying “that shouldn’t be happening….”. part of this relates to something adam said on his blog  in the comments (see here).” 

AG: I think the first part of answering that question has to involve figuring out who “we” are in any given situation. A “we” composed of seven Helsinki-based Linux developers would most likely arrive at very different answers than the United States Air Force Materiel Command or Samsung’s board of directors, right? So clearly, a first challenge is getting to some kind of pragmatically useful alignment between those local and occasionally even painfully parochial perspectives with what’s best for the Big We. And this challenge is only going to become more vexing as the ability to imagine, design, build and deploy informatic componentry gets more and more widely distributed. In this respect the spread of simple, modular, low-barrier-to-entry tools only makes things worse!

The primary issue that I can see here is that the inherent clock speed of technical development is so very much faster than that of any meaningful deliberative process “we” might bring to bear on it. A concomitant concern is that the sources of technical innovation and production are now so widely distributed that you can be reasonably certain that somebody, somewhere will implement any given technically feasible idea, no matter how offensive, poorly thought-out, socially disruptive or frankly stupid. A public toilet you have to SMS to unlock and use? A “Friend Finder” visualization with high locational precision and no privacy features whatsoever? A first-person rape-simulation “game”? A clunky brown iPod knockoff? Somebody thought each one of these things was worth the time, expense and effort to actually go about making it. They exist.

But I’m pretty old-fashioned in some ways, in that I think the good old Habermasian idea of the public sphere still has some life left in it. And I think it should be self-evident by now that there’s no necessary contradiction between even the newest (cough) “social media” and the formation of such a sphere. So you’ve provided a forum, and in it I get to express my belief that these things are stupid and pointless and probably should not have been built. And if somebody gets all het up about that, they can argue right back at me in comments. And eventually one or another of these positions begins to tell, in terms of regulation, legislation, and other tools of the juridical order, in terms of protest campaigns or organized boycotts or litigation…in terms of nonexistent sales!

There’s nothing new in any of this, of course, though indubitably some of the dynamics are amplified or accelerated by e-mail, Twitter and YouTube. My main contention is that informatic technology now has such deeply pervasive implications, and for things like presentation of self that previous waves of technical development barely touched, that “we” as societies need to be very much more conscious of the consequences before committing to any one course of action.

I should also point out that I do not, at all, believe that we’re “in an age where we can build almost anything we can imagine,” though I might buy “…two or three of almost anything we can imagine.” On the contrary, as I implied above, I think the global constraints on our ability to operate freely are already becoming quite evident, and will continue to grow teeth over the next few decades.

TS: Also Usman  added …

Usman Haque: ..where Adam said: in this regard, I very much *do* have a problem with “just showing up.” — something I feel that as well. but i always wonder: What happens when one appears to be mandating participation…?

AG: Look, I happen to have a strong – maybe some would say obnoxious or hyperactive or overdeveloped – sense of personal responsibility and accountability. I think one is basically committed to some measure of responsibility for the commonweal simply by surviving to the age of majority. The choice of how, particularly, to discharge that responsibility can only be yours and yours alone, but it can’t be ducked or gotten around without severe and entirely predictable consequences. So to Usman I’d respectfully suggest that I’m not the one mandating participation. Life is.

TS: It seems we have grown accustomed to striking a Faustian bargain on the internet today -  in order to share and distribute parts of our identity we are expected to give up key information to one site to store and disperse our data. I took part in a discussion with David Levine, IBM and Eben Moglen on privacy last year.  And Eben Moglen gave a succinct description of the elements of privacy and how they have been treated in the American Constitution that is, I think, relevant to unpacking some of the challenges of ubiquitious computing. Here are some extracts from that conversation where, Eben notes:

there are three elements that are mixed up in privacy and we tend not to notice which one we are talking about at any given moment.

There is secrecy – that is the data should not be readable by or understandable by anybody except me or people I designate. There is anonymity which is the data can be seen by anybody but about whom it is should be knowable only by me or people that I designate. And there is autonomy which isn’t about either secrecy or anonymity but which is about my right to live under circumstances which reinforce my sense that I am in control of my own fate. And this form of privacy is actually the one we talk about in the constitutional structure when we talk about the right to get an abortion or use birth control.

“Anonymity” is a condition that is a deep structuring characteristic of the internet as you, Lessig and others have commented on.  And frequently we are promised (questionably) “secrecy” or anonymity as privacy protection by services handling our data on the internet.  But Eben (one of the US’s great constitutional lawyers) points out that “autonomy” is a key form of privacy in the  US constitutional structure that is often compromised in situations where our digital selves may constrain our non-digital selves.

The real issue here is about the forcing of choices on us…digital aspects of identity can quickly acquire an inflexibilty that constrains our non-digital selves.

I see again and again the ways in which people now find themselves unable to make certain life choices easily because there digital self has acquired an inflexibility that constrains their non-digital self.

As we go beyond the end to end internet and we lose the structuring characteristic that has privileged anonymity: How do you see these three elements of privacy, anonymity, secrecy and most importantly autonomy, being worked out in a networked world beyond the end to end internet?

Are there any new structuring characteristics that could privilege autonomy? (which Eben indicates is linked to having a flexible identity).

AG: If we accept for the moment a definition of autonomy as a feeling of being master of one’s own fate, then absolutely yes. One thing I talk about a good deal is using ambient situational awareness to lower decision costs – that is, to lower the information costs associated with arriving at a choice presented to you, and at the same time mitigate the opportunity costs of having committed yourself to a course of action. When given some kind of real-time overview of all of the options available to you in a given time, place and context – and especially if that comes wrapped up in some kind of visualization that makes anomaly detection and edge-case analysis instantaneous gestalts, to be grasped in a single glance – your personal autonomy is tremendously enhanced. Tremendously enhanced.

But as to how this local autonomy could be deployed in Moglen’s more general terms, I don’t know, and I’m not sure anyone does. Because he’s absolutely right: Bernard Stiegler reminds us that the network constitutes a global mnemotechnics, a persistent memory store for planet Earth, and yet we’ve structured our systems of jurisprudence and our life practices and even our psyches around the idea that information about us eventually expires and leaves the world. Its failure to do so in the context of Facebook and Flickr and Twitter is clearly one of the ways in which the elaboration of our digital selves constrains our real-world behavior. Let just one picture of you grabbing a cardboard cutout’s breast or taking a bong hit leak onto the network, and see how the career options available to you shift in response.

This is what’s behind Anne Galloway’s calls for a “forgetting machine.” An everyware that did that – that massively spoofed our traces in the world, that threw up enormous clouds of winnow and chaff to give us plausible deniability about our whereabouts and so on – might give us a fighting chance.

TS: The concept of autonomy is signaled clearly in the title you have chosen for your next book, The City Is Here For You To Use, and is a theme of all your writing!  While you talk about many of the possible constraints to presentation of self and potential threats to a flexible identity that ubicomp poses, your next book signals optimism. What are your key grounds for optimism?

AG: It’s not optimism so much as hope. Whether it’s well-founded or not is not for me to decide. I guess I just trust people to make reasonably good choices, when they’re both aware of the stakes and have been presented with sound, accurate decision-support material.

Putting a fine point on it: I believe that most people don’t actually want to be dicks. We may have differing conceptions of the good, our choices may impinge on one another’s autonomy. But I think most of us, if confronted with the humanity of the Other and offered the ability to do so, would want to find some arrangement that lets everyone find some satisfaction in the world. And in its ability to assist us in signalling our needs and desires, in its potential to mediate the mutual fulfillment of same, in its promise to reduce the fear people face when confronted with the immediate necessity to make a decision on radically imperfect information, a properly-designed networked informatics could underwrite the most transformative expansions of people’s ability to determine the circumstances of their own lives.

Now that’s epochal. If that isn’t cause for hope, then I don’t know what is.

Newson Obamanook – photo by Adam Greenfield, “The fact that it was one of the happiest days of my adult life may have colored my appreciation of this space. A bit, anyway.”

TS: In your writing you seem to imply that we will not find answers to our new relationship with Everyware by transposing the internet onto things for convenience’s sake but rather like the bike messengers -  we must explore the rich and complex terrain of the city that is ours to use in a give an take relationship.  Through our own exertions we find- how “anything reasonably smooth and approximately horizontal can become a thoroughfare,”  rather than be served up the city as something for us to consume.

You seem to be suggesting our city becomes ours to use because of the way we use it in our personal journeys -like “the messenger subconsciously maps the contours of an economic geography – known sources and sinks of courier assignments, or “tags” – and a threat landscape, this latter comprised of blind corners, cable-car and metro tracks, and traffic lanes.

But bike messengers are the lone ranger of our big cities. Others surf the city in tribes that ride the roiling tides of highly networked information together. How are the “natural” gestures of these tribes, e.g. day traders, who yoked to the tracings of a hive mind, part of the city that is here for us to use?  I thought the comment @ginsudo made shortly after joining Twitter and setting up TweetDeck particularly poignant:

“watching Tweetdeck is like watching stock market of your personality ebb and flow. needs analytics to maximize inherent self-involvement.”

But, for many of us our work has more in common with the day trader than the bike messenger, and are we pretty hooked on the ever growing possibilities for “contact” and identity sharing/construction, social media has produced  (with all the”Here Comes Everybody,” C. Shirky, benefits and risks).  Early theorizing of a “calm,” invisible” ubicomp seems out of synch with the excitable, active, engaged, contact driven, “users” that are watching stock market of their personality (or personal brand) ebb and flow.

How will these excitable/exciting processes of contact and identity sharing that have captured of a pretty large segment of popular imagination (not confined to the West -services like Gupshup does much of the same curating, linking and distributing of identity that web based social media does in SMS) be/ or not be part of The City Is Here For You To Use?

AG: Let’s remember that ubicomp itself, as a discipline, has largely moved on from the Weiserian discourse of “calm technology”; Yvonne Rogers, for example, now speaks of “proactive systems for proactive people.” You can look at this as a necessary accommodation with the reality principle, which it is, or as kind of a shame – which it also happens to be, at least in my opinion. Either way, though, I don’t think anybody can credibly argue any longer that just because informatic systems pervade our lives, designers will be compelled to craft encalming interfaces to them. That notion of Mark Weiser’s was never particularly convincing, and as far as I’m concerned it’s been thoroughly refuted by the unfolding actuality of post-PC informatics.

All the available evidence, on the contrary, supports the idea that we will have to actively fight for moments of calm and reflection, as individuals and as collectivities. And not only that, as it happens, but for spaces in which we’re able to engage with the Other on neutral turf, as it were, since the logic of “social media” seems to be producing Big Sort-like effects and echo chambers. We already “maximize inherent self-involvement,” analytics or no, and the result is that the tools allowing us to become involved with anything but the self, or selves that strongly resemble it, are atrophying.

So when people complain about K-Mart and Starbucks and American Eagle Outfitters coming to Manhattan, and how it means the suburbanization of the city, I have to laugh. Because the real suburbanization is the smoothening-out of our social interaction until it only encompasses the congenial. A gated community where everyone looks and acts the same? That’s the suburbs, wherever and however it instantiates, and I don’t care how precious and edgy your tastes may be. Richard Sennett argued that what makes urbanity is precisely the quality of necessary, daily, cheek-by-jowl confrontation with a panoply of the different, and as far as I can tell he’s spot on.

We have to devise platforms that accommodate and yet buffer that confrontation. We have to create the safe(r) spaces that allow us to negotiate that difference. The alternative to doing so is creating a world of ten million autistic, utterly atomic and mutually incomprehensible tribelets, each reinforced in the illusion of its own impeccable correctness: duller than dull, except at the flashpoints between. And those become murderous. Nope. Unacceptable outcome.

Uncanny Valleys - Adam comments,”Our apartment in NYC as rendered in Google Earth, with realtime traffic, weather, daylight and shadow as well as geodetic, street grid and service overlays. Camera view is South; that’s First Avenue just left of center-screen.”

TS: Smart phone’s are now drawing everyware data into the system and the net is reaching into who YOU are, WHERE you are, WHAT you are doing, WHAT is around you, etc..

Nathan Freitas says Android: “seems to be the platform most likely to socialize the idea that sensor data could be a piece of every application.” (Android APIs for a wide range of sensor data.)

What in your view will be the most likely platform, Android or what?, to socialize the idea that sensor data could be a piece of every application?

AG: An open platform. A platform with lots of hooks and ways to plug things into it, a strong developer community, a shallow learning curve and/or an easy-to-use, high-level development environment.

I don’t have a dog in this race, mind you. I couldn’t care less who gets there first.

TS: New location based services, e.g., Xtify and ViaPlace, are offering us ways to share location data across lots of different applications (eg Xtify and a dating application like MeetMoi ). In return for services that allow us to share information, we must give up key information up to one site to store and disperse (although there are many differences in approach to our data, from the Twitter stance “show but don’t own” as opposed to Facebook’s stance – “in order to show we must have rights to it”). But the basic model of Twitter – to provide a white noise platform for people to build service on top off seems to be being transposed to location based services. Obvious questions arise like what happens to our data in a start up like MeetMoi if they go belly up?  Apparently in the dot.com bust data was the first thing to go on the auction block in bankrupcy cases.

Also, I suppose it is hardly surprising (if disappointing to me) that some of the early location based services are trying to get mindshare by picking up on the glue celebrities give to mass culture. At the last New York Tech Meetup, OMGICU demoed a rather terrifying new pre-launch location based “participatory celebrity gossip application” which seems to combine all the worst features of social media with celebrity stalking, plus a narrative to change the notion of celebrity itself by “turning D listers into A listers.”

Hopefully location based applications  will not get stuck on “stalker, stalker, stalker” apps like OMGICU .

David Oliver, Oliver Coady gave me a good question: “How does timeliness and location-independence change our ideas of social media?

And how can we design new architectures that can reinforce the sense that I am in control of my own fate?

AG: But we’ve already come so far in terms of turning D-listers into A-listers! On a daily basis, I’m exposed to almost as many cues insisting I attend to nonentities and dullards like Robert Scoble as those insisting I attend to nonentities like Madonna or Thomas Friedman. It’s gotten ridiculous.

Now, how does timeliness and location change our ideas of social media? It makes them dangerous!

Look, even a proud Z-lister like myself – I’m a public person only in the most debased and degraded meaning of that word – I’ve had experiences that shook me up, like having someone approach me while I was quietly hanging out in the back of St. Mark’s Books, and wanting to strike up a conversation based on some talk they’d seen me give a year or so previously. Now part of learning to deal with this kind of thing is shrugging it off, being grateful and flattered that someone thinks you’re interesting enough to single out for that kind of attention, or chalking this up to Sennett’s observation about the constitution of urbanity. Or doing all three at once.

But let’s remember that at the end of the day, a “social network” is nothing but a group of arbitrarily distributed human beings joined by a communications channel, and those people have eyes and ears. The degree to which they recognize some shared interest gives them significance filters. If social capital accrues to those in the network who are able to claim some connection with a “celebrity,” no matter how fleeting, then such connections are going to be mobilized, made explicit. And now say the network has been provided with the tools allowing it to plot the appearances of those putative celebrities in space and time, and what do you get? You get a circumstance in which it is very, very difficult to maintain any membrane between the private self and the world, for anyone who’s even remotely a public figure, whether they particularly want to be a public figure or not. You get network effects that amplify those locational traces, and further undermine any possibility of anonymity, even anonymity-by-suspension-of-interrogative-awareness (which is a clumsy way of referring to that blasé matter-of-factness around famous people that most big-city folks eventually develop).

Am I letting myself off the hook? Not in the slightest. I passed Terence Stamp on the street not so long ago, and you bet I Twittered it. My only excuse was that I Twittered it to a closed loop of no more than a few dozen people. But then, who knows what those few dozen people will turn around and do with that fact, on the open networks to which they in turn belong? And that, too, is my responsibility.

I’m not sure there’s anything to be done about any of this but cultivate our own urbanity, learn to say “so what” when we happen to find ourselves next to Philip Seymour Hoffman in the line at Whole Foods.

TS: Zittrain in The Future of the Internet: And How To Stop It, foregrounds “generativity” and a generative devices (as opposed to appliances) as the most fortuitous starting point for: “tools to bring about social systems to match the power of the technical one.”

Are appliances a threat to the city that is here for you to use? How can generativity ensure The City Is Here For You To Use as Zittrain argues it has ensured, even if imperfectly, that the internet has been here for us to use?

AG: You know, I haven’t read the book, I’ve only heard him give the talk, so it’s certainly possible there’s a subtlety to the argument that I’m missing. But I’m not sure Jonathan isn’t simply wrong about this notion of generativity. Not that the concern is misplaced, but that he’s insufficiently trustful in human agency. Is a car “generative,” by his definition? Certainly not. And yet look at all the cultural production that goes on around “the car,” look at all the assemblages people make with cars, from Beach Boys songs to ghost riding the whip, from J.G. Ballard novels and Herbie the Love Bug to Tokyo Drift.

Or probably more to his point: look at the Japanese mobile-phone market – seemingly one of the most locked-down and unpropitious circumstances imaginable for the production of culture, in technical terms and Zittrain’s both. And yet fully 50% of the bestselling books in Japan last year were written on mobile phones. Not read, which would already be impressive enough (if “impressive” is indeed the word): written. What does that imply for his argument?

So, yes, I think there are grounds for concern in that we don’t allow technologies and frameworks to appear that unduly limit the scope of human creativity. Code is still law. But I also think people are quite amply able to reach into what would appear to be the least propitious technologies and tell their own stories with same.

TS: One aspect of Everyware that seems in need of some visionary yoga is the how we will relate to pixels anywhere.

In Urban Computing and its Discontents you mention how our technological trajectories often make it seem as if we seem to get fixated on particular scenes in movies, e.g., Minority Report. You point out that so many ambient informatics projects seem simply “to expand the reach of signage and advertising in dense urban spaces….as if we’ve become transfixed by the scene from Minority Report where heterosexual cop John Anderton is on the run from his colleagues.”

Ideas from the Minority Report continue to hold sway in designs as we saw in the recent MIT demo of SixthSense at TED.

But visions of augmented reality were pretty high profile in this years Super Bowl commercials this year (including a highly anthropomorphic imagining of ubicomp that was a kind of WoW mashup with a Pixar movie).

What recent movies/commercials have produced scenes mostly likely to be are new fixation fodder for ubicomp and why?

AG: I don’t think I’m qualified to answer that, actually. We don’t have a TV, so I don’t see much in the way of commercials, and most of the films I wind up seeing are the kind that play at Anthology Film Archives. What I can say is that science fiction is currently suffering in toto from an inability or disinclination to posit future scenarios that are any weirder or more visionary than those emerging from other sectors of the culture. And that would be fine, except sf has traditionally been the place where we wrestled with the imaginary.

We need that set of tools, badly. If for no other reason than something I glean from personal experience: essentially my entire professional career has simply been the leveraging of ideas and concepts I originally wrestled with in the encounter with William Gibson and Bruce Sterling when I was 16. Today’s visionary sf means tomorrow’s halfway-competent generalist.

Nurri Kim in the waiting zone – photo by Adam Greenfield

TS: My AR friend, Robert Rice, who is working on a markerless AR platform, notes that data visualization is one of the critical elements of AR in terms of “make or break.” Robert says, “even with the ultimate in ubiquitious data from everything, without good data vis it will all be useless”

Also something Cory Doctorow said to me last year has really stuck in my mind. When I asked him what happens when Cyberspace everts, he talked about a reverse surveillance society:

Cory: Well this is like Spook Country the new Gibson novel – What happens when cyber space everts – hmmm? I’m not sure I have anything very pithy to say on that EXCEPT………
Apart from all the traditional kind of overlay reality stuff, if there is one thing I am actually interested seeing from a virtual world migrating to the real world its instrumentation.
I think lot of things that are characteristic of very successful internet based business is that they are extremely finally instrumented so like Amazon knows in aggregate on a second by second basis how their site is being used by people and they can twiddle the dials in real time.

As users of the world we have very little access to that kind of instrumentation. We don’t even know how the tube is running. The tube knows how the tube is running and we kinda of don’t. I would be really interested in seeing that. You’ve seen Joi Ito’s WoW interface right. Have you seen it …

Joi Ito’s WoW interface seems a long way from the calm, invisible imaginings for ubicomp by early ubicomp visionaries?

AG: Well, he’s got a particular kind of neural wiring. And there’s not a thing that’s wrong with that, except that I’d never, ever want to assert that what’s appropriate for Joi Ito necessarily is or should be understood to be appropriate for anybody else. The point of calling for open systems and frameworks is to allow us maximum scope of diversity in the ways we choose to interface with the world’s richness and complexity.

TS: What new imaginings/possibilites do you see when pixels anywhere are linked to everyware?

AG: Product placement. Commercial insertions and injections, mostly.

Beyond that: one of the places where Mark Weiser logic breaks down is in thinking that the platforms we use now disappear from the world just because ubiquitous computing’s arrived. We’ve still got radio, for example – OK, now it’s satellite radio and streaming Internet feeds, but the interaction metaphor isn’t any different. By the same token, we’re still going to be using reasonably conventional-looking laptops and desktop keyboard/display combos for awhile yet. The form factor is pretty well optimized for the delivery of a certain class of services, it’s a convenient and well-assimilated interaction vocabulary, none of that’s going away just yet. And the same goes for billboards and “TV” screens.

But all of those things become entirely different propositions in everyware world: more open, more modular, ever more conceived of as network resources with particular input and output affordances. We already see some signs of this with Microsoft’s recent “Social Desktop” prototype – which, mind you, is a very bad idea as it currently stands, especially as implemented on something with the kind of security record that Windows enjoys – and we’ll be seeing many more.

If every display in the world has an IP address and a self-descriptor indicating what kind of protocols it’s capable of handling, then you begin to get into some really interesting and thorny territory. The first things to go away, off the top of my head, are screens for a certain class of mobile device – why power a screen off your battery when you can push the data to a nearby display that’s much bigger, much brighter, much more social? – and conventional projectors.

Then we get into some very interesting issues around large, public interactive displays – who “drives” the display, and so forth. But here again, we’ll have to fight to keep these things sane. It’s past time for a public debate around these issues, because they’re unquestionably going to condition the everyday experience of walking down the street in most of our cities. And that’s difficult to do when times are hard and people have more pressing concerns on their mind.

Citywarecrash – photo by Adam Greenfield, “An occupational hazard for urban screens.”

TS: I know in Everyware you mentioned that architects have play an important visionary role in imagining ubicomp and I know you work closely with your wife, artist Nurri Kim.  Robert Rice asked me the following question – which I will in turn ask you: “In terms of augmented reality do you think virtual worlds and virtual reality experts / leaders / are good pioneers for thought and guidance on AR? Or, should we look for new leaders, or where are new leaders emerging? Is the tech similar enough for the old crowd to be useful or is it different enough to be a disadvantage coming from the old models?.”

AG: I should make it clear that I have absolutely no interest in virtual worlds or virtual reality. The so-called virtual worlds I’ve experienced seem sad and really rather tatty – eversions of the most predictable adolescent fantasies of unlimited power, reinscriptions of all the usual politics – and completely lacking in just about everything that makes life resonant, meaningful and awe-inspiring. And anyway, to paraphrase J.G. Ballard, ordinary, everyday life is now far more vividly and fantastically weird than anything you’ll see in Second Life. I mean, Garry Kasparov was heckled by a radio-control dildocopter, Joe the Plumber’s off to Gaza as a war correspondent, a sea of dust-covered BMWs waits in the long-term parking lot at Dubai International for owners who are never, ever coming back.

Look to virtual worlds for insight into the hard work of negotiating the actual, with its physics, its entropy, its suffering, with all its constraints? Oh my goodness gracious, no.
And look to leaders? Never. Leaders are for followers, and who wants to be that? I don’t mean you can’t take inspiration and insight from the work of others – not at all – but use your own imagination, take some personal risk, do your own damn work.

Now, having said that. This opposition of virtual and physical worlds strikes me as increasingly a false one, as it does many people. The hard-and-fast distinction between “the real world” and virtual environments make less and less sense, as righteously satisfying as making it can sometimes seem. There may be attributes of this physical environment that are impossible to see or make use of without access to the networked overlay, and those attributes may in time come to constitute the primary wellsprings of a given place’s meaning. And if you’re offering me some insight that I think could be of utility in resolving the challenge of making this overlay accessible to all, equally, I’ll gladly accept it, no matter what domain or disciplinary background you claim as your own.

Am I aware of any such insight coming out of virtual worlds? No. As Bryan Boyer notes, “If you want to start talking about some serious cross-disciplinary pollination then you better take both sides of that disciplinary divide seriously. When your ubi- runs into my building with its boring HVAC, mundane load paths, typical finished floors, plain old foundations, etc., the transformative powers of comp are bracketed pretty seriously by the realities of the physical world.”

The Cloud Gate has landed – photo by Adam Greenfield, “Tell me this doesn’t look *just* like the descriptions of “stasis fields” in 70s SF. In fact, the picture looks practically CGId to me.”

TS: Some people thought the whole world would have been plastered with RFID by now.  But before that has happened markerless AR seems to be in our sights.

If I understand it correctly marker versus markerless AR has quite different implications for how the cyberspace of ubicomp evolves?  I asked Robert Rice (he is developing a markerless AR platform) to explain some of the differences.  He said:

Robert also pointed out to me that markerless AR may prove even more problematic for privacy:

Do you have any thoughts about the different roles that markerless versus marker techinologies will play in AR and Ubicomp?

AG: I need to admit that I’ve never until this moment heard the phrase “markerless AR,” although I’d think it’s more or less self-explanatory to anyone who’s been following this stuff. Let me make the distinction explicit, shall I, for anyone who hasn’t been? And you or Robert can correct me if I’ve gotten it wrong.

Augmented reality means that I have some mediating artifact that provides me with a visual overlay on the world. This could be a phone, it could be a windshield, it could be a pair of glasses or contact lenses, doesn’t matter. And you’re going to use that overlay to superimpose some order of information about the world and the objects in it onto the things that enter my field of vision – onto what I see. So far, so good: that’s AR 101.

Now where does that information come from?

What you’re calling marker-based AR implies that there’s some reasonably strong relationship between the information superimposed over a given object, and the object itself. That object is an onto, a spime, it’s been provided with a passive RFID tag or an active transmitter. And it’s radiating information about itself that I’m grabbing, perhaps cross-referencing against other sources of information, and superimposing over the field of vision. Fine and dandy.

But there’s another way of achieving the same end, right? Instead of looking at a suit jacket on a rack and having its onboard tag tell you directly that it’s a Helmut Lang, style number such-and-such from men’s Spring/Summer collection 2011, Size 42 Regular in Color Gunmetal, produced at Joint Venture Factory #4 in Cholon City, Vietnam, and packed for shipment on September 3, 2010, you’re going to run some kind of pattern-matching query on it. And without the necessity of that object being tagged physically in any way, you’re going to have access to information about it. But this set of information isn’t, necessarily, what the object itself, or its creators or merchandisers, want you to know about it; it could be derived from online discussion fora or review sites, or blog posts, or whatever. All there needs to be is a lookup table, essentially, that tells you where to find information about any object in the field of vision whose identity can be established.

Do I have that right? And if I do, then as I understand it, the distinction is primarily a pragmatic one: it’s just easier to get to an augmented world, by far, if we don’t actually have to go to all the trouble of tagging everything in the world with its own dedicated RF transponder. Easier, and cheaper, and quicker, and more environmentally sound besides, because the relevant traffic is in bits not atoms.

Unless I’ve missed something, you don’t, then, get the distinction between classes of objects and instances of same. Sometimes, when there’s a 1:1 correlation between the two, that’s not going to matter: I’m walking down the street in Madrid, and my glasses or whatever can easily recognize that this building is the Caixa Forum. There’s only one of it, and I can get a positive ID via pattern recognition. But for some edge cases – twins and lookalikes, mostly – the same thing is generally true of people.

But other times it will matter. Is this specific watch a real, $10,000 Panerai or a $50 Kowloon fakery? How has this black 1998 Honda Civic over here differ from this other one in terms of its use and maintenance history? Does this O-ring gasket need to be replaced? I don’t see how you extract data from specific instances of things without the necessary sensor instrumentation, transmitter, etc., being coextensive with the object in question or very closely colocated with it over time – in the terminology you’re using, a “marker.”

So using these terms, I’d say that “markerless” AR comes first, is relatively easy to deploy, and generates not-insignificant value. But – again, unless I’m missing something – there are some things that it won’t ever be able to do, and for those things you need some provision for self-identification and self-location.

Ultimately I think it’s a distinction without a difference, from the user’s point of view. People will care much more about the source of whatever information shows up on their overlay than the precise technical means used to get it there.

The surrender to cynicism – photo by Adam Greenfield

TS: Much early thinking around ubicomp seems to have come from visionary architects and engineers but recently I was at the O’Reilly Tools of Change for Publishing Conference (publishing in the Digital Age) and I met several book futurists.  It struck me how ubicomp from the perspective of the book created some interesting questions for how particular material cultures will shape and be shaped by Ubicomp differently.

I noted, Google seemed well down the path to holy grail “converting images to original intent XML.” And Peter Brantley talked about machine parsed books.

At TOC there were many suggestions about how books might manifest as everyware. (Although it did not seem that many people felt books had a special relationship to time and history and would not vanish as one of the great metaphors of calm and solitary enjoyment in our culture soon).  Books as everyware will, it seems, include, amongst other things:

books that read books

books that read context

context that reads books

books that read me

books linked to mobility – timeliness and location independence

books that are not books

books becoming babble

books bubbling up from the babble

There is an Institute of the Future of the Book. Will all former material cultures require their own institutes of the future to guide their cultures into everyware?  Do you think books transition into everyware is especially significant and why?

AG: But all objects have a relationship to time and history, no?

TS: Yes! What I meant to convey really was the idea that many people expressed at TOC that books had a privileged relationship to knowledge in our culture that was valuable and related to some aspects of their current form, and that books as everyware, e.g. machine parsed books, and more sociallly generated forms would not replace that entirely.

AG: Gotcha. Well, I certainly agree that books constitute an interesting category unto themselves – I’ve held onto my physical books, and in fact still spend a fortune buying new ones, where I stopped buying music on discs a long, long time ago. But I don’t think this state of affairs can or should obtain forever.

Lately there’s been a good amount of thought around the notion of “unbooks,” which I regard as a container for long-form ideas appropriate to an internetworked age. By building on some of the tropes of software development, mostly having to do with version control, open-endedness and an explicit role for the “user” community, unbooks can usefully harness the dynamic and responsive nature of discourse on the Web. At the same time, you preserve the things books are really good at: coherence, authorial voice and intent.

The important part is in acknowledging two points which have usually been understood as contradictory, but which are actually nothing of the sort: firstly, that the expression of ideas in written form has something to learn from the practices that have evolved around the collaborative creation of dynamic, digital documents over the half-century-long history of software; and secondly, that certain ideas require elaboration in the reasonably strongly-bounded form we know as a “book,” and cannot meaningfully be shared otherwise. A third point, concomitant to the second, is that despite recent technical advances, screen-based media still cannot, and may not ever fully be able to, deliver the extratextual cues and phenomenological traces that support, inform and extend the meaning of written documents.

The unbook lets you have your cake and eat it too. So, for example, when we publish The City Is Here, one of its manifestations will be a static, physical document – and hopefully, if we do our jobs well, a very nice one indeed. But even before that, you’ll be able to download a Creative Commons-licensed PDF of every numbered version of the manuscript, from zero onward. Bottom line: you buy the book if, and only if, you want the object. The ideas are free.

TS: David Brin sees two futures:1) the government watches everybody, and 2) everybody watches everybody (the latter he calls “sousveillance”).  My friend Ben Goertzel says “hooking AI up to a massive datastore fed by ubicomp is the first step toward sousveillance?” What do you think the role of AI in ubicomp will be?  Is it worth thinking about what is the first important “AI meets AR” app is?

AG: I don’t believe that artificial intelligence as the term is generally understood – which is to say, a self-aware, general-purpose intelligence of human capacity or greater – is likely to appear within my lifetime, or for a comfortably long time thereafter.

Having said that, your friend Ben seems to be making the titanic (and enormously difficult to justify) assumption that a self-aware artificial intelligence would share any perspectives, goals, priorities or values whatsoever with the human species, let alone with that fraction of the human species that could use a little help in countering watchfulness from above. “Hooking [an] AI up to a massive datastore fed by ubicomp” sounds to me more like the first step toward enslavement…if not outright digestion.

Sousveillance - the term is Steve Mann’s, originally – doesn’t imply “everybody watching everybody” to me, anyway, so much as a consciously political act of turning infrastructures of observation and control back on those specific institutions most used to employing same toward their own prerogatives. Think Rodney King, think Oscar Grant.

TS: I have one last question from Usman Haque.

Usman Haque: insofar as a lot of what adam describes as desirable could be said to constitute pretty radical socio-political change (or perhaps… “adjustment”) i would be really interested to know how his current work @ nokia is or isn’t able to gel with the themes of his writing. in some senses there’s quite an undercurrent strongly challenging corporate practices, in other senses it could be seen as gentle nudges. how does adam see it? and how about the nokia behemoth? does he have success nudging nokia towards the kind of world he would like to see (i imagine the answer is ‘yes’ otherwise he wouldn’t be doing it…) but i’d love to know more about the limits/challenges.

AG: I am told that Henry Kissinger, on his first trip to China in 1971, asked Zhou Enlai whether he thought the French Revolution had or had not advanced the cause of human freedom.
Zhou thought for a moment, pursed his lips, and replied, “It is too soon to tell.”

In a conversation with Tim O’Reilly and John Battelle (Federated Media Publishing) at Web 2.0 Summit 2008, Al Gore suggested that only the aggregate bandwidth of the internet could supply us with the kind of emotional intelligence we need to respond with appropriate urgency to the challenges of our times, for example, the CO2 targets necessary to avert catastrophe.

“People hear these things, and there are many other similar signals, and then the next day it’s gone. Now the neuroscientists have explanations for why that is ….. The urgency center of the brain is geared to snakes, spiders and fire and things that evolution posed as tests to our species…

But when we have to use our neo cortex to connect dots in an abstract pattern and then push that down to the urgency and fear center – that’s just a little footpath.

Its  like the internet, mostly, it’s an asynchronous connection.  There is a big connection going from the fear center to the reasoning process but just a very small pathway coming back.

It needs to be stored in the cloud. It is the aggregate bandwidth than counts. We need to have the truth – the inconvenient truth, forgive me, of this challenge stored in the cloud so that people don’t have to rely on that process and so that we can respond to it collectively.”

Tim O’Reilly responded: “Who knew you were the guru of Web 2.0 as well as global warming. You have totally outlined our premise here.”

(Photograph opening this post of the Former Vice President Al Gore on stage with Tim O’Reilly and John Battelle at  Web 2.0 Summit 2008, co-presented by O’Reilly Media and TechWeb. Produced by Good Company Communications. Photograph copyright James Duncan Davidson – see Duncan Davidson’s Flickr stream for a complete photo essay of the event.)

I was trying to find a word to express how powerfully  Al Gore addressed the Summit audience.  And I was discussing this with a legendary serial entrepreneur, Richard Titus, who is also a great admirer of Al Gore, at the closing party. Richard came up with the phrase I was seeking.  “He was totally naked,” Richard said.

Al Gore described himself as a recovering politician.  And yes, he seems totally recovered from the “woodeness” of politics and utterly at home with the “nakedness” of participatory culture.

Al Gore made clear that to change the world we have to change ourselves (he did).

Bertrand Russell is often attributed with the following quote:

The mark of a civilized human being is the ability to read a column of numbers and then weep.

Gore’s exhortation that the internet needs to be a puppy with a purpose resonated with his audience.  From climate change, global issues of health care, to rethinking global economies we desperately need to optimize our collective and individual intelligence.

Instrumenting the World: Life on the Cloud

Kevin Kelly’s  High Order Bit – a brilliant impressionist view of the internet’s next 6537 days describes what “Life on the cloud” will be like.

“If you are producing some information and it is not webized, i.e., it is online and not related and shared to everything else, it doesn’t count.”

This is already the case to some degree. And the challenge of understanding where our networked identities begin and end is with us. But Kevin Kelly points out, “life on the cloud” will heighten our dilemmas.

Nat Torkington’s presentation to the Privacy Forum in Auckland , New Zealand, “Web Meets World: Privacy and the Future of the Cloud” looks at our changing idea of identity through the lens of privacy – both “the nature of privacy” and “how expectations change over time.”  Nat cites William Gibson (interviewed by Rolling Stone on their 40th Anniversary):

“One of the things our grandchildren will find quaintest about us is that we distinguish the digital from the real, the virtual from the real.  In the future that will likely become impossible.”

The critical layer between this database of things and the ultra, mega cloud (see Kevin Kelly’s slide below) is the web of shared intelligence. This is where the transformation will emerge with its dangers and opportunities.

Brian Solis, in his excellent post, “Barack Obama, The Social Web, and the Future of User Generated Government,” proposes Zappos and their “public and transparent customer-focused culture” is a good model for how government can use the internet not only to push out its message but to create a whole new culture of participation.

Far fetched?  Watch Tony Hsieh’s High Order Bit for yourself. The idea that every interaction at Zappos has relevance to the value exchange between consumers and producers is a very interesting idea to apply to the relationship between government and citizens.

“Ecological Intelligence”

Instrumenting the World requires new models of data sharing. Last year, Cory Doctorow described to me an instrumentation model of data.

An Instrumentation model for data differs from a surveillance model of data sharing.  Instrumentation is “when you know a lot about the world,” in contrast to surveillance – “when people in authority know a lot about you”.

(Note: Mashable has an interesting post on the theme of a “instrumentation,” see:  Seventeen Killers Apps for Taking Control of Your Government:“Government is increasingly putting much of its public records online, creating opportunities for developers to build useful applications for citizens.”)

But corporate culture and governments around the world have embraced the surveillance model of data up to now.  I was fortunate to have the opportunity to ask Larry Brilliant, Google.org, a question about how the tables might get turned.  After his conversation with Tim O’Reilly,  I asked:

“What would motivate corporations and governments to participate in the kind of data sharing and transparency that could produce the changes that our world needs, particularly in the area of health and climate change? For example, why would corporations reveal the aspects of products we use and the food we eat that have negative effects on our health and our planet?” (This is more succinctly phrased than my original question!)

Larry Brilliant replied:

“I don’t know how many of you know Dan Goleman? He created emotional intelligence [quotient] – EQ. He is coming out with a book which I have just had the pleasure of reading in draft form which deals specifically with what you are talking about.

How we can have commercial intelligence. How we use the power of corporations and their various different stakeholders, including their customers to drive corporations to do the morally right thing by losing the commercial support of customers who won’t support them unless they are more green, fairer to women, respect gay and lesbian rights, do the things you would like them to do whatever that happens to be, so that you can vote with your dollars.

It is really a fascinating book:  “The Application of Ecological Intelligence to the Commercial World.”  I don’t know what the final title will wind up being but I recommend it to you.

Dan Goleman’s new book: “Ecological Intelligence: How Knowing the Hidden Impacts of What We Buy Can Change Everything,” will come out in April, 2009.

An Extraordinary Gathering At An Historic Time

Web 2.0 Summit was a brilliantly orchestrated gathering of many of the thought/business leaders and entrepreneurs who have shaped the internet as we know it today.

As my friend Jonathan Hochman, Wikipedia, said on Day 1:

“If everyone here [Web 2.0 Summit] shut down their website it would be the end of the internet!.” (See my upcoming interview with Jonathan on Wikipedia and Jon Brouchard on Wikitecture and what these projects can teach us about participatory culture).

But also in this elite crowd of “C” level execs were the next generation of entrepreneurs who are working on a hunch and prayer to create the future Web.

And this year, as the Web 2.0 Summit architects explained in their intro, the decision was made to extend the scope of the Summit even further:

“….our world is fraught with problems that engineers might charitably classify as NP hard—from roiling financial markets to global warming, failing healthcare systems to intractable religious wars. In short, it seems as if many of our most complex systems are reaching their limits.

It strikes us that the Web might teach us new ways to address these limits. From harnessing collective intelligence to a bias toward open systems, the Web’s greatest inventions are, at their core, social movements. To that end, we’re expanding our program this year to include leaders in the fields of healthcare, genetics, finance, global business, and yes, even politics.”

Truly an extraordinary gathering at an historic time – commencing the day after Barak Obama became President Elect, it seemed the causes and conditions for participatory culture and sustainable living were coming together at last!

Virtual Worlds and “The Web Beyond The Web:” Creating “A Supple Approach to Sharing Identity”

Virtual Worlds were not on the schedule.  But this is not surprising as their potential contributions to the very big problems at the heart of the Summit’s theme are only just beginning to emerge.

But new forms of  participatory culture were a recurrent theme of the Summit.  And Virtual Worlds at the high bandwidth tip of the pyramid of global connectedness and SMS at the bottom of the pyramid have a lot to teach us about participatory culture.

Crista Lopes recently co-founded with Christer Lindstrom a company, Encitra, that is focused on improving urban planning processes, starting with transportation, using virtual worlds. Christer Lindstrom has been a key evangelizer of PRT (personal rapid transit – see photo above).

Crista Lopes is Associate Professor at the University of California, Irvine, in the Department of Informatics (full interview coming soon).  Crista is using the dynamic shared viewpoint of virtual world technology to offer a way for the many stakeholders involved in a city scale transportation infrastructure change to participate in the process of planning. Crista is working with OpenSim – see the video of  “Encitra – Creating Immersive Worlds.”

There are a number of use cases for Virtual Worlds in sustainable living being developed. I have written several posts on Oliver Goh’s work,  “The Path to Sustainable Real Estate.” See my earlier posts here, and here, and IBM’s Virtual Network Operation Centers.“

Also see the recent announcement from Intel Research to create ScienceSim using OpenSim (more on this soon). Justin Rattner writes:

“Wilfred Pinfold (an Intel colleague and general chair of Supercomputing 2009) announced to the Supercomputing 2008 conference attendees plans to create a new virtual world called “ScienceSim.” Supported by Intel and the conference committee, this collaboration aims to use these immersive, connected environments to further cutting edge scientific research.”

George Jobi, Intel, writes in his post on ScienceSim: “Intel is one of the founding members of OpenSim and had been building its vision of open standards based 3D web architecture around OpenSim.”

The Achilles Heel of Web 2.0…….?

As Crista pointed out:

“The  Achilles Heel of Web 2.0 is trying to build the concept of person in a platform that doesn’t have people, at the center of the architecture. With Web 2.0 we go through a lot of hoops trying to integrate basics concepts of identity and storage onto a platform that wasn’t designed for it.”

Most of us have bits of our identity scattered all over the web, e.g., partial friends list here, there and everywhere. Some of us have literally hundreds of different log ins and profiles. Our list of applications with pieces of our identity locked up in them might look something like the slide below from the High Order Bit of Beerud Sheth, Webaroo Inc.

In contrast, Crista noted:

“The key component that a Virtual World offers you is that you can take your identity from place to place and the presence of people is at the center of the whole thing.”

Crista has already submitted code that introduces hyperlinks to OpenSim (see here). Crista is computer scientist of many accomplishments including being the co-inventor of Aspect-Oriented Programming.

There is a long conversation in the comments on my interview with Tim O’Reilly about whether the concept of avatar is the Achilles Heel of Virtual Worlds. So I asked Crista:

“Are avatars the Achilles Heel of Virtual Worlds?”

Crista explained why she thinks this is not the case in the modular open source architecture of OpenSim at least.

“The concept of people is not tied to the concept of avatar in OpenSim: One of the important parts of the OpenSim architecture is that the concept of user is very different from the concept of avatar.”

In OpenSim, Crista noted:

User = identity +storage

When I asked David Levine, IBM, what Web 2.0 could learn from virtual worlds re sharing identity, David, who works on interoperability and protocols in the Architecture Working Group, said:

Immersive spaces, are the real time, multi-user online component of Web 2.0, and identity is deeply part of that……..virtual Worlds teach us, as they expose more resources to Web 2.0, that there needs to be increasingly “supple” ways of sharing identity that go beyond simply anchoring it on gmail or openID, or such.

Social media has been one of Web 2.0′s success stories – giving the impression that Web 2.0 has people at the core of its architecture. But, as Crista pointed out, this is not the case.

There is no way in Web 2.0 to do identity at the level of platform, at the moment. As soon as you want to create identity on the Web there is a big mess.”

Participatory Culture at the Bottom of the Pyramid: “The Web Beyond The Web”

The “Web Beyond the Web,” Beerud Sheth, Webaroo Inc quipped, is not his announcement of Web 3.0. Rather, Beerud is describing the parallel innovation at the bottom of the pyramid where lower prices on mobile devices rather than new features drives adoption and voice and SMS (short messaging service) rule.

SMS is the web of the people for most of the world.  The current ratio is 10:1 with 10 people using text messaging to every 1 that has web access and the SMS population is growing at a much higher rate than web users. The  innovation at the top of the pyramid, where a plethora of Web 2.0 apps are built on top of  http, looks like the unreadable slide above with a forest of applications.

In contrast innovation at the bottom of the pyramid, until recently, has been limited to ringtones, wall papers, and voice response mechanisms.  So Beerud introduced a new service GupShup.

Gup Shup = Chit Chat

“Think of GupShup as another cool word from the language that gave you yoga, nirvana and karma sutra,” Beerud said.

GupShup is a “Twitter for India” but on a vastly bigger scale (only 18 months from launch they are up to 12 million users).

But, Beerud points out, don’t just file away GupShup as another twitter clone.  While they have Web and WAP site, they are deeply intergated into SMS as the lowest common denominator. GupShup can be used entirely from mobile which is vital as they have more users already than the total number of web users in India.

This idea of fully integrating into the lowest common denominator medium, SMS, has allowed GupShup to grow extremely rapidly. And, interestingly, when you look at the use cases you see the end users are deploying many of the uses cases that are familiar from the web,

Beerud left the audience with the take away that all the use cases are surprisingly similar to the web as are the ways of monetizing them,  This is creating enormous opportunity for creativity and entrepreneurship in building out this web beyond the web.

He invited those who already know the possibilities of the web to come and join this new adventure.  The enormous scale of the “web beyond the web,” and the fact people are connected almost continuously, creates vast opportunities for participatory culture to expand beyond the small triangle at the top of the pyramid.

On the “web beyond the web” the potential of 160 characters is explored on a scale unimaginable on Web 2.0 where Twitter, for example, is just one app in a vast ocean of other possibilities.

Crossing the Chasm Between The Top and the Bottom of the Pyramid

This total separation between the top and the bottom of the pyramid is, in part at least, constructed through the current web culture of web exclusive subscriptions.

It is perfectly possible to write an app that would accept SMS text and post it on a web page without ever requiring a web visit from the SMS subscriber. The same app could also accept text input from a web page and send it out as SMS to one or many subscribers that have never visited a web page, thus enabling communication across this gap.

Oxygenating the System: Monetizing Doing the Right Thing

The VCs, business leaders and  entrepreneurs at Web 2.0 Summit had their entrepreneurial Spidy Senses (as John Battelle calls them) tuned to the challenges and opportunities of Web Meets World.  Some of the winners of the Web 2.0 Launch Pad Competition explored the premise that doing the right thing can be monetized.

Danny Kennedy’ Sungevity was the overall winner.  Sungevity’s aim is to “scale solar electricity as a solution to climate change.”  Their use of a Virtual Earth feed to streamline the installation of solar panels and ambition to be the SalesForce.com for the solar industry was a very winning combo.

Good Guide, a really excellent service (also available as an iphone app) providing a guide to all products from the perspective of their healthfullness, greeness and other socially valuable criteria clearly scored a 10 on doing the right thing.  But Good Guide’s ability to succeed on the monetizing side of the equation was questioned by one of the VC’s on the Launch Pad panel.

Carbon Networks pitched with the mantra “do the right thing and enhance the balance sheets in the process.” But the difficulty there, it seems to me, is that there are many questions re the benefits, or lack of them, of global carbon trading markets.

Carbon Networks argued that carbon markets, which are already a giant industry, present enormous opportunity for companies to monetize doing the right thing.

I asked Gavin Starks (who I interviewed recently about his venture AMEE – a BIG project to aggregate the world’s energy data) about the problems of carbon markets.

“They have high levels of inappropriate use even for a new market area,” he commented, noting:

“There are some superb projects out there, but it would be fair to say there has been good dose of snake oil in the space – which has certainly not helped to build consumer confidence. However, markets are necessary to engage with the scale of investment that is needed to address the issue – it’s the use of funds that needs more scrutiny and greater transparency needs to be given to the whole process.”

There are projects working with Voluntary Emissions Reduction which aren’t tradable on proper carbon cap-and-trade markets, “though in theory the step up to CERs (certified emissions reductions) isn’t too great a thing,” Gavin noted.

MicroEnergy Credits the  initiative presented on the Track Me panel by April Allderdice, co-founder and CEO, is a good example of this.

Gavin pointed me to CheatNeutral and their YouTube video for a hilarious and razor sharp look at the problems of carbon offsetting. The text below is from the CheatNeutral site.

Gavin also explained a new initiative Sandbag (beta). Sandbag aims to take the permits that allow polluters to pollute out of the system.

“Thanks to policy makers in the UN and Europe levels of pollution are now controlled. Permits must be bought by polluters to let them keep polluting. But there is a finite number of them in circulation and the good news is anyone can buy them. So by taking a permit out of the system we can reduce the amount of pollution taking place and force industry to invest in cleaner technologies. One less permit means one less tonne of greenhouse gas in the atmosphere.”

AMEE is working with  Sandbag

Consuming Less and Redefining Prosperity

This picture is from the Sustainable Mobility Panel at the ASPO-USA Peak Oil Conference.

Perhaps nowhere is it more clear than when we look at the reports that link catastrophic climate change to the assumption of growth that what is really at stake in terms of averting catastrophe is not just retooling our energy infrastructure, but fundamental changes at the level of culture and identity.

Consuming less may be the single biggest thing you can do to save Carbon Emissions, Tim O’Reilly said, in his Tweet on “Why politicians dare not limit economic growth.”

A growing band of experts are looking at figures like these and arguing that personal carbon virtue and collective environmentalism are futile as long as our economic system is built on the assumption of growth. (New Scientist)

But few of us are willing to contemplate what a sustainable economy and averting the catastrophe of climate change require – redefining prosperity and reducing consumption (see Redefining Prosperity).

Web 2.0 Summit took on the challenge of reimagining giant industries like energy, food and transportation and how we might  be able to shift away from a culture of food and energy consumption that is basically killing us and our world (see Michael Pollan’s brilliant High Order Bit on the culture of food in the US).

The Summit gurus urged that taking risks and tackling very big problems has always been what Web 2.0 is about and indeed cultural shifts of the magnitude needed would be hard to imagine without a Web 2.0 perspective

Shai Agassi, Better Place, explained how paradigm shifts require new business models. See Shai’s High Order Bit here on the evolution of “Better Place,” -  by giving away free electric cars he is creating a new business venture that will bring clean cars into the mass market.  New business models not just new technology are required to drive change.

Breaking News From Reuben Steiger’s blog

First Israel.  Then Denmark.  A few weeks ago, Australia.  Today,  Mayor Newsom along with Governor Schwartznegger and the Mayors of San Jose and Oakland, announced that they would be making a major move towards bringing electric vehicles and the Better Place network to the Bay Area.

Please, visit Planet Better Place to sign the petition,  join the movement and bring Better Place to your town or country.

To motivate yourself and others how important it is to change patterns of consumption see Saul Griffith’s High Order Bit here and Project Wattzon

“…..from flying, driving, powering a home, eating, shopping, working and even one’s share of the energy necessary to make our society function. WattzOn helps users understand their personal impact on the environment and how they rate compared to others WattzOn users, as well as global averages.”

“The Secret Sauce”: New Business Models for Web Meets World

I spent some time talking to Don Dodge, Director of Business Development, Microsoft’s Emerging Business Division, about the future of  virtual worlds and what technologies he thought would play an important role in developing the participatory architecture of the web (full interview coming soon!).

“The question is how do you apply these technologies? Where is the best use for them? And this is the hard part.  When you look at social media and social networks and things like Wikipedia, don’t look so much at the technology because that is fairly simple.

Look at the rules of social interaction and how people interact, and how you put protections in there so that people don’t game the system or do bad things.  Look at the processes because that’s really the secret sauce of how it all works.  The technology is simple. It looks easy from a distance, when you start getting into how it really works from a social perspective that’s the secret sauce.”

(screenshot above from Threadless )

Also I caught up with John Battelle, Federated Media Publishing (see his Data Bill of Rights here), and Jennifer Pahlka, TechWeb, at a small press conference. I managed to squeeze in a couple of questions!

Tish Shute: If marketing has been the oxygen of the system up to now, what will oxygenate the system of the new participatory culture of Web meets World”

John Battelle: I don’t think marketing ever stops being one of the most significant pieces of the economy -  because it is, of the whole economy. So what I do think will happen, and this is the company that I run, I do think marketing will shift very dramatically in terms of its approach and how it is a part of the value exchange that occurs around goods.

One of the reasons that I had Tony Tsieh from Zappos was to show that.   Tony shows how every single human being in his organization is a marketer and sees every interaction they have as marketing.  Can you imagine  a company as big as Intel that has that kind of an approach?  That’s when we will have a real shift. Business models based on that idea are emerging.  I run a company that is involved in that. I don’t try to push it on the stage ..but I do it is right there Federated Media!  And now I am pushing it [laughs]

Its an idea that comes from all this staring at this. I do think marketing is going to shift quite dramatically. So we may see in 10 yrs that we don’t have a big media budget  pushing adds at people. But will there always be budgets for creation of value exchange between consumers and producers? yes! There will just be new models for how that money is distributed and spent and new services and intermediaries for that value exchange.

Tish Shute: But who controls definition of data will remain key right?

John Battelle: There is a reason why Yahoo, AOL, Facebook, MySpace, all of whom are here, and Google, are all about the data….all about the data….sorry I have to go!

Jennifer Pahlka: I think in addition to the enormous changes that John was just talking about in marketing, and I think these are very significant – the way marketing will be seen completely differently 5 years from now.  There is also the shift in Web 2 away from an over identification with  Web 2.0 as being primarily about and driven by advertising  because of these models that are emerging for Web 2 that are driven by data, driven by services, subscription.  There are a whole bunch of other business models for Web 2 start ups and for enterprise that really don’t have anything to do with that at all.

Tish Shute: And in terms of participatory culture and sharing data?

Jennifer Pahlka: And even on a simpler level than the data.  Think of a company like Threadless [see screenshot above]. Their co-founders are keynoting at our Spring event.  They have taken some of the other principles of the architecture of participation and the creativity of the community and built a whole difference around that.  And all they do is sell T-Shirts.

“A Billion One-Person Enterprises”

New York Times writer, Saul Hansell, in his article, “Web 2.0 Gets Big and Corporate,” writes, “the best minds of our generation are turning to the Web for solutions.”  …..the big companies that make very complicated systems are reworking them using the principles of Web 2.0 companies.”

But “big companies” themselves may soon be a thing of the past.  One of the potential futures many my friends in virtual worlds have been looking at is, “if the future consisted of a billion one-person enterprises.”

Tony O’Driscoll described some of his thinking re the role virtual worlds will play in this potential future.  See Tony’s presentation, “A brief history of a potential future” on SlideShare. Tony’s research provides a window onto the new participatory architecture of business, government and the economy and the ways the individual and the collective will have new dynamic relationships based on “co-creation.”

Second Life and Wikipedia are the two great experiments in collaborative co-creation. They show us how co-creation can be one of the keys to a participatory global culture and sustainable living – part of creating an alternative to this economy of escalating consumption that has us in its death grip today.

Tim O’Reilly has outlined some of the world’s big problems in his talks, and urged technologists to “work on stuff that matters.” I was one of O’Reilly’s listeners at the Web 2.0 Expo in NYC (see my post here).

But, I found out at the Head Conference in London, recently, that O’Reilly is doing more than just talking about solving the world’s problems. The O’Reilly VC company is investing in technologies that tackle these big problems, for example, a very interesting startup, AMEE.

AMEE is a new company with a VERY big, world changing idea – “to create  a neutral technology platform to aggregate all the energy consumption data in world ” – “to be the world’s energy meter.”

I was fortunate, when I was in London, to get an opportunity to chat with Tim O’Reilly about AMEE, Web 2.0, and the role of virtual worlds in positive global development. Also, I met the CEO of AMEE, Gavin Starks.

We are still, just, in the pre “Internet of Things” era.  But, soon, as Bruce Sterling puts it, we will be able to “Google our shoes” or find out which super market shelves are out of sandwiches at any particular point in time! But for now, it can still be very hard to find a sandwich, even in central London. So, I had plenty of time to talk to Tim O’Reilly whilst searching for a hand held bite to eat.

We journeyed past several sandwichless restaurants (Tim picked up the Financial Times under his arm in the picture above in one of them), and super markets with shelves stripped bare except for some end of the day sushi (it looked scary so we passed on that).

Finally, McDonalds came through for us with the sandwich in the top left corner of the photo above.  The full interview is later in this post.

First, more about AMEE.

Tim O’Reilly says he doesn’t like predicting the future. But the future comes to Tim O’Reilly in very powerful ways.  And AMEE asks us to play a new proactive role in our own future. AMEE’s call to action is:

“If all the energy data in the world were accessible, what would you build?”

AMEE, to me, is a quintessential example of an effort to harness the key paradigm shifts of Web 2.0 (see O’Reilly, “What is Web 2.0?“) to tackle some of the world’s most pressing problems.

AMEE’s mission is to be a neutral technology platform, using open source and standards, and an architecture of participation, to address the need to standardize measurement, encourage collaborative development, and create a market place for energy data.

AMEE’s goal is to enable us to understand energy consumption from the level of the individual to the scale of whole countries.

This would address the need O’Reilly notes here his son-in-law Saul Griffith argued at Emerging Technology Conference earlier this year:  “to pick a target CO2 concentration and work backwards to get to an energy policy, rather than guessing at an energy policy with fingers crossed, hoping for a climate outcome that is tolerable.” AMEE is also involved in Saul’s Wattzon initiative.

Gavin Starks, CEO, AMEE, (pictured above standing under the Head Conference banner – a recording of his talk is here), explained:

AMEE’s vision is to aggregate all the energy data on Earth. By energy I include electricity, gas and all types of fuel, water, waste, you name it: everything we do is energy consumption, which means really building towards our sustainability footprint rather than just our carbon footprint. The initial thing we’ve focused on is Carbon and CO2, because that’s the most pressing issue we have to face: but it’s quite a thin layer on top of the whole sustainability question.

AMEE is not building the front-end applications to harness this energy data. Gavin noted:

We’re aggregating all the standards. This is a massively complex area, so we’ve got a science team whose job is to harvest all the scientific research and methodologies. That’s not something developers tend to want to go anywhere near: it unpacks itself into enormous amounts of complexity very quickly (e.g. building methodologies that have 700 data points).  Our Chief Scientific Officer, Dr Andrew Conway, is ex-NASA and has worked on massive scientific data analysis.

We aggregate government standards and other international standards, so that you know when you’re integrating with us, that you’re working to those standards. But much more than that we actually publish those standards on an open Wiki (the Wiki and the API actually talk to each other). As these standards emerge and evolve, we’ll be tracking them, ensuring that we are up to date, and granularity is added as needed.

We were very fortunate that one of our first clients was Defra which UK’s Department for Environment, Food and Rural Affairs. Defra is currently restructuring into DEC – the Department for Energy and Climate Change. So in the UK they’re actually fusing Energy and Climate Change into a single government department. I think this is quite remarkable: a giant step forward.

We were contracted by them because they were building a national campaign to raise the awareness of every citizen’s personal and household footprint, and they were looking for an Open Source solution – which AMEE is. Defra/DEC now use AMEE for two purposes: they make their standards available through the AMEE platform, so that everybody else can use them, and as the back-end solution to their national campaign, “Act on CO2″.

AMEE is SaaS – a web-service API – we’re not trying to compete with anyone on the front-end development and delivery. Because we aggregate two moving targets: standards and consumption, we enable those integrated with us to be current at all times.

Who Owns the Data?

But, if AMEE hopes to harness global network effects as a neutral aggregator of energy consumption data from individuals, businesses, and governments, one of the key questions that AMEE must answer (also a key question for Web 2.0 in general) is: Who owns the data?  I have delved into this question before on Ugotrade. See David Levine’s conversation with Eben Moglen on privacy here.

Gavin told me that this is a question AMEE has given a lot of thought to.

How AMEE answers this question, Who owns the data?, will probably determine the success of their mission as an ethical endeavor,  and their ability to scale and leverage the network effects of the internet as a platform while still allowing ” a very granular level of energy activity to be tracked.”

Gavin explained where AMEE is going re their approach to this issue. And, how this relates to AMEE’s business model – software as a service (SaaS).

We’ve spent a lot of time thinking about the best way to approach this, from both a commercial perspective and an ethical perspective.

We’re in a position where we’re aggregating vast amounts of personal and business information, on an ongoing basis. If we were to integrate with your credit cards, your smart meter, your supermarket, and your vehicles: we actually know everything about your life. Aside from the Data Protection issues we felt, “How could we protect everybody around ‘excessive’ exploitation of that data and ensure the user has long-term control?”.

As the saying goes, “we don’t know what we don’t know”: when it comes to predicting what our privacy issues will be, and as the data around our physical lives becomes digitally available, we wanted to err on the side of caution. Danny O’Brien, the EFF and MySociety have certainly helped to shape our thinking in this respect.

So if you’re a Google user and you go into the Google and you kick off a calculation, all your answers to the questions are stored in AMEE – but we don’t know who you are. We’ve got an anonymous key, Google’s got the anonymous key. Google will have your user name and so on and so forth. In AMEE we’ve got the aggregate of the responses to the questions. It’s up to Google’s Privacy Policy to determine what they and their user’s can do.

However, this doesn’t preclude us from enabling data-portability on behalf of the user. The anonymous key is not dissimilar to an OpenID, but applied to a specific data set. We are heading towards allowing you to control your data’s portability, as an individual.

It’s a fragile space. We want to give you the opportunity to glue together your AMEE IDs with your OpenID, or whatever login you choose, so that you’re in control. We aim to enable this to be both cloud and edge-based, which while fragile, is in the interest of the user. The more value we can provide, we believe, the stronger the value of our proposition.

But, because were dealing with a range of different massive organizations … imagine credit card companies sharing data with energy companies sharing data with petrol companies, sharing data with airlines etc. That’s a massive challenge from a business and political perspective – almost impossible to navigate.

We can enable people to collaborate, by making it opt-in all the way through the chain. We don’t undermine peoples existing databases: we can actually add value to them, or we aim to add value to them. We think this has got a huge amount of potential to stimulate new business for our clients.

It’s very “web” in its execution: we are part of an ecosystem. Part of our imperative is to be commercially enabling to everybody else. If we’re not being commercially enabling to other people, we’re not going to get the kind of scale of change that we need.

This was another design feature. We felt, “how could we create something which other people could build businesses or platforms on top of”?  And, how could that scale incredibly quickly? If we’d gone beyond our boundaries as an API, we would have been competing with people we want to work with.

While many services have taken similar strategic approaches, most seem to start with a form of lock-in, or evolve quickly to the point of lock-in, which satisfies a current trend in their valuations. We believe this trend will change and adapt to a more “privacy-based” intelligence, which has substantial value.

Tim O’Reilly in The Magic Circle

The motto of The Magic Circle where the Head Conference was held, “Indocilis Privata Loqui,” can be roughly translated as “not apt to disclose secrets.”  One of the wonderful displays of memorabila there was Robert Houdin’s Mystery Clock (picture below).  Luckily, for me, I was was treated to a full explanation of the “Mystery Clock” by another attendee during the Head Conference cocktail party.

As Tim O’Reilly pointed out, in his interview with Aral Balkan, he felt it was a privilege to be talking in this theater and center of magic.  Capturing the magic, spreading the magic, and sharing the magic is at the heart of what he has spent his career doing.  He explained:

I guess this is kind of a root idea for O’Reilly…… When I look back on my career….What did we really do?  Find cool people who were doing cool shit. They didn’t really need any help from us. But then there were a bunch of people who were saying, “How did they do that”? Those are the people we help.

We find the people who are doing what appears to be magic. The Arthur C. Clarke kind of magic you know…. We document – we teach people how to do it.

It is such a great  privilege to be here in a theater devoted to magic – The Magic Circle. This is really what we try to do.  We try to capture the magic, spread the magic, share it with other people.

Interview With Tim O’Reilly

Tish Shute: I was interested in your comment on Chris Brogan’s blog post the other day.

Tim O’Reilly: Actually it wasn’t Chris Brogan’s post. Dennis Howlett was a guest blogger. I was reacting to him saying there is nothing new in Web 2.0. My reaction was: “Well gosh it’s very easy to make a straw man out of Web 2.0 and say, ‘What’s new?’”

Howlett was specifically reacting to the Web 2.0 start ups that are superficial and not really what the trend is all about.  For me, Web 2.0 is about the internet becoming a platform. Does he think that is over?

And, it is about understanding that the rules of business change when the internet is a platform. I think a lot of people do that with Web 2.0 [make it a straw man].

They don’t like the term Web 2.0 and they attach ideas to it that reflect the most superficial elements. And then, they say these aren’t interesting. And, what he was saying was that there is a lot of superficial social media stuff – consumer apps, and what really matters is what will bring ROI to business.

I just said that he is totally missing the point because learning how to use the network as a platform matters very much to business. The same rules that apply to everyone else apply to businesses.

So, for example, I have made the point in my talk in New York, just a few months ago, that in many ways you can think of Walmart as a Web 2.0 company. They are infused with IP – they are taking the data that the users give them by buying things and making themselves a more responsive organization by using that data.

That is the heart of Web 2.0 in the enterprise. Not, do they use social media or not, or the social media buzz words.

Tish Shute: I am going to do an interview with Gavin Starks, CEO of AMEE. Could you tell me about your role in this project?

Tim O’Reilly: My role is as an investor. Our venture firm, O’Reilly AlphaTech Ventures, has just finished closing on investment in AMEE. We think global warming is a really important issue to come to grips with. And, a big part of it is actually keeping track of all the carbon we’re emitting. AMEE helps with that problem.

Tish Shute: What is the potential, now we are beginning to break virtual world technologies down into basic open source building blocks, to create useful mashups with sensor technology, Web 2.0 and Virtual Worlds? Could Virtual Worlds play a key role in this work of instrumenting the world?

Tim O’Reilly: First of all, I don’t think that Virtual Worlds in the Second Life style will have this role …while I like the concept of Second Life, in that we have a Second Life in a virtual world, I am not sure that 3D avatars are [the way to go]…. at least they are certainly not my Second Life.  My Second Life is in other types of media.

But, when I look at this idea of instrumenting the world, one of the things that is very, very clear is that we are turning all the millions of consumer cameras into sensors.

For example, Microsoft’s Photosynth demonstrates how these consumer sensors can be used to build 3D models. We are starting to build a 3D representation of the real world, not a separate virtual world. And, we are all going to be part of that world. So I think that the real Second Life will be ………..well I think the first layer is going to be….to get the 3D models of the world as it is, and then we will have doorways into additional rooms and additional spaces.

That’s when its going to take off because people are going to get used to it through navigating the real physical world with maps – with 3D imagery of buildings and spaces.

And, another piece of this… I talked recently with Carl Bass, CEO of Autodesk……and he was talking about how much even the Autodesk workflow is shifting to scanning things first.

He was describing how they have built this new demo center in an old building.  The first thing they did was photographs and measure it exactly. Then they go and make stuff that fits in the exact space.

Also, he was talking about how in his own hobbyist work, he found this shark’s jaw and he loved the curve of it.  So he scanned it and made it into the arms of a chair.

Tish Shute: I think the two important pieces that might come out of virtual worlds technology are the real time interactions where people can view the same application or context as and when you do, and the rapid prototyping.

Tim O’Reilly: Yes rapid prototyping, no question. But, as I said, the idea of moving an avatar around isn’t very compelling to be quite honest.

Tish Shute: But the web doesn’t do real time interaction very well does it?

Tim O’Reilly: Well Twitter is doing a pretty good job!

Tish Shute: Yes I love Twitter. But, in terms of if you want to get a 10,000 foot view and gather around and interact with data with other people…..what about that?

Tim O’Reilly: Well that’s true. I am using that example of the Squeak based virtual world that Fidelity is using. And, that is exactly what they are using it for – business interaction.

Tish Shute: What about the role Virtual Worlds might play, for example, in instrumenting the world through facilities management?

Tim O’Reilly: Yes, SAP did a very interesting project on property management – and that is interesting.

Tish Shute: Yes, on my way back to New York City tomorrow, I am going to stop off in Zurich and visit Oliver Goh who worked with Denis Browne, SAP, on that project. In fact you showed a picture of Oliver’s Goh’s avatar demoing the virtual counterpart to his instrumented Playmobile house in Second Life in your post, “SAP as a Web 2.0 Company?” (see the picture below).

Tim O’Reilly: I make no attempt at predicting the future.  So you could well be right that Virtual Worlds will be a very powerful tool.  But, I think with the pace that other technologies are progressing, we will get there with photorealism and video, etc.  I think the fundamental problem in most virtual world stuff is the idea of the avatar.

Tish Shute: Why do you say that?

Tim O’Reilly: Well just imagine if when interacting with people in the real world you had to look at yourself interacting with someone else.  First person point of view is our fundamental experience.  And, you are being forced to see yourself in the third person.

Tish Shute: I have always been more interested in avataring the world than in my avatar identity.

Tim O’Reilly: There is something very interesting in having an avatar that you don’t ever see.

[At this point there were less than ten minutes before Tim's interview for the Head Conference, so it was time to concentrate on eating!]

Virtual Worlds: Where Web Meets World

As Ian Hughes, IBM, notes in a recent post on Eightbar:

The last few days have seen a plethora of virtual world pitches, reports, articles and blog posts around certain types of virtual world platform. The first was over at @monkchips a.k.a James Governor analyst blog around a visit to Microsoft to see about the ESP platform. This appears to be a high fidelity simulation platform and toolkit. The second was widely reported. But Wagner’s New World Notes is the one most of the metarati will have read on the matter. This centres around some statments by Craig Mundie that avatar based interaction was of limited interest and really it was photosynth that was the way forward, modelling the real world from photos…….

I agree with Ian when he says:

the interesting thing here is that all the discussion is not about why would anyone want a virtual world, but instead what sort is best.

Tim O’Reilly was not questioning, in my view, that we are moving towards new understandings of virtual spaces or virtual worlds but whether avatar based virtual worlds will be the most useful model.

I began my questions to Tim O’Reilly by bringing up his comment on Dennis Howlett’s post not only because he succinctly states there what is really important about Web 2.0, i.e., “internet as platform, and the rise of applications that harness network effects to get better the more people use them.”

But also, this comment caught my attention because Tim used virtual worlds as one of the examples of the value of Web 2.0 to enterprise.  He wrote:

Guess what : they [SAP] understand that harnessing users is good for their business. At O’Reilly, our InPractice division is working with them to actually turn their documentation into an open source, crowdsourced project. They are doing fascinating experiments at SAP Labs with how to integrate virtual worlds into property management. They have built a great internal social network for employees that has already affected their HR practices.

It is Oliver Goh’s instrumented virtual house in Second Life that Tim mentions in his post “SAP as a Web 2.0 Company?” to make the point that:

This prototype is also very on trend with one of the big ideas we have about where Web 2.0 is going, towards Web 2.0 applications that are fed directly by sensors, so that “participation” no longer just means typing on a keyboard, but the accidental information we create “merely in living as and where we live.”

I have been blogging Oliver’s work prototyping various use cases for virtual worlds in facilities management and energy optimization, e.g., virtual operations centers, in Second Life and OpenSim, since its inception (see here and here).

Now, Oliver has developed a complete solution for sustainabililty in the real estate industry that optimizes energy consumption through the entire life cycle of properties - see here for more.

Also, look out for some interesting intersections between AMEE’s mission – ” to create the world’s energy meter,” and Oliver’s mission to “optimize the world’s energy usage” in the future!

I visited Oliver in Zurich on my way back to NYC from the Head Conference.  In the picture below, Oliver is standing by the Playmobile house that is RL counterpart to the virtual control center house pictured above!

The ability of virtual worlds to play a role in solving the world’s pressing problems is, in my view, linked both to their ability to fully integrate in Web 2.0 and “real” world  data.

I have been blogging a lot on these issues!  Rob Smart, IBM, (see my recent interviews with Rob here and here – “Web 2.0 to OpenSim Made Easy”) has been doing some very interesting work recently integrating JSON support to OpenSim. This is one of the recent important steps forward in virtual world to real world communication.  See this cool video, “OpenSim Meets MQTT jedi mind numbers.”

The powerful value add that virtual worlds, even in a basic form, have shown in the realm of social media that “the people with you can view the changing states of that application or context as and when you do” can also play an important role in the front end applications for projects like AMEE and Oliver’s work.

This is not to discount the role of social media virtual worlds in the participatory work of instrumenting our planet. There is already  a nice integration of AMEE  with Second Life. See Jim Purbrick’s Carbon Goggle’s for Second Life here.

Carbon Goggles from Jim Purbrick on Vimeo

But, if virtual world technology is going be part of the evolving power of the internet to help us solve the big problems facing humanity, there must be an evolving vision for virtual worlds and their relationship with the “real” world.

Most likely, many of the dichotomies, e.g., the notion of avatar based or non avatar based, or simulation versus augmentation, and mirror worlds versus virtual worlds, will increasingly dissolve as all these aspects of virtual reality are woven together into the fabric of everday computing to form new digital/physical realities. And, while I’m not trying to predict the future, perhaps, this will happen sooner than we think!