I’ve been thinking about how identity passes through ubicomp environments and the types of experiences that could occur in such a relationship. We each carry a digital ID in our smartphone. This ID is a key that grants access to voice, data, location, acceleration, and other information both in the net and in our devices. These handshakes occur almost continuously in some form, the most common being the regular polling our mobiles make of our surroundings to determine if we’re in range of a cell tower. Not only do our mobiles contain our digital identification, they also hold rich profiles of our interests, our habits, our journeys, our transactions, and our networks. These elements are forming the core foundation upon which our experience of the networked world is constructed.

Smartphone manufacturers are integrating near-field communication (NFC) chips that enable our devices to manage transactions. At the check-out counter in the corner market (ok, more like Safeway) you wave your phone to make payment. Your mobile knows who you are, it has access to your checking account, and it makes the handshake on your behalf with the trusted vendor. Whether or not NFC becomes the de facto coretech underneath this mechanism, the usability is very sticky. All sorts of lock-and-key relationships like home & vehicle entry, gym membership, library or lab entrance, and network access become a natural characteristic of your presence. Just as your face & voice provision you with access to your parent’s home and induce birthday parties in your name, mobile identity confers digital membership and can initiate personalized experiences around you.

One of the light bulbs that really went off in my head was lit by Ben Cerveny‘s talk at ARE2011. In the course of discussing his data exploration instrument, Bloom, Ben illustrated an example of this type of personal digital provisioning by considering the modern, networked home entertainment system. Imagine you have a dinner party and as your friends arrive their mobiles make the handshake with the local network. The system queries their devices for music likes, recent social network sentiment, and checks their calendars to see how hurried they may be (if the data is shared). It then constructs a playlist on-the-fly that’s tailored to fit the mood. If they like, they can engage the system from their mobiles by sharing media and driving the mood. It’s a simple example that illustrates how we’re sharing a lot more information about ourselves with the computational networks in which we swim, and how those networks can become more aware of us and tailor experiences to fit the context.

Greg Tran has a really great concept video that explores these ideas of local networks and provisioned experiences by looking at augmented reality as a mediating layer. Here’s the video:

Mediating Mediums – The Digital 3d [Short Version] from Greg Tran on Vimeo.

Tran postulates a near-future where some form of native augmented reality is ubiquitous, then considers the kinds of experiences that might be possible. He explores how local networks could push such experiences out to provisioned individuals based on profile & location. For example, as you enter a building it reads your digital ID and passes an access profile to your device. This local profile invokes experiences as you pass through different areas of the structure. Perhaps virtual walls are rendered to offer smaller meeting rooms within a larger space. Planar blinds covered in motion graphics rise up to obscure areas or to convey pertinent information. Real walls are rendered transparent to reveal HVAC systems (for ID:HVACRepair), or network lines (ID:CablingContractor), or the floor below you (ID:Bankrobber). The concept video is slick & compelling and suggests a sort of techno-magic that feels only just beyond our fingertips.

The concept work of Keiichi Matsuda serves to illustrate the inevitable tensions likely to rise in such a data-saturated and dynamic media landscape. He explores the somewhat-uneasy co-mingling of our traditional needs & expectations as humans with the growing presence of push media bombarding our every waking moment. There is a suggestion that perhaps traditions will eventually fall as the older generations withdraw from influence. The new young are better fit to parse & move amongst what we might consider a slightly-terrifying visual information overload. It is said that Descartes considered the pineal gland as the reducing valve of the Soul, keeping us from seeing the whole of Creation so we can focus on the more pressing biosurvival tasks at hand. Keiichi’s work, particularly Domestic Robocop, imparts the sense that we’re steadily opening that valve back up.

Augmented (hyper)Reality: Domestic Robocop from Keiichi Matsuda on Vimeo.

These examples are really just frameworks within which we can explore the relationship between digital identity and ubiquitous computing. More specifically, they show how we are deputizing our mobile device as legitimate cognitive prostheses and proxy selves. The social landscape is increasingly occupied by machines and so we need machine ambassadors to manage these relationships on our behalf. And as we move en masse into social networks we get closer to the machines and share more and more minutia about our lives. Social networks are incredibly fertile ground for getting to know complete strangers better than they even know themselves. Especially if you’re a data crawler crunching billions of analytics per cycle. Pretty quickly this becomes a surreal sort of digital intimacy that for most people never even registers.

This relationship will become more visceral as we hire a growing array of scripts & cloud agents to do our bidding, initialized and left to run, watching and learning about us, and mediating our needs & expectations to innumerable and often-invisible third-parties. There is a reasonably convincing argument that considers the Greek & Roman pantheon to be the early psychological complexes of the awakening human mind. The young ego wasn’t quite able to recognize the emotions & voices as being local and instead ascribed to them an external embodiment in the form of anthropomorphic deities. We seem to be at a similar junction where we’ve yet to fully internalize and integrate our digital pieces. But it’s our mobile devices that bring them closer and invite them to join us.

Rolling forward with personalized ubicomp we can see a possible world where cloud agents flit about enacting our will, communicating with us, transacting with other agents, invoking local experiences & remote actions. We can imagine a more responsive and amorphous physical world that shifts to meet our needs, to persuade us, and to contain us. How does the individual understand itself when embedded in such a fluid & personalized world? How does cognition and psychology change as it distributes and becomes more & more disembodied? What are the powers of crowds as machine intelligences scan & summate them, customizing group experiences to the common denominator? Will distributed intelligence relate to crowds better than individuals? We’re getting a bit scifi here, I know, but ranters gotta rant.

Suffice it to say that the near-future will really get interesting once digital identity is fully integrated as the core component of the ubicomp landscape. The current effort to move payments into the mobile phone is a major step in this direction (and should serve as a hint when looking at the present identity challenges & goals of Facebook, Twitter, and especially Google Plus). Your social networking is painting a rich profile about who you are. Your credit card is arguably a stronger & more universal ID than your driver’s license or passport. And though we may resist sharing so much of ourselves in such a broad way, it won’t matter. Our devices will identify us and our digital ghosts will betray us to their friends.

Challenges
Aesthetics
Technical – power, weight, capture, integration
Interface – eye-tracking, gestural, selection, execution, filtering input & display
Interaction – context awareness, algorithms, provisioning
Perception – occlusion, distraction, depth cues, eyestrain
Legal & Ethical
Privacy
Identity
Surveillance
Security
Safety
Fragmented Realities

Future Horizons
Personal algorithms
Dynamic user interface
Provisioned experience
Cloud agents
Brain-computer interface
Bio-nanotechnology
Fully native augmented reality?

.

Imagine walking around a town wearing your stylish Ray Ban augmented reality glasses (because hand-held mobile devices will become a significant limiting factor to experiencing the annotated world). You see small transparent white dots glowing on people and objects indicating that they contain accessible cloud content. Maybe you “select” (by whatever mechanism constitutes selection through a pair of eyeglasses) a bench on the sidewalk then view a flyout markup indicating that the bench was commissioned by the Bruce family in memorium of Aldis Bruce, manufactured by the Taiwanese Seating Concern. You click through the family link to see a brief bio of Aldis with a set of links to his life story, works, etc…

In the upper corner of your view a light begins to blink indicating a new feed is available in your subscription list. You select and expand, showing a menu item for Bob’s Neighborhood Chat. Initializing this feed draws a new green dot over the bench, indicating that Bob has published information tagged to it. You click and Bob’s markup flies out with text stating, “Tuesday, March 11, 2010: Don & Charise Ludemeyer celebrated their 25th wedding anniversary by returning to the place where they first kissed in 1985.” A link below this offers the couple’s personal website, a photo gallery & playlist of their wedding, and then a link to more public markups about the bench.

Clicking through the “more” link offers a list of other public comments. You choose the Sur 13 layer just to see what the local hoods are up to. Flyout: “Hernandez Bros. shot down by Westside Brownshirts, Sept. 23, 2009. RIP, locos.” Then, drawn over, a bit-crushed graffiti logo “WSB” animates across the view, hacked into the Sur 13 layer by Brownshirts. A click through would open the full Brownshirt regional layer but you already feel like a trespasser on suddenly dangerous turf.

Unsettled, you call up the local Police layer. A trailing list of crimes in a 5mi radius begins scrolling. You narrow the search to your current location with a 2 week time horizon. 3 yellow car break-ins glow indicators along the road, followed by a red assault marker 10 feet down the walk, and then 2 more blinking red markers at the bench. You hover over the bench markers and learn of two shootings here within the last 4 days.

You open up the iCabNow utility, send up your beacon, and wait nervously for Yellow Cab to find you. You thumb back to the Ludemeyer markup and click through to find the playlist from their wedding. As you hop into the cab a few moments later, the theme from Miami Vice swells up in your earbuds, sending you off from this time-twisted place. You call up the WordTweet micromarker app and make a traveler’s note: “This is a dangerous bench with an old heart.” Click “Publish” and a new feed indicator appears, offering your own layer update to subscribers.