How can we explain what you are missing?

Posted by Bettina Tizzy

Avatars often grapple with how to demonstrate what it is that appeals to us so much about art, architecture and fashion in Second Life®, to people who will not or cannot log in. It's a dilemma akin to sharing a new color or flavor, because the immersive qualities of the 3D experience cannot be conveyed in words or even via film, given its flatness. So we take photographs. We create machinima. And we talk and talk and blog and twitter. Still, you are left out until you decide to take the plunge and devote sufficient time to learn how to move your camera and your avatar around.

I recently spent a pleasant hour chatting with a journalist about my own appraisal of content creation in virtual worlds, and while I'm an evangelist and like to think myself persuasive, I was unable to secure his interest in joining me to have a look with his own eyes. Still, we'll keep trying, and experienced early adopters that we are (remember when we tried to tell you about something called the Internet?), we know we will win in the end.

In the meantime, despite its 2 dimensional limitations, we'll blog about the experience with you however we can, sharing machinima like this stunner by artist Lyric Lundquist...

Be sure to click the HD button for higher quality transmission


... or Sepp Schimmer's inaugural video, featuring Bryn Oh's Immersiva and GutterBlood Spoonhammer's Error sims.*

Be sure to click the HD button for higher quality transmission


* A sim is a simulator and virtual region hosted by a single server CPU. You real-life folks call it an "island."

Hasta la vista...

Dear Santa, I know it's early but...

More goodness from AM Radio... this time it's the jDome Project, a 180 degree FOV monitor that is expected to come out sometime this year for about $200 US. Interestingly, they are asking the market directly if we'd be willing to pre-order, and thus determine the level of interest.

Dizzy Banjo's designs on music for (virtual) environments

Not three months ago, the Czar of Second Life blogging, Hamlet Au, and his New World Notes introduced the world to a fellow by the name of Dizzy Banjo - together with his partners Eshi Otawara and Chase Marellan - when they launched Parsec, the application that enables you to move objects with your voice. This happened within days of Dizzy's putting the finishing touches on the music and sound for the artful and complex DynaFleur installation... (teleport directly from here).

Even after all that, as well as the titanic follow-up that ensued after the introduction of Parsec, Dizzy just keeps knocking out new and lofty projects.



When you visit the freshly debuted in-world Mexican "Ruta Maya" regions (teleport directly from here) and turn on your stream, you hear music. Nothing unusual about that. But what you may not realize is that this rich and enveloping music was composed for no other purpose and for no other place, and that those native sounds you are hearing are hardly incidental. All were specifically created and positioned here and there intentionally to boost the narrative of your experience by that same soundscape artist, Dizzy Banjo (rez: 1/30/2005).

Composing music for an immersive 3D environment is not unlike scoring a feature film. In both instances, you strive to elicit an emotional response that varies and grows with each encounter. Perhaps the greatest difference between the two is that rather than create music as a backdrop for one scene or another, the composer in Second Life works within small areas of a region to orchestrate the experience for those micro-zones. Very few people realize what an undertaking this is! For this reason, I thought it was time to get with Dizzy and learn more.

What are the steps you take to create a custom soundtrack, and what do you need to know from the client?

Dizzy Banjo: For me, defining what the project directors want to achieve - emotionally - is the key factor, even surpassing the actual ‘subject’ itself.

From an early stage with Ruta Maya, it was clear that we wanted to achieve a score which immersed you in the emotions of the landscape, as well as containing cultural references. To do this, we expanded the instrumentation beyond purely authentic Mayan instruments (although the score does contain many) to a full orchestra, with a large contingent of tuned percussion. With this palette, I was able to tap into a much richer, cinematic sound.


The lush rainforest at Ruta Maya was created by Kriss Lehmann, probably best known for his beloved Straylight/Botanical

I often ask many questions which the client hasn’t thought about yet, and can’t answer. But generally I find the only thing I need to do is establish a trusting open discussion – and then I can get all the information I need.

Technically, I write in a mixture of various applications, depending on the needs of the project. These days I generally compose and program directly into Nuendo. If the project budget/timescale allows for live musicians, I export out MIDI parts into Sibelius, but often the projects stay in Nuendo right up until mastering stage, which I do in Wavelab.

I use a huge range of virtual instrument and effects. Ruta Maya required a lot of South American percussion and wind instrumentation. My current core orchestral template runs across 4 PC slave machines linked with FX Teleport and consists of a mix from the Vienna Symphonic Library, the East West Quantum Leap Symphonic Orchestra, Project SAM, and bits of older libraries like Miroslav Philharmonik.

However I play violin, viola, piano, guitar, bass and banjo (hehe) myself, so I try to use as many live instruments as possible.

How much did you have to "alter as you go," between the initial plan and the final outcome?

Dizzy Banjo: Luckily, prior to working on Ruta Maya, I scored the music for the Machinima for the first Visit Mexico – Chichen Itza sim.



A lot of the musical direction and general approach to Visit Mexico inSL was developed at that stage. Ruta Maya was a development of that sound, so the process of developing the soundtrack actually went really smoothly. Also Valiant Strangelove and Lester Nefarious from Advanced Virtual really placed all their trust in me with it, which I’m very grateful for.

On all my projects, I have listening sessions with the client. We do these in Second Life ‘on location’ to test the audio visual immersion and mix. These went very well, apart from one session where one of the clients accidentally tuned into a random Internet radio station instead of the score stream – which made for some uncomfortable moments like :

Client: “I’m not sure if there should be rock drums…”
Dizzy: “WHAT?! There aren’t!”

I tend to work through the night a lot. I wanted to wait until the build was almost complete before commencing the main body of work. However I did have a number of concepts in mind prior to that. Throughout the compositional process I was often logged in to Second Life with environmental sound playing so I could soak up both the visuals and sounds as I wrote.



What does "environmental sound design" mean, and how does this apply to Ruta Maya?

Dizzy Banjo: On this project, I think environmental sound design meant exploring a way of vastly increasing immersion through Gestalt effect principles. This involved creating a highly detailed soundscape of many of the sounds of the actual environment of the Real Life Ruta Maya (these were created various sources – some recorded, some from sound design libraries and some from my environmental sound design consultant on the project, Hastur Pieterson). In this way, when you are on the beach and hear the seagulls on the cliffs – you believe there really are seagulls nesting there, even though none are present as prims.

In many ways Ruta Maya is a kind of "beyond reality," or "concentrated reality." It’s audibly very dense - the rainforest alone consists of over 40 sound sources - and so rich that you can close your eyes and still feel you are there. I’ve even navigated around the sims with my eyes closed.

What are some of the biggest challenges that Second Life presents for this type of undertaking?

Dizzy Banjo: The 10-sound upload limit is a challenge, but this has been overcome by some clever scripters. One other constraint here is that the client can only play up to 40(ish) sounds simultaneously. This can actually be nice as it reveals more sounds as you move around the islands.

Scoring for the metaverse is very different to scoring for a video game or film (which are generally single person/linear experiences). The challenge is to try to find ways of tailoring the soundtrack to individual and group experiences, which are non linear in nature. Eventually I hope to develop ways of achieving this in Second Life, but Ruta Maya makes some initial steps by splitting up the soundtrack into zones corresponding to particular environments. I’m developing various other techniques for controlling the delivery of sound at the moment, which I hope will bring a finer granularity to that experience in future projects.


Mayan instruments - all of the Pre-Columbian era - included drums and maracas made of wood, clay and sometimes the tortoise shell. Ceremonial flutes and ocarinas made of fired ceramic, bone, wood, or reeds have also been found at archeological sites. Dizzy performed all of these instruments for the Ruta Maya score.

Ruta Maya (meaning Mayan Route) in Second Life features a few (not all, by any means) of the highlights from five of Mexico's southern states: Quintana Roo (there's more to it than Cancun!), Chiapas (I love some areas of this state better than I do Paris or Venice, to give you an idea of how_much, but do try to set your base camp at San Cristobal de las Casas), Campeche and Tabasco, as well as Yucatan, where Chichen Itza is located.

Fire-side chat with Gary Hazlitt, or interactive marketing 101

Within something like two minutes of meeting NPIRL'er Gary Hazlitt, I realized that I am going to want to warm my toes by the heat of his knowledge and - importantly - his marketing prowess... often and a lot.

It is so very rare to find someone who is, at once, technically expert and savvy/hyper-innovative in the area of user-friendly branding. It isn't for nothing that Australia's 11-island The Pond (or BigPond) - which he masterminded and lead-created for Australia's communications group Telstra - is experiencing 12K+ visits a week (see Tateru Nino's analysis), and is the highest rated brand in Second Life.

Even more endearing is the fact that Gary is a ginormous supporter and believer in the power of the Not Possible in Real Life (NPIRL) concept, and integrates it into his builds in fun, approachable and unexpected ways.

The spice on Gary (aka Gary Hayes IRL):
* Sydney-based, born a Brit, lived in the U.S.
* Director of the Australian Laboratory for Advanced Media Production (LAMP)
* Heads up Virtual Worlds for the UK-based The Project Factory
* ...is a busy blogger on SL and its culture, as well as role-playing which he says is a "big fascination of mine atm"
* Is an advocate and has a passion for creating rich organic
story environments
* Makes cool vids
* Is a musician and composer, having created music for film, radio, tv and self-expressed albums

Here are some highlights of what Gary had to say when, for a change, I actually kept my fingers quiet and listened and, dear readers, for you folks who want to learn something about marketing in the metaverse, this is the smartest - albeit basic - 101 you are going to find on how to get it right from the get-go:

"I have been talking about over-representation for a long time ;-) - hence my interest in NPIRL. In other words too many malls, real world architecture, etc, etc.

I have just posted a simple thesis on wikipedia about how the environment can help nurture inhabitants in SL to really dream and create their own fantasies, but most importantly share stories and experiences through places with total immersion.

There are 5 levels and most of the great places in SL, especially the
NPIRL ones, exhibit levels 3 and 4 where the environment itself has character and leads you into your story mode.

Greenies is a great example, albeit a frozen moment. I am always trying to create fantastical and dynamic (things) so (they are) slowly morphing and exhibiting a different character and sensation at any given moment. Every time you go back you have a slightly different experience (and are) always able to uncover something new.

(I) suppose that is the organic side to it... layers of depth to get under the surface; very few places like that but it should be, as creators, our goal to create things that feel like they have been here for years and centuries, even if they feel contemporary.

I am a good friend of DanCoyote's (Antonelli) and his works have that sense of organic... of being created from the virtual earth... and are timeless vs - spits on the floor - copies of RL!"

* PAUSE while this blog poster and yours truly thinks to herself: OMG, this guy sooo gets it!

"(RL) has its place as I have to do lots of corporate builds, too, and although I would love them all to be floating, moving, spacious, ethereal - you have to create the equivalent of the vanity boardroom and such... that being a metaphor for things noobs from companies can recognise at the start."

* PAUSE while this blog poster lowers head, genuflects and utters "amen"

"(We are) happy for people to drop in and - here is a main point with NPIRL type builds - is that they should be responsive to comment. (Important) that the builder and creators agree with the inhabitants who visit that any piece can be changed (to some extent) so it becomes a work of the SL community, too.

We are very keen for folk to suggest changes, because we love to hear from those who have experienced it and say 'oh that would be great' or 'do this.' To me that is what the social network that is SL is all about... co-creation... so we really listen to comments and suggestions and mix that in with our intentions."

***
Over the next two weeks NPIRL members will have the pleasure of previewing two of Gary Hazlitt's new build environments and learning his thoughts on them.

P.S. After posting this, a couple of friends mentioned that my commentary sounded a bit suggestive. OH MY! Is it my fault that smart marketing makes me sizzle? Not hitting on Gary, no no no. :P