Tuesday, November 19, 2013

Gary Rydstrom - Unexpected Sounds

VIEW Conference 2012, Turin: the live tweet wall during Gary Rydstrom's keynote. Sound is about good choices.

Last year, Skywalker Sound’s Gary Rydstrom, joined for the first time the roster at View Conference – Italy’s leading computer graphics symposium – following Randy Thom in 2011. His feature presentation was called UNEXPECTED SOUNDS. The 19th October 2012, inside the Cavour Hall, at the conference center “Torino Incontra”, professionals and sound lovers coming from different countries, gathered to be part of this unique moment.

Now, we have the opportunity to present here the polished session of Gary at VIEW. The recording I made directly from the console to my Zoom H4 has been possible thanks to Maria Elena Gutierrez, director of the Festival. In this one-hour podcast, Gary talks about the art of sound design and illustrates how sound is being used and how it can be better used to tell stories. You’ll listen to many examples of raw sound effects recordings, designed sounds, and mixes from Pixar films, and live-action films such as “T2,” “Jurassic Park” and “War Horse”.

Enjoy… and thanks Gary for your invaluable experience!

Matteo



The talk

A cleaned and reorganised transcript of the keynote, lightly edited for readability; Gary’s content and examples are preserved.

Introduction

Sound doesn’t get talked about much, but it is central to telling stories in film. This talk is about “unexpected sounds”: the sounds themselves are often not what you would guess, and the power sound holds over an audience is greater than people expect. What follows is, more or less, a career condensed into forty-five minutes: the secrets of sound design.

The creative process, honestly described: get an idea, reject it; get an idea, reject it; repeat; then run out of time. It sounds like a joke, but that is genuinely how it works.

Secret 1 — Gather real sounds

Sound design begins with gathering sounds, and real sounds are far more interesting than manufactured or synthesised ones. Recording is an adventure; it is the heart of the early work.

Examples from War Horse:

  • Plowing recorded at Skywalker Ranch (with George Lucas’s office in the background) using real plow horses and an old-fashioned plow.
  • A liquid-nitrogen “explosion” on the scoring stage: boiling water poured into liquid nitrogen gives a controlled blast that sounds like an old-fashioned movie explosion, and hurts no one.
  • World War I artillery recorded in Georgia, USA, from a collector’s arsenal, on a repaired vintage Nagra with quarter-inch analog tape (“still sounds better than digital, just heavier to lug”). Microphones placed downfield also caught the classic whistle of shells passing overhead — real sounds that are also “fodder” for the future (“someday that sound is going to be a spaceship”).

Secret 2 — The inappropriate sound (the golden rule)

Once a sound is recorded, it is separated from its source. It no longer matters what it really is — only how it makes you feel. That is the key to all sound design.

Rydstrom credits this lesson to Treg Brown (the Warner Bros. cartoon sound man). Chuck Jones told him Brown’s secret was that he never used an appropriate sound. The “inappropriate” sound — not the literal thing, but the one with the right feeling — is often better.

Fake WWI artillery pass-bys built for War Horse:

  • a tea kettle whistle (subliminally apt for a British-military story; the same whistle first used in a Wile E. Coyote gag);
  • a bowed copper bowl, resonated and artificially Dopplered — his favourite, the “fast, dangerous incoming” sound;
  • a vacuum cleaner worked into the crevice of a carpeted stair.

Secret 3 — Keep your ears open

You never know what you’ll hear that could become something else in a movie.

Terminator 2 — many of its strangest sounds came from mundane sources: dropped nails (musical), objects dropped in a frying pan for molten metal, and his wife blowing into a Burger King milkshake (strawberry beat chocolate). Mission: Impossible – Ghost Protocol — the electromagnetic gloves on the Burj Khalifa are the remembered thump of an MRI machine. His dog Chester’s “I hate being cuddled” grumbles became an alien’s complaints in the Pixar short Lifted (which Rydstrom directed — a film, he notes, secretly about the ordeal of mixing).

Secret 4 — Personality

The best word for what makes a good designed sound is personality: something unique, lively, seemingly with a story to tell. Any sound can be given personality.

  • Teddy (Spielberg’s A.I.): the robot bear’s motors are animal sounds — a sped-up parrot, insect buzzing, a woodpecker’s ratchet — read as motors but carrying a living charge.
  • Titanic (Cameron): the dying ship’s creaks are real metallic creaks blended with pitched-down animal sounds (elephant, gorillas, lions), hidden so you hear only a dying beast.
  • Quiz Show: flashbulbs fused with a punch, a door slam and a scream, so the press assaulting the character means something emotionally.

Secret 5 — The magic of combinations

Layering sounds, and marrying sound to picture, produces something you didn’t expect.

  • Luxo Jr. (Pixar’s first film): rather than cartoon slide-whistles, cartoony sounds from realistic sources — screwing/unscrewing light bulbs, scraping metal tubes — cut into emotional phrases become a living, breathing character. This “grounded-real-but-cartoony” approach carried through Toy Story and beyond.
  • Brave: when the mother is turned into a bear but must still “act” as mom, her voice is built entirely from animals (horse and others — very little actual bear), treated like dialogue so the animators could animate to it.

Secret 6 — Storytelling

Sound should advance the story, not just be big, cool or rich — a core of the Pixar approach. The finest sound design keeps recording the real world (a fridge creak, a dog, a bathtub drain, the wind) and turns it into something that serves the story.

On Ben Burtt

Burtt (Rydstrom’s mentor at Skywalker Sound) is the master of taking ordinary sounds and using them so you think you’ve never heard them before:

  • Star Wars blaster: striking a radio-tower guy wire — with his wedding ring for the best twang.
  • Lightsaber: the hum of a bad film projector at USC, recorded close.
  • Opening spaceship fly-over (Star Wars): the air conditioner of the old motel where he was staying, pitched down.
  • The TIE fighter is a camel.

Related: Walter Murch’s “worldizing” on American Graffiti — playing the music back over speakers in various parking lots and re-recording it off the walls, a natural reverb no device has matched.

Memorable sound in film (audience exchange)

  • Raging Bull — punches sweetened with explosions and animal sounds; natural crowd sound drops away to put you inside De Niro’s head. No music in the fight scenes.
  • Alien — horror is the ideal genre for sound: it is scarier to hear more than you see. You barely see the alien; the fear is in the sound (Burtt contributed lonely radio-frequency sweeps and sine tones).
  • The Matrix (Dane Davis) — a world that isn’t quite ours is a gift to the sound designer.
  • Titanic (planned in advance) — the iceberg impact shifts perspective cut by cut: the puncture at the hull, then only a trembling wheel on the bridge, then steerage, then a chandelier’s tinkle in first class. No music. The contrast tells you the scale of the ship and the distance of the event.
  • Rear Window (Hitchcock) — no score except the songwriter’s tune built up across the film; the love song plays over a horror climax, telling a different story from the image.
  • The Bridge on the River Kwai (Lean) — three layers, no score: boots on the bridge above, nature below, a party in the distance.
  • Also cited: Fahrenheit 451 (Truffaut), Citizen Kane (Welles, out of radio), and Kubrick — happy or classical music turned uncanny (The Shining, 2001, Dr. Strangelove), and the great use of silence in 2001. The lesson from all of them: they don’t do the expected thing.
VIEW Conference 2012, Turin: the live tweet wall during Gary Rydstrom's keynote. «Great directors plan ahead the use of sound.»

Case study — Saving Private Ryan (the premixes)

A film’s effects are mixed as ~15 premixes, layered for control. Rydstrom walked through the Omaha Beach landing, element by element:

  1. Foley — equipment, footsteps, sand; as important as dialogue, because the scene is about a soldier’s experience, not the battle itself.
  2. Bullet bys — placed first, before hits, so the level can be controlled; soldiers said the whip-by is what they remembered.
  3. Bullet hits — mostly on-screen; you rarely see a gun fire, you are being shot at, so the gun itself was the least important element.
  4. Specific guns — e.g. the German MG42, so fast the Allies nicknamed it “Hitler’s zipper.”
  5. Distant guns — layered background that keeps the space alive.
  6. Explosions, then incoming artillery (each blast preceded by its by), a deep off-screen boom used like a drum for weight.
  7. Authentic BBC optical recordings of actual 1944–45 battles, low-fi but real.

No music (Spielberg and John Williams left it out to keep it visceral). The scene works because it is shot close and handheld, at human level, and the soundtrack carries the scale the visuals don’t show. Note on accuracy: unlike his usual instinct to “sweeten” (e.g. Backdraft’s fires carry cougar screams; the German tanks were fabricated), here Rydstrom kept it real — no T-Rex in the tanks, despite Spielberg’s suspicion. (The underwater bullet whips were, however, a sound he had recorded for A River Runs Through It: a fly-fishing line whipped off the water’s surface.)

VIEW Conference 2012, Turin: the live tweet wall during Gary Rydstrom's keynote. «It's scarier to hear more than you see.»

Case study — Jurassic Park dinosaurs (layering)

Gather first, then blend real animal sounds into vocals:

  • Velociraptor scream — a low walrus mixed with a high baby-dolphin cry (plus horse breathing, a de-barked dog, an angry goose, and a friend’s mouth sound in the mix).
  • T-Rex — footsteps built from redwood trees being felled, with sonic booms as the first thing you hear (a scary way to introduce it); a whale’s blowhole for breathing; a low alligator; and, for the attack, a baby elephant’s high scream (“too good not to use”).

The T-Rex is introduced heard before seen — several minutes of Hitchcockian tension rather than one second of shock. (When a scientist objected that a real T-Rex would only have gurgled, Rydstrom’s reply: “It’s a movie.”)

Case study — A Bug’s Life (wing flaps)

Roughly twenty different wing-flaps, each from something unrelated: a dragonfly close on the mic, fingernails on a blackboard, a kazoo (for cute little Dot), bubble wrap, a mosquito in a beaker at UC Berkeley, a toy whistle, spinning film at the end of a reel, bees blended with old-aircraft tones. Performing Dot’s kazoo live for children, then playing it against the picture, recaptured the first thrill of putting sound to image.

Closing thoughts

  • There is still no technology that creates believable organic sound effects from scratch the way CG creates images; sound tools collect, edit and mix, but do not synthesise convincing reality. (A morphing tool would be the dream; the Kyma system, made in Illinois, “comes close.”) Rydstrom doesn’t mind — he likes that sound is real, and that real sound grounds otherwise invented worlds (Luxo Jr., Toy Story, Jurassic Park).
  • Useful resources: Cornell’s Lab of Ornithology (the largest nature-recording repository), and new laser-vibrometer recordings of insects (e.g. the treehopper) — sounds never heard before, used for strange ambiences in A.I.
  • The through-line: keep your ears open, gather the real world, and find the inappropriate sound that carries the right feeling. When the right sound meets the image, it comes alive.