GDnD Wiki

GDnD Wiki

This site is for Ulster University students and staff. Enter the class access password to continue.

Writing Interactive Music for Video Games

3 min read

Source metadata

  • Type: Textbook
  • Author: Michael Sweet
  • Publisher: Pearson / Addison-Wesley
  • Year: 2015
  • Structure: 6 parts, 30 chapters

Key takeaways

  • Music in games is categorised by its relationship to the game world: extra-diegetic (underscore — enhances player emotion without existing in the game world) vs diegetic (source music — music the player character could actually hear). A third category, music as gameplay, makes music a core mechanic (Guitar Hero, rhythm games).
  • Interactive/adaptive music responds dynamically to game state via control inputs (player position, AI state, health, time of day). The score may sound different on every playthrough.
  • Horizontal resequencing — time-based branching: music transitions at phrase boundaries, allowing clean harmonic changes but with delayed response. Three sub-techniques: branching, crossfading, transitional.
  • Vertical remixing — layer-based intensity: tracks are added/removed in real time for quick mood shifts, but harmonic and tempo structure remain constant throughout. Two approaches: additive layers (begin with drone, add layers) and individually controlled layers (all layers playing, gain automating per-layer).
  • MIDI scores — a third technique offering real-time tempo, harmonic, and instrumental control, but limited by the synthetic quality of MIDI playback.
  • Repetition kills suspense (Bear McCreary): the brain habituates to repeated stimuli. Unlike film, games cannot control how often music is heard — interactive techniques exist specifically to combat musical fatigue.
  • Music loops require careful audio editing: zero crossing points, waveform direction matching, reverb tail baking into the loop head, and transients to hide edit points.
  • Synthesis chain: sound generator (oscillator/sampler) → filter (LPF/HPF/BPF) → volume envelope (ADSR) → LFO modulation.
  • Audio signal processing (DSP effects): time-based (reverb, delay, chorus, flanging), frequency-based (EQ, filters, pitch shifting), volume-based (compression, limiting, gating).
  • Audio middleware (FMOD/Wwise) sits between the game engine and the audio content, providing composers with non-programmer tools for interactive music implementation, DSP at runtime, 3D audio, cross-platform deployment, and memory/CPU optimisation.
  • Sound design techniques: pitch manipulation of samples, recording unusual objects (bowls, bowed cymbals, oil tanks), live instrument sessions.

Notable claims

“The primary function of music in video games is to create tension. The resolution of that tension amplifies the gamer’s euphoria when finishing a goal, feeding his or her desire to keep playing.” — Bear McCreary (composer perspective, Ch. 1)

“The best interactive scores do a great job of hiding the interactive portions from the player.” — Sweet, Ch. 3

“Video game developers may sometimes ask the composer to deliver drier, less effect-filled mixes because some effects (e.g., reverb, filters, and compression) are applied by a game-wide filter at runtime. Audio middleware such as Wwise and Fmod can provide these DSP effects while the game is running.” — Sweet, Ch. 11

Relevance

This source primarily informs the following wiki topics:

  • music-in-games — music types, functions, serendipitous sync, motifs/cues, repetition problem
  • interactive-music-techniques — horizontal resequencing, vertical remixing, MIDI scores, control inputs, audio middleware
  • sound-design-basics — synthesis chain, filters, ADSR, LFO, DSP effects, sound creation techniques
  • audio-middleware-overview — FMOD/Wwise as the tool layer connecting adaptive score design to runtime implementation

It also touches on production topics (audio design documents, music spotting sessions, working with programmers) and business topics (contracts, rights-for-hire, composer career paths) not yet covered in the wiki.

Open questions raised

  • As procedural/algorithmic music generation (using AI tools) matures, will horizontal resequencing and vertical remixing remain the industry standard, or be supplemented or replaced?
  • Sweet’s book predates spatial audio features now standard in game engines (Unity’s Audio Spatializer, Wwise Spatial Audio). How should 3D audio positioning be documented alongside music techniques?

Graph View

Backlinks