Practice · Research Thread

Music with Digital Musical Instruments

What does the causal link between physical gesture and sonic result contribute to the audience’s sense of authentic concert experience?

The Authenticity Angle

In Higher Order Gestalt Fromage, the deliberate dissolution of the gesture-sound causal link — from first-order surrogacy toward remote surrogacy while the performers’ bodies remain visible — stages the estrangement that results. The piece asks what the causal link was doing for authenticity by systematically removing it, within a co-present setting where the performers’ physical presence is never in question, only the legibility of their agency.

This thread also built the research infrastructure — the T-Stick ecosystem, the T-Stick Music Creation Project (TMCP), the T-Patch software — and established the vocabulary (gestural surrogacy, gesture vocabulary development) that informs the later threads. The DMI strand is the root of the authenticity question: it named it explicitly in the HOGF program note (NIME 2021).

Works

Higher Order Gestalt Fromage (2019/2020)

Two sopranino T-Sticks and 3D surround · 13 min · Co-composed with Ana Dall’Ara-Majek (blablaTrains)

The piece explores the gradual disintegration of the gesture-to-sound causal link, beginning from clear, identifiable mappings between physical gesture and sonic result and progressively dissolving that link into hyperreality, where the causal chain is no longer recoverable. In Smalley’s terms, the piece moves from first-order or second-order surrogacy toward remote surrogacy — the most acousmatic end of the continuum — while the physical performing bodies remain visible.

The disconnection becomes perceptible as a form of estrangement: the audience sees the cause but the expected effect fails to materialise in recognisable form. This connects to Baudrillard’s simulation/hyperreality framework applied to gestural performance: the gesture persists but its sonic referent has been severed.

live@CIRMMT, Montreal, 2020 · NIME 2021, Shanghai

Pythagorean Domino (2019)

Augmented Theremin and gestural controller, octophonic · Co-composed with Ana Dall’Ara-Majek (blablaTrains)

Integrates musique concrète techniques with algorithmic composition for gestural controllers. Fragmented sounds form composite objects that transform gradually from one state to another through an algorithmic system, emphasising triangular interactions between performers, computers, and the performance environment.

Runner-up, IEMC 2020 · Premiere: NIME 2019, Porto Alegre

Key Concepts

  • Gestural surrogacy — Denis Smalley’s continuum between action and sound, from first-order (gesture directly causes sound) to remote surrogacy (no recoverable causal link). The T-Stick makes this continuum compositionally navigable.
  • The second performer problem — when a DMI creator can no longer perform the instrument themselves, the knowledge transfer to a second performer exposes what was tacit in the original design. This is both a practical challenge and a test of the instrument’s longevity.
  • DMI roles taxonomy — actuator, modulator, data provider: a classification of how digital instruments function in ensemble contexts.
  • Demonstration content as pedagogy — compositions written for a DMI serve as pedagogical infrastructure, teaching future performers the instrument’s idiomatic vocabulary.

Publications

  • Fukuda, T. and Wanderley, M. “T-Patch: A Modular Software for the T-Stick.” NIME 2023.
  • Fukuda, T. et al. “The T-Stick Music Creation Project.” NIME 2021.
  • Dall’Ara-Majek, A. and Fukuda, T. “Pythagorean Domino.” NIME 2019 Music Proceedings.
  • Meneses, E., Fukuda, T., and Wanderley, M. “Gesture Vocabulary Development for Digital Musical Instruments.” HCI International 2020.