Trajectoires: a Mobile Application for the Control of Sound Spatialization

Jérémie Garcia, Xavier Favory, Jean Bresson
(2015)

Trajectoires is a mobile application that allows drawing sound sources trajectories. The trajectories remotely control any spatial audio renderer using the OpenSoundControl protocol.

We are investigating the new possibilities offered by mobile devices such as smartphones and tablets to support sound spatialization control by composers. This project aims at combining gestural input with touch input to draw trajectories and the sensors integrated such as accelerometers and gyroscope to compute orientation with algorithmic processes in Max or OpenMusic.

⇒ Project page on GitHub : downloads, installation and resources.

To use these examples, you need to have the Ircam Spat installed and authorized. You also need Max6 or Max7.
The traj-max-4sources-demo.zip archive contains a single patch able to use the data from Trajectoires directly to the spat-oper object.

Note that you can also use the trajectories created with the application within Antescofo. To do so, you need to export a trajectory (bottom-right button of the interface) and then find the traj folder located near the Traj.app application. In the traj folder there is a text file containing the data associated with the trajectory that can be directly loaded by antescofo. This trajectoires-to-antescofo example loads a trajectory and plays it for the duration of a sound in antescofo.

These patches work with the previous version of Traj that can be downloaded here :

• OSX (~80mb)
  

To use these examples, you need to have the Ircam Spat installed and authorized. You also need Max6 or Max7.
The Traj-Max.zip archive contains the following elements:

• traj2spat patch or external: converts messages received via OSC from Trajectoires into Spat.oper messages.
• traj-simple-pan: basic examples using traj2spat to control the position of a sound source.
• traj-complete: advanced example with two sources and automations to control aperture and orientation.

To use these examples, you need to activate the reactive mode in the OpenMusic preferences and have the OMChroma and OMPrisma librairies.

The OM6-trajectoires-patches.zip archive contains the following patches:

• trajectoires-receive: Receives a trajectory and creates a 3d-trajectory object.
• trajectoires-send: Sends a trajectory to the application for a given source.
• trajectoires-collections: Utilities to generate trajectories including circles and spirals.
• trajectoires-transformations: utilities to transform existing trajectories (scaling, rotation, translation).
• trajectoires-demo1: Receives the source 1 trajectory and sends back a mirrored trajectory for source 2.
• trajectoires-demo2: Receives the source 1 trajectory and sends back seven trajectories gradually rotated.
• trajectoires-demo3: Receives the source 1 and 10 trajectories and sends back 10 interpolated trajectories for source 1 to 10.

These videos illustrate the use of Trajectoires and possible applications.
Please use headphones as the videos use binaural sound.

• X. Favory, J. Garcia, J. Bresson (2015) Trajectoires : une application mobile pour le contrôle et l’écriture de la spatialisation sonore. In IHM'15: Proceedings of the 27th International Conference of the Association Francophone d'Interaction Homme-Machine. 8 pages.
• J. Garcia, J. Bresson, M. Schumacher, T. Carpentier, X. Favory, (2015) Tools and Applications for Interactive-Algorithmic Control of Sound Spatialization in OpenMusic. In inSONIC2015, Aesthetics of Spatial Audio in Sound, Music and Sound Art, Karlsruhe, Germany, 8 pages.
• J. Garcia, X. Favory, J. Bresson (2016) Trajectoires : a Mobile Application for Controlling Sound Spatialization. In CHI'16\EA: Extended Abstracts of the Conference on Human Factors in Computing. 2016. 4 pages. to appear

Trajectoires was used by:

• Daniel Cabanzo, Marginal situations (2015) Hidden lines in Electrical dimensions – Pièce pour accordéon et dispositif électronique
• Emmanuele Palumbo, Corps-sans-Organe (2015)
• Michael Jarrell, Dornröschen (Nachlese IVb) (2015)