Trajectoires: a Mobile Application for the Control of Sound Spatialization

Jérémie Garcia, Xavier Favory, Jean Bresson
(2015 - ongoing)

Trajectoires is a mobile application that allows drawing sound sources trajectories. The trajectories remotely control any spatial audio renderer using the OpenSoundControl protocol.

We are investigating the new possibilities offered by mobile devices such as smartphones and tablets to support sound spatialization control by composers. This project aims at combining gestural input with touch input to draw trajectories and the sensors integrated such as accelerometers and gyroscope to compute orientation with algorithmic processes in Max or OpenMusic.

Getting Started

You need to download and launch the desktop app first.
Then visit the web page displayed by the app with your browser or any mobile device to start the application.
Please note that your mobile device and your computer need to be on the same network.

Once the application is launched, you can use any OSC-enabled application or start with our example patches for Max and OpenMusic.

Downloads

Binaries (updated 25/02/2016)

WARNING: Once unzipped, you need to keep all the files in a folder named Traj.

Sources
Max patches (after 1.0)

To use these examples, you need to have the Ircam Spat installed and authorized. You also need Max6 or Max7.
The traj-max-4sources-demo.zip archive contains a single patch able to use the data from Trajectoires directly to the spat-oper object.

Note that you can also use the trajectories created with the application within Antescofo. To do so, you need to export a trajectory (bottom-right button of the interface) and then find the traj folder located near the Traj.app application. In the traj folder there is a text file containing the data associated with the trajectory that can be directly loaded by antescofo. This trajectoires-to-antescofo example loads a trajectory and plays it for the duration of a sound in antescofo.

Max patches for older versions (before 1.0)

These patches work with the previous version of Traj that can be downloaded here :

To use these examples, you need to have the Ircam Spat installed and authorized. You also need Max6 or Max7.
The Traj-Max.zip archive contains the following elements:

  • traj2spat patch or external: converts messages received via OSC from Trajectoires into Spat.oper messages.
  • traj-simple-pan: basic examples using traj2spat to control the position of a sound source.
  • traj-complete: advanced example with two sources and automations to control aperture and orientation.
OpenMusic patches

To use these examples, you need to activate the reactive mode in the OpenMusic preferences and have the OMChroma and OMPrisma librairies.

The OM6-trajectoires-patches.zip archive contains the following patches:

  • trajectoires-receive: Receives a trajectory and creates a 3d-trajectory object.
  • trajectoires-send: Sends a trajectory to the application for a given source.
  • trajectoires-collections: Utilities to generate trajectories including circles and spirals.
  • trajectoires-transformations: utilities to transform existing trajectories (scaling, rotation, translation).
  • trajectoires-demo1: Receives the source 1 trajectory and sends back a mirrored trajectory for source 2.
  • trajectoires-demo2: Receives the source 1 trajectory and sends back seven trajectories gradually rotated.
  • trajectoires-demo3: Receives the source 1 and 10 trajectories and sends back 10 interpolated trajectories for source 1 to 10.

Videos

These videos illustrate the use of Trajectoires and possible applications.
Please use headphones as the videos use binaural sound.

References / Publications

Acknowledgments

This work was carried out in the framework of the EFICACe projects with the support of the SMART Labex (ANR-11-LABX-65).

We are grateful to Eric Daubresse and all the composers that helped us designing and developing the application. The application is build upon Interface.JS, a work done by Charlie Roberts.

Composers/Works using Trajectoires:

  • 2015, Daniel Cabanzo, (Marginal situations) Hidden lines in Electrical dimensions - Pièce pour accordéon et dispositif électronique
  • 2015, Emmanuele Palumbo, Corps-sans-Organe
  • 2015, Michael Jarrell, Dornröschen (Nachlese IVb)
 


efficace/wp/trajectoires.txt · Dernière modification: 2017/08/10 22:50 par Daniel Cabanzo