Mettre les sons en mouvement ? - Frédéric Bevilacqua STMS Ircam-CNRS-Sorbonne Université - CNRS Insu
←
→
Transcription du contenu de la page
Si votre navigateur ne rend pas la page correctement, lisez s'il vous plaît le contenu de la page ci-dessous
Mettre les sons en mouvement ?
Frédéric Bevilacqua
Equipe Interaction Son Musique Mouvement
http://ismm.ircam.fr
UMR STMS Ircam-CNRS-Sorbonne Université
IRCAM – Sound Music Movement Interaction team - http://ismm.ircam.fr Frédéric Bevilacqua, Riccardo Borghesi, Abby Wanyu Liu, Benjamin Matuszewski, Iseline Peyre, Marion Voillot, Hugo Scurto, Diemo Schwarz Former members: Norbert Schnell, Baptiste Caramiaux, Jean-Philippe Lambert, Eric Boyer, Gaël Dubus, Sarah Fdili Alaoui, Jules Françoise, Gabriel Meseguer Brocal, Sébastien Robaszkiewicz, Maël Segalen, Joseph Larralde, Kevin Sanlaville, Pavlos Antoniadis, Bruno Zamborlin,Victor Zappi, Ianis Lallemand, Fabien Cesari, Karim Barkati, Julien Bloit, Nicolas Rasamimanana Collaborators Emmanuel Fléty, Olivier Houix, Patrick Susini, Guillaume Lemaître, Anne Dubos, Bertha Bermudez, Hortense Kack, Agnès Roby-Brami, Sylvain Hanneton, Tajadura Jimenez, Nadia Berthouze, Marco Suarez Cifuentes, Garth Paine, Michelle Agnes Magalhaes, Dominique Fober, Jean-Louis Frechin, Uros Petrevski, Matthieu Savary, Pierre Jodlowski, Andrea Cera, Roland Cahen, Florence Baschet Acknowledgements Support of ANR (Interlude, CoSimA, Legos, Element, Labex SMART, EU projects Rapid-Mix, MusicBricks, Skat-VG, Région Ile de France, Cap Digital,
By DoodleChaos https://www.youtube.com/watch?v=vcBn04IyELc
Manuel Barrueco
was around 3 ms. The data acquisition and the sound generation were processed by a
dedicated program built under the Max/MSP2 environment. The data were received in
Boucle d’action/perception
Max/MSP using a custom built Max object based on the LeapMotion™ API.
Control the sounds with
The subjects were instructed to stand and to place their preferred hand above the
device in order to explore the space in front of them. The figure 4.2 shows a picture of
Listen
a subject in& Move
cylinderEcoute your movements
place and a schematic of the AVS used in the experiment. The AVS was a
section with a curvature radius R, a constant thickness (e = 80 mm) and width
(1000 mm, adapted to the horizontal operating range of the tracking device). A positive
value of R makes the plate concave and a negative one makes it convex, with the same
curvature and centered in the same spot. In the z direction, the depth of the surface was
Interactive gestural systems
also defined with auditory
by the maximum range o↵ered feedback
by the device (the limit of the plate was the
limit of the tracking area, which was superior to the arm length). It was presented as a
“curved plate with a constant thickness” to the blindfolded subjects. The height H of the
surface center was adjusted to the natural initial resting position of the subjects (with the
Mouvement Son/Musique
hand kept horizontally); it was generally around 30 cm.
R
for sensori-motor learning
Y
e
Action
H
X
Technologies
We#acknowledge#support#from#the#ANR#project#LEGOS,#the#Labex#SMART#and#the#EU#project#SkatDVG.#Sound#
sensory music &
corpus#is#part#of#the#DIRTI#installaJon#developed#by#User#Studio,#Diemo#Schwarz#(Ircam)#and#Roland#Cahen#
Sensing device
sport rehabilitation (ENSCI).#Thanks#to#the#ISMM#Team#@#IRCAM#and#SIATDSFU.
Numériques ?
substitution sound design
(a) (b)
http://apps.cosima.ircam.fr/checks/
By Norbert Schnell, Benjamin Matuszewski, Sébastien Robaszkiewicz et al.
IRCAM-STMS
Equipe Interaction Son Musique Mouvement
Création Apprentissage
Pédagogie Jeux
Musicale de mouvement
!
May 13, 2011
For$a$Violinist,$Success$Means$A$New$Low$Point$
By MATTHEW GUREWITSCH$
!
Librado Romero/The New York Times
More than one string to her bow: apart from her remarkable acoustic discoveries in the realm of subharmonics,
the violinist Mari Kimura has been exploring the new horizons opened up by an electronic motion sensor, a half-
Instruments Nouvelles Jeux Rééducation
glove equipped with electrodes that monitor the angle and speed of her bowing arm.
!
SINCE!Pythagoras,!musicians!and!scientists!have!known!(or!thought!they!knew)!that!
augmentés Interfaces Collectifs guidée par le son
the!lowest!pitch!a!string!stretched!taut!can!produce! !the!fundamental! !is!the!pitch!it!
d!
the!vibrating!section!sounds!at!a!higher!pitch.!Theoretically,!there!is!no!ceiling.!As!with!
!
For!the!last!five!centuries,!give!or!take,!the!range!of!a!violin!bottomed!out!on!the!G!
Nouveaux Instruments de Musique Numériques
Biomuse,
Instruments - XX - XXI
A. Tanaka et al., 1992
(few picks among many…)
Karlax
Very Nervous System
David Rokeby (1990)
Smule - iphone
The Hands,
M. Waisvisz, 1984
Theremin,
L. Theremin, 1928
EEG and Music
Alvin Lucier, 1965
ReacTable,
saxophone S. Jorda et al., 2005
Electric Guitar
1846 20th ’20 21thMO – Modular Musical Objects 1er prix 2011 Margaret Guthman Musical Instrument Competition Biennale Internationale Design, St-Etienne 2010 Talk to Me, MoMA – NY 2011 Prix ANR du Numérique, Impact Sociétal 2013
Modular Musical Objects
IRCAM, NoDesign, Da Fact 2011
https://www.youtube.com/watch?v=Uhps_U2E9OMDIRTI, Dirty Tangible Interfaces (projet Topophonie)
User Studio, IRCAM (Diemo Schwarz), R. Cahen 2012
http://en.userstudio.fr/projects/dirti-for-ipad/2011
Prototypes
Produits
Technologies de Installations
Recherche
captation de gestes grand public
DIRTI
Logiciel (UserStudio, IRCAM, ENSCI)
coloop
H2020 tapioca toys
RapidMix/ Stonic / MIMES
MusicBricks EU Skat-VG with PDS team
ANR projects: IRCAM
2019 LEGOS CoSiMa ELEMEN CoSiMa project
IRCAMSonifier des objets
https://www.youtube.com/watch?v=QpwZus_MTBU
Olivier Houix, Patrick Susini, Nicolas Misdariis, Frédéric Bevilacqua, Emmanuel Fléty (IRCAM)Playing Sound Textures
Françoise, J., et al. ACM SIGGRAPH 2014 Emerging Technologies.
Synthesis: Corpus-based Descriptor-driven Sound Synthesis (CataRT D.Schwarz et al.)
Sound Corpora from DIRTI by User Studio, Diemo Schwarz, Roldan CahenThe Imitation Game
SIGGRAPH 15 - Emerging Technologies
Participant 2:
Participant 1:
Action cards for inspiring vocal Imitates the gesture
Performs a gesture
imitations and gestures Vocalization is played back
and a vocalization
(feedback)
J Françoise, N Schnell, R Borghesi, F Bevilacqua - interactions, 2015 - dl.acm.orgGuider le mouvement par le son ?
Jouer des sons avec des objets Rééducation
Le son permet-il
• d’améliorer le mouvement ?
• de motiver la personne ?Rééducation avec retour sonore
I. Peyre, F. Bevilacqua, P. Pradat-Diehl, V Marchand-Pauvert, A. Roby-Brami, Pitié Salpêtrière Hospital, ISIR, L
Sorbonne Université
PhD Thesis “Auto-rehabilitation with Audio Feedbacks with Smartphones and Connected Objets”
• Le son comme information sur le mouvement et comme motivation
• Vers l’auto-rééducation à la maison
Sensors Now Next ?
Collaboration Hortense KackCoMo: Design de geste et mouvement
• Apprentissage de mouvement avec retour sonore http://como.ircam.fr
• Applications artistiques (danse , musique) B. Matuszewski, J. Larralde, F Bevilacqua
Application à danser - Orbe.mobi Dantzagunea 2018, Espagne
Collaborations: Bertha Bermudez, Michelle Agnes Magalhaes, Anne Dubos
+ MovA (http://mova.one/), CRI-Paris.org, Orbe.mobiInteraction mouvement-son sans écran
Collaboration avec Anne Dubos (IAS Nantes, Compagnie Little Heart Movement), Norbert Schnell (HS Furtwangen)
Marion Voillot, Joël Chevrier (CRI-Paris), Guillian Graves, Roland Cahen (ENSCI-les Ateliers)
• Interaction basée sur le mouvement avec des dispositifs nomades (telephones etc)
• Applications pour l’éducation par le numérique
Next
La Géante Endormie, Nuit blanche 2018 (Marion Voillot, Zoé Aegerter et Roland Cahen)Interactions Musicales
Collectiveswireles
motion s
data
receive
n s e n s o r r
mot i o
d w i re l e s s
an
n s m i t t e r
traUrban Musical Game – Early Tests IRCAM, NoDesign, Phonotonic, Andrea Cera, 2011
Urban Musical Game – Festival Futur en Seine IRCAM, NoDesign, Phonotonic, Andrea Cera 2011
N. Schnell (coordination)
Collaborative Benjamin Matuszewski
Sébastien Robaszkiewicz
Situated Jean-Philippe Lambert
Media David Poirier-Quinot
Samuel Goldszmidt
Olivier Warusfel
Expériences sonores et musicales Frédéric Bevilacqua
collectives / participatives / distribuées
ProXoMix
basées sur les technologies web-mobiles
Ircam CoSiMa, 2016
OrbCollective Sound Checks
Ircam, Centre Pompidou, anywhere since 2014
apps.cosima.ircam.fr/checks/wwryCollective Sound Checks Paris Face Cachée
https://apps.cosima.ircam.fr/CoLoop NoDesign et Ircam Futur en Seine, 2017
CoLoop NoDesign et Ircam Futur en Seine, 2017
Collaboration avec l’équipe Espaces Acoustiques et Cognitifs IRCAM
https://www.youtube.com/watch?v=a4taMsypqosChloé X Ircam (2015) CoSiMa Project
Grainfield
B. Matuszewski,N. Schnell, présenté à MusciTechFest’16
et AudioMostly’17 (Best Music Award avec Peyman Heydarian)Questions ?
Vous pouvez aussi lire
