01.11.2018
Yleisöluennot

Vierailuluento: Olivier Lartillot, Computational sound/music/gesture analysis and application to gesture-based query in music catalogue

Aika:

9.11.2018 10:00 — 11:00


Sijainti: Muu, Musica, M308
Olivier Lartillot is a researcher working in the fields of computational music and sound analysis and artificial intelligence. He designed MIRtoolbox, a referential tool for music feature extraction from audio.

Time: Friday, November 9, 2018, klo 10-11
Place: M308, Musica

In the first part of this talk, I will give a short and broad overview of the MiningSuite, a Matlab toolbox that combines sound, music and gesture analysis. I will give a quick tour of the various types of sound and music analyses that can be carried out using the toolbox, covering a large range of musical dimensions such as timbre, rhythm, harmony or structure. The MiningSuite, integrating previous toolboxes such as MIRtoolbox and MIDI toolbox, can be used both for the analysis of audio recordings and of “symbolic” representations such as MIDI files. I will also present the current integration of motion capture and gesture analysis (from the MoCap Toolbox), as well as other sensor data such as breathing. The benefit of articulating these different types of analyses into a single framework will be demonstrated.

In the second part, I will present a project aimed at automatically extracting melodic gestures from a catalogue of folk music recordings from the National Library of Norway. While melodic lines can be easily extracted from a cappella songs, the task is more challenging for other types of music such as Hardanger fiddle music. In such cases, we need to automatically transcribe the recordings and track melodic voices throughout the counterpoint of each composition. I will also present an iPhone app that enables to draw a gesture in the air with the phone and to find pieces of music from the catalogue that is characterised by a similar musical gesture.

Bio
Olivier Lartillot, PhD, is a researcher at the RITMO Centre for Interdisciplinary Studies in Rhythm, Time and Motion, at the University of Oslo. Olivier earned an Art degree in Musicology at Sorbonne University in Paris, an engineering degree at Supélec in France, and a PhD in computer science at Ircam - Centre George Pompidou, UPMC Paris University. He conducted postdoctoral research as well as an Academy of Finland research fellowship at the Finnish Centre of Excellence in Interdisciplinary Music Research the University of Jyväskylä. He has also been researcher at the Swiss Center for Affective Sciences of the University of Geneva and at the Department for Architecture, Design and Media Technology, Aalborg University.

Olivier Lartillot is a researcher working in the fields of computational music and sound analysis and artificial intelligence. He designed MIRtoolbox, a referential tool for music feature extraction from audio. He also works on symbolic music analysis, notably on sequential pattern mining. He has collaborated on various projects around the topics of artificial intelligence, signal processing, cognitive science, neuroscience, music analysis, ethnomusicology and music therapy. He is a member of the Editorial Board of the Transactions of the International Society for Music Information Retrieval.

Lisätietoja

Petri Toiviainen

Professori

petri.toivianen@jyu.fi