Contribution

I see something you can only hear - New ways of analysing instruments and players using sonic camera, as well as pose, pitch, hand and expression tracking

Authors

* Presenting author
Day / Time: 18.03.2025, 15:20-16:00
Room: Hall E, Poster Island G
Typ: Poster
Session: Audio Signal Analysis, AI and other Tools in Musical Acoustics (Poster Island G)
Information: The posters will be exhibited in Hall E north from Tuesday to Thursday, sorted by thematic context in the poster island indicated in the session title. The poster session at the specified time offers the opportunity to enter into discussion with the authors.
Abstract: The current rapid development in the field of audio signal analysis and artificial intelligence as well as the possibilities of the acoustic camera expand the possibilities for describing and evaluating instrument sounds enormously and provide new insights into sound propagation and radiation on the instrument. Using the guitar and violin as examples, the contribution presents various possible applications of these new techniques, such as interactive visualisations of sound propagation in the first milliseconds from the plucked string via the bridge to the body, fast and easy-to-use online audio feature analyses, 2D and 3D pose tracking visualizations for musicians or an application for intonation control while playing the violin.During the DAS|DAGA conference there will be the opportunity to try out the applications presented at the poster stand.