Contribution
Sciene shines with SInES - SInES Tools for audio and video analysis, new updates and improvements
* Presenting author
Abstract:
Since 2023, the Space for Interdisciplinary Experiments on Sound (SInES) of the Vienna Department of Systematic Musicology has been offering a range of free online tools at https://sinestools.univie.ac.at/, with which researchers, students and others can collect a variety of music-related data from audio and video files. The tools include automatic pitch recognition, audio signal analysis, facial emotion analysis, and motion tracking of musicians, conductors, and dancers (Reuter, Czedik-Eysenberg, Cui 2023a+b). New additions include an application for precise pitch recognition, a program for violin intonation recognition/correction and an extreme metal vocals analyzer. The pose and hand tracking tools have also been improved to track both hands simultaneously and capture depth information for 3D body and hand tracking. In addition, new visualization tools have been developed for the data collected with the SInES tools. All these tools, updates and improvements will be presented at the DAS|DAGA conference in March 2025.Literature:Reuter, C., Czedik-Eysenberg, I., Cui, A.-X. (2023a). Happy Life comes with P5 - P5, ML5, Meyda and Plotly as helpful Tools in Teaching and Research. Proceedings of DAGA2023 (p. 991-994). Hamburg.Reuter, C., Czedik-Eysenberg, I., Cui, A.-X. (2023b). Moves & Grooves. OCG Journal 48/4, S. 20-23.