repoVizz: a framework for remote storage, visual browsing, annotation and exchange of multi-modal data
Motivated by a growing need for data-driven collaborative research, repoVizz aims to resolve commonly encountered difficulties in sharing or browsing large collections of multi-modal data. At its current state, repoVizz is designed to hold time-aligned streams of heterogeneous data: audio, video, motion capture, physiological signals, extracted descriptors, annotations, etcetera. As an UPF initiative, repoVizz has been developed in the context of a number of research projects dealing with multi-modal analysis of music performance like the EU FP7 ICT FET SIEMPRE. repoVizz continues to be developed and extended within PHENICX by adding new and advanced visualizations that allow improving the user experiences in the frame of classical music concerts
http://repovizz.upf.edu/ and http://repovizz.upf.edu/RCO-Eroica/
RCO Editions: the world of the Royal Concertgebouw Orchestra from the comfort of your own home
RCO Editions is a bimonthly video magazine for the iPad, featuring concert registrations of the Royal Concertgebouw Orchestra and supporting commentary, documentaries, articles and graphics. Together with Videodock, the SME partner in the PHENICX project, an innovative way of adding enriching content to the musical presentation has been developed, offering rich content as extra layer on specific moments in the music.
Advances in the PHENICX project inspire novel features in RCO Editions: for example, this led to synchronized score information being integrated as an enrichment layer. At the same time, RCO Editions is used as a platform to attract a user audience which can give feedback on early academic achievements within PHENICX.
http://www.concertgebouworkest.nl/en/rco-editions/
PHENICX videos
We will continuously show several videos showcasing ongoing work in the PHENICX project :
- visualization of musical piece information in RepoVizz (UPF)
- performance worm visualization (OFAI)
- source separation in symphonic recordings (UPF)
- expressiveness from conducting motion capture data (ESMUC, UPF)
- visual analysis of performing musicians (TUD)
- alignment of multiple performances of the same piece (OFAI)
- offline score following (OFAI)
- online score following: automatic page turner (JKU)
- online score following: piano music companion with anytime piece identification (JKU)