Tuning manifold harmonics filters

Tuning manifold harmonics filters
Thomas Lewiner, Thales Vieira, Alex Bordignon, Allyson Cabral, Clarissa Marques, João Paixão, Lis Custódio, Marcos Lage, Maria Andrade, Renata Nascimento, Scarlett de Botton, Sinésio Pesco, Hélio Lopes, Vinícius Mello, Adelailson Peixoto, Dimas Martinez

Abstract:

There are several techniques for automatic music visualization, which are included with virtually any media player. The basic ingredient of those techniques is spectral analysis of the sound, used to automatically generate parameters for procedural image generation. However, only a few music visualizations rely on 3d models. This paper proposes to use spectral mesh processing techniques, namely manifold harmonics, to produce 3d music visualization. The images are generated from 3d models by deforming an initial shape, mapping the sound frequencies to the mesh harmonics. A concise representation of such frequency mapping is proposed to permit for an animated gallery interface with genetic reproduction. Such galleries allow the user to quickly navigate between visual effects. Rendering such animated galleries in real-time is a challenging task, since it requires computing and rendering the deformed shapes at a very high rate. This paper introduces a direct GPU implementation of manifold harmonics filters, which allows to display animated gallery.

Downloads:

PDF paper (11.1 MB)
Keynote presentation (300.6 MB)
Slides in PDF (10.3 MB)
movie (107.8 MB)
YouTube

BibTeX:

@inproceedings{tuningmh_sibgrapi,
    author = {Thomas Lewiner and Thales Vieira and Alex Bordignon and Allyson Cabral and Clarissa Marques and João Paixão and Lis Custódio and Marcos Lage and Maria Andrade and Renata Nascimento and Scarlett de Botton and Sinésio Pesco and Hélio Lopes and Vinícius Mello and Adelailson Peixoto and Dimas Martinez},
    title = {Tuning manifold harmonics filters},
    year = {2010},
    month = {august},
    booktitle = {Sibgrapi 2010 (XXIII Conference on Graphics, Patterns and Images)},
    pages = {110--117},
    publisher = {IEEE},
    address = {Gramado, RS},
    doi = {10.1109/SIBGRAPI.2010.23},
    url = {\url{http://thomas.lewiner.org/pdfs/tuningmh_sibgrapi.pdf}}
}