Selected Research Publications from CNMAT from 1989 to the Present

Areas of Research include:

  • Protocol and encoding development including Open Sound Control (OSC) (http://opensoundcontrol.org/introduction-osc) and the Sound Description Interchange Format (SDIF) (http://www.cnmat.berkeley.edu/content/sdif-specification).
  • New sensor technologies and interface modalities: sensor fusion, integration.
  • New sense-enabled media: conductive/resistive fibre, malleable media.
  • eTextile, conductive paper and other materials for the New Lutherie
  • Many-channel digital audio interfaces; hundreds of channels over common ethernet. FPGA-based audio systems development.
  • Parallel computing theory in music/audio computing; algorithms, requirements.
  • Musical interactivity tools including digitizing tablets, multitouch and manytouch surfaces.
  • New user-interfaces for interaction with expressive musical/auditory environments, e.g. spatial mapping with dimensionality reduction.
  • Theoretical and applied spatial acoustics of loudspeaker and microphone arrays, especially in spherical configurations
  • Musical quality; metrics, augmentation, compression, hearing loss.
  • Signal-theory for musical gestures; requirements on jitter and latency, expressive bandwidth estimation
  • Semantics, requirements and cognitive models of music performance and their implications for software design patterns
  • Sound analysis for event detection, pitch and noise estimation and auditory perceptual models
  • Machine learning applications in audio synthesis and musical control
  • Auditory psychophysics and music cognition and perception
  • Curation and Development of real-time music and audio software tools.
Lalor E, Mesgarani N, Rajaram S, ODonovan A, Wright J, Choi I, et al.. Decoding Auditory Attention (in Real Time) with EEG. 37th ARO MidWinter Meeting. Baltimore, US: Association for Research in Otolaryngology; 2013. MacCallum J, Freed A, Wessel D. Agile Interface Development using OSC Expressions and Process Migration. In NIME. Daejeon Korea; 2013. Peters N, Lossius T, Schacher JC. The Spatial Sound Description Interchange Format - Principles, Specification, and Examples. Computer Music Journal [Internet]. MIT Press; 2013;37:11-22. http://www.mitpressjournals.org/loi/comj Piazza EA, Sweeny TD, Wessel D, Silver MA, Whitney D. Ensemble Coding in Audition. Psychological Science [Internet]. 2013;24:1389-1397. http://pss.sagepub.com/content/24/8/1389.short Rowland J. Flexible Audio Speakers for Composition and Art Practice. Leonardo Music Journal [Internet]. MIT Press; 2013;23:33-36. http://www.mitpressjournals.org/doi/abs/10.1162/LMJ_a_00151 Rowland J, Freed A. Colocated Surface Sound Interaction. In SigCHI. Paris, France; 2013. Santos JF, Peters N, Falk TH. Towards blind reverberation time estimation for non-speech signals. 21st International Congress on Acoustics (ICA). Montreal; 2013. Wei SXin, . Sound Design as Human Matter Interaction. In SigChi. Paris, France; 2013. Banerji R. Maxines Turing Test A Player-Program as Co-Ethnographer of Socio-Aesthetic Interaction in Improvised Music. 1st International Workshop on Musical Metacreation. Stanford University: Association for the Advancement of Artificial Intelligence; 2012. Battenberg E, Wessel D. Analyzing Drum Patterns using Conditional, Deep Belief Networks. In ISMIR 2012. Portugal: ISMIR; 2012. Battenberg E, Huang V, Wessel D. Toward Live Drum Separation Using Probabilistic Spectral Clustering Based on the Itakura-Saito Divergence. In AES 45th Conference: Applications of Time-Frequency Processing in Audio,. Helsinki, Finland; 2012. Freed A. The Paper FingerPhone: a case study of Musical Instrument Redesign for Sustainability. In NIME 2012 (Best Poster Award). Ann Arbor, Michigan; 2012. Freed A. Integration of Touch Pressure and Position Sensing with Speaker Diaphragms (Colocating Loudspeakers and Touch Interaction). In Audio Engineering Society. San Francisco: AES; 2012. Peters N, Lei H, Friedland G. Name That Room: Room identification using acoustic features in a recording. ACM Multimedia. Nara, Japan: ACM; 2012. Peters N, Choi J, Lei H. Matching Artificial Reverb Settings to Unknown Room Recordings: a Recommendation System for Reverb Plugins. 133rd AES Convention. San Francisco, US; 2012.

Pages