Selected Research Publications from CNMAT from 1989 to the Present

Areas of Research include:

  • Protocol and encoding development including Open Sound Control (OSC) ( and the Sound Description Interchange Format (SDIF) (
  • New sensor technologies and interface modalities: sensor fusion, integration.
  • New sense-enabled media: conductive/resistive fibre, malleable media.
  • eTextile, conductive paper and other materials for the New Lutherie
  • Many-channel digital audio interfaces; hundreds of channels over common ethernet. FPGA-based audio systems development.
  • Parallel computing theory in music/audio computing; algorithms, requirements.
  • Musical interactivity tools including digitizing tablets, multitouch and manytouch surfaces.
  • New user-interfaces for interaction with expressive musical/auditory environments, e.g. spatial mapping with dimensionality reduction.
  • Theoretical and applied spatial acoustics of loudspeaker and microphone arrays, especially in spherical configurations
  • Musical quality; metrics, augmentation, compression, hearing loss.
  • Signal-theory for musical gestures; requirements on jitter and latency, expressive bandwidth estimation
  • Semantics, requirements and cognitive models of music performance and their implications for software design patterns
  • Sound analysis for event detection, pitch and noise estimation and auditory perceptual models
  • Machine learning applications in audio synthesis and musical control
  • Auditory psychophysics and music cognition and perception
  • Curation and Development of real-time music and audio software tools.
Andrews R, Smith H. CNMAT Newsletter Fall 2020. Harlan A, Ribeiro D, Campion E. 2020. Campion J. Discovering and Composing with Logos. 2020. Gillick J, Cella C-E, Bamman D. Estimating unobserved audio features for targed-based orchestration. In ISMIR [Internet]. 2019. Kulpa J, Campion E, Bedrossian F, Melford M. QuBits, an Interactive Virtual Reality Project and Compositional Space for Sound and Image [Internet]. [Berkeley, CA]: University of California, Berkeley; 2019. Valle R. Data Hallucination, Falsification and Validation using Generative Models and Formal Methods. Computational and Data Science and Engineering. 2018. p. 84. Campion E. Dual Reflections: A Conversation with Kaija Saariaho and Jean-Baptiste Barriere on Music, Art, and Technology. Saariaho K, Barrière J-B. Computer Music Journal (MIT) [Internet]. 2017;43(3). Banerji R. Balancing Defiance and Cooperation: The Design and Human Critique of a Virtual Free Improviser. In ICMC 2016. Utrecht: ICMA; 2016. Freed A. Sounds from the Electrified Human Body: Reconfigurations of Embodied and Encultured Knowledge from the development of Electrosomatophones. In Bodies of Knowledge BOK2016. UC Irvine; 2016. Freed A. David Wessels Slabs: a case study in Preventative Digital Musical Instrument Conservation. In SMC2016. Hamburg; 2016. Sha XWei, Solomonova E, Freed A, Veissire S, Formis B, MacCallum J. Experimental Collective Experience. In UC Irvine; 2016. Valle R, Fremont DJ, Akkaya I, Donze A, Freed A, Seshia SS. Learning and Visualizing Music Specifications Using Pattern Graphs. In International Society for Music Information Retrieval Conference. New York; 2016. Valle R. ABROA : Audio-based Room-occupancy Analysis using Gaussian Mixtures and Hidden Markov Models. In Future Technologies Conference (FTC) 2016. San Francisco; 2016. Valle R, Donz A, Fremont D, Akkaya I, Seshia S, Freed A, et al.. Specification Mining For Machine Improvisation With Formal Specifications. ACM : Computers in Entertainment (Musical Metacreation). 2016;. Bresson J, Bouche D, Garcia J, Carpentier T, Jacquemard F, MacCallum J, et al.. PROJET EFFICACE : DVELOPPEMENTS ET PERSPECTIVES EN COMPOSITION ASSISTE PAR ORDINATEUR. In Journes d'Informatique Musicale. Montral, QC, Canada; 2015. Bresson J, MacCallum J. Tempo Curving as a Framework for Interactive Computer-Aided Composition. In Sound and Music Computing. Maynooth, Ireland; 2015. Freed A, Wessel D. An Accessible Platform for Exploring Haptic Interactions with Co-located Capacitive and Piezoresistive Sensors. In TEI 2015. Stanford, California: ACM; 2015. Gottfried R. SVG to OSC Transcoding: Towards a Platform for Notational Praxis and Electronic Performance. In International Conference on Technologies for Music Notation and Representation (TENOR). Paris, France; 2015. MacCallum J, Gottfried R, Rostovtsev I, Bresson J, Freed A. Dynamic Message-Oriented Middleware with Open Sound Control and Odot. In International Computer Music Conference. University of North Texas, Denton, TX, USA; 2015. MacCallum J, Goodheart M, Freed A. Antony: A Reimagining. In International Computer Music Conference. University of North Texas, Denton, TX, USA; 2015. MacCallum J, Naccarato T. The Impossibility of Control: Real-time Negotiations with the Heart. In Electronic Visualization in the Arts. London, UK; 2015. Madgwick S, Mitchell T, Barreto C, Freed A. Simple Synchronization for Open Sound Control. In ICMC [Internet]. Texas: ICMA; 2015. Valle R, Freed A. Symbolic Music Similarity using Neuronal Periodicity and Dynamic Programming. Springer. Mathematics and Computation in Music. London, UK: Springer; 2015. Valle R, Freed A. Batera : Drummer Agent with Style Learning and Interpolation. In Study Day On Computer Simulation Of Musical Creativity [Internet]. University of Huddersfield, UK; 2015. Wessel D, Battenberg E, Schmeder A, Kelly F, Edwards B. Hearing aid fitting procedure and processing based on subjective space representation. USPTO. UC Berkeley; 2015. Donze A, Akkaya I, Seshia SA, Libkind S, Valle R, Wessel D. Machine Improvisation with Formal Specifications. In International Computer Music Conference. Athens, Greece; 2014. Freed A, DeFilippo D, Gottfried R, MacCallum J, Lubow J, Razo D, et al.. a Unified Communications Framework for Music, Intermedia and Cloud Interaction. In ICMC. Athens, Greece: IMCA; 2014. Lee EA, Rabaey J, Blaauw D, Dutta P, Fu K, Guestrin C, et al.. The Swarm at the Edge of the Cloud. IEEE Design and Test of Computers on Cloud Computing for Embedded Systems. 2014;. MacCallum J, Freed A, Wessel D. New Tools for Aspect-Oriented Programming in Music and Media Programming Environments. In International Computer Music Conference. Athens, Greece; 2014. Mitchell T, Madgwick S, Rankine S, Hilton G, Freed A, Andrew N. Making the Most of Wifi: Optimisations for Robust Wireless Live Music Performance. In New Instruments of Musical Expression. 2014. Colmenares JA, Peters N, Eads G, Saxton I, Jacques I, Kubiatowicz JD, et al.. A Multi-core Operating System with QoS Guarantees for Network Audio Applications. Journal of the Audio Engineering Society (JAES). 2013;61:174-184. Freed A, Uitti F-M, Mansfield S, MacCallum J. Old is the new New: a Fingerboard Case Study in Recrudescence as a NIME Development Strategy. In NIME. Daejeon Korea; 2013. Lalor E, Mesgarani N, Rajaram S, ODonovan A, Wright J, Choi I, et al.. Decoding Auditory Attention (in Real Time) with EEG. 37th ARO MidWinter Meeting. Baltimore, US: Association for Research in Otolaryngology; 2013. MacCallum J, Freed A, Wessel D. Agile Interface Development using OSC Expressions and Process Migration. In NIME. Daejeon Korea; 2013. Peters N, Lossius T, Schacher JC. The Spatial Sound Description Interchange Format - Principles, Specification, and Examples. Computer Music Journal [Internet]. MIT Press; 2013;37:11-22. Piazza EA, Sweeny TD, Wessel D, Silver MA, Whitney D. Ensemble Coding in Audition. Psychological Science [Internet]. 2013;24:1389-1397. Rowland J. Flexible Audio Speakers for Composition and Art Practice. Leonardo Music Journal [Internet]. MIT Press; 2013;23:33-36. Rowland J, Freed A. Colocated Surface Sound Interaction. In SigCHI. Paris, France; 2013. Santos JF, Peters N, Falk TH. Towards blind reverberation time estimation for non-speech signals. 21st International Congress on Acoustics (ICA). Montreal; 2013. Wei SXin, . Sound Design as Human Matter Interaction. In SigChi. Paris, France; 2013. Banerji R. Maxines Turing Test A Player-Program as Co-Ethnographer of Socio-Aesthetic Interaction in Improvised Music. 1st International Workshop on Musical Metacreation. Stanford University: Association for the Advancement of Artificial Intelligence; 2012. Battenberg E, Wessel D. Analyzing Drum Patterns using Conditional, Deep Belief Networks. In ISMIR 2012. Portugal: ISMIR; 2012. Battenberg E, Huang V, Wessel D. Toward Live Drum Separation Using Probabilistic Spectral Clustering Based on the Itakura-Saito Divergence. In AES 45th Conference: Applications of Time-Frequency Processing in Audio,. Helsinki, Finland; 2012. Freed A. The Paper FingerPhone: a case study of Musical Instrument Redesign for Sustainability. In NIME 2012 (Best Poster Award). Ann Arbor, Michigan; 2012. Freed A. Integration of Touch Pressure and Position Sensing with Speaker Diaphragms (Colocating Loudspeakers and Touch Interaction). In Audio Engineering Society. San Francisco: AES; 2012. Peters N, Lei H, Friedland G. Name That Room: Room identification using acoustic features in a recording. ACM Multimedia. Nara, Japan: ACM; 2012. Peters N, Choi J, Lei H. Matching Artificial Reverb Settings to Unknown Room Recordings: a Recommendation System for Reverb Plugins. 133rd AES Convention. San Francisco, US; 2012. Peters N, Lossius T, Schacher JC. SpatDIF: Principles, Specification, and Examples. SMC: 9th Sound and Music Computing Conference (Best Paper Award). Copenhagen, DK; 2012. Peters N, Lossius T, Place T. An Automated Testing Suite for Computer Music Environments. In 9th Sound and Music Computing Conference (SMC). Copenhagen, DK; 2012. Peters N, McAdams S. A Perceptual Analysis of Off-Center Sound Degradation in Surround-Sound Reproduction Based on Geometrical Properties (A). J. Acoust. Soc. Am., presented at Acoustics 2012, Hong Kong [Internet]. 2012;131:3256-3256. Rowland J, Freed A. Flexible Surfaces for Interactive Audio. In Interactive Tabletops and Surfaces. Cambridge, MA: ITS; 2012. Battenberg E, Avizienis R. Implementing Real-Time Partitioned Convolution Algorithms on Conventional Operating Systems. In DAFX 2011. Paris, France; 2011. Colmenares J, Ian S, Battenberg E, Avizienis R, Peters N, Asanovic K, et al.. REAL-TIME MUSICAL APPLICATIONS ON AN EXPERIMENTAL OPERATING SYSTEM FOR MULTI-CORE PROCESSORS. In ICMC 2011. Huddersfield, England; 2011. Freed A, MacCallum J, Schmeder A. Composability for Musical Gesture Signal Processing using new OSC-based Object and Functional Programming Extensions to Max/MSP. In New Interfaces for Musical Expression. Oslo, Norway; 2011. Freed A. Diverse Roles of Objets Trouvs in Live Solo Visual Music Practice. In Understanding VISUAL Music 2011. Montreal, CA; 2011. Freed A, MacCallum J, Schmeder A. Dynamic, Instance-based, Object-Oriented Programming (OOP) in Max/MSP using Open Sound Control (OSC) Message Delegation. In ICMC 2011. Huddersfield, England: ICMA; 2011. Mann Y, Freed A. Pervasive Cameras: Making Sense of Many Angles using Radial Basis Function Interpolation and Salience Analysis. In Pervasive 2011. San Francisco, CA; 2011. Peters N, W. SAndrew. Synthesizing classic recording microphones characteristics using a spherical microphone array (A). J. Acoust. Soc. Am., presented at the 162th Meeting of the Acoustical Society of America [Internet]. 4th ed. San Diego, US: ASA; 2011;130:2507. Peters N, Braasch J, McAdams S. Sound Spatialization Across Disciplines Using Virtual Microphone Control (ViMiC). Journal of Interdisciplinary Music Studies [Internet]. 2011;5:167-190. Peters N, Jonas B. Compensation of Undesired Doppler Artifacts in Virtual Microphone Simulations. In DAGA - Deutsche Jahrestagung fr Akustik . Dsseldorf, Germany; 2011. Peters N, W. SAndrew. Beamforming using a spherical microphone array based on legacy microphone characteristics. In International Conference on Spatial Audio. Detmold, Germany; 2011. Roh J-S, Freed A, Mann Y, Wessel D. Robust and Reliable Fabric, Piezoresistive Multitouch Sensing Surfaces for Musical Controllers. In NIME 2011. 2011. Battenberg E, Freed A, Wessel D. Advances in the Parallelization of Musical Applications. In ICMC 2010. ICMA; 2010. Freed A. The Fingerboard Instruments: Recontextualizing Lutherie without Strings . In 3rd Music and Cognition Conference. McGill University, Montreal; 2010. Freed A, MacCallum J, Schmeder A, Wessel D. Visualizations and Interaction Strategies for Hybridization Interfaces . In New Instruments for Musical Expression. Sydney, Australia; 2010. MacCallum J, Schmeder A. Timewarp: A Graphical Tool for the Control of Polyphonic Smoothly Varying Tempos. In International Computer Music Conference. New York; 2010. Ryokai K, Raffle H, Horri H, Mann Y. Tangible Video Bubbles. In CHI 2010. Atlanta, Georgia; 2010. Schmeder A, Freed A, Wessel D. Best Practices for Open Sound Control. In Linux Audio Conference. Utrecht, NL; 2010. Schmeder A. Spherical Directivity Resonance Synthesis. In Ambisonics Symposium. Paris, FR; 2010. Schmeder A, Freed A. Support Vector Machine Learning for Gesture Signal Estimation with a Piezo Resistive Fabric Touch Surface. In NIME. Sydney, Australia; 2010. Einbond A, Schwarz D, Bresson J. Corpus-based Transcription as an Approach to the Compositional Control of Timbre . In International Computer Music Conference. ICMA; 2009. Freed A, Schmeder A. Features and Future of Open Sound Control version 1.1 for NIME. In NIME [Internet]. 2009. Freed A, McCutchen D, Schmeder A, Hansen A-MSkriver, Overholt D, Burleson W, et al.. Musical Applications and Design Techniques for the Gametrak Tethered Spatial Position Controller . In SMC 2009. 2009. Freed A. Joy of Hex and the Cordless Guitars of the Future. In Identits de la Guitare Electrique. Paris, France; 2009. Freed A. Novel and Forgotten Current-steering Techniques for Resistive Multitouch, Duotouch, and Polytouch Position Sensing with Pressure. In NIME 2009. 2009. Loui P, Wu EH, Wessel DL, Knight RT. A Generalized Mechanism for Perception of Pitch Patterns. Journal of Neuroscience. 2009;29:454-459. Loui P, Alsop D, Schlaug G. Tone-deafness: a disconnection syndrome?. Journal of Neuroscience. 2009;29:10215-10220. MacCallum J, Schmeder A, Wessel D. Timbral Migration: Stochastic Processes for the Control of Smooth Spectral Tranformation. In ICMC. 2009. Mann Y, Lubow J, Freed A. The Tactus: a Tangible, Rhythmic Grid Interface Using Found-Objects. In NIME 2009. Pittsburgh, PA; 2009. Schmeder A. An Exploration of Design Parameters for Human-Interactive Systems with Compact Spherical Loudspeaker Arrays. In Ambisonics Symposium. Graz, Austria; 2009. Schmeder A, Freed A. A Low-level Embedded Service Architecture for Rapid DIY Design of Real-time Musical Instruments [Internet]. NIME. 2009. Schmeder A. Efficient Gesture Storage and Retrieval for Multiple Applications Using a Relational Data Model of Open Sound Control. In ICMC 2009. 2009. Siedenburg K. An Exploration of Real-Time Visualizations of Musical Timbre. 2009 . Andrews R, Schmeder A. CNMAT Studio Report 2008. ICMC 2008. 2008 . Andrews R. Studio Report: UC Berkeley Center for New Music and Audio Technologies (CNMAT). In 2008 International Computer Music Conference (ICMC2008). Belfast, Ireland; 2008. Battenberg E. Improvements to percussive component extraction using non-negative matrix factorization and support vector machines. EECS. [Berkeley, CA]: University of California, Berkeley; 2008. p. 48. Freed A. Application of new Fiber and Malleable Materials for Agile Development of Augmented Instruments and Controllers. In NIME 2008. 2008. Freed A, Schmeder A, Zotter F. Applications of Environmental Sensing for Spherical Loudspeaker Arrays. In IASTED Signal and Image Processing. Hawaii; 2008. Goodheart M. for bass - tuning instructions. 2008. Loui P, Guenther FH, Mathys C, Schlaug G. Action-Perception Mismatch in Tone-Deafness. Current Biology. 2008;. Schmeder A, Freed A. uOSC: The Open Sound Control Reference Platform for Embedded Devices. In NIME. Genova, Italy; 2008. Schmeder A, Freed A. Implementation and Applications of Open Sound Control Timestamps. In ICMC. Belfast, Ireland: ICMA; 2008. pp. 655-658. Schwenke R, Zotter F, Schmeder A, Wessel D. Room Acoustics Measurements with an Approximately Spherical Source of 120 Drivers. In ASA-EAA Joint Conference. Paris, FR; 2008. Wessel D, Morrison A, Rossing TD. Sound of the Hang. In Acoustics 08. Paris, France; 2008. Zbyszynski M. An Elementary Method for Tablet. In New Interfaces for Musical Expression. Genova, Italy; 2008. Zotter F, Schmeder A, Noisternig M. Crosstalk Cancellation for Spherical Loudspeaker Arrays. In DAGA08. Dresden: DEGA; 2008. Cont A, Dubnov S, Wessel D. Realtime Multiple-Pitch and Multiple-Instrument Recognition for Music Signals Using Sparse Non-Negative Constraints. In 10th International Conference on Digital Audio Effects (DAFx-07). 2007. pp. 85-92. Loui P, Wessel D. Harmonic Expectation and Affect in Western Music: Effects of Attention and Training. Perception & Psychophysics. 2007;69:1084-1092. Loui P, Wessel D, Wu EH, Knight RT. Perceiving new music recruits flexible neural mechanisms. In Cognitive Neuroscience Society [Internet]. 2007. p. 48. MacCallum J, Einbond A. Real-time Analysis of Sensory Dissonance. In International Computer Music Conference. Copenhagen, Denmark; 2007. Maxwell CB, Bindel D. Modal Parameter Tracking for Shape-Changing Geometric Objects. Proc. of the 10th Int. Conference on Digital Audio Effects (DAFx-07). Bordeaux, France; 2007.