TitleRealtime Multiple-Pitch and Multiple-Instrument Recognition for Music Signals Using Sparse Non-Negative Constraints
Publication TypeConference Paper
Year of Publication2007
AuthorsCont, A, Dubnov, S, Wessel, D
Conference Name10th International Conference on Digital Audio Effects (DAFx-07)

In this paper we introduce a simple and fast method for realtime recognition of multiple pitches produced by multiple musical in- struments. Our proposed method is based on two important facts: (1) that timbral information of any instrument is pitch-dependant and (2) that the modulation spectrum of the same pitch seems to re- sult into a persistent representation of the characteristics of the in- strumental family. Using these basic facts, we construct a learning algorithm to obtain pitch templates of all possible notes on vari- ous instruments and then devise an online algorithm to decompose a realtime audio buffer using the learned templates. The learn- ing and decomposition proposed here are inspired by non-negative matrix factorization methods but differ by introduction of an ex- plicit sparsity control. Our test results show promising recognition rates for a realtime system on real music recordings. We discuss further improvements that can be made over the proposed system.