0:00/0:00
undefined 32 min
undefined 29 min
undefined 20 min
undefined 20 min
undefined 30 min
undefined 26 min
undefined 20 min
undefined 47 min
undefined 21 min
undefined 20 min
undefined 01 h 07 min
undefined 59 min
undefined 12 min
undefined 50 min
undefined 47 min
undefined 18 min
undefined 51 min
Mel-filterbanks are fixed, engineered audio features which emulate human perception and have been used through the history of audio understanding up to today. However, their undeniable qualities are counterbalanced by the fundamental limitations of handmade representations. In this talk, I will present LEAF, a new, lightweight, fully learnable neural network that can be used as a drop-in replacement of mel-filterbanks. LEAF learns all operations of audio features extraction, from filtering to pooling, compression and normalization, and can be integrated into any neural network at a negligible parameter cost, to adapt to the task at hand. I will show how LEAF outperforms mel-filterbanks on a wide range of audio signals, including speech, music, audio events and animal sounds, providing a general-purpose learned frontend for audio classification.