Pinned Loading

1. whisper-flamingo whisper-flamingo Public

   Whisper-Flamingo [Interspeech 2024] and mWhisper-Flamingo [IEEE SPL 2025] for Audio-Visual Speech Recognition and Translation

   Jupyter Notebook 207 16

2. Omni-R1 Omni-R1 Public

   [ASRU 2025] Omni-R1: Do You Really Need Audio to Fine-Tune Your Audio LLM?

   Python 46 1

3. MUSIC_dataset MUSIC_dataset Public

   MUSIC Dataset from The Sound of Pixels (ECCV '18)

   136 22

4. AVLnet AVLnet Public

   Code for the AVLnet (Interspeech 2021) and Cascaded Multilingual (Interspeech 2021) papers.

   Python 54 6

5. c2kd c2kd Public

   Code for the C2KD paper (ICASSP 2023)

   Python 19 2

6. Sound-of-Pixels Sound-of-Pixels Public

   Forked from hangzhaomit/Sound-of-Pixels

   Codebase for ECCV18 "The Sound of Pixels"

   Python 1 1