ICCV 2023 AV4D Workshop

Separating Invisible Sounds Toward Universal Audiovisual Scene-Aware Sound Separation

Figure: Separating Invisible Sounds Toward Universal Audiovisual Scene-Aware Sound Separation

Yiyang Su, Ali Vosoughi, Shijian Deng, Yapeng Tian, Chenliang Xu

Audiovisual scene-aware sound separation that recovers off-screen and otherwise invisible sound sources (AVSA-Sep).

My part. Contributed AVSA-Sep work on scene-aware audiovisual source separation for on-screen and off-screen sound recovery, combining audio-visual semantic parsing, mask-based spectrogram separation and MUSIC/VEGAS evaluation.

Paper

Audiovisual scene-aware sound separation that recovers off-screen and otherwise invisible sound sources (AVSA-Sep).

All publications