MEKAWIRE
ExpertarXiv

Sonic-AMG: Streaming Human Motion Generation from Spatial Audio

Jingcheng Ni, Zekun Li, Zhiyang Dou, Xiaoyan Cong, Ziyao Zeng, Hongyang Du, Randall Balestriero, Taku Komura, Srinath Sridhar
From the abstract

Modeling human reactions to spatial audio requires understanding both what is heard and where it comes from. Prior work generates motion offline from complete acoustic and spatial input sequences.

From the abstract. Our summary is in progress.

The full text is not republished here because the paper's license does not allow it. Read the original on arXiv.