Sound effects are the unsung heroes of cinema and gaming, enhancing realism, impact, and emotional depth for an immersive audiovisual experience. FoleyCrafter is a video-to-audio generation framework which can produce realistic sound effects semantically relevant and synchronized with videos.
Sound effects are the unsung heroes of cinema and gaming, enhancing realism, impact, and emotional depth for an immersive audiovisual experience. FoleyCrafter is a video-to-audio generation framework which can produce realistic sound effects semantically relevant and synchronized with videos.
The links in the readme to the samples, all have expired messages from AWS.
Alternative: https://www.youtube.com/watch?v=7m4YLrSBOv0
https://foleycrafter.github.io/
Since the video links in the README are broken, it might be better to switch the submission to their Github Pages website.
Also, does anyone happen to know what the VRAM requirements might be for something like this?