TransVDM: Motion-Constrained

B站影视 韩国电影 2025-03-20 04:29 1

摘要:[TransVDM: Motion-Constrained Video Diffusion Model for Transparent Video Synthesis]: Recent developments in Video Diffusion Model

[TransVDM: Motion-Constrained Video Diffusion Model for Transparent Video Synthesis]: Recent developments in Video Diffusion Models (VDMs) have demonstrated remarkable capability to generate high-quality video content. Nonetheless, the potential of VDMs for creating transparent videos remains largely uncharted. In this paper, we introduce TransVDM, the first diffusion-based model specifically designed for transparent video generation. TransVDM integrates a Transparent Variational Autoencoder (TVAE) and a pretrained UNet-based VDM, along with a novel Alpha Motion Constraint Module (AMCM). The TVAE captures the alpha channel transparency of video frames and encodes it into the latent space of the VDMs, facilitating a seamless transition to transparent video diffusion models. To improve the detection of transparent areas, the AMCM integrates motion constraints from the foreground within the VDM, helping to reduce undesira......#CV #深度学习 #扩散模型 #ai #多模态 #视频生成 #检测 #AIGC #科研 #计算机视觉

来源:莱娜探长

相关推荐