[TransVDM: Motion-Constrained Video Diffusion Model for Transparent Video Synthesis]: Recent developments in Video Diffusion Models (VDMs) have demonstrated remarkable capability to generate high-quality video content. Nonetheless, the potential of VDMs for creating transparent videos remains largely uncharted. In this paper, we introduce TransVDM, the first diffusion-based model specifically designed for transparent video generation. TransVDM integrates a Transparent Variational Autoencoder (TVAE) and a pretrained UNet-based VDM, along with a novel Alpha Motion Constraint Module (AMCM). The TVAE captures the alpha channel transparency of video frames and encodes it into the latent space of the VDMs, facilitating a seamless transition to transparent video diffusion models. To improve the detection of transparent areas, the AMCM integrates motion constraints from the foreground within the VDM, helping to reduce undesira......#CV #深度学习 #扩散模型 #ai #多模态 #视频生成 #检测 #AIGC #科研 #计算机视觉摘要:[TransVDM: Motion-Constrained Video Diffusion Model for Transparent Video Synthesis]: Recent developments in Video Diffusion Model
来源:莱娜探长
免责声明:本站系转载,并不代表本网赞同其观点和对其真实性负责。如涉及作品内容、版权和其它问题,请在30日内与本站联系,我们将在第一时间删除内容!