EMO: Emote Portrait Alive - Generating Expressive Portrait Videos with Audio2Video Diffusion Model under Weak Conditions
Paper
•
2402.17485
•
Published
•
190
🎭 Avatars
The latest AI-powered technologies usher in a new era of realistic avatars! 🚀
Note 📮 Post: https://huggingface.co/posts/DmitryRyumin/146398971160140 📄 Paper: https://huggingface.co/papers/2402.17485 🌐 Github Page: https://humanaigc.github.io/emote-portrait-alive 📁 Repository: https://github.com/HumanAIGC/EMO
VividTalk: One-Shot Audio-Driven Talking Head Generation Based on 3D Hybrid Prior
Paper • 2312.01841 • Published • 1Note 📄 Paper: https://huggingface.co/papers/2312.01841 🌐 Github Page: https://humanaigc.github.io/vivid-talk 📁 Repository: https://github.com/HumanAIGC/VividTalk 📺 Video: https://www.youtube.com/watch?v=lJVzt7JCe_4
MagicAnimate: Temporally Consistent Human Image Animation using Diffusion Model
Paper • 2311.16498 • Published • 1Note 📮 Post: https://huggingface.co/posts/DmitryRyumin/578997477674932 📅 Conference: CVPR, Jun 17-21, 2024 | Seattle WA, USA 🇺🇸 🤗 Demo: https://huggingface.co/spaces/zcxu-eric/magicanimate 📄 Paper: https://huggingface.co/papers/2311.16498 🌐 Github Page: https://showlab.github.io/magicanimate/ 📁 Repository: https://github.com/magic-research/magic-animate 🔥 Model 🤖: https://huggingface.co/zcxu-eric/MagicAnimate
GaussianAvatar: Towards Realistic Human Avatar Modeling from a Single Video via Animatable 3D Gaussians
Paper • 2312.02134 • Published • 2Note 📮 Post: https://huggingface.co/posts/DmitryRyumin/635360328098616 📅 Conference: CVPR, Jun 17-21, 2024 | Seattle WA, USA 🇺🇸 📄 Paper: https://huggingface.co/papers/2312.02134 🌐 Github Page: https://huliangxiao.github.io/GaussianAvatar 📁 Repository: https://github.com/huliangxiao/GaussianAvatar 📺 Video: https://www.youtube.com/watch?v=a4g8Z9nCF-k
SyncTalk: The Devil is in the Synchronization for Talking Head Synthesis
Paper • 2311.17590 • Published • 2Note 📮 Post: https://huggingface.co/posts/DmitryRyumin/733100901107547 📅 Conference: CVPR, Jun 17-21, 2024 | Seattle WA, USA 🇺🇸 📄 Paper: https://huggingface.co/papers/2311.17590 🌐 Github Page: https://ziqiaopeng.github.io/synctalk 📁 Repository: https://github.com/ZiqiaoPeng/SyncTalk
Real3D-Portrait: One-shot Realistic 3D Talking Portrait Synthesis
Paper • 2401.08503 • Published • 4Note 📮 Post: https://huggingface.co/posts/DmitryRyumin/170929653134354 📅 Conference: ICLR, May 7-11, 2024 | Vienna, Austria 🇦🇹 📄 Paper: https://huggingface.co/papers/2401.08503 🌐 Github Page: https://real3dportrait.github.io/ 📁 Repository: https://github.com/yerfor/Real3DPortrait 🔥 Model 🤖: https://huggingface.co/ameerazam08/Real3DPortrait
GPAvatar: Generalizable and Precise Head Avatar from Image(s)
Paper • 2401.10215 • Published • 1Note 📮 Post: https://huggingface.co/posts/DmitryRyumin/289967366439346 📅 Conference: ICLR, May 7-11, 2024 | Vienna, Austria 🇦🇹 📄 Paper: https://huggingface.co/papers/2401.10215 🌐 Github Page: https://xg-chu.github.io/project_gpavatar 📁 Repository: https://github.com/xg-chu/GPAvatar 📺 Video: https://www.youtube.com/watch?v=7A3DMaB6Zk0
Relightable and Animatable Neural Avatars from Videos
Paper • 2312.12877 • Published • 1Note 📮 Post: https://huggingface.co/posts/DmitryRyumin/188560282332993 📅 Conference: AAAI, February 20-27, 2024 | Vancouver, Canada 🇨🇦 📄 Paper: https://huggingface.co/papers/2312.12877 🌐 Github Page: https://wenbin-lin.github.io/RelightableAvatar-page 📁 Repository: https://github.com/wenbin-lin/RelightableAvatar 📺 Video: https://www.youtube.com/watch?v=v9rlys0xQGo
High-Fidelity 3D Head Avatars Reconstruction through Spatially-Varying Expression Conditioned Neural Radiance Field
Paper • 2310.06275 • Published • 2Note 📅 Conference: AAAI, February 20-27, 2024 | Vancouver, Canada 🇨🇦 📄 Paper: https://huggingface.co/papers/2310.06275 🌐 Github Page: https://minghanqin.github.io/AvatarSVE/ 📁 Repository: https://github.com/minghanqin/AvatarSVE 📺 Video: https://www.youtube.com/watch?v=dPgAa-6Kt8Q
VLOGGER: Multimodal Diffusion for Embodied Avatar Synthesis
Paper • 2403.08764 • Published • 36Note 📮 Post: https://huggingface.co/posts/DmitryRyumin/888482747169050 📄 Paper: https://huggingface.co/papers/2403.08764 🌐 Github Page: https://enriccorona.github.io/vlogger/
Animatable Gaussians: Learning Pose-dependent Gaussian Maps for High-fidelity Human Avatar Modeling
Paper • 2311.16096 • Published • 1Note 📮 Post: https://huggingface.co/posts/DmitryRyumin/496583626851543 📅 Conference: CVPR, Jun 17-21, 2024 | Seattle WA, USA 🇺🇸 📄 Paper: https://huggingface.co/papers/2311.16096 🌐 Github Page: https://animatable-gaussians.github.io 📁 Repository: https://github.com/lizhe00/AnimatableGaussians 📺 Video: https://www.youtube.com/watch?v=kOmZxD0HxZI
NECA: Neural Customizable Human Avatar
Paper • 2403.10335 • Published • 1Note 📮 Post: https://huggingface.co/posts/DmitryRyumin/399329903001758 📅 Conference: CVPR, Jun 17-21, 2024 | Seattle WA, USA 🇺🇸 📄 Paper: https://huggingface.co/papers/2403.10335 📁 Repository: https://github.com/iSEE-Laboratory/NECA
InstructPix2NeRF: Instructed 3D Portrait Editing from a Single Image
Paper • 2311.02826 • Published • 1Note 📮 Post: https://huggingface.co/posts/DmitryRyumin/288502341253111 📅 Conference: ICLR, May 7-11, 2024 | Vienna, Austria 🇦🇹 📄 Paper: https://huggingface.co/papers/2311.02826 🌐 Github Page: https://mybabyyh.github.io/InstructPix2NeRF 📁 Repository: https://github.com/mybabyyh/InstructPix2NeRF
Gaussian Head Avatar: Ultra High-fidelity Head Avatar via Dynamic Gaussians
Paper • 2312.03029 • Published • 23Note 📮 Post: https://huggingface.co/posts/DmitryRyumin/685682060907396 📅 Conference: CVPR, Jun 17-21, 2024 | Seattle WA, USA 🇺🇸 📄 Paper: https://huggingface.co/papers/2312.03029 🌐 Github Page: https://yuelangx.github.io/gaussianheadavatar 📁 Repository: https://github.com/YuelangX/Gaussian-Head-Avatar 📺 Video: https://www.youtube.com/watch?v=kvrrI3EoM5g
GaussianAvatars: Photorealistic Head Avatars with Rigged 3D Gaussians
Paper • 2312.02069 • Published • 1Note 📮 Post: https://huggingface.co/posts/DmitryRyumin/619817116350533 📅 Conference: CVPR, Jun 17-21, 2024 | Seattle WA, USA 🇺🇸 📄 Paper: https://huggingface.co/papers/2312.02069 🌐 Github Page: https://shenhanqian.github.io/gaussian-avatars 📁 Repository: https://github.com/ShenhanQian/GaussianAvatars 📺 Video: https://www.youtube.com/watch?v=lVEY78RwU_I
Text2Avatar: Text to 3D Human Avatar Generation with Codebook-Driven Body Controllable Attribute
Paper • 2401.00711 • Published • 2Note 📮 Post: https://huggingface.co/posts/DmitryRyumin/595207139085023 📅 Conference: ICASSP, 14-19 April 2024 | Seoul, Korea 🇰🇷 📄 Paper: https://huggingface.co/papers/2401.00711 🌐 Github Page: https://iecqgong.github.io/text2avatar/
FlashFace: Human Image Personalization with High-fidelity Identity Preservation
Paper • 2403.17008 • Published • 19Note 📮 Post: https://huggingface.co/posts/DmitryRyumin/204103548247572 📄 Paper: https://huggingface.co/papers/2403.17008 🌐 Github Page: https://jshilong.github.io/flashface-page/
AniPortrait: Audio-Driven Synthesis of Photorealistic Portrait Animation
Paper • 2403.17694 • Published • 10Note 📮 Post: https://huggingface.co/posts/DmitryRyumin/191716706611860 🤗 Demo: https://huggingface.co/spaces/ZJYang/AniPortrait_official 📄 Paper: https://huggingface.co/papers/2403.17694 📁 Repository: https://github.com/Zejun-Yang/AniPortrait 🔥 Model 🤖: https://huggingface.co/ZJYang/AniPortrait
Efficient 3D Implicit Head Avatar with Mesh-anchored Hash Table Blendshapes
Paper • 2404.01543 • Published • 3Note 📮 Post: https://huggingface.co/posts/DmitryRyumin/763522030257659 📅 Conference: CVPR, Jun 17-21, 2024 | Seattle WA, USA 🇺🇸 📄 Paper: https://huggingface.co/papers/2404.01543 🌐 Github Page: https://augmentedperception.github.io/monoavatar-plus/
GeneAvatar: Generic Expression-Aware Volumetric Head Avatar Editing from a Single Image
Paper • 2404.02152 • Published • 3Note 📮 Post: https://huggingface.co/posts/DmitryRyumin/335365529548063 📅 Conference: CVPR, Jun 17-21, 2024 | Seattle WA, USA 🇺🇸 🔗 Paper: https://huggingface.co/papers/2404.02152 🌐 Github Page: https://zju3dv.github.io/geneavatar/ 📁 Repository: https://github.com/zju3dv/GeneAvatar 📺 Video: https://www.youtube.com/watch?v=4zfbfPivtVU
3DGS-Avatar: Animatable Avatars via Deformable 3D Gaussian Splatting
Paper • 2312.09228 • Published • 1Note 📮 Post: https://huggingface.co/posts/DmitryRyumin/381309144455409 📅 Conference: CVPR, Jun 17-21, 2024 | Seattle WA, USA 🇺🇸 🔗 Paper: https://huggingface.co/papers/2312.09228 🌐 Github Page: https://neuralbodies.github.io/3DGS-Avatar/ 📁 Repository: https://github.com/mikeqzy/3dgs-avatar-release 📺 Video: https://www.youtube.com/watch?v=FJ29U9OkmmU
InstructHumans: Editing Animated 3D Human Textures with Instructions
Paper • 2404.04037 • PublishedNote 📮 Post: https://huggingface.co/posts/DmitryRyumin/462458353486294 🔗 Paper: https://huggingface.co/papers/2404.04037 🌐 Web Page: https://jyzhu.top/instruct-humans/ 📁 Repository: https://github.com/viridityzhu/InstructHumans
PhysAvatar: Learning the Physics of Dressed 3D Avatars from Visual Observations
Paper • 2404.04421 • Published • 16Note 📮 Post: https://huggingface.co/posts/DmitryRyumin/930608949502580 🔗 Paper: https://huggingface.co/papers/2404.04421 🌐 GitHub Page: https://qingqing-zhao.github.io/PhysAvatar
GoMAvatar: Efficient Animatable Human Modeling from Monocular Video Using Gaussians-on-Mesh
Paper • 2404.07991 • Published • 1Note 📮 Post: https://huggingface.co/posts/DmitryRyumin/532264219296718 📅 Conference: CVPR, Jun 17-21, 2024 | Seattle WA, USA 🇺🇸 🔗 Paper: https://huggingface.co/papers/2404.07991 🌐 Github Page: https://wenj.github.io/GoMAvatar/ 📁 Repository: https://github.com/wenj/GoMAvatar
VASA-1: Lifelike Audio-Driven Talking Faces Generated in Real Time
Paper • 2404.10667 • Published • 18Note 🔗 Paper: https://huggingface.co/papers/2404.10667 🌐 Web Page: https://www.microsoft.com/en-us/research/project/vasa-1/
HairFastGAN: Realistic and Robust Hair Transfer with a Fast Encoder-Based Approach
Paper • 2404.01094 • Published • 5Note 📮 Post: https://huggingface.co/posts/DmitryRyumin/932263322939776 🤗 Demo: https://huggingface.co/spaces/multimodalart/hairfastgan 🔗 Paper: https://huggingface.co/papers/2404.01094 📁 Repository: https://github.com/AIRI-Institute/HairFastGAN 🔥 Model 🤖: https://huggingface.co/AIRI-Institute/HairFastGAN
Learn2Talk: 3D Talking Face Learns from 2D Talking Face
Paper • 2404.12888 • Published • 2Note 📮 Post: https://huggingface.co/posts/DmitryRyumin/511657668327096 🔗 Paper: https://huggingface.co/papers/2404.12888 🌐 Github Page: https://lkjkjoiuiu.github.io/Learn2Talk/
WANDR: Intention-guided Human Motion Generation
Paper • 2404.15383 • Published • 1Note 📮 Post: https://huggingface.co/posts/DmitryRyumin/295452758814429 📅 Conference: CVPR, Jun 17-21, 2024 | Seattle WA, USA 🇺🇸 📄 Paper: https://huggingface.co/papers/2404.15383 🌐 Web Page: https://wandr.is.tue.mpg.de 📁 Repository: https://github.com/markos-diomataris/wandr 📺 Video: https://www.youtube.com/watch?v=9szizM-XUCg
ConsistentID: Portrait Generation with Multimodal Fine-Grained Identity Preserving
Paper • 2404.16771 • Published • 16Note 📮 Post: https://huggingface.co/posts/DmitryRyumin/303634956982953 🔗 Paper: https://huggingface.co/papers/2404.16771 🌐 Github Page: https://ssugarwh.github.io/consistentid.github.io/ 📁 Repository: https://github.com/JackAILab/ConsistentID
EMOPortraits: Emotion-enhanced Multimodal One-shot Head Avatars
Paper • 2404.19110 • Published • 3Note 📮 Post: https://huggingface.co/posts/DmitryRyumin/113952082634225 📅 Conference: CVPR, Jun 17-21, 2024 | Seattle WA, USA 🇺🇸 🔗 Paper: https://huggingface.co/papers/2404.19110 🌐 Github Page: https://neeek2303.github.io/EMOPortraits
3D Gaussian Blendshapes for Head Avatar Animation
Paper • 2404.19398 • Published • 2Note 📮 Post: https://huggingface.co/posts/DmitryRyumin/802475347987275 📅 Conference: SIGGRAPH, 28 Jul – 1 Aug, 2024 | Denver CO, USA 🇺🇸 🔗 Paper: https://huggingface.co/papers/2404.19398 🌐 Github Page: https://gapszju.github.io/GaussianBlendshape/
AniTalker: Animate Vivid and Diverse Talking Faces through Identity-Decoupled Facial Motion Encoding
Paper • 2405.03121 • Published • 2Note 📮 Post: https://huggingface.co/posts/DmitryRyumin/698577433443867 🔗 Paper: https://huggingface.co/papers/2405.03121 🌐 Github Page: https://x-lance.github.io/AniTalker 📁 Repository: https://github.com/X-LANCE/AniTalker
LayGA: Layered Gaussian Avatars for Animatable Clothing Transfer
Paper • 2405.07319 • PublishedNote 📮 Post: https://huggingface.co/posts/DmitryRyumin/182984250825015 📅 Conference: SIGGRAPH, 28 Jul – 1 Aug, 2024 | Denver CO, USA 🇺🇸 🔗 Paper: https://huggingface.co/papers/2405.07319 🌐 Github Page: https://jsnln.github.io/layga/index.html
Gaussian Head & Shoulders: High Fidelity Neural Upper Body Avatars with Anchor Gaussian Guided Texture Warping
Paper • 2405.12069 • Published • 1Note 📮 Post: https://huggingface.co/posts/DmitryRyumin/557611713480917 🔗 Paper: https://huggingface.co/papers/2405.12069 🌐 Github Page: https://gaussian-head-shoulders.netlify.app
InstructAvatar: Text-Guided Emotion and Motion Control for Avatar Generation
Paper • 2405.15758 • Published • 1Note 📮 Post: https://huggingface.co/posts/DmitryRyumin/378045093988402 🔗 Paper: https://huggingface.co/papers/2405.15758 🌐 Github Page: https://wangyuchi369.github.io/InstructAvatar/ 📁 Repository: https://github.com/wangyuchi369/InstructAvatar
Human4DiT: Free-view Human Video Generation with 4D Diffusion Transformer
Paper • 2405.17405 • Published • 14Note 🔗 Paper: https://huggingface.co/papers/2405.17405 🌐 Github Page: https://human4dit.github.io/
Relightable Gaussian Codec Avatars
Paper • 2312.03704 • Published • 29Note 📮 Post: https://huggingface.co/posts/DmitryRyumin/998191475426468 📅 Conference: CVPR, Jun 17-21, 2024 | Seattle WA, USA 🇺🇸 🔗 Paper: https://huggingface.co/papers/2312.03704 🌐 Github Page: https://shunsukesaito.github.io/rgca/
GMTalker: Gaussian Mixture based Emotional talking video Portraits
Paper • 2312.07669 • Published • 1Note 🔗 Paper: https://huggingface.co/papers/2312.07669 🌐 Github Page: https://bob35buaa.github.io/GMTalker 📺 Video: https://www.youtube.com/watch?v=8kcYw3Ps48w
NPGA: Neural Parametric Gaussian Avatars
Paper • 2405.19331 • Published • 10Note 🔗 Paper: https://huggingface.co/papers/2405.19331 🌐 Github Page: https://simongiebenhain.github.io/NPGA/ 📺 Video: https://www.youtube.com/watch?v=NGRxAYbIkus
Learning One-Shot 4D Head Avatar Synthesis using Synthetic Data
Paper • 2311.18729 • PublishedNote 📅 Conference: CVPR, Jun 17-21, 2024 | Seattle WA, USA 🇺🇸 🔗 Paper: https://huggingface.co/papers/2311.18729 🌐 Github Page: https://yudeng.github.io/Portrait4D/ 📁 Repository: https://github.com/YuDeng/Portrait-4D 📺 Video: https://www.youtube.com/watch?v=8f1NBTdhvzw
Portrait4D-v2: Pseudo Multi-View Data Creates Better 4D Head Synthesizer
Paper • 2403.13570 • Published • 3Note 📮 Post: https://huggingface.co/posts/DmitryRyumin/891674447263162 🔗 Paper: https://huggingface.co/papers/2403.13570 🌐 Github Page: https://yudeng.github.io/Portrait4D-v2/ 📁 Repository: https://github.com/YuDeng/Portrait-4D 📺 Video: https://www.youtube.com/watch?v=5YJY6-wcOJo
Stratified Avatar Generation from Sparse Observations
Paper • 2405.20786 • PublishedNote 🔗 Paper: https://huggingface.co/papers/2405.20786 🌐 Github Page: https://fhan235.github.io/SAGENet/ 📁 Repository: https://github.com/Wenchao-M/SAGE 📺 Video: https://www.youtube.com/watch?v=RkXaxyv1TOU
Human 3Diffusion: Realistic Avatar Creation via Explicit 3D Consistent Diffusion Models
Paper • 2406.08475 • PublishedNote 🔗 Paper: https://huggingface.co/papers/2406.08475 🌐 Github Page: https://yuxuan-xue.com/human-3diffusion/ 📁 Repository: https://github.com/YuxuanSnow/Human3Diffusion/
Instant 3D Human Avatar Generation using Image Diffusion Models
Paper • 2406.07516 • PublishedNote 🔗 Paper: https://huggingface.co/papers/2406.07516 🌐 Github Page: https://www.nikoskolot.com/avatarpopup/
Topo4D: Topology-Preserving Gaussian Splatting for High-Fidelity 4D Head Capture
Paper • 2406.00440 • PublishedNote 📮 Post: https://huggingface.co/posts/DmitryRyumin/753056979023615 📅 Conference: ECCV, 29 Sep – 4 Oct, 2024 | Milano, Italy 🇮🇹 📄 Paper: https://huggingface.co/papers/2406.00440 🌐 Github Page: https://xuanchenli.github.io/Topo4D/ 📁 Repository: https://github.com/XuanchenLi/Topo4D
Expressive Gaussian Human Avatars from Monocular RGB Video
Paper • 2407.03204 • Published • 1Note 📮 Post: https://huggingface.co/posts/DmitryRyumin/852656118525688 📄 Paper: https://huggingface.co/papers/2407.03204 🌐 Github Page: https://evahuman.github.io/ 📁 Repository: https://github.com/evahuman/EVA
LivePortrait: Efficient Portrait Animation with Stitching and Retargeting Control
Paper • 2407.03168 • Published • 2Note 📮 Post: https://huggingface.co/posts/DmitryRyumin/181465871908039 🤗 Demo: https://huggingface.co/spaces/KwaiVGI/LivePortrait 📄 Paper: https://huggingface.co/papers/2407.03168 🌐 Github Page: https://liveportrait.github.io/ 📁 Repository: https://github.com/KwaiVGI/LivePortrait 🔥 Model 🤖: https://huggingface.co/KwaiVGI/LivePortrait
A Simple Baseline for Spoken Language to Sign Language Translation with 3D Avatars
Paper • 2401.04730 • PublishedNote 📅 Conference: ECCV, 29 Sep – 4 Oct, 2024 | Milano, Italy 🇮🇹 📄 Paper: https://huggingface.co/papers/2401.04730 📁 Repository: https://github.com/FangyunWei/SLRT
PICA: Physics-Integrated Clothed Avatar
Paper • 2407.05324 • PublishedNote 📄 Paper: https://huggingface.co/papers/2407.05324 🌐 Github Page: https://ustc3dv.github.io/PICA/
MobilePortrait: Real-Time One-Shot Neural Head Avatars on Mobile Devices
Paper • 2407.05712 • PublishedNote 📄 Paper: https://huggingface.co/papers/2407.05712 🌐 Github Page: https://mobileportrait.github.io/
RodinHD: High-Fidelity 3D Avatar Generation with Diffusion Models
Paper • 2407.06938 • Published • 23Note 📮 Post: https://huggingface.co/posts/DmitryRyumin/124284908420927 📅 Conference: ECCV, 29 Sep – 4 Oct, 2024 | Milano, Italy 🇮🇹 📄 Paper: https://huggingface.co/papers/2407.06938 🌐 Github Page: https://rodinhd.github.io/ 📁 Repository: https://github.com/RodinHD/RodinHD 📺 Video: https://www.youtube.com/watch?v=ULvHt7dZx-Q
IntrinsicAvatar: Physically Based Inverse Rendering of Dynamic Humans from Monocular Videos via Explicit Ray Tracing
Paper • 2312.05210 • PublishedNote 📮 Post: https://huggingface.co/posts/DmitryRyumin/211717085209386 📅 Conference: CVPR, Jun 17-21, 2024 | Seattle WA, USA 🇺🇸 🔗 Paper: https://huggingface.co/papers/2312.05210 🌐 Github Page: https://neuralbodies.github.io/IntrinsicAvatar/ 📁 Repository: https://github.com/taconite/IntrinsicAvatar 📺 Video: https://www.youtube.com/watch?v=aS8AIxgVXzI
MIGS: Multi-Identity Gaussian Splatting via Tensor Decomposition
Paper • 2407.07284 • PublishedNote 📅 Conference: ECCV, 29 Sep – 4 Oct, 2024 | Milano, Italy 🇮🇹 📄 Paper: https://huggingface.co/papers/2407.07284 🌐 Github Page: https://aggelinacha.github.io/MIGS 📺 Video: https://www.youtube.com/watch?v=yUhIi3g5chI
WildAvatar: Web-scale In-the-wild Video Dataset for 3D Avatar Creation
Paper • 2407.02165 • PublishedNote 📄 Paper: https://huggingface.co/papers/2407.02165 🌐 Github Page: https://wildavatar.github.io 📁 Repository: https://github.com/wildavatar/WildAvatar_Toolbox 📺 Video: https://www.youtube.com/watch?v=T-XafMVKY7E
MeshAvatar: Learning High-quality Triangular Human Avatars from Multi-view Videos
Paper • 2407.08414 • PublishedNote 📮 Post: https://huggingface.co/posts/DmitryRyumin/644671729298990 📅 Conference: ECCV, 29 Sep – 4 Oct, 2024 | Milano, Italy 🇮🇹 📄 Paper: https://huggingface.co/papers/2407.08414 🌐 Github Page: https://shad0wta9.github.io/meshavatar-page 📁 Repository: https://github.com/shad0wta9/meshavatar 📺 Video: https://www.youtube.com/watch?v=Kpbpujkh2iI
Tri^{2}-plane: Thinking Head Avatar via Feature Pyramid
Paper • 2401.09386 • PublishedNote 📄 Paper: https://huggingface.co/papers/2401.09386 🌐 Github Page: https://songluchuan.github.io/Tri2Plane.github.io 📁 Repository: https://github.com/Songluchuan/Tri2plane 📺 Video: https://www.youtube.com/watch?v=qU7zijI2DCQ
CanonicalFusion: Generating Drivable 3D Human Avatars from Multiple Images
Paper • 2407.04345 • PublishedNote 📅 Conference: ECCV, 29 Sep – 4 Oct, 2024 | Milano, Italy 🇮🇹 📄 Paper: https://huggingface.co/papers/2407.04345 📁 Repository: https://github.com/jsshin98/CanonicalFusion
iHuman: Instant Animatable Digital Humans From Monocular Videos
Paper • 2407.11174 • PublishedNote 📅 Conference: ECCV, 29 Sep – 4 Oct, 2024 | Milano, Italy 🇮🇹 📄 Paper: https://huggingface.co/papers/2407.11174 🌐 Github Page: https://pramishp.github.io/iHuman/index.html 📁 Repository: https://github.com/pramishp/ihuman 📺 Video: https://www.youtube.com/watch?v=W5xG2GYfUM0
EmoFace: Audio-driven Emotional 3D Face Animation
Paper • 2407.12501 • PublishedNote 📅 Conference: VR, March 16-21, 2024 | Orlando FL, USA 🇺🇸 📄 Paper: https://huggingface.co/papers/2407.12501 🌐 Github Page: https://sjtu-lucy.github.io/EmoFace 📁 Repository: https://github.com/SJTU-Lucy/EmoFace
HIMO: A New Benchmark for Full-Body Human Interacting with Multiple Objects
Paper • 2407.12371 • PublishedNote 📅 Conference: ECCV, 29 Sep – 4 Oct, 2024 | Milano, Italy 🇮🇹 📄 Paper: https://huggingface.co/papers/2407.12371 🌐 Github Page: https://lvxintao.github.io/himo 📁 Repository: https://github.com/LvXinTao/HIMO_dataset
Fast Registration of Photorealistic Avatars for VR Facial Animation
Paper • 2401.11002 • Published • 2Note 📅 Conference: ECCV, 29 Sep – 4 Oct, 2024 | Milano, Italy 🇮🇹 📄 Paper: https://huggingface.co/papers/2401.11002 🌐 Github Page: https://chaitanya100100.github.io/FastRegistration 📁 Repository: https://github.com/chaitanya100100/FastRegistration 📺 Video: https://www.youtube.com/watch?v=Jq_KJV3QoJ0
Expressive Whole-Body 3D Gaussian Avatar
Paper • 2407.21686 • Published • 7Note 📮 Post: https://huggingface.co/posts/DmitryRyumin/144143912433557 📅 Conference: ECCV, 29 Sep – 4 Oct, 2024 | Milano, Italy 🇮🇹 📄 Paper: https://huggingface.co/papers/2407.21686 🌐 Github Page: https://mks0601.github.io/ExAvatar 📁 Repository: https://github.com/mks0601/ExAvatar_RELEASE
HeadGAP: Few-shot 3D Head Avatar via Generalizable Gaussian Priors
Paper • 2408.06019 • Published • 13Note 📮 Post: https://huggingface.co/posts/DmitryRyumin/334746128110541 📄 Paper: https://huggingface.co/papers/2408.06019 🌐 Github Page: https://headgap.github.io
Loopy: Taming Audio-Driven Portrait Avatar with Long-Term Motion Dependency
Paper • 2409.02634 • Published • 90Note 📄 Paper: https://huggingface.co/papers/2409.02634 🌐 Github Page: https://loopyavatar.github.io
Instant Facial Gaussians Translator for Relightable and Interactable Facial Rendering
Paper • 2409.07441 • Published • 10Note 📄 Paper: https://huggingface.co/papers/2409.07441 🌐 Github Page: https://dafei-qin.github.io/TransGS.github.io 📺 Video: https://www.youtube.com/watch?v=MQTm3WTQ3KI
Portrait Video Editing Empowered by Multimodal Generative Priors
Paper • 2409.13591 • Published • 16Note 📅 Conference: SIGGRAPH Asia, Dec 3-6, 2024 | Tokyo, Japan 🇯🇵 🔗 Paper: https://huggingface.co/papers/2409.13591 🌐 Github Page: https://ustc3dv.github.io/PortraitGen 📁 Repository: https://github.com/USTC3DV/PortraitGen-code
-
HeadGaS: Real-Time Animatable Head Avatars via 3D Gaussian Splatting
Paper • 2312.02902 • Published -
TextToon: Real-Time Text Toonify Head Avatar from Single Video
Paper • 2410.07160 • Published • 8 -
DAWN: Dynamic Frame Avatar with Non-autoregressive Diffusion Framework for Talking Head Video Generation
Paper • 2410.13726 • Published • 11 -
IDOL: Instant Photorealistic 3D Human Creation from a Single Image
Paper • 2412.14963 • Published • 5