metadata

license: mit
title: Audio Mouth
sdk: gradio
emoji: 😻
colorFrom: blue
colorTo: indigo
pinned: true

AudioMouth

AudioMouth is a simple Python app that generates animated videos by syncing mouth movements with audio decibel levels. It processes an audio file and switches between images (open and closed mouth) to create a lip-sync effect.

Features

Syncs mouth images to audio based on decibel levels.
Custom FPS.
Outputs video with green screen background (or a custom color) for chroma keying.

Installation

Git clone the repository and install the required dependencies. You can do this by opening the command line in the AudioMouth folder and running:

git clone https://github.com/luisesantillan/AudioMouth
cd AudioMouth
pip install -r requirements.txt

Usage

Add 1-4 images in the frames folder and modify the paths in the config.json to use the images you want. Put the audios into the audio folder. It will create as many animations as there are audios.

closed_mouth	closed_mouth_blinking	open_mouth	open_mouth_blinking

If you're on Windows, now you can open run.bat and the output will be saved in the output folder. If you're on Linux, simply run the main.py file.

https://github.com/user-attachments/assets/dcf3728c-0d3b-455d-b17e-5e9819be069b