Nvidia TensorRT image generation is 6x slower!!! - A1111 WebUI - What is going on?

#20188
by dezokun - opened

Thank you for your time.

I installed the TensorRT extension within the A1111 WebUI and followed the instructions to "export engine" (screenshot). However, when generating images, it takes approximately three times as long.
For a test run, I first generated an image without the SD Unet activated, followed by one with the SD Unet activated for that specific model (screenshot). The regular generation takes about 0.5 minutes, while the TensorRT-boosted one takes around 6 minutes.

4.png

My setup: NVIDIA GeForce RTX 3060 (12GB).

Sign up or log in to comment