Possible to include onnx model that supports dynamic batching ?
#16
by
a0g04p1
- opened
Hi,
I was looking at your onnx model files, it looks like only one input image can be passed at a time. Is it possible to have dynamic batching enabled while creating the onnx model ?
It would be great if you can provide the onnx generation code, or the onnx model with batching support.
Thanks!
@Xenova can you tell if and how to support dynamic batching in ONNX?
I did the conversion a long time ago, but if I remember correctly, I ran into some issues when trying to export with dynamic batch size. Maybe someone else can give it a go :)
It was adapted from the notebook in the BiRefNet readme: https://github.com/ZhengPeng7/BiRefNet