[UNRESOLVED ISSUE] Over-usage of the AI Comic Factory

#335
by jbilcke-hf HF staff - opened

Hello everyone,

the servers are currently over capacity, creating an outage (sometimes the "LLM" step of the generation doesn't work, which preven tit from creating interesting stories - that can be verified if you display the captions, you will see an error message)

I understand this is an inconvenience, I will try to see on monday if we can allocate a bit more capacity

in the meantime, know that it is still possible to fork the AI Comic Factory to use alternative engines (OpenAI, to not name it)

jbilcke-hf changed discussion title from Over-usage of the AI Comic Factory to [UNRESOLVED ISSUE] Over-usage of the AI Comic Factory

So, what's next? Can we help you pay for more capacity, like render farm credits? Can capacity be allocated to specific accounts, paying accounts? You have a viable product here. This is a 'killer' app.

having a lot of users is a good thing as this drive people towards Hugging Face, so the plan is to keep the AI Comic Factory in free access, and add more servers

For the image generation (SDXL) this is easy since I have control over this, yesterday I deployed additional servers for instance

For the language model I don't really have any control but as demand increase the capacity should be increased by the team as well
(this is a hardware issue - llama-2 requires a larger server, and we don't physically have many of those)

In the longer term, it is possible that some performance optimizations are implemented, such as using a smaller-sized language model (eg. trained specifically to generate compelling stories and captions), allowing to scale to more users with less ressources, but this project has not been started yet

Sign up or log in to comment