Spaces:
Running
on
CPU Upgrade
AI Comic Factory works again (incident resolved + post-mortem)
Hello,
Sorry for the downtime, as a quick post-mortem:
- Downtime was longer than usual, and required manual intervention
- It stopped working spontaneously
- The Space was still in a "running" green state
- Restarting the Space of the frontend (not the backend) was enough to make it work again
- I don't know what happened (it doesn't look like a memory leak, and the NodeJS app didn't crash)
- It could be an issue with the Next13 server
So.. that's weird. Maybe a random issue, or it could still be a memory leak after all (the Next app was working uninterrupted for some time, and received many, many queries)
Anyway, do not hesitate to ping me on X (@flngr) when that happens!
To give a bit more details:
looking at the logs, I saw the same error on loop:
Error: connect ECONNREFUSED 10.19.1.229:42613
at TCPConnectWrap.afterConnect [as oncomplete] (node:net:1495:16) {
errno: -111,
code: 'ECONNREFUSED',
syscall: 'connect',
address: '10.19.1.229',
port: 42613
}
Error: connect ECONNREFUSED 10.19.1.229:42613
at TCPConnectWrap.afterConnect [as oncomplete] (node:net:1495:16) {
errno: -111,
code: 'ECONNREFUSED',
syscall: 'connect',
address: '10.19.1.229',
port: 42613
}
this is probably what caused the bug / freeze
It's still not working. It attempts to load images, but the images never load. So you sit waiting for the images and can see the progress indicators. The indicators complete, but no images load.
A single word prompt does get me 3 out of 4 images displayed, but the fourth image does not load freezing up the entire page. If I use any of my previous prompts at 20 words no images load. I can't continue the work I was doing... and building the images is much slower.
Still says Internal Service Error for me as well.