Spaces:

open-llm-leaderboard

/

open_llm_leaderboard

like 12.2k

Running on CPU Upgrade

Hi!
There was a problem when parsing your model weights, so it was not allowed enough memory to run.
Could you please follow the steps in the Submit page, and convert your model to safetensors?

Feel free to resubmit once it's done.

Hi @clefourrier
Absolutely! I didn't even know it was not already safetensors, might have set that config in Axolotl to False by mistake. (I'll retry and come back to you)

Hi @clefourrier

I have converted the weights to safetensors now. Could you please merge these deleted models? They are all failed requests and I can retry with safetensors this time: https://huggingface.co/datasets/open-llm-leaderboard/requests/discussions

Done, you'll be able to resubmit once the changes get propagated to the leaderboard (in max 2h)

Thanks @clefourrier appreciate it

Sorry @clefourrier to bother you, it still tells me I've had 6 models in the last 7 days and I have to wait. Just wanted to confirm if I have to wait or the deleted models will be updated in the stats.

Many thanks (also, not urgent, I can totally wait)

Hi! The deleted models should not count towards your total count, but you can check the queue to see if other people recently submitted some of your models

Many thanks @clefourrier

I can now submit my models and see them inside the requests. However, it is strange that I cannot submit MaziyarPanahi/Qwen1.5-8x7b-v0.1 model, it says This model has been already submitted. but I don't see it in my requests. Is this normal?

It could be a problem with the cache, I'll do a factory restart of the leaderboard later today

It could be a problem with the cache, I'll do a factory restart of the leaderboard later today

Hi @clefourrier

It is still saying This model has been already submitted. Is it the caching problem?