Can't use the model, keeps telling me The checkpoint you are trying to load has model type `vstream`
When I am using :
from transformers import AutoModelForCausalLMmodel = AutoModelForCausalLM.from_pretrained("IVGSZ/Flash-VStream-7b")
It returns an error, I tried many ways to deploy the model locally, I still get the same error, what might be wrong?
The error detailed is as followed:
media/tang/Windows-Storage/HW/CV/Cv_Project/Flash-VStream/get_model.py
The token has not been saved to the git credentials helper. Pass add_to_git_credential=True in this function directly or --add-to-git-credential if using via huggingface-cli if you want to set the git credential as well.
Token is valid (permission: write).
Your token has been saved to /home/tang/.cache/huggingface/token
Login successful
Traceback (most recent call last):
File "/home/tang/.conda/envs/NYU-CV/lib/python3.11/site-packages/transformers/models/auto/configuration_auto.py", line 1038, in from_pretrained
config_class = CONFIG_MAPPING[config_dict["model_type"]]
~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/tang/.conda/envs/NYU-CV/lib/python3.11/site-packages/transformers/models/auto/configuration_auto.py", line 740, in getitem
raise KeyError(key)
KeyError: 'vstream'
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/media/tang/Windows-Storage/HW/CV/Cv_Project/Flash-VStream/get_model.py", line 7, in
model = AutoModelForCausalLM.from_pretrained("IVGSZ/Flash-VStream-7b")
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/tang/.conda/envs/NYU-CV/lib/python3.11/site-packages/transformers/models/auto/auto_factory.py", line 526, in from_pretrained
config, kwargs = AutoConfig.from_pretrained(
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/tang/.conda/envs/NYU-CV/lib/python3.11/site-packages/transformers/models/auto/configuration_auto.py", line 1040, in from_pretrained
raise ValueError(
ValueError: The checkpoint you are trying to load has model type vstream but Transformers does not recognize this architecture. This could be because of an issue with the checkpoint, or because your version of Transformers is out of date.