When initiating the model, come to this problem:
Traceback (most recent call last):
File "/home/user/documents/checkpoint/download/down_bigcode2.py", line 12, in
model = AutoModelForCausalLM.from_pretrained(checkpoint, device_map="auto", torch_dtype=torch.bfloat16)
File "/home/user/miniconda3/envs/lib/python3.7/site-packages/transformers/models/auto/auto_factory.py", line 461, in from_pretrained
**kwargs,
File "/home/user/miniconda3/envs/lib/python3.7/site-packages/transformers/models/auto/configuration_auto.py", line 957, in from_pretrained
config_class = CONFIG_MAPPING[config_dict["model_type"]]
File "/home/user/miniconda3/envs/lib/python3.7/site-packages/transformers/models/auto/configuration_auto.py", line 671, in getitem
raise KeyError(key)
KeyError: 'starcoder2'
When initiating the model, come to this problem:
Traceback (most recent call last):
File "/home/user/documents/checkpoint/download/down_bigcode2.py", line 12, in
model = AutoModelForCausalLM.from_pretrained(checkpoint, device_map="auto", torch_dtype=torch.bfloat16)
File "/home/user/miniconda3/envs/lib/python3.7/site-packages/transformers/models/auto/auto_factory.py", line 461, in from_pretrained
**kwargs,
File "/home/user/miniconda3/envs/lib/python3.7/site-packages/transformers/models/auto/configuration_auto.py", line 957, in from_pretrained
config_class = CONFIG_MAPPING[config_dict["model_type"]]
File "/home/user/miniconda3/envs/lib/python3.7/site-packages/transformers/models/auto/configuration_auto.py", line 671, in getitem
raise KeyError(key)
KeyError: 'starcoder2'