Loading from local storage gives error
#24
by
b1rd13
- opened
AttributeError: 'TextGenerationPipeline' object has no attribute 'prefix'.
Using this code to load the model:
model = AutoModel.from_pretrained(model_path)
pipeline = transformers.pipeline("text-generation",
model=model, #"microsoft/phi-4",
tokenizer=tokenizer,
model_kwargs={"torch_dtype": "auto"},
device = 0)