GPTModelWrapper' object has no attribute 'can_generate'

[jxcomeon]

When i run

with torch.inference_mode():
    gpt2_model = GPTModelWrapper(config=model.config, device=model.device, inference=inference_torch)
    sample_output = gpt2_model.generate(inputs.input_ids, max_length=64)

There has an error
'GPTModelWrapper' object has no attribute 'can_generate'
how can i do?
thanks

[ostlee]

When i run

with torch.inference_mode():
    gpt2_model = GPTModelWrapper(config=model.config, device=model.device, inference=inference_torch)
    sample_output = gpt2_model.generate(inputs.input_ids, max_length=64)

There has an error 'GPTModelWrapper' object has no attribute 'can_generate' how can i do? thanks

I encountered the same problem. The reason is that the GPTModelWrapper, which inherits from the GenerationMixin, lacks the corresponding class methods and related attributes. My solution is to modify the GPTModelWrapper class according to the PreTrainedModel in transformers : 1. Add the can_generate() method 2. Add self.generation_config in init()