Hi, this article covers fine-tuning GPT2 on custom datasets. From your code snippet, it seems you are using other repository/framework to load the model.

If you are looking for sentence embedding, consider using sentence-transformer.

https://huggingface.co/sentence-transformers/LaBSE