Skip to content

A PyTorch-based fine-tuning implementation for GPT-2 models, designed for advanced prompt generation. This project includes a custom dataset handler, dynamic checkpointing, and a streamlined training procedure, making it ideal for educational platforms, job portals, and AI-driven chatbots.

License

Notifications You must be signed in to change notification settings

ESgarbi/gpt-nq-prompt-generator

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

3 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

gpt-nq-prompt-generator

This is an exploratory project into machine learning by initially training a GPT-2 model (gpt2-medium) on the Natural Questions (NQ) dataset to grasp question-answering mechanisms. Post this foundational training, the model underwent fine-tuning to pivot its capabilities towards generating job title prompts using prompt examples created by 'text-davinci-002' and further augmented with source and target noise. Used PyTorch and Hugging Face's Transformers api. The model is published at on Hugging Face: sgarbi/gpt-nq-prompt-generator.

License

This project is shared under the MIT License. For more information, refer to the LICENSE file. While open-source, this project is developed and maintained exclusively by its creator, serving as a personal history exploring of NER technologies.

About

A PyTorch-based fine-tuning implementation for GPT-2 models, designed for advanced prompt generation. This project includes a custom dataset handler, dynamic checkpointing, and a streamlined training procedure, making it ideal for educational platforms, job portals, and AI-driven chatbots.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published