When to use GPT

As I have already explained earlier, at the moment GPT works best for extractive question answering where you feed a whole bunch of questions and answers (or just regular paragraphs) and ask GPT a question based on the information provided.

But once you go past extractive Q&A, GPT is still not a very mature tool, and using prompts for things like entity extraction and state management will quickly turn into what has been aptly named LLM Maximalism (the tendency to use LLMs for poor use cases)

While some chatbots need only extractive Q&A, most chatbots need more advanced features which you don’t get from using GPT.