A really good way to test LLM capabilities

Keep a list of inputs and a predefined schema, and ask the LLM to extract the structured data and measure how well it does

For a sufficiently complex schema (which you will use in this course), and reasonably long text, you will be surprised at how often even the best LLMs fail to produce complete output

Don’t fall for the AI hype! 🙂