Validation/Correction NB

[wendy-aw]

Added notebook that helps with validation and correction of invalid/inaccurate SQL and instructions in our evals.

It can be used for the following purposes:

• Check that all the SQL in a sql-eval/data .csv file are valid and do not produce empty results
• Correct any invalid SQL with the help of an LLM
• Correct any inaccurate SQL you’ve discovered that doesn’t answer the question with the help of an LLM
• Translate just the instructions column in the csv file. Useful for when there are modifications made to the instructions_to_{dialect} functions.
• Inspect the instructions column to check that translation is accurate

[rishsriv]

Oh neat!! Thank you – this saves so much time :D