H2O GenAI Model Validation Training

Requirements

Artifact	Version
h2o-mrm	0.3.4
h2o-eval-studio-client	1.0.0

Usage

1. Go to https://h2oworld.h2o.ai/
2. Login with assign credentials
3. Open Jupyter lab
4. Load notebook from H2O World folder.

Slides

Topic	Slides	Notebooks
Generative AI Model Validation	01_genai_model_validation.pdf	notebooks/h2o_mrm_full.ipynb and notebooks/eval-studio-walkthrough.ipynb
Human Calibration	02_human_calibration.pdf	notebooks/h2o_mrm_full.ipynb
Summary metrics	03_summary_evaluations.pdf	---