remove all gx artifacts, and run gx scripts in CI

.github/workflows/ci.yml

@@ -54,6 +54,12 @@ jobs:
         run: |
           poetry run coverage run -m pytest
           poetry run coverage xml
+        env:
+          SNOWFLAKE_USER: ${{ secrets.SNOWFLAKE_USER }}
+          SNOWFLAKE_PASSWORD: ${{ secrets.SNOWFLAKE_PASSWORD }}
+          SNOWFLAKE_ACCOUNT: ${{ secrets.SNOWFLAKE_ACCOUNT }}
+          SNOWFLAKE_ROLE: ${{ secrets.SNOWFLAKE_ROLE }}
+          SNOWFLAKE_WAREHOUSE: ${{ secrets.SNOWFLAKE_WAREHOUSE }}
 
       - name: Codecov
         uses: codecov/codecov-action@v4

.gitignore

@@ -144,6 +144,8 @@ poetry.toml
 # Minio system files
 tests/s3/data/.minio.sys
 
+# GX artifacts
+tests/great_expectations/*/gx
 # GX snowflake config in tests
 tests/great_expectations/snowflake/config.yml
 

tests/great_expectations/README.md

@@ -1,5 +1,27 @@
 # GX test cases
 
+A test case in the unit test is a directory that has a file named `run.py`. In the file, there should be a `run` method that cleans up the `gx` directory, creates the context in the directory and use `file` as the mode. In other words, it should look like this:
+
+```python
+import great_expectations as gx
+import shutil
+from pathlib import Path
+
+def run() -> None:
+
+    # Clear gx context.
+    if (current_path / "gx").exists():
+        shutil.rmtree(current_path / "gx")
+
+    # Create Data Context.
+    context = gx.get_context(mode="file", project_root_dir=current_path)
+
+    # ... snipped ...
+
+if __name__ == "__main__":
+    run()
+```
+
 Running `run.py` in each directory will regenerate the `gx` directory, which is where GX artifacts are stored.
 
 ## Snowflake
@@ -14,4 +36,6 @@ role: role
 warehouse: wh
 ```
 
-When running `run.py`, remember to substitute the connection string (which has sensitive information inside!) with some bogus value in `great_expectations.yml`. The crawler can still parse it if the values are fake.
+### CI
+
+Pass environment variables so that the test can run.