Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Document promoting data to production with transfer-config #118

Closed
wants to merge 1 commit into from
Closed

Document promoting data to production with transfer-config #118

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
8 changes: 6 additions & 2 deletions README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -107,7 +107,7 @@ Should follow the following format:

### `discovery-items/`

The `ingestion-data/discovery-items/` directory holds json files representing the step function inputs for initiating the discovery, ingest and publication workflows.
The `ingestion-data/discovery-items/` directory holds json files representing the inputs for initiating the discovery, ingest and publication workflows.
Can either be a single input event or a list of input events.

Should follow the following format:
Expand Down Expand Up @@ -138,7 +138,7 @@ Should follow the following format:

### `dataset-config/`

The `ingestion-data/dataset-config/` directory holds json files that can be used with the `dataset/publish` stac ingestor endpoint, combining both collection metadata and discovery items. For an example of this ingestion workflow, see this [jupyter notebook](./transformation-scripts/example-template/example-geoglam-ingest.ipynb).
The `ingestion-data/dataset-config/` directory holds json files that can be used with the `dataset/publish` veda-backend ingest-api endpoint, combining both collection metadata and discovery items. For an example of this ingestion workflow, see this [jupyter notebook](./transformation-scripts/example-template/example-geoglam-ingest.ipynb).

```json
{
Expand Down Expand Up @@ -172,6 +172,10 @@ The `ingestion-data/dataset-config/` directory holds json files that can be used
}
```

### `transfer-config/`

After data have been evaluated in the staging system, data are published to the production data store. When promoting a collecction to production, a new configuration file is added `transfer-config/` directory. These configuration files are formatted like discovery-items but the asset locations reflect the production data store.

## Validation

This repository provides a script for validating all collections.
Expand Down
Loading