Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

💡 [Feature] Include rook server in optional components #455

Open
huard opened this issue May 13, 2024 · 6 comments
Open

💡 [Feature] Include rook server in optional components #455

huard opened this issue May 13, 2024 · 6 comments
Assignees
Labels
enhancement New feature or request

Comments

@huard
Copy link
Collaborator

huard commented May 13, 2024

Description

Rook is a birdhouse WPS server offering simple subsetting and averaging processes. See https://github.com/roocs/rook/tree/master/rook/processes

Unlike Finch, it has an established database of datasets it is willing to operate on. That is, process input includes a dataset ID, not a URL to a file, and the server converts that ID to an actual path. This database is built from an intake catalog.

Rook comes with a custom-built client, rooki, based off birdy.

This work would align with the ESGF roadmap to deploy remote computing along ESGF nodes.

Steps:

  • Push rook docker image to dockerhub
  • Create intake catalog for datasets we want supported.
  • Include rook in birdhouse-deploy optional components
  • Add notebook to test use cases

References

Concerned Organizations

@huard huard added the enhancement New feature or request label May 13, 2024
@fmigneault
Copy link
Collaborator

Should also consider adding it as a provider to Weaver to give it instant OGC API support.

@tlvu
Copy link
Collaborator

tlvu commented May 14, 2024

I did a quick search on DockerHub, did not find a matching docker image. Is Rook publishing their docker image to another public registry? Or they do not yet publish any docker images?

@huard
Copy link
Collaborator Author

huard commented May 14, 2024

They don't. Can we use our dockerhub account to do it?

@tlvu
Copy link
Collaborator

tlvu commented May 14, 2024

Oh ! So I guess they deploy using Ansible.

Yes we can use our DockerHub account to host their image. We are paying so have unlimited storage.

But that also means their Dockerfile is not tested ! I was hoping for a quick win on this one, might not be the case anymore.

@huard
Copy link
Collaborator Author

huard commented May 14, 2024

Yes, their production backend runs SLURM.
Ok good.
Correct, but it should work very similarly to Finch. I'll gather more information on the intake catalog that's needed to configure the database and try to get it to work locally.

@fmigneault
Copy link
Collaborator

Could also be added to their repo directly and make use of GitHub Container Registry.
This way, they manage their own tokens within their CI.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

4 participants