From 25b9b881e9ffb053722941fad4f593e576fec228 Mon Sep 17 00:00:00 2001 From: Jonas Date: Mon, 2 Dec 2024 23:14:49 +0100 Subject: [PATCH 01/11] Add evaluation matrix --- docs/use-case-evaluation/evaluation-matrix.md | 42 +++++++++++++++++++ 1 file changed, 42 insertions(+) create mode 100644 docs/use-case-evaluation/evaluation-matrix.md diff --git a/docs/use-case-evaluation/evaluation-matrix.md b/docs/use-case-evaluation/evaluation-matrix.md new file mode 100644 index 0000000..6a65cd2 --- /dev/null +++ b/docs/use-case-evaluation/evaluation-matrix.md @@ -0,0 +1,42 @@ +# VEDA Auth Solution Evaluation Matrix + +The below table refers to the previously [defined auth workflows](https://github.com/NASA-IMPACT/veda-auth-central/blob/main/docs/use-case-evaluation/workflows.md). + +Our goal with this evaluation is to find out whether there is a solution that fulfils the workflows while relying on upstream projects as much as possible, +i.e. pieces together existing community solutions (such as KeyCloak and maybe Airavata Custos) only with IaC and durable enough configuration. + +Building a replicable platform from community-maintained upstream solutions is a principle of the [VEDA Open Source Ecosystem](https://docs.openveda.cloud/open-source-ecosystem/). + + +## Explanation of the evaluation criteria + +1. Can this workflow already be satisfied with this technology without having to *build* new things? +2. Did we (the NASA VEDA team) *build* this, or are we simply *deploying* a specific configuration of something built by an upstream community? +3. Ongoing effort required to maintain this workflow in the future. This includes keeping up with upstream releases, +4. How is the user experience for those who have to actually perform this workflow? +5. How easy is it to extend and modify this workflow in the future? + + +## Explanation of the values + +To evaluate these workflows, each cell in the below shall be given + +1. A numerical score (1-5) (except for col 1 and 2, which are yes/no) +2. A justification of the numerical score referencing the implementation section of the workflow document + + +## Matrix + +| Workflow | (E1) Existing upstream features | (E2) Building ourselves? | (E3) Ongoing Maintenance Effort | (E4) User Experience | (E5) Ease of future change | +| - | - | - | - | - | - | +| W1 KeyCloak | | | | | | +| W1 KeyCloak + Custos | | | | | | +| W2 KeyCloak | +| W2 KeyCloak + Custos | +| W3 KeyCloak | +| W3 KeyCloak + Custos | +| 4 KeyCloak | +| 4 KeyCloak + Custos | +| 5 KeyCloak | +| 5 KeyCloak + Custos | + From 500df42932d8e5b4786033e5ee8f3b5c44cd51be Mon Sep 17 00:00:00 2001 From: Jonas Date: Thu, 12 Dec 2024 20:52:18 +0100 Subject: [PATCH 02/11] Call me custos --- docs/use-case-evaluation/evaluation-matrix.md | 10 +++++----- 1 file changed, 5 insertions(+), 5 deletions(-) diff --git a/docs/use-case-evaluation/evaluation-matrix.md b/docs/use-case-evaluation/evaluation-matrix.md index 6a65cd2..7c27f69 100644 --- a/docs/use-case-evaluation/evaluation-matrix.md +++ b/docs/use-case-evaluation/evaluation-matrix.md @@ -30,13 +30,13 @@ To evaluate these workflows, each cell in the below shall be given | Workflow | (E1) Existing upstream features | (E2) Building ourselves? | (E3) Ongoing Maintenance Effort | (E4) User Experience | (E5) Ease of future change | | - | - | - | - | - | - | | W1 KeyCloak | | | | | | -| W1 KeyCloak + Custos | | | | | | +| W1 Custos | | | | | | | W2 KeyCloak | -| W2 KeyCloak + Custos | +| W2 Custos | | W3 KeyCloak | -| W3 KeyCloak + Custos | +| W3 Custos | | 4 KeyCloak | -| 4 KeyCloak + Custos | +| 4 Custos | | 5 KeyCloak | -| 5 KeyCloak + Custos | +| 5 Custos | From 99fe0800c43fac1409b01121fb6954b2ece2bfff Mon Sep 17 00:00:00 2001 From: Jonas Date: Thu, 12 Dec 2024 20:52:50 +0100 Subject: [PATCH 03/11] Add missing prefix --- docs/use-case-evaluation/evaluation-matrix.md | 8 ++++---- 1 file changed, 4 insertions(+), 4 deletions(-) diff --git a/docs/use-case-evaluation/evaluation-matrix.md b/docs/use-case-evaluation/evaluation-matrix.md index 7c27f69..310e04a 100644 --- a/docs/use-case-evaluation/evaluation-matrix.md +++ b/docs/use-case-evaluation/evaluation-matrix.md @@ -35,8 +35,8 @@ To evaluate these workflows, each cell in the below shall be given | W2 Custos | | W3 KeyCloak | | W3 Custos | -| 4 KeyCloak | -| 4 Custos | -| 5 KeyCloak | -| 5 Custos | +| W4 KeyCloak | +| W4 Custos | +| W5 KeyCloak | +| W5 Custos | From 430496e7a11353d2349a97caa3814c9263e7cea0 Mon Sep 17 00:00:00 2001 From: Jonas Date: Thu, 12 Dec 2024 20:54:24 +0100 Subject: [PATCH 04/11] Add links --- docs/use-case-evaluation/evaluation-matrix.md | 21 ++++++++----------- 1 file changed, 9 insertions(+), 12 deletions(-) diff --git a/docs/use-case-evaluation/evaluation-matrix.md b/docs/use-case-evaluation/evaluation-matrix.md index 310e04a..1d3a954 100644 --- a/docs/use-case-evaluation/evaluation-matrix.md +++ b/docs/use-case-evaluation/evaluation-matrix.md @@ -27,16 +27,13 @@ To evaluate these workflows, each cell in the below shall be given ## Matrix -| Workflow | (E1) Existing upstream features | (E2) Building ourselves? | (E3) Ongoing Maintenance Effort | (E4) User Experience | (E5) Ease of future change | +| [Workflow](https://github.com/NASA-IMPACT/veda-auth-central/blob/main/docs/use-case-evaluation/workflows.md) | (E1) Existing upstream features | (E2) Building ourselves? | (E3) Ongoing Maintenance Effort | (E4) User Experience | (E5) Ease of future change | | - | - | - | - | - | - | -| W1 KeyCloak | | | | | | -| W1 Custos | | | | | | -| W2 KeyCloak | -| W2 Custos | -| W3 KeyCloak | -| W3 Custos | -| W4 KeyCloak | -| W4 Custos | -| W5 KeyCloak | -| W5 Custos | - +| [W1](https://github.com/NASA-IMPACT/veda-auth-central/blob/main/docs/use-case-evaluation/workflows.md#workflow-1-configuring-the-upstream-authentication-provider) KeyCloak | | | | | | +| [W1](https://github.com/NASA-IMPACT/veda-auth-central/blob/main/docs/use-case-evaluation/workflows.md#workflow-1-configuring-the-upstream-authentication-provider) Custos | | | | | | +| [W2](https://github.com/NASA-IMPACT/veda-auth-central/blob/main/docs/use-case-evaluation/workflows.md#workflow-2-provisioning-and-configuring-authentication-clients) KeyCloak | +| [W2](https://github.com/NASA-IMPACT/veda-auth-central/blob/main/docs/use-case-evaluation/workflows.md#workflow-2-provisioning-and-configuring-authentication-clients) Custos | +| [W3](https://github.com/NASA-IMPACT/veda-auth-central/blob/main/docs/use-case-evaluation/workflows.md#workflow-3-assigning-users-to-groups-via-a-ui) KeyCloak | +| [W3](https://github.com/NASA-IMPACT/veda-auth-central/blob/main/docs/use-case-evaluation/workflows.md#workflow-3-assigning-users-to-groups-via-a-ui) Custos | +| [W4](https://github.com/NASA-IMPACT/veda-auth-central/blob/main/docs/use-case-evaluation/workflows.md#workflow-4-expose-roles--capabilities-to-services) KeyCloak | +| [W4](https://github.com/NASA-IMPACT/veda-auth-central/blob/main/docs/use-case-evaluation/workflows.md#workflow-4-expose-roles--capabilities-to-services) Custos | From cda99b18f38fc249bf987bb456190ebf7b91e37b Mon Sep 17 00:00:00 2001 From: Jonas Date: Thu, 12 Dec 2024 21:34:16 +0100 Subject: [PATCH 05/11] Update criteria headings --- docs/use-case-evaluation/evaluation-matrix.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/use-case-evaluation/evaluation-matrix.md b/docs/use-case-evaluation/evaluation-matrix.md index 1d3a954..57ea271 100644 --- a/docs/use-case-evaluation/evaluation-matrix.md +++ b/docs/use-case-evaluation/evaluation-matrix.md @@ -27,7 +27,7 @@ To evaluate these workflows, each cell in the below shall be given ## Matrix -| [Workflow](https://github.com/NASA-IMPACT/veda-auth-central/blob/main/docs/use-case-evaluation/workflows.md) | (E1) Existing upstream features | (E2) Building ourselves? | (E3) Ongoing Maintenance Effort | (E4) User Experience | (E5) Ease of future change | +| [Workflow](https://github.com/NASA-IMPACT/veda-auth-central/blob/main/docs/use-case-evaluation/workflows.md) | (E1) Already implemented | (E2) Built by VEDA | (E3) Ongoing Maintenance Effort | (E4) User Experience | (E5) Ease of future change | | - | - | - | - | - | - | | [W1](https://github.com/NASA-IMPACT/veda-auth-central/blob/main/docs/use-case-evaluation/workflows.md#workflow-1-configuring-the-upstream-authentication-provider) KeyCloak | | | | | | | [W1](https://github.com/NASA-IMPACT/veda-auth-central/blob/main/docs/use-case-evaluation/workflows.md#workflow-1-configuring-the-upstream-authentication-provider) Custos | | | | | | From 6d62b9ab8e79429be9a2c64e73f6f50e6b6be252 Mon Sep 17 00:00:00 2001 From: Jonas Date: Thu, 12 Dec 2024 22:57:46 +0100 Subject: [PATCH 06/11] Add loe column --- docs/use-case-evaluation/evaluation-matrix.md | 34 +++++++++++-------- 1 file changed, 19 insertions(+), 15 deletions(-) diff --git a/docs/use-case-evaluation/evaluation-matrix.md b/docs/use-case-evaluation/evaluation-matrix.md index 57ea271..7e9099c 100644 --- a/docs/use-case-evaluation/evaluation-matrix.md +++ b/docs/use-case-evaluation/evaluation-matrix.md @@ -12,28 +12,32 @@ Building a replicable platform from community-maintained upstream solutions is a 1. Can this workflow already be satisfied with this technology without having to *build* new things? 2. Did we (the NASA VEDA team) *build* this, or are we simply *deploying* a specific configuration of something built by an upstream community? -3. Ongoing effort required to maintain this workflow in the future. This includes keeping up with upstream releases, -4. How is the user experience for those who have to actually perform this workflow? -5. How easy is it to extend and modify this workflow in the future? +3. Ongoing effort required to maintain this workflow in the future. This includes keeping up with upstream releases +4. Level of effort to implement in developer sprints +5. How is the user experience for those who have to actually perform this workflow? +6. How easy is it to extend and modify this workflow in the future? ## Explanation of the values To evaluate these workflows, each cell in the below shall be given -1. A numerical score (1-5) (except for col 1 and 2, which are yes/no) -2. A justification of the numerical score referencing the implementation section of the workflow document - +1. yes/no +2. yes/no +3. Numerical score (1-5, where 5 is best) +4. Estimated number of developer sprints +5. Numerical score (1-5, where 5 is best) +6. Numerical score (1-5, where 5 is best) ## Matrix -| [Workflow](https://github.com/NASA-IMPACT/veda-auth-central/blob/main/docs/use-case-evaluation/workflows.md) | (E1) Already implemented | (E2) Built by VEDA | (E3) Ongoing Maintenance Effort | (E4) User Experience | (E5) Ease of future change | +| [Workflow](https://github.com/NASA-IMPACT/veda-auth-central/blob/main/docs/use-case-evaluation/workflows.md) | (E1) Already implemented | (E2) Built by VEDA | (E3) Ongoing Maintenance Effort | (E4) Level of Effort | (E5) User Experience | (E6) Ease of future change | | - | - | - | - | - | - | -| [W1](https://github.com/NASA-IMPACT/veda-auth-central/blob/main/docs/use-case-evaluation/workflows.md#workflow-1-configuring-the-upstream-authentication-provider) KeyCloak | | | | | | -| [W1](https://github.com/NASA-IMPACT/veda-auth-central/blob/main/docs/use-case-evaluation/workflows.md#workflow-1-configuring-the-upstream-authentication-provider) Custos | | | | | | -| [W2](https://github.com/NASA-IMPACT/veda-auth-central/blob/main/docs/use-case-evaluation/workflows.md#workflow-2-provisioning-and-configuring-authentication-clients) KeyCloak | -| [W2](https://github.com/NASA-IMPACT/veda-auth-central/blob/main/docs/use-case-evaluation/workflows.md#workflow-2-provisioning-and-configuring-authentication-clients) Custos | -| [W3](https://github.com/NASA-IMPACT/veda-auth-central/blob/main/docs/use-case-evaluation/workflows.md#workflow-3-assigning-users-to-groups-via-a-ui) KeyCloak | -| [W3](https://github.com/NASA-IMPACT/veda-auth-central/blob/main/docs/use-case-evaluation/workflows.md#workflow-3-assigning-users-to-groups-via-a-ui) Custos | -| [W4](https://github.com/NASA-IMPACT/veda-auth-central/blob/main/docs/use-case-evaluation/workflows.md#workflow-4-expose-roles--capabilities-to-services) KeyCloak | -| [W4](https://github.com/NASA-IMPACT/veda-auth-central/blob/main/docs/use-case-evaluation/workflows.md#workflow-4-expose-roles--capabilities-to-services) Custos | +| [W1](https://github.com/NASA-IMPACT/veda-auth-central/blob/main/docs/use-case-evaluation/workflows.md#workflow-1-configuring-the-upstream-authentication-provider) KeyCloak | | | | | | | +| [W1](https://github.com/NASA-IMPACT/veda-auth-central/blob/main/docs/use-case-evaluation/workflows.md#workflow-1-configuring-the-upstream-authentication-provider) Custos | | | | | | | +| [W2](https://github.com/NASA-IMPACT/veda-auth-central/blob/main/docs/use-case-evaluation/workflows.md#workflow-2-provisioning-and-configuring-authentication-clients) KeyCloak | | +| [W2](https://github.com/NASA-IMPACT/veda-auth-central/blob/main/docs/use-case-evaluation/workflows.md#workflow-2-provisioning-and-configuring-authentication-clients) Custos | | +| [W3](https://github.com/NASA-IMPACT/veda-auth-central/blob/main/docs/use-case-evaluation/workflows.md#workflow-3-assigning-users-to-groups-via-a-ui) KeyCloak | | +| [W3](https://github.com/NASA-IMPACT/veda-auth-central/blob/main/docs/use-case-evaluation/workflows.md#workflow-3-assigning-users-to-groups-via-a-ui) Custos | | +| [W4](https://github.com/NASA-IMPACT/veda-auth-central/blob/main/docs/use-case-evaluation/workflows.md#workflow-4-expose-roles--capabilities-to-services) KeyCloak | | +| [W4](https://github.com/NASA-IMPACT/veda-auth-central/blob/main/docs/use-case-evaluation/workflows.md#workflow-4-expose-roles--capabilities-to-services) Custos | | From e163b71a59e169bf42fc4b84152502562b586a64 Mon Sep 17 00:00:00 2001 From: Jonas Date: Thu, 12 Dec 2024 22:58:08 +0100 Subject: [PATCH 07/11] Fix table --- docs/use-case-evaluation/evaluation-matrix.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/use-case-evaluation/evaluation-matrix.md b/docs/use-case-evaluation/evaluation-matrix.md index 7e9099c..dc84b21 100644 --- a/docs/use-case-evaluation/evaluation-matrix.md +++ b/docs/use-case-evaluation/evaluation-matrix.md @@ -32,7 +32,7 @@ To evaluate these workflows, each cell in the below shall be given ## Matrix | [Workflow](https://github.com/NASA-IMPACT/veda-auth-central/blob/main/docs/use-case-evaluation/workflows.md) | (E1) Already implemented | (E2) Built by VEDA | (E3) Ongoing Maintenance Effort | (E4) Level of Effort | (E5) User Experience | (E6) Ease of future change | -| - | - | - | - | - | - | +| - | - | - | - | - | - | - | | [W1](https://github.com/NASA-IMPACT/veda-auth-central/blob/main/docs/use-case-evaluation/workflows.md#workflow-1-configuring-the-upstream-authentication-provider) KeyCloak | | | | | | | | [W1](https://github.com/NASA-IMPACT/veda-auth-central/blob/main/docs/use-case-evaluation/workflows.md#workflow-1-configuring-the-upstream-authentication-provider) Custos | | | | | | | | [W2](https://github.com/NASA-IMPACT/veda-auth-central/blob/main/docs/use-case-evaluation/workflows.md#workflow-2-provisioning-and-configuring-authentication-clients) KeyCloak | | From a4c0846373ba8abea8f5b4a68d8104881417d77a Mon Sep 17 00:00:00 2001 From: Jonas Date: Thu, 12 Dec 2024 23:03:03 +0100 Subject: [PATCH 08/11] Add notes on cost --- docs/use-case-evaluation/evaluation-matrix.md | 10 ++++++++++ 1 file changed, 10 insertions(+) diff --git a/docs/use-case-evaluation/evaluation-matrix.md b/docs/use-case-evaluation/evaluation-matrix.md index dc84b21..bb9a9bf 100644 --- a/docs/use-case-evaluation/evaluation-matrix.md +++ b/docs/use-case-evaluation/evaluation-matrix.md @@ -41,3 +41,13 @@ To evaluate these workflows, each cell in the below shall be given | [W3](https://github.com/NASA-IMPACT/veda-auth-central/blob/main/docs/use-case-evaluation/workflows.md#workflow-3-assigning-users-to-groups-via-a-ui) Custos | | | [W4](https://github.com/NASA-IMPACT/veda-auth-central/blob/main/docs/use-case-evaluation/workflows.md#workflow-4-expose-roles--capabilities-to-services) KeyCloak | | | [W4](https://github.com/NASA-IMPACT/veda-auth-central/blob/main/docs/use-case-evaluation/workflows.md#workflow-4-expose-roles--capabilities-to-services) Custos | | + +## Cost estimates + +The evaluation criteria include level of effort to implement. This is both for project costs but even more for project planning - how much will it take to get to a solution for a workflow. +This assumes that there is only a smaller additional effort required for implementing a concrete use case that makes use of a given workflow. + +It seems like there will be no other costs than developer time: +1. It seems like there will be no subscription costs - there seem to be different ways for us to get around paying for a new CILogon subscription https://github.com/NASA-IMPACT/veda-auth-central/issues/139 +2. All solutions are/will be open-source, so no license fees either. +3. Compute costs should also be negligible - probably some low-powered EC2 instances for the KeyCloak and maybe Custos services + UI, etc. From 84b26b3257f82e87550df254402d821ab06c6a02 Mon Sep 17 00:00:00 2001 From: Jonas Date: Fri, 13 Dec 2024 00:36:52 +0100 Subject: [PATCH 09/11] Clear table --- docs/use-case-evaluation/evaluation-matrix.md | 16 ++++++++-------- 1 file changed, 8 insertions(+), 8 deletions(-) diff --git a/docs/use-case-evaluation/evaluation-matrix.md b/docs/use-case-evaluation/evaluation-matrix.md index bb9a9bf..87c569f 100644 --- a/docs/use-case-evaluation/evaluation-matrix.md +++ b/docs/use-case-evaluation/evaluation-matrix.md @@ -33,14 +33,14 @@ To evaluate these workflows, each cell in the below shall be given | [Workflow](https://github.com/NASA-IMPACT/veda-auth-central/blob/main/docs/use-case-evaluation/workflows.md) | (E1) Already implemented | (E2) Built by VEDA | (E3) Ongoing Maintenance Effort | (E4) Level of Effort | (E5) User Experience | (E6) Ease of future change | | - | - | - | - | - | - | - | -| [W1](https://github.com/NASA-IMPACT/veda-auth-central/blob/main/docs/use-case-evaluation/workflows.md#workflow-1-configuring-the-upstream-authentication-provider) KeyCloak | | | | | | | -| [W1](https://github.com/NASA-IMPACT/veda-auth-central/blob/main/docs/use-case-evaluation/workflows.md#workflow-1-configuring-the-upstream-authentication-provider) Custos | | | | | | | -| [W2](https://github.com/NASA-IMPACT/veda-auth-central/blob/main/docs/use-case-evaluation/workflows.md#workflow-2-provisioning-and-configuring-authentication-clients) KeyCloak | | -| [W2](https://github.com/NASA-IMPACT/veda-auth-central/blob/main/docs/use-case-evaluation/workflows.md#workflow-2-provisioning-and-configuring-authentication-clients) Custos | | -| [W3](https://github.com/NASA-IMPACT/veda-auth-central/blob/main/docs/use-case-evaluation/workflows.md#workflow-3-assigning-users-to-groups-via-a-ui) KeyCloak | | -| [W3](https://github.com/NASA-IMPACT/veda-auth-central/blob/main/docs/use-case-evaluation/workflows.md#workflow-3-assigning-users-to-groups-via-a-ui) Custos | | -| [W4](https://github.com/NASA-IMPACT/veda-auth-central/blob/main/docs/use-case-evaluation/workflows.md#workflow-4-expose-roles--capabilities-to-services) KeyCloak | | -| [W4](https://github.com/NASA-IMPACT/veda-auth-central/blob/main/docs/use-case-evaluation/workflows.md#workflow-4-expose-roles--capabilities-to-services) Custos | | +| W1 KeyCloak | | | | | | | +| W1 Custos | | | | | | | +| W2 KeyCloak | | | | | | | +| W2 Custos | | | | | | | +| W3 KeyCloak | | | | | | | +| W3 Custos | | | | | | | +| W4 KeyCloak | | | | | | | +| W4 Custos | | | | | | | ## Cost estimates From 17d06d88b26614097016fdfc023820796475bee8 Mon Sep 17 00:00:00 2001 From: Jonas Date: Fri, 20 Dec 2024 12:21:55 +0100 Subject: [PATCH 10/11] Refine evaluation criteria --- docs/use-case-evaluation/evaluation-matrix.md | 22 +++++++++---------- 1 file changed, 11 insertions(+), 11 deletions(-) diff --git a/docs/use-case-evaluation/evaluation-matrix.md b/docs/use-case-evaluation/evaluation-matrix.md index 87c569f..f1c2acc 100644 --- a/docs/use-case-evaluation/evaluation-matrix.md +++ b/docs/use-case-evaluation/evaluation-matrix.md @@ -2,20 +2,21 @@ The below table refers to the previously [defined auth workflows](https://github.com/NASA-IMPACT/veda-auth-central/blob/main/docs/use-case-evaluation/workflows.md). -Our goal with this evaluation is to find out whether there is a solution that fulfils the workflows while relying on upstream projects as much as possible, -i.e. pieces together existing community solutions (such as KeyCloak and maybe Airavata Custos) only with IaC and durable enough configuration. +Our goal with this evaluation is to find out whether there is a solution that fulfils the workflows while relying on existing community solutions as much as possible, +only with IaC and durable configuration of the solution. Building a replicable platform from community-maintained upstream solutions is a principle of the [VEDA Open Source Ecosystem](https://docs.openveda.cloud/open-source-ecosystem/). +The evaluated options are [KeyCloak](https://www.keycloak.org/) and [Apache Airavata Custos](https://airavata.apache.org/custos/), which uses KeyCloak under the hood. + ## Explanation of the evaluation criteria 1. Can this workflow already be satisfied with this technology without having to *build* new things? -2. Did we (the NASA VEDA team) *build* this, or are we simply *deploying* a specific configuration of something built by an upstream community? -3. Ongoing effort required to maintain this workflow in the future. This includes keeping up with upstream releases -4. Level of effort to implement in developer sprints -5. How is the user experience for those who have to actually perform this workflow? -6. How easy is it to extend and modify this workflow in the future? +2. Did we (the NASA VEDA team) *build* this, in contrast to *deploying* a specific configuration of features built by an upstream community? +3. Level of effort to implement and document the workflow solution, in developer sprints (2 weeks) +4. Ongoing effort required to maintain this workflow in the future. This includes keeping up with upstream releases. +5. How easy is it to extend and modify this workflow in the future? ## Explanation of the values @@ -24,10 +25,9 @@ To evaluate these workflows, each cell in the below shall be given 1. yes/no 2. yes/no -3. Numerical score (1-5, where 5 is best) -4. Estimated number of developer sprints +3. Estimated number of developer sprints (2 weeks) +4. Numerical score (1-5, where 5 is best) 5. Numerical score (1-5, where 5 is best) -6. Numerical score (1-5, where 5 is best) ## Matrix @@ -50,4 +50,4 @@ This assumes that there is only a smaller additional effort required for impleme It seems like there will be no other costs than developer time: 1. It seems like there will be no subscription costs - there seem to be different ways for us to get around paying for a new CILogon subscription https://github.com/NASA-IMPACT/veda-auth-central/issues/139 2. All solutions are/will be open-source, so no license fees either. -3. Compute costs should also be negligible - probably some low-powered EC2 instances for the KeyCloak and maybe Custos services + UI, etc. +3. Infrastructure costs should also be negligible - probably some low-powered EC2 instances for the KeyCloak and maybe Custos services + UI, etc. From 12d416a6c61b81a139a9a8b362bb648a97d67f98 Mon Sep 17 00:00:00 2001 From: Jonas Date: Fri, 20 Dec 2024 12:23:55 +0100 Subject: [PATCH 11/11] Also fix table --- docs/use-case-evaluation/evaluation-matrix.md | 20 +++++++++---------- 1 file changed, 10 insertions(+), 10 deletions(-) diff --git a/docs/use-case-evaluation/evaluation-matrix.md b/docs/use-case-evaluation/evaluation-matrix.md index f1c2acc..34df85f 100644 --- a/docs/use-case-evaluation/evaluation-matrix.md +++ b/docs/use-case-evaluation/evaluation-matrix.md @@ -31,16 +31,16 @@ To evaluate these workflows, each cell in the below shall be given ## Matrix -| [Workflow](https://github.com/NASA-IMPACT/veda-auth-central/blob/main/docs/use-case-evaluation/workflows.md) | (E1) Already implemented | (E2) Built by VEDA | (E3) Ongoing Maintenance Effort | (E4) Level of Effort | (E5) User Experience | (E6) Ease of future change | -| - | - | - | - | - | - | - | -| W1 KeyCloak | | | | | | | -| W1 Custos | | | | | | | -| W2 KeyCloak | | | | | | | -| W2 Custos | | | | | | | -| W3 KeyCloak | | | | | | | -| W3 Custos | | | | | | | -| W4 KeyCloak | | | | | | | -| W4 Custos | | | | | | | +| [Workflow](https://github.com/NASA-IMPACT/veda-auth-central/blob/main/docs/use-case-evaluation/workflows.md) | (E1) Already implemented | (E2) Built by VEDA | (E4) Level of Effort | (E3) Ongoing Maintenance Effort | (E6) Ease of future change | +| - | - | - | - | - | - | +| W1 KeyCloak | | | | | | +| W1 Custos | | | | | | +| W2 KeyCloak | | | | | | +| W2 Custos | | | | | | +| W3 KeyCloak | | | | | | +| W3 Custos | | | | | | +| W4 KeyCloak | | | | | | +| W4 Custos | | | | | | ## Cost estimates