v1.5.1 Release

Version Summary

Version Number : v1.5.1 [tag: v1.5.1]
Version Name: RC1 for SODA 'L' Release
Date: 24-Dec-2021

Projects / Repos Included : delfin, api, controller, dock, nbp, multi-cloud, installer, dashboard, documentation, orchestration, anomaly-detection, examples

Release Summary :

SODA v1.5.1 Release is an incremental release over the Kalpeni release (v1.5.0) of SODA Foundation.
The earlier stable release Kalpeni, you can get here.

This is a pre-release and is for testing/demo only

Changelog

This changelog is based on SODA release Kalpeni release.

SODA releases will provide the key use cases, integrations and overall solutions based on SODA projects. It will list all the respective project releases under the scope of each of the SODA releases. You can get a detailed feature list of specific projects from the respective project release pages.

Overall Features:

• Enhanced Heterogeneous Performance Metric Collection Framework

  • Historic performance collection
  • Scheduling of storages to nodes
  • Failed Task Scheduling
  • Subclasses of StorageResourceTask

• Driver Enhancements for SPM

  • NetApp login improvements
  • VMAX disk resource and disk metrics collection
  • New driver added to support Fujitsu ETERNUS
  • New driver added to support Hitachi HNAS
  • New driver added to support HPE MSA

• SODA Installation Support for Ubuntu 20.04 LTS

• Visualization enhanced

Delfin: SODA Infrastructure Management

• 781 Add Delfin driver support for Fujitsu ETERNUS storage
• 777 Add Vmax disk resource support
• 776 Add Vmax disk metrics collection
• 769 Add storage status:degraded
• 767 Add Delfin driver support for Hitachi HNAS storage
• 765 Historic performance collection when last runtime not set
• 764 Improve scheduling of storages to nodes
• 763 Failed task scheduling based on driver capability
• 762 Added REST login verification for Netapp
• 761 Add Delfin driver support for HPE MSA Storage
• 760 Adding overlap between collection intervals
• 755 Updated sequence during history collection
• 754 Optimize subclasses of StorageResourceTask
• Multiple fixes and optimization in drivers

SODA Experience & Quality

Installer:

Updates for tags of new SODA releases

Dashboard :

Updates for delfin changes to support new devices

SODA Projects/Repos part of this release:

Key projects part of this SODA Release
SODA Framework Core Projects:

Project	Release Link
delfin	delfin release v1.4.1
api	api release v1.1.0
controller	controller release v1.1.0
dock	dock release v1.3.0
multi-cloud	multicloud release v1.5.0

SODA Experience Projects

Project	Release Link
installer	installer release v1.5.1
dashboard	dashboard release v1.5.1

SODA Other Projects

Project	Release Link
orchestration	orchestration release v0.13.0
anomaly-detection	anomaly detection release v0.10.0
nbp	nbp release v1.4.0

How to use the Release:

Configuration & Installation: Follow these steps: https://docs.sodafoundation.io/soda-gettingstarted/installation-using-ansible/ ; Use the correct version tags for the commands and config files for the projects as per this release notes. (Example : git checkout v1.5.1)

SODA Documentation

docs.sodafoundation.io

Issues and Suggestions

Any SODA Release related issues/suggestions, please raise at https://github.com/sodafoundation/soda/issues

For all other issues/suggestions, please raise to the respective project repositories.

SODA v1.5.0 Kalpeni release

Version Summary

Version Number : v1.5.0 [tag: v1.5.0]
Version Name: Kalpeni Release
Date: 06-Oct-2021

Projects / Repos Included : delfin, api, controller, dock, nbp, multi-cloud, installer, dashboard, documentation, orchestration, anomaly-detection, examples

Release Summary :

SODA v1.5.0 Release is an incremental release over Jerba release (v1.4.0) of SODA Foundation.
The earlier stable release Jerba, you can get here.
SODA Open Data Framework (ODF) Kalpeni v1.5.0 is released with enhanced features for heterogeneous storage performance monitoring.
Kalpeni release comes with multiple features in Heterogeneous Storage Performance Monitoring(SPM) viz., improved job distribution, load balancing, multiprocessing, host mapping, new performance metrics, and driver enhancements for performance collection.
This release is focused on monitoring and some of the bug fixes of multi-cloud user-level tiering features.
Kalpeni can be trailed for heterogeneous performance monitoring and for all other existing features from container data management, on-premise data management, and multi-cloud data management

Kalpeni: Focus on Heterogeneous Performance Monitoring!
(Kalpeni is an inhabited Atoll in the Union Territory of Lakshadweep, India. It is famous for coral reefs and different beach activities)

Highlights:

• Enhanced Heterogeneous Performance Metric Collection Framework
• Host mapping support through resource groups
• Filesystem metrics support
• Driver Enhancements for SPM
• Enhanced host mapping visualization from dashboard
• Multi-Cloud User level storage tiering Fixes

Changelog

This changelog is based on SODA release Jerba release.

SODA releases will provide the key use cases, integrations, and overall solutions based on SODA projects. It will list all the respective project releases under the scope of each of the SODA releases. You can get a detailed feature list of specific projects from the respective project release pages.

Delfin: SODA Infrastructure Management

• Enhanced Heterogeneous Performance Metric Collection Framework with improved job distribution, load balancing, and multiprocessing
• Host mapping support through resource groups
• File-system metrics added
• Driver Enhancements
  -Netapp C mode Performance metric collection
  -EMC VMAX port and controller resources
  -EMC VMAX pool, port and controller metrics collection
  -Host mapping from Huawei Oceanstor

Multi-Cloud

• Bucket access by different users of tenants
• Validation of Tenants in Tier API
• Admin to list all buckets

SODA Experience & Quality

Installer:

• Removed Ubunut 16.04 from CI
• Added multi processing enable flag for deflin

Dashboard :

• Updated masking views. Added support for following resource groups:
• Storage Host Groups
• Volume Groups
• Port Groups
• Enabled support for port and controller resources for vmax devices.

SODA Projects/Repos part of this release:

Key projects part of this SODA Release
SODA Framework Core Projects:

Project	Release Link
delfin	delfin release v1.4.0
api	api release v1.1.0
controller	controller release v1.1.0
dock	dock release v1.3.0
multi-cloud	multicloud release v1.5.0

SODA Experience Projects

Project	Release Link
installer	installer release v1.5.0
dashboard	dashboard release v1.5.0

SODA Other Projects

Project	Release Link
orchestration	orchestration release v0.13.0
anomaly-detection	anomaly detection release v0.10.0
nbp	nbp release v1.4.0

How to use the Release:

Configuration & Installation: Follow these steps: https://docs.sodafoundation.io/soda-gettingstarted/installation-using-ansible/ ; Use the correct version tags for the commands and config files for the projects as per this release notes. (Example: git checkout v1.5.0)

SODA Documentation

docs.sodafoundation.io

Issues and Suggestions

Any SODA Release related issues/suggestions, please raise at https://github.com/sodafoundation/soda/issues

For all other issues/suggestions, please raise it to the respective project repositories.

SODA v1.4.0 Jerba release

Version Summary

Version Number : v1.4.0 [tag: v1.4.0]
Version Name: Jerba Release
Date: 30-June-2021

Projects / Repos Included : delfin, api, controller, dock, nbp, multi-cloud, installer, dashboard, documentation, orchestration, anomaly-detection, examples

Release Summary :

SODA v1.4.0 Release is an incremental release over Isabela release (v1.3.0) of SODA Foundation.
The earlier stable release Isabela, you can get here.

Background: J release is named after Jerba - a Tunisian island and where Star Wars Episode IV was filmed
SODA Open Data Framework (ODF) v1.4.0 Jerba Release is designed to simplify Kubernetes storage and data management.
Multi-instance CSI support along with seamless CSI pluggability, consistent snapshot across on-prem to any cloud along in a framework for container data management.
Heterogeneous Storage Performance Monitoring(SPM) has been enhanced with a distributed scheduler for metric collection, new metric additions, host-mapping support and more vendor driver support. Storage Service Plan framework has been added in the multi-cloud, which can abstract the storage backends and provide ability to create custom service plans. Automatic bucket management now supports all major cloud services.
Jerba is ready for POC testing for container data management across on-prem/cloud, heterogeneous monitoring and multi-cloud data management

Highlights

• Plug-in support for any CSI driver
• Support multiple concurrent CSI drivers in Kubernetes deployment
• Container data protection framework based on Restic
• Policy-based application-consistent snapshot to cloud
• Storage performance monitoring enhanced with distributed scheduler, host mapping, and additional metrics support
• Storage Service Plan framework for multi-cloud
• Bucket management extended to all major cloud backends

Changelog

This changelog is based on SODA release Isabela release.

SODA releases will provide the key use cases, integrations and overall solution based on SODA projects. It will list all the respective project releases under the scope of each of the SODA releases. You can get a detailed feature list of specific projects from the respective project release pages.

Delfin: SODA Infrastructure Management

• Heterogeneous SPM enhancement with Distributed Scheduler
• Enhanced metrics support
• New driver: NetApp C-Mode
• Swagger API spec update for host to LUN masking

Multi-Cloud

• Storage service plan (SSP) management for multi-cloud storage
• Swagger API update for storage service plan and AK/SK generation
• Automated Bucket Management extended for multicloud backends like Ceph and IBM COS
• Bug fixes

Nbp

• [SODA Syncer] New solution for Policy based consistent snapshot of container storage using restic. Solution Details
• Framework for Container data protection
• CSI multiple instance support in K8S deployments
• CSI Plug N Play

Overall Features:

• Migration of all SODA Projects CI from Travis to Github action

• Automated E2E test suite using Postman collections, global variables and Newman collection runner

• More Test coverage and reports. Check the reports

• Swagger API spec updates

• Ux enhancements

• Enhanced SODA documentation. Please check here

SODA Experience & Quality

Installer:

• Enhancements for resilient installer

Dashboard :

• Storage Service Plan management for multi-cloud through UI
• New drivers supported: NetApp C-Mode
• Host Masking view for Storage Host to LUN
• New multi-cloud backend registration support for SONY ODA
• Bucket management support for IBM COS and Ceph

Documentation:

• Updated User guide and Developer guides for different projects
• Updated Support matrix
• API spec updates

SODA Projects/Repos part of this release:

Key projects part of this SODA Release
SODA Framework Core Projects:

Project	Release Link
delfin	delfin release v1.3.0
api	api release v1.1.0
controller	controller release v1.1.0
dock	dock release v1.3.0
multi-cloud	multicloud release v1.4.0

SODA Experience Projects

Project	Release Link
installer	installer release v1.4.0
dashboard	dashboard release v1.4.0
documentation	documentation release v1.1.0

SODA Other Projects

Project	Release Link
orchestration	orchestration release v0.13.0
anomaly-detection	anomaly detection release v0.10.0
nbp	nbp release v1.4.0

How to use the Release:

Configuration & Installation: Follow these steps: https://docs.sodafoundation.io/soda-gettingstarted/installation-using-ansible/ ; Use the correct version tags for the commands and config files for the projects as per this release notes. (Example : git checkout v1.4.0)

Sunsetting installation on Ubuntu 16.04

Please note that from Jerba (v1.4.0) release onward, installation of SODA projects on Ubuntu 16.04 is deprecated. 
If you still need to install SODA projects on Ubuntu 16.04, please contact us .

SODA Documentation

docs.sodafoundation.io

Issues and Suggestions

Any SODA Release related issues/suggestions, please raise at https://github.com/sodafoundation/soda/issues

For all other issues/suggestions, please raise to the respective project repositories.

Jerba RC3 release

Version Summary

Version Number : v1.3.3 [tag: v1.3.3]
Version Name: Jerba Pre-Release
Date: 29-June-2021

Projects / Repos Included : delfin, api, controller, dock, nbp, multi-cloud, installer, dashboard, documentation, orchestration, anomaly-detection, examples

Release Summary :

SODA v1.3.3 Release is an incremental pre-release over Jerba pre-release v1.3.2 of SODA Foundation.
The earlier stable release Isabela, you can get here.

This is a pre-release for Jerba and for testing/demo only

Changelog

This changelog is based on SODA release Jerba pre-release.

SODA releases will provide the key use cases, integrations and overall solution based on SODA projects. It will list all the respective project releases under the scope of each of the SODA releases. You can get a detailed feature list of specific projects from the respective project release pages.

Overall Features:

• Swagger API spec updates for SODA multi-cloud Storage service plan and SODA multicloud AK/SK management
• Swagger API spec update for Host Masking (host to LUN)
• Ux enhancements

Delfin: SODA Infrastructure Management

• Swagger API spec update for host to LUN masking
• Bug fixes

Multi-Cloud

• Swagger API update for storage service plan and AK/SK generation
• Bug fixes

SODA Experience & Quality

Installer:

• Fix for taking HOST_IP from environment variable for AK/SK container

Dashboard :

• Bug fixes for storage service plan for multicloud

SODA Projects/Repos part of this release:

Key projects part of this SODA Release
SODA Framework Core Projects:

Project	Release Link
delfin	delfin release v1.2.3
api	api release v1.0.1
controller	controller release v1.0.1
dock	dock release v1.2.1
multi-cloud	multicloud release v1.3.3

SODA Experience Projects

Project	Release Link
installer	installer release v1.3.3
dashboard	dashboard release v1.3.4

SODA Other Projects

Project	Release Link
orchestration	orchestration release v0.12.1
anomaly-detection	anomaly detection release v0.10.0
nbp	nbp release v1.3.1

How to use the Release:

Configuration & Installation: Follow these steps: https://docs.sodafoundation.io/soda-gettingstarted/installation-using-ansible/ ; Use the correct version tags for the commands and config files for the projects as per this release notes. (Example : git checkout v1.3.3)

SODA Documentation

docs.sodafoundation.io

Issues and Suggestions

Any SODA Release related issues/suggestions, please raise at https://github.com/sodafoundation/soda/issues

For all other issues/suggestions, please raise to the respective project repositories.

Jerba RC2 release

Version Summary

Version Number : v1.3.2 [tag: v1.3.2]
Version Name: Jerba Pre-Release
Date: 26-June-2021

Projects / Repos Included : delfin, api, controller, dock, nbp, multi-cloud, installer, dashboard, documentation, orchestration, anomaly-detection, examples

Release Summary :

SODA v1.3.2 Release is an incremental pre-release over Jerba pre-release (v1.3.1) of SODA Foundation.
The earlier stable release Isabela, you can get here.

This is a pre-release for Jerba and for testing/demo only

Changelog

This changelog is based on SODA release Jerba RC1 pre-release .

SODA releases will provide the key use cases, integrations and overall solution based on SODA projects. It will list all the respective project releases under the scope of each of the SODA releases. You can get a detailed feature list of specific projects from the respective project release pages.

Overall Features:

• Enhanced framework support for HOST to LUN Mapping
• Storage Service Plan (SSP) support for multi-cloud
• Generation of SODA multi-cloud AK,SK through API
• Enhanced installer
• Dashboard visualization for SSP and Host-LUN Mapping

Delfin: SODA Infrastructure Management

• Framework enhanced to support Host to LUN mapping
• Enable delfin installer to run multiple instances of delfin components

Multi-Cloud

• Access Key, Secret Key (AK , SK) can now be generated using APIs.
• Storage service plan feature(SSP) for multi-cloud

SODA Experience & Quality

Installer:

• new delfin metric support through Grafana Dashboard

Dashboard :

• Updated the overall performance monitoring grafana dashboard embedded url
• Multi-cloud SSP Plan creation and management support
• Host-LUN Masking view feature support for storage backends

SODA Projects/Repos part of this release:

Key projects part of this SODA Release
SODA Framework Core Projects:

Project	Release Link
delfin	delfin release v1.2.2
api	api release v1.0.1
controller	controller release v1.0.1
dock	dock release v1.2.1
multi-cloud	multicloud release v1.3.2

SODA Experience Projects

Project	Release Link
installer	installer release v1.3.2
dashboard	dashboard release v1.3.3

SODA Other Projects

Project	Release Link
orchestration	orchestration release v0.12.1
anomaly-detection	anomaly detection release v0.10.0
nbp	nbp release v1.3.1

How to use the Release:

Configuration & Installation: Follow these steps: https://docs.sodafoundation.io/soda-gettingstarted/installation-using-ansible/ ; Use the correct version tags for the commands and config files for the projects as per this release notes. (Example : git checkout v1.3.2)

SODA Documentation

docs.sodafoundation.io

Issues and Suggestions

Any SODA Release related issues/suggestions, please raise at https://github.com/sodafoundation/soda/issues

For all other issues/suggestions, please raise to the respective project repositories.

Jerba-RC1 release

Version Summary

Version Number : v1.3.1 [tag: v1.3.1]
Version Name: Jerba Pre-Release
Date: 22-June-2021

Projects / Repos Included : delfin, api, controller, dock, nbp, multi-cloud, installer, dashboard, documentation, orchestration, anomaly-detection, examples

Release Summary :

SODA v1.3.1 Release is an incremental pre-release over Isabela release (v1.3.0) of SODA Foundation.
The earlier stable release Isabela, you can get here.

This is a pre-release for Jerba and for testing/demo only

Changelog

This changelog is based on SODA release Isabela.

SODA releases will provide the key use cases, integrations and overall solution based on SODA projects. It will list all the respective project releases under the scope of each of the SODA releases. You can get a detailed feature list of specific projects from the respective project release pages.

Overall Features:

• Automated Bucket Management for multicloud backends like Alibaba, Ceph and IBM COS
• Installer enhancements
• Heterogeneous SPM enhanced with Distributed Scheduler
• Enhanced metrics support
• CLI and SMIS based storage backend aceess for Heterogeneous Storage
• Support new drivers: NetApp C-Mode
• Policy based Container storage snapshot support from on-prem to AWS Cloud using restic
• Migration of Project CI from Travis to Github action

Delfin: SODA Infrastructure Management

• Heterogeneous SPM enhanced with Distributed Scheduler
• New metrics support
• Support for new driver: NetApp C-Mode

Multi-Cloud

• Automated Bucket Management for Alibaba cloud, Ceph and IBM COS
• Security hardening using secrets for Multi-Cloud HA Deployment

NBP

• CSI multiple instance support in K8S deployments
• Policy based Container storage snapshot support from on-prem to AWS Cloud using restic

SODA Experience & Quality

Installer:

• Enhancements for resilient installer

Dashboard :

• Added support for Sony-ODA (Optical Disk Archive) for multi-cloud
• Copy profile ID feature added for SODA profile. Allows users to copy the profile ID to be used for tasks on the command line or in configurations like Kubernetes yaml files.
• Use shared modules to inject dependencies. Remove duplication of framework component and common modules in all modules.
• Notifications for create migration is added for multi-cloud. Added Validation for migration name check
• Added a search filter and removed the scroll from type selection during Register Backend for multicloud
• Bucket field is removed in Ceph backend registration process in multi-cloud, as per new bucket management changes
• Added support for NetApp driver for Delfin

SODA Projects/Repos part of this release:

Key projects part of this SODA Release
SODA Framework Core Projects:

Project	Release Link
delfin	delfin release v1.2.1
api	api release v1.0.1
controller	controller release v1.0.1
dock	dock release v1.2.1
multi-cloud	multicloud release v1.3.1

SODA Experience Projects

Project	Release Link
installer	installer release v1.3.1
dashboard	dashboard release v1.3.1

SODA Other Projects

Project	Release Link
orchestration	orchestration release v0.12.1
anomaly-detection	anomaly detection release v0.10.0
nbp	nbp release v1.3.1

How to use the Release:

Configuration & Installation: Follow these steps: https://docs.sodafoundation.io/soda-gettingstarted/installation-using-ansible/ ; Use the correct version tags for the commands and config files for the projects as per this release notes. (Example : git checkout v1.3.1)

SODA Documentation

docs.sodafoundation.io

Issues and Suggestions

Any SODA Release related issues/suggestions, please raise at https://github.com/sodafoundation/soda/issues

For all other issues/suggestions, please raise to the respective project repositories.

SODA v1.3.0 Isabela release

Version Summary

Version Number : v1.3.0 [tag: v1.3.0]
Version Name: Isabela Release
Date: 03-April-2021
Projects / Repos Included : delfin, api, controller, dock, nbp, multi-cloud, installer, dashboard, documentation, orchestration, anomaly-detection, examples

Release Summary :

SODA v1.3.0 Release is an incremental release over the Hawaii release(v1.2.0) of SODA Foundation. The earlier stable release of Hawaii, you can get here.

SODA Open Data Framework (ODF) Isabela Release comes with enhanced features for storage performance monitoring and multi-cloud data management. ODF Storage Performance Monitoring has been enhanced with NAS resource support, performance framework refactored with generic task manager & scheduling, and more drivers. The multi-cloud project has been upgraded with integrated bucket management, cold storage support, added more backend support for data archival/restore. Isabela release also has added more CSI drivers for cloud-native storage management.

Isabela: Growing stronger Heterogeneous and Hybrid Data Management Solutions!
Island is the largest island of the Galápagos (Republic Ecuador)

Changelog

This changelog is based on SODA Hawaii release v1.2.0.

SODA releases will provide the key use cases, integrations, and overall solution based on SODA projects. It will list all the respective project releases under the scope of each of the SODA releases. You can get a detailed feature list of specific projects from the respective project release pages.

Overall Features:

• Heterogeneous SPM with Enhanced Performance Framework
• NAS Resource support
• Upgraded SPM Visualization (along with Grafana integration)
• Multi-cloud HA support
• More Cloud Backends for Data Archival/Restore
• Cold Storage Support
• Cloud Native storage with more CSI drivers.
• More Storage Backends (On-prem/Cloud)

Delfin: SODA Infrastructure Management

Heterogeneous Storage Performance Monitoring(SPM) has been enhanced with new features and framework updates.
- Performance metric collection framework enhancements with generic task manager and scheduler
- Storage monitoring support of NAS resources
- CLI and SMIS based back end access mechanism support
- New drivers: EMC VPLEX | EMC VNX (Block) | Huawei Ocean Stor(NAS Support)
- Bug fixes for Drivers
Please check the support matrix here

Multi-Cloud

Multi-cloud HA

- High Availability (HA) supported for multi-cloud project (Pod level HA based on K8S for services & db)
- Configurable HA (install/uninstall)

Data Archival

- Cold Storage backend for SONY ODA
- Data Archival from on-prem to Azure and GCP Cloud
- Data Archival from on-prem/public cloud to SONY ODA

Automated Bucket Management

- Fully integrated bucket management support added for AWS, Azure, GCP, and Huawei Cloud 
- Policy-based lifecycle management and object migration upgraded for new bucket management for AWS, Azure, GCP and Huawei Cloud

Note: (Other cloud backends continue to work in the same. It will be upgraded in the next release)
Please check the support matrix here

NBP CSI

- Qualification of Full Lifecycle management with 5 CSI Drivers using CSI Plug N Play 
- OpenEBS LVM and ZFS support added

Please check the support matrix here

SODA Experience & Quality

Documentation

- Updated the following documents:
    - Integration guide for CSI driver via SODA CSI Plug and play
    - SODA Installer guide
    - Multi-Cloud User guides (Bucket Management, Data Archival)
- Support matrix added for Delfin and Multi-Cloud 

Dashboard :

- [Delfin UI] Added support for DellEMC VNX and VPLEX devices in Delfin.
- [Delfin UI] Added CLI and SMI-S access methods for registering storage devices using Delfin
- [Delfin UI] Added new resource types: Qtree, Filesystems, Quotas and Shares display for NAS capable devices in Delfin
- [Multicloud UI] Updated the lifecycle CRUD UI. Changed to a sidebar panel from dialog boxes.
- [Multicloud UI] Added Archive and retrieve support for Azure and GCP object storage.
- [Multicloud UI] Updated the Backend registration form. Removed bucket param from backend registration for AWS, Azure, Huawei, and GCP.
- [Multicloud UI] Updated the lifecycle UI as per bucket management changes for AWS, Azure, Huawei, and GCP

Installer :

- K8S based deployment of multi-cloud to support services and DB HA
- Delfin enhancements

QA:

- More tests, test cases, and execution report

SODA Projects/Repos part of this release:

Key projects part of this SODA Release
SODA Framework Core Projects:

Project	Release Link
delfin	delfin release v1.2.0
api	api release v1.0.0
controller	controller release v1.0.0
dock	dock release v1.2.0
multi-cloud	multicloud release v1.3.0

SODA Experience Projects

Project	Release Link
installer	installer release v1.3.0
dashboard	dashboard release v1.3.0

SODA Other Projects

Project	Release Link
orchestration	orchestration release v0.12.0
anomaly-detection	anomaly detection release v0.10.0
nbp	nbp release v1.3.0

How to use the Release:

Quick Start : https://docs.sodafoundation.io/soda-gettingstarted/quickstart/
Configuration & Installation: Follow these steps: https://docs.sodafoundation.io/soda-gettingstarted/installation-using-ansible/ ; Use the correct version tags for the commands and config files for the projects as per this release notes. (Example: git checkout v1.3.0)

SODA Documentation

docs.sodafoundation.io

Issues and Suggestions

Any SODA Release related issues/suggestions, please raise at https://github.com/sodafoundation/soda/issues

For all other issues/suggestions, please raise them to the respective project repositories.

v1.2.2 release

Version Summary

Version Number : v1.2.2 [tag: v1.2.2]
Version Name: Isabela Pre-Release
Date: 25-March-2021

Projects / Repos Included : delfin, api, controller, dock, nbp, multi-cloud, installer, dashboard, documentation, orchestration, anomaly-detection, examples

Release Summary :

SODA v1.2.2 Release is an incremental pre-release over Isabela pre- release (v1.2.01) of SODA Foundation.
The earlier stable release Hawaii, you can get here.

This is a pre-release for Isabela and for testing/demo only

Changelog

This changelog is based on SODA release Hawaii.

SODA releases will provide the key use cases, integrations and overall solution based on SODA projects. It will list all the respective project releases under the scope of each of the SODA releases. You can get a detailed feature list of specific projects from the respective project release pages.

Overall Features:

• Hybrid Data Archival /Retrieval:
  • Archival to Public Cloud (Azure, GCP)
  • SONY ODA Cold Storage support
• Automated Bucket Management for multicloud
• HA for multicloud services and DB
• Framework for NAS resources and Oceanstor support
• CLI and SMIS based storage backend aceess for Heterogeneous Storage
• Support new drivers: Dell EMC VNX and Dell EMC VPLEX
• Framework enhancement for periodic job scheduling and performance metrics collection
• Full Lifecycle with new CSI drivers
• Data Archival and NAS resources visualisation through SODA Dashboard

Delfin: SODA Infrastructure Management

- Framework enhancement to support CLI and SMIS based back end access methods
- Framework enhancement to support NAS resources (Filesystem, Qtree, Quota, and Share)
- Framework enhancement to support driver capability API
- Enhanced Oceanstor driver with NAS resource support
- Framework enhancement for performance job scheduler and metrics
- Support for Dell EMC VNX and VPLEX devices

Multi-Cloud

- Hybrid Data Archival / Retrieval:
        - On-Prem to Cloud Archival and retrieval support for Azure and GCP
        - On-premise data archival to SONY ODA from Hybrid Cloud 
- Automated Bucket Management for AWS, Azure, GCP and Huawei cloud
- HA support for multicloud services and DB

NBP CSI

Qualification of Full Lifecycle management with 5 CSI Drivers using CSI Plug N Play

SODA Experience & Quality

• Installer:
  Configurable HA for multi-cloud services and DB
• Documentation:
  update for CSI Plug N Play deployment with new drivers
• Dashboard :
  • CLI and SMI-S access methods for registering storage devices using Delfin
  • New resource types: Qtree, Filesystems and Shares display for NAS capable devices in Delfin
  • Updated the lifecycle CRUD UI. Changed to a sidebar panel from dialog boxes.
  • Added support for archive and retrieve objects for Azure and GCP cloud.
  • Added conditional display of resources based on storage device capability

SODA Projects/Repos part of this release:

Key projects part of this SODA Release
SODA Framework Core Projects:

Project	Release Link
delfin	delfin release v1.1.2
api	api release v1.0.0
controller	controller release v1.0.0
dock	dock release v1.2.0
multi-cloud	multicloud release v1.2.2

SODA Experience Projects

Project	Release Link
installer	installer release v1.2.2
dashboard	dashboard release v1.2.2

SODA Other Projects

Project	Release Link
orchestration	orchestration release v0.12.0
anomaly-detection	anomaly detection release v0.10.0
nbp	nbp release v1.2.1

How to use the Release:

Configuration & Installation: Follow these steps: https://docs.sodafoundation.io/soda-gettingstarted/installation-using-ansible/ ; Use the correct version tags for the commands and config files for the projects as per this release notes. (Example : git checkout v1.2.2)

SODA Documentation

docs.sodafoundation.io

Issues and Suggestions

Any SODA Release related issues/suggestions, please raise at https://github.com/sodafoundation/soda/issues

For all other issues/suggestions, please raise to the respective project repositories.

v1.2.1 release

Version Summary

Version Number : v1.2.1 [tag: v1.2.1]
Version Name: Isabela Pre-Release
Date: 16-March-2021

Projects / Repos Included : delfin, api, controller, dock, nbp, multi-cloud, installer, dashboard, documentation, orchestration, anomaly-detection, examples

Release Summary :

SODA v1.2.1 Release is an incremental release over Hawaii Release(v1.2.0) of SODA Foundation.
The earlier stable release Hawaii, you can get here.

This is a pre-release for Isabela and for testing/demo only

Changelog

This changelog is based on SODA release Hawaii.

SODA releases will provide the key use cases, integrations and overall solution based on SODA projects. It will list all the respective project releases under the scope of each of the SODA releases. You can get a detailed feature list of specific projects from the respective project release pages.

Overall Features:

• Hybrid Data Archival /Retrieval:
  • Archival to Public Cloud (Azure, GCP)
  • SONY ODA Cold Storage support
• Framework for NAS resources and Ocenastor support
  - CLI and SMIS based storage backend aceess for Heterogeneous Storage
• Full Lifecycle with new CSI drivers

Delfin: SODA Infrastructure Management

- Framework enhancement to support CLI and SMIS based back end access methods
- Framework enhancement to support NAS resources (Filesystem, Qtree, Quota, and Share)
- Framework enhancement to support driver capability API
- Enhanced Oceanstor driver with NAS resource support

Multi-Cloud

- Hybrid Data Archival / Retrieval:
        - On-Prem to Cloud Archival and retrieval support for Azure and GCP
        - On-premise data archival to SONY ODA from Hybrid Cloud 

NBP CSI

Qualification of Full Lifecycle management with 5 CSI Drivers using CSI Plug N Play

SODA Experience & Quality

- Documentation:
     update for CSI Plug N Play deployment with new drivers
- Dashboard :
   -  CLI and SMI-S access methods for registering storage devices using Delfin
   -  New resource types: Qtree, Filesystems and Shares display for NAS capable devices in Delfin 
   - Updated the lifecycle CRUD UI. Changed to a sidebar panel from dialog boxes.
   - Added support for archive and retrieve objects for Azure and GCP cloud.
   - Added conditional display of resources based on storage device capability

SODA Projects/Repos part of this release:

Key projects part of this SODA Release
SODA Framework Core Projects:

Project	Release Link
delfin	delfin release v1.1.1
api	api release v1.0.0
controller	controller release v1.0.0
dock	dock release v1.2.0
multi-cloud	multicloud release v1.2.1

SODA Experience Projects

Project	Release Link
installer	installer release v1.2.1
dashboard	dashboard release v1.2.1

SODA Other Projects

Project	Release Link
orchestration	orchestration release v0.12.0
anomaly-detection	anomaly detection release v0.10.0
nbp	nbp release v1.2.1

How to use the Release:

Configuration & Installation: Follow these steps: https://docs.sodafoundation.io/soda-gettingstarted/installation-using-ansible/ ; Use the correct version tags for the commands and config files for the projects as per this release notes. (Example : git checkout v1.2.1)

SODA Documentation

docs.sodafoundation.io

Issues and Suggestions

Any SODA Release related issues/suggestions, please raise at https://github.com/sodafoundation/soda/issues

For all other issues/suggestions, please raise to the respective project repositories.

SODA v1.2.0 Hawaii Release

Version Summary

Version Number : v1.2.0 [tag: v1.2.0]
Version Name: Hawaii
Date: 08-Jan-2020
Projects / Repos Included : delfin, api, controller, dock, nbp, multi-cloud, installer, dashboard, documentation, orchestration, anomaly-detection, examples

Release Summary :

SODA Hawaii Release is an incremental release on Greenland Release(v1.1.0) of SODA Foundation.
The earlier stable release Greenland, you can get here.

SODA Open Data Framework (ODF) Hawaii Release adds storage performance monitoring (SPM) with anomaly detection and visualization with Grafana integration. This release also adds enhanced multi-cloud file & block support, hybrid cloud data archival/restore, and support for more heterogeneous vendor storage systems. It provides integrated data management for Kubernetes, VMware, and more.
(Hawaii is known for its beauty and fertile soil. Hawaii is comprised of 130+ islands (ref: Wikipedia)).

Hawaii: Working with heterogeneous, and providing a unified solution!

Key Features:

• Heterogeneous SPM with Anomaly Detection
• SPM Visualization (Grafana integration)
• Resource Monitoring for Port, Controller, and Disk
• Enhanced Multi-cloud File & Block Store
• Hybrid Cloud Data Archival/Restore
• Data Replication & CSI Plug and play use cases
• More Storage Drivers

This release can be used for production integration trials. Please contact SODA Community for support

Changelog

This changelog is based on SODA release Greenland.

SODA releases will provide the key use cases, integrations, and overall solution based on SODA projects. It will list all the respective project releases under the scope of each of the SODA releases. You can get a detailed feature list of specific projects from the respective project release pages.

1. Overall Features:

   • Heterogeneous SPM (Storage Performance Monitoring) with Anomaly Detection
   • SPM Visualization (Grafana integration)
   • Resource Monitoring for Port, Controller, and Disk
   • Enhanced Multi-cloud:
     • Block(AWS, Huawei)
     • File(AWS, GCP, Azure, Huawei)
     • Hybrid Data Archival /Retrieval (Onprem-AWS)
   • Data Replication Use case PoC on NetApp
   • CSI Plug and Play - Ceph support added

2. Delfin: SODA Infrastructure Management

   • Storage Performance Monitoring Anomaly Detection (Delfin-Kafka-Tensorflow) - PoC [Please refer- Examples / Use case Demos below]
   • Storage Performance monitoring visualization (Grafana integrated)
   • Resource Monitoring for Port, Controller, and Disk
   • Alert exporter (Kafka)
   • Drivers :IBM Storwize/SVC | Hitachi VSP | EMC Unity
   • Code improvements and optimization

3. Multi-Cloud

   • Block:
     • EVS support for Huawei Cloud
     • Current Block support for AWS, Huawei tested
   • File:
     • EFS support for Huawei Cloud
     • Current File Support for AWS, GCP, Huawei, Azure
   • Object:
     • Support continued for AWS, GCP, Azure, Huawei, IBM, AliBaba, Ceph, YIG-Ceph
   • Validation for register cloud backend
   • Hybrid Data Archival / Retrieval:
     • On-Prem to Cloud Archival and retrieval support for AWS

4. SODA Drivers

   • S3 API compatibility for snapshot backup to Cloud
   • IBM Storwize/SVC | Hitachi VSP | EMC Unity for Delfin added

5. SODA Experience & Quality

   • Dashboard :
     • Performance metric collection and visualization(Grafana integrated) | support for fetching Delfin alerts from Alertmanager API | Data archival and retrieval support for multi-cloud | Huawei Cloud EVS and EFS support
   • Installer :
     • srm toolchain (Grafana, Prometheus) installation for Delfin performance metric visualization
   • QA:
     • Added more test cases.
     • Test cases are available here for reference and update

6. Examples / Use case Demos

   • Heterogeneous Storage Monitoring with Anomaly Detection - Delfin - Kafka - Tensorflow PoC
   • Data Replication PoC with NetApp
   • CSI Plug and Play PoC - Ceph support added

SODA Projects/Repos part of this release:

Key projects part of this SODA Release
SODA Framework Projects:

Project	Release Link
delfin	delfin release v1.1.0
api	api release v1.0.0
controller	controller release v1.0.0
dock	dock release v1.2.0
multi-cloud	multicloud release v1.2.0
nbp	nbp release v1.2.0

SODA Experience Projects

Project	Release Link
installer	installer release v1.2.0
dashboard	dashboard release v1.2.0

SODA Other Projects

Project	Release Link
orchestration	orchestration release v0.12.0
anomaly-detection	anomaly detection release v0.10.0

How to use the Release:

1. Quick installation from the release binaries: https://docs.sodafoundation.io/soda-gettingstarted/quickstart/

2. Configuration & Installation If you want more config control, you can follow these steps: https://docs.sodafoundation.io/soda-gettingstarted/installation-using-ansible/
   Use the correct version tags for the commands and config files for the projects as per this release notes. (Example: git checkout v1.2.0 for Hawaii Release)

SODA Documentation

docs.sodafoundation.io

Issues and Suggestions

Any SODA Release related issues/suggestions, please raise at https://github.com/sodafoundation/soda/issues

For all other issues/suggestions, please raise to the respective project repositories.