Releases: HERMES-SOC/sdc_aws_sorting_lambda
Releases · HERMES-SOC/sdc_aws_sorting_lambda
v0.2.0
v0.2.0 (2023-03-22)
This release includes improvements in preparation for the upcoming second dataflow test. Since the last release, the improvements are as follows:
- Added slack notification functionality to support sending slack messages to a slack channel for pipeline updates when provided the proper slack channel and token in the environmental variables.
Changelog
Full Changelog: v0.1.0...v0.2.0
v0.1.0
v0.1.0 (2022-10-05)
This release follows the HERMES Ground System data flow test that took place on 2022-09-28. This first release of the SDC AWS Sorting Lambda repo includes the following functionality
- First iteration of the sorting lambda function, written in Python.
- The sorting function sorts the files into the appropriate instrument bucket, and if it's a duplicate or invalid file sorts it into the unsorted bucket.
- CI/CD Pipeline that tests and lints the code before deploying the function on AWS.
- Logs object event to a timestream database.
- In this release there is a known duplication bug if syncing the entire folder instead copying the new files individually into the incoming bucket. This is because when you sync the same folder, because the files are removed from the incoming, the
sync
command believes the files are new causing a lot of duplicates to be created.