Skip to content

Releases: redhat-best-practices-for-k8s/certsuite

v5.2.1

09 Jul 19:53
5c2738d
Compare
Choose a tag to compare

v5.2.1

This version of the certsuite introduces 4 new operator suite tests:

  • testOperatorPodsRunAsUserID(): This test verifies that no pods managed by operators run with the root user ID (UID) of 0, which could introduce security vulnerabilities.
  • testOperatorPodsRunAsNonRoot(): This test ensures that pods managed by operators adhere to security best practices by running as non-root users.
  • testOperatorPodsAutomountTokens(): This test evaluates the configuration of automount service tokens in pods managed by operators.
  • testOperatorContainersReadOnlyFilesystem(): This test verifies whether containers within pods managed by operators have a read-only root filesystem, enhancing security by preventing unauthorized modifications.

New Operator Tests

Improvements

Dependency Updates

  • Bump github/codeql-action from 3.25.10 to 3.25.11 by @dependabot in #2211
  • Bump ubi9/python-39 from 1-186 to 1-186.1719562233 in /.github/actions/documentation by @dependabot in #2217
  • Bump ubi9/ubi from 9.4-1123 to 9.4-1123.1719560047 by @dependabot in #2218
  • Bump docker/setup-qemu-action from 3.0.0 to 3.1.0 by @dependabot in #2221
  • Bump docker/build-push-action from 6.2.0 to 6.3.0 by @dependabot in #2220
  • Bump docker/setup-buildx-action from 3.3.0 to 3.4.0 by @dependabot in #2222
  • Bump actions/download-artifact from 4.1.7 to 4.1.8 by @dependabot in #2225
  • Bump actions/upload-artifact from 4.3.3 to 4.3.4 by @dependabot in #2226
  • Bump golang.org/x/term from 0.21.0 to 0.22.0 by @dependabot in #2224
  • Bump certifi from 2024.2.2 to 2024.7.4 in /.github/actions/documentation by @dependabot in #2227
  • Update Go to v1.22.5 by @sebrandon1 in #2229
  • Bump github.com/test-network-function/oct from 0.0.12 to 0.0.14 by @dependabot in #2232
  • Bump zipp from 3.18.1 to 3.19.1 in /.github/actions/documentation by @dependabot in #2234
  • Bump github.com/test-network-function/test-network-function-claim from 1.0.39 to 1.0.41 by @dependabot in #2233
  • Bump ubi9/python-39 from 1-186.1719562233 to 1-186.1720018722 in /.github/actions/documentation by @dependabot in #2230
  • Update GolangCI-lint to v1.59.1 by @sebrandon1 in #2216

Full Changelog: v5.2.0...v5.2.1

v5.2.0

28 Jun 16:35
f67a1c1
Compare
Choose a tag to compare

v5.2.0

With the v5.2.0 release of the test suite, we have done some underlying changes to the way the test suite is ran. Mainly, we have removed the bash scripts that were previously needed to kick things off. Now all you need to run the test suite is our new certsuite binary. We will also be publishing the binaries on release built for different architectures.

The documentation and the README have been updated with this new information as well.

Script Removal

CI Updates

  • workflows: add new workflow to upload release assets by @jmontesi in #2208
  • workflows: several fixes to upload release assets by @jmontesi in #2209

Dependency Updates

  • Bump github.com/test-network-function/privileged-daemonset from 1.0.26 to 1.0.27 by @dependabot in #2206

Full Changelog: v5.1.3...v5.2.0

v5.1.3

26 Jun 18:46
d6690e9
Compare
Choose a tag to compare

v5.1.3

Brings in a fix for the IsRedHatRelease test to allow for images that somehow show they are "Beta".

Improvements

Documentation Updates

  • docs: update to show how to run the test suite with the "certsuite" cmd by @jmontesi in #2174
  • docs: move and rename docs on how to run the Test Suite inside a cluster pod by @jmontesi in #2192

CI Updates

Dependency Updates

Github Actions Updates

  • Bump peter-evans/create-pull-request from 6.0.5 to 6.1.0 by @dependabot in #2177
  • Bump docker/build-push-action from 6.0.0 to 6.0.1 by @dependabot in #2178
  • Bump docker/build-push-action from 6.0.1 to 6.0.2 by @dependabot in #2182
  • Bump ludeeus/action-shellcheck from cd81f4475ab741e097ec0fe73b692f3e49d66b8c to 00b27aa7cb85167568cb48a3838b75f4265f2bca by @dependabot in #2183
  • Bump docker/build-push-action from 6.0.2 to 6.1.0 by @dependabot in #2188
  • Bump docker/build-push-action from 6.1.0 to 6.2.0 by @dependabot in #2201

Full Changelog: v5.1.2...v5.1.3

v5.1.2

18 Jun 15:42
4044829
Compare
Choose a tag to compare

v5.1.2

The most notable change to the certsuite functionality comes from #2145 where we changed the way we determine which operators to test in the operator suite. We changed it to only test operators that are listed in the TargetCrdFilters configuration variable instead of testing all operators on the cluster regardless if they were targeted for test or not.

Improvements

CI Updates

Doc Updates

  • Added Test Case Implementation subsection to docs site. by @greyerof in #2140

Operator Testing Script Updates

  • Use the certsuite command in "run-basic-batch-operators-test.sh" by @jmontesi in #2147

Dependency Updates

Go Mod Updates

Dockerfile Updates

  • Bump ubi9/ubi from 9.4-947.1716476138 to 9.4-947.1717074712 by @dependabot in #2137
  • Bump ubi9/ubi-minimal from 9.4-949.1716471857 to 9.4-949.1717074713 by @dependabot in #2138
  • Bump ubi9/python-39 from 1-182.1716478612 to 1-182.1717085980 in /.github/actions/documentation by @dependabot in #2136
  • Bump ubi9/python-39 from 1-182.1717085980 to 1-186 in /.github/actions/documentation by @dependabot in #2162
  • Bump ubi9/ubi-minimal from 9.4-949.1717074713 to 9.4-1134 by @dependabot in #2159
  • Bump ubi9/ubi from 9.4-947.1717074712 to 9.4-1123 by @dependabot in #2158

Github Action Updates

Full Changelog: v5.1.1...v5.1.2

v5.1.1

30 May 17:01
0e89077
Compare
Choose a tag to compare

v5.1.1

This release includes a number of improvements surrounding our CLI and how the test suite is ran.

There was a bug found in the RHCOS version compatibility test that was fixed in #2109 for OCP beta versions greater than 4.14.

Bug Fixes and Improvements

  • feat : Add a link back to the test case that mentioned security categories by @bnshr in #2075
  • Operators script: label pods under test after waiting for all pods to come up by @edcdavid in #2096
  • Bug fix: adjust OCP beta slice by @sebrandon1 in #2109
  • Batch operators test catalog source automation by @shirmoran in #2107
  • log: rename global log file by @jmontesi in #2116

CLI Improvements

CI Updates

Dependency Updates

  • build(deps): bump k8s.io/apiextensions-apiserver from 0.30.0 to 0.30.1 by @dependabot in #2072
  • build(deps): bump helm.sh/helm/v3 from 3.14.4 to 3.15.0 by @dependabot in #2077
  • build(deps): bump k8s.io/kubectl from 0.29.4 to 0.30.1 by @dependabot in #2071
  • Update operator-sdk to v1.34.2 by @sebrandon1 in #2083
  • Update preflight to v1.9.5 by @sebrandon1 in #2081
  • build(deps): bump actions/checkout from 4.1.5 to 4.1.6 by @dependabot in #2082
  • build(deps): bump ubi9/python-39 from 1-182.1714671018 to 1-182.1715774360 in /.github/actions/documentation by @dependabot in #2090
  • build(deps): bump github/codeql-action from 3.25.5 to 3.25.6 by @dependabot in #2089
  • build(deps): bump requests from 2.31.0 to 2.32.0 in /.github/actions/documentation by @dependabot in #2091
  • build(deps): bump github.com/go-logr/logr from 1.4.1 to 1.4.2 by @dependabot in #2093
  • Bump helm.sh/helm/v3 from 3.15.0 to 3.15.1 by @dependabot in #2099
  • Bump github.com/operator-framework/api from 0.24.0 to 0.25.0 by @dependabot in #2100
  • Bump github.com/hashicorp/go-version from 1.6.0 to 1.7.0 by @dependabot in #2102
  • Bump docker/login-action from 3.1.0 to 3.2.0 by @dependabot in #2110
  • Bump ubi9/python-39 from 1-182.1715774360 to 1-182.1716478612 in /.github/actions/documentation by @dependabot in #2108
  • Bump ubi9/ubi-minimal from 9.4-949.1714662671 to 9.4-949.1716471857 by @dependabot in #2113
  • Bump ubi9/ubi from 9.4-947.1714667021 to 9.4-947.1716476138 by @dependabot in #2114

Full Changelog: v5.1.0...v5.1.1

v5.1.0

15 May 16:30
995d946
Compare
Choose a tag to compare

v5.1.0

We have renamed the test suite from cnf-certification-test to Red Hat Best Practices Test Suite for Kubernetes.

Future Changes on the Roadmap:

  • Further releases in v5.1.x will include more tests in the operator test suite.
  • Modifications to how the test suite is ran/kicked off by removing the scripts and environment variables to provide a seamless way to run the binaries.
  • Since v5.0.8 we are now building arm64 images (see #1943), we have been experimenting with how to better test our new arm64 images on a fully arm enabled CI. This is an ongoing initiative that probably will not be completed until Github Actions allows for fully arm64 runners.

Test Suite Renaming

OSSF Additions

Various Updates

  • Group badges by @rdavid in #2029
  • Add README badges for QE OCP nightlies by @sebrandon1 in #2022
  • flags: add a new flag to provide a rhcos_version_map file by @jmontesi in #2047
  • Bug fix: avoid runtime panic (SIGSEGV) when using the list flag by @jmontesi in #2066
  • operatingsystem: embed rhcos_version_map file into the test suite binary by @jmontesi in #2052
  • scripts: use the test suite binary directly in "run-tnf-container.sh" by @jmontesi in #2033
  • style : Modify catalog generation to add 4 security contexts categories by @bnshr in #2044
  • main: simplify and move some functions to the certsuite and log packages by @jmontesi in #2060

CI Improvements

Dependency Updates

  • build(deps): bump actions/upload-artifact from 3.pre.node20 to 4.3.3 by @dependabot in #2016
  • build(deps): bump github/codeql-action from 3.24.9 to 3.25.3 by @dependabot in #2015
  • build(deps): bump actions/checkout from 4.1.1 to 4.1.4 by @dependabot in #2014
  • build(deps): bump ubi9/python-39 from 1-161 to 1-172.1712567222 in /.github/actions/documentation by @dependabot in #2013
  • build(deps): bump golangci/golangci-lint-action from 4 to 5 by @dependabot in #2008
  • Fix for missing frozen dependency by @edcdavid in #2020
  • build(deps): bump golangci/golangci-lint-action from 5.0.0 to 5.1.0 by @dependabot in #2021
  • build(deps): bump ubi9/python-39 from 1-172.1712567222 to 1-182 in /.github/actions/documentation by @dependabot in #2025
  • build(deps): bump ubi9/ubi from 9.3-1610 to 9.4-947 by @dependabot in #2026
  • Update machine-config-operator; update preflight to v1.9.2 by @sebrandon1 in #2024
  • build(deps): bump ubi9/ubi-minimal from 9.3-1612 to 9.4-949 by @dependabot in #2027
  • build(deps): bump actions/setup-go from 5.0.0 to 5.0.1 by @dependabot in #2030
  • build(deps): bump jinja2 from 3.1.3 to 3.1.4 in /.github/actions/documentation by @dependabot in #2041
  • build(deps): bump golangci/golangci-lint-action from 5.1.0 to 5.3.0 by @dependabot in #2038
  • build(deps): bump jinja2 from 3.1.3 to 3.1.4 in /.github/workflows by @dependabot in #2040
  • build(deps): bump ubi9/python-39 from 1-182 to 1-182.1714671018 in /.github/actions/documentation by @dependabot in #2037
  • build(deps): bump ubi9/ubi-minimal from 9.4-949 to 9.4-949.1714662671 by @dependabot in #2036
  • build(deps): bump ubi9/ubi from 9.4-947 to 9.4-947.1714667021 by @dependabot in #2035
  • build(deps): bump actions/checkout from 4.1.4 to 4.1.5 by @dependabot in #2046
  • build(deps): bump golangci/golangci-lint-action from 5.3.0 to 6.0.0 by @dependabot in #2045
  • build(deps): bump github/codeql-action from 3.25.3 to 3.25.4 by @dependabot in #2049
  • build(deps): bump golangci/golangci-lint-action from 6.0.0 to 6.0.1 by @dependabot in #2048
  • Update Go to v1.22.3 by @sebrandon1 in #2053
  • build(deps): bump github/codeql-action from 3.25.4 to 3.25.5 by @dependabot in #2061
  • build(deps): bump github.com/fatih/color from 1.16.0 to 1.17.0 by @dependabot in #2062
  • build(deps): bump ossf/scorecard-action from 2.3.1 to 2.3.3 by @dependabot in #2058
  • build(deps): bump golang.org/x/term from 0.19.0 to 0.20.0 by @dependabot in #2056
  • Update GolangCI-lint to v1.58.1 by @sebrandon1 in #2054
  • build(deps): bump github.com/operator-framework/api from 0.23.0 to 0.24.0 by @dependabot in #2057
  • Update preflight to v1.9.4 by @sebrandon1 in #2055

New Contributors

Full Changelog: v5.0.8...v5.1.0

v5.0.8

24 Apr 19:39
71b33d2
Compare
Choose a tag to compare

This release is a quick fix to update our affiliated-certification online/offline database of certified images.

Documentation Updates

Dependency Updates

CI Updates

Full Changelog: v5.0.7...v5.0.8

v5.0.7

18 Apr 21:23
6a869da
Compare
Choose a tag to compare

v5.0.7

This is the first release that has been QE tested against OCP 4.15 clusters with all tests passing. Prior to this we were only testing against 4.13 and 4.14 clusters.

New Tests

  • operator: add new test case operator-single-crd-owner by @jmontesi in #1951
  • feat : Operator CRD versioning by @bnshr in #1957

Note: We plan on making our v5.1.x minor release when all of our new operator tests are completed and added to the test suite.

Improvements

  • log: replace the pattern log.Error() + os.Exit(1) with log.Fatal() by @jmontesi in #1964
  • Fix for test case operator-install-status-no-privileges. by @greyerof in #1665
  • Operator script: Improved log output with limited information on command line and color coding. by @edcdavid in #1965
  • operator: delete very long debug log by @jmontesi in #1975
  • Add 4.15 and 4.16 to RHCOS versions script by @sebrandon1 in #1979
  • Add OCP 4.15 to lifecycle matrix by @sebrandon1 in #1984

Dependency Updates

  • Bump parser tag by @edcdavid in #1962
  • build(deps): bump peaceiris/actions-gh-pages from 3 to 4 by @dependabot in #1966
  • build(deps): bump github.com/k8snetworkplumbingwg/network-attachment-definition-client from 1.6.0 to 1.7.0 by @dependabot in #1971
  • build(deps): bump helm.sh/helm/v3 from 3.14.3 to 3.14.4 by @dependabot in #1972
  • Update Go to v1.22.2 by @sebrandon1 in #1973
  • build(deps): bump k8s.io/apiextensions-apiserver from 0.29.3 to 0.29.4 by @dependabot in #1985
  • build(deps): bump k8s.io/kubectl from 0.29.3 to 0.29.4 by @dependabot in #1988

Housekeeping

Full Changelog: v5.0.6...v5.0.7

v5.0.6

04 Apr 19:35
9b80b06
Compare
Choose a tag to compare

With v5.0.6 we are now building our released images in both arm64 and amd64 architectures.

Suite Improvements

  • feat : Check for semantic versioning of the installed application operators by @bnshr in #1920
  • feat : Operator CRD has OpenAPI spec by @bnshr in #1949
  • log: add fatal level by @jmontesi in #1958

Multi-Arch Images

Dependency Updates

  • build(deps): bump github.com/test-network-function/oct from 0.0.6 to 0.0.7 by @dependabot in #1941
  • build(deps): bump github.com/operator-framework/api from 0.22.0 to 0.23.0 by @dependabot in #1950
  • build(deps): bump golang.org/x/term from 0.18.0 to 0.19.0 by @dependabot in #1959

Documentation Updates

CI

Full Changelog: v5.0.5...v5.0.6

v5.0.5

21 Mar 15:59
09a4b5f
Compare
Choose a tag to compare

Improvements

Config Updates

Documentation Updates

  • Refactor Operator Requirement Doc Link by @bnshr in #1935

CI Updates

  • Changed alert msg to be sent to a slack webhook. by @greyerof in #1929

Dependency Updates

  • build(deps): bump github.com/test-network-function/privileged-daemonset from 1.0.21 to 1.0.22 by @dependabot in #1909
  • build(deps): bump github.com/test-network-function/test-network-function-claim from 1.0.35 to 1.0.36 by @dependabot in #1910
  • build(deps): bump github.com/mittwald/go-helm-client from 0.12.8 to 0.12.9 by @dependabot in #1917
  • Update operator-sdk to v1.34.1 by @sebrandon1 in #1915
  • build(deps): bump google.golang.org/protobuf from 1.32.0 to 1.33.0 by @dependabot in #1918
  • build(deps): bump helm.sh/helm/v3 from 3.14.2 to 3.14.3 by @dependabot in #1922
  • build(deps): bump k8s.io/apiextensions-apiserver from 0.29.2 to 0.29.3 by @dependabot in #1924
  • build(deps): bump k8s.io/kubectl from 0.29.2 to 0.29.3 by @dependabot in #1927
  • build(deps): bump github.com/docker/docker from 24.0.7+incompatible to 24.0.9+incompatible by @dependabot in #1934

Full Changelog: v5.0.4...v5.0.5