PMM Upgrade Matrix (e2e tests) #71
This run and associated checks have been archived and are scheduled for deletion.
Learn more about checks retention
pmm-upgrade-ui-tests-matrix.yml
on: schedule
Get versions
/
Get versions
2s
Matrix: Configuration / Settings
Matrix: RBAC / User Roles
Annotations
6 errors, 13 warnings, and 39 notices
[chromium] βΊ rbac/rbac.spec.ts:82:7 βΊ Spec file for Access Control (RBAC) βΊ PMM-T1580 Verify creating Access Role @rbac @rbac-pre-upgrade @rbac-post-upgrade:
pmm-ui-tests/playwright-tests/components/toast.ts#L34
1) [chromium] βΊ rbac/rbac.spec.ts:82:7 βΊ Spec file for Access Control (RBAC) βΊ PMM-T1580 Verify creating Access Role @rbac @rbac-pre-upgrade @rbac-post-upgrade
locator.waitFor: Error: strict mode violation: locator('xpath=//div[contains(@data-testid, "Alert") or contains(@aria-label, "Alert")]') resolved to 3 elements:
1) <div role="alert" class="css-14ka8ii" data-testid="daβ¦>β¦</div> aka getByRole('alert', { name: 'Templating [environment]' })
2) <div role="alert" class="css-14ka8ii" data-testid="daβ¦>β¦</div> aka getByRole('alert', { name: 'Templating [region]' })
3) <div role="alert" class="css-14ka8ii" data-testid="daβ¦>β¦</div> aka getByTestId('data-testid Alert success')
=========================== logs ===========================
waiting for locator('xpath=//div[contains(@data-testid, "Alert") or contains(@aria-label, "Alert")]') to be visible
============================================================
at ../components/toast.ts:34
32 | let selectedToast: Locator = this.selectToast(options?.variant);
33 |
> 34 | await selectedToast.waitFor({ state: 'visible', timeout: options?.timeout || 30000 });
| ^
35 | await expect(selectedToast).toHaveText(message, { timeout: options?.assertionTimeout || config.expect?.timeout });
36 | await this.closeButton(selectedToast).click();
37 | await selectedToast.waitFor({ state: 'detached' });
at Toast.checkToastMessage (/home/runner/work/pmm-ui-tests/pmm-ui-tests/pmm-ui-tests/playwright-tests/components/toast.ts:34:25)
at CreateRolePage.createNewRole (/home/runner/work/pmm-ui-tests/pmm-ui-tests/pmm-ui-tests/playwright-tests/tests/configuration/pages/CreateRole.page.ts:69:22)
at /home/runner/work/pmm-ui-tests/pmm-ui-tests/pmm-ui-tests/playwright-tests/tests/rbac/rbac.spec.ts:98:7
at /home/runner/work/pmm-ui-tests/pmm-ui-tests/pmm-ui-tests/playwright-tests/tests/rbac/rbac.spec.ts:97:5
|
RBAC / User Roles (2.35.0) / Docker way "2.35.0" -> "2.40.0"
Process completed with exit code 1.
|
[chromium] βΊ configuration/defaultSettings.spec.ts:23:7 βΊ Default Settings tests βΊ PMM-T1659 Verify that BM is enabled by default after upgrade in 2.36.0+ @config-post-upgrade @config:
pmm-ui-tests/playwright-tests/api/helpers/apiHelper.ts#L79
1) [chromium] βΊ configuration/defaultSettings.spec.ts:23:7 βΊ Default Settings tests βΊ PMM-T1659 Verify that BM is enabled by default after upgrade in 2.36.0+ @config-post-upgrade @config
Error: Status: 401 Unauthorized
Expected: 200
Received: 401
at ../api/helpers/apiHelper.ts:79
77 | console.log(`GET: ${path}${options ? ` with ${JSON.stringify(options)}` : ''}`);
78 | const response = await (await getConfiguredRestApi()).get(path, options);
> 79 | expect(response.status(), `Status: ${response.status()} ${response.statusText()}`).toEqual(200);
| ^
80 | return response;
81 | },
82 |
at Object.get (/home/runner/work/pmm-ui-tests/pmm-ui-tests/pmm-ui-tests/playwright-tests/api/helpers/apiHelper.ts:79:88)
at Object.getPmmVersion (/home/runner/work/pmm-ui-tests/pmm-ui-tests/pmm-ui-tests/playwright-tests/api/server.ts:12:22)
at /home/runner/work/pmm-ui-tests/pmm-ui-tests/pmm-ui-tests/playwright-tests/tests/configuration/defaultSettings.spec.ts:11:18
|
Configuration / Settings (2.34.0) / Docker way "2.34.0" -> "2.40.0"
Process completed with exit code 1.
|
[chromium] βΊ configuration/defaultSettings.spec.ts:23:7 βΊ Default Settings tests βΊ PMM-T1659 Verify that BM is enabled by default after upgrade in 2.36.0+ @config-post-upgrade @config:
pmm-ui-tests/playwright-tests/api/helpers/apiHelper.ts#L79
1) [chromium] βΊ configuration/defaultSettings.spec.ts:23:7 βΊ Default Settings tests βΊ PMM-T1659 Verify that BM is enabled by default after upgrade in 2.36.0+ @config-post-upgrade @config
Error: Status: 401 Unauthorized
Expected: 200
Received: 401
at ../api/helpers/apiHelper.ts:79
77 | console.log(`GET: ${path}${options ? ` with ${JSON.stringify(options)}` : ''}`);
78 | const response = await (await getConfiguredRestApi()).get(path, options);
> 79 | expect(response.status(), `Status: ${response.status()} ${response.statusText()}`).toEqual(200);
| ^
80 | return response;
81 | },
82 |
at Object.get (/home/runner/work/pmm-ui-tests/pmm-ui-tests/pmm-ui-tests/playwright-tests/api/helpers/apiHelper.ts:79:88)
at Object.getPmmVersion (/home/runner/work/pmm-ui-tests/pmm-ui-tests/pmm-ui-tests/playwright-tests/api/server.ts:12:22)
at /home/runner/work/pmm-ui-tests/pmm-ui-tests/pmm-ui-tests/playwright-tests/tests/configuration/defaultSettings.spec.ts:11:18
|
Configuration / Settings (2.33.0) / Docker way "2.33.0" -> "2.40.0"
Process completed with exit code 1.
|
Slow Test:
pmm-ui-tests/playwright-tests/[chromium] βΊ rbac/rbac.spec.ts#L1
pmm-ui-tests/playwright-tests/[chromium] βΊ rbac/rbac.spec.ts took 34.8s
|
Slow Test:
pmm-ui-tests/playwright-tests/[chromium] βΊ rbac/rbac.spec.ts#L1
pmm-ui-tests/playwright-tests/[chromium] βΊ rbac/rbac.spec.ts took 3.4m
|
Slow Test:
pmm-ui-tests/playwright-tests/[chromium] βΊ rbac/rbac.spec.ts#L1
pmm-ui-tests/playwright-tests/[chromium] βΊ rbac/rbac.spec.ts took 2.1m
|
Slow Test:
pmm-ui-tests/playwright-tests/[chromium] βΊ rbac/rbac.spec.ts#L1
pmm-ui-tests/playwright-tests/[chromium] βΊ rbac/rbac.spec.ts took 2.1m
|
Slow Test:
pmm-ui-tests/playwright-tests/[chromium] βΊ rbac/rbac.spec.ts#L1
pmm-ui-tests/playwright-tests/[chromium] βΊ rbac/rbac.spec.ts took 3.5m
|
Slow Test:
pmm-ui-tests/playwright-tests/[chromium] βΊ rbac/rbac.spec.ts#L1
pmm-ui-tests/playwright-tests/[chromium] βΊ rbac/rbac.spec.ts took 3.3m
|
Slow Test:
pmm-ui-tests/playwright-tests/[chromium] βΊ rbac/rbac.spec.ts#L1
pmm-ui-tests/playwright-tests/[chromium] βΊ rbac/rbac.spec.ts took 2.0m
|
Slow Test:
pmm-ui-tests/playwright-tests/[chromium] βΊ rbac/rbac.spec.ts#L1
pmm-ui-tests/playwright-tests/[chromium] βΊ rbac/rbac.spec.ts took 2.7m
|
Slow Test:
pmm-ui-tests/playwright-tests/[chromium] βΊ rbac/rbac.spec.ts#L1
pmm-ui-tests/playwright-tests/[chromium] βΊ rbac/rbac.spec.ts took 2.3m
|
Slow Test:
pmm-ui-tests/playwright-tests/[chromium] βΊ rbac/rbac.spec.ts#L1
pmm-ui-tests/playwright-tests/[chromium] βΊ rbac/rbac.spec.ts took 2.1m
|
Slow Test:
pmm-ui-tests/playwright-tests/[chromium] βΊ rbac/rbac.spec.ts#L1
pmm-ui-tests/playwright-tests/[chromium] βΊ rbac/rbac.spec.ts took 4.1m
|
Slow Test:
pmm-ui-tests/playwright-tests/[chromium] βΊ rbac/rbac.spec.ts#L1
pmm-ui-tests/playwright-tests/[chromium] βΊ rbac/rbac.spec.ts took 3.4m
|
Slow Test:
pmm-ui-tests/playwright-tests/[chromium] βΊ rbac/rbac.spec.ts#L1
pmm-ui-tests/playwright-tests/[chromium] βΊ rbac/rbac.spec.ts took 2.9m
|
π Playwright Run Summary
1 passed (1.2s)
|
π Playwright Run Summary
1 passed (1.1s)
|
π Playwright Run Summary
1 failed
[chromium] βΊ rbac/rbac.spec.ts:82:7 βΊ Spec file for Access Control (RBAC) βΊ PMM-T1580 Verify creating Access Role @rbac @rbac-pre-upgrade @rbac-post-upgrade
1 skipped
1 passed (38.5s)
|
π Playwright Run Summary
3 skipped
|
π Playwright Run Summary
7 skipped
|
π Playwright Run Summary
1 passed (1.3s)
|
π Playwright Run Summary
1 failed
[chromium] βΊ configuration/defaultSettings.spec.ts:23:7 βΊ Default Settings tests βΊ PMM-T1659 Verify that BM is enabled by default after upgrade in 2.36.0+ @config-post-upgrade @config
|
π Playwright Run Summary
7 skipped
|
π Playwright Run Summary
3 skipped
|
π Playwright Run Summary
1 passed (1.5s)
|
π Playwright Run Summary
1 passed (1.6s)
|
π Playwright Run Summary
1 skipped
|
π Playwright Run Summary
1 passed (1.8s)
|
π Playwright Run Summary
1 failed
[chromium] βΊ configuration/defaultSettings.spec.ts:23:7 βΊ Default Settings tests βΊ PMM-T1659 Verify that BM is enabled by default after upgrade in 2.36.0+ @config-post-upgrade @config
|
π Playwright Run Summary
1 passed (1.7s)
|
π Playwright Run Summary
1 passed (1.3s)
|
π Playwright Run Summary
1 skipped
|
π Playwright Run Summary
1 skipped
|
π Playwright Run Summary
1 passed (2.0s)
|
π Playwright Run Summary
1 skipped
|
π Playwright Run Summary
1 passed (1.4s)
|
π Playwright Run Summary
1 skipped
|
π Playwright Run Summary
1 passed (1.7s)
|
π Playwright Run Summary
3 skipped
|
π Playwright Run Summary
7 skipped
|
π Playwright Run Summary
1 skipped
|
π Playwright Run Summary
1 passed (1.8s)
|
π Playwright Run Summary
3 passed (3.4m)
|
π Playwright Run Summary
2 skipped
5 passed (2.2m)
|
π Playwright Run Summary
2 skipped
5 passed (2.2m)
|
π Playwright Run Summary
3 passed (3.5m)
|
π Playwright Run Summary
3 passed (3.3m)
|
π Playwright Run Summary
2 skipped
5 passed (2.0m)
|
π Playwright Run Summary
3 passed (2.7m)
|
π Playwright Run Summary
2 skipped
5 passed (2.3m)
|
π Playwright Run Summary
2 skipped
5 passed (2.2m)
|
π Playwright Run Summary
3 passed (4.1m)
|
π Playwright Run Summary
3 passed (3.4m)
|
π Playwright Run Summary
2 skipped
5 passed (2.9m)
|
Artifacts
Produced during runtime
Name | Size | |
---|---|---|
config-2.33.0-report
Expired
|
1.15 MB |
|
config-2.34.0-report
Expired
|
1.15 MB |
|
rbac-2.35.0-report
Expired
|
2.92 MB |
|