Functional Tests

feature/TASK-2024-00351 : update side-bar #4

Triggered via pull request June 12, 2024 09:05

manan-redsoft

synchronize #1

feature/TASK-2024-00351

Status Failure

Total duration 33m 46s

Artifacts –

functional-tests.yml

on: pull_request

Matrix: functional-tests

Annotations

12 errors, 4 warnings, and 1 notice

[chromium] › functional/detailed/login.test.ts:41:1 › forgot password process is working properly: frontend/tests/functional/detailed/login.test.ts#L68

1) [chromium] › functional/detailed/login.test.ts:41:1 › forgot password process is working properly Error: Timed out 10000ms waiting for expect(locator).toHaveURL(expected) Locator: locator(':root') Expected pattern: /.*\/analytics/ Received string: "http://localhost:4173/bird-eye" Call log: - expect.toHaveURL with timeout 10000ms - waiting for locator(':root') - locator resolved to <html lang="en">…</html> - unexpected value "http://localhost:4173/login" - locator resolved to <html lang="en">…</html> - unexpected value "http://localhost:4173/login" - locator resolved to <html lang="en">…</html> - unexpected value "http://localhost:4173/login" - locator resolved to <html lang="en">…</html> - unexpected value "http://localhost:4173/login" - locator resolved to <html lang="en">…</html> - unexpected value "http://localhost:4173/login" - locator resolved to <html lang="en">…</html> - unexpected value "http://localhost:4173/bird-eye" - locator resolved to <html lang="en">…</html> - unexpected value "http://localhost:4173/bird-eye" - locator resolved to <html lang="en">…</html> - unexpected value "http://localhost:4173/bird-eye" - locator resolved to <html lang="en">…</html> - unexpected value "http://localhost:4173/bird-eye" - locator resolved to <html lang="en">…</html> - unexpected value "http://localhost:4173/bird-eye" - locator resolved to <html lang="en">…</html> - unexpected value "http://localhost:4173/bird-eye" - locator resolved to <html lang="en">…</html> - unexpected value "http://localhost:4173/bird-eye" - locator resolved to <html lang="en">…</html> - unexpected value "http://localhost:4173/bird-eye" - locator resolved to <html lang="en">…</html> - unexpected value "http://localhost:4173/bird-eye" 66 | 67 | await logedPage.login(email, testData.user.password); > 68 | await expect(page).toHaveURL(/.*\/analytics/); | ^ 69 | 70 | await sideBar.logout(); 71 | at /home/runner/work/quant_assure/quant_assure/frontend/tests/functional/detailed/login.test.ts:68:21

[chromium] › functional/detailed/login.test.ts:41:1 › forgot password process is working properly: frontend/tests/functional/detailed/login.test.ts#L68

1) [chromium] › functional/detailed/login.test.ts:41:1 › forgot password process is working properly Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Timed out 10000ms waiting for expect(locator).toHaveURL(expected) Locator: locator(':root') Expected pattern: /.*\/analytics/ Received string: "http://localhost:4173/bird-eye" Call log: - expect.toHaveURL with timeout 10000ms - waiting for locator(':root') - locator resolved to <html lang="en">…</html> - unexpected value "http://localhost:4173/login" - locator resolved to <html lang="en">…</html> - unexpected value "http://localhost:4173/login" - locator resolved to <html lang="en">…</html> - unexpected value "http://localhost:4173/login" - locator resolved to <html lang="en">…</html> - unexpected value "http://localhost:4173/login" - locator resolved to <html lang="en">…</html> - unexpected value "http://localhost:4173/login" - locator resolved to <html lang="en">…</html> - unexpected value "http://localhost:4173/bird-eye" - locator resolved to <html lang="en">…</html> - unexpected value "http://localhost:4173/bird-eye" - locator resolved to <html lang="en">…</html> - unexpected value "http://localhost:4173/bird-eye" - locator resolved to <html lang="en">…</html> - unexpected value "http://localhost:4173/bird-eye" - locator resolved to <html lang="en">…</html> - unexpected value "http://localhost:4173/bird-eye" - locator resolved to <html lang="en">…</html> - unexpected value "http://localhost:4173/bird-eye" - locator resolved to <html lang="en">…</html> - unexpected value "http://localhost:4173/bird-eye" - locator resolved to <html lang="en">…</html> - unexpected value "http://localhost:4173/bird-eye" - locator resolved to <html lang="en">…</html> - unexpected value "http://localhost:4173/bird-eye" 66 | 67 | await logedPage.login(email, testData.user.password); > 68 | await expect(page).toHaveURL(/.*\/analytics/); | ^ 69 | 70 | await sideBar.logout(); 71 | at /home/runner/work/quant_assure/quant_assure/frontend/tests/functional/detailed/login.test.ts:68:21

[chromium] › functional/nav.test.ts:5:1 › sidebar navigation tests: frontend/tests/utils/base-page.ts#L24

2) [chromium] › functional/nav.test.ts:5:1 › sidebar navigation tests ──────────────────────────── Error: Timed out 10000ms waiting for expect(locator).toHaveText(expected) Locator: locator('#page-title') Expected string: "BirdEye" Received string: "Bird Eye" Call log: - expect.soft.toHaveText with timeout 10000ms - waiting for locator('#page-title') - locator resolved to Bird Eye - unexpected value "Bird Eye" - locator resolved to Bird Eye - unexpected value "Bird Eye" - locator resolved to Bird Eye - unexpected value "Bird Eye" - locator resolved to Bird Eye - unexpected value "Bird Eye" - locator resolved to Bird Eye - unexpected value "Bird Eye" - locator resolved to Bird Eye - unexpected value "Bird Eye" - locator resolved to Bird Eye - unexpected value "Bird Eye" - locator resolved to Bird Eye - unexpected value "Bird Eye" - locator resolved to Bird Eye - unexpected value "Bird Eye" - locator resolved to Bird Eye - unexpected value "Bird Eye" - locator resolved to Bird Eye - unexpected value "Bird Eye" - locator resolved to Bird Eye - unexpected value "Bird Eye" - locator resolved to Bird Eye - unexpected value "Bird Eye" - locator resolved to Bird Eye - unexpected value "Bird Eye" at utils/base-page.ts:24 22 | 23 | async hasTitle(title: string | RegExp = this.name) { > 24 | await expect.soft(this.pageTitle).toHaveText(title); | ^ 25 | } 26 | 27 | async hasUrl() { at BirdEyePage.hasTitle (/home/runner/work/quant_assure/quant_assure/frontend/tests/utils/base-page.ts:24:37) at /home/runner/work/quant_assure/quant_assure/frontend/tests/functional/nav.test.ts:10:21 at /home/runner/work/quant_assure/quant_assure/frontend/tests/functional/nav.test.ts:8:2

[chromium] › functional/nav.test.ts:5:1 › sidebar navigation tests: frontend/tests/utils/sidebar.ts#L52

2) [chromium] › functional/nav.test.ts:5:1 › sidebar navigation tests ──────────────────────────── Error: locator.isVisible: Error: strict mode violation: getByTestId('accordion-item-applied-controls') resolved to 2 elements: 1) <a href="/applied-controls" data-testid="accordion-…>…</a> aka getByRole('link', { name: ' Applied controls' }) 2) <a href="/applied-controls" data-testid="accordion-…>…</a> aka getByRole('link', { name: ' Mapped Controls' }) Call log: - checking visibility of getByTestId('accordion-item-applied-controls') at utils/sidebar.ts:52 50 | 51 | async click(parent: string, tab: string, waitForURL = true) { > 52 | if (!(await this.page.getByTestId('accordion-item-' + tab.substring(1)).isVisible())) { | ^ 53 | await this.page.locator('#' + parent.toLowerCase().replace(' ', '-')).click(); 54 | } 55 | await expect(this.page.getByTestId('accordion-item-' + tab.substring(1))).toBeVisible(); at SideBar.click (/home/runner/work/quant_assure/quant_assure/frontend/tests/utils/sidebar.ts:52:75) at /home/runner/work/quant_assure/quant_assure/frontend/tests/functional/nav.test.ts:19:20 at /home/runner/work/quant_assure/quant_assure/frontend/tests/functional/nav.test.ts:14:2

[chromium] › functional/nav.test.ts:5:1 › sidebar navigation tests: frontend/tests/utils/base-page.ts#L24

2) [chromium] › functional/nav.test.ts:5:1 › sidebar navigation tests ──────────────────────────── Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Timed out 10000ms waiting for expect(locator).toHaveText(expected) Locator: locator('#page-title') Expected string: "BirdEye" Received string: "Bird Eye" Call log: - expect.soft.toHaveText with timeout 10000ms - waiting for locator('#page-title') - locator resolved to Bird Eye - unexpected value "Bird Eye" - locator resolved to Bird Eye - unexpected value "Bird Eye" - locator resolved to Bird Eye - unexpected value "Bird Eye" - locator resolved to Bird Eye - unexpected value "Bird Eye" - locator resolved to Bird Eye - unexpected value "Bird Eye" - locator resolved to Bird Eye - unexpected value "Bird Eye" - locator resolved to Bird Eye - unexpected value "Bird Eye" - locator resolved to Bird Eye - unexpected value "Bird Eye" - locator resolved to Bird Eye - unexpected value "Bird Eye" - locator resolved to Bird Eye - unexpected value "Bird Eye" - locator resolved to Bird Eye - unexpected value "Bird Eye" - locator resolved to Bird Eye - unexpected value "Bird Eye" - locator resolved to Bird Eye - unexpected value "Bird Eye" - locator resolved to Bird Eye - unexpected value "Bird Eye" at utils/base-page.ts:24 22 | 23 | async hasTitle(title: string | RegExp = this.name) { > 24 | await expect.soft(this.pageTitle).toHaveText(title); | ^ 25 | } 26 | 27 | async hasUrl() { at BirdEyePage.hasTitle (/home/runner/work/quant_assure/quant_assure/frontend/tests/utils/base-page.ts:24:37) at /home/runner/work/quant_assure/quant_assure/frontend/tests/functional/nav.test.ts:10:21 at /home/runner/work/quant_assure/quant_assure/frontend/tests/functional/nav.test.ts:8:2

[chromium] › functional/nav.test.ts:5:1 › sidebar navigation tests: frontend/tests/utils/sidebar.ts#L52

2) [chromium] › functional/nav.test.ts:5:1 › sidebar navigation tests ──────────────────────────── Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: locator.isVisible: Error: strict mode violation: getByTestId('accordion-item-applied-controls') resolved to 2 elements: 1) <a href="/applied-controls" data-testid="accordion-…>…</a> aka getByRole('link', { name: ' Applied controls' }) 2) <a href="/applied-controls" data-testid="accordion-…>…</a> aka getByRole('link', { name: ' Mapped Controls' }) Call log: - checking visibility of getByTestId('accordion-item-applied-controls') at utils/sidebar.ts:52 50 | 51 | async click(parent: string, tab: string, waitForURL = true) { > 52 | if (!(await this.page.getByTestId('accordion-item-' + tab.substring(1)).isVisible())) { | ^ 53 | await this.page.locator('#' + parent.toLowerCase().replace(' ', '-')).click(); 54 | } 55 | await expect(this.page.getByTestId('accordion-item-' + tab.substring(1))).toBeVisible(); at SideBar.click (/home/runner/work/quant_assure/quant_assure/frontend/tests/utils/sidebar.ts:52:75) at /home/runner/work/quant_assure/quant_assure/frontend/tests/functional/nav.test.ts:19:20 at /home/runner/work/quant_assure/quant_assure/frontend/tests/functional/nav.test.ts:14:2

[chromium] › functional/startup.test.ts:3:1 › startup tests: frontend/tests/utils/base-page.ts#L24

3) [chromium] › functional/startup.test.ts:3:1 › startup tests › proper redirection to the analytics page after login Error: Timed out 10000ms waiting for expect(locator).toHaveText(expected) Locator: locator('#page-title') Expected string: "BirdEye" Received string: "Bird Eye" Call log: - expect.soft.toHaveText with timeout 10000ms - waiting for locator('#page-title') - locator resolved to Bird Eye - unexpected value "Bird Eye" - locator resolved to Bird Eye - unexpected value "Bird Eye" - locator resolved to Bird Eye - unexpected value "Bird Eye" - locator resolved to Bird Eye - unexpected value "Bird Eye" - locator resolved to Bird Eye - unexpected value "Bird Eye" - locator resolved to Bird Eye - unexpected value "Bird Eye" - locator resolved to Bird Eye - unexpected value "Bird Eye" - locator resolved to Bird Eye - unexpected value "Bird Eye" - locator resolved to Bird Eye - unexpected value "Bird Eye" - locator resolved to Bird Eye - unexpected value "Bird Eye" - locator resolved to Bird Eye - unexpected value "Bird Eye" - locator resolved to Bird Eye - unexpected value "Bird Eye" - locator resolved to Bird Eye - unexpected value "Bird Eye" - locator resolved to Bird Eye - unexpected value "Bird Eye" at utils/base-page.ts:24 22 | 23 | async hasTitle(title: string | RegExp = this.name) { > 24 | await expect.soft(this.pageTitle).toHaveText(title); | ^ 25 | } 26 | 27 | async hasUrl() { at BirdEyePage.hasTitle (/home/runner/work/quant_assure/quant_assure/frontend/tests/utils/base-page.ts:24:37) at /home/runner/work/quant_assure/quant_assure/frontend/tests/functional/startup.test.ts:13:21 at /home/runner/work/quant_assure/quant_assure/frontend/tests/functional/startup.test.ts:11:2

[chromium] › functional/startup.test.ts:3:1 › startup tests: frontend/tests/utils/base-page.ts#L24

3) [chromium] › functional/startup.test.ts:3:1 › startup tests › proper redirection to the analytics page after login Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Timed out 10000ms waiting for expect(locator).toHaveText(expected) Locator: locator('#page-title') Expected string: "BirdEye" Received string: "Bird Eye" Call log: - expect.soft.toHaveText with timeout 10000ms - waiting for locator('#page-title') - locator resolved to Bird Eye - unexpected value "Bird Eye" - locator resolved to Bird Eye - unexpected value "Bird Eye" - locator resolved to Bird Eye - unexpected value "Bird Eye" - locator resolved to Bird Eye - unexpected value "Bird Eye" - locator resolved to Bird Eye - unexpected value "Bird Eye" - locator resolved to Bird Eye - unexpected value "Bird Eye" - locator resolved to Bird Eye - unexpected value "Bird Eye" - locator resolved to Bird Eye - unexpected value "Bird Eye" - locator resolved to Bird Eye - unexpected value "Bird Eye" - locator resolved to Bird Eye - unexpected value "Bird Eye" - locator resolved to Bird Eye - unexpected value "Bird Eye" - locator resolved to Bird Eye - unexpected value "Bird Eye" - locator resolved to Bird Eye - unexpected value "Bird Eye" - locator resolved to Bird Eye - unexpected value "Bird Eye" at utils/base-page.ts:24 22 | 23 | async hasTitle(title: string | RegExp = this.name) { > 24 | await expect.soft(this.pageTitle).toHaveText(title); | ^ 25 | } 26 | 27 | async hasUrl() { at BirdEyePage.hasTitle (/home/runner/work/quant_assure/quant_assure/frontend/tests/utils/base-page.ts:24:37) at /home/runner/work/quant_assure/quant_assure/frontend/tests/functional/startup.test.ts:13:21 at /home/runner/work/quant_assure/quant_assure/frontend/tests/functional/startup.test.ts:11:2

[chromium] › functional/user-permissions.test.ts:28:3 › Analyst user has the right permissions › user can set his password: frontend/tests/utils/base-page.ts#L61

4) [chromium] › functional/user-permissions.test.ts:28:3 › Analyst user has the right permissions › user can set his password Error: Timed out 10000ms waiting for expect(locator).toBeVisible() Locator: getByTestId('toast').filter({ hasText: /Your password has been successfully set. Welcome to CISO Assistant!/ }) Expected: visible Received: hidden Call log: - expect.toBeVisible with timeout 10000ms - waiting for getByTestId('toast').filter({ hasText: /Your password has been successfully set. Welcome to CISO Assistant!/ }) at utils/base-page.ts:61 59 | async isToastVisible(value: string, flags?: string | undefined, options?: {} | undefined) { 60 | const toast = this.page.getByTestId('toast').filter({ hasText: new RegExp(value, flags) }); > 61 | await expect(toast).toBeVisible(options); | ^ 62 | await toast.getByLabel('Dismiss toast').click(); 63 | await expect(toast).toBeHidden(); 64 | return toast; at LoginPage.isToastVisible (/home/runner/work/quant_assure/quant_assure/frontend/tests/utils/base-page.ts:61:23) at /home/runner/work/quant_assure/quant_assure/frontend/tests/functional/user-permissions.test.ts:71:23

[chromium] › functional/user-permissions.test.ts:28:3 › Analyst user has the right permissions › user can set his password: frontend/tests/utils/base-page.ts#L61

4) [chromium] › functional/user-permissions.test.ts:28:3 › Analyst user has the right permissions › user can set his password Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Timed out 10000ms waiting for expect(locator).toBeVisible() Locator: getByTestId('toast').filter({ hasText: /Your password has been successfully set. Welcome to CISO Assistant!/ }) Expected: visible Received: hidden Call log: - expect.toBeVisible with timeout 10000ms - waiting for getByTestId('toast').filter({ hasText: /Your password has been successfully set. Welcome to CISO Assistant!/ }) at utils/base-page.ts:61 59 | async isToastVisible(value: string, flags?: string | undefined, options?: {} | undefined) { 60 | const toast = this.page.getByTestId('toast').filter({ hasText: new RegExp(value, flags) }); > 61 | await expect(toast).toBeVisible(options); | ^ 62 | await toast.getByLabel('Dismiss toast').click(); 63 | await expect(toast).toBeHidden(); 64 | return toast; at LoginPage.isToastVisible (/home/runner/work/quant_assure/quant_assure/frontend/tests/utils/base-page.ts:61:23) at /home/runner/work/quant_assure/quant_assure/frontend/tests/functional/user-permissions.test.ts:71:23

functional-tests (3.11, firefox)

The job was canceled because "_3_11_chromium" failed.

functional-tests (3.11, firefox)

The operation was canceled.

functional-tests (3.11, chromium)

Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/setup-python@v4. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.

Slow Test: frontend/[chromium] › functional/detailed/common.test.ts#L1

frontend/[chromium] › functional/detailed/common.test.ts took 3.1m

functional-tests (3.11, chromium)

No files were found with the provided path: ./frontend/tests/chromiumresults/ ./frontend/tests/chromiumreports/. No artifacts will be uploaded.

functional-tests (3.11, firefox)

No files were found with the provided path: ./frontend/tests/firefoxresults/ ./frontend/tests/firefoxreports/. No artifacts will be uploaded.

🎭 Playwright Run Summary

8 failed [chromium] › functional/detailed/login.test.ts:41:1 › forgot password process is working properly [chromium] › functional/nav.test.ts:5:1 › sidebar navigation tests ───────────────────────────── [chromium] › functional/startup.test.ts:3:1 › startup tests ──────────────────────────────────── [chromium] › functional/user-permissions.test.ts:28:3 › Analyst user has the right permissions › user can set his password [chromium] › functional/user-permissions.test.ts:28:3 › Reader user has the right permissions › user can set his password [chromium] › functional/user-permissions.test.ts:28:3 › Domain manager user has the right permissions › user can set his password [chromium] › functional/user-permissions.test.ts:28:3 › Approver user has the right permissions › user can set his password [chromium] › functional/user-route.test.ts:6:1 › user usual routine actions are working correctly 1 flaky [chromium] › functional/detailed/libraries.test.ts:5:1 › every library can be loaded ─────────── 194 skipped 28 passed (30.5m)

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

feature/TASK-2024-00351 : update side-bar #4

Summary