Skip to content
Code Check with Gradle

Add basic visual regression tests #83

Sign in to view logs

Add basic visual regression tests

Add basic visual regression tests #83

GitHub Actions / JUnit Test Report failed Nov 19, 2024 in 0s

73 tests run, 71 passed, 0 skipped, 2 failed.

Annotations

Check failure on line 7 in .gradle/nodejs/node-v20.11.0-linux-x64/include/node/openssl/ts.h

See this annotation in the file changed.

@github-actions github-actions / JUnit Test Report

ts.renders 

basic.spec.ts:3:5 renders
Raw output 
[chromium] › basic.spec.ts:3:5 › renders ─────────────────────────────────────────────────────────

    Error: expect(page).toHaveScreenshot(expected)

      170 pixels (ratio 0.01 of all image pixels) are different.

    Expected: /home/runner/work/JCR-Hopper/JCR-Hopper/src/test/playwright/basic.spec.ts-snapshots/renders-1-chromium-linux.png
    Received: /home/runner/work/JCR-Hopper/JCR-Hopper/build/reports/playwright/basic-renders-chromium/renders-1-actual.png
        Diff: /home/runner/work/JCR-Hopper/JCR-Hopper/build/reports/playwright/basic-renders-chromium/renders-1-diff.png

    Call log:
      - expect.toHaveScreenshot with timeout 5000ms
        - verifying given screenshot expectation
      - taking page screenshot
        - disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - 170 pixels (ratio 0.01 of all image pixels) are different.
      - waiting 100ms before taking screenshot
      - taking page screenshot
        - disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - captured a stable screenshot
      - 170 pixels (ratio 0.01 of all image pixels) are different.


       5 |
       6 | 	await expect(page).toHaveTitle(/JCR Hopper Script Builder/);
    >  7 | 	await expect(page).toHaveScreenshot({ fullPage: true });
         | 	                   ^
       8 | });
       9 |
      10 | test('add step', async ({ page }) => {
        at /home/runner/work/JCR-Hopper/JCR-Hopper/src/test/playwright/basic.spec.ts:7:21

    attachment #1: renders-1-expected.png (image/png) ──────────────────────────────────────────────
    src/test/playwright/basic.spec.ts-snapshots/renders-1-chromium-linux.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #2: renders-1-actual.png (image/png) ────────────────────────────────────────────────
    build/reports/playwright/basic-renders-chromium/renders-1-actual.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #3: renders-1-diff.png (image/png) ──────────────────────────────────────────────────
    build/reports/playwright/basic-renders-chromium/renders-1-diff.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    Retry #1 ───────────────────────────────────────────────────────────────────────────────────────

    Error: expect(page).toHaveScreenshot(expected)

      170 pixels (ratio 0.01 of all image pixels) are different.

    Expected: /home/runner/work/JCR-Hopper/JCR-Hopper/src/test/playwright/basic.spec.ts-snapshots/renders-1-chromium-linux.png
    Received: /home/runner/work/JCR-Hopper/JCR-Hopper/build/reports/playwright/basic-renders-chromium-retry1/renders-1-actual.png
        Diff: /home/runner/work/JCR-Hopper/JCR-Hopper/build/reports/playwright/basic-renders-chromium-retry1/renders-1-diff.png

    Call log:
      - expect.toHaveScreenshot with timeout 5000ms
        - verifying given screenshot expectation
      - taking page screenshot
        - disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - 170 pixels (ratio 0.01 of all image pixels) are different.
      - waiting 100ms before taking screenshot
      - taking page screenshot
        - disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - captured a stable screenshot
      - 170 pixels (ratio 0.01 of all image pixels) are different.


       5 |
       6 | 	await expect(page).toHaveTitle(/JCR Hopper Script Builder/);
    >  7 | 	await expect(page).toHaveScreenshot({ fullPage: true });
         | 	                   ^
       8 | });
       9 |
      10 | test('add step', async ({ page }) => {
        at /home/runner/work/JCR-Hopper/JCR-Hopper/src/test/playwright/basic.spec.ts:7:21

    attachment #1: renders-1-expected.png (image/png) ──────────────────────────────────────────────
    src/test/playwright/basic.spec.ts-snapshots/renders-1-chromium-linux.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #2: renders-1-actual.png (image/png) ────────────────────────────────────────────────
    build/reports/playwright/basic-renders-chromium-retry1/renders-1-actual.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #3: renders-1-diff.png (image/png) ──────────────────────────────────────────────────
    build/reports/playwright/basic-renders-chromium-retry1/renders-1-diff.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #4: trace (application/zip) ─────────────────────────────────────────────────────────
    build/reports/playwright/basic-renders-chromium-retry1/trace.zip
    Usage:

        npx playwright show-trace build/reports/playwright/basic-renders-chromium-retry1/trace.zip

    ────────────────────────────────────────────────────────────────────────────────────────────────

    Retry #2 ───────────────────────────────────────────────────────────────────────────────────────

    Error: expect(page).toHaveScreenshot(expected)

      170 pixels (ratio 0.01 of all image pixels) are different.

    Expected: /home/runner/work/JCR-Hopper/JCR-Hopper/src/test/playwright/basic.spec.ts-snapshots/renders-1-chromium-linux.png
    Received: /home/runner/work/JCR-Hopper/JCR-Hopper/build/reports/playwright/basic-renders-chromium-retry2/renders-1-actual.png
        Diff: /home/runner/work/JCR-Hopper/JCR-Hopper/build/reports/playwright/basic-renders-chromium-retry2/renders-1-diff.png

    Call log:
      - expect.toHaveScreenshot with timeout 5000ms
        - verifying given screenshot expectation
      - taking page screenshot
        - disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - 170 pixels (ratio 0.01 of all image pixels) are different.
      - waiting 100ms before taking screenshot
      - taking page screenshot
        - disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - captured a stable screenshot
      - 170 pixels (ratio 0.01 of all image pixels) are different.


       5 |
       6 | 	await expect(page).toHaveTitle(/JCR Hopper Script Builder/);
    >  7 | 	await expect(page).toHaveScreenshot({ fullPage: true });
         | 	                   ^
       8 | });
       9 |
      10 | test('add step', async ({ page }) => {
        at /home/runner/work/JCR-Hopper/JCR-Hopper/src/test/playwright/basic.spec.ts:7:21

    attachment #1: renders-1-expected.png (image/png) ──────────────────────────────────────────────
    src/test/playwright/basic.spec.ts-snapshots/renders-1-chromium-linux.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #2: renders-1-actual.png (image/png) ────────────────────────────────────────────────
    build/reports/playwright/basic-renders-chromium-retry2/renders-1-actual.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #3: renders-1-diff.png (image/png) ──────────────────────────────────────────────────
    build/reports/playwright/basic-renders-chromium-retry2/renders-1-diff.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

Check failure on line 15 in .gradle/nodejs/node-v20.11.0-linux-x64/include/node/openssl/ts.h

See this annotation in the file changed.

@github-actions github-actions / JUnit Test Report

ts.add step 

basic.spec.ts:10:5 add step
Raw output 
[chromium] › basic.spec.ts:10:5 › add step ───────────────────────────────────────────────────────

    Error: expect(page).toHaveScreenshot(expected)

      175 pixels (ratio 0.01 of all image pixels) are different.

    Expected: /home/runner/work/JCR-Hopper/JCR-Hopper/src/test/playwright/basic.spec.ts-snapshots/add-step-1-chromium-linux.png
    Received: /home/runner/work/JCR-Hopper/JCR-Hopper/build/reports/playwright/basic-add-step-chromium/add-step-1-actual.png
        Diff: /home/runner/work/JCR-Hopper/JCR-Hopper/build/reports/playwright/basic-add-step-chromium/add-step-1-diff.png

    Call log:
      - expect.toHaveScreenshot with timeout 5000ms
        - verifying given screenshot expectation
      - taking page screenshot
        - disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - 466 pixels (ratio 0.01 of all image pixels) are different.
      - waiting 100ms before taking screenshot
      - taking page screenshot
        - disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - 288 pixels (ratio 0.01 of all image pixels) are different.
      - waiting 250ms before taking screenshot
      - taking page screenshot
        - disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - captured a stable screenshot
      - 175 pixels (ratio 0.01 of all image pixels) are different.


      13 | 	await page.getByRole('button', { name: 'Add', exact: true }).click();
      14 |
    > 15 | 	await expect(page).toHaveScreenshot();
         | 	                   ^
      16 | 	await page.getByRole('option', { name: 'Query JCR' }).click();
      17 | 	await page.getByLabel('Log Level: INFO').click();
      18 |   await page.getByRole('option', { name: 'TRACE' }).click();
        at /home/runner/work/JCR-Hopper/JCR-Hopper/src/test/playwright/basic.spec.ts:15:21

    attachment #1: add-step-1-expected.png (image/png) ─────────────────────────────────────────────
    src/test/playwright/basic.spec.ts-snapshots/add-step-1-chromium-linux.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #2: add-step-1-actual.png (image/png) ───────────────────────────────────────────────
    build/reports/playwright/basic-add-step-chromium/add-step-1-actual.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #3: add-step-1-diff.png (image/png) ─────────────────────────────────────────────────
    build/reports/playwright/basic-add-step-chromium/add-step-1-diff.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    Retry #1 ───────────────────────────────────────────────────────────────────────────────────────

    Error: expect(page).toHaveScreenshot(expected)

      175 pixels (ratio 0.01 of all image pixels) are different.

    Expected: /home/runner/work/JCR-Hopper/JCR-Hopper/src/test/playwright/basic.spec.ts-snapshots/add-step-1-chromium-linux.png
    Received: /home/runner/work/JCR-Hopper/JCR-Hopper/build/reports/playwright/basic-add-step-chromium-retry1/add-step-1-actual.png
        Diff: /home/runner/work/JCR-Hopper/JCR-Hopper/build/reports/playwright/basic-add-step-chromium-retry1/add-step-1-diff.png

    Call log:
      - expect.toHaveScreenshot with timeout 5000ms
        - verifying given screenshot expectation
      - taking page screenshot
        - disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - 466 pixels (ratio 0.01 of all image pixels) are different.
      - waiting 100ms before taking screenshot
      - taking page screenshot
        - disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - 288 pixels (ratio 0.01 of all image pixels) are different.
      - waiting 250ms before taking screenshot
      - taking page screenshot
        - disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - captured a stable screenshot
      - 175 pixels (ratio 0.01 of all image pixels) are different.


      13 | 	await page.getByRole('button', { name: 'Add', exact: true }).click();
      14 |
    > 15 | 	await expect(page).toHaveScreenshot();
         | 	                   ^
      16 | 	await page.getByRole('option', { name: 'Query JCR' }).click();
      17 | 	await page.getByLabel('Log Level: INFO').click();
      18 |   await page.getByRole('option', { name: 'TRACE' }).click();
        at /home/runner/work/JCR-Hopper/JCR-Hopper/src/test/playwright/basic.spec.ts:15:21

    attachment #1: add-step-1-expected.png (image/png) ─────────────────────────────────────────────
    src/test/playwright/basic.spec.ts-snapshots/add-step-1-chromium-linux.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #2: add-step-1-actual.png (image/png) ───────────────────────────────────────────────
    build/reports/playwright/basic-add-step-chromium-retry1/add-step-1-actual.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #3: add-step-1-diff.png (image/png) ─────────────────────────────────────────────────
    build/reports/playwright/basic-add-step-chromium-retry1/add-step-1-diff.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #4: trace (application/zip) ─────────────────────────────────────────────────────────
    build/reports/playwright/basic-add-step-chromium-retry1/trace.zip
    Usage:

        npx playwright show-trace build/reports/playwright/basic-add-step-chromium-retry1/trace.zip

    ────────────────────────────────────────────────────────────────────────────────────────────────

    Retry #2 ───────────────────────────────────────────────────────────────────────────────────────

    Error: expect(page).toHaveScreenshot(expected)

      175 pixels (ratio 0.01 of all image pixels) are different.

    Expected: /home/runner/work/JCR-Hopper/JCR-Hopper/src/test/playwright/basic.spec.ts-snapshots/add-step-1-chromium-linux.png
    Received: /home/runner/work/JCR-Hopper/JCR-Hopper/build/reports/playwright/basic-add-step-chromium-retry2/add-step-1-actual.png
        Diff: /home/runner/work/JCR-Hopper/JCR-Hopper/build/reports/playwright/basic-add-step-chromium-retry2/add-step-1-diff.png

    Call log:
      - expect.toHaveScreenshot with timeout 5000ms
        - verifying given screenshot expectation
      - taking page screenshot
        - disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - 466 pixels (ratio 0.01 of all image pixels) are different.
      - waiting 100ms before taking screenshot
      - taking page screenshot
        - disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - 288 pixels (ratio 0.01 of all image pixels) are different.
      - waiting 250ms before taking screenshot
      - taking page screenshot
        - disabled all CSS animations
      - waiting for fonts to load...
      - fonts loaded
      - captured a stable screenshot
      - 175 pixels (ratio 0.01 of all image pixels) are different.


      13 | 	await page.getByRole('button', { name: 'Add', exact: true }).click();
      14 |
    > 15 | 	await expect(page).toHaveScreenshot();
         | 	                   ^
      16 | 	await page.getByRole('option', { name: 'Query JCR' }).click();
      17 | 	await page.getByLabel('Log Level: INFO').click();
      18 |   await page.getByRole('option', { name: 'TRACE' }).click();
        at /home/runner/work/JCR-Hopper/JCR-Hopper/src/test/playwright/basic.spec.ts:15:21

    attachment #1: add-step-1-expected.png (image/png) ─────────────────────────────────────────────
    src/test/playwright/basic.spec.ts-snapshots/add-step-1-chromium-linux.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #2: add-step-1-actual.png (image/png) ───────────────────────────────────────────────
    build/reports/playwright/basic-add-step-chromium-retry2/add-step-1-actual.png
    ────────────────────────────────────────────────────────────────────────────────────────────────

    attachment #3: add-step-1-diff.png (image/png) ─────────────────────────────────────────────────
    build/reports/playwright/basic-add-step-chromium-retry2/add-step-1-diff.png
    ────────────────────────────────────────────────────────────────────────────────────────────────
View more details on GitHub Actions