Create android config in patrol android_test_backend #2293
Merged
GitHub Actions / Patrol tests on iPhone 14
failed
Aug 6, 2024 in 0s
Xcode test results
Test Runner
Summary
| Total |  Passed |  Failed |  Skipped |  Expected Failure | ⏱️ Time |
|---|---|---|---|---|---|
| 31 | 19 | 10 | 2 | 0 | 14.37s |
Test Summary
RunnerUITests
- Device: iPhone 14, 18.0 (22A5316j)
- SDK: Simulator - iOS 17.5, 17.5
| Test | Total | | | |
|
|---|---|---|---|---|---|
 RunnerUITests | 31 | 19 | 10 | 2 | 0 |
Failures
RunnerUITests/RunnerUITests/define_test check dart-define-from-file
| File | /Users/runner/work/patrol/patrol/dev/e2e_app/ios/RunnerUITests/RunnerUITests.m:5 |
| Issue Type | Assertion Failure |
| Message | ((passed) is true) failed - ══╡ EXCEPTION CAUGHT BY FLUTTER TEST FRAMEWORK ╞═════════════════
The following TestFailure was thrown running a test:
Expected: exactly one matching candidate
Actual: PatrolFinder:
Which: means none were found but one was expected
When the exception was thrown, this was the stack: This was caught by the test expectation on the following line: |
RunnerUITests/RunnerUITests/external_link_test Open external url
| File | /Users/runner/work/patrol/patrol/dev/e2e_app/ios/RunnerUITests/RunnerUITests.m:5 |
| Issue Type | Assertion Failure |
| Message | ((passed) is true) failed - ══╡ EXCEPTION CAUGHT BY FLUTTER TEST FRAMEWORK ╞═════════════════
The following PatrolActionException was thrown running a test:
Patrol action failed: NativeAutomatorClientException:
waitUntilVisible() failed with Invalid response: 400 The
operation couldn�t be completed. (patrol.PatrolError error 0.)
When the exception was thrown, this was the stack: The test description was: |
RunnerUITests/RunnerUITests/permissions.notifications_test taps on notification
| File | /Users/runner/work/patrol/patrol/dev/e2e_app/ios/RunnerUITests/RunnerUITests.m:5 |
| Issue Type | Assertion Failure |
| Message | ((passed) is true) failed - ══╡ EXCEPTION CAUGHT BY FLUTTER TEST FRAMEWORK ╞═════════════════
The following PatrolActionException was thrown running a test:
Patrol action failed: NativeAutomatorClientException:
tapOnNotificationBySelector() failed with Invalid response: 400
The operation couldn�t be completed. (patrol.PatrolError error
0.)
When the exception was thrown, this was the stack: The test description was: |
RunnerUITests/RunnerUITests/permissions.notifications_test taps on notification native2
| File | /Users/runner/work/patrol/patrol/dev/e2e_app/ios/RunnerUITests/RunnerUITests.m:5 |
| Issue Type | Assertion Failure |
| Message | ((passed) is true) failed - ══╡ EXCEPTION CAUGHT BY FLUTTER TEST FRAMEWORK ╞═════════════════
The following PatrolActionException was thrown running a test:
Patrol action failed: NativeAutomatorClientException:
tapOnNotificationBySelector() failed with Invalid response: 400
The operation couldn�t be completed. (patrol.PatrolError error
0.)
When the exception was thrown, this was the stack: The test description was: |
RunnerUITests/RunnerUITests/permissions.permissions_location_test accepts location permission
| File | /Users/runner/work/patrol/patrol/dev/e2e_app/ios/RunnerUITests/RunnerUITests.m:5 |
| Issue Type | Assertion Failure |
| Message | Failed to get matching snapshots: Lost connection to the application (pid 13134). (Underlying Error: Couldn’t communicate with a helper application. Try your operation again. If that fails, quit and relaunch the application and try again. The connection to service created from an endpoint was invalidated: failed to check-in, peer may have been unloaded: mach_error=10000003.) |
| File | /Users/runner/work/patrol/patrol/dev/e2e_app/ios/RunnerUITests/RunnerUITests.m:5 |
| Issue Type | Assertion Failure |
| Message | Failed to get matching snapshots: Lost connection to the application (pid 13134). (Underlying Error: Couldn’t communicate with a helper application. Try your operation again. If that fails, quit and relaunch the application and try again. The connection to service created from an endpoint was invalidated: failed to check-in, peer may have been unloaded: mach_error=10000003.) |
| File | /Users/runner/work/patrol/patrol/dev/e2e_app/ios/RunnerUITests/RunnerUITests.m:5 |
| Issue Type | Assertion Failure |
| Message | Failed to get matching snapshots: Lost connection to the application (pid 13134). (Underlying Error: Couldn’t communicate with a helper application. Try your operation again. If that fails, quit and relaunch the application and try again. The connection to service created from an endpoint was invalidated: failed to check-in, peer may have been unloaded: mach_error=10000003.) |
| File | /Users/runner/work/patrol/patrol/dev/e2e_app/ios/RunnerUITests/RunnerUITests.m:5 |
| Issue Type | Assertion Failure |
| Message | Failed to get matching snapshots: Lost connection to the application (pid 13134). (Underlying Error: Couldn’t communicate with a helper application. Try your operation again. If that fails, quit and relaunch the application and try again. The connection to service created from an endpoint was invalidated: failed to check-in, peer may have been unloaded: mach_error=10000003.) |
| File | /Users/runner/work/patrol/patrol/dev/e2e_app/ios/RunnerUITests/RunnerUITests.m:5 |
| Issue Type | Assertion Failure |
| Message | Failed to get matching snapshots: Lost connection to the application (pid 13134). (Underlying Error: Couldn’t communicate with a helper application. Try your operation again. If that fails, quit and relaunch the application and try again. The connection to service created from an endpoint was invalidated: failed to check-in, peer may have been unloaded: mach_error=10000003.) |
RunnerUITests/RunnerUITests/permissions.permissions_location_test accepts location permission native2
| File | /Users/runner/work/patrol/patrol/dev/e2e_app/ios/RunnerUITests/RunnerUITests.m:5 |
| Issue Type | Assertion Failure |
| Message | ((passed) is true) failed - ══╡ EXCEPTION CAUGHT BY FLUTTER TEST FRAMEWORK ╞═════════════════
The following WaitUntilVisibleTimeoutException was thrown running
a test:
TimeoutException after 0:00:10.000000: Finder "Found 0 widgets
with text containing RegExp: pattern=lat flags=: []" did not find
any visible (i.e. hit-testable) widgets
When the exception was thrown, this was the stack: The test description was: |
RunnerUITests/RunnerUITests/permissions.permissions_many_test grants various permissions
| File | /Users/runner/work/patrol/patrol/dev/e2e_app/ios/RunnerUITests/RunnerUITests.m:5 |
| Issue Type | Assertion Failure |
| Message | ((passed) is true) failed - ══╡ EXCEPTION CAUGHT BY FLUTTER TEST FRAMEWORK ╞═════════════════
The following TestFailure was thrown running a test:
Expected: 'Granted'
Actual: 'Not granted'
Which: is different.
Expected: Granted
Actual: Not grante ...
^
Differ at offset 0
When the exception was thrown, this was the stack: This was caught by the test expectation on the following line: |
RunnerUITests/RunnerUITests/service_dark_mode_test disables and enables dark mode twice
| File | /Users/runner/work/patrol/patrol/dev/e2e_app/ios/RunnerUITests/RunnerUITests.m:5 |
| Issue Type | Assertion Failure |
| Message | Failed to tap "Developer" Any: No matches found for first query match sequence: `Descendants matching type Any` -> `Elements matching predicate '"Developer" IN identifiers'`, given input App element pid: 15358 |
| File | /Users/runner/work/patrol/patrol/dev/e2e_app/ios/RunnerUITests/RunnerUITests.m:5 |
| Issue Type | Assertion Failure |
| Message | Failed to get matching snapshot: No matches found for first query match sequence: `Descendants matching type Any` -> `Elements matching predicate '"Dark Appearance" IN identifiers'`, given input App element pid: 15358 |
| File | |
| Issue Type | Assertion Failure |
| Message | Failed to tap "Developer" Any: No matches found for first query match sequence: `Descendants matching type Any` -> `Elements matching predicate '"Developer" IN identifiers'`, given input App element pid: 15373 |
| File | |
| Issue Type | Assertion Failure |
| Message | Failed to get matching snapshot: No matches found for first query match sequence: `Descendants matching type Any` -> `Elements matching predicate '"Dark Appearance" IN identifiers'`, given input App element pid: 15373 |
| File | |
| Issue Type | Assertion Failure |
| Message | Failed to tap "Developer" Any: Application com.apple.Preferences is not running |
| File | |
| Issue Type | Assertion Failure |
| Message | Failed to get matching snapshot: Application com.apple.Preferences is not running |
RunnerUITests/RunnerUITests/swipe_test scrolls the Settings app
| File | |
| Issue Type | Assertion Failure |
| Message | Failed to tap "Developer" Any: No matches found for first query match sequence: `Descendants matching type Any` -> `Elements matching predicate '"Developer" IN identifiers'`, given input App element pid: 15663 |
| File | |
| Issue Type | Assertion Failure |
| Message | Failed to get matching snapshot: No matches found for first query match sequence: `Descendants matching type Any` -> `Elements matching predicate '"Dark Appearance" IN identifiers'`, given input App element pid: 15663 |
| File | |
| Issue Type | Assertion Failure |
| Message | Failed to terminate com.apple.Preferences:15663: Failed to terminate com.apple.Preferences:0 |
RunnerUITests/RunnerUITests/tap_at_test taps at the lower middle of the screen in the Settings app
| File | /Users/runner/work/patrol/patrol/dev/e2e_app/ios/RunnerUITests/RunnerUITests.m:5 |
| Issue Type | Assertion Failure |
| Message | Failed to get matching snapshot: Lost connection to the application (pid 15663). (Underlying Error: Couldn’t communicate with a helper application. Try your operation again. If that fails, quit and relaunch the application and try again. The connection to service created from an endpoint was invalidated: failed to check-in, peer may have been unloaded: mach_error=10000003.) |
Details
Test Details
RunnerUITests
RunnerUITests
| | | | ⏱️ |
|---|---|---|---|---|
| 19 (61%) | 10 (32%) | 2 (6%) | 0 (0%) | 14.37s |
|  deep_link_test Open url in the appActivities:
|
| define_test check dart-define-from-file Activities:
|
| example_test counter state is the same after going to Home and switching appsActivities:
|
| example_test short test with tagActivities:
|
| example_test short test with two tagsActivities:
|
| external_link_test Open external urlActivities:
|
| internal.group_test at the beginningActivities:
|
| internal.group_test top level group in file alpha firstActivities:
|
| internal.group_test top level group in file alpha secondActivities:
|
| internal.group_test top level group in file bravo firstActivities:
|
| internal.group_test top level group in file bravo secondActivities:
|
| internal.group_test top level group in file in the middleActivities:
|
| internal.long_name_test aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaActivities:
|
| internal.long_name_test alphaalphaalphaalphaalphaalphaalphaalphaalphaalphaalphaalphaalphaalphaalphaalphaalphaalphaalphaalphaalphaalphaalphaalphaalphaalphaalphaalphaalphaalphaalphaalphaalphaaActivities:
|
| internal.long_name_test kocykkocykkocykkocykkocykkocykkocykkocykkocykkocykkocykkocykkocykkocykkocykkocykkocykkocykkocykkocykkocykkocykkocykkocykkocykkocykkocykkocykkocykkocykkocykkocykkocykkActivities:
|
| macos.macos_app_test taps aroundActivities:
|
| macos.macos_app_test taps around test to skipActivities:
|
| open_app_test open browserActivities:
|
| open_app_test open mapsActivities:
|
| open_app_test same open maps test that should be skippedActivities:
|
| open_quick_settings_test opens quick settingsActivities:
|
| permissions.deny_many_permissions_twice_test denies various permissionsActivities:
|
| permissions.notifications_test taps on notificationActivities:
|
| permissions.notifications_test taps on notification native2Activities:
|
| permissions.permissions_location_test accepts location permissionActivities:
|
| permissions.permissions_location_test accepts location permission native2Activities:
|
| permissions.permissions_many_test grants various permissionsActivities:
|
| service_dark_mode_test disables and enables dark mode twiceActivities:
|
| swipe_test scrolls the Settings appActivities:
|
| tap_at_test taps at the lower middle of the screen in the Settings appActivities:
|
| volume_test change volumeActivities:
|
Annotations
github-actions / Patrol tests on iPhone 14
Assertion Failure
((passed) is true) failed - ══╡ EXCEPTION CAUGHT BY FLUTTER TEST FRAMEWORK ╞═════════════════
The following TestFailure was thrown running a test:
Expected: exactly one matching candidate
Actual: PatrolFinder:<Found 0 widgets with text "FIRST_KEY:
First key from defines_1.json": []>
Which: means none were found but one was expected
When the exception was thrown, this was the stack:
#4 main.<anonymous closure> (file:///Users/runner/work/patrol/patrol/dev/e2e_app/integration_test/define_test.dart:12:5)
<asynchronous suspension>
#5 patrolTest.<anonymous closure> (package:patrol/src/common.dart:135:7)
<asynchronous suspension>
#6 testWidgets.<anonymous closure>.<anonymous closure> (package:flutter_test/src/widget_tester.dart:183:15)
<asynchronous suspension>
#7 TestWidgetsFlutterBinding._runTestBody (package:flutter_test/src/binding.dart:1017:5)
<asynchronous suspension>
#8 TestWidgetsFlutterBinding._createTestCompletionHandler.<anonymous closure> (package:flutter_test/src/binding.dart:809:12)
<asynchronous suspension>
This was caught by the test expectation on the following line:
file:///Users/runner/work/patrol/patrol/dev/e2e_app/integration_test/define_test.dart line 12
The test description was:
check dart-define-from-file
═════════════════════════════════════════════════════════════════
github-actions / Patrol tests on iPhone 14
Assertion Failure
((passed) is true) failed - ══╡ EXCEPTION CAUGHT BY FLUTTER TEST FRAMEWORK ╞═════════════════
The following PatrolActionException was thrown running a test:
Patrol action failed: NativeAutomatorClientException:
waitUntilVisible() failed with Invalid response: 400 The
operation couldnât be completed. (patrol.PatrolError error 0.)
When the exception was thrown, this was the stack:
#0 NativeAutomator._wrapRequest (package:patrol/src/native/native_automator.dart:226:7)
<asynchronous suspension>
#1 NativeAutomator.waitUntilVisible (package:patrol/src/native/native_automator.dart:768:5)
<asynchronous suspension>
#2 main.<anonymous closure> (file:///Users/runner/work/patrol/patrol/dev/e2e_app/integration_test/external_link_test.dart:27:5)
<asynchronous suspension>
#3 patrolTest.<anonymous closure> (package:patrol/src/common.dart:135:7)
<asynchronous suspension>
#4 testWidgets.<anonymous closure>.<anonymous closure> (package:flutter_test/src/widget_tester.dart:183:15)
<asynchronous suspension>
#5 TestWidgetsFlutterBinding._runTestBody (package:flutter_test/src/binding.dart:1017:5)
<asynchronous suspension>
#6 TestWidgetsFlutterBinding._createTestCompletionHandler.<anonymous closure> (package:flutter_test/src/binding.dart:809:12)
<asynchronous suspension>
The test description was:
Open external url
═════════════════════════════════════════════════════════════════
github-actions / Patrol tests on iPhone 14
Assertion Failure
((passed) is true) failed - ══╡ EXCEPTION CAUGHT BY FLUTTER TEST FRAMEWORK ╞═════════════════
The following PatrolActionException was thrown running a test:
Patrol action failed: NativeAutomatorClientException:
tapOnNotificationBySelector() failed with Invalid response: 400
The operation couldnât be completed. (patrol.PatrolError error
0.)
When the exception was thrown, this was the stack:
#0 NativeAutomator._wrapRequest (package:patrol/src/native/native_automator.dart:226:7)
<asynchronous suspension>
#1 NativeAutomator.tapOnNotificationBySelector (package:patrol/src/native/native_automator.dart:452:5)
<asynchronous suspension>
#2 main.<anonymous closure> (file:///Users/runner/work/patrol/patrol/dev/e2e_app/integration_test/permissions/notifications_test.dart:36:7)
<asynchronous suspension>
#3 patrolTest.<anonymous closure> (package:patrol/src/common.dart:135:7)
<asynchronous suspension>
#4 testWidgets.<anonymous closure>.<anonymous closure> (package:flutter_test/src/widget_tester.dart:183:15)
<asynchronous suspension>
#5 TestWidgetsFlutterBinding._runTestBody (package:flutter_test/src/binding.dart:1017:5)
<asynchronous suspension>
#6 TestWidgetsFlutterBinding._createTestCompletionHandler.<anonymous closure> (package:flutter_test/src/binding.dart:809:12)
<asynchronous suspension>
The test description was:
taps on notification
═════════════════════════════════════════════════════════════════
github-actions / Patrol tests on iPhone 14
Assertion Failure
((passed) is true) failed - ══╡ EXCEPTION CAUGHT BY FLUTTER TEST FRAMEWORK ╞═════════════════
The following PatrolActionException was thrown running a test:
Patrol action failed: NativeAutomatorClientException:
tapOnNotificationBySelector() failed with Invalid response: 400
The operation couldnât be completed. (patrol.PatrolError error
0.)
When the exception was thrown, this was the stack:
#0 NativeAutomator2._wrapRequest (package:patrol/src/native/native_automator2.dart:109:7)
<asynchronous suspension>
#1 NativeAutomator2.tapOnNotificationBySelector (package:patrol/src/native/native_automator2.dart:335:5)
<asynchronous suspension>
#2 main.<anonymous closure> (file:///Users/runner/work/patrol/patrol/dev/e2e_app/integration_test/permissions/notifications_test.dart:81:7)
<asynchronous suspension>
#3 patrolTest.<anonymous closure> (package:patrol/src/common.dart:135:7)
<asynchronous suspension>
#4 testWidgets.<anonymous closure>.<anonymous closure> (package:flutter_test/src/widget_tester.dart:183:15)
<asynchronous suspension>
#5 TestWidgetsFlutterBinding._runTestBody (package:flutter_test/src/binding.dart:1017:5)
<asynchronous suspension>
#6 TestWidgetsFlutterBinding._createTestCompletionHandler.<anonymous closure> (package:flutter_test/src/binding.dart:809:12)
<asynchronous suspension>
The test description was:
taps on notification native2
═════════════════════════════════════════════════════════════════
github-actions / Patrol tests on iPhone 14
Assertion Failure
Failed to get matching snapshots: Lost connection to the application (pid 13134). (Underlying Error: Couldn’t communicate with a helper application. Try your operation again. If that fails, quit and relaunch the application and try again. The connection to service created from an endpoint was invalidated: failed to check-in, peer may have been unloaded: mach_error=10000003.)
github-actions / Patrol tests on iPhone 14
Assertion Failure
Failed to get matching snapshots: Lost connection to the application (pid 13134). (Underlying Error: Couldn’t communicate with a helper application. Try your operation again. If that fails, quit and relaunch the application and try again. The connection to service created from an endpoint was invalidated: failed to check-in, peer may have been unloaded: mach_error=10000003.)
github-actions / Patrol tests on iPhone 14
Assertion Failure
Failed to get matching snapshots: Lost connection to the application (pid 13134). (Underlying Error: Couldn’t communicate with a helper application. Try your operation again. If that fails, quit and relaunch the application and try again. The connection to service created from an endpoint was invalidated: failed to check-in, peer may have been unloaded: mach_error=10000003.)
github-actions / Patrol tests on iPhone 14
Assertion Failure
Failed to get matching snapshots: Lost connection to the application (pid 13134). (Underlying Error: Couldn’t communicate with a helper application. Try your operation again. If that fails, quit and relaunch the application and try again. The connection to service created from an endpoint was invalidated: failed to check-in, peer may have been unloaded: mach_error=10000003.)
github-actions / Patrol tests on iPhone 14
Assertion Failure
Failed to get matching snapshots: Lost connection to the application (pid 13134). (Underlying Error: Couldn’t communicate with a helper application. Try your operation again. If that fails, quit and relaunch the application and try again. The connection to service created from an endpoint was invalidated: failed to check-in, peer may have been unloaded: mach_error=10000003.)
github-actions / Patrol tests on iPhone 14
Assertion Failure
((passed) is true) failed - ══╡ EXCEPTION CAUGHT BY FLUTTER TEST FRAMEWORK ╞═════════════════
The following WaitUntilVisibleTimeoutException was thrown running
a test:
TimeoutException after 0:00:10.000000: Finder "Found 0 widgets
with text containing RegExp: pattern=lat flags=: []" did not find
any visible (i.e. hit-testable) widgets
When the exception was thrown, this was the stack:
#0 PatrolTester.waitUntilVisible.<anonymous closure> (package:patrol_finders/src/custom_finders/patrol_tester.dart:405:11)
<asynchronous suspension>
#1 TestAsyncUtils.guard.<anonymous closure> (package:flutter_test/src/test_async_utils.dart:117:7)
<asynchronous suspension>
#2 main.<anonymous closure> (file:///Users/runner/work/patrol/patrol/dev/e2e_app/integration_test/permissions/permissions_location_test.dart:94:12)
<asynchronous suspension>
#3 patrolTest.<anonymous closure> (package:patrol/src/common.dart:135:7)
<asynchronous suspension>
#4 testWidgets.<anonymous closure>.<anonymous closure> (package:flutter_test/src/widget_tester.dart:183:15)
<asynchronous suspension>
#5 TestWidgetsFlutterBinding._runTestBody (package:flutter_test/src/binding.dart:1017:5)
<asynchronous suspension>
#6 TestWidgetsFlutterBinding._createTestCompletionHandler.<anonymous closure> (package:flutter_test/src/binding.dart:809:12)
<asynchronous suspension>
The test description was:
accepts location permission native2
═════════════════════════════════════════════════════════════════
github-actions / Patrol tests on iPhone 14
Assertion Failure
((passed) is true) failed - ══╡ EXCEPTION CAUGHT BY FLUTTER TEST FRAMEWORK ╞═════════════════
The following TestFailure was thrown running a test:
Expected: 'Granted'
Actual: 'Not granted'
Which: is different.
Expected: Granted
Actual: Not grante ...
^
Differ at offset 0
When the exception was thrown, this was the stack:
#4 _requestAndGrantCameraPermission (file:///Users/runner/work/patrol/patrol/dev/e2e_app/integration_test/permissions/permissions_many_test.dart:29:3)
<asynchronous suspension>
#5 main.<anonymous closure> (file:///Users/runner/work/patrol/patrol/dev/e2e_app/integration_test/permissions/permissions_many_test.dart:13:5)
<asynchronous suspension>
#6 patrolTest.<anonymous closure> (package:patrol/src/common.dart:135:7)
<asynchronous suspension>
#7 testWidgets.<anonymous closure>.<anonymous closure> (package:flutter_test/src/widget_tester.dart:183:15)
<asynchronous suspension>
#8 TestWidgetsFlutterBinding._runTestBody (package:flutter_test/src/binding.dart:1017:5)
<asynchronous suspension>
#9 TestWidgetsFlutterBinding._createTestCompletionHandler.<anonymous closure> (package:flutter_test/src/binding.dart:809:12)
<asynchronous suspension>
This was caught by the test expectation on the following line:
file:///Users/runner/work/patrol/patrol/dev/e2e_app/integration_test/permissions/permissions_many_test.dart line 29
The test description was:
grants various permissions
═════════════════════════════════════════════════════════════════
github-actions / Patrol tests on iPhone 14
Assertion Failure
Failed to tap "Developer" Any: No matches found for first query match sequence: `Descendants matching type Any` -> `Elements matching predicate '"Developer" IN identifiers'`, given input App element pid: 15358
github-actions / Patrol tests on iPhone 14
Assertion Failure
Failed to get matching snapshot: No matches found for first query match sequence: `Descendants matching type Any` -> `Elements matching predicate '"Dark Appearance" IN identifiers'`, given input App element pid: 15358
github-actions / Patrol tests on iPhone 14
Assertion Failure
Failed to get matching snapshot: Lost connection to the application (pid 15663). (Underlying Error: Couldn’t communicate with a helper application. Try your operation again. If that fails, quit and relaunch the application and try again. The connection to service created from an endpoint was invalidated: failed to check-in, peer may have been unloaded: mach_error=10000003.)
Loading