Improve experience of launching iOS tests on BrowserStack

[bartekpacia]

customer: @mateuszwojtczak

We want to add docs for getting Patrol tests to run on BrowserStack, similar to the docs we already have for Firebase Test Lab. This issue mainly concerns iOS, since Android is easier to get started with and the same as Firebase Test Lab.

Notes:

• Official tutorial by BrowserStack

• We have to use these endpoints:

  • https://api-cloud.browserstack.com/app-automate/xcuitest/v2/app
  • https://api-cloud.browserstack.com/app-automate/xcuitest/v2/test-suite

  In particular, we can't use this endpoint:

  • https://api-cloud.browserstack.com/app-automate/flutter-integration-tests/v2/ios/build
    Because it uses XCTest, but Patrol needs XCUITest.

• patrol build ios has to be modified to be able to output an .ipa – because BrowserStack wants an .ipa. Currently it only outputs two .apps (because Firebase Test Lab is okay with two .apps and an .xctestrun.

  $ patrol build ios -t integration_test/example_test.dart --release
  • Building app with entrypoint example_test.dart for iOS device (release)...
  ✓ Completed building app with entrypoint example_test.dart for iOS device (31.5s)
  build/ios_integ/Build/Products/Release-iphoneos/Runner.app (app under test)
  build/ios_integ/Build/Products/Release-iphoneos/RunnerUITests-Runner.app (test instrumentation app)
  build/ios_integ/Build/Products/Runner_iphoneos16.2-arm64.xctestrun (xctestrun file)

[bartekpacia]

Work is being done internally here.

When it's ready we'll update the docs to make it easy to run Patrol tests on BrowserStack for y'all.

[Naweap]

I'm looking forward to implement Patrol with BrowserStack in our testing solution! Any news on this ?

[bartekpacia]

Related: #1419

[bartekpacia]

This is done - see https://patrol.leancode.co/integrations/browserstack.

[Naweap]

@bartekpacia Thanks for the amazing work. Looking forward to get the same for iOS.

[datdang1995]

Hi @bartekpacia, I would like to ask if there's any plan on integrating Browserstack for iOS side as of this moment

[jozefvodicka]

Any update please?

[AnthonyDadeWT]

I am hoping for this to be fixed as well!

[fylyppo]

Hi all,
Basically iOS integration with BrowserStack works.
Firstly, you need to convert your scheme to use TestPlans via Xcode (Read more here).
Then, inside this thread and comment you can read more about integration and find bs_ios (it's not perfect, you may see "original_args[@]: unbound variable", then just put some character like: bs_ios a).

In the future, we should make this setup more convenient and support iOS officially but as of now you can try to use it like that.

[Dbis7]

@fylyppo Is there a guide on how to set up a scheme that uses Patrol in release mode with different flavors on Xcode?

[fylyppo]

@Dbis7 all needed info should be at iOS setup section at https://patrol.leancode.co/getting-started#integrate-with-native-side. Also, you can pass flavor argument to patrol build command.

[Dbis7]

@fylyppo I have already configured all, i only need help with TestPlans in xCode and with .ipa