Skip to content

Commit

Permalink
Refactor MTE-1595 [v119] Cleanup Debug Code from Firebase Perfherder …
Browse files Browse the repository at this point in the history
…Ingest Work (#16551)

* remove perfherder ingest debug code

* enable tab perf tests

* change firebase perf testing device

* retrigger github checks
  • Loading branch information
jjSDET authored Sep 25, 2023
1 parent 8289fb4 commit 9cc413d
Show file tree
Hide file tree
Showing 2 changed files with 6 additions and 30 deletions.
2 changes: 0 additions & 2 deletions Tests/PerformanceTestPlan.xctestplan
Original file line number Diff line number Diff line change
Expand Up @@ -53,8 +53,6 @@
"NoImageTests",
"OnboardingTests",
"OpeningScreenTests",
"PerformanceTests\/testPerfTabs_3_20tabTray()",
"PerformanceTests\/testPerfTabs_4_1280tabTray()",
"PhotonActionSheetTest",
"PocketTest",
"PrivateBrowsingTest",
Expand Down
34 changes: 6 additions & 28 deletions bitrise.yml
Original file line number Diff line number Diff line change
Expand Up @@ -1494,7 +1494,6 @@ workflows:
-sdk iphoneos \
-destination "generic/platform=iOS" \
-derivedDataPath "/Users/vagrant/git/DerivedData"
- deploy-to-bitrise-io@2: {}
- [email protected]:
title: Create .zip artifact for Firebase Testing
inputs:
Expand All @@ -1507,7 +1506,6 @@ workflows:
cd DerivedData/Build/Products
zip -r Fennec_Enterprise.zip Fennec_Enterprise-iphoneos Fennec_Enterprise_PerformanceTestPlan_iphoneos16.4-arm64.xctestrun
mv Fennec_Enterprise.zip /Users/vagrant/git/Fennec_Enterprise.zip
- deploy-to-bitrise-io@2: {}
- [email protected]:
inputs:
- cache_paths: "$HOME/google-cloud-sdk"
Expand Down Expand Up @@ -1540,8 +1538,8 @@ workflows:
TIMESTAMP=$(date "+%Y%m%d%H%M%S")
RESULTS_DIR="firefox_ios_performance_tests_$TIMESTAMP"
GOOGLE_CLOUD_BUCKET="firefox_ios_test_artifacts"
DEVICE_MODEL="iphone14pro"
DEVICE_VERSION="16.6"
DEVICE_MODEL="iphone13pro"
DEVICE_VERSION="15.7"
XCRESULT_PATH="gs://$GOOGLE_CLOUD_BUCKET/$RESULTS_DIR/$DEVICE_MODEL-$DEVICE_VERSION-en-portrait/TestLogs/"
curl -o /tmp/key-file.json $BITRISEIO_GOOGLE_APPLICATION_CREDENTIALS_URL
Expand All @@ -1557,22 +1555,8 @@ workflows:
--results-bucket="$GOOGLE_CLOUD_BUCKET" \
--results-dir="$RESULTS_DIR")
echo "Your FIREBASE_TEST_RESULT:\n$FIREBASE_TEST_RESULT"
# the following code is temporary and only here to verify scope within bitrise
# it will be handled entirely in the next step and removed after testing
echo $XCRESULT_PATH
$HOME/google-cloud-sdk/bin/gsutil ls $XCRESULT_PATH
$HOME/google-cloud-sdk/bin/gsutil ls $XCRESULT_PATH | grep ".xcresult"
FIREBASE_XCRESULT_PATH=$($HOME/google-cloud-sdk/bin/gsutil ls $XCRESULT_PATH | grep ".xcresult")
echo $FIREBASE_XCRESULT_PATH
envman add --key FIREBASE_XCRESULT_PATH --value "$FIREBASE_XCRESULT_PATH"
mkdir firebase_xcresult
$HOME/google-cloud-sdk/bin/gsutil -m cp -r $FIREBASE_XCRESULT_PATH ./firebase_xcresult
ls -R ./firebase_xcresult
mv ./firebase_xcresult/*.xcresult ./firebase_xcresult/Test-Fennec_Enterprise.xcresult
ls ./firebase_xcresult
ls -R ./firebase_xcresult
- [email protected]:
is_always_run: true
title: Create Perfherder Data Object from Firebase
Expand All @@ -1586,24 +1570,18 @@ workflows:
# get dependency
cd ./test-fixtures && git clone https://github.com/isabelrios/xcresult_extract.git
ls
echo $FIREBASE_XCRESULT_PATH
$HOME/google-cloud-sdk/bin/gsutil ls $FIREBASE_XCRESULT_PATH
# pull firebase xcresult and rename it to extract measurement data
mkdir test_firebase_xcresult
$HOME/google-cloud-sdk/bin/gsutil -m cp -r $FIREBASE_XCRESULT_PATH ./test_firebase_xcresult
ls -R ./test_firebase_xcresult
mv ./test_firebase_xcresult/*.xcresult ./test_firebase_xcresult/Test-Fennec-test.xcresult
ls -R ./test_firebase_xcresult
echo "DerivedData/Client/Log/Tests"
ls /Users/vagrant/Library/Developer/Xcode/DerivedData
# firebase xcresult needs to be in the Test dir created during earlier build-for-testing step
FIREBASE_XCRESULT="./test_firebase_xcresult/Test-Fennec-test.xcresult"
CLIENT_PATH=$(ls /Users/vagrant/Library/Developer/Xcode/DerivedData | grep 'Client-')
BITRISE_XCRESULT="/Users/vagrant/Library/Developer/Xcode/DerivedData/$CLIENT_PATH/Logs/Test/Test-Fennec-test.xcresult"
mv $FIREBASE_XCRESULT $BITRISE_XCRESULT
ls /Users/vagrant/Library/Developer/Xcode/DerivedData/$CLIENT_PATH/Logs/Test
# create and print perf data object for perfherder ingest via taskcluster log output
xcrun xcresulttool graph --path $BITRISE_XCRESULT
ls ..
python3 xcresult_extract/xcresult_extract.py -project ../Client.xcodeproj -scheme Fennec
Expand Down

0 comments on commit 9cc413d

Please sign in to comment.