Skip to content

Commit

Permalink
Implement filter to run browser tests with Linux/Ozone
Browse files Browse the repository at this point in the history
It's verified with '--ozone-platform=headless'
This filter disables all the crashing and failing tests and
leaves only the working ones.

TBR=msisov

fixup! Implement filter to run browser tests with Linux/Ozone

It updated the filter for browser_tests with failed test cases
on build-bot.

fixup! Implement filter to run browser tests with Linux/Ozone

Exclude failing tests. The reason of failures is unknown.

All the tests must be removed from this filter and added again
after a check.
  • Loading branch information
jkim-julie authored and msisov committed Mar 4, 2019
1 parent d996889 commit 90b146b
Showing 1 changed file with 307 additions and 0 deletions.
307 changes: 307 additions & 0 deletions testing/buildbot/filters/ozone.browser_tests.filter
Original file line number Diff line number Diff line change
@@ -0,0 +1,307 @@
#194 tests failed: It happens with upstream "ozone". (21/Nov/2018)
-AppInfoDialogBrowserTest.InvokeUi_default
-AskGoogleForSuggestionsDialogTest.InvokeUi_default
-AuthenticatorDialogTest.InvokeUi_activate_usb
-AuthenticatorDialogTest.InvokeUi_ble_activate
-AuthenticatorDialogTest.InvokeUi_ble_device_selection
-AuthenticatorDialogTest.InvokeUi_ble_enter_pairing_mode
-AuthenticatorDialogTest.InvokeUi_ble_pairing_begin
-AuthenticatorDialogTest.InvokeUi_ble_pin_entry
-AuthenticatorDialogTest.InvokeUi_ble_power_on_manual
-AuthenticatorDialogTest.InvokeUi_ble_verifying
-AuthenticatorDialogTest.InvokeUi_cable_activate
-AuthenticatorDialogTest.InvokeUi_closed
-AuthenticatorDialogTest.InvokeUi_default
-AuthenticatorDialogTest.InvokeUi_key_already_registered
-AuthenticatorDialogTest.InvokeUi_key_not_registered
-AuthenticatorDialogTest.InvokeUi_no_available_transports
-AuthenticatorDialogTest.InvokeUi_timeout
-AuthenticatorDialogTest.InvokeUi_touchid
-AuthenticatorDialogTest.InvokeUi_transports
-AuthenticatorDialogViewTest.InvokeUi_default
-BluetoothChooserBrowserTest.InvokeUi_ConnectedBubble
-BluetoothChooserBrowserTest.InvokeUi_ConnectedModal
-BluetoothChooserBrowserTest.InvokeUi_NoDevicesBubble
-BluetoothChooserBrowserTest.InvokeUi_NoDevicesModal
-BluetoothChooserBrowserTest.InvokeUi_PairedBubble
-BluetoothChooserBrowserTest.InvokeUi_PairedModal
-BluetoothChooserBrowserTest.InvokeUi_ScanningBubble
-BluetoothChooserBrowserTest.InvokeUi_ScanningModal
-BluetoothChooserBrowserTest.InvokeUi_ScanningWithDevicesBubble
-BluetoothChooserBrowserTest.InvokeUi_ScanningWithDevicesModal
-BluetoothChooserBrowserTest.InvokeUi_UnavailableBubble
-BluetoothChooserBrowserTest.InvokeUi_UnavailableModal
-BookmarkAppHelperTest.InvokeUi_CreateBookmarkApp
-BookmarkAppHelperTest.InvokeUi_CreateWindowedPWA
-BookmarkBubbleViewBrowserTest.InvokeUi_bookmark_details
-BookmarkBubbleViewBrowserTest.InvokeUi_bookmark_details_signed_in
-BookmarkEditorViewBrowserTest.InvokeUi_all_tabs
-BrowserActionApiTest.BrowserActionOpenPopupOnPopup
-BrowserTest.DialogsDropFullscreen
-BrowserViewTest.GetAccessibleTabModalDialogTitle
-CardUnmaskPromptViewBrowserTest.InvokeUi_expired
-CardUnmaskPromptViewBrowserTest.InvokeUi_valid
-CertificateSelectorDialogTest.InvokeUi_default
-CollectedCookiesTest.InvokeUi_default
-ContentSettingBubbleDialogTest.InvokeUi_ads
-ContentSettingBubbleDialogTest.InvokeUi_automatic_downloads
-ContentSettingBubbleDialogTest.InvokeUi_cookies
-ContentSettingBubbleDialogTest.InvokeUi_geolocation
-ContentSettingBubbleDialogTest.InvokeUi_images
-ContentSettingBubbleDialogTest.InvokeUi_javascript
-ContentSettingBubbleDialogTest.InvokeUi_mediastream_camera
-ContentSettingBubbleDialogTest.InvokeUi_mediastream_mic
-ContentSettingBubbleDialogTest.InvokeUi_mediastream_mic_and_camera
-ContentSettingBubbleDialogTest.InvokeUi_midi_sysex
-ContentSettingBubbleDialogTest.InvokeUi_mixed_script
-ContentSettingBubbleDialogTest.InvokeUi_plugins
-ContentSettingBubbleDialogTest.InvokeUi_popups
-ContentSettingBubbleDialogTest.InvokeUi_ppapi_broker
-ContentSettingBubbleDialogTest.InvokeUi_protocol_handlers
-DesktopCaptureApiTest.ChooseDesktopMedia
-DesktopMediaPickerViewsBrowserTest.InvokeUi_default
-DownloadDangerPromptBrowserTest.InvokeUi_DangerousFile
-DownloadDangerPromptBrowserTest.InvokeUi_DangerousFileFromApi
-DownloadDangerPromptBrowserTest.InvokeUi_DangerousUrl
-DownloadDangerPromptBrowserTest.InvokeUi_DangerousUrlFromApi
-DownloadDangerPromptBrowserTest.InvokeUi_PotentiallyUnwanted
-DownloadDangerPromptBrowserTest.InvokeUi_PotentiallyUnwantedFromApi
-DownloadDangerPromptBrowserTest.InvokeUi_UncommonContent
-DownloadDangerPromptBrowserTest.InvokeUi_UncommonContentFromApi
-ExtensionBlockedActionsBubbleTest.InvokeUi_ExtensionBlockedActionsBubble
-ExtensionInstallDialogViewInteractiveBrowserTest.InvokeUi_AllInfoTypes
-ExtensionInstallDialogViewInteractiveBrowserTest.InvokeUi_DetailedPermission
-ExtensionInstallDialogViewInteractiveBrowserTest.InvokeUi_External
-ExtensionInstallDialogViewInteractiveBrowserTest.InvokeUi_ExternalWithPermission
-ExtensionInstallDialogViewInteractiveBrowserTest.InvokeUi_FromWebstore
-ExtensionInstallDialogViewInteractiveBrowserTest.InvokeUi_FromWebstoreWithPermission
-ExtensionInstallDialogViewInteractiveBrowserTest.InvokeUi_ManyPermissions
-ExtensionInstallDialogViewInteractiveBrowserTest.InvokeUi_MultilinePermission
-ExtensionInstallDialogViewInteractiveBrowserTest.InvokeUi_ReEnable
-ExtensionInstallDialogViewInteractiveBrowserTest.InvokeUi_Simple
-ExtensionInstallDialogViewInteractiveBrowserTest.InvokeUi_WithRetainedDevices
-ExtensionInstallDialogViewInteractiveBrowserTest.InvokeUi_WithRetainedFiles
-ExtensionMessageBubbleViewBrowserTest.InvokeUi_devmode_warning
-ExtensionUninstallDialogViewInteractiveBrowserTest.InvokeUi_ManualUninstall
-ExtensionUninstallDialogViewInteractiveBrowserTest.InvokeUi_ManualUninstallShowReportAbuse
-ExtensionUninstallDialogViewInteractiveBrowserTest.InvokeUi_UninstallByExtension
-ExtensionUninstallDialogViewInteractiveBrowserTest.InvokeUi_UninstallByExtensionShowReportAbuse
-ExtensionWindowCreateTest.AcceptState
-ExternalProtocolDialogBrowserTest.InvokeUi_default
-FeaturePromoDialogTest.InvokeUi_FeaturePromo
-FolderUploadConfirmationViewTest.InitiallyFocusesCancel
-FolderUploadConfirmationViewTest.InvokeUi_default
-FullscreenControllerTest.FastKeyboardLockUnlockRelock
-FullscreenControllerTest.FullscreenOnFileURL
-FullscreenControllerTest.KeyboardLockAfterMouseLock
-FullscreenControllerTest.KeyboardLockAfterMouseLockWithEscLocked
-FullscreenControllerTest.KeyboardLockBubbleHideCallbackUnlock
-FullscreenControllerTest.KeyboardLockCycleWithMixedEscLockStates
-FullscreenControllerTest.KeyboardLockDoesNotExitOnEscPressWhenEscIsLocked
-FullscreenControllerTest.KeyboardLockExitsOnEscPressWhenEscNotLocked
-FullscreenControllerTest.KeyboardLockNotLockedAfterFullscreenTransition
-FullscreenControllerTest.KeyboardLockNotLockedInExtensionFullscreenMode
-FullscreenControllerTest.KeyboardLockOnFileURLWithEscLocked
-FullscreenControllerTest.KeyboardLockOnFileURLWithEscUnlocked
-FullscreenControllerTest.KeyboardLockWithEscLocked
-FullscreenControllerTest.KeyboardLockWithEscUnlocked
-FullscreenControllerTest.MouseLockAfterKeyboardLock
-FullscreenControllerTest.MouseLockAfterKeyboardLockWithEscLocked
-FullscreenControllerTest.RepeatedEscEventsOutsideWindowDoesNotShowExitBubble
-FullscreenControllerTest.RepeatedEscEventsWithinWindowReshowsExitBubble
-FullscreenControllerTest.SlowKeyboardLockUnlockRelock
-FullscreenControllerTest.TopViewStatusChange
-GlobalErrorBubbleTest.InvokeUi_ExtensionDisabledGlobalError
-GlobalErrorBubbleTest.InvokeUi_ExtensionDisabledGlobalErrorRemote
-GlobalErrorBubbleTest.InvokeUi_ExternalInstallBubbleAlert
-GlobalErrorBubbleTest.InvokeUi_SigninGlobalError
-HatsBubbleTest.InvokeUi_default
-HostedAppOpaqueBrowserFrameViewTest.DarkThemeColor
-HostedAppOpaqueBrowserFrameViewTest.LightThemeColor
-HostedAppOpaqueBrowserFrameViewTest.MediumThemeColor
-HostedAppOpaqueBrowserFrameViewTest.SystemThemeColor
-InputImeApiTest.SendKeyEventsOnNormalPage
-LocalNTPVoiceJavascriptTest.TextTests
-MediaGalleriesInteractiveDialogTest.InvokeUi_DisplayDialog
-OmniboxPopupContentsViewTest.PopupMatchesLocationBarBackground
-OmniboxPopupContentsViewTest.ThemeIntegration
-OutOfProcessPPAPITest.Printing
-OutdatedUpgradeBubbleTest.InvokeUi_NoAutoUpdate
-OutdatedUpgradeBubbleTest.InvokeUi_Outdated
-PWAConfirmationViewTest.InvokeUi_long_text
-PWAConfirmationViewTest.InvokeUi_rtl
-PWAConfirmationViewTest.InvokeUi_short_text
-PageInfoBubbleViewBrowserTest.InvokeUi_AllowAllPermissions
-PageInfoBubbleViewBrowserTest.InvokeUi_BlockAllPermissions
-PageInfoBubbleViewBrowserTest.InvokeUi_Deceptive
-PageInfoBubbleViewBrowserTest.InvokeUi_File
-PageInfoBubbleViewBrowserTest.InvokeUi_Insecure
-PageInfoBubbleViewBrowserTest.InvokeUi_Internal
-PageInfoBubbleViewBrowserTest.InvokeUi_InternalExtension
-PageInfoBubbleViewBrowserTest.InvokeUi_InternalViewSource
-PageInfoBubbleViewBrowserTest.InvokeUi_Malware
-PageInfoBubbleViewBrowserTest.InvokeUi_MixedContent
-PageInfoBubbleViewBrowserTest.InvokeUi_MixedContentForm
-PageInfoBubbleViewBrowserTest.InvokeUi_PasswordReuse
-PageInfoBubbleViewBrowserTest.InvokeUi_Secure
-PageInfoBubbleViewBrowserTest.InvokeUi_UnwantedSoftware
-PasswordBubbleBrowserTest.InvokeUi_AutoSignin
-PasswordBubbleBrowserTest.InvokeUi_AutomaticPasswordBubble
-PasswordBubbleBrowserTest.InvokeUi_PendingPasswordBubble
-PasswordDialogViewTest.InvokeUi_AutoSigninFirstRun
-PasswordDialogViewTest.InvokeUi_PopupAccountChooserWithMultipleCredentialClickSignIn
-PasswordDialogViewTest.InvokeUi_PopupAccountChooserWithSingleCredentialClickSignIn
-PasswordDialogViewTest.InvokeUi_PopupAutoSigninPrompt
-PasswordManagerDialogBrowserTest.InvokeUi_normal
-PasswordReuseModalWarningTest.InvokeUi_default
-PaymentRequestCreditCardEditorTest.EditingExpiredCard
-PaymentRequestShippingAddressEditorTest.FocusFirstField_Name
-PaymentRequestShippingAddressEditorTest.FocusFirstInvalidField_NotName
-PaymentsRequestVisualTest.InvokeUi_NoShipping
-PermissionDialogTest.InvokeUi_camera
-PermissionDialogTest.InvokeUi_flash
-PermissionDialogTest.InvokeUi_geolocation
-PermissionDialogTest.InvokeUi_mic
-PermissionDialogTest.InvokeUi_midi
-PermissionDialogTest.InvokeUi_multiple
-PermissionDialogTest.InvokeUi_notifications
-PermissionDialogTest.InvokeUi_protocol_handlers
-PresentationReceiverWindowControllerBrowserTest.CreatesWindow
-ProfileChooserViewExtensionsTest.InvokeUi_Guest
-ProfileChooserViewExtensionsTest.InvokeUi_ManageAccountLink
-ProfileChooserViewExtensionsTest.InvokeUi_MultiProfile
-ProfileChooserViewExtensionsTest.InvokeUi_SignedIn
-ProfileChooserViewExtensionsTest.InvokeUi_SupervisedOwner
-ProfileChooserViewExtensionsTest.InvokeUi_default
-ProfileSigninConfirmationDialogTest.InvokeUi_default
-RelaunchRecommendedBubbleViewDialogTest.InvokeUi_default
-RelaunchRequiredDialogViewDialogTest.InvokeUi_default
-RepostFormWarningTest.InvokeUi_TestRepostWarning
-SaveCardBubbleControllerImplTest.InvokeUi_Local
-SaveCardBubbleControllerImplTest.InvokeUi_Manage
-SaveCardBubbleControllerImplTest.InvokeUi_Server
-SaveCardBubbleControllerImplTest.InvokeUi_Server_WithCardExpirationDateDropDownBox
-SaveCardBubbleControllerImplTest.InvokeUi_Server_WithCardholderNameTextfield
-SessionCrashedBubbleViewTest.InvokeUi_SessionCrashedBubble
-SessionCrashedBubbleViewTest.InvokeUi_SessionCrashedBubbleOfferUma
-UpdateRecommendedDialogTest.InvokeUi_default
-UsbChooserBrowserTest.InvokeUi_NoDevicesBubble
-UsbChooserBrowserTest.InvokeUi_NoDevicesModal
-UsbChooserBrowserTest.InvokeUi_WithDevicesBubble
-UsbChooserBrowserTest.InvokeUi_WithDevicesModal
-ZoomBubbleBrowserTest.NonImmersiveFullscreen
-ZoomBubbleDialogTest.InvokeUi_default
# Failed on the stock Chromium as well.
-PaymentRequestShippingAddressEditorTest.AddImpossiblePhoneNumber
-PaymentRequestShippingAddressEditorTest.AsyncData
#26 tests timed out: It happens with upstream "ozone". (21/Nov/2018)
-AutomationManagerAuraBrowserTest.TransientFocusChangesAreSuppressed
-ChromeSitePerProcessTest.PopupWindowFocus
-ExtensionWindowLastFocusedTest.NoDevtoolsAndAppWindows
-ExtensionWindowLastFocusedTest.NoTabIdForDevToolsAndAppWindows
-MachineLevelUserCloudPolicyEnrollmentTest.Test/0
-MachineLevelUserCloudPolicyEnrollmentTest.Test/1
-NavigationConsumingTest.NavigationConsumesUserGesture_Fullscreen
-PDFExtensionClipboardTest.CombinedShiftArrowPresses
-PDFExtensionClipboardTest.CombinedShiftRightArrowPresses
-PDFExtensionClipboardTest.IndividualShiftRightArrowPresses
-PDFExtensionTest.PdfZoomWithoutBubble
-PictureInPictureWindowControllerBrowserTest.EnterFullscreenThenPictureInPicture
-PictureInPictureWindowControllerBrowserTest.EnterPictureInPictureThenFullscreen
-PluginPowerSaverBrowserTest.BlockTinyPlugins
-PluginPowerSaverBrowserTest.EssentialPlugins
-PluginPowerSaverBrowserTest.ExpandingSmallPlugin
-PluginPowerSaverBrowserTest.ExpandingTinyPlugins
-PluginPowerSaverBrowserTest.LargePostersNotThrottled
-PluginPowerSaverBrowserTest.OriginWhitelisting
-PluginPowerSaverBrowserTest.PosterTests
-PluginPowerSaverBrowserTest.RunAllFlashInAllowMode
-PluginPowerSaverBrowserTest.SmallCrossOrigin
-PluginPowerSaverBrowserTest.SmallerThanPlayIcon
-PluginPowerSaverBrowserTest.ZoomIndependent
-ProfileHelperTest.OpenNewWindowForProfile
-ProfileWindowBrowserTest.OpenBrowserWindowForProfileWithSigninRequired
-MachineLevelUserCloudPolicyEnrollmentTest.Test/3
#57 tests crashed: It happens with upstream "ozone". (21/Nov/2018)
-AppBackgroundPageApiTest.NoJsBackgroundPage
-BrowserViewTest.CloseWithTabs
-BrowserViewTest.CloseWithTabsStartWithActive
-CardUnmaskPromptViewBrowserTest.InvokeUi_valid_PermanentError
-CardUnmaskPromptViewBrowserTest.InvokeUi_valid_TemporaryError
-DefaultIsolation/TaskManagerOOPIFBrowserTest.CrossSiteIframeBecomesSameSite/0
-DefaultIsolation/TaskManagerOOPIFBrowserTest.KillSubframe/0
-DefaultIsolation/TaskManagerOOPIFBrowserTest.LeavePageWithCrossSiteIframes/0
-DefaultIsolation/TaskManagerOOPIFBrowserTest.NavigateToSiteWithSubframeToOriginalSite/0
-DefaultIsolation/TaskManagerOOPIFBrowserTest.NavigateToSubframeProcess/0
-DefaultIsolation/TaskManagerOOPIFBrowserTest.OrderingOfDependentRows/0
-DefaultIsolation/TaskManagerOOPIFBrowserTest.SubframeHistoryNavigation/0
-EnterpriseStartupDialogViewBrowserTest.InvokeUi_Error
-EnterpriseStartupDialogViewBrowserTest.InvokeUi_Information
-EnterpriseStartupDialogViewBrowserTest.InvokeUi_Switch
-FirstRunInternalPosixTest.HandleSigterm
-ImportLockDialogViewBrowserTest.InvokeUi_default
-IncognitoWindowTrackerBrowserTest.ShowPromo
-NewTabTrackerBrowserTest.TestShowPromo
-OutOfProcessPPAPITest.FlashFullscreen
-PrerenderBrowserTest.OpenTaskManagerAfterPrerender
-PrerenderBrowserTest.OpenTaskManagerAfterSwapIn
-PrerenderBrowserTest.OpenTaskManagerBeforePrerender
-ScreenCaptureNotificationUiBrowserTest.InvokeUi
-SitePerProcess/TaskManagerOOPIFBrowserTest.CrossSiteIframeBecomesSameSite/0
-SitePerProcess/TaskManagerOOPIFBrowserTest.KillSubframe/0
-SitePerProcess/TaskManagerOOPIFBrowserTest.LeavePageWithCrossSiteIframes/0
-SitePerProcess/TaskManagerOOPIFBrowserTest.NavigateToSiteWithSubframeToOriginalSite/0
-SitePerProcess/TaskManagerOOPIFBrowserTest.NavigateToSubframeProcess/0
-SitePerProcess/TaskManagerOOPIFBrowserTest.OrderingOfDependentRows/0
-SitePerProcess/TaskManagerOOPIFBrowserTest.SubframeHistoryNavigation/0
-StartupHelperBrowserTest.ValidateCrx
-TaskManagerBrowserTest.DevToolsNewDockedWindow
-TaskManagerBrowserTest.DevToolsNewUndockedWindow
-TaskManagerBrowserTest.DevToolsOldDockedWindow
-TaskManagerBrowserTest.DevToolsOldUndockedWindow
-TaskManagerBrowserTest.HistoryNavigationInNewTab
-TaskManagerBrowserTest.IdleWakeups
-TaskManagerBrowserTest.JSHeapMemory
-TaskManagerBrowserTest.KillTab
-TaskManagerBrowserTest.NavigateAwayFromHungRenderer
-TaskManagerBrowserTest.NoticeAppTab
-TaskManagerBrowserTest.NoticeAppTabChanges
-TaskManagerBrowserTest.NoticeExtensionTab
-TaskManagerBrowserTest.NoticeExtensionTabChanges
-TaskManagerBrowserTest.NoticeHostedAppTabAfterReload
-TaskManagerBrowserTest.NoticeHostedAppTabBeforeReload
-TaskManagerBrowserTest.NoticeHostedAppTabChanges
-TaskManagerBrowserTest.NoticeTabContentsChanges
-TaskManagerBrowserTest.ReloadExtension
-TaskManagerBrowserTest.SentDataObserved
-TaskManagerBrowserTest.TotalSentDataObserved
-TaskManagerBrowserTest.WebWorkerJSHeapMemory
-TaskManagerUtilityProcessBrowserTest.UtilityJSHeapMemory
-WebRtcDesktopCaptureBrowserTest.RunsScreenshareFromOneTabToAnother
-WebRtcGetDisplayMediaBrowserTestWithPicker.GetDisplayMediaVideo
-WebViewTest.TaskManagerExistingWebView
-WebViewTest.TaskManagerNewWebView
#The following cases happen on Igalia Buildbot.
#7 tests failed:
-PaymentRequestShippingAddressEditorTest.AddPossiblePhoneNumber
-ProcessMemoryMetricsEmitterTest.FetchAndEmitMetrics
-ProcessMemoryMetricsEmitterTest.FetchAndEmitMetricsWithExtensions
-ProcessMemoryMetricsEmitterTest.FetchAndEmitMetricsWithHostedApps
-ProcessMemoryMetricsEmitterTest.FetchDuringTrace
-ProcessMemoryMetricsEmitterTest.FetchThreeTimes
-ProcessMemoryMetricsEmitterTest.ForegroundAndBackgroundPages
#2 tests failed: due to using no-sandbox switch
-SandboxStatusUITest.testBPFSandboxEnabled
-SandboxStatusUITest.testSUIDorNamespaceSandboxEnabled
#2 tests timed out:
-MediaGalleriesGalleryWatchApiTest.CorrectResponseOnModifyingWatchedGallery
-MediaGalleriesGalleryWatchApiTest.RemoveListenerAndModifyGallery

#Failed:
-OmniboxPopupContentsViewTest.ClickOmnibox
-ProfileChooserViewExtensionsTest.InvokeUi_DiceGuest
-TabHoverCardBubbleViewBrowserTest.InvokeUi_tab_hover_card

#Timed out
-MediaGalleriesGalleryWatchApiTest.BasicGalleryWatch
-StartupBrowserCreatorTest.UpdateWithTwoProfiles

0 comments on commit 90b146b

Please sign in to comment.