427 Commits

Author SHA1 Message Date
Pablo Gamito
2dba1bd72d Promote stable test
Bug: 225834503
Bug: 215702751

Test: presubmit
Change-Id: I1e94cf5f287a6b19fd921fa07e89b404981ef807
2022-03-30 10:05:09 +00:00
Nataniel Borges
786e62ef54 Enable passing shell transition tests
- App close: with home / with back
- Launch app: cold / warm / from overview
- Bubbles: expand / launch / dismiss

Bug: 214452854
Bug: 213852103
Bug: 219690120
Bug: 217777115
Bug: 205288792
Fixes: 219693385
Fixes: 219688533
Fixes: 218604389
Test: atest FlickerTests:com.android.server.wm.flicker.close
Change-Id: Ib9b290baac911d42fdc8ac87755fd8df98fdb272
2022-03-29 16:46:15 +00:00
Wei Sheng Shih
94d1958df5 Merge "Waiting for snapshot layer gone for quick switch tests." into tm-dev 2022-03-29 12:21:15 +00:00
TreeHugger Robot
83e668b241 Merge "Move passing postsubmit tests to presubmit" into tm-dev 2022-03-28 17:57:59 +00:00
Nataniel Borges
4a69f3a27f Move passing postsubmit tests to presubmit
- Open IME from fixed orientation
- Open IME to overview

Bug: 224407658
Bug: 227189877
Test: atest FlickerTests:com.android.server.wm.flicker.ime
Change-Id: I814720b6998ae06638962fab3b7daaaf30982e5e
2022-03-28 17:23:05 +02:00
TreeHugger Robot
d8ea5df381 Merge "Disable flaky app launch test" into tm-dev 2022-03-28 12:39:06 +00:00
wilsonshih
3402a4930e Waiting for snapshot layer gone for quick switch tests.
Reduce the flakness caused from remove window animation, the snapshot
starting window with IME window could stay on screen longer.

Bug: 226684870
Test: atest FlickerTests:SwitchImeWindowsFromGestureNavTest
Change-Id: I247a718d637f0b2d5c05210f670289dcae5968a5
2022-03-28 11:48:04 +08:00
TreeHugger Robot
d7a314b239 Merge "Update quick switch test to support animations without SnapshotStartingWindow" into tm-dev 2022-03-27 23:48:23 +00:00
Nataniel Borges
4cfae2ce8f Disable flaky app launch test
At the moment, when launching an app over the lock screen, the navbar flickers. During the animation it:

- appears
- disappears
- reappears

Bug: 227072573
Test: atest OpenAppNonResizeableTest
Change-Id: I17dd8f8ff70c4c12db97d6f337f1500e0ab177d0
2022-03-27 16:11:43 +02:00
Nataniel Borges
47f3818bd2 Update quick switch test to support animations without SnapshotStartingWindow
Fixes: 227072573
Test: atest QuickSwitchFromLauncherTest
Change-Id: I1e0339a3da0426fcffa5062da859032cecb8724d
2022-03-27 11:07:10 +02:00
Ming-Shin Lu
b030e80284 Add more FlickerTests for verifying IME transition
Making sure CL[1] can resolve IME flickers when
- App with IME transiting from a fixed orientation task
- App with IME transiting to the overview screen

[1]: I332c0e4fff62df5d7b793eda2767bb58fe85a938

Fix: 224407658
Test: atest FlickerTests:OpenImeWindowFromFixedOrientationAppTest
Test: atest FlickerTests:OpenImeWindowToOverViewTest
Change-Id: I3120d403b850418a87f57472b91674b0165982b0
2022-03-22 13:23:49 +08:00
Pablo Gamito
633398fe8c Merge "Promote stable flicker tests" into tm-dev 2022-03-10 18:30:39 +00:00
Pablo Gamito
19caa1d7d8 Promote stable flicker tests
Change-Id: Ibdb17efe85a8a6cb8da16d96c1658720f53bd671
2022-03-10 11:28:41 +00:00
TreeHugger Robot
9bb218a9c4 Merge "Add stable tests back to presubmit" into tm-dev 2022-03-04 21:22:22 +00:00
Pablo Gamito
3d4661b350 Add stable tests back to presubmit
Bug: 219749605

Bug: 219757170

Test: n/a
Change-Id: Ie326da68469fb0b8d7dc84efd66e50a819e26933
2022-03-04 18:13:17 +00:00
wilsonshih
8654089f3f Waiting for snapshot layer gone for quick switch tests.
Reduce the flakness caused from remove window animation.

Bug: 213867585
Test: atest FlickerTests:QuickSwitchBetweenTwoAppsForwardTest
Test: atest FlickerTests:QuickSwitchBetweenTwoAppsBackTest
Change-Id: I79250fc188e9cefca5862727b5be0b399c5af57e
2022-03-01 19:42:46 +08:00
TreeHugger Robot
fdbfa75157 Merge "Move all non shell quickswitch tests to presubmit" into tm-dev 2022-02-24 15:45:19 +00:00
Pablo Gamito
554859be00 Merge "Make use of TAPL in quickswitch tests" into tm-dev 2022-02-24 15:17:00 +00:00
Pablo Gamito
4740dd05f8 Move all non shell quickswitch tests to presubmit
Looking at the dashboard all these tests are fairly reliable now pretty much always green

Test: atest FlickerTests:QuickSwitchFromLauncherTest FlickerTests:QuickSwitchBetweenTwoAppsBackTest FlickerTests:QuickSwitchBetweenTwoAppsForwardTest
Change-Id: Ifc9e042439aa436497d3f4e2e7df94ba0f30a14b
2022-02-24 14:29:58 +01:00
Pablo Gamito
e18ed7dde7 Make use of TAPL in quickswitch tests
Test: atest FlickerTests:QuickSwitchFromLauncherTest FlickerTests:QuickSwitchBetweenTwoAppsBackTest FlickerTests:QuickSwitchBetweenTwoAppsBackTest

Bug: 217379707
Change-Id: I40ff578b7ae26463b1ba6d06e7e15f0910f4b5a3
2022-02-24 13:34:22 +01:00
Nataniel Borges
09212fcd90 Fix wait condition on quickswitch
The navbar vanishes and reappears during the transition. Wait until the navbar appears to consider the transition finished.

Bug: 219690120
Bug: 220083329
Test: atest WMShellFlickerTests
Change-Id: Ib4514872fa8e9c2eac4148095474d26255f4a712
2022-02-24 13:00:24 +01:00
Nataniel Borges
798fe83b4b Crash test when wait condition not met
This makes triaging issues unrelated to the test (e.g., transition crash) easier since all failing assertions are clustered with the same stack trace

Bug: 219773854
Test: atest FlickerTests WMShellFlickerTests
Change-Id: I65bb1b5e87997c856ce080b24d549ba1c978955a
Merged-In: I65bb1b5e87997c856ce080b24d549ba1c978955a
2022-02-22 14:23:34 +00:00
Pablo Gamito
3d6d75b455 Merge changes Icf637f09,Ibae3c102,I9758fc10,Ic4a53d96
* changes:
  Extract out rotationLayerAppearsAndVanishes assertions
  Demote flaky transitions
  Update FlakyTest annotation to correct package
  Remove redundant tests
2022-02-17 11:20:22 +00:00
TreeHugger Robot
8dc59320da Merge "Disable async trace" 2022-02-17 10:40:02 +00:00
Pablo Gamito
eb773ab87a Extract out rotationLayerAppearsAndVanishes assertions
Fixes problem with rotationLayerAppearsAndVanishes_shellTransit calling rotationLayerAppearsAndVanishes which included the assertion along with an Assume.assumeFalse(isShellTransitionsEnabled) which meant the test would never run

Test: atest FlickerTests:ChangeAppRotationTest
Change-Id: Icf637f09a062e5f56cab4b5b28fbba7208b0fea4
2022-02-16 18:52:50 +01:00
Pablo Gamito
904c875e23 Update FlakyTest annotation to correct package
Test: atest FlickerTests
Change-Id: I9758fc103e8f35b964883c0aea8c970bb4f3f0c1
2022-02-16 17:18:47 +01:00
Pablo Gamito
398d3e6d03 Remove redundant tests
Since added OpenAppFromOverviewTest_ShellTransit any tests in OpenAppFromOverviewTest that are split between shell and non shell become redundant

Test: atest FlickerTests:OpenAppFromOverviewTest FlickerTests:OpenAppFromOverviewTest_ShellTransit

Change-Id: Ic4a53d969d2d62457c3d98d98090af0b942d03c8
2022-02-16 17:14:01 +01:00
Nataniel Borges
669a1a74c9 Disable async trace
Using compressed trace files speeds up trace collection and the benefits of using async trace fetch become negligible.

To simplify the code, remove the functionality

Bug: 209843622
Test: atest FlickerTests WMShellFlickerTests
Change-Id: Id21d58af5393eb7f364b353db619c55a5a5b616c
2022-02-16 07:14:59 +01:00
TreeHugger Robot
0b2c1a8079 Merge "Demote and promote flicker tests" 2022-02-15 23:21:20 +00:00
Pablo Gamito
5283cc714d Demote test class with flaky transitions
Test: NA
Change-Id: I5b38bf8281c286cf1feb9160718450c30f807340
2022-02-15 21:06:08 +01:00
Pablo Gamito
11e8f789e1 Demote and promote flicker tests
To stablize fliker tests and move stable ones back to presubmit

Test: N/A
Change-Id: Id21a1fcf8b1cf0b950618444cf65711e8dc7c0e6
2022-02-15 17:39:29 +01:00
Pablo Gamito
2c37d7a5e0 Merge "Remove fass assertions from tests" 2022-02-10 14:46:06 +00:00
TreeHugger Robot
d25198a25e Merge "Disable flaky tests" 2022-02-10 09:16:48 +00:00
Nataniel Borges
d86a80274a Merge "Run flicker tests 3x" 2022-02-10 07:32:47 +00:00
Nataniel Borges
77dff60b1b Disable flaky tests
Create specific class for shell transition when whole CUJ crashes

Bug: 209843622
Test: atest FlickerTests WMShellFlickerTests
Change-Id: I8d3d96af7303e6bd7bc4a540aa79b0f9ea3bf4a0
2022-02-09 19:02:17 +01:00
Nataniel Borges
c95bc4d69a Run flicker tests 3x
We run the flicker tests multiple times to detect CLs that intoruce flakiness early. Currently we run 5 executions of each CUJ. However, due to lab capacity and impact in presubmit times, this CL reduces the repetitions to 3

Bug: 209843622
Test: atest FlickerTests WMShellFlickerTests
Change-Id: I165937fb82953d62c028ffe96a948d0ca00dbbe2
2022-02-09 11:11:54 +01:00
TreeHugger Robot
14da91737a Merge "Add default theme for flicker test app" 2022-02-09 06:36:41 +00:00
Pablo Gamito
1574f79287 Split inheritance structure between OpenAppFromLauncher and OpenAppFromLock tests
OpenAppNonResizeableTest was inheriting from OpenAppTransition which specified assertions assuming the app was launched from the launcher but that isn't the case there, we launch from the lock screen

Test: atest FlickerTests:OpenAppColdTest FlickerTests:OpenAppFromOverviewTest FlickerTests:OpenAppNonResizeableTest

Bug: 213856453
Change-Id: I4bc1eca68598471452e4cac94903f0d92dba635b
2022-02-08 17:12:09 +01:00
Pablo Gamito
b85d6f1ad4 Remove fass assertions from tests
Assertions are very flaky, don't provide any immediately useful information in the current state and going to be replace soon anyways

Test: atest FlickerTests
Change-Id: Id8f7649b818237bc16051d808ef46ca875669faa
2022-02-08 17:10:10 +01:00
Riddle Hsu
5a68f5cd91 Add default theme for flicker test app
Otherwise its WidowManager.LayoutParams#windowAnimations is 0, then
it won't play animation (TransitionAnimation#loadAnimationAttr
returns null) so the the surface of closing app may be updated to
invisible at random timing that causes the test flaky.

Use darker gray as window background color to make it easier to
distinguish the visual result between home, starting window (gray)
and app content (orange).

Bug: 216297992
Bug: 213852103
Test: com.android.server.wm.flicker.launch.OpenAppColdTest
Change-Id: I3bb073dfa52484a63168b3aeb6e7f5f43bd02aac
2022-02-08 14:58:55 +00:00
Nataniel Borges
cbe01b513c Merge "Fetch traces async" 2022-02-03 13:07:15 +00:00
Nataniel Borges
ccc875cc97 Fetch traces async
Due to the large amount of traces on flicker, the tests take 15min+ to copy the files from the device to the host after the test execution. Instead, start copying the files asynchronously.

It is not possible to use the async mechanism from Tradefed's FilePullerLogCollector because it either: (1) pushes the files form the directory multiple times -- once per test -- creating a lot of duplicates; or (2) cleans up the directory without checking for new files, losing some files.

This CL creates an asynchronous file upload mechanism for flicker using coroutines

Bug: 216111397
Test: atest FlickerTests WMShellFlickerTests
Change-Id: I5bbae834cf3439950626823c6b665c733e27e517
2022-02-01 20:08:51 +01:00
Nataniel Borges
469918d283 Launch main activity only 1x
Currently we launch the activity for each iteration and that is not necessary. The test hsould launch it once

Bug: 209843622
Test: atest FlickerTests
Change-Id: Ibce9f17954771158cb6d85b213f40a215f0c0c30
2022-02-01 20:04:44 +01:00
Pablo Gamito
d378d62742 Merge "Demote OpenAppFromOverviewTest#appWindowReplacesLauncherAsTopWindow to flaky test" 2022-01-27 14:35:42 +00:00
Pablo Gamito
d42926bdb0 Demote OpenAppFromOverviewTest#appWindowReplacesLauncherAsTopWindow to flaky test
Change-Id: I9763e14f9236d71112e8f2e280d2be1a7a36a573
2022-01-27 11:28:56 +01:00
Chris Li
63be3c89bb Move disabled shelltransit flicker tests to flaky
So that we can keep track of the status, and move it back to presubmit
after it becomes stable

Bug: 214452854
Test: pass existing
Change-Id: I60453789676cda9eb0892b601806d398af7bdc82
2022-01-26 18:27:49 +08:00
Chris Li
d4de0febd4 Merge "Enable flicker test group1 with Shell transition" 2022-01-25 02:20:55 +00:00
Nataniel Borges
6c218cd563 Merge "Run CloseImeToHome 5x as other flicker tests" 2022-01-24 17:54:15 +00:00
Ming-Shin Lu
8563424438 Merge "Fix LaunchAppShowImeAndDialogThemeAppTest flakiness" 2022-01-24 14:21:43 +00:00
Nataniel Borges
39510a7df3 Merge "Enable 3-button navigation mode on ReOpenImeWindowTest" 2022-01-24 13:51:42 +00:00