25 Commits

Author SHA1 Message Date
Nataniel Borges
9f2ad75a6e Automatically clean up flicker test data
Currently the flicker tests leave data on the /sdcard/flicker directory. We now clean up this data after the test.

The logs are still available in the atest results directory.

Test: atest FlickerTests
Change-Id: Ia83cbedff3104964e3d4be14a7c035f2193d36a8
2019-12-04 10:38:42 +01:00
Treehugger Robot
3341bbefea Merge "Include janky runs on flicker rotation tests" 2019-11-26 16:29:45 +00:00
Nataniel Borges
8e65a898ec Include janky runs on flicker rotation tests
Sometimes the tests crash because all runs are janky. Our checks are so far robust to jank, so we will consider janky runs too

Test: atest FlickerTests
Change-Id: I20303d530e1a9cc266230530c6f7fa1cecd51020
2019-11-26 11:46:42 +01:00
Nataniel Borges
4512ac6fa8 Record videos of the flicker tests
After a change in the flickerlib the videos are no longer recorded by
default. The tests which need to record a video must signal it.

Test: atest FlickerTests, check if the video exists in /sdcard/flicker
Change-Id: I8e74411ca6bf654ec7c0afcacf1c0591610f50bb
2019-11-12 16:07:28 +01:00
Treehugger Robot
f2a739d5f0 Merge changes from topic "flicker-rotation"
* changes:
  New FlickerTests: Run split screen tests at 0 and 90 degrees
  New FlickerTests: Start app warm and cold at both 0 and 90 degrees
  New FlickerTests: Start IME alongside the app (0 and 90 degrees)
  New FlickerTests: Start IME tests with app rotated by 90 degrees
2019-09-27 14:21:58 +00:00
Nataniel Borges
40c517afac New FlickerTests: Run split screen tests at 0 and 90 degrees
Test: atest ResizeSplitScreenTest
Change-Id: I44b0733f8abbb022f2a00072bbb398e6d29699c7
2019-09-26 17:46:47 +02:00
Nataniel Borges
97572097a4 Add secure settings to the test apps
When running the flicker tests on postsubmit the apps require the following permission: "android.permission.WRITE_SECURE_SETTINGS"

Test: atest FlickerTests
Change-Id: I6a2647fb6d2351617297b3f89ae3f3edc1aad981
2019-09-26 12:01:57 +02:00
Nataniel Borges
d051c3b767 New FlickerTests: Start app warm and cold at both 0 and 90 degrees
Test: atest OpenAppColdTest OpenAppWarmTest
Change-Id: I1ea7377a07938b583c537b3db2da7bd5a3fc0ae1
2019-09-25 16:12:18 +02:00
Nataniel Borges
4bfe816030 New FlickerTests: Start IME alongside the app (0 and 90 degrees)
Test: atest FlickerTests:CloseImeAutoOpenWindowToAppTest
Change-Id: I8ed60eb5e4653cdcf4d31402069be7da96c5d2bb
2019-09-25 16:11:14 +02:00
Nataniel Borges
89888bf124 New FlickerTests: Start IME tests with app rotated by 90 degrees
Test: atest FlickerTests:CloseImeWindowToAppTest FlickerTests:CloseImeWindowToHomeTest
Change-Id: Ib78e3ecf5629938b722e067027098b8c43a64771
2019-09-25 16:10:50 +02:00
Nataniel Borges
0e476aa881 Ignore flicker tests with open bugs
Some flicker tests are failing because of open bugs. Mark them as
ignored until the bugs are fixed to prevent test failures.

Test: atest FlickerTests
Change-Id: If9216bccc32d64cd32ff87fae785df200eae8b79
2019-09-18 17:18:22 +02:00
Nataniel Borges
eb63fdd6e5 Don't remove flicker test logs from device for easier debugging
Test: atest FlickerTests
Change-Id: Id8a7869967df2ccd2e905c61cc1a348ae06d4430
2019-09-18 17:17:35 +02:00
Nataniel Borges
f5a1ed72a8 Reduce delays on Flicker test rotation
Flicker tests currently wait 3 seconds until the screen rotation have
been complete. This long delay may hide some issues. Reduce delay to 1
second.

Test: atest FlickerTests
Change-Id: I1646086018fac52c0751ff70fff1f5082fee4685
2019-09-18 17:17:24 +02:00
Nataniel Borges
527ee2e145 Make OpenAppCold/Warm tests compatible with AOSP
Test: atest FlickerTests
Change-Id: Ib1071b125597e73a5c72e22e9107ae4d29f5cb7f
2019-09-18 17:17:03 +02:00
Nataniel Borges
f5c828cb48 Make Flicker Tests compatible with current AOSP
Current status:
atest FlickerTests: Passed: 132, Failed: 11, Ignored: 0

Test: atest FlickerTests
Change-Id: I581005fd293631630a3939eeaae485c1fd41ebb9
2019-09-18 12:45:46 +02:00
Winson Chung
0d4ac4ec1c Exposing flickerlib classes and layer tracing to sysui
- Allow recents component to enable/disable layer tracing
- Expose flickerlib classes for use with sysui/launcher tests
- Allow trace files to be moved to a path that the client can read
- Ensure layers are flattened with depth traversal to encode ordering

Bug: 140244969
Test: atest FlickerTests
Change-Id: I7af5699ff5b8a4bc62c1a8105c67b31bc45a2236
Merged-In: Ia0934ec7c2b9484fa6c85f5aa8d9b2e5e6f7dc0f
2019-09-16 18:08:13 +00:00
Colin Cross
e0bcbdb2bd Merge "Update frameworks tests for truth 0.42" into qt-dev-plus-aosp 2019-04-17 20:09:15 +00:00
Tadashi G. Takaoka
9f376950bd Rename cts-amwm-util to cts-wm-util
Test: Build FlickerTests
  atest -b FlickerTests
Bug: 129909356
Change-Id: I796bd8f52be21ccb7f770fb6c8dda9605451b10d
2019-04-17 02:36:22 +00:00
Colin Cross
b6cf22daf1 Update frameworks tests for truth 0.42
SubjectFactory has been replaced with Subject.Factory.

Bug: 130435731
Test: m checkbuild
Change-Id: I5ae4009aeeab54518c5169a5cd37948cb056058e
2019-04-12 14:34:58 -07:00
Julien Desprez
c82d3e9e3c Explicitly exclude @Ignore annotation
Some flicker class are marked Ignored causing some issue
with the AJUR runner. To avoid them, simply filter it.

Test: None
Bug: 129468528
Change-Id: I6442204eb6f89b4bf90a39ee821ebc4daebbe120
2019-03-28 08:50:03 -07:00
Hsin-Yi Chen
677a0025cb Replace GoogleDeviceSetup with DeviceSetup in FlickerTests
This commit replaces GoogleDeviceSetup which is not on AOSP.

Test: atest FlickerTests
Bug: 128877715
Change-Id: I2e4167dd7e4e5ef3352cb8fda2f753a0acf2f600
2019-03-19 05:31:40 +00:00
Sasha Smundak
89414e1ed5 Convert tests/**/Android.mk files to Android.bp, part II
See build/soong/README.md for more information.

Bug: 122332340
Test: treehugger
Change-Id: I886b6536a0ef1c8d21f15ec7ff9fdb9784d5b865
2019-03-12 09:37:32 -07:00
Brett Chabot
502ec7ae4b Migrate remainder of frameworks/base to androidx.test
See go/jetpack-test-android-migration

Exempt-From-Owner-Approval: automated package name refactoring

Test: m  m -j BroadcastRadioTests KeystoreTests mediaframeworktest ActivityManagerPerfTests AppLaunch AppLaunchWear BackgroundDexOptServiceIntegrationTests AppCompatibilityTest DynamicCodeLoggerIntegrationTests FlickerLibTest InternalTests PackageWatchdogTest RcsTests RollbackTestAppAv1 RollbackTestAppAv2 RollbackTestAppACrashingV2 RollbackTestAppBv1 RollbackTestAppBv2 RollbackTestAppASplitV1 RollbackTestAppASplitV2 RollbackTest ServiceCrashTest UsageStatsPerfTests UsbTests WindowAnimationJank
Change-Id: I32fe3297656eec6060da6c7e24582bcd5315fb16
2019-03-02 00:35:17 +00:00
Nataniel Borges
7b3ec11b8c Fix error message on Flicker's launchSplitActivity test
When the Flicker test is unable to launch a split activity it crashes
with a `NullPointerException`.

Change this error into a meaningful error message.

Test: Run `atest WindowManagerSmokeTest`
Change-Id: I1c3c06b3327b94ad6da1a1eabe147182202676a1
2019-01-30 17:29:13 -08:00
Vishnu Nair
8248b7c995 Move FlickerTests to frameworks/base/tests 2/2
platform_testing is moving to AOSP first development. FlickerTests may require access to
in development test apis and cannot be developed in AOSP.

Other minor changes:
- remove FlickerTests from APCT. FlickerTests will use TEST_MAPPING
- use @FlakyTest instead of @Ignore annotation to skip tests

Test: atest FlickerTests
Test: make -j32 continuous_instrumentation_tests
Test: cd frameworks/base/tests/FlickerTests/ && atest :postsubmit

Bug: 112044297
Change-Id: Icc3194ddd9b801034d8797bf2ec60ebff071612c
2018-08-01 10:13:36 -07:00