Subject: next/master baseline: 752 runs, 90 regressions (next-20230324)

From: "kernelci.org bot" <[email-masked]>
Date: Fri, 24 Mar 2023 03:17:38 -0700 (PDT)

next/master baseline: 752 runs, 90 regressions (next-20230324)

Regressions Summary
-------------------

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
acer-R721T-grunt             | x86_64 | lab-collabora   | clang-13 | x86_64_defcon...6-chromebook | 1          
acer-R721T-grunt             | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...ok+kselftest | 1          
acer-R721T-grunt             | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...ebook+amdgpu | 1          
acer-R721T-grunt             | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...6-chromebook | 1          
am57xx-beagle-x15            | arm    | lab-linaro-lkft | gcc-10   | multi_v7_defc...CONFIG_SMP=n | 1          
am57xx-beagle-x15            | arm    | lab-linaro-lkft | gcc-10   | multi_v7_defconfig+debug     | 1          
asus-CM1400CXA-dalboz        | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...ok+kselftest | 1          
beagle-xm                    | arm    | lab-baylibre    | gcc-10   | multi_v7_defc...MB2_KERNEL=y | 1          
cubietruck                   | arm    | lab-baylibre    | gcc-10   | multi_v7_defc...MB2_KERNEL=y | 1          
da850-lcdk                   | arm    | lab-baylibre    | gcc-10   | davinci_all_defconfig        | 1          
fsl-ls1088a-rdb              | arm64  | lab-nxp         | gcc-10   | defconfig+kselftest          | 1          
fsl-ls1088a-rdb              | arm64  | lab-nxp         | gcc-10   | defconfig+debug              | 1          
hp-11A-G6-EE-grunt           | x86_64 | lab-collabora   | clang-13 | x86_64_defcon...6-chromebook | 1          
hp-11A-G6-EE-grunt           | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...ok+kselftest | 1          
hp-11A-G6-EE-grunt           | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...ebook+amdgpu | 1          
hp-11A-G6-EE-grunt           | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...6-chromebook | 1          
hp-14-db0003na-grunt         | x86_64 | lab-collabora   | clang-13 | x86_64_defcon...6-chromebook | 1          
hp-14-db0003na-grunt         | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...ok+kselftest | 1          
hp-14-db0003na-grunt         | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...ebook+amdgpu | 1          
hp-14-db0003na-grunt         | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...6-chromebook | 1          
imx6qp-wandboard-revd1       | arm    | lab-pengutronix | gcc-10   | multi_v7_defconfig+debug     | 1          
jetson-tk1                   | arm    | lab-baylibre    | gcc-10   | multi_v7_defc...G_ARM_LPAE=y | 1          
meson-g12a-sei510            | arm64  | lab-baylibre    | gcc-10   | defconfig                    | 1          
meson-g12a-sei510            | arm64  | lab-baylibre    | gcc-10   | defconfig+crypto             | 1          
meson-g12a-u200              | arm64  | lab-baylibre    | gcc-10   | defconfig+kselftest          | 1          
meson-g12a-x96-max           | arm64  | lab-baylibre    | gcc-10   | defconfig+kselftest          | 1          
meson-g12a-x96-max           | arm64  | lab-baylibre    | gcc-10   | defconfig+crypto             | 1          
meson-g12b-a311d-khadas-vim3 | arm64  | lab-baylibre    | gcc-10   | defconfig                    | 1          
meson-g12b-a311d-khadas-vim3 | arm64  | lab-baylibre    | gcc-10   | defconfig+kselftest          | 1          
meson-g12b-a311d-khadas-vim3 | arm64  | lab-collabora   | gcc-10   | defconfig+ima                | 1          
meson-g12b-a311d-khadas-vim3 | arm64  | lab-collabora   | gcc-10   | defconfig+kselftest          | 1          
meson-g12b-odroid-n2         | arm64  | lab-baylibre    | gcc-10   | defconfig+kselftest          | 1          
meson-gxbb-nanopi-k2         | arm64  | lab-baylibre    | gcc-10   | defconfig                    | 1          
meson-gxbb-nanopi-k2         | arm64  | lab-baylibre    | gcc-10   | defconfig+ima                | 1          
meson-gxbb-nanopi-k2         | arm64  | lab-baylibre    | gcc-10   | defconfig+kselftest          | 1          
meson-gxl-s905d-p230         | arm64  | lab-baylibre    | gcc-10   | defconfig                    | 1          
meson-gxl-s905d-p230         | arm64  | lab-baylibre    | gcc-10   | defconfig+ima                | 1          
meson-gxl-s905d-p230         | arm64  | lab-baylibre    | gcc-10   | defconfig+kselftest          | 1          
meson-gxl-s905d-p230         | arm64  | lab-baylibre    | gcc-10   | defconfig+debug              | 1          
meson-gxl-s905d-p230         | arm64  | lab-baylibre    | gcc-10   | defconfig+crypto             | 1          
meson-gxl-s905x-khadas-vim   | arm64  | lab-baylibre    | gcc-10   | defconfig                    | 1          
meson-gxl-s905x-khadas-vim   | arm64  | lab-baylibre    | gcc-10   | defconfig+ima                | 1          
meson-gxl-s905x-khadas-vim   | arm64  | lab-baylibre    | gcc-10   | defconfig+kselftest          | 1          
meson-gxl-s905x-khadas-vim   | arm64  | lab-baylibre    | gcc-10   | defconfig+crypto             | 1          
meson-gxl-s905x-libretech-cc | arm64  | lab-baylibre    | gcc-10   | defconfig+kselftest          | 1          
meson-gxl-s905x-libretech-cc | arm64  | lab-broonie     | gcc-10   | defconfig+kselftest          | 1          
meson-gxm-khadas-vim2        | arm64  | lab-baylibre    | gcc-10   | defconfig+kselftest          | 1          
meson-gxm-khadas-vim2        | arm64  | lab-baylibre    | gcc-10   | defconfig+crypto             | 1          
meson-sm1-khadas-vim3l       | arm64  | lab-baylibre    | gcc-10   | defconfig                    | 1          
meson-sm1-khadas-vim3l       | arm64  | lab-baylibre    | gcc-10   | defconfig+ima                | 1          
meson-sm1-sei610             | arm64  | lab-baylibre    | gcc-10   | defconfig                    | 1          
meson-sm1-sei610             | arm64  | lab-baylibre    | gcc-10   | defconfig+crypto             | 1          
mt8173-elm-hana              | arm64  | lab-collabora   | gcc-10   | defconfig+arm...ok+kselftest | 1          
mt8183-kukui-...uniper-sku16 | arm64  | lab-collabora   | clang-13 | cros://chrome...4-chromebook | 1          
mt8183-kukui-...uniper-sku16 | arm64  | lab-collabora   | clang-13 | cros://chrome...4-chromebook | 1          
mt8183-kukui-...uniper-sku16 | arm64  | lab-collabora   | gcc-10   | defconfig+arm...ok+kselftest | 1          
mt8192-asurada-spherion-r0   | arm64  | lab-collabora   | clang-13 | cros://chrome...4-chromebook | 1          
mt8192-asurada-spherion-r0   | arm64  | lab-collabora   | gcc-10   | defconfig+arm...ok+kselftest | 1          
ox820-clouden...lug-series-3 | arm    | lab-baylibre    | gcc-10   | oxnas_v6_defconfig           | 1          
qcom-qdf2400                 | arm64  | lab-linaro-lkft | gcc-10   | defconfig+kselftest          | 1          
qcom-qdf2400                 | arm64  | lab-linaro-lkft | gcc-10   | defconfig+arm...ok+kselftest | 1          
qemu_arm-virt-gicv2          | arm    | lab-baylibre    | gcc-10   | multi_v7_defconfig+debug     | 1          
qemu_arm-virt-gicv2          | arm    | lab-broonie     | gcc-10   | multi_v7_defconfig+debug     | 1          
qemu_arm-virt-gicv2          | arm    | lab-collabora   | gcc-10   | multi_v7_defconfig+debug     | 1          
qemu_arm-virt-gicv2-uefi     | arm    | lab-baylibre    | gcc-10   | multi_v7_defconfig+debug     | 1          
qemu_arm-virt-gicv2-uefi     | arm    | lab-broonie     | gcc-10   | multi_v7_defconfig+debug     | 1          
qemu_arm-virt-gicv2-uefi     | arm    | lab-collabora   | gcc-10   | multi_v7_defconfig+debug     | 1          
qemu_arm-virt-gicv3          | arm    | lab-baylibre    | gcc-10   | multi_v7_defconfig+debug     | 1          
qemu_arm-virt-gicv3          | arm    | lab-broonie     | gcc-10   | multi_v7_defconfig+debug     | 1          
qemu_arm-virt-gicv3          | arm    | lab-collabora   | gcc-10   | multi_v7_defconfig+debug     | 1          
qemu_arm-virt-gicv3-uefi     | arm    | lab-baylibre    | gcc-10   | multi_v7_defconfig+debug     | 1          
qemu_arm-virt-gicv3-uefi     | arm    | lab-broonie     | gcc-10   | multi_v7_defconfig+debug     | 1          
qemu_arm-virt-gicv3-uefi     | arm    | lab-collabora   | gcc-10   | multi_v7_defconfig+debug     | 1          
qemu_arm64-virt-gicv2        | arm64  | lab-baylibre    | gcc-10   | defconfig+debug              | 1          
qemu_arm64-virt-gicv2        | arm64  | lab-collabora   | gcc-10   | defconfig+debug              | 1          
r8a7743-iwg20d-q7            | arm    | lab-cip         | gcc-10   | shmobile_defconfig           | 1          
r8a77960-ulcb                | arm64  | lab-collabora   | gcc-10   | defconfig                    | 1          
r8a77960-ulcb                | arm64  | lab-collabora   | gcc-10   | defconfig+kselftest          | 1          
rk3288-rock2-square          | arm    | lab-collabora   | gcc-10   | multi_v7_defc...G_ARM_LPAE=y | 1          
rk3288-veyron-jaq            | arm    | lab-collabora   | gcc-10   | multi_v7_defc...G_ARM_LPAE=y | 1          
rk3399-gru-kevin             | arm64  | lab-collabora   | clang-13 | cros://chrome...4-chromebook | 2          
rk3399-gru-kevin             | arm64  | lab-collabora   | gcc-10   | defconfig+arm...ok+kselftest | 1          
rk3399-roc-pc                | arm64  | lab-clabbe      | gcc-10   | defconfig+kselftest          | 1          
rk3399-rock-pi-4b            | arm64  | lab-collabora   | gcc-10   | defconfig+kselftest          | 1          
sc7180-trogdo...zor-limozeen | arm64  | lab-collabora   | gcc-10   | defconfig+arm...ok+kselftest | 1          
sun50i-a64-pine64-plus       | arm64  | lab-broonie     | gcc-10   | defconfig+kselftest          | 1          
sun50i-h5-lib...ch-all-h3-cc | arm64  | lab-broonie     | gcc-10   | defconfig+kselftest          | 1          
sun8i-h2-plus-orangepi-zero  | arm    | lab-baylibre    | gcc-10   | sunxi_defconfig              | 1          
sun8i-h3-libretech-all-h3-cc | arm    | lab-baylibre    | gcc-10   | sunxi_defconfig              | 1          

  Details:  https://kernelci.org/test/job/next/branch/master/kernel/next-20230324/plan/baseline/

  Test:     baseline
  Tree:     next
  Branch:   master
  Describe: next-20230324
  URL:      https://git.kernel.org/pub/scm/linux/kernel/git/next/linux-next.git
  SHA:      e5dbf24e8b9e6aa0a185d86ce46a7a9c79ebb40f 

Test Regressions
---------------- 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
acer-R721T-grunt             | x86_64 | lab-collabora   | clang-13 | x86_64_defcon...6-chromebook | 1          

  Details:     https://kernelci.org/test/plan/id/641d4370d1b35e3e1c9c9539

  Results:     18 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook
  Compiler:    clang-13 (Debian clang version 13.0.1-6~deb11u1)
  Plain log:   https://storage.kernelci.org//next/master/next-20230324/x86_64/x86_64_defconfig+x86-chromebook/clang-13/lab-collabora/baseline-acer-R721T-grunt.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230324/x86_64/x86_64_defconfig+x86-chromebook/clang-13/lab-collabora/baseline-acer-R721T-grunt.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/x86/rootfs.cpio.gz 

  * baseline.bootrr.battery-device-probed: https://kernelci.org/test/case/id/641d4370d1b35e3e1c9c9548
        failing since 2 days (last pass: next-20230316, first fail: next-20230321)

    2023-03-24T06:30:02.306416  /lava-9758236/1/../bin/lava-test-case

    2023-03-24T06:30:02.323480  <8>[   13.947426] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=battery-device-probed RESULT=fail>

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
acer-R721T-grunt             | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...ok+kselftest | 1          

  Details:     https://kernelci.org/test/plan/id/641d3f0243d79f67a19c9574

  Results:     18 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook+kselftest
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230324/x86_64/x86_64_defconfig+x86-chromebook+kselftest/gcc-10/lab-collabora/baseline-acer-R721T-grunt.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230324/x86_64/x86_64_defconfig+x86-chromebook+kselftest/gcc-10/lab-collabora/baseline-acer-R721T-grunt.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/x86/rootfs.cpio.gz 

  * baseline.bootrr.battery-device-probed: https://kernelci.org/test/case/id/641d3f0243d79f67a19c9583
        failing since 2 days (last pass: next-20230320, first fail: next-20230322)

    2023-03-24T06:10:52.999974  /lava-9757695/1/../bin/lava-test-case

    2023-03-24T06:10:53.015642  <8>[   92.092878] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=battery-device-probed RESULT=fail>

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
acer-R721T-grunt             | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...ebook+amdgpu | 1          

  Details:     https://kernelci.org/test/plan/id/641d3fd9b34ace12689c9599

  Results:     17 PASS, 1 FAIL, 1 SKIP
  Full config: x86_64_defconfig+x86-chromebook+amdgpu
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230324/x86_64/x86_64_defconfig+x86-chromebook+amdgpu/gcc-10/lab-collabora/baseline-acer-R721T-grunt.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230324/x86_64/x86_64_defconfig+x86-chromebook+amdgpu/gcc-10/lab-collabora/baseline-acer-R721T-grunt.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/x86/rootfs.cpio.gz 

  * baseline.bootrr.battery-device-probed: https://kernelci.org/test/case/id/641d3fd9b34ace12689c95a8
        failing since 2 days (last pass: next-20230320, first fail: next-20230321)

    2023-03-24T06:14:30.138158  /lava-9757755/1/../bin/lava-test-case

    2023-03-24T06:14:30.145412  <8>[   12.328318] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=battery-device-probed RESULT=fail>

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
acer-R721T-grunt             | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...6-chromebook | 1          

  Details:     https://kernelci.org/test/plan/id/641d42837d6f8b68ee9c954b

  Results:     18 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230324/x86_64/x86_64_defconfig+x86-chromebook/gcc-10/lab-collabora/baseline-acer-R721T-grunt.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230324/x86_64/x86_64_defconfig+x86-chromebook/gcc-10/lab-collabora/baseline-acer-R721T-grunt.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/x86/rootfs.cpio.gz 

  * baseline.bootrr.battery-device-probed: https://kernelci.org/test/case/id/641d42837d6f8b68ee9c955a
        failing since 2 days (last pass: next-20230320, first fail: next-20230321)

    2023-03-24T06:25:49.169926  /lava-9758002/1/../bin/lava-test-case<8>[   11.547149] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=battery-device-probed RESULT=fail>

    2023-03-24T06:25:49.170068  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
am57xx-beagle-x15            | arm    | lab-linaro-lkft | gcc-10   | multi_v7_defc...CONFIG_SMP=n | 1          

  Details:     https://kernelci.org/test/plan/id/641d542eaf733758f99c9506

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_SMP=n
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230324/arm/multi_v7_defconfig+CONFIG_SMP=n/gcc-10/lab-linaro-lkft/baseline-am57xx-beagle-x15.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230324/arm/multi_v7_defconfig+CONFIG_SMP=n/gcc-10/lab-linaro-lkft/baseline-am57xx-beagle-x15.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d542eaf733758f99c9507
        failing since 188 days (last pass: next-20220915, first fail: next-20220916) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
am57xx-beagle-x15            | arm    | lab-linaro-lkft | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/641d5679b4d9b3aaa79c952e

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230324/arm/multi_v7_defconfig+debug/gcc-10/lab-linaro-lkft/baseline-am57xx-beagle-x15.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230324/arm/multi_v7_defconfig+debug/gcc-10/lab-linaro-lkft/baseline-am57xx-beagle-x15.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d5679b4d9b3aaa79c952f
        failing since 191 days (last pass: next-20220907, first fail: next-20220913) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
asus-CM1400CXA-dalboz        | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...ok+kselftest | 1          

  Details:     https://kernelci.org/test/plan/id/641d3ea8c2536a798f9c9505

  Results:     6 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook+kselftest
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230324/x86_64/x86_64_defconfig+x86-chromebook+kselftest/gcc-10/lab-collabora/baseline-asus-CM1400CXA-dalboz.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230324/x86_64/x86_64_defconfig+x86-chromebook+kselftest/gcc-10/lab-collabora/baseline-asus-CM1400CXA-dalboz.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/x86/rootfs.cpio.gz 

  * baseline.dmesg.emerg: https://kernelci.org/test/case/id/641d3ea8c2536a798f9c9508
        new failure (last pass: next-20230323)
        3 lines

    2023-03-24T06:09:25.350931  kern  :emerg : __common_interrupt: 1.55 No irq handler for vector

    2023-03-24T06:09:25.357830  kern  :emerg : __common_interrupt: 2.55 No irq handler for vector

    2023-03-24T06:09:25.367636  <8>[   13.997536] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=emerg RESULT=fail UNITS=lines MEASUREMENT=3>

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
beagle-xm                    | arm    | lab-baylibre    | gcc-10   | multi_v7_defc...MB2_KERNEL=y | 1          

  Details:     https://kernelci.org/test/plan/id/641d4299c63c450a259c9593

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230324/arm/multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y/gcc-10/lab-baylibre/baseline-beagle-xm.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230324/arm/multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y/gcc-10/lab-baylibre/baseline-beagle-xm.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d4299c63c450a259c9594
        failing since 14 days (last pass: next-20230308, first fail: next-20230309) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
cubietruck                   | arm    | lab-baylibre    | gcc-10   | multi_v7_defc...MB2_KERNEL=y | 1          

  Details:     https://kernelci.org/test/plan/id/641d42e89496aaa1499c9542

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230324/arm/multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y/gcc-10/lab-baylibre/baseline-cubietruck.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230324/arm/multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y/gcc-10/lab-baylibre/baseline-cubietruck.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/armel/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/641d42e89496aaa1499c954b
        failing since 64 days (last pass: next-20221219, first fail: next-20230118)

    2023-03-24T06:27:36.726136  <8>[   14.313852] <LAVA_SIGNAL_ENDRUN 0_dmesg 3439773_1.5.2.4.1>
    2023-03-24T06:27:36.837205  / # #
    2023-03-24T06:27:36.940495  export SHELL=/bin/sh
    2023-03-24T06:27:36.941651  #
    2023-03-24T06:27:37.044076  / # export SHELL=/bin/sh. /lava-3439773/environment
    2023-03-24T06:27:37.045085  
    2023-03-24T06:27:37.147784  / # . /lava-3439773/environment/lava-3439773/bin/lava-test-runner /lava-3439773/1
    2023-03-24T06:27:37.149314  
    2023-03-24T06:27:37.154723  / # /lava-3439773/bin/lava-test-runner /lava-3439773/1
    2023-03-24T06:27:37.198649  <3>[   14.761542] Bluetooth: hci0: command 0xfc18 tx timeout 
    ... (12 line(s) more)  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
da850-lcdk                   | arm    | lab-baylibre    | gcc-10   | davinci_all_defconfig        | 1          

  Details:     https://kernelci.org/test/plan/id/641d3feca06b1314899c9507

  Results:     3 PASS, 3 FAIL, 1 SKIP
  Full config: davinci_all_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230324/arm/davinci_all_defconfig/gcc-10/lab-baylibre/baseline-da850-lcdk.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230324/arm/davinci_all_defconfig/gcc-10/lab-baylibre/baseline-da850-lcdk.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/armel/rootfs.cpio.gz 

  * baseline.dmesg.emerg: https://kernelci.org/test/case/id/641d3feca06b1314899c950a
        failing since 39 days (last pass: next-20230208, first fail: next-20230213)
        29 lines

    2023-03-24T06:14:47.017371  kern  :alert : Register r8 information: slab kmalloc-512 start c4e7e200 pointer offset 4 size 512
    2023-03-24T06:14:47.051581  kern  :alert : Register r9 information: non-paged memory
    2023-03-24T06:14:47.051886  kern  :alert : Register r10 information: NULL pointer
    2023-03-24T06:14:47.052133  kern  :alert : Register r11 information: 1-page vmalloc region starting at 0xbf2b9000 allocated at load_module+0x690/0x1a80
    2023-03-24T06:14:47.054669  kern  :alert : Register r12 information: non-paged memory
    2023-03-24T06:14:47.158862  kern  :emerg : Internal error: Oops: 17 [#1] PREEMPT ARM
    2023-03-24T06:14:47.159100  kern  :emerg : Process udevd (pid: 74, stack limit = 0x576c3a06)
    2023-03-24T06:14:47.159234  kern  :emerg : Stack: (0xc88e5d08 to 0xc88e6000)
    2023-03-24T06:14:47.159368  kern  :emerg : 5d00:                   c4e7e200 c076f860 00000000 c03ad9d0 00000000 44ee4cff
    2023-03-24T06:14:47.159523  kern  :emerg : 5d20: 0000005d 44ee4cff c076f860 bf2b9220 00000000 00000000 00000000 00000001 
    ... (6 line(s) more)  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
fsl-ls1088a-rdb              | arm64  | lab-nxp         | gcc-10   | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/641d43e0e8f32a21229c951b

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig+kselftest/gcc-10/lab-nxp/baseline-fsl-ls1088a-rdb.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig+kselftest/gcc-10/lab-nxp/baseline-fsl-ls1088a-rdb.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/arm64/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/641d43e0e8f32a21229c9522
        failing since 42 days (last pass: next-20230209, first fail: next-20230210)

    2023-03-24T06:31:45.804790  + set +x
    2023-03-24T06:31:45.806588  [   20.206575] <LAVA_SIGNAL_ENDRUN 0_dmesg 1184807_1.5.2.4.1>
    2023-03-24T06:31:45.921883  #
    2023-03-24T06:31:46.024179  / # #export SHELL=/bin/sh
    2023-03-24T06:31:46.024734  
    2023-03-24T06:31:46.126474  / # export SHELL=/bin/sh. /lava-1184807/environment
    2023-03-24T06:31:46.127127  
    2023-03-24T06:31:46.228573  / # . /lava-1184807/environment/lava-1184807/bin/lava-test-runner /lava-1184807/1
    2023-03-24T06:31:46.229504  
    2023-03-24T06:31:46.231810  / # /lava-1184807/bin/lava-test-runner /lava-1184807/1 
    ... (12 line(s) more)  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
fsl-ls1088a-rdb              | arm64  | lab-nxp         | gcc-10   | defconfig+debug              | 1          

  Details:     https://kernelci.org/test/plan/id/641d45573ad7dd99a79c9543

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+debug
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig+debug/gcc-10/lab-nxp/baseline-fsl-ls1088a-rdb.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig+debug/gcc-10/lab-nxp/baseline-fsl-ls1088a-rdb.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d45573ad7dd99a79c9544
        failing since 60 days (last pass: next-20230120, first fail: next-20230123) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
hp-11A-G6-EE-grunt           | x86_64 | lab-collabora   | clang-13 | x86_64_defcon...6-chromebook | 1          

  Details:     https://kernelci.org/test/plan/id/641d4393a578c83f069c952d

  Results:     18 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook
  Compiler:    clang-13 (Debian clang version 13.0.1-6~deb11u1)
  Plain log:   https://storage.kernelci.org//next/master/next-20230324/x86_64/x86_64_defconfig+x86-chromebook/clang-13/lab-collabora/baseline-hp-11A-G6-EE-grunt.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230324/x86_64/x86_64_defconfig+x86-chromebook/clang-13/lab-collabora/baseline-hp-11A-G6-EE-grunt.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/x86/rootfs.cpio.gz 

  * baseline.bootrr.battery-device-probed: https://kernelci.org/test/case/id/641d4393a578c83f069c953c
        failing since 2 days (last pass: next-20230316, first fail: next-20230321)

    2023-03-24T06:30:16.923425  /lava-9758235/1/../bin/lava-test-case

    2023-03-24T06:30:16.940440  <8>[   13.311484] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=battery-device-probed RESULT=fail>

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
hp-11A-G6-EE-grunt           | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...ok+kselftest | 1          

  Details:     https://kernelci.org/test/plan/id/641d3e9347e1ee582a9c9522

  Results:     18 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook+kselftest
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230324/x86_64/x86_64_defconfig+x86-chromebook+kselftest/gcc-10/lab-collabora/baseline-hp-11A-G6-EE-grunt.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230324/x86_64/x86_64_defconfig+x86-chromebook+kselftest/gcc-10/lab-collabora/baseline-hp-11A-G6-EE-grunt.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/x86/rootfs.cpio.gz 

  * baseline.bootrr.battery-device-probed: https://kernelci.org/test/case/id/641d3e9347e1ee582a9c9531
        failing since 2 days (last pass: next-20230320, first fail: next-20230321)

    2023-03-24T06:09:16.686944  /lava-9757689/1/../bin/lava-test-case

    2023-03-24T06:09:16.703664  <8>[   15.249559] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=battery-device-probed RESULT=fail>

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
hp-11A-G6-EE-grunt           | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...ebook+amdgpu | 1          

  Details:     https://kernelci.org/test/plan/id/641d3fe723311cfd139c954f

  Results:     18 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook+amdgpu
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230324/x86_64/x86_64_defconfig+x86-chromebook+amdgpu/gcc-10/lab-collabora/baseline-hp-11A-G6-EE-grunt.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230324/x86_64/x86_64_defconfig+x86-chromebook+amdgpu/gcc-10/lab-collabora/baseline-hp-11A-G6-EE-grunt.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/x86/rootfs.cpio.gz 

  * baseline.bootrr.battery-device-probed: https://kernelci.org/test/case/id/641d3fe723311cfd139c955e
        failing since 2 days (last pass: next-20230320, first fail: next-20230321)

    2023-03-24T06:14:42.990276  /lava-9757756/1/../bin/lava-test-case

    2023-03-24T06:14:42.998049  <8>[   12.107439] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=battery-device-probed RESULT=fail>

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
hp-11A-G6-EE-grunt           | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...6-chromebook | 1          

  Details:     https://kernelci.org/test/plan/id/641d42cea684fed7389c9572

  Results:     17 PASS, 1 FAIL, 1 SKIP
  Full config: x86_64_defconfig+x86-chromebook
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230324/x86_64/x86_64_defconfig+x86-chromebook/gcc-10/lab-collabora/baseline-hp-11A-G6-EE-grunt.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230324/x86_64/x86_64_defconfig+x86-chromebook/gcc-10/lab-collabora/baseline-hp-11A-G6-EE-grunt.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/x86/rootfs.cpio.gz 

  * baseline.bootrr.battery-device-probed: https://kernelci.org/test/case/id/641d42cea684fed7389c9581
        failing since 2 days (last pass: next-20230320, first fail: next-20230321)

    2023-03-24T06:27:20.595016  /lava-9757969/1/../bin/lava-test-case

    2023-03-24T06:27:20.602398  <8>[   10.761824] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=battery-device-probed RESULT=fail>

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
hp-14-db0003na-grunt         | x86_64 | lab-collabora   | clang-13 | x86_64_defcon...6-chromebook | 1          

  Details:     https://kernelci.org/test/plan/id/641d43760e5d7236549c9507

  Results:     18 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook
  Compiler:    clang-13 (Debian clang version 13.0.1-6~deb11u1)
  Plain log:   https://storage.kernelci.org//next/master/next-20230324/x86_64/x86_64_defconfig+x86-chromebook/clang-13/lab-collabora/baseline-hp-14-db0003na-grunt.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230324/x86_64/x86_64_defconfig+x86-chromebook/clang-13/lab-collabora/baseline-hp-14-db0003na-grunt.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/x86/rootfs.cpio.gz 

  * baseline.bootrr.battery-device-probed: https://kernelci.org/test/case/id/641d43760e5d7236549c9516
        failing since 2 days (last pass: next-20230316, first fail: next-20230321)

    2023-03-24T06:29:52.377126  /lava-9758298/1/../bin/lava-test-case

    2023-03-24T06:29:52.393516  <8>[   13.600573] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=battery-device-probed RESULT=fail>

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
hp-14-db0003na-grunt         | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...ok+kselftest | 1          

  Details:     https://kernelci.org/test/plan/id/641d3e896b2425673f9c9505

  Results:     18 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook+kselftest
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230324/x86_64/x86_64_defconfig+x86-chromebook+kselftest/gcc-10/lab-collabora/baseline-hp-14-db0003na-grunt.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230324/x86_64/x86_64_defconfig+x86-chromebook+kselftest/gcc-10/lab-collabora/baseline-hp-14-db0003na-grunt.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/x86/rootfs.cpio.gz 

  * baseline.bootrr.battery-device-probed: https://kernelci.org/test/case/id/641d3e896b2425673f9c9514
        failing since 2 days (last pass: next-20230320, first fail: next-20230321)

    2023-03-24T06:09:09.218780  /lava-9757700/1/../bin/lava-test-case

    2023-03-24T06:09:09.234866  <8>[   15.339013] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=battery-device-probed RESULT=fail>

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
hp-14-db0003na-grunt         | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...ebook+amdgpu | 1          

  Details:     https://kernelci.org/test/plan/id/641d3fdde1da34512b9c9507

  Results:     18 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook+amdgpu
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230324/x86_64/x86_64_defconfig+x86-chromebook+amdgpu/gcc-10/lab-collabora/baseline-hp-14-db0003na-grunt.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230324/x86_64/x86_64_defconfig+x86-chromebook+amdgpu/gcc-10/lab-collabora/baseline-hp-14-db0003na-grunt.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/x86/rootfs.cpio.gz 

  * baseline.bootrr.battery-device-probed: https://kernelci.org/test/case/id/641d3fdde1da34512b9c9516
        failing since 2 days (last pass: next-20230320, first fail: next-20230321)

    2023-03-24T06:14:27.172721  /lava-9757789/1/../bin/lava-test-case

    2023-03-24T06:14:27.179850  <8>[   11.861308] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=battery-device-probed RESULT=fail>

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
hp-14-db0003na-grunt         | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...6-chromebook | 1          

  Details:     https://kernelci.org/test/plan/id/641d4279daba2d067a9c9514

  Results:     18 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230324/x86_64/x86_64_defconfig+x86-chromebook/gcc-10/lab-collabora/baseline-hp-14-db0003na-grunt.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230324/x86_64/x86_64_defconfig+x86-chromebook/gcc-10/lab-collabora/baseline-hp-14-db0003na-grunt.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/x86/rootfs.cpio.gz 

  * baseline.bootrr.battery-device-probed: https://kernelci.org/test/case/id/641d4279daba2d067a9c9523
        failing since 2 days (last pass: next-20230320, first fail: next-20230321)

    2023-03-24T06:25:35.326814  /lava-9758043/1/../bin/lava-test-case

    2023-03-24T06:25:35.333251  <8>[   11.667126] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=battery-device-probed RESULT=fail>

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
imx6qp-wandboard-revd1       | arm    | lab-pengutronix | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/641d454445b670c8ba9c956e

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230324/arm/multi_v7_defconfig+debug/gcc-10/lab-pengutronix/baseline-imx6qp-wandboard-revd1.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230324/arm/multi_v7_defconfig+debug/gcc-10/lab-pengutronix/baseline-imx6qp-wandboard-revd1.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d454445b670c8ba9c956f
        failing since 213 days (last pass: next-20220810, first fail: next-20220822) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
jetson-tk1                   | arm    | lab-baylibre    | gcc-10   | multi_v7_defc...G_ARM_LPAE=y | 1          

  Details:     https://kernelci.org/test/plan/id/641d429767d79d3c1e9c9543

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230324/arm/multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y/gcc-10/lab-baylibre/baseline-jetson-tk1.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230324/arm/multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y/gcc-10/lab-baylibre/baseline-jetson-tk1.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d429767d79d3c1e9c9544
        failing since 346 days (last pass: next-20220401, first fail: next-20220411) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
meson-g12a-sei510            | arm64  | lab-baylibre    | gcc-10   | defconfig                    | 1          

  Details:     https://kernelci.org/test/plan/id/641d416cc274ffae9c9c951f

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig/gcc-10/lab-baylibre/baseline-meson-g12a-sei510.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig/gcc-10/lab-baylibre/baseline-meson-g12a-sei510.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d416cc274ffae9c9c9520
        new failure (last pass: next-20230322) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
meson-g12a-sei510            | arm64  | lab-baylibre    | gcc-10   | defconfig+crypto             | 1          

  Details:     https://kernelci.org/test/plan/id/641d44eff35b8714099c96d5

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+crypto
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig+crypto/gcc-10/lab-baylibre/baseline-meson-g12a-sei510.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig+crypto/gcc-10/lab-baylibre/baseline-meson-g12a-sei510.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d44eff35b8714099c96d6
        failing since 1 day (last pass: next-20230322, first fail: next-20230323) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
meson-g12a-u200              | arm64  | lab-baylibre    | gcc-10   | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/641d42d07cf35053e59c955e

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-g12a-u200.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-g12a-u200.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d42d07cf35053e59c955f
        failing since 44 days (last pass: next-20230206, first fail: next-20230207) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
meson-g12a-x96-max           | arm64  | lab-baylibre    | gcc-10   | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/641d430146257507859c952d

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-g12a-x96-max.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-g12a-x96-max.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d430146257507859c952e
        failing since 58 days (last pass: next-20230124, first fail: next-20230125) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
meson-g12a-x96-max           | arm64  | lab-baylibre    | gcc-10   | defconfig+crypto             | 1          

  Details:     https://kernelci.org/test/plan/id/641d464a55d998cb049c9510

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+crypto
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig+crypto/gcc-10/lab-baylibre/baseline-meson-g12a-x96-max.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig+crypto/gcc-10/lab-baylibre/baseline-meson-g12a-x96-max.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d464a55d998cb049c9511
        failing since 1 day (last pass: next-20230322, first fail: next-20230323) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
meson-g12b-a311d-khadas-vim3 | arm64  | lab-baylibre    | gcc-10   | defconfig                    | 1          

  Details:     https://kernelci.org/test/plan/id/641d4259a57b8efce69c9518

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig/gcc-10/lab-baylibre/baseline-meson-g12b-a311d-khadas-vim3.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig/gcc-10/lab-baylibre/baseline-meson-g12b-a311d-khadas-vim3.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d4259a57b8efce69c9519
        new failure (last pass: next-20230322) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
meson-g12b-a311d-khadas-vim3 | arm64  | lab-baylibre    | gcc-10   | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/641d4463f3fe3eb5cc9c95d7

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-g12b-a311d-khadas-vim3.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-g12b-a311d-khadas-vim3.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d4463f3fe3eb5cc9c95d8
        failing since 58 days (last pass: next-20230124, first fail: next-20230125) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
meson-g12b-a311d-khadas-vim3 | arm64  | lab-collabora   | gcc-10   | defconfig+ima                | 1          

  Details:     https://kernelci.org/test/plan/id/641d4197113cc7c6009c956a

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+ima
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig+ima/gcc-10/lab-collabora/baseline-meson-g12b-a311d-khadas-vim3.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig+ima/gcc-10/lab-collabora/baseline-meson-g12b-a311d-khadas-vim3.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d4197113cc7c6009c956b
        failing since 1 day (last pass: next-20230322, first fail: next-20230323) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
meson-g12b-a311d-khadas-vim3 | arm64  | lab-collabora   | gcc-10   | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/641d44030526e2a1b09c95e3

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig+kselftest/gcc-10/lab-collabora/baseline-meson-g12b-a311d-khadas-vim3.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig+kselftest/gcc-10/lab-collabora/baseline-meson-g12b-a311d-khadas-vim3.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d44030526e2a1b09c95e4
        failing since 58 days (last pass: next-20230124, first fail: next-20230125) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
meson-g12b-odroid-n2         | arm64  | lab-baylibre    | gcc-10   | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/641d42e7d24cab16739c9539

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-g12b-odroid-n2.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-g12b-odroid-n2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d42e7d24cab16739c953a
        failing since 45 days (last pass: next-20230203, first fail: next-20230206) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
meson-gxbb-nanopi-k2         | arm64  | lab-baylibre    | gcc-10   | defconfig                    | 1          

  Details:     https://kernelci.org/test/plan/id/641d416ec274ffae9c9c9525

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig/gcc-10/lab-baylibre/baseline-meson-gxbb-nanopi-k2.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig/gcc-10/lab-baylibre/baseline-meson-gxbb-nanopi-k2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d416ec274ffae9c9c9526
        new failure (last pass: next-20230322) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
meson-gxbb-nanopi-k2         | arm64  | lab-baylibre    | gcc-10   | defconfig+ima                | 1          

  Details:     https://kernelci.org/test/plan/id/641d42d59496aaa1499c9509

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+ima
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig+ima/gcc-10/lab-baylibre/baseline-meson-gxbb-nanopi-k2.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig+ima/gcc-10/lab-baylibre/baseline-meson-gxbb-nanopi-k2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d42d59496aaa1499c950a
        failing since 1 day (last pass: next-20230322, first fail: next-20230323) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
meson-gxbb-nanopi-k2         | arm64  | lab-baylibre    | gcc-10   | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/641d44436f5c5b54c79c9593

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-gxbb-nanopi-k2.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-gxbb-nanopi-k2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d44436f5c5b54c79c9594
        failing since 44 days (last pass: next-20230206, first fail: next-20230207) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
meson-gxl-s905d-p230         | arm64  | lab-baylibre    | gcc-10   | defconfig                    | 1          

  Details:     https://kernelci.org/test/plan/id/641d418ea9f3007d359c9580

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig/gcc-10/lab-baylibre/baseline-meson-gxl-s905d-p230.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig/gcc-10/lab-baylibre/baseline-meson-gxl-s905d-p230.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d418ea9f3007d359c9581
        new failure (last pass: next-20230322) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
meson-gxl-s905d-p230         | arm64  | lab-baylibre    | gcc-10   | defconfig+ima                | 1          

  Details:     https://kernelci.org/test/plan/id/641d42fd46257507859c951f

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+ima
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig+ima/gcc-10/lab-baylibre/baseline-meson-gxl-s905d-p230.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig+ima/gcc-10/lab-baylibre/baseline-meson-gxl-s905d-p230.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d42fd46257507859c9520
        failing since 1 day (last pass: next-20230322, first fail: next-20230323) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
meson-gxl-s905d-p230         | arm64  | lab-baylibre    | gcc-10   | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/641d44906d6fb5201b9c9505

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-gxl-s905d-p230.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-gxl-s905d-p230.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d44906d6fb5201b9c9506
        failing since 44 days (last pass: next-20230203, first fail: next-20230207) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
meson-gxl-s905d-p230         | arm64  | lab-baylibre    | gcc-10   | defconfig+debug              | 1          

  Details:     https://kernelci.org/test/plan/id/641d4578421f16766d9c9506

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+debug
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig+debug/gcc-10/lab-baylibre/baseline-meson-gxl-s905d-p230.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig+debug/gcc-10/lab-baylibre/baseline-meson-gxl-s905d-p230.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d4578421f16766d9c9507
        failing since 1 day (last pass: next-20230322, first fail: next-20230323) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
meson-gxl-s905d-p230         | arm64  | lab-baylibre    | gcc-10   | defconfig+crypto             | 1          

  Details:     https://kernelci.org/test/plan/id/641d47237e634965f19c9513

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+crypto
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig+crypto/gcc-10/lab-baylibre/baseline-meson-gxl-s905d-p230.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig+crypto/gcc-10/lab-baylibre/baseline-meson-gxl-s905d-p230.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d47237e634965f19c9514
        failing since 1 day (last pass: next-20230322, first fail: next-20230323) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
meson-gxl-s905x-khadas-vim   | arm64  | lab-baylibre    | gcc-10   | defconfig                    | 1          

  Details:     https://kernelci.org/test/plan/id/641d416dc274ffae9c9c9522

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig/gcc-10/lab-baylibre/baseline-meson-gxl-s905x-khadas-vim.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig/gcc-10/lab-baylibre/baseline-meson-gxl-s905x-khadas-vim.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d416dc274ffae9c9c9523
        new failure (last pass: next-20230322) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
meson-gxl-s905x-khadas-vim   | arm64  | lab-baylibre    | gcc-10   | defconfig+ima                | 1          

  Details:     https://kernelci.org/test/plan/id/641d42d4146e664ce09c9597

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+ima
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig+ima/gcc-10/lab-baylibre/baseline-meson-gxl-s905x-khadas-vim.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig+ima/gcc-10/lab-baylibre/baseline-meson-gxl-s905x-khadas-vim.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d42d4146e664ce09c9598
        failing since 1 day (last pass: next-20230322, first fail: next-20230323) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
meson-gxl-s905x-khadas-vim   | arm64  | lab-baylibre    | gcc-10   | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/641d4441da79dfcad69c9509

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-gxl-s905x-khadas-vim.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-gxl-s905x-khadas-vim.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d4441da79dfcad69c950a
        failing since 44 days (last pass: next-20230206, first fail: next-20230207) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
meson-gxl-s905x-khadas-vim   | arm64  | lab-baylibre    | gcc-10   | defconfig+crypto             | 1          

  Details:     https://kernelci.org/test/plan/id/641d469bb51a9eed809c9556

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+crypto
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig+crypto/gcc-10/lab-baylibre/baseline-meson-gxl-s905x-khadas-vim.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig+crypto/gcc-10/lab-baylibre/baseline-meson-gxl-s905x-khadas-vim.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d469bb51a9eed809c9557
        failing since 1 day (last pass: next-20230322, first fail: next-20230323) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
meson-gxl-s905x-libretech-cc | arm64  | lab-baylibre    | gcc-10   | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/641d430f5adc4212819c958b

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-gxl-s905x-libretech-cc.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-gxl-s905x-libretech-cc.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d430f5adc4212819c958c
        failing since 44 days (last pass: next-20230206, first fail: next-20230207) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
meson-gxl-s905x-libretech-cc | arm64  | lab-broonie     | gcc-10   | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/641d42d9b48a0dad0a9c9507

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig+kselftest/gcc-10/lab-broonie/baseline-meson-gxl-s905x-libretech-cc.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig+kselftest/gcc-10/lab-broonie/baseline-meson-gxl-s905x-libretech-cc.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d42d9b48a0dad0a9c9508
        failing since 44 days (last pass: next-20230206, first fail: next-20230207) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
meson-gxm-khadas-vim2        | arm64  | lab-baylibre    | gcc-10   | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/641d42ecd24cab16739c9550

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-gxm-khadas-vim2.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-gxm-khadas-vim2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d42ecd24cab16739c9551
        failing since 44 days (last pass: next-20230206, first fail: next-20230207) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
meson-gxm-khadas-vim2        | arm64  | lab-baylibre    | gcc-10   | defconfig+crypto             | 1          

  Details:     https://kernelci.org/test/plan/id/641d446c8b258ec0649c9525

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+crypto
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig+crypto/gcc-10/lab-baylibre/baseline-meson-gxm-khadas-vim2.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig+crypto/gcc-10/lab-baylibre/baseline-meson-gxm-khadas-vim2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d446c8b258ec0649c9526
        failing since 1 day (last pass: next-20230322, first fail: next-20230323) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
meson-sm1-khadas-vim3l       | arm64  | lab-baylibre    | gcc-10   | defconfig                    | 1          

  Details:     https://kernelci.org/test/plan/id/641d41a7113cc7c6009c95db

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig/gcc-10/lab-baylibre/baseline-meson-sm1-khadas-vim3l.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig/gcc-10/lab-baylibre/baseline-meson-sm1-khadas-vim3l.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d41a7113cc7c6009c95dc
        new failure (last pass: next-20230322) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
meson-sm1-khadas-vim3l       | arm64  | lab-baylibre    | gcc-10   | defconfig+ima                | 1          

  Details:     https://kernelci.org/test/plan/id/641d430d5adc4212819c9588

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+ima
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig+ima/gcc-10/lab-baylibre/baseline-meson-sm1-khadas-vim3l.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig+ima/gcc-10/lab-baylibre/baseline-meson-sm1-khadas-vim3l.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d430d5adc4212819c9589
        failing since 1 day (last pass: next-20230322, first fail: next-20230323) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
meson-sm1-sei610             | arm64  | lab-baylibre    | gcc-10   | defconfig                    | 1          

  Details:     https://kernelci.org/test/plan/id/641d416ac274ffae9c9c9511

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig/gcc-10/lab-baylibre/baseline-meson-sm1-sei610.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig/gcc-10/lab-baylibre/baseline-meson-sm1-sei610.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d416ac274ffae9c9c9512
        new failure (last pass: next-20230322) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
meson-sm1-sei610             | arm64  | lab-baylibre    | gcc-10   | defconfig+crypto             | 1          

  Details:     https://kernelci.org/test/plan/id/641d450447e17d154c9c9602

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+crypto
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig+crypto/gcc-10/lab-baylibre/baseline-meson-sm1-sei610.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig+crypto/gcc-10/lab-baylibre/baseline-meson-sm1-sei610.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d450447e17d154c9c9603
        failing since 1 day (last pass: next-20230322, first fail: next-20230323) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
mt8173-elm-hana              | arm64  | lab-collabora   | gcc-10   | defconfig+arm...ok+kselftest | 1          

  Details:     https://kernelci.org/test/plan/id/641d44946d6fb5201b9c9565

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig+arm64-chromebook+kselftest/gcc-10/lab-collabora/baseline-mt8173-elm-hana.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig+arm64-chromebook+kselftest/gcc-10/lab-collabora/baseline-mt8173-elm-hana.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d44946d6fb5201b9c9566
        failing since 58 days (last pass: next-20230123, first fail: next-20230124) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
mt8183-kukui-...uniper-sku16 | arm64  | lab-collabora   | clang-13 | cros://chrome...4-chromebook | 1          

  Details:     https://kernelci.org/test/plan/id/641d47277e634965f19c952c

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: cros://chromeos-5.10/arm64/chromiumos-arm64.flavour.config+arm64-chromebook
  Compiler:    clang-13 (Debian clang version 13.0.1-6~deb11u1)
  Plain log:   https://storage.kernelci.org//next/master/next-20230324/arm64/cros---chromeos-5.10-arm64-chromiumos-arm64.flavour.config+arm64-chromebook/clang-13/lab-collabora/baseline-mt8183-kukui-jacuzzi-juniper-sku16.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230324/arm64/cros---chromeos-5.10-arm64-chromiumos-arm64.flavour.config+arm64-chromebook/clang-13/lab-collabora/baseline-mt8183-kukui-jacuzzi-juniper-sku16.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d47277e634965f19c952d
        failing since 55 days (last pass: next-20230120, first fail: next-20230127) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
mt8183-kukui-...uniper-sku16 | arm64  | lab-collabora   | clang-13 | cros://chrome...4-chromebook | 1          

  Details:     https://kernelci.org/test/plan/id/641d483f6272e769ce9c956b

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: cros://chromeos-5.10/arm64/chromiumos-mediatek.flavour.config+arm64-chromebook
  Compiler:    clang-13 (Debian clang version 13.0.1-6~deb11u1)
  Plain log:   https://storage.kernelci.org//next/master/next-20230324/arm64/cros---chromeos-5.10-arm64-chromiumos-mediatek.flavour.config+arm64-chromebook/clang-13/lab-collabora/baseline-mt8183-kukui-jacuzzi-juniper-sku16.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230324/arm64/cros---chromeos-5.10-arm64-chromiumos-mediatek.flavour.config+arm64-chromebook/clang-13/lab-collabora/baseline-mt8183-kukui-jacuzzi-juniper-sku16.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d483f6272e769ce9c956c
        failing since 58 days (last pass: next-20230123, first fail: next-20230124) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
mt8183-kukui-...uniper-sku16 | arm64  | lab-collabora   | gcc-10   | defconfig+arm...ok+kselftest | 1          

  Details:     https://kernelci.org/test/plan/id/641d44928d1f06c96e9c9516

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig+arm64-chromebook+kselftest/gcc-10/lab-collabora/baseline-mt8183-kukui-jacuzzi-juniper-sku16.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig+arm64-chromebook+kselftest/gcc-10/lab-collabora/baseline-mt8183-kukui-jacuzzi-juniper-sku16.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d44928d1f06c96e9c9517
        failing since 44 days (last pass: next-20230206, first fail: next-20230208) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
mt8192-asurada-spherion-r0   | arm64  | lab-collabora   | clang-13 | cros://chrome...4-chromebook | 1          

  Details:     https://kernelci.org/test/plan/id/641d46a4b51a9eed809c9567

  Results:     177 PASS, 8 FAIL, 0 SKIP
  Full config: cros://chromeos-5.10/arm64/chromiumos-mediatek.flavour.config+arm64-chromebook
  Compiler:    clang-13 (Debian clang version 13.0.1-6~deb11u1)
  Plain log:   https://storage.kernelci.org//next/master/next-20230324/arm64/cros---chromeos-5.10-arm64-chromiumos-mediatek.flavour.config+arm64-chromebook/clang-13/lab-collabora/baseline-mt8192-asurada-spherion-r0.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230324/arm64/cros---chromeos-5.10-arm64-chromiumos-mediatek.flavour.config+arm64-chromebook/clang-13/lab-collabora/baseline-mt8192-asurada-spherion-r0.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/arm64/rootfs.cpio.gz 

  * baseline.bootrr.clk-mt8192-apmixedsys-probed: https://kernelci.org/test/case/id/641d46a4b51a9eed809c961b
        failing since 2 days (last pass: next-20230316, first fail: next-20230321)

    2023-03-24T06:43:21.186691  /lava-9758805/1/../bin/lava-test-case

    2023-03-24T06:43:21.193708  <8>[    5.887399] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=clk-mt8192-apmixedsys-probed RESULT=fail>

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
mt8192-asurada-spherion-r0   | arm64  | lab-collabora   | gcc-10   | defconfig+arm...ok+kselftest | 1          

  Details:     https://kernelci.org/test/plan/id/641d4487cc489164c89c9631

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig+arm64-chromebook+kselftest/gcc-10/lab-collabora/baseline-mt8192-asurada-spherion-r0.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig+arm64-chromebook+kselftest/gcc-10/lab-collabora/baseline-mt8192-asurada-spherion-r0.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d4487cc489164c89c9632
        failing since 44 days (last pass: next-20230206, first fail: next-20230208) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
ox820-clouden...lug-series-3 | arm    | lab-baylibre    | gcc-10   | oxnas_v6_defconfig           | 1          

  Details:     https://kernelci.org/test/plan/id/641d3fa0c24e8ce5d49c9559

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: oxnas_v6_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230324/arm/oxnas_v6_defconfig/gcc-10/lab-baylibre/baseline-ox820-cloudengines-pogoplug-series-3.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230324/arm/oxnas_v6_defconfig/gcc-10/lab-baylibre/baseline-ox820-cloudengines-pogoplug-series-3.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d3fa0c24e8ce5d49c955a
        failing since 212 days (last pass: next-20220822, first fail: next-20220823) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
qcom-qdf2400                 | arm64  | lab-linaro-lkft | gcc-10   | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/641d4c8a500c1d7b069c9521

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig+kselftest/gcc-10/lab-linaro-lkft/baseline-qcom-qdf2400.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig+kselftest/gcc-10/lab-linaro-lkft/baseline-qcom-qdf2400.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d4c8a500c1d7b069c9522
        failing since 44 days (last pass: next-20230206, first fail: next-20230207) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
qcom-qdf2400                 | arm64  | lab-linaro-lkft | gcc-10   | defconfig+arm...ok+kselftest | 1          

  Details:     https://kernelci.org/test/plan/id/641d50b0170fb61b349c9514

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig+arm64-chromebook+kselftest/gcc-10/lab-linaro-lkft/baseline-qcom-qdf2400.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig+arm64-chromebook+kselftest/gcc-10/lab-linaro-lkft/baseline-qcom-qdf2400.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d50b0170fb61b349c9515
        failing since 44 days (last pass: next-20230206, first fail: next-20230208) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
qemu_arm-virt-gicv2          | arm    | lab-baylibre    | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/641d4624cf31dccd0b9c9531

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230324/arm/multi_v7_defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_arm-virt-gicv2.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230324/arm/multi_v7_defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_arm-virt-gicv2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d4624cf31dccd0b9c9532
        failing since 191 days (last pass: next-20220907, first fail: next-20220913) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
qemu_arm-virt-gicv2          | arm    | lab-broonie     | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/641d4698b51a9eed809c9507

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230324/arm/multi_v7_defconfig+debug/gcc-10/lab-broonie/baseline-qemu_arm-virt-gicv2.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230324/arm/multi_v7_defconfig+debug/gcc-10/lab-broonie/baseline-qemu_arm-virt-gicv2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d4698b51a9eed809c9508
        failing since 191 days (last pass: next-20220907, first fail: next-20220913) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
qemu_arm-virt-gicv2          | arm    | lab-collabora   | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/641d4583f0ecf5aa759c9528

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230324/arm/multi_v7_defconfig+debug/gcc-10/lab-collabora/baseline-qemu_arm-virt-gicv2.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230324/arm/multi_v7_defconfig+debug/gcc-10/lab-collabora/baseline-qemu_arm-virt-gicv2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d4583f0ecf5aa759c9529
        failing since 191 days (last pass: next-20220907, first fail: next-20220913) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
qemu_arm-virt-gicv2-uefi     | arm    | lab-baylibre    | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/641d45e1409febc7969c95e9

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230324/arm/multi_v7_defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_arm-virt-gicv2-uefi.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230324/arm/multi_v7_defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_arm-virt-gicv2-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d45e1409febc7969c95ea
        failing since 189 days (last pass: next-20220907, first fail: next-20220915) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
qemu_arm-virt-gicv2-uefi     | arm    | lab-broonie     | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/641d4647ee554c513f9c9522

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230324/arm/multi_v7_defconfig+debug/gcc-10/lab-broonie/baseline-qemu_arm-virt-gicv2-uefi.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230324/arm/multi_v7_defconfig+debug/gcc-10/lab-broonie/baseline-qemu_arm-virt-gicv2-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d4647ee554c513f9c9523
        failing since 189 days (last pass: next-20220907, first fail: next-20220915) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
qemu_arm-virt-gicv2-uefi     | arm    | lab-collabora   | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/641d455b3ad7dd99a79c956f

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230324/arm/multi_v7_defconfig+debug/gcc-10/lab-collabora/baseline-qemu_arm-virt-gicv2-uefi.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230324/arm/multi_v7_defconfig+debug/gcc-10/lab-collabora/baseline-qemu_arm-virt-gicv2-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d455b3ad7dd99a79c9570
        failing since 189 days (last pass: next-20220907, first fail: next-20220915) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
qemu_arm-virt-gicv3          | arm    | lab-baylibre    | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/641d45e2409febc7969c95ec

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230324/arm/multi_v7_defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_arm-virt-gicv3.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230324/arm/multi_v7_defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_arm-virt-gicv3.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d45e2409febc7969c95ed
        failing since 189 days (last pass: next-20220907, first fail: next-20220915) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
qemu_arm-virt-gicv3          | arm    | lab-broonie     | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/641d465b87a06f16dc9c9517

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230324/arm/multi_v7_defconfig+debug/gcc-10/lab-broonie/baseline-qemu_arm-virt-gicv3.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230324/arm/multi_v7_defconfig+debug/gcc-10/lab-broonie/baseline-qemu_arm-virt-gicv3.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d465b87a06f16dc9c9518
        failing since 189 days (last pass: next-20220907, first fail: next-20220915) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
qemu_arm-virt-gicv3          | arm    | lab-collabora   | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/641d455c3ad7dd99a79c9575

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230324/arm/multi_v7_defconfig+debug/gcc-10/lab-collabora/baseline-qemu_arm-virt-gicv3.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230324/arm/multi_v7_defconfig+debug/gcc-10/lab-collabora/baseline-qemu_arm-virt-gicv3.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d455c3ad7dd99a79c9576
        failing since 189 days (last pass: next-20220907, first fail: next-20220915) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
qemu_arm-virt-gicv3-uefi     | arm    | lab-baylibre    | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/641d4622cf31dccd0b9c952b

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230324/arm/multi_v7_defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_arm-virt-gicv3-uefi.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230324/arm/multi_v7_defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_arm-virt-gicv3-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d4622cf31dccd0b9c952c
        failing since 191 days (last pass: next-20220907, first fail: next-20220913) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
qemu_arm-virt-gicv3-uefi     | arm    | lab-broonie     | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/641d4697ec7c6e43b19c9516

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230324/arm/multi_v7_defconfig+debug/gcc-10/lab-broonie/baseline-qemu_arm-virt-gicv3-uefi.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230324/arm/multi_v7_defconfig+debug/gcc-10/lab-broonie/baseline-qemu_arm-virt-gicv3-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d4697ec7c6e43b19c9517
        failing since 191 days (last pass: next-20220907, first fail: next-20220913) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
qemu_arm-virt-gicv3-uefi     | arm    | lab-collabora   | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/641d45623ad7dd99a79c9581

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230324/arm/multi_v7_defconfig+debug/gcc-10/lab-collabora/baseline-qemu_arm-virt-gicv3-uefi.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230324/arm/multi_v7_defconfig+debug/gcc-10/lab-collabora/baseline-qemu_arm-virt-gicv3-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d45623ad7dd99a79c9582
        failing since 191 days (last pass: next-20220907, first fail: next-20220913) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
qemu_arm64-virt-gicv2        | arm64  | lab-baylibre    | gcc-10   | defconfig+debug              | 1          

  Details:     https://kernelci.org/test/plan/id/641d44946d6fb5201b9c9568

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+debug
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_arm64-virt-gicv2.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_arm64-virt-gicv2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d44946d6fb5201b9c9569
        failing since 1 day (last pass: next-20230322, first fail: next-20230323) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
qemu_arm64-virt-gicv2        | arm64  | lab-collabora   | gcc-10   | defconfig+debug              | 1          

  Details:     https://kernelci.org/test/plan/id/641d43fa0526e2a1b09c9583

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+debug
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig+debug/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv2.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig+debug/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d43fa0526e2a1b09c9584
        failing since 1 day (last pass: next-20230322, first fail: next-20230323) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
r8a7743-iwg20d-q7            | arm    | lab-cip         | gcc-10   | shmobile_defconfig           | 1          

  Details:     https://kernelci.org/test/plan/id/641d400b4fe3565dc99c951a

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: shmobile_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230324/arm/shmobile_defconfig/gcc-10/lab-cip/baseline-r8a7743-iwg20d-q7.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230324/arm/shmobile_defconfig/gcc-10/lab-cip/baseline-r8a7743-iwg20d-q7.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d400b4fe3565dc99c951b
        failing since 9 days (last pass: next-20230310, first fail: next-20230315) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
r8a77960-ulcb                | arm64  | lab-collabora   | gcc-10   | defconfig                    | 1          

  Details:     https://kernelci.org/test/plan/id/641d408b1107e00fbb9c9511

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig/gcc-10/lab-collabora/baseline-r8a77960-ulcb.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig/gcc-10/lab-collabora/baseline-r8a77960-ulcb.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/arm64/rootfs.cpio.gz 

  * baseline.bootrr.all-cpus-are-online: https://kernelci.org/test/case/id/641d408c1107e00fbb9c9519
        failing since 36 days (last pass: next-20230214, first fail: next-20230215)

    2023-03-24T06:17:24.558704  /lava-9757795/1/../bin/lava-test-case

    2023-03-24T06:17:24.606777  <8>[   35.507557] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=all-cpus-are-online RESULT=fail>

    2023-03-24T06:17:24.607294  /lava-9757795/1/../bin/lava-test-case

    2023-03-24T06:17:24.607735  <8>[   35.523282] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=tpm-chip-is-online RESULT=skip>

    2023-03-24T06:17:24.608187  + set +x

    2023-03-24T06:17:24.608616  <8>[   35.536748] <LAVA_SIGNAL_ENDRUN 1_bootrr 9757795_1.5.2.4.5>

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
r8a77960-ulcb                | arm64  | lab-collabora   | gcc-10   | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/641d4246a1e0b7d3329c9562

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig+kselftest/gcc-10/lab-collabora/baseline-r8a77960-ulcb.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig+kselftest/gcc-10/lab-collabora/baseline-r8a77960-ulcb.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/arm64/rootfs.cpio.gz 

  * baseline.bootrr.all-cpus-are-online: https://kernelci.org/test/case/id/641d4247a1e0b7d3329c956a
        failing since 36 days (last pass: next-20230214, first fail: next-20230215)

    2023-03-24T06:24:59.275365  /lava-9757936/1/../bin/lava-test-case

    2023-03-24T06:24:59.315506  <8>[  125.295826] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=all-cpus-are-online RESULT=fail>

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
rk3288-rock2-square          | arm    | lab-collabora   | gcc-10   | multi_v7_defc...G_ARM_LPAE=y | 1          

  Details:     https://kernelci.org/test/plan/id/641d4334a50aa8c8d79c9531

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230324/arm/multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y/gcc-10/lab-collabora/baseline-rk3288-rock2-square.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230324/arm/multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y/gcc-10/lab-collabora/baseline-rk3288-rock2-square.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d4334a50aa8c8d79c9532
        failing since 121 days (last pass: next-20221121, first fail: next-20221122) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
rk3288-veyron-jaq            | arm    | lab-collabora   | gcc-10   | multi_v7_defc...G_ARM_LPAE=y | 1          

  Details:     https://kernelci.org/test/plan/id/641d42482dbfade6279c9506

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230324/arm/multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y/gcc-10/lab-collabora/baseline-rk3288-veyron-jaq.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230324/arm/multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y/gcc-10/lab-collabora/baseline-rk3288-veyron-jaq.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d42482dbfade6279c9507
        failing since 121 days (last pass: next-20221121, first fail: next-20221122) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
rk3399-gru-kevin             | arm64  | lab-collabora   | clang-13 | cros://chrome...4-chromebook | 2          

  Details:     https://kernelci.org/test/plan/id/641d4669a0d31baf089c9512

  Results:     77 PASS, 5 FAIL, 1 SKIP
  Full config: cros://chromeos-5.10/arm64/chromiumos-rockchip64.flavour.config+arm64-chromebook
  Compiler:    clang-13 (Debian clang version 13.0.1-6~deb11u1)
  Plain log:   https://storage.kernelci.org//next/master/next-20230324/arm64/cros---chromeos-5.10-arm64-chromiumos-rockchip64.flavour.config+arm64-chromebook/clang-13/lab-collabora/baseline-rk3399-gru-kevin.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230324/arm64/cros---chromeos-5.10-arm64-chromiumos-rockchip64.flavour.config+arm64-chromebook/clang-13/lab-collabora/baseline-rk3399-gru-kevin.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/arm64/rootfs.cpio.gz 

  * baseline.bootrr.cros-ec-sensors-driver-present: https://kernelci.org/test/case/id/641d466aa0d31baf089c9555
        new failure (last pass: next-20230321)

    2023-03-24T06:42:31.164455  /lava-9758694/1/../bin/lava-test-case

    2023-03-24T06:42:31.176742  <8>[   19.842226] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=cros-ec-sensors-driver-present RESULT=fail>

  * baseline.bootrr.cros-ec-rtc-probed: https://kernelci.org/test/case/id/641d466aa0d31baf089c9556
        new failure (last pass: next-20230321)

    2023-03-24T06:42:29.564750  <4>[   18.229716] cdn-dp fec00000.dp: Direct firmware load for rockchip/dptx.bin failed with error -2

    2023-03-24T06:42:30.138988  /lava-9758694/1/../bin/lava-test-case

    2023-03-24T06:42:30.147730  <8>[   18.814045] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=cros-ec-rtc-probed RESULT=fail>

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
rk3399-gru-kevin             | arm64  | lab-collabora   | gcc-10   | defconfig+arm...ok+kselftest | 1          

  Details:     https://kernelci.org/test/plan/id/641d4420562c6166849c9506

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig+arm64-chromebook+kselftest/gcc-10/lab-collabora/baseline-rk3399-gru-kevin.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig+arm64-chromebook+kselftest/gcc-10/lab-collabora/baseline-rk3399-gru-kevin.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d4420562c6166849c9507
        failing since 44 days (last pass: next-20230206, first fail: next-20230208) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
rk3399-roc-pc                | arm64  | lab-clabbe      | gcc-10   | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/641d42d3740a319bd19c9505

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig+kselftest/gcc-10/lab-clabbe/baseline-rk3399-roc-pc.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig+kselftest/gcc-10/lab-clabbe/baseline-rk3399-roc-pc.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d42d3740a319bd19c9506
        failing since 44 days (last pass: next-20230206, first fail: next-20230207) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
rk3399-rock-pi-4b            | arm64  | lab-collabora   | gcc-10   | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/641d42eb740a319bd19c957b

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig+kselftest/gcc-10/lab-collabora/baseline-rk3399-rock-pi-4b.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig+kselftest/gcc-10/lab-collabora/baseline-rk3399-rock-pi-4b.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d42eb740a319bd19c957c
        failing since 44 days (last pass: next-20230206, first fail: next-20230207) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
sc7180-trogdo...zor-limozeen | arm64  | lab-collabora   | gcc-10   | defconfig+arm...ok+kselftest | 1          

  Details:     https://kernelci.org/test/plan/id/641d443fbaa3c150869c9513

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig+arm64-chromebook+kselftest/gcc-10/lab-collabora/baseline-sc7180-trogdor-lazor-limozeen.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig+arm64-chromebook+kselftest/gcc-10/lab-collabora/baseline-sc7180-trogdor-lazor-limozeen.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d443fbaa3c150869c9514
        failing since 44 days (last pass: next-20230206, first fail: next-20230208) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
sun50i-a64-pine64-plus       | arm64  | lab-broonie     | gcc-10   | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/641d43848612c04db69c9505

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig+kselftest/gcc-10/lab-broonie/baseline-sun50i-a64-pine64-plus.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig+kselftest/gcc-10/lab-broonie/baseline-sun50i-a64-pine64-plus.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d43848612c04db69c9506
        failing since 44 days (last pass: next-20230206, first fail: next-20230207) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
sun50i-h5-lib...ch-all-h3-cc | arm64  | lab-broonie     | gcc-10   | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/641d44e68b9db535e09c951c

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig+kselftest/gcc-10/lab-broonie/baseline-sun50i-h5-libretech-all-h3-cc.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230324/arm64/defconfig+kselftest/gcc-10/lab-broonie/baseline-sun50i-h5-libretech-all-h3-cc.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d44e68b9db535e09c951d
        failing since 44 days (last pass: next-20230206, first fail: next-20230207) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
sun8i-h2-plus-orangepi-zero  | arm    | lab-baylibre    | gcc-10   | sunxi_defconfig              | 1          

  Details:     https://kernelci.org/test/plan/id/641d3f6e4c663a037f9c957a

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: sunxi_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230324/arm/sunxi_defconfig/gcc-10/lab-baylibre/baseline-sun8i-h2-plus-orangepi-zero.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230324/arm/sunxi_defconfig/gcc-10/lab-baylibre/baseline-sun8i-h2-plus-orangepi-zero.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/armel/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/641d3f6e4c663a037f9c9583
        failing since 26 days (last pass: next-20230224, first fail: next-20230225)

    2023-03-24T06:12:37.965107  / # #
    2023-03-24T06:12:38.071269  export SHELL=/bin/sh
    2023-03-24T06:12:38.073139  #
    2023-03-24T06:12:38.176655  / # export SHELL=/bin/sh. /lava-3439576/environment
    2023-03-24T06:12:38.178642  
    2023-03-24T06:12:38.282354  / # . /lava-3439576/environment/lava-3439576/bin/lava-test-runner /lava-3439576/1
    2023-03-24T06:12:38.285538  
    2023-03-24T06:12:38.287848  / # /lava-3439576/bin/lava-test-runner /lava-3439576/1
    2023-03-24T06:12:38.415894  + export 'TESTRUN_ID=1_bootrr'
    2023-03-24T06:12:38.417052  + cd /lava-3439576/1/tests/1_bootrr 
    ... (10 line(s) more)  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
sun8i-h3-libretech-all-h3-cc | arm    | lab-baylibre    | gcc-10   | sunxi_defconfig              | 1          

  Details:     https://kernelci.org/test/plan/id/641d3f17223806fea89c9555

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: sunxi_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230324/arm/sunxi_defconfig/gcc-10/lab-baylibre/baseline-sun8i-h3-libretech-all-h3-cc.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230324/arm/sunxi_defconfig/gcc-10/lab-baylibre/baseline-sun8i-h3-libretech-all-h3-cc.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/armel/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/641d3f17223806fea89c955e
        failing since 58 days (last pass: next-20230123, first fail: next-20230124)

    2023-03-24T06:11:06.359207  / # #
    2023-03-24T06:11:06.461229  export SHELL=/bin/sh
    2023-03-24T06:11:06.461771  #
    2023-03-24T06:11:06.562926  / # export SHELL=/bin/sh. /lava-3439573/environment
    2023-03-24T06:11:06.563464  
    2023-03-24T06:11:06.664885  / # . /lava-3439573/environment/lava-3439573/bin/lava-test-runner /lava-3439573/1
    2023-03-24T06:11:06.665697  
    2023-03-24T06:11:06.670988  / # /lava-3439573/bin/lava-test-runner /lava-3439573/1
    2023-03-24T06:11:06.833886  + export 'TESTRUN_ID=1_bootrr'
    2023-03-24T06:11:06.834297  + cd /lava-3439573/1/tests/1_bootrr 
    ... (10 line(s) more)