Subject: next/master baseline: 619 runs, 80 regressions (next-20221110)

From: "kernelci.org bot" <[email-masked]>
Date: Thu, 10 Nov 2022 04:53:48 -0800 (PST)

next/master baseline: 619 runs, 80 regressions (next-20221110)

Regressions Summary
-------------------

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
am57xx-beagle-x15            | arm   | lab-linaro-lkft | gcc-10   | multi_v7_defc...CONFIG_SMP=n | 1          
bcm2711-rpi-4-b              | arm64 | lab-linaro-lkft | clang-16 | defconfig                    | 1          
imx6sx-sdb                   | arm   | lab-nxp         | gcc-10   | imx_v6_v7_defconfig          | 1          
imx6ul-pico-hobbit           | arm   | lab-pengutronix | gcc-10   | imx_v6_v7_defconfig          | 1          
imx6ul-pico-hobbit           | arm   | lab-pengutronix | gcc-10   | multi_v7_defconfig           | 1          
imx6ul-pico-hobbit           | arm   | lab-pengutronix | gcc-10   | multi_v7_defc...CONFIG_SMP=n | 1          
imx6ul-pico-hobbit           | arm   | lab-pengutronix | gcc-10   | multi_v7_defc...MB2_KERNEL=y | 1          
imx7ulp-evk                  | arm   | lab-nxp         | gcc-10   | imx_v6_v7_defconfig          | 1          
jetson-tk1                   | arm   | lab-baylibre    | clang-16 | multi_v7_defconfig           | 1          
jetson-tk1                   | arm   | lab-baylibre    | gcc-10   | multi_v7_defc...G_ARM_LPAE=y | 1          
kontron-kbox-a-230-ls        | arm64 | lab-kontron     | clang-16 | defconfig                    | 1          
kontron-kbox-a-230-ls        | arm64 | lab-kontron     | clang-16 | defconfig+CON..._64K_PAGES=y | 1          
kontron-kbox-a-230-ls        | arm64 | lab-kontron     | gcc-10   | defconfig+videodec           | 1          
kontron-kbox-a-230-ls        | arm64 | lab-kontron     | gcc-10   | defconfig+crypto             | 1          
kontron-kbox-a-230-ls        | arm64 | lab-kontron     | gcc-10   | defconfig+CON...OMIZE_BASE=y | 1          
kontron-kbox-a-230-ls        | arm64 | lab-kontron     | gcc-10   | defconfig+CON..._64K_PAGES=y | 1          
kontron-kbox-a-230-ls        | arm64 | lab-kontron     | gcc-10   | defconfig+ima                | 1          
kontron-kbox-a-230-ls        | arm64 | lab-kontron     | gcc-10   | defconfig                    | 1          
kontron-kbox-a-230-ls        | arm64 | lab-kontron     | gcc-10   | defconfig+debug              | 1          
kontron-kswit...0-mmt-6g-2gs | arm   | lab-kontron     | clang-16 | multi_v7_defconfig           | 1          
kontron-kswit...0-mmt-6g-2gs | arm   | lab-kontron     | gcc-10   | multi_v7_defconfig           | 1          
kontron-kswit...0-mmt-6g-2gs | arm   | lab-kontron     | gcc-10   | multi_v7_defc...CONFIG_SMP=n | 1          
kontron-kswit...0-mmt-6g-2gs | arm   | lab-kontron     | gcc-10   | multi_v7_defc...MB2_KERNEL=y | 1          
kontron-pitx-imx8m           | arm64 | lab-kontron     | clang-16 | defconfig                    | 1          
kontron-pitx-imx8m           | arm64 | lab-kontron     | clang-16 | defconfig+CON..._64K_PAGES=y | 1          
kontron-pitx-imx8m           | arm64 | lab-kontron     | gcc-10   | defconfig+videodec           | 1          
kontron-pitx-imx8m           | arm64 | lab-kontron     | gcc-10   | defconfig+crypto             | 1          
kontron-pitx-imx8m           | arm64 | lab-kontron     | gcc-10   | defconfig+CON...OMIZE_BASE=y | 1          
kontron-pitx-imx8m           | arm64 | lab-kontron     | gcc-10   | defconfig+CON..._64K_PAGES=y | 1          
kontron-pitx-imx8m           | arm64 | lab-kontron     | gcc-10   | defconfig+ima                | 1          
kontron-pitx-imx8m           | arm64 | lab-kontron     | gcc-10   | defconfig                    | 1          
meson-gxl-s905d-p230         | arm64 | lab-baylibre    | gcc-10   | defconfig+CON...BIG_ENDIAN=y | 1          
mt8183-kukui-...uniper-sku16 | arm64 | lab-collabora   | clang-13 | defconfig+arm64-chromebook   | 1          
mt8183-kukui-...uniper-sku16 | arm64 | lab-collabora   | gcc-10   | defconfig+arm64-chromebook   | 1          
ox820-clouden...lug-series-3 | arm   | lab-baylibre    | gcc-10   | oxnas_v6_defconfig           | 1          
qemu_arm64-virt-gicv2-uefi   | arm64 | lab-baylibre    | gcc-10   | defconfig+debug              | 1          
qemu_arm64-virt-gicv2-uefi   | arm64 | lab-collabora   | gcc-10   | defconfig+debug              | 1          
qemu_arm64-virt-gicv3-uefi   | arm64 | lab-baylibre    | gcc-10   | defconfig+debug              | 1          
qemu_arm64-virt-gicv3-uefi   | arm64 | lab-collabora   | gcc-10   | defconfig+debug              | 1          
r8a7743-iwg20d-q7            | arm   | lab-cip         | gcc-10   | shmobile_defconfig           | 1          
rk3288-veyron-jaq            | arm   | lab-collabora   | clang-16 | multi_v7_defconfig           | 5          
rk3288-veyron-jaq            | arm   | lab-collabora   | gcc-10   | multi_v7_defconfig           | 5          
rk3288-veyron-jaq            | arm   | lab-collabora   | gcc-10   | multi_v7_defc...CONFIG_SMP=n | 5          
rk3288-veyron-jaq            | arm   | lab-collabora   | gcc-10   | multi_v7_defc...G_ARM_LPAE=y | 6          
rk3288-veyron-jaq            | arm   | lab-collabora   | gcc-10   | multi_v7_defc...MB2_KERNEL=y | 5          
rk3399-gru-kevin             | arm64 | lab-collabora   | clang-13 | cros://chrome...4-chromebook | 2          
rk3399-gru-kevin             | arm64 | lab-collabora   | clang-13 | cros://chrome...4-chromebook | 3          
rk3399-gru-kevin             | arm64 | lab-collabora   | clang-13 | defconfig+arm64-chromebook   | 3          
rk3399-gru-kevin             | arm64 | lab-collabora   | gcc-10   | defconfig+arm64-chromebook   | 3          
sc7180-trogdo...zor-limozeen | arm64 | lab-collabora   | clang-13 | defconfig+arm64-chromebook   | 1          
sc7180-trogdo...zor-limozeen | arm64 | lab-collabora   | gcc-10   | defconfig+arm64-chromebook   | 1          
sun8i-h3-orangepi-pc         | arm   | lab-clabbe      | gcc-10   | multi_v7_defc...CONFIG_SMP=n | 1          

  Details:  https://kernelci.org/test/job/next/branch/master/kernel/next-20221110/plan/baseline/

  Test:     baseline
  Tree:     next
  Branch:   master
  Describe: next-20221110
  URL:      https://git.kernel.org/pub/scm/linux/kernel/git/next/linux-next.git
  SHA:      382d2f9e739bc6f151c718b38537ae522ff848cd 

Test Regressions
---------------- 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
am57xx-beagle-x15            | arm   | lab-linaro-lkft | gcc-10   | multi_v7_defc...CONFIG_SMP=n | 1          

  Details:     https://kernelci.org/test/plan/id/636cd31d1e39ffdbd0e7db50

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_SMP=n
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221110/arm/multi_v7_defconfig+CONFIG_SMP=n/gcc-10/lab-linaro-lkft/baseline-am57xx-beagle-x15.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221110/arm/multi_v7_defconfig+CONFIG_SMP=n/gcc-10/lab-linaro-lkft/baseline-am57xx-beagle-x15.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221024.1/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/636cd31d1e39ffdbd0e7db51
        failing since 54 days (last pass: next-20220915, first fail: next-20220916) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
bcm2711-rpi-4-b              | arm64 | lab-linaro-lkft | clang-16 | defconfig                    | 1          

  Details:     https://kernelci.org/test/plan/id/636cbf8a426d35c5a3e7db58

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig
  Compiler:    clang-16 (Debian clang version 16.0.0-++20221025071726+e6c8418aab0b-1~exp1~20221025071826.433)
  Plain log:   https://storage.kernelci.org//next/master/next-20221110/arm64/defconfig/clang-16/lab-linaro-lkft/baseline-bcm2711-rpi-4-b.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221110/arm64/defconfig/clang-16/lab-linaro-lkft/baseline-bcm2711-rpi-4-b.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221024.1/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/636cbf8a426d35c5a3e7db59
        new failure (last pass: next-20221109) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
imx6sx-sdb                   | arm   | lab-nxp         | gcc-10   | imx_v6_v7_defconfig          | 1          

  Details:     https://kernelci.org/test/plan/id/636cbe4426368eeafee7db63

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: imx_v6_v7_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221110/arm/imx_v6_v7_defconfig/gcc-10/lab-nxp/baseline-imx6sx-sdb.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221110/arm/imx_v6_v7_defconfig/gcc-10/lab-nxp/baseline-imx6sx-sdb.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221024.1/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/636cbe4426368eeafee7db64
        failing since 63 days (last pass: next-20220831, first fail: next-20220907) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
imx6ul-pico-hobbit           | arm   | lab-pengutronix | gcc-10   | imx_v6_v7_defconfig          | 1          

  Details:     https://kernelci.org/test/plan/id/636cbd4d568dd16face7dbb1

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: imx_v6_v7_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221110/arm/imx_v6_v7_defconfig/gcc-10/lab-pengutronix/baseline-imx6ul-pico-hobbit.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221110/arm/imx_v6_v7_defconfig/gcc-10/lab-pengutronix/baseline-imx6ul-pico-hobbit.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221024.1/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/636cbd4d568dd16face7dbb2
        failing since 184 days (last pass: v5.16-rc4-6579-gea922272cbe5, first fail: next-20220509) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
imx6ul-pico-hobbit           | arm   | lab-pengutronix | gcc-10   | multi_v7_defconfig           | 1          

  Details:     https://kernelci.org/test/plan/id/636cbf91719882cea1e7db56

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221110/arm/multi_v7_defconfig/gcc-10/lab-pengutronix/baseline-imx6ul-pico-hobbit.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221110/arm/multi_v7_defconfig/gcc-10/lab-pengutronix/baseline-imx6ul-pico-hobbit.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221024.1/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/636cbf91719882cea1e7db57
        failing since 184 days (last pass: v5.16-rc4-6579-gea922272cbe5, first fail: next-20220509) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
imx6ul-pico-hobbit           | arm   | lab-pengutronix | gcc-10   | multi_v7_defc...CONFIG_SMP=n | 1          

  Details:     https://kernelci.org/test/plan/id/636cc01d73b38af776e7db56

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_SMP=n
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221110/arm/multi_v7_defconfig+CONFIG_SMP=n/gcc-10/lab-pengutronix/baseline-imx6ul-pico-hobbit.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221110/arm/multi_v7_defconfig+CONFIG_SMP=n/gcc-10/lab-pengutronix/baseline-imx6ul-pico-hobbit.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221024.1/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/636cc01d73b38af776e7db57
        failing since 184 days (last pass: v5.16-rc4-6579-gea922272cbe5, first fail: next-20220509) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
imx6ul-pico-hobbit           | arm   | lab-pengutronix | gcc-10   | multi_v7_defc...MB2_KERNEL=y | 1          

  Details:     https://kernelci.org/test/plan/id/636cc33d7290d36d6fe7db56

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221110/arm/multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y/gcc-10/lab-pengutronix/baseline-imx6ul-pico-hobbit.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221110/arm/multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y/gcc-10/lab-pengutronix/baseline-imx6ul-pico-hobbit.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221024.1/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/636cc33d7290d36d6fe7db57
        failing since 184 days (last pass: next-20211207, first fail: next-20220509) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
imx7ulp-evk                  | arm   | lab-nxp         | gcc-10   | imx_v6_v7_defconfig          | 1          

  Details:     https://kernelci.org/test/plan/id/636cbe4226368eeafee7db60

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: imx_v6_v7_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221110/arm/imx_v6_v7_defconfig/gcc-10/lab-nxp/baseline-imx7ulp-evk.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221110/arm/imx_v6_v7_defconfig/gcc-10/lab-nxp/baseline-imx7ulp-evk.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221024.1/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/636cbe4226368eeafee7db61
        failing since 153 days (last pass: next-20220601, first fail: next-20220610) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
jetson-tk1                   | arm   | lab-baylibre    | clang-16 | multi_v7_defconfig           | 1          

  Details:     https://kernelci.org/test/plan/id/636cc6a0cfcfd56788e7db5f

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig
  Compiler:    clang-16 (Debian clang version 16.0.0-++20221025071726+e6c8418aab0b-1~exp1~20221025071826.433)
  Plain log:   https://storage.kernelci.org//next/master/next-20221110/arm/multi_v7_defconfig/clang-16/lab-baylibre/baseline-jetson-tk1.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221110/arm/multi_v7_defconfig/clang-16/lab-baylibre/baseline-jetson-tk1.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221024.1/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/636cc6a0cfcfd56788e7db60
        failing since 78 days (last pass: next-20220822, first fail: next-20220823) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
jetson-tk1                   | arm   | lab-baylibre    | gcc-10   | multi_v7_defc...G_ARM_LPAE=y | 1          

  Details:     https://kernelci.org/test/plan/id/636cc3848ff89fed89e7db51

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221110/arm/multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y/gcc-10/lab-baylibre/baseline-jetson-tk1.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221110/arm/multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y/gcc-10/lab-baylibre/baseline-jetson-tk1.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221024.1/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/636cc3848ff89fed89e7db52
        failing since 212 days (last pass: next-20220401, first fail: next-20220411) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
kontron-kbox-a-230-ls        | arm64 | lab-kontron     | clang-16 | defconfig                    | 1          

  Details:     https://kernelci.org/test/plan/id/636cc0d28fd49d2a43e7db8e

  Results:     94 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig
  Compiler:    clang-16 (Debian clang version 16.0.0-++20221025071726+e6c8418aab0b-1~exp1~20221025071826.433)
  Plain log:   https://storage.kernelci.org//next/master/next-20221110/arm64/defconfig/clang-16/lab-kontron/baseline-kontron-kbox-a-230-ls.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221110/arm64/defconfig/clang-16/lab-kontron/baseline-kontron-kbox-a-230-ls.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221024.1/arm64/rootfs.cpio.gz 

  * baseline.bootrr.leds-gpio-probed: https://kernelci.org/test/case/id/636cc0d28fd49d2a43e7db99
        new failure (last pass: next-20221109)

    2022-11-10T09:13:35.046449  /lava-201471/1/../bin/lava-test-case
    2022-11-10T09:13:35.046836  <8>[   17.319528] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=leds-gpio-probed RESULT=fail>   

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
kontron-kbox-a-230-ls        | arm64 | lab-kontron     | clang-16 | defconfig+CON..._64K_PAGES=y | 1          

  Details:     https://kernelci.org/test/plan/id/636cc33f7290d36d6fe7db67

  Results:     94 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+CONFIG_ARM64_64K_PAGES=y
  Compiler:    clang-16 (Debian clang version 16.0.0-++20221025071726+e6c8418aab0b-1~exp1~20221025071826.433)
  Plain log:   https://storage.kernelci.org//next/master/next-20221110/arm64/defconfig+CONFIG_ARM64_64K_PAGES=y/clang-16/lab-kontron/baseline-kontron-kbox-a-230-ls.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221110/arm64/defconfig+CONFIG_ARM64_64K_PAGES=y/clang-16/lab-kontron/baseline-kontron-kbox-a-230-ls.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221024.1/arm64/rootfs.cpio.gz 

  * baseline.bootrr.leds-gpio-probed: https://kernelci.org/test/case/id/636cc33f7290d36d6fe7db72
        new failure (last pass: next-20221103)

    2022-11-10T09:24:06.366681  /lava-201488/1/../bin/lava-test-case
    2022-11-10T09:24:06.367064  <8>[   18.220478] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=leds-gpio-probed RESULT=fail>
    2022-11-10T09:24:06.367307  /lava-201488/1/../bin/lava-test-case
    2022-11-10T09:24:06.367535  <8>[   18.237272] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=at24-driver-present RESULT=pass>   

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
kontron-kbox-a-230-ls        | arm64 | lab-kontron     | gcc-10   | defconfig+videodec           | 1          

  Details:     https://kernelci.org/test/plan/id/636cbea2eafac304d2e7db68

  Results:     94 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+videodec
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221110/arm64/defconfig+videodec/gcc-10/lab-kontron/baseline-kontron-kbox-a-230-ls.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221110/arm64/defconfig+videodec/gcc-10/lab-kontron/baseline-kontron-kbox-a-230-ls.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221024.1/arm64/rootfs.cpio.gz 

  * baseline.bootrr.leds-gpio-probed: https://kernelci.org/test/case/id/636cbea2eafac304d2e7db73
        new failure (last pass: next-20221109)

    2022-11-10T09:04:17.330286  /lava-201453/1/../bin/lava-test-case
    2022-11-10T09:04:17.330683  <8>[   16.946740] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=leds-gpio-probed RESULT=fail>
    2022-11-10T09:04:17.330928  /lava-201453/1/../bin/lava-test-case
    2022-11-10T09:04:17.331157  <8>[   16.963555] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=at24-driver-present RESULT=pass>   

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
kontron-kbox-a-230-ls        | arm64 | lab-kontron     | gcc-10   | defconfig+crypto             | 1          

  Details:     https://kernelci.org/test/plan/id/636cbf1c089bb61474e7db51

  Results:     94 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+crypto
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221110/arm64/defconfig+crypto/gcc-10/lab-kontron/baseline-kontron-kbox-a-230-ls.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221110/arm64/defconfig+crypto/gcc-10/lab-kontron/baseline-kontron-kbox-a-230-ls.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221024.1/arm64/rootfs.cpio.gz 

  * baseline.bootrr.leds-gpio-probed: https://kernelci.org/test/case/id/636cbf1c089bb61474e7db5c
        new failure (last pass: next-20221109)

    2022-11-10T09:06:22.194294  /lava-201460/1/../bin/lava-test-case
    2022-11-10T09:06:22.194710  <8>[   17.851157] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=leds-gpio-probed RESULT=fail>
    2022-11-10T09:06:22.194955  /lava-201460/1/../bin/lava-test-case   

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
kontron-kbox-a-230-ls        | arm64 | lab-kontron     | gcc-10   | defconfig+CON...OMIZE_BASE=y | 1          

  Details:     https://kernelci.org/test/plan/id/636cc137cbb4b68c17e7db4f

  Results:     94 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+CONFIG_RANDOMIZE_BASE=y
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221110/arm64/defconfig+CONFIG_RANDOMIZE_BASE=y/gcc-10/lab-kontron/baseline-kontron-kbox-a-230-ls.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221110/arm64/defconfig+CONFIG_RANDOMIZE_BASE=y/gcc-10/lab-kontron/baseline-kontron-kbox-a-230-ls.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221024.1/arm64/rootfs.cpio.gz 

  * baseline.bootrr.leds-gpio-probed: https://kernelci.org/test/case/id/636cc137cbb4b68c17e7db5a
        new failure (last pass: next-20221109)

    2022-11-10T09:15:27.515486  /lava-201474/1/../bin/lava-test-case
    2022-11-10T09:15:27.515868  <8>[   17.661920] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=leds-gpio-probed RESULT=fail>   

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
kontron-kbox-a-230-ls        | arm64 | lab-kontron     | gcc-10   | defconfig+CON..._64K_PAGES=y | 1          

  Details:     https://kernelci.org/test/plan/id/636cc2db206ce8d1dfe7dba4

  Results:     94 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+CONFIG_ARM64_64K_PAGES=y
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221110/arm64/defconfig+CONFIG_ARM64_64K_PAGES=y/gcc-10/lab-kontron/baseline-kontron-kbox-a-230-ls.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221110/arm64/defconfig+CONFIG_ARM64_64K_PAGES=y/gcc-10/lab-kontron/baseline-kontron-kbox-a-230-ls.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221024.1/arm64/rootfs.cpio.gz 

  * baseline.bootrr.leds-gpio-probed: https://kernelci.org/test/case/id/636cc2db206ce8d1dfe7dbaf
        new failure (last pass: next-20221109)

    2022-11-10T09:22:26.230522  /lava-201482/1/../bin/lava-test-case
    2022-11-10T09:22:26.230913  <8>[   16.953273] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=leds-gpio-probed RESULT=fail>   

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
kontron-kbox-a-230-ls        | arm64 | lab-kontron     | gcc-10   | defconfig+ima                | 1          

  Details:     https://kernelci.org/test/plan/id/636cc457f8ae9f7b10e7dbbf

  Results:     94 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+ima
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221110/arm64/defconfig+ima/gcc-10/lab-kontron/baseline-kontron-kbox-a-230-ls.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221110/arm64/defconfig+ima/gcc-10/lab-kontron/baseline-kontron-kbox-a-230-ls.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221024.1/arm64/rootfs.cpio.gz 

  * baseline.bootrr.leds-gpio-probed: https://kernelci.org/test/case/id/636cc457f8ae9f7b10e7dbca
        new failure (last pass: next-20221109)

    2022-11-10T09:28:44.361983  /lava-201493/1/../bin/lava-test-case
    2022-11-10T09:28:44.362379  <8>[   18.266072] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=leds-gpio-probed RESULT=fail>   

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
kontron-kbox-a-230-ls        | arm64 | lab-kontron     | gcc-10   | defconfig                    | 1          

  Details:     https://kernelci.org/test/plan/id/636cc583ad7855bd96e7db54

  Results:     94 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221110/arm64/defconfig/gcc-10/lab-kontron/baseline-kontron-kbox-a-230-ls.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221110/arm64/defconfig/gcc-10/lab-kontron/baseline-kontron-kbox-a-230-ls.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221024.1/arm64/rootfs.cpio.gz 

  * baseline.bootrr.leds-gpio-probed: https://kernelci.org/test/case/id/636cc583ad7855bd96e7db5f
        new failure (last pass: next-20221109)

    2022-11-10T09:33:40.763195  /lava-201497/1/../bin/lava-test-case
    2022-11-10T09:33:40.763595  <8>[   18.673623] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=leds-gpio-probed RESULT=fail>
    2022-11-10T09:33:40.763832  /lava-201497/1/../bin/lava-test-case
    2022-11-10T09:33:40.764054  <8>[   18.691029] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=at24-driver-present RESULT=pass>   

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
kontron-kbox-a-230-ls        | arm64 | lab-kontron     | gcc-10   | defconfig+debug              | 1          

  Details:     https://kernelci.org/test/plan/id/636cc6d8981ae16f7ae7dbd4

  Results:     94 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+debug
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221110/arm64/defconfig+debug/gcc-10/lab-kontron/baseline-kontron-kbox-a-230-ls.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221110/arm64/defconfig+debug/gcc-10/lab-kontron/baseline-kontron-kbox-a-230-ls.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221024.1/arm64/rootfs.cpio.gz 

  * baseline.bootrr.leds-gpio-probed: https://kernelci.org/test/case/id/636cc6d8981ae16f7ae7dbdf
        new failure (last pass: next-20221109)

    2022-11-10T09:39:10.548911  /lava-201504/1/../bin/lava-test-case
    2022-11-10T09:39:10.649862  <8>[   39.100716][  T322] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=leds-gpio-probed RESULT=fail>   

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
kontron-kswit...0-mmt-6g-2gs | arm   | lab-kontron     | clang-16 | multi_v7_defconfig           | 1          

  Details:     https://kernelci.org/test/plan/id/636cc83f21a2844ea6e7db61

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig
  Compiler:    clang-16 (Debian clang version 16.0.0-++20221025071726+e6c8418aab0b-1~exp1~20221025071826.433)
  Plain log:   https://storage.kernelci.org//next/master/next-20221110/arm/multi_v7_defconfig/clang-16/lab-kontron/baseline-kontron-kswitch-d10-mmt-6g-2gs.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221110/arm/multi_v7_defconfig/clang-16/lab-kontron/baseline-kontron-kswitch-d10-mmt-6g-2gs.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221024.1/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/636cc83f21a2844ea6e7db62
        failing since 3 days (last pass: next-20221104, first fail: next-20221107) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
kontron-kswit...0-mmt-6g-2gs | arm   | lab-kontron     | gcc-10   | multi_v7_defconfig           | 1          

  Details:     https://kernelci.org/test/plan/id/636cc0ac8fd49d2a43e7db62

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221110/arm/multi_v7_defconfig/gcc-10/lab-kontron/baseline-kontron-kswitch-d10-mmt-6g-2gs.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221110/arm/multi_v7_defconfig/gcc-10/lab-kontron/baseline-kontron-kswitch-d10-mmt-6g-2gs.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221024.1/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/636cc0ac8fd49d2a43e7db63
        failing since 3 days (last pass: next-20221104, first fail: next-20221107) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
kontron-kswit...0-mmt-6g-2gs | arm   | lab-kontron     | gcc-10   | multi_v7_defc...CONFIG_SMP=n | 1          

  Details:     https://kernelci.org/test/plan/id/636cc3b78ff89fed89e7db7c

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_SMP=n
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221110/arm/multi_v7_defconfig+CONFIG_SMP=n/gcc-10/lab-kontron/baseline-kontron-kswitch-d10-mmt-6g-2gs.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221110/arm/multi_v7_defconfig+CONFIG_SMP=n/gcc-10/lab-kontron/baseline-kontron-kswitch-d10-mmt-6g-2gs.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221024.1/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/636cc3b78ff89fed89e7db7d
        failing since 3 days (last pass: next-20221104, first fail: next-20221107) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
kontron-kswit...0-mmt-6g-2gs | arm   | lab-kontron     | gcc-10   | multi_v7_defc...MB2_KERNEL=y | 1          

  Details:     https://kernelci.org/test/plan/id/636cc6c50b552ab219e7db4e

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221110/arm/multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y/gcc-10/lab-kontron/baseline-kontron-kswitch-d10-mmt-6g-2gs.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221110/arm/multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y/gcc-10/lab-kontron/baseline-kontron-kswitch-d10-mmt-6g-2gs.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221024.1/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/636cc6c50b552ab219e7db4f
        failing since 3 days (last pass: next-20221104, first fail: next-20221107) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
kontron-pitx-imx8m           | arm64 | lab-kontron     | clang-16 | defconfig                    | 1          

  Details:     https://kernelci.org/test/plan/id/636cc55b391b548ee3e7dbd2

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig
  Compiler:    clang-16 (Debian clang version 16.0.0-++20221025071726+e6c8418aab0b-1~exp1~20221025071826.433)
  Plain log:   https://storage.kernelci.org//next/master/next-20221110/arm64/defconfig/clang-16/lab-kontron/baseline-kontron-pitx-imx8m.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221110/arm64/defconfig/clang-16/lab-kontron/baseline-kontron-pitx-imx8m.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221024.1/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/636cc55b391b548ee3e7dbd3
        new failure (last pass: next-20221109) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
kontron-pitx-imx8m           | arm64 | lab-kontron     | clang-16 | defconfig+CON..._64K_PAGES=y | 1          

  Details:     https://kernelci.org/test/plan/id/636cd0b1ab76917475e7db64

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+CONFIG_ARM64_64K_PAGES=y
  Compiler:    clang-16 (Debian clang version 16.0.0-++20221025071726+e6c8418aab0b-1~exp1~20221025071826.433)
  Plain log:   https://storage.kernelci.org//next/master/next-20221110/arm64/defconfig+CONFIG_ARM64_64K_PAGES=y/clang-16/lab-kontron/baseline-kontron-pitx-imx8m.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221110/arm64/defconfig+CONFIG_ARM64_64K_PAGES=y/clang-16/lab-kontron/baseline-kontron-pitx-imx8m.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221024.1/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/636cd0b1ab76917475e7db65
        failing since 9 days (last pass: next-20221028, first fail: next-20221101) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
kontron-pitx-imx8m           | arm64 | lab-kontron     | gcc-10   | defconfig+videodec           | 1          

  Details:     https://kernelci.org/test/plan/id/636cc0aa8fd49d2a43e7db5c

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+videodec
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221110/arm64/defconfig+videodec/gcc-10/lab-kontron/baseline-kontron-pitx-imx8m.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221110/arm64/defconfig+videodec/gcc-10/lab-kontron/baseline-kontron-pitx-imx8m.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221024.1/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/636cc0aa8fd49d2a43e7db5d
        new failure (last pass: next-20221109) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
kontron-pitx-imx8m           | arm64 | lab-kontron     | gcc-10   | defconfig+crypto             | 1          

  Details:     https://kernelci.org/test/plan/id/636cc23ed37e4829b7e7db74

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+crypto
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221110/arm64/defconfig+crypto/gcc-10/lab-kontron/baseline-kontron-pitx-imx8m.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221110/arm64/defconfig+crypto/gcc-10/lab-kontron/baseline-kontron-pitx-imx8m.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221024.1/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/636cc23ed37e4829b7e7db75
        new failure (last pass: next-20221109) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
kontron-pitx-imx8m           | arm64 | lab-kontron     | gcc-10   | defconfig+CON...OMIZE_BASE=y | 1          

  Details:     https://kernelci.org/test/plan/id/636cc8a59be5def456e7db62

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+CONFIG_RANDOMIZE_BASE=y
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221110/arm64/defconfig+CONFIG_RANDOMIZE_BASE=y/gcc-10/lab-kontron/baseline-kontron-pitx-imx8m.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221110/arm64/defconfig+CONFIG_RANDOMIZE_BASE=y/gcc-10/lab-kontron/baseline-kontron-pitx-imx8m.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221024.1/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/636cc8a59be5def456e7db63
        new failure (last pass: next-20221109) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
kontron-pitx-imx8m           | arm64 | lab-kontron     | gcc-10   | defconfig+CON..._64K_PAGES=y | 1          

  Details:     https://kernelci.org/test/plan/id/636ccd90f3c2ff0ed6e7db4f

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+CONFIG_ARM64_64K_PAGES=y
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221110/arm64/defconfig+CONFIG_ARM64_64K_PAGES=y/gcc-10/lab-kontron/baseline-kontron-pitx-imx8m.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221110/arm64/defconfig+CONFIG_ARM64_64K_PAGES=y/gcc-10/lab-kontron/baseline-kontron-pitx-imx8m.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221024.1/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/636ccd90f3c2ff0ed6e7db50
        failing since 1 day (last pass: next-20221107, first fail: next-20221109) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
kontron-pitx-imx8m           | arm64 | lab-kontron     | gcc-10   | defconfig+ima                | 1          

  Details:     https://kernelci.org/test/plan/id/636cd3bddd1ee9873ae7db53

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+ima
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221110/arm64/defconfig+ima/gcc-10/lab-kontron/baseline-kontron-pitx-imx8m.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221110/arm64/defconfig+ima/gcc-10/lab-kontron/baseline-kontron-pitx-imx8m.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221024.1/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/636cd3bddd1ee9873ae7db54
        new failure (last pass: next-20221109) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
kontron-pitx-imx8m           | arm64 | lab-kontron     | gcc-10   | defconfig                    | 1          

  Details:     https://kernelci.org/test/plan/id/636cd6de26a207b3f1e7db5c

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221110/arm64/defconfig/gcc-10/lab-kontron/baseline-kontron-pitx-imx8m.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221110/arm64/defconfig/gcc-10/lab-kontron/baseline-kontron-pitx-imx8m.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221024.1/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/636cd6de26a207b3f1e7db5d
        new failure (last pass: next-20221109) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
meson-gxl-s905d-p230         | arm64 | lab-baylibre    | gcc-10   | defconfig+CON...BIG_ENDIAN=y | 1          

  Details:     https://kernelci.org/test/plan/id/636cc2c8206ce8d1dfe7db88

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+CONFIG_CPU_BIG_ENDIAN=y
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221110/arm64/defconfig+CONFIG_CPU_BIG_ENDIAN=y/gcc-10/lab-baylibre/baseline-meson-gxl-s905d-p230.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221110/arm64/defconfig+CONFIG_CPU_BIG_ENDIAN=y/gcc-10/lab-baylibre/baseline-meson-gxl-s905d-p230.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221024.1/arm64be/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/636cc2c8206ce8d1dfe7db89
        failing since 1 day (last pass: next-20221017, first fail: next-20221109) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
mt8183-kukui-...uniper-sku16 | arm64 | lab-collabora   | clang-13 | defconfig+arm64-chromebook   | 1          

  Details:     https://kernelci.org/test/plan/id/636cc29bfd1b403d0ce7db4e

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook
  Compiler:    clang-13 (Debian clang version 13.0.1-6~deb11u1)
  Plain log:   https://storage.kernelci.org//next/master/next-20221110/arm64/defconfig+arm64-chromebook/clang-13/lab-collabora/baseline-mt8183-kukui-jacuzzi-juniper-sku16.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221110/arm64/defconfig+arm64-chromebook/clang-13/lab-collabora/baseline-mt8183-kukui-jacuzzi-juniper-sku16.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221024.1/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/636cc29bfd1b403d0ce7db4f
        failing since 181 days (last pass: next-20220506, first fail: next-20220512) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
mt8183-kukui-...uniper-sku16 | arm64 | lab-collabora   | gcc-10   | defconfig+arm64-chromebook   | 1          

  Details:     https://kernelci.org/test/plan/id/636cc2955602e3e85be7db67

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221110/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-mt8183-kukui-jacuzzi-juniper-sku16.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221110/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-mt8183-kukui-jacuzzi-juniper-sku16.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221024.1/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/636cc2955602e3e85be7db68
        failing since 147 days (last pass: next-20220610, first fail: next-20220616) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
ox820-clouden...lug-series-3 | arm   | lab-baylibre    | gcc-10   | oxnas_v6_defconfig           | 1          

  Details:     https://kernelci.org/test/plan/id/636cbd8b0135426f87e7dba3

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: oxnas_v6_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221110/arm/oxnas_v6_defconfig/gcc-10/lab-baylibre/baseline-ox820-cloudengines-pogoplug-series-3.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221110/arm/oxnas_v6_defconfig/gcc-10/lab-baylibre/baseline-ox820-cloudengines-pogoplug-series-3.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221024.1/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/636cbd8b0135426f87e7dba4
        failing since 79 days (last pass: next-20220822, first fail: next-20220823) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
qemu_arm64-virt-gicv2-uefi   | arm64 | lab-baylibre    | gcc-10   | defconfig+debug              | 1          

  Details:     https://kernelci.org/test/plan/id/636cc381370f8b4bfae7db75

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+debug
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221110/arm64/defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_arm64-virt-gicv2-uefi.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221110/arm64/defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_arm64-virt-gicv2-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221024.1/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/636cc381370f8b4bfae7db76
        failing since 58 days (last pass: next-20220908, first fail: next-20220912) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
qemu_arm64-virt-gicv2-uefi   | arm64 | lab-collabora   | gcc-10   | defconfig+debug              | 1          

  Details:     https://kernelci.org/test/plan/id/636cc3367290d36d6fe7db50

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+debug
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221110/arm64/defconfig+debug/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv2-uefi.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221110/arm64/defconfig+debug/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv2-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221024.1/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/636cc3367290d36d6fe7db51
        failing since 58 days (last pass: next-20220908, first fail: next-20220912) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
qemu_arm64-virt-gicv3-uefi   | arm64 | lab-baylibre    | gcc-10   | defconfig+debug              | 1          

  Details:     https://kernelci.org/test/plan/id/636cc3833ed14f6f19e7db5d

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+debug
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221110/arm64/defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_arm64-virt-gicv3-uefi.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221110/arm64/defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_arm64-virt-gicv3-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221024.1/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/636cc3833ed14f6f19e7db5e
        failing since 58 days (last pass: next-20220908, first fail: next-20220912) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
qemu_arm64-virt-gicv3-uefi   | arm64 | lab-collabora   | gcc-10   | defconfig+debug              | 1          

  Details:     https://kernelci.org/test/plan/id/636cc35ed41be9adbde7db88

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+debug
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221110/arm64/defconfig+debug/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv3-uefi.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221110/arm64/defconfig+debug/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv3-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221024.1/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/636cc35ed41be9adbde7db89
        failing since 58 days (last pass: next-20220908, first fail: next-20220912) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
r8a7743-iwg20d-q7            | arm   | lab-cip         | gcc-10   | shmobile_defconfig           | 1          

  Details:     https://kernelci.org/test/plan/id/636cbe575e450444e2e7db72

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: shmobile_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221110/arm/shmobile_defconfig/gcc-10/lab-cip/baseline-r8a7743-iwg20d-q7.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221110/arm/shmobile_defconfig/gcc-10/lab-cip/baseline-r8a7743-iwg20d-q7.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221024.1/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/636cbe575e450444e2e7db73
        failing since 1 day (last pass: next-20221107, first fail: next-20221109) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
rk3288-veyron-jaq            | arm   | lab-collabora   | clang-16 | multi_v7_defconfig           | 5          

  Details:     https://kernelci.org/test/plan/id/636ccaf0e3507c326be7db4e

  Results:     65 PASS, 6 FAIL, 0 SKIP
  Full config: multi_v7_defconfig
  Compiler:    clang-16 (Debian clang version 16.0.0-++20221025071726+e6c8418aab0b-1~exp1~20221025071826.433)
  Plain log:   https://storage.kernelci.org//next/master/next-20221110/arm/multi_v7_defconfig/clang-16/lab-collabora/baseline-rk3288-veyron-jaq.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221110/arm/multi_v7_defconfig/clang-16/lab-collabora/baseline-rk3288-veyron-jaq.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221024.1/armel/rootfs.cpio.gz 

  * baseline.bootrr.rockchip-iodomain-grf-probed: https://kernelci.org/test/case/id/636ccaf0e3507c326be7db62
        new failure (last pass: next-20221109)

    2022-11-10T09:56:45.805845  <8>[   23.328204] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=rockchip-iodomain-driver-present RESULT=pass>
    2022-11-10T09:56:46.823773  /lava-7930315/1/../bin/lava-test-case<8>[   24.347573] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=rockchip-iodomain-grf-probed RESULT=fail>
    2022-11-10T09:56:46.824086     

  * baseline.bootrr.rockchip-dp-edp-probed: https://kernelci.org/test/case/id/636ccaf0e3507c326be7db68
        new failure (last pass: next-20221109) 

  * baseline.bootrr.dwmmc_rockchip-emmc-probed: https://kernelci.org/test/case/id/636ccaf0e3507c326be7db79
        new failure (last pass: next-20221109)

    2022-11-10T09:56:43.416982  <8>[   20.939482] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=dwmmc_rockchip-sdio0-probed RESULT=fail>
    2022-11-10T09:56:44.425705  /lava-7930315/1/../bin/lava-test-case
    2022-11-10T09:56:44.434528  <8>[   21.957956] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=dwmmc_rockchip-emmc-probed RESULT=fail>   

  * baseline.bootrr.dwmmc_rockchip-sdio0-probed: https://kernelci.org/test/case/id/636ccaf0e3507c326be7db7a
        new failure (last pass: next-20221109)

    2022-11-10T09:56:42.398467  /lava-7930315/1/../bin/lava-test-case<8>[   19.921228] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=dwmmc_rockchip-sdmmc-probed RESULT=fail>
    2022-11-10T09:56:42.398680  
    2022-11-10T09:56:43.406968  /lava-7930315/1/../bin/lava-test-case   

  * baseline.bootrr.dwmmc_rockchip-sdmmc-probed: https://kernelci.org/test/case/id/636ccaf0e3507c326be7db7b
        new failure (last pass: next-20221109) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
rk3288-veyron-jaq            | arm   | lab-collabora   | gcc-10   | multi_v7_defconfig           | 5          

  Details:     https://kernelci.org/test/plan/id/636cc09fc35b319af2e7db58

  Results:     65 PASS, 6 FAIL, 0 SKIP
  Full config: multi_v7_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221110/arm/multi_v7_defconfig/gcc-10/lab-collabora/baseline-rk3288-veyron-jaq.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221110/arm/multi_v7_defconfig/gcc-10/lab-collabora/baseline-rk3288-veyron-jaq.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221024.1/armel/rootfs.cpio.gz 

  * baseline.bootrr.rockchip-iodomain-grf-probed: https://kernelci.org/test/case/id/636cc09fc35b319af2e7db6c
        new failure (last pass: next-20221109)

    2022-11-10T09:12:47.010621  <8>[   23.404381] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=rockchip-iodomain-driver-present RESULT=pass>
    2022-11-10T09:12:48.018889  /lava-7929555/1/../bin/lava-test-case
    2022-11-10T09:12:48.028156  <8>[   24.423244] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=rockchip-iodomain-grf-probed RESULT=fail>   

  * baseline.bootrr.rockchip-dp-edp-probed: https://kernelci.org/test/case/id/636cc09fc35b319af2e7db72
        new failure (last pass: next-20221109)

    2022-11-10T09:12:46.918402  /lava-7929555/1/../bin/lava-test-case   

  * baseline.bootrr.dwmmc_rockchip-emmc-probed: https://kernelci.org/test/case/id/636cc09fc35b319af2e7db83
        new failure (last pass: next-20221109)

    2022-11-10T09:12:44.625570  /lava-7929555/1/../bin/lava-test-case<8>[   21.019755] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=dwmmc_rockchip-sdio0-probed RESULT=fail>
    2022-11-10T09:12:44.625773  
    2022-11-10T09:12:44.629750  
    2022-11-10T09:12:45.633538  /lava-7929555/1/../bin/lava-test-case
    2022-11-10T09:12:45.634333  
    2022-11-10T09:12:45.643504  <8>[   22.037888] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=dwmmc_rockchip-emmc-probed RESULT=fail>   

  * baseline.bootrr.dwmmc_rockchip-sdio0-probed: https://kernelci.org/test/case/id/636cc09fc35b319af2e7db84
        new failure (last pass: next-20221109) 

  * baseline.bootrr.dwmmc_rockchip-sdmmc-probed: https://kernelci.org/test/case/id/636cc09fc35b319af2e7db85
        new failure (last pass: next-20221109)

    2022-11-10T09:12:43.597195  /lava-7929555/1/../bin/lava-test-case
    2022-11-10T09:12:43.598239  
    2022-11-10T09:12:43.606512  <8>[   20.001542] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=dwmmc_rockchip-sdmmc-probed RESULT=fail>   

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
rk3288-veyron-jaq            | arm   | lab-collabora   | gcc-10   | multi_v7_defc...CONFIG_SMP=n | 5          

  Details:     https://kernelci.org/test/plan/id/636cc1a4c693042d70e7dba2

  Results:     65 PASS, 6 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_SMP=n
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221110/arm/multi_v7_defconfig+CONFIG_SMP=n/gcc-10/lab-collabora/baseline-rk3288-veyron-jaq.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221110/arm/multi_v7_defconfig+CONFIG_SMP=n/gcc-10/lab-collabora/baseline-rk3288-veyron-jaq.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221024.1/armel/rootfs.cpio.gz 

  * baseline.bootrr.rockchip-iodomain-grf-probed: https://kernelci.org/test/case/id/636cc1a4c693042d70e7dbb6
        new failure (last pass: next-20221107)

    2022-11-10T09:17:05.954279  /lava-7929579/1/../bin/lava-test-case<8>[   25.740241] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=rockchip-iodomain-driver-present RESULT=pass>
    2022-11-10T09:17:05.954486  
    2022-11-10T09:17:06.970990  /lava-7929579/1/../bin/lava-test-case<8>[   26.758357] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=rockchip-iodomain-grf-probed RESULT=fail>   

  * baseline.bootrr.rockchip-dp-edp-probed: https://kernelci.org/test/case/id/636cc1a4c693042d70e7dbbc
        new failure (last pass: next-20221107)

    2022-11-10T09:17:04.856731  
    2022-11-10T09:17:04.856937     

  * baseline.bootrr.dwmmc_rockchip-emmc-probed: https://kernelci.org/test/case/id/636cc1a4c693042d70e7dbcd
        new failure (last pass: next-20221107)

    2022-11-10T09:17:03.577408  /lava-7929579/1/../bin/lava-test-case<8>[   23.363415] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=dwmmc_rockchip-sdio0-probed RESULT=fail>
    2022-11-10T09:17:03.577612  
    2022-11-10T09:17:04.594184  /lava-7929579/1/../bin/lava-test-case<8>[   24.381141] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=dwmmc_rockchip-emmc-probed RESULT=fail>
    2022-11-10T09:17:04.594617     

  * baseline.bootrr.dwmmc_rockchip-sdio0-probed: https://kernelci.org/test/case/id/636cc1a4c693042d70e7dbce
        new failure (last pass: next-20221107)

    2022-11-10T09:17:02.559862     

  * baseline.bootrr.dwmmc_rockchip-sdmmc-probed: https://kernelci.org/test/case/id/636cc1a4c693042d70e7dbcf
        new failure (last pass: next-20221107)

    2022-11-10T09:17:01.541527  /lava-7929579/1/../bin/lava-test-case<8>[   21.327361] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=dwmmc_rockchip-driver-present RESULT=pass>
    2022-11-10T09:17:01.541733  
    2022-11-10T09:17:02.558625  /lava-7929579/1/../bin/lava-test-case<8>[   22.345641] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=dwmmc_rockchip-sdmmc-probed RESULT=fail>   

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
rk3288-veyron-jaq            | arm   | lab-collabora   | gcc-10   | multi_v7_defc...G_ARM_LPAE=y | 6          

  Details:     https://kernelci.org/test/plan/id/636cc6a5cfcfd56788e7db63

  Results:     64 PASS, 7 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221110/arm/multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y/gcc-10/lab-collabora/baseline-rk3288-veyron-jaq.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221110/arm/multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y/gcc-10/lab-collabora/baseline-rk3288-veyron-jaq.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221024.1/armel/rootfs.cpio.gz 

  * baseline.bootrr.rockchip-iodomain-grf-probed: https://kernelci.org/test/case/id/636cc6a5cfcfd56788e7db77
        new failure (last pass: next-20221109)

    2022-11-10T09:38:24.715712  <8>[   24.645766] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=rockchip-iodomain-driver-present RESULT=pass>
    2022-11-10T09:38:25.724059  /lava-7929796/1/../bin/lava-test-case   

  * baseline.bootrr.rockchip-dp-edp-probed: https://kernelci.org/test/case/id/636cc6a5cfcfd56788e7db7d
        new failure (last pass: next-20221109)

    2022-11-10T09:38:23.615711  
    2022-11-10T09:38:24.623413  /lava-7929796/1/../bin/lava-test-case
    2022-11-10T09:38:24.632056  <8>[   24.563836] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=rockchip-dp-edp-probed RESULT=fail>   

  * baseline.bootrr.dwmmc_rockchip-emmc-probed: https://kernelci.org/test/case/id/636cc6a5cfcfd56788e7db8e
        new failure (last pass: next-20221109)

    2022-11-10T09:38:23.339426  /lava-7929796/1/../bin/lava-test-case
    2022-11-10T09:38:23.340797     

  * baseline.bootrr.dwmmc_rockchip-sdio0-probed: https://kernelci.org/test/case/id/636cc6a5cfcfd56788e7db8f
        new failure (last pass: next-20221109)

    2022-11-10T09:38:21.313554  
    2022-11-10T09:38:22.321666  /lava-7929796/1/../bin/lava-test-case
    2022-11-10T09:38:22.330632  <8>[   22.261695] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=dwmmc_rockchip-sdio0-probed RESULT=fail>   

  * baseline.bootrr.dwmmc_rockchip-sdmmc-probed: https://kernelci.org/test/case/id/636cc6a5cfcfd56788e7db90
        new failure (last pass: next-20221109)

    2022-11-10T09:38:21.303762  /lava-7929796/1/../bin/lava-test-case
    2022-11-10T09:38:21.312270  <8>[   21.243612] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=dwmmc_rockchip-sdmmc-probed RESULT=fail>   

  * baseline.bootrr.cros-ec-keyb-probed: https://kernelci.org/test/case/id/636cc6a5cfcfd56788e7dba0
        new failure (last pass: next-20221109)

    2022-11-10T09:38:19.025652  <8>[   18.955836] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=cros-ec-keyb-driver-present RESULT=pass>
    2022-11-10T09:38:20.033915  /lava-7929796/1/../bin/lava-test-case
    2022-11-10T09:38:20.042146  <8>[   19.974047] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=cros-ec-keyb-probed RESULT=fail>   

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
rk3288-veyron-jaq            | arm   | lab-collabora   | gcc-10   | multi_v7_defc...MB2_KERNEL=y | 5          

  Details:     https://kernelci.org/test/plan/id/636cc71ca5d3d10415e7db60

  Results:     65 PASS, 6 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221110/arm/multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y/gcc-10/lab-collabora/baseline-rk3288-veyron-jaq.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221110/arm/multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y/gcc-10/lab-collabora/baseline-rk3288-veyron-jaq.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221024.1/armel/rootfs.cpio.gz 

  * baseline.bootrr.rockchip-iodomain-grf-probed: https://kernelci.org/test/case/id/636cc71ca5d3d10415e7db74
        new failure (last pass: next-20221109)

    2022-11-10T09:40:27.613241  
    2022-11-10T09:40:28.621427  /lava-7930020/1/../bin/lava-test-case
    2022-11-10T09:40:28.622031  
    2022-11-10T09:40:28.630563  <8>[   24.646184] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=rockchip-iodomain-grf-probed RESULT=fail>   

  * baseline.bootrr.rockchip-dp-edp-probed: https://kernelci.org/test/case/id/636cc71ca5d3d10415e7db7a
        new failure (last pass: next-20221109)

    2022-11-10T09:40:26.513512  
    2022-11-10T09:40:26.513695  
    2022-11-10T09:40:27.521357  /lava-7930020/1/../bin/lava-test-case
    2022-11-10T09:40:27.521945  
    2022-11-10T09:40:27.530163  <8>[   23.546249] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=rockchip-dp-edp-probed RESULT=fail>   

  * baseline.bootrr.dwmmc_rockchip-emmc-probed: https://kernelci.org/test/case/id/636cc71ca5d3d10415e7db8b
        new failure (last pass: next-20221109)

    2022-11-10T09:40:25.231218  
    2022-11-10T09:40:26.248423  /lava-7930020/1/../bin/lava-test-case<8>[   22.264154] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=dwmmc_rockchip-emmc-probed RESULT=fail>   

  * baseline.bootrr.dwmmc_rockchip-sdio0-probed: https://kernelci.org/test/case/id/636cc71ca5d3d10415e7db8c
        new failure (last pass: next-20221109)

    2022-11-10T09:40:24.213816  
    2022-11-10T09:40:25.221247  /lava-7930020/1/../bin/lava-test-case
    2022-11-10T09:40:25.230233  <8>[   21.246043] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=dwmmc_rockchip-sdio0-probed RESULT=fail>   

  * baseline.bootrr.dwmmc_rockchip-sdmmc-probed: https://kernelci.org/test/case/id/636cc71ca5d3d10415e7db8d
        new failure (last pass: next-20221109)

    2022-11-10T09:40:23.194982  <8>[   19.209693] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=dwmmc_rockchip-driver-present RESULT=pass>
    2022-11-10T09:40:24.212497  /lava-7930020/1/../bin/lava-test-case<8>[   20.228122] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=dwmmc_rockchip-sdmmc-probed RESULT=fail>
    2022-11-10T09:40:24.212829     

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
rk3399-gru-kevin             | arm64 | lab-collabora   | clang-13 | cros://chrome...4-chromebook | 2          

  Details:     https://kernelci.org/test/plan/id/636cc7d276be4221b2e7db58

  Results:     69 PASS, 23 FAIL, 0 SKIP
  Full config: cros://chromeos-5.10/arm64/chromiumos-arm64.flavour.config+arm64-chromebook
  Compiler:    clang-13 (Debian clang version 13.0.1-6~deb11u1)
  Plain log:   https://storage.kernelci.org//next/master/next-20221110/arm64/cros---chromeos-5.10-arm64-chromiumos-arm64.flavour.config+arm64-chromebook/clang-13/lab-collabora/baseline-rk3399-gru-kevin.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221110/arm64/cros---chromeos-5.10-arm64-chromiumos-arm64.flavour.config+arm64-chromebook/clang-13/lab-collabora/baseline-rk3399-gru-kevin.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221024.1/arm64/rootfs.cpio.gz 

  * baseline.bootrr.rockchip-pcie-probed: https://kernelci.org/test/case/id/636cc7d276be4221b2e7db75
        new failure (last pass: next-20221109)

    2022-11-10T09:43:27.027488  /lava-7930053/1/../bin/lava-test-case
    2022-11-10T09:43:27.039895  <8>[   38.624391] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=rockchip-pcie-probed RESULT=fail>   

  * baseline.bootrr.rockchip-iodomain1-probed: https://kernelci.org/test/case/id/636cc7d276be4221b2e7db77
        new failure (last pass: next-20221109)

    2022-11-10T09:43:24.950912  <8>[   36.533883] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=rockchip-iodomain0-probed RESULT=pass>
    2022-11-10T09:43:25.969920  /lava-7930053/1/../bin/lava-test-case
    2022-11-10T09:43:25.983071  <8>[   37.567805] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=rockchip-iodomain1-probed RESULT=fail>   

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
rk3399-gru-kevin             | arm64 | lab-collabora   | clang-13 | cros://chrome...4-chromebook | 3          

  Details:     https://kernelci.org/test/plan/id/636cc05da09f3e0f91e7db59

  Results:     79 PASS, 13 FAIL, 0 SKIP
  Full config: cros://chromeos-5.10/arm64/chromiumos-rockchip64.flavour.config+arm64-chromebook
  Compiler:    clang-13 (Debian clang version 13.0.1-6~deb11u1)
  Plain log:   https://storage.kernelci.org//next/master/next-20221110/arm64/cros---chromeos-5.10-arm64-chromiumos-rockchip64.flavour.config+arm64-chromebook/clang-13/lab-collabora/baseline-rk3399-gru-kevin.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221110/arm64/cros---chromeos-5.10-arm64-chromiumos-rockchip64.flavour.config+arm64-chromebook/clang-13/lab-collabora/baseline-rk3399-gru-kevin.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221024.1/arm64/rootfs.cpio.gz 

  * baseline.bootrr.rockchip-pcie-probed: https://kernelci.org/test/case/id/636cc05da09f3e0f91e7db76
        new failure (last pass: next-20221109)

    2022-11-10T09:11:46.965239  /lava-7929786/1/../bin/lava-test-case
    2022-11-10T09:11:46.978123  <8>[   31.580803] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=rockchip-pcie-probed RESULT=fail>   

  * baseline.bootrr.rockchip-iodomain1-probed: https://kernelci.org/test/case/id/636cc05da09f3e0f91e7db78
        new failure (last pass: next-20221109)

    2022-11-10T09:11:45.909234  /lava-7929786/1/../bin/lava-test-case
    2022-11-10T09:11:45.910232  
    2022-11-10T09:11:45.919725  <8>[   30.522235] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=rockchip-iodomain1-probed RESULT=fail>   

  * baseline.bootrr.rockchip-dp-probed: https://kernelci.org/test/case/id/636cc05da09f3e0f91e7db83
        new failure (last pass: next-20221109)

    2022-11-10T09:11:40.599777  <8>[   25.201096] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=rockchip-dp-driver-present RESULT=pass>
    2022-11-10T09:11:41.614856  /lava-7929786/1/../bin/lava-test-case
    2022-11-10T09:11:41.628188  <8>[   26.230759] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=rockchip-dp-probed RESULT=fail>   

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
rk3399-gru-kevin             | arm64 | lab-collabora   | clang-13 | defconfig+arm64-chromebook   | 3          

  Details:     https://kernelci.org/test/plan/id/636cc1e389a5fead67e7dbc4

  Results:     82 PASS, 10 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook
  Compiler:    clang-13 (Debian clang version 13.0.1-6~deb11u1)
  Plain log:   https://storage.kernelci.org//next/master/next-20221110/arm64/defconfig+arm64-chromebook/clang-13/lab-collabora/baseline-rk3399-gru-kevin.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221110/arm64/defconfig+arm64-chromebook/clang-13/lab-collabora/baseline-rk3399-gru-kevin.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221024.1/arm64/rootfs.cpio.gz 

  * baseline.bootrr.rockchip-pcie-probed: https://kernelci.org/test/case/id/636cc1e389a5fead67e7dbe1
        new failure (last pass: next-20221109)

    2022-11-10T09:18:01.541239  /lava-7929820/1/../bin/lava-test-case   

  * baseline.bootrr.rockchip-iodomain1-probed: https://kernelci.org/test/case/id/636cc1e389a5fead67e7dbe3
        new failure (last pass: next-20221109)

    2022-11-10T09:18:00.474327  /lava-7929820/1/../bin/lava-test-case   

  * baseline.bootrr.rockchip-dp-probed: https://kernelci.org/test/case/id/636cc1e389a5fead67e7dbee
        new failure (last pass: next-20221109)

    2022-11-10T09:17:57.067818  
    2022-11-10T09:17:58.088205  /lava-7929820/1/../bin/lava-test-case
    2022-11-10T09:17:58.088550  
    2022-11-10T09:17:58.097901  <8>[   39.777128] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=rockchip-dp-probed RESULT=fail>   

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
rk3399-gru-kevin             | arm64 | lab-collabora   | gcc-10   | defconfig+arm64-chromebook   | 3          

  Details:     https://kernelci.org/test/plan/id/636cc3d627cfb9acebe7db5e

  Results:     82 PASS, 10 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221110/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-rk3399-gru-kevin.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221110/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-rk3399-gru-kevin.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221024.1/arm64/rootfs.cpio.gz 

  * baseline.bootrr.rockchip-pcie-probed: https://kernelci.org/test/case/id/636cc3d627cfb9acebe7db7b
        new failure (last pass: next-20221109)

    2022-11-10T09:26:24.207293  /lava-7929860/1/../bin/lava-test-case   

  * baseline.bootrr.rockchip-iodomain1-probed: https://kernelci.org/test/case/id/636cc3d627cfb9acebe7db7d
        new failure (last pass: next-20221109)

    2022-11-10T09:26:23.137408  /lava-7929860/1/../bin/lava-test-case
    2022-11-10T09:26:23.153279  <8>[   50.353693] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=rockchip-iodomain1-probed RESULT=fail>   

  * baseline.bootrr.rockchip-dp-probed: https://kernelci.org/test/case/id/636cc3d627cfb9acebe7db88
        new failure (last pass: next-20221109)

    2022-11-10T09:26:20.766572  /lava-7929860/1/../bin/lava-test-case   

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
sc7180-trogdo...zor-limozeen | arm64 | lab-collabora   | clang-13 | defconfig+arm64-chromebook   | 1          

  Details:     https://kernelci.org/test/plan/id/636cc19475c56cd3dae7db7c

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook
  Compiler:    clang-13 (Debian clang version 13.0.1-6~deb11u1)
  Plain log:   https://storage.kernelci.org//next/master/next-20221110/arm64/defconfig+arm64-chromebook/clang-13/lab-collabora/baseline-sc7180-trogdor-lazor-limozeen.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221110/arm64/defconfig+arm64-chromebook/clang-13/lab-collabora/baseline-sc7180-trogdor-lazor-limozeen.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221024.1/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/636cc19475c56cd3dae7db7d
        new failure (last pass: next-20221109) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
sc7180-trogdo...zor-limozeen | arm64 | lab-collabora   | gcc-10   | defconfig+arm64-chromebook   | 1          

  Details:     https://kernelci.org/test/plan/id/636cc1abd9fb4aa1f4e7db5d

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221110/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-sc7180-trogdor-lazor-limozeen.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221110/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-sc7180-trogdor-lazor-limozeen.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221024.1/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/636cc1abd9fb4aa1f4e7db5e
        failing since 15 days (last pass: next-20221025, first fail: next-20221026) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
sun8i-h3-orangepi-pc         | arm   | lab-clabbe      | gcc-10   | multi_v7_defc...CONFIG_SMP=n | 1          

  Details:     https://kernelci.org/test/plan/id/636cc1cccc9a8edb1ce7db98

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_SMP=n
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221110/arm/multi_v7_defconfig+CONFIG_SMP=n/gcc-10/lab-clabbe/baseline-sun8i-h3-orangepi-pc.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221110/arm/multi_v7_defconfig+CONFIG_SMP=n/gcc-10/lab-clabbe/baseline-sun8i-h3-orangepi-pc.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221024.1/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/636cc1cccc9a8edb1ce7db99
        new failure (last pass: next-20221107)