Subject: next/master baseline: 512 runs, 31 regressions (next-20220822)

From: "kernelci.org bot" <[email-masked]>
Date: Mon, 22 Aug 2022 16:02:38 -0700 (PDT)

next/master baseline: 512 runs, 31 regressions (next-20220822)

Regressions Summary
-------------------

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
am57xx-beagle-x15            | arm   | lab-linaro-lkft | gcc-10   | multi_v7_defconfig           | 1          
am57xx-beagle-x15            | arm   | lab-linaro-lkft | gcc-10   | multi_v7_defconfig+debug     | 1          
am57xx-beagle-x15            | arm   | lab-linaro-lkft | gcc-10   | omap2plus_defconfig          | 1          
beaglebone-black             | arm   | lab-cip         | gcc-10   | multi_v7_defconfig           | 1          
beaglebone-black             | arm   | lab-cip         | gcc-10   | omap2plus_defconfig          | 1          
hifive-unleashed-a00         | riscv | lab-baylibre    | gcc-10   | defconfig                    | 1          
imx6dl-riotboard             | arm   | lab-pengutronix | gcc-10   | multi_v7_defconfig+debug     | 1          
imx6qp-wandboard-revd1       | arm   | lab-pengutronix | gcc-10   | multi_v7_defconfig+debug     | 1          
imx6ul-pico-hobbit           | arm   | lab-pengutronix | gcc-10   | imx_v6_v7_defconfig          | 1          
imx6ul-pico-hobbit           | arm   | lab-pengutronix | gcc-10   | multi_v7_defconfig           | 1          
imx7d-sdb                    | arm   | lab-nxp         | gcc-10   | imx_v6_v7_defconfig          | 1          
imx8mn-ddr4-evk              | arm64 | lab-baylibre    | gcc-10   | defconfig                    | 1          
imx8mn-ddr4-evk              | arm64 | lab-nxp         | gcc-10   | defconfig                    | 1          
jetson-tk1                   | arm   | lab-baylibre    | gcc-10   | multi_v7_defc...G_ARM_LPAE=y | 1          
meson-gxbb-p200              | arm64 | lab-baylibre    | gcc-10   | defconfig+CON..._64K_PAGES=y | 1          
mt8183-kukui-...uniper-sku16 | arm64 | lab-collabora   | gcc-10   | defconfig+arm64-chromebook   | 1          
panda                        | arm   | lab-baylibre    | gcc-10   | multi_v7_defconfig           | 1          
panda                        | arm   | lab-baylibre    | gcc-10   | omap2plus_defconfig          | 1          
qemu_arm-vexpress-a15        | arm   | lab-baylibre    | gcc-10   | vexpress_defconfig           | 1          
qemu_arm-vexpress-a15        | arm   | lab-broonie     | gcc-10   | vexpress_defconfig           | 1          
qemu_arm-vexpress-a9         | arm   | lab-baylibre    | gcc-10   | vexpress_defconfig           | 1          
qemu_arm-vexpress-a9         | arm   | lab-broonie     | gcc-10   | vexpress_defconfig           | 1          
qemu_arm64-virt-gicv3-uefi   | arm64 | lab-broonie     | gcc-10   | defconfig+debug              | 1          
qemu_arm64-virt-gicv3-uefi   | arm64 | lab-collabora   | gcc-10   | defconfig+debug              | 1          
rk3288-veyron-jaq            | arm   | lab-collabora   | clang-16 | multi_v7_defconfig           | 1          
rk3288-veyron-jaq            | arm   | lab-collabora   | gcc-10   | multi_v7_defconfig           | 1          
rk3288-veyron-jaq            | arm   | lab-collabora   | gcc-10   | multi_v7_defc...G_ARM_LPAE=y | 1          
rk3399-gru-kevin             | arm64 | lab-collabora   | gcc-10   | defconfig+arm64-chromebook   | 4          

  Details:  https://kernelci.org/test/job/next/branch/master/kernel/next-20220822/plan/baseline/

  Test:     baseline
  Tree:     next
  Branch:   master
  Describe: next-20220822
  URL:      https://git.kernel.org/pub/scm/linux/kernel/git/next/linux-next.git
  SHA:      cc2986f4dc67df7e6209e0cd74145fffbd30d693 

Test Regressions
---------------- 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
am57xx-beagle-x15            | arm   | lab-linaro-lkft | gcc-10   | multi_v7_defconfig           | 1          

  Details:     https://kernelci.org/test/plan/id/6303d2032dc387e1b4355644

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220822/arm/multi_v7_defconfig/gcc-10/lab-linaro-lkft/baseline-am57xx-beagle-x15.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220822/arm/multi_v7_defconfig/gcc-10/lab-linaro-lkft/baseline-am57xx-beagle-x15.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220805.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6303d2032dc387e1b4355645
        failing since 62 days (last pass: next-20220610, first fail: next-20220621) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
am57xx-beagle-x15            | arm   | lab-linaro-lkft | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/6303d3e2315b477c1135566d

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220822/arm/multi_v7_defconfig+debug/gcc-10/lab-linaro-lkft/baseline-am57xx-beagle-x15.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220822/arm/multi_v7_defconfig+debug/gcc-10/lab-linaro-lkft/baseline-am57xx-beagle-x15.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220805.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6303d3e2315b477c1135566e
        failing since 67 days (last pass: next-20220610, first fail: next-20220616) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
am57xx-beagle-x15            | arm   | lab-linaro-lkft | gcc-10   | omap2plus_defconfig          | 1          

  Details:     https://kernelci.org/test/plan/id/6303d0cfff5f1865bf355651

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: omap2plus_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220822/arm/omap2plus_defconfig/gcc-10/lab-linaro-lkft/baseline-am57xx-beagle-x15.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220822/arm/omap2plus_defconfig/gcc-10/lab-linaro-lkft/baseline-am57xx-beagle-x15.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220805.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6303d0cfff5f1865bf355652
        failing since 66 days (last pass: next-20220610, first fail: next-20220617) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
beaglebone-black             | arm   | lab-cip         | gcc-10   | multi_v7_defconfig           | 1          

  Details:     https://kernelci.org/test/plan/id/6303e546d56c015c85355676

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220822/arm/multi_v7_defconfig/gcc-10/lab-cip/baseline-beaglebone-black.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220822/arm/multi_v7_defconfig/gcc-10/lab-cip/baseline-beaglebone-black.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220805.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6303e546d56c015c85355677
        failing since 67 days (last pass: next-20220610, first fail: next-20220616) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
beaglebone-black             | arm   | lab-cip         | gcc-10   | omap2plus_defconfig          | 1          

  Details:     https://kernelci.org/test/plan/id/6303dd8954b0078506355658

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: omap2plus_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220822/arm/omap2plus_defconfig/gcc-10/lab-cip/baseline-beaglebone-black.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220822/arm/omap2plus_defconfig/gcc-10/lab-cip/baseline-beaglebone-black.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220805.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6303dd8954b0078506355659
        failing since 66 days (last pass: next-20220610, first fail: next-20220617) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
hifive-unleashed-a00         | riscv | lab-baylibre    | gcc-10   | defconfig                    | 1          

  Details:     https://kernelci.org/test/plan/id/6303d2a53625e1066e35565b

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig
  Compiler:    gcc-10 (riscv64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220822/riscv/defconfig/gcc-10/lab-baylibre/baseline-hifive-unleashed-a00.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220822/riscv/defconfig/gcc-10/lab-baylibre/baseline-hifive-unleashed-a00.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220805.0/riscv/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6303d2a53625e1066e35565c
        failing since 299 days (last pass: next-20211026, first fail: next-20211027) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
imx6dl-riotboard             | arm   | lab-pengutronix | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/6303d3a98937d3bbeb355644

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220822/arm/multi_v7_defconfig+debug/gcc-10/lab-pengutronix/baseline-imx6dl-riotboard.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220822/arm/multi_v7_defconfig+debug/gcc-10/lab-pengutronix/baseline-imx6dl-riotboard.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220805.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6303d3a98937d3bbeb355645
        failing since 12 days (last pass: next-20220808, first fail: next-20220810) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
imx6qp-wandboard-revd1       | arm   | lab-pengutronix | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/6303d2e280d09f9222355643

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220822/arm/multi_v7_defconfig+debug/gcc-10/lab-pengutronix/baseline-imx6qp-wandboard-revd1.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220822/arm/multi_v7_defconfig+debug/gcc-10/lab-pengutronix/baseline-imx6qp-wandboard-revd1.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220805.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6303d2e280d09f9222355644
        new failure (last pass: next-20220810) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
imx6ul-pico-hobbit           | arm   | lab-pengutronix | gcc-10   | imx_v6_v7_defconfig          | 1          

  Details:     https://kernelci.org/test/plan/id/6303e7319900b3cdd1355665

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: imx_v6_v7_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220822/arm/imx_v6_v7_defconfig/gcc-10/lab-pengutronix/baseline-imx6ul-pico-hobbit.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220822/arm/imx_v6_v7_defconfig/gcc-10/lab-pengutronix/baseline-imx6ul-pico-hobbit.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220805.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6303e7319900b3cdd1355666
        failing since 105 days (last pass: v5.16-rc4-6579-gea922272cbe5, first fail: next-20220509) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
imx6ul-pico-hobbit           | arm   | lab-pengutronix | gcc-10   | multi_v7_defconfig           | 1          

  Details:     https://kernelci.org/test/plan/id/6303dde59a41d54570355666

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220822/arm/multi_v7_defconfig/gcc-10/lab-pengutronix/baseline-imx6ul-pico-hobbit.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220822/arm/multi_v7_defconfig/gcc-10/lab-pengutronix/baseline-imx6ul-pico-hobbit.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220805.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6303dde59a41d54570355667
        failing since 105 days (last pass: v5.16-rc4-6579-gea922272cbe5, first fail: next-20220509) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
imx7d-sdb                    | arm   | lab-nxp         | gcc-10   | imx_v6_v7_defconfig          | 1          

  Details:     https://kernelci.org/test/plan/id/6303d7a546c92d27393556c7

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: imx_v6_v7_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220822/arm/imx_v6_v7_defconfig/gcc-10/lab-nxp/baseline-imx7d-sdb.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220822/arm/imx_v6_v7_defconfig/gcc-10/lab-nxp/baseline-imx7d-sdb.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220805.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6303d7a546c92d27393556c8
        failing since 34 days (last pass: next-20220707, first fail: next-20220718) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
imx8mn-ddr4-evk              | arm64 | lab-baylibre    | gcc-10   | defconfig                    | 1          

  Details:     https://kernelci.org/test/plan/id/6303dac1ae49c8aaa1355643

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220822/arm64/defconfig/gcc-10/lab-baylibre/baseline-imx8mn-ddr4-evk.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220822/arm64/defconfig/gcc-10/lab-baylibre/baseline-imx8mn-ddr4-evk.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220805.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6303dac1ae49c8aaa1355644
        failing since 5 days (last pass: next-20220816, first fail: next-20220817) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
imx8mn-ddr4-evk              | arm64 | lab-nxp         | gcc-10   | defconfig                    | 1          

  Details:     https://kernelci.org/test/plan/id/6303d2ba5ffee11b3b355662

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220822/arm64/defconfig/gcc-10/lab-nxp/baseline-imx8mn-ddr4-evk.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220822/arm64/defconfig/gcc-10/lab-nxp/baseline-imx8mn-ddr4-evk.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220805.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6303d2ba5ffee11b3b355663
        failing since 5 days (last pass: next-20220816, first fail: next-20220817) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
jetson-tk1                   | arm   | lab-baylibre    | gcc-10   | multi_v7_defc...G_ARM_LPAE=y | 1          

  Details:     https://kernelci.org/test/plan/id/6303de931cebb17ed5355688

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220822/arm/multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y/gcc-10/lab-baylibre/baseline-jetson-tk1.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220822/arm/multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y/gcc-10/lab-baylibre/baseline-jetson-tk1.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220805.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6303de931cebb17ed5355689
        failing since 133 days (last pass: next-20220401, first fail: next-20220411) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
meson-gxbb-p200              | arm64 | lab-baylibre    | gcc-10   | defconfig+CON..._64K_PAGES=y | 1          

  Details:     https://kernelci.org/test/plan/id/6303e9a804b90846f4355664

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+CONFIG_ARM64_64K_PAGES=y
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220822/arm64/defconfig+CONFIG_ARM64_64K_PAGES=y/gcc-10/lab-baylibre/baseline-meson-gxbb-p200.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220822/arm64/defconfig+CONFIG_ARM64_64K_PAGES=y/gcc-10/lab-baylibre/baseline-meson-gxbb-p200.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220805.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6303e9a804b90846f4355665
        new failure (last pass: next-20220817) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
mt8183-kukui-...uniper-sku16 | arm64 | lab-collabora   | gcc-10   | defconfig+arm64-chromebook   | 1          

  Details:     https://kernelci.org/test/plan/id/6303d23ad4d3f213d5355664

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220822/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-mt8183-kukui-jacuzzi-juniper-sku16.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220822/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-mt8183-kukui-jacuzzi-juniper-sku16.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220805.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6303d23ad4d3f213d5355665
        failing since 67 days (last pass: next-20220610, first fail: next-20220616) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
panda                        | arm   | lab-baylibre    | gcc-10   | multi_v7_defconfig           | 1          

  Details:     https://kernelci.org/test/plan/id/6303e84002963df8cd355654

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220822/arm/multi_v7_defconfig/gcc-10/lab-baylibre/baseline-panda.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220822/arm/multi_v7_defconfig/gcc-10/lab-baylibre/baseline-panda.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220805.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6303e84002963df8cd355655
        failing since 62 days (last pass: next-20220602, first fail: next-20220621) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
panda                        | arm   | lab-baylibre    | gcc-10   | omap2plus_defconfig          | 1          

  Details:     https://kernelci.org/test/plan/id/6303e33f4043c60af4355683

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: omap2plus_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220822/arm/omap2plus_defconfig/gcc-10/lab-baylibre/baseline-panda.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220822/arm/omap2plus_defconfig/gcc-10/lab-baylibre/baseline-panda.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220805.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6303e33f4043c60af4355684
        failing since 65 days (last pass: next-20220602, first fail: next-20220617) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
qemu_arm-vexpress-a15        | arm   | lab-baylibre    | gcc-10   | vexpress_defconfig           | 1          

  Details:     https://kernelci.org/test/plan/id/6303d203e5f8e1450035568a

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: vexpress_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220822/arm/vexpress_defconfig/gcc-10/lab-baylibre/baseline-qemu_arm-vexpress-a15.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220822/arm/vexpress_defconfig/gcc-10/lab-baylibre/baseline-qemu_arm-vexpress-a15.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220805.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6303d203e5f8e1450035568b
        failing since 19 days (last pass: next-20220726, first fail: next-20220802) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
qemu_arm-vexpress-a15        | arm   | lab-broonie     | gcc-10   | vexpress_defconfig           | 1          

  Details:     https://kernelci.org/test/plan/id/6303d6236caf7255b9355656

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: vexpress_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220822/arm/vexpress_defconfig/gcc-10/lab-broonie/baseline-qemu_arm-vexpress-a15.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220822/arm/vexpress_defconfig/gcc-10/lab-broonie/baseline-qemu_arm-vexpress-a15.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220805.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6303d6236caf7255b9355657
        failing since 19 days (last pass: next-20220726, first fail: next-20220802) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
qemu_arm-vexpress-a9         | arm   | lab-baylibre    | gcc-10   | vexpress_defconfig           | 1          

  Details:     https://kernelci.org/test/plan/id/6303d202e5f8e14500355685

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: vexpress_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220822/arm/vexpress_defconfig/gcc-10/lab-baylibre/baseline-qemu_arm-vexpress-a9.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220822/arm/vexpress_defconfig/gcc-10/lab-baylibre/baseline-qemu_arm-vexpress-a9.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220805.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6303d202e5f8e14500355686
        failing since 19 days (last pass: next-20220726, first fail: next-20220802) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
qemu_arm-vexpress-a9         | arm   | lab-broonie     | gcc-10   | vexpress_defconfig           | 1          

  Details:     https://kernelci.org/test/plan/id/6303d6226caf7255b9355653

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: vexpress_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220822/arm/vexpress_defconfig/gcc-10/lab-broonie/baseline-qemu_arm-vexpress-a9.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220822/arm/vexpress_defconfig/gcc-10/lab-broonie/baseline-qemu_arm-vexpress-a9.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220805.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6303d6226caf7255b9355654
        failing since 19 days (last pass: next-20220726, first fail: next-20220802) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
qemu_arm64-virt-gicv3-uefi   | arm64 | lab-broonie     | gcc-10   | defconfig+debug              | 1          

  Details:     https://kernelci.org/test/plan/id/6303d8de7431f37aff35565d

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+debug
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220822/arm64/defconfig+debug/gcc-10/lab-broonie/baseline-qemu_arm64-virt-gicv3-uefi.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220822/arm64/defconfig+debug/gcc-10/lab-broonie/baseline-qemu_arm64-virt-gicv3-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220805.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6303d8de7431f37aff35565e
        failing since 250 days (last pass: v5.16-rc5-6644-gbcd5ddb85fad, first fail: next-20211214) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
qemu_arm64-virt-gicv3-uefi   | arm64 | lab-collabora   | gcc-10   | defconfig+debug              | 1          

  Details:     https://kernelci.org/test/plan/id/6303d2ff80d09f9222355670

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+debug
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220822/arm64/defconfig+debug/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv3-uefi.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220822/arm64/defconfig+debug/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv3-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220805.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6303d2ff80d09f9222355671
        failing since 250 days (last pass: v5.16-rc5-6644-gbcd5ddb85fad, first fail: next-20211214) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
rk3288-veyron-jaq            | arm   | lab-collabora   | clang-16 | multi_v7_defconfig           | 1          

  Details:     https://kernelci.org/test/plan/id/6303fd11f3598b26c3355653

  Results:     69 PASS, 2 FAIL, 0 SKIP
  Full config: multi_v7_defconfig
  Compiler:    clang-16 (Debian clang version 16.0.0-++20220815071801+8719faafdb3f-1~exp1~20220815071906.353)
  Plain log:   https://storage.kernelci.org//next/master/next-20220822/arm/multi_v7_defconfig/clang-16/lab-collabora/baseline-rk3288-veyron-jaq.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220822/arm/multi_v7_defconfig/clang-16/lab-collabora/baseline-rk3288-veyron-jaq.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220805.0/armel/rootfs.cpio.gz 

  * baseline.bootrr.rockchip-iodomain-grf-probed: https://kernelci.org/test/case/id/6303fd11f3598b26c335566b
        new failure (last pass: next-20220812)

    2022-08-22T22:02:36.836999  /lava-7088341/1/../bin/lava-test-case
    2022-08-22T22:02:36.864552  <8>[   23.624826] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=rockchip-iodomain-grf-probed RESULT=fail>   

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
rk3288-veyron-jaq            | arm   | lab-collabora   | gcc-10   | multi_v7_defconfig           | 1          

  Details:     https://kernelci.org/test/plan/id/6303e271d29e458c7f35566a

  Results:     69 PASS, 2 FAIL, 0 SKIP
  Full config: multi_v7_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220822/arm/multi_v7_defconfig/gcc-10/lab-collabora/baseline-rk3288-veyron-jaq.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220822/arm/multi_v7_defconfig/gcc-10/lab-collabora/baseline-rk3288-veyron-jaq.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220805.0/armel/rootfs.cpio.gz 

  * baseline.bootrr.rockchip-iodomain-grf-probed: https://kernelci.org/test/case/id/6303e271d29e458c7f355682
        new failure (last pass: next-20220816)

    2022-08-22T20:08:58.732867  /lava-7087829/1/../bin/lava-test-case
    2022-08-22T20:08:58.757328  <8>[   22.755314] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=rockchip-iodomain-grf-probed RESULT=fail>   

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
rk3288-veyron-jaq            | arm   | lab-collabora   | gcc-10   | multi_v7_defc...G_ARM_LPAE=y | 1          

  Details:     https://kernelci.org/test/plan/id/6303e88bb7d4a3248b355654

  Results:     69 PASS, 2 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220822/arm/multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y/gcc-10/lab-collabora/baseline-rk3288-veyron-jaq.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220822/arm/multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y/gcc-10/lab-collabora/baseline-rk3288-veyron-jaq.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220805.0/armel/rootfs.cpio.gz 

  * baseline.bootrr.rockchip-iodomain-grf-probed: https://kernelci.org/test/case/id/6303e88bb7d4a3248b35566c
        new failure (last pass: next-20220810)

    2022-08-22T20:35:00.477960  /lava-7088020/1/../bin/lava-test-case
    2022-08-22T20:35:00.497206  <8>[   23.546844] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=rockchip-iodomain-grf-probed RESULT=fail>   

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
rk3399-gru-kevin             | arm64 | lab-collabora   | gcc-10   | defconfig+arm64-chromebook   | 4          

  Details:     https://kernelci.org/test/plan/id/6303d2d16a01884700355656

  Results:     84 PASS, 8 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220822/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-rk3399-gru-kevin.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220822/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-rk3399-gru-kevin.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220805.0/arm64/rootfs.cpio.gz 

  * baseline.bootrr.rockchip-iodomain1-probed: https://kernelci.org/test/case/id/6303d2d16a01884700355679
        new failure (last pass: next-20220812)

    2022-08-22T19:02:29.546429  /lava-7087888/1/../bin/lava-test-case   

  * baseline.bootrr.cros-ec-sensors-gyro0-probed: https://kernelci.org/test/case/id/6303d2d16a0188470035569f
        failing since 117 days (last pass: next-20220421, first fail: next-20220426)

    2022-08-22T19:02:26.178735  /lava-7087888/1/../bin/lava-test-case
    2022-08-22T19:02:26.191096  <8>[   34.742779] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=cros-ec-sensors-gyro0-probed RESULT=fail>   

  * baseline.bootrr.cros-ec-sensors-accel1-probed: https://kernelci.org/test/case/id/6303d2d16a018847003556a0
        failing since 117 days (last pass: next-20220421, first fail: next-20220426)

    2022-08-22T19:02:25.133343  /lava-7087888/1/../bin/lava-test-case
    2022-08-22T19:02:25.145430  <8>[   33.697106] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=cros-ec-sensors-accel1-probed RESULT=fail>   

  * baseline.bootrr.cros-ec-sensors-accel0-probed: https://kernelci.org/test/case/id/6303d2d16a018847003556a1
        failing since 117 days (last pass: next-20220421, first fail: next-20220426)

    2022-08-22T19:02:24.097991  /lava-7087888/1/../bin/lava-test-case
    2022-08-22T19:02:24.107880  <8>[   32.659632] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=cros-ec-sensors-accel0-probed RESULT=fail>