Subject: next/master baseline: 490 runs, 31 regressions (next-20220726)

From: "kernelci.org bot" <[email-masked]>
Date: Tue, 26 Jul 2022 10:39:43 -0700 (PDT)

next/master baseline: 490 runs, 31 regressions (next-20220726)

Regressions Summary
-------------------

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
am57xx-beagle-x15            | arm   | lab-linaro-lkft | gcc-10   | multi_v7_defc...CONFIG_SMP=n | 1          
am57xx-beagle-x15            | arm   | lab-linaro-lkft | gcc-10   | multi_v7_defconfig           | 1          
am57xx-beagle-x15            | arm   | lab-linaro-lkft | gcc-10   | multi_v7_defconfig+debug     | 1          
bcm2711-rpi-4-b              | arm64 | lab-linaro-lkft | clang-15 | defconfig                    | 1          
beaglebone-black             | arm   | lab-broonie     | gcc-10   | multi_v7_defconfig           | 1          
beaglebone-black             | arm   | lab-broonie     | gcc-10   | multi_v7_defc...CONFIG_SMP=n | 1          
beaglebone-black             | arm   | lab-cip         | gcc-10   | multi_v7_defconfig           | 1          
beaglebone-black             | arm   | lab-cip         | gcc-10   | multi_v7_defc...CONFIG_SMP=n | 1          
imx6dl-riotboard             | arm   | lab-pengutronix | gcc-10   | multi_v7_defconfig+debug     | 1          
imx6qp-wandboard-revd1       | arm   | lab-pengutronix | gcc-10   | multi_v7_defconfig+debug     | 1          
imx6ul-pico-hobbit           | arm   | lab-pengutronix | gcc-10   | multi_v7_defconfig           | 1          
imx6ul-pico-hobbit           | arm   | lab-pengutronix | gcc-10   | multi_v7_defc...CONFIG_SMP=n | 1          
kontron-pitx-imx8m           | arm64 | lab-kontron     | clang-15 | defconfig                    | 2          
mt8183-kukui-...uniper-sku16 | arm64 | lab-collabora   | clang-13 | cros://chrome...4-chromebook | 1          
mt8183-kukui-...uniper-sku16 | arm64 | lab-collabora   | clang-13 | defconfig+arm64-chromebook   | 1          
mt8183-kukui-...uniper-sku16 | arm64 | lab-collabora   | gcc-10   | defconfig+arm64-chromebook   | 1          
ox820-clouden...lug-series-3 | arm   | lab-baylibre    | gcc-10   | oxnas_v6_defconfig           | 1          
panda                        | arm   | lab-baylibre    | gcc-10   | multi_v7_defconfig           | 1          
panda                        | arm   | lab-baylibre    | gcc-10   | multi_v7_defc...CONFIG_SMP=n | 1          
r8a77950-salvator-x          | arm64 | lab-baylibre    | clang-15 | defconfig                    | 1          
rk3399-gru-kevin             | arm64 | lab-collabora   | clang-13 | defconfig+arm64-chromebook   | 3          
rk3399-gru-kevin             | arm64 | lab-collabora   | gcc-10   | defconfig+arm64-chromebook   | 3          
rk3399-roc-pc                | arm64 | lab-clabbe      | gcc-10   | defconfig+CON..._64K_PAGES=y | 1          
rk3399-roc-pc                | arm64 | lab-clabbe      | gcc-10   | defconfig                    | 1          
sc7180-trogdo...zor-limozeen | arm64 | lab-collabora   | clang-13 | defconfig+arm64-chromebook   | 1          
sc7180-trogdo...zor-limozeen | arm64 | lab-collabora   | gcc-10   | defconfig+arm64-chromebook   | 1          

  Details:  https://kernelci.org/test/job/next/branch/master/kernel/next-20220726/plan/baseline/

  Test:     baseline
  Tree:     next
  Branch:   master
  Describe: next-20220726
  URL:      https://git.kernel.org/pub/scm/linux/kernel/git/next/linux-next.git
  SHA:      058affafc65a74cf54499fb578b66ad0b18f939b 

Test Regressions
---------------- 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
am57xx-beagle-x15            | arm   | lab-linaro-lkft | gcc-10   | multi_v7_defc...CONFIG_SMP=n | 1          

  Details:     https://kernelci.org/test/plan/id/62e00c3c2095e2ae64daf08c

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_SMP=n
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220726/arm/multi_v7_defconfig+CONFIG_SMP=n/gcc-10/lab-linaro-lkft/baseline-am57xx-beagle-x15.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220726/arm/multi_v7_defconfig+CONFIG_SMP=n/gcc-10/lab-linaro-lkft/baseline-am57xx-beagle-x15.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220718.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/62e00c3c2095e2ae64daf08d
        failing since 40 days (last pass: next-20220601, first fail: next-20220616) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
am57xx-beagle-x15            | arm   | lab-linaro-lkft | gcc-10   | multi_v7_defconfig           | 1          

  Details:     https://kernelci.org/test/plan/id/62e00c526fb3c41fcadaf056

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220726/arm/multi_v7_defconfig/gcc-10/lab-linaro-lkft/baseline-am57xx-beagle-x15.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220726/arm/multi_v7_defconfig/gcc-10/lab-linaro-lkft/baseline-am57xx-beagle-x15.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220718.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/62e00c526fb3c41fcadaf057
        failing since 35 days (last pass: next-20220610, first fail: next-20220621) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
am57xx-beagle-x15            | arm   | lab-linaro-lkft | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/62e00c797566cb7ca3daf056

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220726/arm/multi_v7_defconfig+debug/gcc-10/lab-linaro-lkft/baseline-am57xx-beagle-x15.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220726/arm/multi_v7_defconfig+debug/gcc-10/lab-linaro-lkft/baseline-am57xx-beagle-x15.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220718.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/62e00c797566cb7ca3daf057
        failing since 40 days (last pass: next-20220610, first fail: next-20220616) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
bcm2711-rpi-4-b              | arm64 | lab-linaro-lkft | clang-15 | defconfig                    | 1          

  Details:     https://kernelci.org/test/plan/id/62e003fe12a98b7adcdaf076

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig
  Compiler:    clang-15 (Debian clang version 15.0.0-++20220719071818+5fc621355110-1~exp1~20220719071918.324)
  Plain log:   https://storage.kernelci.org//next/master/next-20220726/arm64/defconfig/clang-15/lab-linaro-lkft/baseline-bcm2711-rpi-4-b.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220726/arm64/defconfig/clang-15/lab-linaro-lkft/baseline-bcm2711-rpi-4-b.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220718.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/62e003fe12a98b7adcdaf077
        new failure (last pass: next-20220722) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
beaglebone-black             | arm   | lab-broonie     | gcc-10   | multi_v7_defconfig           | 1          

  Details:     https://kernelci.org/test/plan/id/62dffa8380f2b5e99cdaf062

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220726/arm/multi_v7_defconfig/gcc-10/lab-broonie/baseline-beaglebone-black.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220726/arm/multi_v7_defconfig/gcc-10/lab-broonie/baseline-beaglebone-black.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220718.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/62dffa8380f2b5e99cdaf063
        failing since 40 days (last pass: next-20220610, first fail: next-20220616) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
beaglebone-black             | arm   | lab-broonie     | gcc-10   | multi_v7_defc...CONFIG_SMP=n | 1          

  Details:     https://kernelci.org/test/plan/id/62dfffb67aa67463f9daf060

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_SMP=n
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220726/arm/multi_v7_defconfig+CONFIG_SMP=n/gcc-10/lab-broonie/baseline-beaglebone-black.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220726/arm/multi_v7_defconfig+CONFIG_SMP=n/gcc-10/lab-broonie/baseline-beaglebone-black.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220718.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/62dfffb67aa67463f9daf061
        failing since 40 days (last pass: next-20220602, first fail: next-20220616) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
beaglebone-black             | arm   | lab-cip         | gcc-10   | multi_v7_defconfig           | 1          

  Details:     https://kernelci.org/test/plan/id/62e004cacaa8193af2daf06d

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220726/arm/multi_v7_defconfig/gcc-10/lab-cip/baseline-beaglebone-black.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220726/arm/multi_v7_defconfig/gcc-10/lab-cip/baseline-beaglebone-black.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220718.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/62e004cacaa8193af2daf06e
        failing since 40 days (last pass: next-20220610, first fail: next-20220616) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
beaglebone-black             | arm   | lab-cip         | gcc-10   | multi_v7_defc...CONFIG_SMP=n | 1          

  Details:     https://kernelci.org/test/plan/id/62e00caf5933477905daf05a

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_SMP=n
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220726/arm/multi_v7_defconfig+CONFIG_SMP=n/gcc-10/lab-cip/baseline-beaglebone-black.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220726/arm/multi_v7_defconfig+CONFIG_SMP=n/gcc-10/lab-cip/baseline-beaglebone-black.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220718.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/62e00caf5933477905daf05b
        failing since 40 days (last pass: next-20220602, first fail: next-20220616) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
imx6dl-riotboard             | arm   | lab-pengutronix | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/62e01d45f2386ffa96daf062

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220726/arm/multi_v7_defconfig+debug/gcc-10/lab-pengutronix/baseline-imx6dl-riotboard.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220726/arm/multi_v7_defconfig+debug/gcc-10/lab-pengutronix/baseline-imx6dl-riotboard.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220718.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/62e01d45f2386ffa96daf063
        new failure (last pass: next-20220722) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
imx6qp-wandboard-revd1       | arm   | lab-pengutronix | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/62e00391d3b26fab49daf0b0

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220726/arm/multi_v7_defconfig+debug/gcc-10/lab-pengutronix/baseline-imx6qp-wandboard-revd1.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220726/arm/multi_v7_defconfig+debug/gcc-10/lab-pengutronix/baseline-imx6qp-wandboard-revd1.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220718.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/62e00391d3b26fab49daf0b1
        new failure (last pass: next-20220722) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
imx6ul-pico-hobbit           | arm   | lab-pengutronix | gcc-10   | multi_v7_defconfig           | 1          

  Details:     https://kernelci.org/test/plan/id/62e01c7e6f106db8afdaf0ad

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220726/arm/multi_v7_defconfig/gcc-10/lab-pengutronix/baseline-imx6ul-pico-hobbit.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220726/arm/multi_v7_defconfig/gcc-10/lab-pengutronix/baseline-imx6ul-pico-hobbit.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220718.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/62e01c7e6f106db8afdaf0ae
        failing since 78 days (last pass: v5.16-rc4-6579-gea922272cbe5, first fail: next-20220509) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
imx6ul-pico-hobbit           | arm   | lab-pengutronix | gcc-10   | multi_v7_defc...CONFIG_SMP=n | 1          

  Details:     https://kernelci.org/test/plan/id/62e01fee7e498d708adaf0b3

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_SMP=n
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220726/arm/multi_v7_defconfig+CONFIG_SMP=n/gcc-10/lab-pengutronix/baseline-imx6ul-pico-hobbit.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220726/arm/multi_v7_defconfig+CONFIG_SMP=n/gcc-10/lab-pengutronix/baseline-imx6ul-pico-hobbit.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220718.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/62e01fee7e498d708adaf0b4
        failing since 78 days (last pass: v5.16-rc4-6579-gea922272cbe5, first fail: next-20220509) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
kontron-pitx-imx8m           | arm64 | lab-kontron     | clang-15 | defconfig                    | 2          

  Details:     https://kernelci.org/test/plan/id/62e0060c0091c85b2adaf0b4

  Results:     50 PASS, 2 FAIL, 1 SKIP
  Full config: defconfig
  Compiler:    clang-15 (Debian clang version 15.0.0-++20220719071818+5fc621355110-1~exp1~20220719071918.324)
  Plain log:   https://storage.kernelci.org//next/master/next-20220726/arm64/defconfig/clang-15/lab-kontron/baseline-kontron-pitx-imx8m.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220726/arm64/defconfig/clang-15/lab-kontron/baseline-kontron-pitx-imx8m.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220718.0/arm64/rootfs.cpio.gz 

  * baseline.bootrr.imx6q-pcie-pcie0-probed: https://kernelci.org/test/case/id/62e0060c0091c85b2adaf0c2
        failing since 28 days (last pass: next-20220610, first fail: next-20220628)

    2022-07-26T15:19:32.232309  /lava-145839/1/../bin/lava-test-case
    2022-07-26T15:19:32.232577  <8>[   19.553290] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=imx6q-pcie-pcie0-probed RESULT=fail>
    2022-07-26T15:19:32.232728  /lava-145839/1/../bin/lava-test-case
    2022-07-26T15:19:32.232872  <8>[   19.575036] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=intel-igb-driver-present RESULT=pass>   

  * baseline.bootrr.intel-igb-probed: https://kernelci.org/test/case/id/62e0060c0091c85b2adaf0c4
        failing since 28 days (last pass: next-20220610, first fail: next-20220628)

    2022-07-26T15:19:33.263073  /lava-145839/1/../bin/lava-test-case
    2022-07-26T15:19:33.263634  <8>[   20.599768] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=intel-igb-probed RESULT=fail>
    2022-07-26T15:19:33.263819  /lava-145839/1/../bin/lava-test-case
    2022-07-26T15:19:33.264028  <8>[   20.620449] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=dwc3-driver-present RESULT=pass>
    2022-07-26T15:19:33.264265  /lava-145839/1/../bin/lava-test-case
    2022-07-26T15:19:33.264428  <8>[   20.641970] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=dwc3-usb0-probed RESULT=pass>
    2022-07-26T15:19:33.264589  /lava-145839/1/../bin/lava-test-case   

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
mt8183-kukui-...uniper-sku16 | arm64 | lab-collabora   | clang-13 | cros://chrome...4-chromebook | 1          

  Details:     https://kernelci.org/test/plan/id/62dff75cd955049b1edaf075

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: cros://chromeos-5.10/arm64/chromiumos-arm64.flavour.config+arm64-chromebook
  Compiler:    clang-13 (Debian clang version 13.0.1-++20220126092033+75e33f71c2da-1~exp1~20220126212112.63)
  Plain log:   https://storage.kernelci.org//next/master/next-20220726/arm64/cros---chromeos-5.10-arm64-chromiumos-arm64.flavour.config+arm64-chromebook/clang-13/lab-collabora/baseline-mt8183-kukui-jacuzzi-juniper-sku16.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220726/arm64/cros---chromeos-5.10-arm64-chromiumos-arm64.flavour.config+arm64-chromebook/clang-13/lab-collabora/baseline-mt8183-kukui-jacuzzi-juniper-sku16.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220718.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/62dff75cd955049b1edaf076
        failing since 12 days (last pass: next-20220705, first fail: next-20220714) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
mt8183-kukui-...uniper-sku16 | arm64 | lab-collabora   | clang-13 | defconfig+arm64-chromebook   | 1          

  Details:     https://kernelci.org/test/plan/id/62dff1f4ad5e7b092edaf05b

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook
  Compiler:    clang-13 (Debian clang version 13.0.1-++20220126092033+75e33f71c2da-1~exp1~20220126212112.63)
  Plain log:   https://storage.kernelci.org//next/master/next-20220726/arm64/defconfig+arm64-chromebook/clang-13/lab-collabora/baseline-mt8183-kukui-jacuzzi-juniper-sku16.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220726/arm64/defconfig+arm64-chromebook/clang-13/lab-collabora/baseline-mt8183-kukui-jacuzzi-juniper-sku16.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220718.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/62dff1f4ad5e7b092edaf05c
        failing since 75 days (last pass: next-20220506, first fail: next-20220512) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
mt8183-kukui-...uniper-sku16 | arm64 | lab-collabora   | gcc-10   | defconfig+arm64-chromebook   | 1          

  Details:     https://kernelci.org/test/plan/id/62dfff169165b7bcabdaf062

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220726/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-mt8183-kukui-jacuzzi-juniper-sku16.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220726/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-mt8183-kukui-jacuzzi-juniper-sku16.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220718.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/62dfff169165b7bcabdaf063
        failing since 40 days (last pass: next-20220610, first fail: next-20220616) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
ox820-clouden...lug-series-3 | arm   | lab-baylibre    | gcc-10   | oxnas_v6_defconfig           | 1          

  Details:     https://kernelci.org/test/plan/id/62dff7835a9230c15cdaf09f

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: oxnas_v6_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220726/arm/oxnas_v6_defconfig/gcc-10/lab-baylibre/baseline-ox820-cloudengines-pogoplug-series-3.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220726/arm/oxnas_v6_defconfig/gcc-10/lab-baylibre/baseline-ox820-cloudengines-pogoplug-series-3.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220718.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/62dff7835a9230c15cdaf0a0
        failing since 7 days (last pass: next-20220714, first fail: next-20220718) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
panda                        | arm   | lab-baylibre    | gcc-10   | multi_v7_defconfig           | 1          

  Details:     https://kernelci.org/test/plan/id/62dffeac49f8741792daf059

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220726/arm/multi_v7_defconfig/gcc-10/lab-baylibre/baseline-panda.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220726/arm/multi_v7_defconfig/gcc-10/lab-baylibre/baseline-panda.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220718.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/62dffeac49f8741792daf05a
        failing since 35 days (last pass: next-20220602, first fail: next-20220621) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
panda                        | arm   | lab-baylibre    | gcc-10   | multi_v7_defc...CONFIG_SMP=n | 1          

  Details:     https://kernelci.org/test/plan/id/62e0016888f7e32ec1daf07e

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_SMP=n
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220726/arm/multi_v7_defconfig+CONFIG_SMP=n/gcc-10/lab-baylibre/baseline-panda.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220726/arm/multi_v7_defconfig+CONFIG_SMP=n/gcc-10/lab-baylibre/baseline-panda.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220718.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/62e0016888f7e32ec1daf07f
        failing since 35 days (last pass: next-20220602, first fail: next-20220621) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
r8a77950-salvator-x          | arm64 | lab-baylibre    | clang-15 | defconfig                    | 1          

  Details:     https://kernelci.org/test/plan/id/62e00bc1e4c270a15fdaf057

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig
  Compiler:    clang-15 (Debian clang version 15.0.0-++20220719071818+5fc621355110-1~exp1~20220719071918.324)
  Plain log:   https://storage.kernelci.org//next/master/next-20220726/arm64/defconfig/clang-15/lab-baylibre/baseline-r8a77950-salvator-x.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220726/arm64/defconfig/clang-15/lab-baylibre/baseline-r8a77950-salvator-x.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220718.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/62e00bc1e4c270a15fdaf058
        new failure (last pass: next-20220722) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
rk3399-gru-kevin             | arm64 | lab-collabora   | clang-13 | defconfig+arm64-chromebook   | 3          

  Details:     https://kernelci.org/test/plan/id/62dff19d6ae3b9d5c9daf056

  Results:     85 PASS, 7 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook
  Compiler:    clang-13 (Debian clang version 13.0.1-++20220126092033+75e33f71c2da-1~exp1~20220126212112.63)
  Plain log:   https://storage.kernelci.org//next/master/next-20220726/arm64/defconfig+arm64-chromebook/clang-13/lab-collabora/baseline-rk3399-gru-kevin.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220726/arm64/defconfig+arm64-chromebook/clang-13/lab-collabora/baseline-rk3399-gru-kevin.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220718.0/arm64/rootfs.cpio.gz 

  * baseline.bootrr.cros-ec-sensors-gyro0-probed: https://kernelci.org/test/case/id/62dff19d6ae3b9d5c9daf09d
        failing since 90 days (last pass: next-20220422, first fail: next-20220427)

    2022-07-26T13:52:02.423960  /lava-6894733/1/../bin/lava-test-case
    2022-07-26T13:52:02.436131  <8>[   39.236575] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=cros-ec-sensors-gyro0-probed RESULT=fail>   

  * baseline.bootrr.cros-ec-sensors-accel1-probed: https://kernelci.org/test/case/id/62dff19d6ae3b9d5c9daf09e
        failing since 90 days (last pass: next-20220422, first fail: next-20220427)

    2022-07-26T13:52:00.361626  <8>[   37.161632] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=cros-ec-sensors-accel0-probed RESULT=fail>
    2022-07-26T13:52:01.390857  /lava-6894733/1/../bin/lava-test-case
    2022-07-26T13:52:01.400854  <8>[   38.200685] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=cros-ec-sensors-accel1-probed RESULT=fail>   

  * baseline.bootrr.cros-ec-sensors-accel0-probed: https://kernelci.org/test/case/id/62dff19d6ae3b9d5c9daf09f
        failing since 90 days (last pass: next-20220422, first fail: next-20220427)

    2022-07-26T13:51:59.312211  <8>[   36.110358] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=cros-ec-sensors-driver-present RESULT=pass>
    2022-07-26T13:52:00.350522  /lava-6894733/1/../bin/lava-test-case   

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
rk3399-gru-kevin             | arm64 | lab-collabora   | gcc-10   | defconfig+arm64-chromebook   | 3          

  Details:     https://kernelci.org/test/plan/id/62e00042648ee814eadaf07f

  Results:     85 PASS, 7 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220726/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-rk3399-gru-kevin.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220726/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-rk3399-gru-kevin.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220718.0/arm64/rootfs.cpio.gz 

  * baseline.bootrr.cros-ec-sensors-gyro0-probed: https://kernelci.org/test/case/id/62e00043648ee814eadaf0c4
        failing since 90 days (last pass: next-20220421, first fail: next-20220426)

    2022-07-26T14:54:38.600731  /lava-6895791/1/../bin/lava-test-case
    2022-07-26T14:54:38.612360  <8>[   34.807024] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=cros-ec-sensors-gyro0-probed RESULT=fail>   

  * baseline.bootrr.cros-ec-sensors-accel1-probed: https://kernelci.org/test/case/id/62e00043648ee814eadaf0c5
        failing since 90 days (last pass: next-20220421, first fail: next-20220426)

    2022-07-26T14:54:37.553521  /lava-6895791/1/../bin/lava-test-case
    2022-07-26T14:54:37.568620  <8>[   33.763158] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=cros-ec-sensors-accel1-probed RESULT=fail>   

  * baseline.bootrr.cros-ec-sensors-accel0-probed: https://kernelci.org/test/case/id/62e00043648ee814eadaf0c6
        failing since 90 days (last pass: next-20220421, first fail: next-20220426)

    2022-07-26T14:54:35.460779  <8>[   31.654895] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=cros-ec-sensors-driver-present RESULT=pass>
    2022-07-26T14:54:36.509908  /lava-6895791/1/../bin/lava-test-case
    2022-07-26T14:54:36.523154  <8>[   32.717354] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=cros-ec-sensors-accel0-probed RESULT=fail>   

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
rk3399-roc-pc                | arm64 | lab-clabbe      | gcc-10   | defconfig+CON..._64K_PAGES=y | 1          

  Details:     https://kernelci.org/test/plan/id/62dffa1a4d3c34319bdaf07a

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+CONFIG_ARM64_64K_PAGES=y
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220726/arm64/defconfig+CONFIG_ARM64_64K_PAGES=y/gcc-10/lab-clabbe/baseline-rk3399-roc-pc.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220726/arm64/defconfig+CONFIG_ARM64_64K_PAGES=y/gcc-10/lab-clabbe/baseline-rk3399-roc-pc.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220718.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/62dffa1a4d3c34319bdaf07b
        failing since 19 days (last pass: next-20220705, first fail: next-20220706) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
rk3399-roc-pc                | arm64 | lab-clabbe      | gcc-10   | defconfig                    | 1          

  Details:     https://kernelci.org/test/plan/id/62dffece5b9b5c4c7bdaf089

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220726/arm64/defconfig/gcc-10/lab-clabbe/baseline-rk3399-roc-pc.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220726/arm64/defconfig/gcc-10/lab-clabbe/baseline-rk3399-roc-pc.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220718.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/62dffece5b9b5c4c7bdaf08a
        new failure (last pass: next-20220719) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
sc7180-trogdo...zor-limozeen | arm64 | lab-collabora   | clang-13 | defconfig+arm64-chromebook   | 1          

  Details:     https://kernelci.org/test/plan/id/62dff0f708484ba67edaf0b0

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook
  Compiler:    clang-13 (Debian clang version 13.0.1-++20220126092033+75e33f71c2da-1~exp1~20220126212112.63)
  Plain log:   https://storage.kernelci.org//next/master/next-20220726/arm64/defconfig+arm64-chromebook/clang-13/lab-collabora/baseline-sc7180-trogdor-lazor-limozeen.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220726/arm64/defconfig+arm64-chromebook/clang-13/lab-collabora/baseline-sc7180-trogdor-lazor-limozeen.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220718.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/62dff0f708484ba67edaf0b1
        failing since 5 days (last pass: next-20220719, first fail: next-20220720) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
sc7180-trogdo...zor-limozeen | arm64 | lab-collabora   | gcc-10   | defconfig+arm64-chromebook   | 1          

  Details:     https://kernelci.org/test/plan/id/62dffe2200c2ad9370daf056

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220726/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-sc7180-trogdor-lazor-limozeen.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220726/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-sc7180-trogdor-lazor-limozeen.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220718.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/62dffe2200c2ad9370daf057
        failing since 3 days (last pass: next-20220719, first fail: next-20220722)