Subject: next/master baseline: 607 runs, 22 regressions (next-20221103)

From: "kernelci.org bot" <[email-masked]>
Date: Thu, 03 Nov 2022 02:47:01 -0700 (PDT)

next/master baseline: 607 runs, 22 regressions (next-20221103)

Regressions Summary
-------------------

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
am57xx-beagle-x15            | arm   | lab-linaro-lkft | gcc-10   | multi_v7_defc...CONFIG_SMP=n | 1          
am57xx-beagle-x15            | arm   | lab-linaro-lkft | gcc-10   | multi_v7_defconfig+debug     | 1          
imx6sx-sdb                   | arm   | lab-nxp         | gcc-10   | imx_v6_v7_defconfig          | 1          
imx7ulp-evk                  | arm   | lab-nxp         | gcc-10   | imx_v6_v7_defconfig          | 1          
imx7ulp-evk                  | arm   | lab-nxp         | gcc-10   | multi_v7_defc...CONFIG_SMP=n | 1          
imx7ulp-evk                  | arm   | lab-nxp         | gcc-10   | multi_v7_defconfig           | 1          
imx7ulp-evk                  | arm   | lab-nxp         | gcc-10   | multi_v7_defc...MB2_KERNEL=y | 1          
jetson-tk1                   | arm   | lab-baylibre    | gcc-10   | multi_v7_defc...G_ARM_LPAE=y | 1          
kontron-pitx-imx8m           | arm64 | lab-kontron     | clang-16 | defconfig+CON..._64K_PAGES=y | 1          
kontron-pitx-imx8m           | arm64 | lab-kontron     | gcc-10   | defconfig+crypto             | 1          
mt8183-kukui-...uniper-sku16 | arm64 | lab-collabora   | clang-13 | cros://chrome...4-chromebook | 1          
mt8183-kukui-...uniper-sku16 | arm64 | lab-collabora   | gcc-10   | defconfig+arm64-chromebook   | 1          
ox820-clouden...lug-series-3 | arm   | lab-baylibre    | gcc-10   | oxnas_v6_defconfig           | 1          
qemu_arm-virt-gicv2          | arm   | lab-baylibre    | gcc-10   | multi_v7_defconfig+debug     | 1          
qemu_arm-virt-gicv2          | arm   | lab-broonie     | gcc-10   | multi_v7_defconfig+debug     | 1          
qemu_arm-virt-gicv2-uefi     | arm   | lab-baylibre    | gcc-10   | multi_v7_defconfig+debug     | 1          
qemu_arm-virt-gicv2-uefi     | arm   | lab-broonie     | gcc-10   | multi_v7_defconfig+debug     | 1          
qemu_arm-virt-gicv3          | arm   | lab-baylibre    | gcc-10   | multi_v7_defconfig+debug     | 1          
qemu_arm-virt-gicv3          | arm   | lab-broonie     | gcc-10   | multi_v7_defconfig+debug     | 1          
qemu_arm-virt-gicv3-uefi     | arm   | lab-baylibre    | gcc-10   | multi_v7_defconfig+debug     | 1          
qemu_arm-virt-gicv3-uefi     | arm   | lab-broonie     | gcc-10   | multi_v7_defconfig+debug     | 1          
sc7180-trogdo...zor-limozeen | arm64 | lab-collabora   | gcc-10   | defconfig+arm64-chromebook   | 1          

  Details:  https://kernelci.org/test/job/next/branch/master/kernel/next-20221103/plan/baseline/

  Test:     baseline
  Tree:     next
  Branch:   master
  Describe: next-20221103
  URL:      https://git.kernel.org/pub/scm/linux/kernel/git/next/linux-next.git
  SHA:      81214a573d19ae2fa5b528286ba23cd1cb17feec 

Test Regressions
---------------- 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
am57xx-beagle-x15            | arm   | lab-linaro-lkft | gcc-10   | multi_v7_defc...CONFIG_SMP=n | 1          

  Details:     https://kernelci.org/test/plan/id/636367567d21e498bde7db5a

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_SMP=n
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221103/arm/multi_v7_defconfig+CONFIG_SMP=n/gcc-10/lab-linaro-lkft/baseline-am57xx-beagle-x15.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221103/arm/multi_v7_defconfig+CONFIG_SMP=n/gcc-10/lab-linaro-lkft/baseline-am57xx-beagle-x15.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221024.1/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/636367567d21e498bde7db5b
        failing since 47 days (last pass: next-20220915, first fail: next-20220916) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
am57xx-beagle-x15            | arm   | lab-linaro-lkft | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/63636c9a8ddec27bbce7db65

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221103/arm/multi_v7_defconfig+debug/gcc-10/lab-linaro-lkft/baseline-am57xx-beagle-x15.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221103/arm/multi_v7_defconfig+debug/gcc-10/lab-linaro-lkft/baseline-am57xx-beagle-x15.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221024.1/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/63636c9a8ddec27bbce7db66
        failing since 50 days (last pass: next-20220907, first fail: next-20220913) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
imx6sx-sdb                   | arm   | lab-nxp         | gcc-10   | imx_v6_v7_defconfig          | 1          

  Details:     https://kernelci.org/test/plan/id/63636589dbc06e104be7db4e

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: imx_v6_v7_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221103/arm/imx_v6_v7_defconfig/gcc-10/lab-nxp/baseline-imx6sx-sdb.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221103/arm/imx_v6_v7_defconfig/gcc-10/lab-nxp/baseline-imx6sx-sdb.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221024.1/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/63636589dbc06e104be7db4f
        failing since 56 days (last pass: next-20220831, first fail: next-20220907) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
imx7ulp-evk                  | arm   | lab-nxp         | gcc-10   | imx_v6_v7_defconfig          | 1          

  Details:     https://kernelci.org/test/plan/id/63637a3d9e2bc63c7ee7dbb0

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: imx_v6_v7_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221103/arm/imx_v6_v7_defconfig/gcc-10/lab-nxp/baseline-imx7ulp-evk.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221103/arm/imx_v6_v7_defconfig/gcc-10/lab-nxp/baseline-imx7ulp-evk.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221024.1/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/63637a3d9e2bc63c7ee7dbb1
        failing since 146 days (last pass: next-20220601, first fail: next-20220610) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
imx7ulp-evk                  | arm   | lab-nxp         | gcc-10   | multi_v7_defc...CONFIG_SMP=n | 1          

  Details:     https://kernelci.org/test/plan/id/63637d0dcfcbce839ce7db4e

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_SMP=n
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221103/arm/multi_v7_defconfig+CONFIG_SMP=n/gcc-10/lab-nxp/baseline-imx7ulp-evk.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221103/arm/multi_v7_defconfig+CONFIG_SMP=n/gcc-10/lab-nxp/baseline-imx7ulp-evk.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221024.1/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/63637d0dcfcbce839ce7db4f
        failing since 36 days (last pass: next-20220921, first fail: next-20220927) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
imx7ulp-evk                  | arm   | lab-nxp         | gcc-10   | multi_v7_defconfig           | 1          

  Details:     https://kernelci.org/test/plan/id/63637e75d9faa4f52be7db4e

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221103/arm/multi_v7_defconfig/gcc-10/lab-nxp/baseline-imx7ulp-evk.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221103/arm/multi_v7_defconfig/gcc-10/lab-nxp/baseline-imx7ulp-evk.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221024.1/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/63637e75d9faa4f52be7db4f
        failing since 40 days (last pass: next-20220921, first fail: next-20220923) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
imx7ulp-evk                  | arm   | lab-nxp         | gcc-10   | multi_v7_defc...MB2_KERNEL=y | 1          

  Details:     https://kernelci.org/test/plan/id/63637fdedd3a66fb73e7db7e

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221103/arm/multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y/gcc-10/lab-nxp/baseline-imx7ulp-evk.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221103/arm/multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y/gcc-10/lab-nxp/baseline-imx7ulp-evk.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221024.1/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/63637fdedd3a66fb73e7db7f
        failing since 48 days (last pass: next-20220915, first fail: next-20220916) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
jetson-tk1                   | arm   | lab-baylibre    | gcc-10   | multi_v7_defc...G_ARM_LPAE=y | 1          

  Details:     https://kernelci.org/test/plan/id/63636d9a0f16017f94e7db8d

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221103/arm/multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y/gcc-10/lab-baylibre/baseline-jetson-tk1.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221103/arm/multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y/gcc-10/lab-baylibre/baseline-jetson-tk1.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221024.1/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/63636d9a0f16017f94e7db8e
        failing since 205 days (last pass: next-20220401, first fail: next-20220411) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
kontron-pitx-imx8m           | arm64 | lab-kontron     | clang-16 | defconfig+CON..._64K_PAGES=y | 1          

  Details:     https://kernelci.org/test/plan/id/63636ff164af8916fce7db52

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+CONFIG_ARM64_64K_PAGES=y
  Compiler:    clang-16 (Debian clang version 16.0.0-++20221025071726+e6c8418aab0b-1~exp1~20221025071826.433)
  Plain log:   https://storage.kernelci.org//next/master/next-20221103/arm64/defconfig+CONFIG_ARM64_64K_PAGES=y/clang-16/lab-kontron/baseline-kontron-pitx-imx8m.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221103/arm64/defconfig+CONFIG_ARM64_64K_PAGES=y/clang-16/lab-kontron/baseline-kontron-pitx-imx8m.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221024.1/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/63636ff164af8916fce7db53
        failing since 2 days (last pass: next-20221028, first fail: next-20221101) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
kontron-pitx-imx8m           | arm64 | lab-kontron     | gcc-10   | defconfig+crypto             | 1          

  Details:     https://kernelci.org/test/plan/id/63636b5598e349eab1e7db73

  Results:     51 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+crypto
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221103/arm64/defconfig+crypto/gcc-10/lab-kontron/baseline-kontron-pitx-imx8m.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221103/arm64/defconfig+crypto/gcc-10/lab-kontron/baseline-kontron-pitx-imx8m.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221024.1/arm64/rootfs.cpio.gz 

  * baseline.bootrr.dwc3-usb1-probed: https://kernelci.org/test/case/id/63636b5598e349eab1e7db86
        new failure (last pass: next-20221101)

    2022-11-03T07:18:33.449252  /lava-197170/1/../bin/lava-test-case
    2022-11-03T07:18:33.449643  <8>[   16.966581] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=dwc3-usb1-probed RESULT=fail>   

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
mt8183-kukui-...uniper-sku16 | arm64 | lab-collabora   | clang-13 | cros://chrome...4-chromebook | 1          

  Details:     https://kernelci.org/test/plan/id/636359bbe6c66ce9a0e7db4f

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: cros://chromeos-5.10/arm64/chromiumos-arm64.flavour.config+arm64-chromebook
  Compiler:    clang-13 (Debian clang version 13.0.1-6~deb11u1)
  Plain log:   https://storage.kernelci.org//next/master/next-20221103/arm64/cros---chromeos-5.10-arm64-chromiumos-arm64.flavour.config+arm64-chromebook/clang-13/lab-collabora/baseline-mt8183-kukui-jacuzzi-juniper-sku16.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221103/arm64/cros---chromeos-5.10-arm64-chromiumos-arm64.flavour.config+arm64-chromebook/clang-13/lab-collabora/baseline-mt8183-kukui-jacuzzi-juniper-sku16.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221024.1/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/636359bbe6c66ce9a0e7db50
        failing since 111 days (last pass: next-20220705, first fail: next-20220714) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
mt8183-kukui-...uniper-sku16 | arm64 | lab-collabora   | gcc-10   | defconfig+arm64-chromebook   | 1          

  Details:     https://kernelci.org/test/plan/id/63636b5471ae0fd16ce7db67

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221103/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-mt8183-kukui-jacuzzi-juniper-sku16.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221103/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-mt8183-kukui-jacuzzi-juniper-sku16.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221024.1/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/63636b5471ae0fd16ce7db68
        failing since 139 days (last pass: next-20220610, first fail: next-20220616) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
ox820-clouden...lug-series-3 | arm   | lab-baylibre    | gcc-10   | oxnas_v6_defconfig           | 1          

  Details:     https://kernelci.org/test/plan/id/636361e8bbb9049418e7db62

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: oxnas_v6_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221103/arm/oxnas_v6_defconfig/gcc-10/lab-baylibre/baseline-ox820-cloudengines-pogoplug-series-3.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221103/arm/oxnas_v6_defconfig/gcc-10/lab-baylibre/baseline-ox820-cloudengines-pogoplug-series-3.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221024.1/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/636361e8bbb9049418e7db63
        failing since 71 days (last pass: next-20220822, first fail: next-20220823) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
qemu_arm-virt-gicv2          | arm   | lab-baylibre    | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/63636c9b42a10a6602e7db64

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221103/arm/multi_v7_defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_arm-virt-gicv2.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221103/arm/multi_v7_defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_arm-virt-gicv2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221024.1/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/63636c9b42a10a6602e7db65
        failing since 50 days (last pass: next-20220907, first fail: next-20220913) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
qemu_arm-virt-gicv2          | arm   | lab-broonie     | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/636372fcd88966edb4e7dba7

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221103/arm/multi_v7_defconfig+debug/gcc-10/lab-broonie/baseline-qemu_arm-virt-gicv2.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221103/arm/multi_v7_defconfig+debug/gcc-10/lab-broonie/baseline-qemu_arm-virt-gicv2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221024.1/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/636372fcd88966edb4e7dba8
        failing since 50 days (last pass: next-20220907, first fail: next-20220913) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
qemu_arm-virt-gicv2-uefi     | arm   | lab-baylibre    | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/63636c9cffeff02f08e7db6b

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221103/arm/multi_v7_defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_arm-virt-gicv2-uefi.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221103/arm/multi_v7_defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_arm-virt-gicv2-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221024.1/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/63636c9cffeff02f08e7db6c
        failing since 50 days (last pass: next-20220907, first fail: next-20220913) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
qemu_arm-virt-gicv2-uefi     | arm   | lab-broonie     | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/6363744f09f213ffb1e7db69

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221103/arm/multi_v7_defconfig+debug/gcc-10/lab-broonie/baseline-qemu_arm-virt-gicv2-uefi.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221103/arm/multi_v7_defconfig+debug/gcc-10/lab-broonie/baseline-qemu_arm-virt-gicv2-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221024.1/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6363744f09f213ffb1e7db6a
        failing since 50 days (last pass: next-20220907, first fail: next-20220913) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
qemu_arm-virt-gicv3          | arm   | lab-baylibre    | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/63636c9942a10a6602e7db5f

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221103/arm/multi_v7_defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_arm-virt-gicv3.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221103/arm/multi_v7_defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_arm-virt-gicv3.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221024.1/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/63636c9942a10a6602e7db60
        failing since 50 days (last pass: next-20220907, first fail: next-20220913) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
qemu_arm-virt-gicv3          | arm   | lab-broonie     | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/636372e674c2c27e7fe7db5e

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221103/arm/multi_v7_defconfig+debug/gcc-10/lab-broonie/baseline-qemu_arm-virt-gicv3.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221103/arm/multi_v7_defconfig+debug/gcc-10/lab-broonie/baseline-qemu_arm-virt-gicv3.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221024.1/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/636372e674c2c27e7fe7db5f
        failing since 50 days (last pass: next-20220907, first fail: next-20220913) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
qemu_arm-virt-gicv3-uefi     | arm   | lab-baylibre    | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/63636c9affeff02f08e7db66

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221103/arm/multi_v7_defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_arm-virt-gicv3-uefi.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221103/arm/multi_v7_defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_arm-virt-gicv3-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221024.1/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/63636c9affeff02f08e7db67
        failing since 50 days (last pass: next-20220907, first fail: next-20220913) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
qemu_arm-virt-gicv3-uefi     | arm   | lab-broonie     | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/636372fa96f7480d15e7db56

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221103/arm/multi_v7_defconfig+debug/gcc-10/lab-broonie/baseline-qemu_arm-virt-gicv3-uefi.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221103/arm/multi_v7_defconfig+debug/gcc-10/lab-broonie/baseline-qemu_arm-virt-gicv3-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221024.1/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/636372fa96f7480d15e7db57
        failing since 50 days (last pass: next-20220907, first fail: next-20220913) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
sc7180-trogdo...zor-limozeen | arm64 | lab-collabora   | gcc-10   | defconfig+arm64-chromebook   | 1          

  Details:     https://kernelci.org/test/plan/id/63636a562d884642b6e7db4e

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221103/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-sc7180-trogdor-lazor-limozeen.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221103/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-sc7180-trogdor-lazor-limozeen.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221024.1/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/63636a562d884642b6e7db4f
        failing since 8 days (last pass: next-20221025, first fail: next-20221026)