Subject: next/master baseline: 684 runs, 27 regressions (next-20221025)

From: "kernelci.org bot" <[email-masked]>
Date: Tue, 25 Oct 2022 02:47:17 -0700 (PDT)

next/master baseline: 684 runs, 27 regressions (next-20221025)

Regressions Summary
-------------------

platform                     | arch   | lab           | compiler | defconfig                    | regressions
-----------------------------+--------+---------------+----------+------------------------------+------------
d2500cc                      | x86_64 | lab-clabbe    | gcc-10   | x86_64_defconfig+debug       | 1          
jetson-tk1                   | arm    | lab-baylibre  | clang-16 | multi_v7_defconfig           | 1          
jetson-tk1                   | arm    | lab-baylibre  | gcc-10   | multi_v7_defc...G_ARM_LPAE=y | 1          
juno-uboot                   | arm64  | lab-broonie   | gcc-10   | defconfig+CON...OMIZE_BASE=y | 1          
kontron-pitx-imx8m           | arm64  | lab-kontron   | gcc-10   | defconfig+CON..._64K_PAGES=y | 1          
mt8183-kukui-...uniper-sku16 | arm64  | lab-collabora | clang-13 | cros://chrome...4-chromebook | 1          
mt8183-kukui-...uniper-sku16 | arm64  | lab-collabora | clang-13 | defconfig+arm64-chromebook   | 1          
mt8183-kukui-...uniper-sku16 | arm64  | lab-collabora | gcc-10   | defconfig+arm64-chromebook   | 1          
ox820-clouden...lug-series-3 | arm    | lab-baylibre  | gcc-10   | oxnas_v6_defconfig           | 1          
qemu_arm-virt-gicv2          | arm    | lab-baylibre  | gcc-10   | multi_v7_defconfig+debug     | 1          
qemu_arm-virt-gicv2          | arm    | lab-broonie   | gcc-10   | multi_v7_defconfig+debug     | 1          
qemu_arm-virt-gicv2-uefi     | arm    | lab-baylibre  | gcc-10   | multi_v7_defconfig+debug     | 1          
qemu_arm-virt-gicv2-uefi     | arm    | lab-broonie   | gcc-10   | multi_v7_defconfig+debug     | 1          
qemu_arm-virt-gicv3          | arm    | lab-baylibre  | gcc-10   | multi_v7_defconfig+debug     | 1          
qemu_arm-virt-gicv3          | arm    | lab-broonie   | gcc-10   | multi_v7_defconfig+debug     | 1          
qemu_arm-virt-gicv3          | arm    | lab-collabora | gcc-10   | multi_v7_defconfig+debug     | 1          
qemu_arm-virt-gicv3-uefi     | arm    | lab-baylibre  | gcc-10   | multi_v7_defconfig+debug     | 1          
qemu_arm-virt-gicv3-uefi     | arm    | lab-broonie   | gcc-10   | multi_v7_defconfig+debug     | 1          
qemu_x86_64                  | x86_64 | lab-baylibre  | gcc-10   | x86_64_defconfig+debug       | 1          
qemu_x86_64                  | x86_64 | lab-broonie   | gcc-10   | x86_64_defconfig+debug       | 1          
qemu_x86_64-uefi             | x86_64 | lab-baylibre  | gcc-10   | x86_64_defconfig+debug       | 1          
qemu_x86_64-uefi             | x86_64 | lab-broonie   | gcc-10   | x86_64_defconfig+debug       | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-baylibre  | gcc-10   | x86_64_defconfig+debug       | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-broonie   | gcc-10   | x86_64_defconfig+debug       | 1          
rk3399-gru-kevin             | arm64  | lab-collabora | clang-13 | cros://chrome...4-chromebook | 3          

  Details:  https://kernelci.org/test/job/next/branch/master/kernel/next-20221025/plan/baseline/

  Test:     baseline
  Tree:     next
  Branch:   master
  Describe: next-20221025
  URL:      https://git.kernel.org/pub/scm/linux/kernel/git/next/linux-next.git
  SHA:      89bf6e28373beef9577fa71f996a5f73a569617c 

Test Regressions
---------------- 

platform                     | arch   | lab           | compiler | defconfig                    | regressions
-----------------------------+--------+---------------+----------+------------------------------+------------
d2500cc                      | x86_64 | lab-clabbe    | gcc-10   | x86_64_defconfig+debug       | 1          

  Details:     https://kernelci.org/test/plan/id/6357799c4e241fbbda5e5b72

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+debug
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221025/x86_64/x86_64_defconfig+debug/gcc-10/lab-clabbe/baseline-d2500cc.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221025/x86_64/x86_64_defconfig+debug/gcc-10/lab-clabbe/baseline-d2500cc.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221007.0/x86/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6357799c4e241fbbda5e5b73
        failing since 1 day (last pass: next-20221021, first fail: next-20221024) 

platform                     | arch   | lab           | compiler | defconfig                    | regressions
-----------------------------+--------+---------------+----------+------------------------------+------------
jetson-tk1                   | arm    | lab-baylibre  | clang-16 | multi_v7_defconfig           | 1          

  Details:     https://kernelci.org/test/plan/id/635790c654fba7f6b35e5b47

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig
  Compiler:    clang-16 (Debian clang version 16.0.0-++20221005071926+a3a9b0743e31-1~exp1~20221005072024.410)
  Plain log:   https://storage.kernelci.org//next/master/next-20221025/arm/multi_v7_defconfig/clang-16/lab-baylibre/baseline-jetson-tk1.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221025/arm/multi_v7_defconfig/clang-16/lab-baylibre/baseline-jetson-tk1.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221007.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/635790c654fba7f6b35e5b48
        failing since 62 days (last pass: next-20220822, first fail: next-20220823) 

platform                     | arch   | lab           | compiler | defconfig                    | regressions
-----------------------------+--------+---------------+----------+------------------------------+------------
jetson-tk1                   | arm    | lab-baylibre  | gcc-10   | multi_v7_defc...G_ARM_LPAE=y | 1          

  Details:     https://kernelci.org/test/plan/id/63578e33a3efbd09aa5e5b5c

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221025/arm/multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y/gcc-10/lab-baylibre/baseline-jetson-tk1.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221025/arm/multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y/gcc-10/lab-baylibre/baseline-jetson-tk1.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221007.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/63578e33a3efbd09aa5e5b5d
        failing since 196 days (last pass: next-20220401, first fail: next-20220411) 

platform                     | arch   | lab           | compiler | defconfig                    | regressions
-----------------------------+--------+---------------+----------+------------------------------+------------
juno-uboot                   | arm64  | lab-broonie   | gcc-10   | defconfig+CON...OMIZE_BASE=y | 1          

  Details:     https://kernelci.org/test/plan/id/63577cc0d605b4c03a5e5b64

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+CONFIG_RANDOMIZE_BASE=y
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221025/arm64/defconfig+CONFIG_RANDOMIZE_BASE=y/gcc-10/lab-broonie/baseline-juno-uboot.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221025/arm64/defconfig+CONFIG_RANDOMIZE_BASE=y/gcc-10/lab-broonie/baseline-juno-uboot.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221007.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/63577cc0d605b4c03a5e5b65
        new failure (last pass: next-20221024) 

platform                     | arch   | lab           | compiler | defconfig                    | regressions
-----------------------------+--------+---------------+----------+------------------------------+------------
kontron-pitx-imx8m           | arm64  | lab-kontron   | gcc-10   | defconfig+CON..._64K_PAGES=y | 1          

  Details:     https://kernelci.org/test/plan/id/63578247bfeaa0f9375e5b71

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+CONFIG_ARM64_64K_PAGES=y
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221025/arm64/defconfig+CONFIG_ARM64_64K_PAGES=y/gcc-10/lab-kontron/baseline-kontron-pitx-imx8m.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221025/arm64/defconfig+CONFIG_ARM64_64K_PAGES=y/gcc-10/lab-kontron/baseline-kontron-pitx-imx8m.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221007.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/63578247bfeaa0f9375e5b72
        failing since 13 days (last pass: next-20221011, first fail: next-20221012) 

platform                     | arch   | lab           | compiler | defconfig                    | regressions
-----------------------------+--------+---------------+----------+------------------------------+------------
mt8183-kukui-...uniper-sku16 | arm64  | lab-collabora | clang-13 | cros://chrome...4-chromebook | 1          

  Details:     https://kernelci.org/test/plan/id/63578dd292f0cc91b95e5b74

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: cros://chromeos-5.10/arm64/chromiumos-arm64.flavour.config+arm64-chromebook
  Compiler:    clang-13 (Debian clang version 13.0.1-6~deb11u1)
  Plain log:   https://storage.kernelci.org//next/master/next-20221025/arm64/cros---chromeos-5.10-arm64-chromiumos-arm64.flavour.config+arm64-chromebook/clang-13/lab-collabora/baseline-mt8183-kukui-jacuzzi-juniper-sku16.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221025/arm64/cros---chromeos-5.10-arm64-chromiumos-arm64.flavour.config+arm64-chromebook/clang-13/lab-collabora/baseline-mt8183-kukui-jacuzzi-juniper-sku16.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221007.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/63578dd292f0cc91b95e5b75
        failing since 102 days (last pass: next-20220705, first fail: next-20220714) 

platform                     | arch   | lab           | compiler | defconfig                    | regressions
-----------------------------+--------+---------------+----------+------------------------------+------------
mt8183-kukui-...uniper-sku16 | arm64  | lab-collabora | clang-13 | defconfig+arm64-chromebook   | 1          

  Details:     https://kernelci.org/test/plan/id/635789a9fc6eab64a65e5baf

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook
  Compiler:    clang-13 (Debian clang version 13.0.1-6~deb11u1)
  Plain log:   https://storage.kernelci.org//next/master/next-20221025/arm64/defconfig+arm64-chromebook/clang-13/lab-collabora/baseline-mt8183-kukui-jacuzzi-juniper-sku16.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221025/arm64/defconfig+arm64-chromebook/clang-13/lab-collabora/baseline-mt8183-kukui-jacuzzi-juniper-sku16.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221007.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/635789a9fc6eab64a65e5bb0
        failing since 165 days (last pass: next-20220506, first fail: next-20220512) 

platform                     | arch   | lab           | compiler | defconfig                    | regressions
-----------------------------+--------+---------------+----------+------------------------------+------------
mt8183-kukui-...uniper-sku16 | arm64  | lab-collabora | gcc-10   | defconfig+arm64-chromebook   | 1          

  Details:     https://kernelci.org/test/plan/id/63577af938574ae7de5e5b3b

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221025/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-mt8183-kukui-jacuzzi-juniper-sku16.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221025/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-mt8183-kukui-jacuzzi-juniper-sku16.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221007.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/63577af938574ae7de5e5b3c
        failing since 130 days (last pass: next-20220610, first fail: next-20220616) 

platform                     | arch   | lab           | compiler | defconfig                    | regressions
-----------------------------+--------+---------------+----------+------------------------------+------------
ox820-clouden...lug-series-3 | arm    | lab-baylibre  | gcc-10   | oxnas_v6_defconfig           | 1          

  Details:     https://kernelci.org/test/plan/id/635775886c6d51aaae5e5b5f

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: oxnas_v6_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221025/arm/oxnas_v6_defconfig/gcc-10/lab-baylibre/baseline-ox820-cloudengines-pogoplug-series-3.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221025/arm/oxnas_v6_defconfig/gcc-10/lab-baylibre/baseline-ox820-cloudengines-pogoplug-series-3.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221007.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/635775886c6d51aaae5e5b60
        failing since 62 days (last pass: next-20220822, first fail: next-20220823) 

platform                     | arch   | lab           | compiler | defconfig                    | regressions
-----------------------------+--------+---------------+----------+------------------------------+------------
qemu_arm-virt-gicv2          | arm    | lab-baylibre  | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/63577c14a0b929851d5e5b3f

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221025/arm/multi_v7_defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_arm-virt-gicv2.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221025/arm/multi_v7_defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_arm-virt-gicv2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221007.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/63577c14a0b929851d5e5b40
        failing since 41 days (last pass: next-20220907, first fail: next-20220913) 

platform                     | arch   | lab           | compiler | defconfig                    | regressions
-----------------------------+--------+---------------+----------+------------------------------+------------
qemu_arm-virt-gicv2          | arm    | lab-broonie   | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/63577e3f59c9bf16185e5b7e

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221025/arm/multi_v7_defconfig+debug/gcc-10/lab-broonie/baseline-qemu_arm-virt-gicv2.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221025/arm/multi_v7_defconfig+debug/gcc-10/lab-broonie/baseline-qemu_arm-virt-gicv2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221007.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/63577e3f59c9bf16185e5b7f
        failing since 41 days (last pass: next-20220907, first fail: next-20220913) 

platform                     | arch   | lab           | compiler | defconfig                    | regressions
-----------------------------+--------+---------------+----------+------------------------------+------------
qemu_arm-virt-gicv2-uefi     | arm    | lab-baylibre  | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/63577c4984822dce8a5e5b4f

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221025/arm/multi_v7_defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_arm-virt-gicv2-uefi.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221025/arm/multi_v7_defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_arm-virt-gicv2-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221007.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/63577c4984822dce8a5e5b50
        failing since 41 days (last pass: next-20220907, first fail: next-20220913) 

platform                     | arch   | lab           | compiler | defconfig                    | regressions
-----------------------------+--------+---------------+----------+------------------------------+------------
qemu_arm-virt-gicv2-uefi     | arm    | lab-broonie   | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/63577e55ae998016775e5b62

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221025/arm/multi_v7_defconfig+debug/gcc-10/lab-broonie/baseline-qemu_arm-virt-gicv2-uefi.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221025/arm/multi_v7_defconfig+debug/gcc-10/lab-broonie/baseline-qemu_arm-virt-gicv2-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221007.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/63577e55ae998016775e5b63
        failing since 41 days (last pass: next-20220907, first fail: next-20220913) 

platform                     | arch   | lab           | compiler | defconfig                    | regressions
-----------------------------+--------+---------------+----------+------------------------------+------------
qemu_arm-virt-gicv3          | arm    | lab-baylibre  | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/63577c58d563b6016e5e5bb0

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221025/arm/multi_v7_defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_arm-virt-gicv3.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221025/arm/multi_v7_defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_arm-virt-gicv3.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221007.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/63577c58d563b6016e5e5bb1
        failing since 39 days (last pass: next-20220907, first fail: next-20220915) 

platform                     | arch   | lab           | compiler | defconfig                    | regressions
-----------------------------+--------+---------------+----------+------------------------------+------------
qemu_arm-virt-gicv3          | arm    | lab-broonie   | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/63577e53ae998016775e5b5f

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221025/arm/multi_v7_defconfig+debug/gcc-10/lab-broonie/baseline-qemu_arm-virt-gicv3.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221025/arm/multi_v7_defconfig+debug/gcc-10/lab-broonie/baseline-qemu_arm-virt-gicv3.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221007.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/63577e53ae998016775e5b60
        failing since 39 days (last pass: next-20220907, first fail: next-20220915) 

platform                     | arch   | lab           | compiler | defconfig                    | regressions
-----------------------------+--------+---------------+----------+------------------------------+------------
qemu_arm-virt-gicv3          | arm    | lab-collabora | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/63577b34b3a64d6c405e5b3a

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221025/arm/multi_v7_defconfig+debug/gcc-10/lab-collabora/baseline-qemu_arm-virt-gicv3.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221025/arm/multi_v7_defconfig+debug/gcc-10/lab-collabora/baseline-qemu_arm-virt-gicv3.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221007.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/63577b34b3a64d6c405e5b3b
        failing since 39 days (last pass: next-20220907, first fail: next-20220915) 

platform                     | arch   | lab           | compiler | defconfig                    | regressions
-----------------------------+--------+---------------+----------+------------------------------+------------
qemu_arm-virt-gicv3-uefi     | arm    | lab-baylibre  | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/63577c1298350784635e5b73

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221025/arm/multi_v7_defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_arm-virt-gicv3-uefi.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221025/arm/multi_v7_defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_arm-virt-gicv3-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221007.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/63577c1298350784635e5b74
        failing since 41 days (last pass: next-20220907, first fail: next-20220913) 

platform                     | arch   | lab           | compiler | defconfig                    | regressions
-----------------------------+--------+---------------+----------+------------------------------+------------
qemu_arm-virt-gicv3-uefi     | arm    | lab-broonie   | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/63577e17136897cf9c5e5b7d

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221025/arm/multi_v7_defconfig+debug/gcc-10/lab-broonie/baseline-qemu_arm-virt-gicv3-uefi.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221025/arm/multi_v7_defconfig+debug/gcc-10/lab-broonie/baseline-qemu_arm-virt-gicv3-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221007.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/63577e17136897cf9c5e5b7e
        failing since 41 days (last pass: next-20220907, first fail: next-20220913) 

platform                     | arch   | lab           | compiler | defconfig                    | regressions
-----------------------------+--------+---------------+----------+------------------------------+------------
qemu_x86_64                  | x86_64 | lab-baylibre  | gcc-10   | x86_64_defconfig+debug       | 1          

  Details:     https://kernelci.org/test/plan/id/63577b4e42b8c37d6d5e5b6b

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+debug
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221025/x86_64/x86_64_defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_x86_64.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221025/x86_64/x86_64_defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_x86_64.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221007.0/x86/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/63577b4e42b8c37d6d5e5b6c
        failing since 1 day (last pass: next-20221021, first fail: next-20221024) 

platform                     | arch   | lab           | compiler | defconfig                    | regressions
-----------------------------+--------+---------------+----------+------------------------------+------------
qemu_x86_64                  | x86_64 | lab-broonie   | gcc-10   | x86_64_defconfig+debug       | 1          

  Details:     https://kernelci.org/test/plan/id/63577cafc60c0f44f05e5b84

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+debug
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221025/x86_64/x86_64_defconfig+debug/gcc-10/lab-broonie/baseline-qemu_x86_64.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221025/x86_64/x86_64_defconfig+debug/gcc-10/lab-broonie/baseline-qemu_x86_64.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221007.0/x86/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/63577cafc60c0f44f05e5b85
        failing since 1 day (last pass: next-20221021, first fail: next-20221024) 

platform                     | arch   | lab           | compiler | defconfig                    | regressions
-----------------------------+--------+---------------+----------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-baylibre  | gcc-10   | x86_64_defconfig+debug       | 1          

  Details:     https://kernelci.org/test/plan/id/63577b4db3a64d6c405e5b70

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+debug
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221025/x86_64/x86_64_defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_x86_64-uefi.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221025/x86_64/x86_64_defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_x86_64-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221007.0/x86/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/63577b4db3a64d6c405e5b71
        failing since 1 day (last pass: next-20221021, first fail: next-20221024) 

platform                     | arch   | lab           | compiler | defconfig                    | regressions
-----------------------------+--------+---------------+----------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-broonie   | gcc-10   | x86_64_defconfig+debug       | 1          

  Details:     https://kernelci.org/test/plan/id/63577c9c7b3e946c0a5e5b74

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+debug
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221025/x86_64/x86_64_defconfig+debug/gcc-10/lab-broonie/baseline-qemu_x86_64-uefi.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221025/x86_64/x86_64_defconfig+debug/gcc-10/lab-broonie/baseline-qemu_x86_64-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221007.0/x86/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/63577c9c7b3e946c0a5e5b75
        failing since 1 day (last pass: next-20221021, first fail: next-20221024) 

platform                     | arch   | lab           | compiler | defconfig                    | regressions
-----------------------------+--------+---------------+----------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-baylibre  | gcc-10   | x86_64_defconfig+debug       | 1          

  Details:     https://kernelci.org/test/plan/id/63577b4bec2b30d9685e5b3b

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+debug
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221025/x86_64/x86_64_defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_x86_64-uefi-mixed.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221025/x86_64/x86_64_defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_x86_64-uefi-mixed.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221007.0/x86/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/63577b4bec2b30d9685e5b3c
        failing since 1 day (last pass: next-20221021, first fail: next-20221024) 

platform                     | arch   | lab           | compiler | defconfig                    | regressions
-----------------------------+--------+---------------+----------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-broonie   | gcc-10   | x86_64_defconfig+debug       | 1          

  Details:     https://kernelci.org/test/plan/id/63577c9b7b3e946c0a5e5b71

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+debug
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221025/x86_64/x86_64_defconfig+debug/gcc-10/lab-broonie/baseline-qemu_x86_64-uefi-mixed.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221025/x86_64/x86_64_defconfig+debug/gcc-10/lab-broonie/baseline-qemu_x86_64-uefi-mixed.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221007.0/x86/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/63577c9b7b3e946c0a5e5b72
        failing since 1 day (last pass: next-20221021, first fail: next-20221024) 

platform                     | arch   | lab           | compiler | defconfig                    | regressions
-----------------------------+--------+---------------+----------+------------------------------+------------
rk3399-gru-kevin             | arm64  | lab-collabora | clang-13 | cros://chrome...4-chromebook | 3          

  Details:     https://kernelci.org/test/plan/id/63578dbc47e472eddd5e5b3c

  Results:     71 PASS, 21 FAIL, 0 SKIP
  Full config: cros://chromeos-5.10/arm64/chromiumos-arm64.flavour.config+arm64-chromebook
  Compiler:    clang-13 (Debian clang version 13.0.1-6~deb11u1)
  Plain log:   https://storage.kernelci.org//next/master/next-20221025/arm64/cros---chromeos-5.10-arm64-chromiumos-arm64.flavour.config+arm64-chromebook/clang-13/lab-collabora/baseline-rk3399-gru-kevin.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221025/arm64/cros---chromeos-5.10-arm64-chromiumos-arm64.flavour.config+arm64-chromebook/clang-13/lab-collabora/baseline-rk3399-gru-kevin.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221007.0/arm64/rootfs.cpio.gz 

  * baseline.bootrr.cros-ec-sensors-gyro0-probed: https://kernelci.org/test/case/id/63578dbc47e472eddd5e5b85
        failing since 7 days (last pass: next-20221013, first fail: next-20221017)

    2022-10-25T07:17:58.718728  <8>[   24.022809] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=cros-ec-sensors-accel1-probed RESULT=fail>
    2022-10-25T07:17:59.733892  /lava-7709439/1/../bin/lava-test-case
    2022-10-25T07:17:59.745698  <8>[   25.050061] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=cros-ec-sensors-gyro0-probed RESULT=fail>   

  * baseline.bootrr.cros-ec-sensors-accel1-probed: https://kernelci.org/test/case/id/63578dbc47e472eddd5e5b86
        failing since 7 days (last pass: next-20221013, first fail: next-20221017)

    2022-10-25T07:17:58.705953  /lava-7709439/1/../bin/lava-test-case   

  * baseline.bootrr.cros-ec-sensors-accel0-probed: https://kernelci.org/test/case/id/63578dbc47e472eddd5e5b87
        failing since 7 days (last pass: next-20221013, first fail: next-20221017)

    2022-10-25T07:17:56.637567  <8>[   21.941749] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=cros-ec-sensors-driver-present RESULT=pass>
    2022-10-25T07:17:57.674477  /lava-7709439/1/../bin/lava-test-case
    2022-10-25T07:17:57.687840  <8>[   22.991984] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=cros-ec-sensors-accel0-probed RESULT=fail>