Subject: next/master baseline: 888 runs, 31 regressions (next-20221219)

From: "kernelci.org bot" <[email-masked]>
Date: Sun, 18 Dec 2022 21:56:06 -0800 (PST)

next/master baseline: 888 runs, 31 regressions (next-20221219)

Regressions Summary
-------------------

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
am57xx-beagle-x15            | arm   | lab-linaro-lkft | gcc-10   | multi_v7_defc...CONFIG_SMP=n | 1          
am57xx-beagle-x15            | arm   | lab-linaro-lkft | gcc-10   | multi_v7_defconfig+debug     | 1          
beagle-xm                    | arm   | lab-baylibre    | gcc-10   | multi_v7_defc...MB2_KERNEL=y | 1          
imx6dl-riotboard             | arm   | lab-pengutronix | gcc-10   | multi_v7_defconfig+debug     | 1          
imx6qp-wandboard-revd1       | arm   | lab-pengutronix | gcc-10   | multi_v7_defconfig+debug     | 1          
jetson-tk1                   | arm   | lab-baylibre    | clang-16 | multi_v7_defconfig           | 1          
jetson-tk1                   | arm   | lab-baylibre    | gcc-10   | multi_v7_defc...G_ARM_LPAE=y | 1          
kontron-pitx-imx8m           | arm64 | lab-kontron     | clang-16 | defconfig+CON..._64K_PAGES=y | 1          
kontron-pitx-imx8m           | arm64 | lab-kontron     | gcc-10   | defconfig+CON..._64K_PAGES=y | 1          
mt8183-kukui-...uniper-sku16 | arm64 | lab-collabora   | clang-13 | cros://chrome...4-chromebook | 1          
mt8183-kukui-...uniper-sku16 | arm64 | lab-collabora   | clang-13 | cros://chrome...4-chromebook | 1          
mt8192-asurada-spherion-r0   | arm64 | lab-collabora   | clang-13 | cros://chrome...4-chromebook | 1          
ox820-clouden...lug-series-3 | arm   | lab-baylibre    | gcc-10   | oxnas_v6_defconfig           | 1          
qemu_arm-virt-gicv2          | arm   | lab-baylibre    | gcc-10   | multi_v7_defconfig+debug     | 1          
qemu_arm-virt-gicv2          | arm   | lab-broonie     | gcc-10   | multi_v7_defconfig+debug     | 1          
qemu_arm-virt-gicv2          | arm   | lab-collabora   | gcc-10   | multi_v7_defconfig+debug     | 1          
qemu_arm-virt-gicv2-uefi     | arm   | lab-baylibre    | gcc-10   | multi_v7_defconfig+debug     | 1          
qemu_arm-virt-gicv2-uefi     | arm   | lab-broonie     | gcc-10   | multi_v7_defconfig+debug     | 1          
qemu_arm-virt-gicv2-uefi     | arm   | lab-collabora   | gcc-10   | multi_v7_defconfig+debug     | 1          
qemu_arm-virt-gicv3          | arm   | lab-baylibre    | gcc-10   | multi_v7_defconfig+debug     | 1          
qemu_arm-virt-gicv3          | arm   | lab-broonie     | gcc-10   | multi_v7_defconfig+debug     | 1          
qemu_arm-virt-gicv3          | arm   | lab-collabora   | gcc-10   | multi_v7_defconfig+debug     | 1          
qemu_arm-virt-gicv3-uefi     | arm   | lab-baylibre    | gcc-10   | multi_v7_defconfig+debug     | 1          
qemu_arm-virt-gicv3-uefi     | arm   | lab-broonie     | gcc-10   | multi_v7_defconfig+debug     | 1          
qemu_arm-virt-gicv3-uefi     | arm   | lab-collabora   | gcc-10   | multi_v7_defconfig+debug     | 1          
qemu_mips-malta              | mips  | lab-collabora   | gcc-10   | malta_defconfig              | 1          
r8a7743-iwg20d-q7            | arm   | lab-cip         | gcc-10   | shmobile_defconfig           | 1          
rk3288-rock2-square          | arm   | lab-collabora   | gcc-10   | multi_v7_defc...G_ARM_LPAE=y | 1          
rk3288-veyron-jaq            | arm   | lab-collabora   | gcc-10   | multi_v7_defc...G_ARM_LPAE=y | 1          
rk3399-rock-pi-4b            | arm64 | lab-collabora   | clang-16 | defconfig+CON..._64K_PAGES=y | 1          
tegra124-nyan-big            | arm   | lab-collabora   | gcc-10   | multi_v7_defc...G_ARM_LPAE=y | 1          

  Details:  https://kernelci.org/test/job/next/branch/master/kernel/next-20221219/plan/baseline/

  Test:     baseline
  Tree:     next
  Branch:   master
  Describe: next-20221219
  URL:      https://git.kernel.org/pub/scm/linux/kernel/git/next/linux-next.git
  SHA:      d650871875b2ccc670f1044be7f3cc90f276745d 

Test Regressions
---------------- 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
am57xx-beagle-x15            | arm   | lab-linaro-lkft | gcc-10   | multi_v7_defc...CONFIG_SMP=n | 1          

  Details:     https://kernelci.org/test/plan/id/639fdadc4b406712492abcfe

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_SMP=n
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221219/arm/multi_v7_defconfig+CONFIG_SMP=n/gcc-10/lab-linaro-lkft/baseline-am57xx-beagle-x15.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221219/arm/multi_v7_defconfig+CONFIG_SMP=n/gcc-10/lab-linaro-lkft/baseline-am57xx-beagle-x15.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221209.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/639fdadc4b406712492abcff
        failing since 92 days (last pass: next-20220915, first fail: next-20220916) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
am57xx-beagle-x15            | arm   | lab-linaro-lkft | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/639fdbf4fa325798b92abcfc

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221219/arm/multi_v7_defconfig+debug/gcc-10/lab-linaro-lkft/baseline-am57xx-beagle-x15.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221219/arm/multi_v7_defconfig+debug/gcc-10/lab-linaro-lkft/baseline-am57xx-beagle-x15.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221209.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/639fdbf4fa325798b92abcfd
        failing since 95 days (last pass: next-20220907, first fail: next-20220913) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
beagle-xm                    | arm   | lab-baylibre    | gcc-10   | multi_v7_defc...MB2_KERNEL=y | 1          

  Details:     https://kernelci.org/test/plan/id/639fcdbf912d4917df2abd1d

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221219/arm/multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y/gcc-10/lab-baylibre/baseline-beagle-xm.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221219/arm/multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y/gcc-10/lab-baylibre/baseline-beagle-xm.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221209.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/639fcdbf912d4917df2abd1e
        failing since 10 days (last pass: next-20221017, first fail: next-20221208) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
imx6dl-riotboard             | arm   | lab-pengutronix | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/639fcfed1e0105077e2abd38

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221219/arm/multi_v7_defconfig+debug/gcc-10/lab-pengutronix/baseline-imx6dl-riotboard.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221219/arm/multi_v7_defconfig+debug/gcc-10/lab-pengutronix/baseline-imx6dl-riotboard.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221209.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/639fcfed1e0105077e2abd39
        failing since 130 days (last pass: next-20220808, first fail: next-20220810) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
imx6qp-wandboard-revd1       | arm   | lab-pengutronix | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/639fcf3927484164922abd0f

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221219/arm/multi_v7_defconfig+debug/gcc-10/lab-pengutronix/baseline-imx6qp-wandboard-revd1.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221219/arm/multi_v7_defconfig+debug/gcc-10/lab-pengutronix/baseline-imx6qp-wandboard-revd1.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221209.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/639fcf3927484164922abd10
        failing since 118 days (last pass: next-20220810, first fail: next-20220822) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
jetson-tk1                   | arm   | lab-baylibre    | clang-16 | multi_v7_defconfig           | 1          

  Details:     https://kernelci.org/test/plan/id/639fd3795ef71a4a922abd0c

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig
  Compiler:    clang-16 (Debian clang version 16.0.0 (++20221215071834+2e8c7f652776-1~exp1~20221215071936.493))
  Plain log:   https://storage.kernelci.org//next/master/next-20221219/arm/multi_v7_defconfig/clang-16/lab-baylibre/baseline-jetson-tk1.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221219/arm/multi_v7_defconfig/clang-16/lab-baylibre/baseline-jetson-tk1.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221209.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/639fd3795ef71a4a922abd0d
        failing since 117 days (last pass: next-20220822, first fail: next-20220823) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
jetson-tk1                   | arm   | lab-baylibre    | gcc-10   | multi_v7_defc...G_ARM_LPAE=y | 1          

  Details:     https://kernelci.org/test/plan/id/639fcbbd2ea1d0c3802abd15

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221219/arm/multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y/gcc-10/lab-baylibre/baseline-jetson-tk1.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221219/arm/multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y/gcc-10/lab-baylibre/baseline-jetson-tk1.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221209.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/639fcbbd2ea1d0c3802abd16
        failing since 251 days (last pass: next-20220401, first fail: next-20220411) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
kontron-pitx-imx8m           | arm64 | lab-kontron     | clang-16 | defconfig+CON..._64K_PAGES=y | 1          

  Details:     https://kernelci.org/test/plan/id/639fd35112578994ae2abd38

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+CONFIG_ARM64_64K_PAGES=y
  Compiler:    clang-16 (Debian clang version 16.0.0 (++20221215071834+2e8c7f652776-1~exp1~20221215071936.493))
  Plain log:   https://storage.kernelci.org//next/master/next-20221219/arm64/defconfig+CONFIG_ARM64_64K_PAGES=y/clang-16/lab-kontron/baseline-kontron-pitx-imx8m.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221219/arm64/defconfig+CONFIG_ARM64_64K_PAGES=y/clang-16/lab-kontron/baseline-kontron-pitx-imx8m.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221209.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/639fd35112578994ae2abd39
        failing since 47 days (last pass: next-20221028, first fail: next-20221101) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
kontron-pitx-imx8m           | arm64 | lab-kontron     | gcc-10   | defconfig+CON..._64K_PAGES=y | 1          

  Details:     https://kernelci.org/test/plan/id/639fcb81be7bee03572abd1b

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+CONFIG_ARM64_64K_PAGES=y
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221219/arm64/defconfig+CONFIG_ARM64_64K_PAGES=y/gcc-10/lab-kontron/baseline-kontron-pitx-imx8m.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221219/arm64/defconfig+CONFIG_ARM64_64K_PAGES=y/gcc-10/lab-kontron/baseline-kontron-pitx-imx8m.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221209.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/639fcb81be7bee03572abd1c
        failing since 39 days (last pass: next-20221107, first fail: next-20221109) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
mt8183-kukui-...uniper-sku16 | arm64 | lab-collabora   | clang-13 | cros://chrome...4-chromebook | 1          

  Details:     https://kernelci.org/test/plan/id/639fc892d0172e3d552abcfe

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: cros://chromeos-5.10/arm64/chromiumos-arm64.flavour.config+arm64-chromebook
  Compiler:    clang-13 (Debian clang version 13.0.1-6~deb11u1)
  Plain log:   https://storage.kernelci.org//next/master/next-20221219/arm64/cros---chromeos-5.10-arm64-chromiumos-arm64.flavour.config+arm64-chromebook/clang-13/lab-collabora/baseline-mt8183-kukui-jacuzzi-juniper-sku16.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221219/arm64/cros---chromeos-5.10-arm64-chromiumos-arm64.flavour.config+arm64-chromebook/clang-13/lab-collabora/baseline-mt8183-kukui-jacuzzi-juniper-sku16.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221209.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/639fc892d0172e3d552abcff
        failing since 32 days (last pass: next-20221114, first fail: next-20221116) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
mt8183-kukui-...uniper-sku16 | arm64 | lab-collabora   | clang-13 | cros://chrome...4-chromebook | 1          

  Details:     https://kernelci.org/test/plan/id/639fc893ab863a11612abd00

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: cros://chromeos-5.10/arm64/chromiumos-mediatek.flavour.config+arm64-chromebook
  Compiler:    clang-13 (Debian clang version 13.0.1-6~deb11u1)
  Plain log:   https://storage.kernelci.org//next/master/next-20221219/arm64/cros---chromeos-5.10-arm64-chromiumos-mediatek.flavour.config+arm64-chromebook/clang-13/lab-collabora/baseline-mt8183-kukui-jacuzzi-juniper-sku16.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221219/arm64/cros---chromeos-5.10-arm64-chromiumos-mediatek.flavour.config+arm64-chromebook/clang-13/lab-collabora/baseline-mt8183-kukui-jacuzzi-juniper-sku16.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221209.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/639fc893ab863a11612abd01
        failing since 32 days (last pass: next-20221114, first fail: next-20221116) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
mt8192-asurada-spherion-r0   | arm64 | lab-collabora   | clang-13 | cros://chrome...4-chromebook | 1          

  Details:     https://kernelci.org/test/plan/id/639fc7d1ed4e828c392abd33

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: cros://chromeos-5.10/arm64/chromiumos-mediatek.flavour.config+arm64-chromebook
  Compiler:    clang-13 (Debian clang version 13.0.1-6~deb11u1)
  Plain log:   https://storage.kernelci.org//next/master/next-20221219/arm64/cros---chromeos-5.10-arm64-chromiumos-mediatek.flavour.config+arm64-chromebook/clang-13/lab-collabora/baseline-mt8192-asurada-spherion-r0.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221219/arm64/cros---chromeos-5.10-arm64-chromiumos-mediatek.flavour.config+arm64-chromebook/clang-13/lab-collabora/baseline-mt8192-asurada-spherion-r0.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221209.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/639fc7d1ed4e828c392abd34
        failing since 5 days (last pass: next-20221208, first fail: next-20221213) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
ox820-clouden...lug-series-3 | arm   | lab-baylibre    | gcc-10   | oxnas_v6_defconfig           | 1          

  Details:     https://kernelci.org/test/plan/id/639fc98265de147dd52abd0e

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: oxnas_v6_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221219/arm/oxnas_v6_defconfig/gcc-10/lab-baylibre/baseline-ox820-cloudengines-pogoplug-series-3.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221219/arm/oxnas_v6_defconfig/gcc-10/lab-baylibre/baseline-ox820-cloudengines-pogoplug-series-3.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221209.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/639fc98265de147dd52abd0f
        failing since 117 days (last pass: next-20220822, first fail: next-20220823) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
qemu_arm-virt-gicv2          | arm   | lab-baylibre    | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/639fcf2babf46ca9902abcfb

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221219/arm/multi_v7_defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_arm-virt-gicv2.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221219/arm/multi_v7_defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_arm-virt-gicv2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221209.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/639fcf2babf46ca9902abcfc
        failing since 96 days (last pass: next-20220907, first fail: next-20220913) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
qemu_arm-virt-gicv2          | arm   | lab-broonie     | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/639fd1f7d420cb60302abe52

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221219/arm/multi_v7_defconfig+debug/gcc-10/lab-broonie/baseline-qemu_arm-virt-gicv2.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221219/arm/multi_v7_defconfig+debug/gcc-10/lab-broonie/baseline-qemu_arm-virt-gicv2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221209.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/639fd1f7d420cb60302abe53
        failing since 96 days (last pass: next-20220907, first fail: next-20220913) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
qemu_arm-virt-gicv2          | arm   | lab-collabora   | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/639fcf1293f27e53d52abd1f

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221219/arm/multi_v7_defconfig+debug/gcc-10/lab-collabora/baseline-qemu_arm-virt-gicv2.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221219/arm/multi_v7_defconfig+debug/gcc-10/lab-collabora/baseline-qemu_arm-virt-gicv2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221209.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/639fcf1293f27e53d52abd20
        failing since 96 days (last pass: next-20220907, first fail: next-20220913) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
qemu_arm-virt-gicv2-uefi     | arm   | lab-baylibre    | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/639fcf2cabf46ca9902abd00

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221219/arm/multi_v7_defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_arm-virt-gicv2-uefi.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221219/arm/multi_v7_defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_arm-virt-gicv2-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221209.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/639fcf2cabf46ca9902abd01
        failing since 94 days (last pass: next-20220907, first fail: next-20220915) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
qemu_arm-virt-gicv2-uefi     | arm   | lab-broonie     | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/639fd21f1a654b77312abcfb

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221219/arm/multi_v7_defconfig+debug/gcc-10/lab-broonie/baseline-qemu_arm-virt-gicv2-uefi.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221219/arm/multi_v7_defconfig+debug/gcc-10/lab-broonie/baseline-qemu_arm-virt-gicv2-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221209.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/639fd21f1a654b77312abcfc
        failing since 94 days (last pass: next-20220907, first fail: next-20220915) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
qemu_arm-virt-gicv2-uefi     | arm   | lab-collabora   | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/639fcf1b93f27e53d52abd2e

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221219/arm/multi_v7_defconfig+debug/gcc-10/lab-collabora/baseline-qemu_arm-virt-gicv2-uefi.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221219/arm/multi_v7_defconfig+debug/gcc-10/lab-collabora/baseline-qemu_arm-virt-gicv2-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221209.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/639fcf1b93f27e53d52abd2f
        failing since 94 days (last pass: next-20220907, first fail: next-20220915) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
qemu_arm-virt-gicv3          | arm   | lab-baylibre    | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/639fcf2893f27e53d52abd70

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221219/arm/multi_v7_defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_arm-virt-gicv3.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221219/arm/multi_v7_defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_arm-virt-gicv3.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221209.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/639fcf2893f27e53d52abd71
        failing since 94 days (last pass: next-20220907, first fail: next-20220915) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
qemu_arm-virt-gicv3          | arm   | lab-broonie     | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/639fd1cfed436621482abd04

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221219/arm/multi_v7_defconfig+debug/gcc-10/lab-broonie/baseline-qemu_arm-virt-gicv3.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221219/arm/multi_v7_defconfig+debug/gcc-10/lab-broonie/baseline-qemu_arm-virt-gicv3.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221209.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/639fd1cfed436621482abd05
        failing since 94 days (last pass: next-20220907, first fail: next-20220915) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
qemu_arm-virt-gicv3          | arm   | lab-collabora   | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/639fcf1993f27e53d52abd2b

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221219/arm/multi_v7_defconfig+debug/gcc-10/lab-collabora/baseline-qemu_arm-virt-gicv3.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221219/arm/multi_v7_defconfig+debug/gcc-10/lab-collabora/baseline-qemu_arm-virt-gicv3.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221209.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/639fcf1993f27e53d52abd2c
        failing since 94 days (last pass: next-20220907, first fail: next-20220915) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
qemu_arm-virt-gicv3-uefi     | arm   | lab-baylibre    | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/639fcf2a5b9ebdf1bc2abd17

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221219/arm/multi_v7_defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_arm-virt-gicv3-uefi.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221219/arm/multi_v7_defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_arm-virt-gicv3-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221209.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/639fcf2a5b9ebdf1bc2abd18
        failing since 96 days (last pass: next-20220907, first fail: next-20220913) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
qemu_arm-virt-gicv3-uefi     | arm   | lab-broonie     | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/639fd1e3d420cb60302abcfb

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221219/arm/multi_v7_defconfig+debug/gcc-10/lab-broonie/baseline-qemu_arm-virt-gicv3-uefi.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221219/arm/multi_v7_defconfig+debug/gcc-10/lab-broonie/baseline-qemu_arm-virt-gicv3-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221209.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/639fd1e3d420cb60302abcfc
        failing since 96 days (last pass: next-20220907, first fail: next-20220913) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
qemu_arm-virt-gicv3-uefi     | arm   | lab-collabora   | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/639fcf2ae04be101242abd1a

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221219/arm/multi_v7_defconfig+debug/gcc-10/lab-collabora/baseline-qemu_arm-virt-gicv3-uefi.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221219/arm/multi_v7_defconfig+debug/gcc-10/lab-collabora/baseline-qemu_arm-virt-gicv3-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221209.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/639fcf2ae04be101242abd1b
        failing since 96 days (last pass: next-20220907, first fail: next-20220913) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
qemu_mips-malta              | mips  | lab-collabora   | gcc-10   | malta_defconfig              | 1          

  Details:     https://kernelci.org/test/plan/id/639fcc1962350e27752abd10

  Results:     4 PASS, 1 FAIL, 2 SKIP
  Full config: malta_defconfig
  Compiler:    gcc-10 (mips-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221219/mips/malta_defconfig/gcc-10/lab-collabora/baseline-qemu_mips-malta.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221219/mips/malta_defconfig/gcc-10/lab-collabora/baseline-qemu_mips-malta.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221209.0/mipsel/rootfs.cpio.gz 

  * baseline.dmesg.alert: https://kernelci.org/test/case/id/639fcc1962350e27752abd18
        failing since 4 days (last pass: next-20221213, first fail: next-20221214)
        1 lines

    2022-12-19T02:27:20.185195  
    2022-12-19T02:27:20.245824  kern  :alert : CPU 0 Unable to handle kernel paging request at virtual address fc8a9fc4, epc == 802030b4, ra == 80205a04
    2022-12-19T02:27:20.246005  
    2022-12-19T02:27:20.287383  <8><LAVA_SIGNAL_TESTCASE TEST_CASE_ID=alert RESULT=fail UNITS=lines MEASUREMENT=1>
    2022-12-19T02:27:20.287554     

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
r8a7743-iwg20d-q7            | arm   | lab-cip         | gcc-10   | shmobile_defconfig           | 1          

  Details:     https://kernelci.org/test/plan/id/639fcae9502bc1a48a2abcfb

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: shmobile_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221219/arm/shmobile_defconfig/gcc-10/lab-cip/baseline-r8a7743-iwg20d-q7.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221219/arm/shmobile_defconfig/gcc-10/lab-cip/baseline-r8a7743-iwg20d-q7.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221209.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/639fcae9502bc1a48a2abcfc
        failing since 5 days (last pass: next-20221208, first fail: next-20221213) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
rk3288-rock2-square          | arm   | lab-collabora   | gcc-10   | multi_v7_defc...G_ARM_LPAE=y | 1          

  Details:     https://kernelci.org/test/plan/id/639fcd44dc23139d0c2abd07

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221219/arm/multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y/gcc-10/lab-collabora/baseline-rk3288-rock2-square.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221219/arm/multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y/gcc-10/lab-collabora/baseline-rk3288-rock2-square.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221209.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/639fcd44dc23139d0c2abd08
        failing since 26 days (last pass: next-20221121, first fail: next-20221122) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
rk3288-veyron-jaq            | arm   | lab-collabora   | gcc-10   | multi_v7_defc...G_ARM_LPAE=y | 1          

  Details:     https://kernelci.org/test/plan/id/639fcb282fa7ade3002abd1d

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221219/arm/multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y/gcc-10/lab-collabora/baseline-rk3288-veyron-jaq.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221219/arm/multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y/gcc-10/lab-collabora/baseline-rk3288-veyron-jaq.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221209.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/639fcb282fa7ade3002abd1e
        failing since 26 days (last pass: next-20221121, first fail: next-20221122) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
rk3399-rock-pi-4b            | arm64 | lab-collabora   | clang-16 | defconfig+CON..._64K_PAGES=y | 1          

  Details:     https://kernelci.org/test/plan/id/639fd2e178ca478f4d2abd36

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+CONFIG_ARM64_64K_PAGES=y
  Compiler:    clang-16 (Debian clang version 16.0.0 (++20221215071834+2e8c7f652776-1~exp1~20221215071936.493))
  Plain log:   https://storage.kernelci.org//next/master/next-20221219/arm64/defconfig+CONFIG_ARM64_64K_PAGES=y/clang-16/lab-collabora/baseline-rk3399-rock-pi-4b.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221219/arm64/defconfig+CONFIG_ARM64_64K_PAGES=y/clang-16/lab-collabora/baseline-rk3399-rock-pi-4b.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221209.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/639fd2e178ca478f4d2abd37
        new failure (last pass: next-20221208) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
tegra124-nyan-big            | arm   | lab-collabora   | gcc-10   | multi_v7_defc...G_ARM_LPAE=y | 1          

  Details:     https://kernelci.org/test/plan/id/639fcad930eaa3b3fa2abcfa

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221219/arm/multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y/gcc-10/lab-collabora/baseline-tegra124-nyan-big.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221219/arm/multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y/gcc-10/lab-collabora/baseline-tegra124-nyan-big.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221209.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/639fcad930eaa3b3fa2abcfb
        failing since 25 days (last pass: next-20221121, first fail: next-20221123)