Subject: next/pending-fixes baseline: 639 runs, 30 regressions (v6.1-rc5-501-gd09591611a38)

From: "kernelci.org bot" <[email-masked]>
Date: Sun, 20 Nov 2022 19:55:16 -0800 (PST)

next/pending-fixes baseline: 639 runs, 30 regressions (v6.1-rc5-501-gd09591611a38)

Regressions Summary
-------------------

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
am57xx-beagle-x15            | arm   | lab-linaro-lkft | gcc-10   | multi_v7_defc...CONFIG_SMP=n | 1          
am57xx-beagle-x15            | arm   | lab-linaro-lkft | gcc-10   | multi_v7_defconfig+debug     | 1          
at91sam9g20ek                | arm   | lab-broonie     | gcc-10   | at91_dt_defconfig            | 1          
da850-lcdk                   | arm   | lab-baylibre    | gcc-10   | davinci_all_defconfig        | 1          
imx6dl-riotboard             | arm   | lab-pengutronix | gcc-10   | multi_v7_defconfig+debug     | 1          
imx6qp-wandboard-revd1       | arm   | lab-pengutronix | gcc-10   | multi_v7_defconfig+debug     | 1          
imx6ul-pico-hobbit           | arm   | lab-pengutronix | gcc-10   | imx_v6_v7_defconfig          | 1          
imx6ul-pico-hobbit           | arm   | lab-pengutronix | gcc-10   | multi_v7_defc...CONFIG_SMP=n | 1          
imx6ul-pico-hobbit           | arm   | lab-pengutronix | gcc-10   | multi_v7_defc...MB2_KERNEL=y | 1          
imx6ul-pico-hobbit           | arm   | lab-pengutronix | gcc-10   | multi_v7_defconfig+crypto    | 1          
imx6ul-pico-hobbit           | arm   | lab-pengutronix | gcc-10   | multi_v7_defconfig           | 1          
imx7ulp-evk                  | arm   | lab-nxp         | gcc-10   | imx_v6_v7_defconfig          | 1          
mt8183-kukui-...uniper-sku16 | arm64 | lab-collabora   | gcc-10   | defconfig+arm64-chromebook   | 1          
ox820-clouden...lug-series-3 | arm   | lab-baylibre    | gcc-10   | oxnas_v6_defconfig           | 1          
qemu_arm-virt-gicv2          | arm   | lab-baylibre    | gcc-10   | multi_v7_defconfig+debug     | 1          
qemu_arm-virt-gicv2          | arm   | lab-broonie     | gcc-10   | multi_v7_defconfig+debug     | 1          
qemu_arm-virt-gicv2-uefi     | arm   | lab-baylibre    | gcc-10   | multi_v7_defconfig+debug     | 1          
qemu_arm-virt-gicv2-uefi     | arm   | lab-broonie     | gcc-10   | multi_v7_defconfig+debug     | 1          
qemu_arm-virt-gicv3          | arm   | lab-baylibre    | gcc-10   | multi_v7_defconfig+debug     | 1          
qemu_arm-virt-gicv3          | arm   | lab-broonie     | gcc-10   | multi_v7_defconfig+debug     | 1          
qemu_arm-virt-gicv3          | arm   | lab-collabora   | gcc-10   | multi_v7_defconfig+debug     | 1          
qemu_arm-virt-gicv3-uefi     | arm   | lab-baylibre    | gcc-10   | multi_v7_defconfig+debug     | 1          
qemu_arm-virt-gicv3-uefi     | arm   | lab-broonie     | gcc-10   | multi_v7_defconfig+debug     | 1          
r8a7743-iwg20d-q7            | arm   | lab-cip         | gcc-10   | shmobile_defconfig           | 1          
rk3399-gru-kevin             | arm64 | lab-collabora   | gcc-10   | defconfig+arm64-chromebook   | 4          
sc7180-trogdo...zor-limozeen | arm64 | lab-collabora   | gcc-10   | defconfig+arm64-chromebook   | 1          
sc7180-trogdo...zor-limozeen | arm64 | lab-collabora   | gcc-10   | defconfig+arm...ook+videodec | 1          

  Details:  https://kernelci.org/test/job/next/branch/pending-fixes/kernel/v6.1-rc5-501-gd09591611a38/plan/baseline/

  Test:     baseline
  Tree:     next
  Branch:   pending-fixes
  Describe: v6.1-rc5-501-gd09591611a38
  URL:      https://git.kernel.org/pub/scm/linux/kernel/git/next/linux-next.git
  SHA:      d09591611a381848473fdd0d9b8c449c3f690d64 

Test Regressions
---------------- 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
am57xx-beagle-x15            | arm   | lab-linaro-lkft | gcc-10   | multi_v7_defc...CONFIG_SMP=n | 1          

  Details:     https://kernelci.org/test/plan/id/637ac0afe0350f3dcb2abcfc

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_SMP=n
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.1-rc5-501-gd09591611a38/arm/multi_v7_defconfig+CONFIG_SMP=n/gcc-10/lab-linaro-lkft/baseline-am57xx-beagle-x15.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.1-rc5-501-gd09591611a38/arm/multi_v7_defconfig+CONFIG_SMP=n/gcc-10/lab-linaro-lkft/baseline-am57xx-beagle-x15.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221107.1/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/637ac0afe0350f3dcb2abcfd
        failing since 42 days (last pass: v6.0-6424-g1af0c6a154d32, first fail: v6.0-9666-g02c05e0b8d5c) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
am57xx-beagle-x15            | arm   | lab-linaro-lkft | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/637ad012213bc7885d2abd18

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.1-rc5-501-gd09591611a38/arm/multi_v7_defconfig+debug/gcc-10/lab-linaro-lkft/baseline-am57xx-beagle-x15.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.1-rc5-501-gd09591611a38/arm/multi_v7_defconfig+debug/gcc-10/lab-linaro-lkft/baseline-am57xx-beagle-x15.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221107.1/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/637ad012213bc7885d2abd19
        failing since 39 days (last pass: v6.0-9666-g02c05e0b8d5c, first fail: v6.0-11312-g1778d6da389c) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
at91sam9g20ek                | arm   | lab-broonie     | gcc-10   | at91_dt_defconfig            | 1          

  Details:     https://kernelci.org/test/plan/id/637abdd06db776d3242abd19

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: at91_dt_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.1-rc5-501-gd09591611a38/arm/at91_dt_defconfig/gcc-10/lab-broonie/baseline-at91sam9g20ek.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.1-rc5-501-gd09591611a38/arm/at91_dt_defconfig/gcc-10/lab-broonie/baseline-at91sam9g20ek.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221107.1/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/637abdd06db776d3242abd1a
        new failure (last pass: v6.1-rc5-379-g251424ad2a76) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
da850-lcdk                   | arm   | lab-baylibre    | gcc-10   | davinci_all_defconfig        | 1          

  Details:     https://kernelci.org/test/plan/id/637abf44d46ecba2a22abd45

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: davinci_all_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.1-rc5-501-gd09591611a38/arm/davinci_all_defconfig/gcc-10/lab-baylibre/baseline-da850-lcdk.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.1-rc5-501-gd09591611a38/arm/davinci_all_defconfig/gcc-10/lab-baylibre/baseline-da850-lcdk.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221107.1/armel/rootfs.cpio.gz 

  * baseline.dmesg.alert: https://kernelci.org/test/case/id/637abf44d46ecba2a22abd4d
        failing since 301 days (last pass: v5.16-11577-gffd79fec234d, first fail: v5.17-rc1-180-g86539e2bdb99)
        3 lines

    2022-11-20T23:58:49.776738  kern  :alert : BUG: Bad page state in process kworker/u2:0  pfn:c3000
    2022-11-20T23:58:49.777553  kern  :alert : BUG: Bad page state in process kworker/u2:0  pfn:c3400
    2022-11-20T23:58:49.780090  kern  :alert : BUG: Bad page state in process kworker/u2:0  pfn:c3800
    2022-11-20T23:58:49.826241  <8><LAVA_SIGNAL_TESTCASE TEST_CASE_ID=alert RESULT=fail UNITS=lines MEASUREMENT=3>   

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
imx6dl-riotboard             | arm   | lab-pengutronix | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/637ac622fd44768ce52abd07

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.1-rc5-501-gd09591611a38/arm/multi_v7_defconfig+debug/gcc-10/lab-pengutronix/baseline-imx6dl-riotboard.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.1-rc5-501-gd09591611a38/arm/multi_v7_defconfig+debug/gcc-10/lab-pengutronix/baseline-imx6dl-riotboard.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221107.1/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/637ac622fd44768ce52abd08
        failing since 14 days (last pass: v6.0-rc5-224-g269f27f24a11, first fail: v6.1-rc3-573-g82d05e3975f5) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
imx6qp-wandboard-revd1       | arm   | lab-pengutronix | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/637ac54686315a7b442abd22

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.1-rc5-501-gd09591611a38/arm/multi_v7_defconfig+debug/gcc-10/lab-pengutronix/baseline-imx6qp-wandboard-revd1.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.1-rc5-501-gd09591611a38/arm/multi_v7_defconfig+debug/gcc-10/lab-pengutronix/baseline-imx6qp-wandboard-revd1.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221107.1/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/637ac54686315a7b442abd23
        failing since 66 days (last pass: v6.0-rc4-291-g83a56f559828, first fail: v6.0-rc5-197-ga6a750a2f4166) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
imx6ul-pico-hobbit           | arm   | lab-pengutronix | gcc-10   | imx_v6_v7_defconfig          | 1          

  Details:     https://kernelci.org/test/plan/id/637ac0bfe0350f3dcb2abd0e

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: imx_v6_v7_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.1-rc5-501-gd09591611a38/arm/imx_v6_v7_defconfig/gcc-10/lab-pengutronix/baseline-imx6ul-pico-hobbit.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.1-rc5-501-gd09591611a38/arm/imx_v6_v7_defconfig/gcc-10/lab-pengutronix/baseline-imx6ul-pico-hobbit.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221107.1/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/637ac0bfe0350f3dcb2abd0f
        failing since 124 days (last pass: v5.19-rc6-500-g27ca1dbc37a0, first fail: v5.19-rc7-183-ga3866a7dc77d) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
imx6ul-pico-hobbit           | arm   | lab-pengutronix | gcc-10   | multi_v7_defc...CONFIG_SMP=n | 1          

  Details:     https://kernelci.org/test/plan/id/637ac42eb507e76c3c2abd0a

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_SMP=n
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.1-rc5-501-gd09591611a38/arm/multi_v7_defconfig+CONFIG_SMP=n/gcc-10/lab-pengutronix/baseline-imx6ul-pico-hobbit.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.1-rc5-501-gd09591611a38/arm/multi_v7_defconfig+CONFIG_SMP=n/gcc-10/lab-pengutronix/baseline-imx6ul-pico-hobbit.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221107.1/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/637ac42eb507e76c3c2abd0b
        failing since 174 days (last pass: v5.16-rc4-356-ga119cd39dcbf, first fail: v5.18-11575-gceccc06b624ed) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
imx6ul-pico-hobbit           | arm   | lab-pengutronix | gcc-10   | multi_v7_defc...MB2_KERNEL=y | 1          

  Details:     https://kernelci.org/test/plan/id/637ac6eaeff63ce03e2abd2f

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.1-rc5-501-gd09591611a38/arm/multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y/gcc-10/lab-pengutronix/baseline-imx6ul-pico-hobbit.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.1-rc5-501-gd09591611a38/arm/multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y/gcc-10/lab-pengutronix/baseline-imx6ul-pico-hobbit.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221107.1/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/637ac6eaeff63ce03e2abd30
        failing since 174 days (last pass: v5.16-rc4-356-ga119cd39dcbf, first fail: v5.18-11575-gceccc06b624ed) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
imx6ul-pico-hobbit           | arm   | lab-pengutronix | gcc-10   | multi_v7_defconfig+crypto    | 1          

  Details:     https://kernelci.org/test/plan/id/637ac9068e6b99d0652abd71

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+crypto
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.1-rc5-501-gd09591611a38/arm/multi_v7_defconfig+crypto/gcc-10/lab-pengutronix/baseline-imx6ul-pico-hobbit.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.1-rc5-501-gd09591611a38/arm/multi_v7_defconfig+crypto/gcc-10/lab-pengutronix/baseline-imx6ul-pico-hobbit.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221107.1/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/637ac9068e6b99d0652abd72
        failing since 173 days (last pass: v5.16-rc4-356-ga119cd39dcbf, first fail: v5.18-11575-gceccc06b624ed) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
imx6ul-pico-hobbit           | arm   | lab-pengutronix | gcc-10   | multi_v7_defconfig           | 1          

  Details:     https://kernelci.org/test/plan/id/637acb225830628a2d2abd01

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.1-rc5-501-gd09591611a38/arm/multi_v7_defconfig/gcc-10/lab-pengutronix/baseline-imx6ul-pico-hobbit.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.1-rc5-501-gd09591611a38/arm/multi_v7_defconfig/gcc-10/lab-pengutronix/baseline-imx6ul-pico-hobbit.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221107.1/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/637acb225830628a2d2abd02
        failing since 148 days (last pass: v5.19-rc3-373-gd317111b3b1ae, first fail: v5.19-rc3-470-g4fc9c7cb4051) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
imx7ulp-evk                  | arm   | lab-nxp         | gcc-10   | imx_v6_v7_defconfig          | 1          

  Details:     https://kernelci.org/test/plan/id/637ac1a1947483a1742abd09

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: imx_v6_v7_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.1-rc5-501-gd09591611a38/arm/imx_v6_v7_defconfig/gcc-10/lab-nxp/baseline-imx7ulp-evk.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.1-rc5-501-gd09591611a38/arm/imx_v6_v7_defconfig/gcc-10/lab-nxp/baseline-imx7ulp-evk.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221107.1/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/637ac1a1947483a1742abd0a
        failing since 109 days (last pass: v5.19-1483-gffa33bbcf63ea, first fail: v5.19-3879-ge7dffa5317766) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
mt8183-kukui-...uniper-sku16 | arm64 | lab-collabora   | gcc-10   | defconfig+arm64-chromebook   | 1          

  Details:     https://kernelci.org/test/plan/id/637ac25b1e3d36caa82abd13

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.1-rc5-501-gd09591611a38/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-mt8183-kukui-jacuzzi-juniper-sku16.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.1-rc5-501-gd09591611a38/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-mt8183-kukui-jacuzzi-juniper-sku16.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221107.1/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/637ac25b1e3d36caa82abd14
        failing since 107 days (last pass: v5.19-8283-ga8bc7f656e322, first fail: v5.19-11387-gd91170a44a94) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
ox820-clouden...lug-series-3 | arm   | lab-baylibre    | gcc-10   | oxnas_v6_defconfig           | 1          

  Details:     https://kernelci.org/test/plan/id/637abfcf761bbff5ee2abd22

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: oxnas_v6_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.1-rc5-501-gd09591611a38/arm/oxnas_v6_defconfig/gcc-10/lab-baylibre/baseline-ox820-cloudengines-pogoplug-series-3.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.1-rc5-501-gd09591611a38/arm/oxnas_v6_defconfig/gcc-10/lab-baylibre/baseline-ox820-cloudengines-pogoplug-series-3.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221107.1/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/637abfcf761bbff5ee2abd23
        failing since 39 days (last pass: v6.0-9666-g02c05e0b8d5c, first fail: v6.0-11312-g1778d6da389c) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
qemu_arm-virt-gicv2          | arm   | lab-baylibre    | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/637ac558673ef75bac2abd01

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.1-rc5-501-gd09591611a38/arm/multi_v7_defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_arm-virt-gicv2.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.1-rc5-501-gd09591611a38/arm/multi_v7_defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_arm-virt-gicv2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221107.1/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/637ac558673ef75bac2abd02
        failing since 39 days (last pass: v6.0-9666-g02c05e0b8d5c, first fail: v6.0-11312-g1778d6da389c) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
qemu_arm-virt-gicv2          | arm   | lab-broonie     | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/637ac57cf0b30ad06d2abd08

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.1-rc5-501-gd09591611a38/arm/multi_v7_defconfig+debug/gcc-10/lab-broonie/baseline-qemu_arm-virt-gicv2.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.1-rc5-501-gd09591611a38/arm/multi_v7_defconfig+debug/gcc-10/lab-broonie/baseline-qemu_arm-virt-gicv2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221107.1/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/637ac57cf0b30ad06d2abd09
        failing since 39 days (last pass: v6.0-9666-g02c05e0b8d5c, first fail: v6.0-11312-g1778d6da389c) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
qemu_arm-virt-gicv2-uefi     | arm   | lab-baylibre    | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/637ac557c977c7a42d2abcfa

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.1-rc5-501-gd09591611a38/arm/multi_v7_defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_arm-virt-gicv2-uefi.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.1-rc5-501-gd09591611a38/arm/multi_v7_defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_arm-virt-gicv2-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221107.1/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/637ac557c977c7a42d2abcfb
        failing since 39 days (last pass: v6.0-9666-g02c05e0b8d5c, first fail: v6.0-11312-g1778d6da389c) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
qemu_arm-virt-gicv2-uefi     | arm   | lab-broonie     | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/637ac556ea4bde6fec2abd23

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.1-rc5-501-gd09591611a38/arm/multi_v7_defconfig+debug/gcc-10/lab-broonie/baseline-qemu_arm-virt-gicv2-uefi.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.1-rc5-501-gd09591611a38/arm/multi_v7_defconfig+debug/gcc-10/lab-broonie/baseline-qemu_arm-virt-gicv2-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221107.1/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/637ac556ea4bde6fec2abd24
        failing since 39 days (last pass: v6.0-9666-g02c05e0b8d5c, first fail: v6.0-11312-g1778d6da389c) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
qemu_arm-virt-gicv3          | arm   | lab-baylibre    | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/637ac559913a8943842abcfb

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.1-rc5-501-gd09591611a38/arm/multi_v7_defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_arm-virt-gicv3.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.1-rc5-501-gd09591611a38/arm/multi_v7_defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_arm-virt-gicv3.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221107.1/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/637ac559913a8943842abcfc
        failing since 39 days (last pass: v6.0-5324-g7871897dadfa9, first fail: v6.0-11312-g1778d6da389c) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
qemu_arm-virt-gicv3          | arm   | lab-broonie     | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/637ac590c977c7a42d2abd23

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.1-rc5-501-gd09591611a38/arm/multi_v7_defconfig+debug/gcc-10/lab-broonie/baseline-qemu_arm-virt-gicv3.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.1-rc5-501-gd09591611a38/arm/multi_v7_defconfig+debug/gcc-10/lab-broonie/baseline-qemu_arm-virt-gicv3.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221107.1/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/637ac590c977c7a42d2abd24
        failing since 39 days (last pass: v6.0-5324-g7871897dadfa9, first fail: v6.0-11312-g1778d6da389c) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
qemu_arm-virt-gicv3          | arm   | lab-collabora   | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/637ac543ea4bde6fec2abd0a

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.1-rc5-501-gd09591611a38/arm/multi_v7_defconfig+debug/gcc-10/lab-collabora/baseline-qemu_arm-virt-gicv3.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.1-rc5-501-gd09591611a38/arm/multi_v7_defconfig+debug/gcc-10/lab-collabora/baseline-qemu_arm-virt-gicv3.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221107.1/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/637ac543ea4bde6fec2abd0b
        failing since 39 days (last pass: v6.0-5324-g7871897dadfa9, first fail: v6.0-11312-g1778d6da389c) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
qemu_arm-virt-gicv3-uefi     | arm   | lab-baylibre    | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/637ac55686315a7b442abd3a

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.1-rc5-501-gd09591611a38/arm/multi_v7_defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_arm-virt-gicv3-uefi.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.1-rc5-501-gd09591611a38/arm/multi_v7_defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_arm-virt-gicv3-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221107.1/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/637ac55686315a7b442abd3b
        failing since 39 days (last pass: v6.0-9666-g02c05e0b8d5c, first fail: v6.0-11312-g1778d6da389c) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
qemu_arm-virt-gicv3-uefi     | arm   | lab-broonie     | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/637ac554ea4bde6fec2abd1d

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.1-rc5-501-gd09591611a38/arm/multi_v7_defconfig+debug/gcc-10/lab-broonie/baseline-qemu_arm-virt-gicv3-uefi.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.1-rc5-501-gd09591611a38/arm/multi_v7_defconfig+debug/gcc-10/lab-broonie/baseline-qemu_arm-virt-gicv3-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221107.1/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/637ac554ea4bde6fec2abd1e
        failing since 39 days (last pass: v6.0-9666-g02c05e0b8d5c, first fail: v6.0-11312-g1778d6da389c) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
r8a7743-iwg20d-q7            | arm   | lab-cip         | gcc-10   | shmobile_defconfig           | 1          

  Details:     https://kernelci.org/test/plan/id/637abeaa5c4f36c6a72abd15

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: shmobile_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.1-rc5-501-gd09591611a38/arm/shmobile_defconfig/gcc-10/lab-cip/baseline-r8a7743-iwg20d-q7.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.1-rc5-501-gd09591611a38/arm/shmobile_defconfig/gcc-10/lab-cip/baseline-r8a7743-iwg20d-q7.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221107.1/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/637abeaa5c4f36c6a72abd16
        failing since 4 days (last pass: v6.1-rc5-291-gb36f34e79a29, first fail: v6.1-rc5-352-gd66d752269c3) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
rk3399-gru-kevin             | arm64 | lab-collabora   | gcc-10   | defconfig+arm64-chromebook   | 4          

  Details:     https://kernelci.org/test/plan/id/637ac1a80e35a949052abcfc

  Results:     85 PASS, 7 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.1-rc5-501-gd09591611a38/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-rk3399-gru-kevin.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.1-rc5-501-gd09591611a38/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-rk3399-gru-kevin.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221107.1/arm64/rootfs.cpio.gz 

  * baseline.bootrr.rockchip-i2s1-probed: https://kernelci.org/test/case/id/637ac1a80e35a949052abd1c
        failing since 265 days (last pass: v5.17-rc5-244-gd77a1b37f796, first fail: v5.17-rc6-176-gb4e03e0dde48)

    2022-11-21T00:08:48.413700  /lava-8056473/1/../bin/lava-test-case
    2022-11-21T00:08:48.432355  <8>[   48.633531] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=rockchip-i2s1-probed RESULT=fail>   

  * baseline.bootrr.cros-ec-sensors-gyro0-probed: https://kernelci.org/test/case/id/637ac1a80e35a949052abd3e
        failing since 173 days (last pass: v5.18-5613-ge079cf8f6817, first fail: v5.18-11575-gceccc06b624ed)

    2022-11-21T00:08:44.604999  <8>[   44.805401] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=cros-ec-sensors-accel1-probed RESULT=fail>
    2022-11-21T00:08:45.633621  /lava-8056473/1/../bin/lava-test-case
    2022-11-21T00:08:45.652712  <8>[   45.853513] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=cros-ec-sensors-gyro0-probed RESULT=fail>   

  * baseline.bootrr.cros-ec-sensors-accel1-probed: https://kernelci.org/test/case/id/637ac1a80e35a949052abd3f
        failing since 173 days (last pass: v5.18-5613-ge079cf8f6817, first fail: v5.18-11575-gceccc06b624ed)

    2022-11-21T00:08:44.588341  /lava-8056473/1/../bin/lava-test-case   

  * baseline.bootrr.cros-ec-sensors-accel0-probed: https://kernelci.org/test/case/id/637ac1a80e35a949052abd40
        failing since 173 days (last pass: v5.18-5613-ge079cf8f6817, first fail: v5.18-11575-gceccc06b624ed)

    2022-11-21T00:08:42.492891  <8>[   42.693290] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=cros-ec-sensors-driver-present RESULT=pass>
    2022-11-21T00:08:42.493257  
    2022-11-21T00:08:43.551921  /lava-8056473/1/../bin/lava-test-case
    2022-11-21T00:08:43.552258  
    2022-11-21T00:08:43.561921  <8>[   43.762838] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=cros-ec-sensors-accel0-probed RESULT=fail>   

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
sc7180-trogdo...zor-limozeen | arm64 | lab-collabora   | gcc-10   | defconfig+arm64-chromebook   | 1          

  Details:     https://kernelci.org/test/plan/id/637ac157f3d64374082abd18

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.1-rc5-501-gd09591611a38/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-sc7180-trogdor-lazor-limozeen.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.1-rc5-501-gd09591611a38/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-sc7180-trogdor-lazor-limozeen.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221107.1/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/637ac157f3d64374082abd19
        failing since 5 days (last pass: v6.1-rc5-247-g22dce2b89d604, first fail: v6.1-rc5-291-gb36f34e79a29) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
sc7180-trogdo...zor-limozeen | arm64 | lab-collabora   | gcc-10   | defconfig+arm...ook+videodec | 1          

  Details:     https://kernelci.org/test/plan/id/637ac1a83783c8b5cb2abd1f

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook+videodec
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.1-rc5-501-gd09591611a38/arm64/defconfig+arm64-chromebook+videodec/gcc-10/lab-collabora/baseline-sc7180-trogdor-lazor-limozeen.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.1-rc5-501-gd09591611a38/arm64/defconfig+arm64-chromebook+videodec/gcc-10/lab-collabora/baseline-sc7180-trogdor-lazor-limozeen.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221107.1/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/637ac1a83783c8b5cb2abd20
        new failure (last pass: v6.1-rc5-379-g251424ad2a76)