Subject: next/pending-fixes baseline: 656 runs, 27 regressions (v6.0-rc5-168-ga477b3dec64f2)

From: "kernelci.org bot" <[email-masked]>
Date: Mon, 12 Sep 2022 22:57:03 -0700 (PDT)

next/pending-fixes baseline: 656 runs, 27 regressions (v6.0-rc5-168-ga477b3dec64f2)

Regressions Summary
-------------------

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
at91sam9g20ek                | arm   | lab-broonie     | gcc-10   | multi_v5_defconfig           | 1          
da850-lcdk                   | arm   | lab-baylibre    | gcc-10   | davinci_all_defconfig        | 1          
hifive-unleashed-a00         | riscv | lab-baylibre    | gcc-10   | defconfig                    | 1          
imx6dl-udoo                  | arm   | lab-broonie     | gcc-10   | imx_v6_v7_defconfig          | 1          
imx6q-udoo                   | arm   | lab-broonie     | gcc-10   | imx_v6_v7_defconfig          | 1          
imx6sx-sdb                   | arm   | lab-nxp         | gcc-10   | imx_v6_v7_defconfig          | 1          
imx6ul-14x14-evk             | arm   | lab-nxp         | gcc-10   | imx_v6_v7_defconfig          | 1          
imx6ul-pico-hobbit           | arm   | lab-pengutronix | gcc-10   | imx_v6_v7_defconfig          | 1          
imx6ul-pico-hobbit           | arm   | lab-pengutronix | gcc-10   | multi_v7_defc...CONFIG_SMP=n | 1          
imx6ul-pico-hobbit           | arm   | lab-pengutronix | gcc-10   | multi_v7_defconfig           | 1          
imx6ul-pico-hobbit           | arm   | lab-pengutronix | gcc-10   | multi_v7_defc...MB2_KERNEL=y | 1          
imx6ul-pico-hobbit           | arm   | lab-pengutronix | gcc-10   | multi_v7_defconfig+ima       | 1          
imx7d-sdb                    | arm   | lab-nxp         | gcc-10   | imx_v6_v7_defconfig          | 1          
imx7ulp-evk                  | arm   | lab-nxp         | gcc-10   | imx_v6_v7_defconfig          | 1          
jetson-tk1                   | arm   | lab-baylibre    | gcc-10   | multi_v7_defc...G_ARM_LPAE=y | 1          
meson-g12b-a311d-khadas-vim3 | arm64 | lab-baylibre    | gcc-10   | defconfig+debug              | 1          
mt8183-kukui-...uniper-sku16 | arm64 | lab-collabora   | gcc-10   | defconfig+arm64-chromebook   | 1          
odroid-xu3                   | arm   | lab-collabora   | gcc-10   | multi_v7_defc...G_ARM_LPAE=y | 1          
qemu_arm64-virt-gicv2-uefi   | arm64 | lab-broonie     | gcc-10   | defconfig+debug              | 1          
qemu_arm64-virt-gicv2-uefi   | arm64 | lab-collabora   | gcc-10   | defconfig+debug              | 1          
qemu_arm64-virt-gicv3-uefi   | arm64 | lab-broonie     | gcc-10   | defconfig+debug              | 1          
qemu_arm64-virt-gicv3-uefi   | arm64 | lab-collabora   | gcc-10   | defconfig+debug              | 1          
rk3399-gru-kevin             | arm64 | lab-collabora   | gcc-10   | defconfig+arm64-chromebook   | 4          
rk3399-roc-pc                | arm64 | lab-clabbe      | gcc-10   | defconfig                    | 1          

  Details:  https://kernelci.org/test/job/next/branch/pending-fixes/kernel/v6.0-rc5-168-ga477b3dec64f2/plan/baseline/

  Test:     baseline
  Tree:     next
  Branch:   pending-fixes
  Describe: v6.0-rc5-168-ga477b3dec64f2
  URL:      https://git.kernel.org/pub/scm/linux/kernel/git/next/linux-next.git
  SHA:      a477b3dec64f21f466ed9208f8e87d148ef5bf9b 

Test Regressions
---------------- 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
at91sam9g20ek                | arm   | lab-broonie     | gcc-10   | multi_v5_defconfig           | 1          

  Details:     https://kernelci.org/test/plan/id/631fe0a03749d40b5e355645

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v5_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.0-rc5-168-ga477b3dec64f2/arm/multi_v5_defconfig/gcc-10/lab-broonie/baseline-at91sam9g20ek.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.0-rc5-168-ga477b3dec64f2/arm/multi_v5_defconfig/gcc-10/lab-broonie/baseline-at91sam9g20ek.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220805.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/631fe0a03749d40b5e355646
        new failure (last pass: v6.0-rc4-326-g49ccb7c6c3ca) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
da850-lcdk                   | arm   | lab-baylibre    | gcc-10   | davinci_all_defconfig        | 1          

  Details:     https://kernelci.org/test/plan/id/631fe37266438e8968355664

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: davinci_all_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.0-rc5-168-ga477b3dec64f2/arm/davinci_all_defconfig/gcc-10/lab-baylibre/baseline-da850-lcdk.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.0-rc5-168-ga477b3dec64f2/arm/davinci_all_defconfig/gcc-10/lab-baylibre/baseline-da850-lcdk.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220805.0/armel/rootfs.cpio.gz 

  * baseline.dmesg.alert: https://kernelci.org/test/case/id/631fe37266438e8968355668
        failing since 232 days (last pass: v5.16-11577-gffd79fec234d, first fail: v5.17-rc1-180-g86539e2bdb99)
        3 lines

    2022-09-13T01:56:36.447964  kern  :alert : BUG: Bad page state in process kworker/u2:0  pfn:c3000
    2022-09-13T01:56:36.448221  kern  :alert : BUG: Bad page state in process kworker/u2:0  pfn:c3400
    2022-09-13T01:56:36.451147  kern  :alert : BUG: Bad page state in process kworker/u2:0  pfn:c3800
    2022-09-13T01:56:36.492403  <8><LAVA_SIGNAL_TESTCASE TEST_CASE_ID=alert RESULT=fail UNITS=lines MEASUREMENT=3>   

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
hifive-unleashed-a00         | riscv | lab-baylibre    | gcc-10   | defconfig                    | 1          

  Details:     https://kernelci.org/test/plan/id/631fe57bbd83bfc7ad3556a9

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig
  Compiler:    gcc-10 (riscv64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.0-rc5-168-ga477b3dec64f2/riscv/defconfig/gcc-10/lab-baylibre/baseline-hifive-unleashed-a00.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.0-rc5-168-ga477b3dec64f2/riscv/defconfig/gcc-10/lab-baylibre/baseline-hifive-unleashed-a00.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220805.0/riscv/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/631fe57bbd83bfc7ad3556aa
        failing since 13 days (last pass: v6.0-rc3-304-gd62f6b276548, first fail: v6.0-rc3-353-g0c97ffa2a016) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
imx6dl-udoo                  | arm   | lab-broonie     | gcc-10   | imx_v6_v7_defconfig          | 1          

  Details:     https://kernelci.org/test/plan/id/631fe50db8b9159f6135569f

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: imx_v6_v7_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.0-rc5-168-ga477b3dec64f2/arm/imx_v6_v7_defconfig/gcc-10/lab-broonie/baseline-imx6dl-udoo.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.0-rc5-168-ga477b3dec64f2/arm/imx_v6_v7_defconfig/gcc-10/lab-broonie/baseline-imx6dl-udoo.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220805.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/631fe50db8b9159f613556a0
        failing since 5 days (last pass: v5.19-rc5-383-g73ad9bd963c1, first fail: v6.0-rc4-291-g83a56f559828) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
imx6q-udoo                   | arm   | lab-broonie     | gcc-10   | imx_v6_v7_defconfig          | 1          

  Details:     https://kernelci.org/test/plan/id/631fe409e42ecc65af355677

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: imx_v6_v7_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.0-rc5-168-ga477b3dec64f2/arm/imx_v6_v7_defconfig/gcc-10/lab-broonie/baseline-imx6q-udoo.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.0-rc5-168-ga477b3dec64f2/arm/imx_v6_v7_defconfig/gcc-10/lab-broonie/baseline-imx6q-udoo.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220805.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/631fe409e42ecc65af355678
        failing since 7 days (last pass: v6.0-rc3-415-gf29d411eb4af, first fail: v6.0-rc4-270-gdea3dab2e6fc) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
imx6sx-sdb                   | arm   | lab-nxp         | gcc-10   | imx_v6_v7_defconfig          | 1          

  Details:     https://kernelci.org/test/plan/id/631fe442823686ec3f355684

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: imx_v6_v7_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.0-rc5-168-ga477b3dec64f2/arm/imx_v6_v7_defconfig/gcc-10/lab-nxp/baseline-imx6sx-sdb.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.0-rc5-168-ga477b3dec64f2/arm/imx_v6_v7_defconfig/gcc-10/lab-nxp/baseline-imx6sx-sdb.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220805.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/631fe442823686ec3f355685
        failing since 7 days (last pass: v6.0-rc3-415-gf29d411eb4af, first fail: v6.0-rc4-270-gdea3dab2e6fc) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
imx6ul-14x14-evk             | arm   | lab-nxp         | gcc-10   | imx_v6_v7_defconfig          | 1          

  Details:     https://kernelci.org/test/plan/id/631fe41a5fdd011a10355650

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: imx_v6_v7_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.0-rc5-168-ga477b3dec64f2/arm/imx_v6_v7_defconfig/gcc-10/lab-nxp/baseline-imx6ul-14x14-evk.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.0-rc5-168-ga477b3dec64f2/arm/imx_v6_v7_defconfig/gcc-10/lab-nxp/baseline-imx6ul-14x14-evk.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220805.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/631fe41a5fdd011a10355651
        failing since 5 days (last pass: v6.0-rc3-304-gd62f6b276548, first fail: v6.0-rc4-291-g83a56f559828) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
imx6ul-pico-hobbit           | arm   | lab-pengutronix | gcc-10   | imx_v6_v7_defconfig          | 1          

  Details:     https://kernelci.org/test/plan/id/631fe517a6cd138834355666

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: imx_v6_v7_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.0-rc5-168-ga477b3dec64f2/arm/imx_v6_v7_defconfig/gcc-10/lab-pengutronix/baseline-imx6ul-pico-hobbit.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.0-rc5-168-ga477b3dec64f2/arm/imx_v6_v7_defconfig/gcc-10/lab-pengutronix/baseline-imx6ul-pico-hobbit.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220805.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/631fe517a6cd138834355667
        failing since 55 days (last pass: v5.19-rc6-500-g27ca1dbc37a0, first fail: v5.19-rc7-183-ga3866a7dc77d) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
imx6ul-pico-hobbit           | arm   | lab-pengutronix | gcc-10   | multi_v7_defc...CONFIG_SMP=n | 1          

  Details:     https://kernelci.org/test/plan/id/631fe71f3f2af974db3556b2

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_SMP=n
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.0-rc5-168-ga477b3dec64f2/arm/multi_v7_defconfig+CONFIG_SMP=n/gcc-10/lab-pengutronix/baseline-imx6ul-pico-hobbit.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.0-rc5-168-ga477b3dec64f2/arm/multi_v7_defconfig+CONFIG_SMP=n/gcc-10/lab-pengutronix/baseline-imx6ul-pico-hobbit.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220805.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/631fe71f3f2af974db3556b3
        failing since 105 days (last pass: v5.16-rc4-356-ga119cd39dcbf, first fail: v5.18-11575-gceccc06b624ed) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
imx6ul-pico-hobbit           | arm   | lab-pengutronix | gcc-10   | multi_v7_defconfig           | 1          

  Details:     https://kernelci.org/test/plan/id/631fe913b128849aed35565d

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.0-rc5-168-ga477b3dec64f2/arm/multi_v7_defconfig/gcc-10/lab-pengutronix/baseline-imx6ul-pico-hobbit.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.0-rc5-168-ga477b3dec64f2/arm/multi_v7_defconfig/gcc-10/lab-pengutronix/baseline-imx6ul-pico-hobbit.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220805.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/631fe913b128849aed35565e
        failing since 79 days (last pass: v5.19-rc3-373-gd317111b3b1ae, first fail: v5.19-rc3-470-g4fc9c7cb4051) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
imx6ul-pico-hobbit           | arm   | lab-pengutronix | gcc-10   | multi_v7_defc...MB2_KERNEL=y | 1          

  Details:     https://kernelci.org/test/plan/id/631fe9dbf455b4cc463556a4

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.0-rc5-168-ga477b3dec64f2/arm/multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y/gcc-10/lab-pengutronix/baseline-imx6ul-pico-hobbit.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.0-rc5-168-ga477b3dec64f2/arm/multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y/gcc-10/lab-pengutronix/baseline-imx6ul-pico-hobbit.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220805.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/631fe9dbf455b4cc463556a5
        failing since 105 days (last pass: v5.16-rc4-356-ga119cd39dcbf, first fail: v5.18-11575-gceccc06b624ed) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
imx6ul-pico-hobbit           | arm   | lab-pengutronix | gcc-10   | multi_v7_defconfig+ima       | 1          

  Details:     https://kernelci.org/test/plan/id/631febcf6464479ab5355642

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+ima
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.0-rc5-168-ga477b3dec64f2/arm/multi_v7_defconfig+ima/gcc-10/lab-pengutronix/baseline-imx6ul-pico-hobbit.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.0-rc5-168-ga477b3dec64f2/arm/multi_v7_defconfig+ima/gcc-10/lab-pengutronix/baseline-imx6ul-pico-hobbit.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220805.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/631febcf6464479ab5355643
        failing since 105 days (last pass: v5.16-rc4-356-ga119cd39dcbf, first fail: v5.18-11575-gceccc06b624ed) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
imx7d-sdb                    | arm   | lab-nxp         | gcc-10   | imx_v6_v7_defconfig          | 1          

  Details:     https://kernelci.org/test/plan/id/631fe36866438e8968355652

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: imx_v6_v7_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.0-rc5-168-ga477b3dec64f2/arm/imx_v6_v7_defconfig/gcc-10/lab-nxp/baseline-imx7d-sdb.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.0-rc5-168-ga477b3dec64f2/arm/imx_v6_v7_defconfig/gcc-10/lab-nxp/baseline-imx7d-sdb.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220805.0/armel/rootfs.cpio.gz 

  * baseline.dmesg.emerg: https://kernelci.org/test/case/id/631fe36866438e8968355657
        failing since 5 days (last pass: v6.0-rc4-291-g83a56f559828, first fail: v6.0-rc4-326-g49ccb7c6c3ca)
        2 lines

    2022-09-13T01:56:31.383571  kern  :emerg : BUG: spinlock wrong CPU on CPU#0, swapper/0/1
    2022-09-13T01:56:31.384302  kern  :emerg :  lock: 0xc45da8d8, .magic: dead4ead, .owner: swapper/0/1, .owner_cpu: 1
    2022-09-13T01:56:31.384584  <8>[   27.206810] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=emerg RESULT=fail UNITS=lines MEASUREMENT=2>
    2022-09-13T01:56:31.384839  + set +x   

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
imx7ulp-evk                  | arm   | lab-nxp         | gcc-10   | imx_v6_v7_defconfig          | 1          

  Details:     https://kernelci.org/test/plan/id/631fe44450ee2db97e35564c

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: imx_v6_v7_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.0-rc5-168-ga477b3dec64f2/arm/imx_v6_v7_defconfig/gcc-10/lab-nxp/baseline-imx7ulp-evk.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.0-rc5-168-ga477b3dec64f2/arm/imx_v6_v7_defconfig/gcc-10/lab-nxp/baseline-imx7ulp-evk.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220805.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/631fe44450ee2db97e35564d
        failing since 40 days (last pass: v5.19-1483-gffa33bbcf63ea, first fail: v5.19-3879-ge7dffa5317766) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
jetson-tk1                   | arm   | lab-baylibre    | gcc-10   | multi_v7_defc...G_ARM_LPAE=y | 1          

  Details:     https://kernelci.org/test/plan/id/631fe502b8b9159f61355650

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.0-rc5-168-ga477b3dec64f2/arm/multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y/gcc-10/lab-baylibre/baseline-jetson-tk1.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.0-rc5-168-ga477b3dec64f2/arm/multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y/gcc-10/lab-baylibre/baseline-jetson-tk1.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220805.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/631fe502b8b9159f61355651
        failing since 136 days (last pass: v5.18-rc2-366-ga3e1163f7eb1a, first fail: v5.18-rc4-464-g425675974eb3) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
meson-g12b-a311d-khadas-vim3 | arm64 | lab-baylibre    | gcc-10   | defconfig+debug              | 1          

  Details:     https://kernelci.org/test/plan/id/632013cacd1f9294a435564f

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+debug
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.0-rc5-168-ga477b3dec64f2/arm64/defconfig+debug/gcc-10/lab-baylibre/baseline-meson-g12b-a311d-khadas-vim3.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.0-rc5-168-ga477b3dec64f2/arm64/defconfig+debug/gcc-10/lab-baylibre/baseline-meson-g12b-a311d-khadas-vim3.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220805.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/632013cacd1f9294a4355650
        new failure (last pass: v6.0-rc4-291-g83a56f559828) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
mt8183-kukui-...uniper-sku16 | arm64 | lab-collabora   | gcc-10   | defconfig+arm64-chromebook   | 1          

  Details:     https://kernelci.org/test/plan/id/631fe4d8ae1736703b35565a

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.0-rc5-168-ga477b3dec64f2/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-mt8183-kukui-jacuzzi-juniper-sku16.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.0-rc5-168-ga477b3dec64f2/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-mt8183-kukui-jacuzzi-juniper-sku16.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220805.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/631fe4d8ae1736703b35565b
        failing since 38 days (last pass: v5.19-8283-ga8bc7f656e322, first fail: v5.19-11387-gd91170a44a94) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
odroid-xu3                   | arm   | lab-collabora   | gcc-10   | multi_v7_defc...G_ARM_LPAE=y | 1          

  Details:     https://kernelci.org/test/plan/id/631ff9886d8f773234355679

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.0-rc5-168-ga477b3dec64f2/arm/multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y/gcc-10/lab-collabora/baseline-odroid-xu3.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.0-rc5-168-ga477b3dec64f2/arm/multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y/gcc-10/lab-collabora/baseline-odroid-xu3.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220805.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/631ff9886d8f77323435567a
        new failure (last pass: v6.0-rc4-326-g49ccb7c6c3ca) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
qemu_arm64-virt-gicv2-uefi   | arm64 | lab-broonie     | gcc-10   | defconfig+debug              | 1          

  Details:     https://kernelci.org/test/plan/id/631fe7cdb308c884e335566a

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+debug
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.0-rc5-168-ga477b3dec64f2/arm64/defconfig+debug/gcc-10/lab-broonie/baseline-qemu_arm64-virt-gicv2-uefi.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.0-rc5-168-ga477b3dec64f2/arm64/defconfig+debug/gcc-10/lab-broonie/baseline-qemu_arm64-virt-gicv2-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220805.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/631fe7cdb308c884e335566b
        failing since 5 days (last pass: v6.0-rc4-270-gdea3dab2e6fc, first fail: v6.0-rc4-291-g83a56f559828) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
qemu_arm64-virt-gicv2-uefi   | arm64 | lab-collabora   | gcc-10   | defconfig+debug              | 1          

  Details:     https://kernelci.org/test/plan/id/631fe79d5d9e926cb6355649

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+debug
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.0-rc5-168-ga477b3dec64f2/arm64/defconfig+debug/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv2-uefi.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.0-rc5-168-ga477b3dec64f2/arm64/defconfig+debug/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv2-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220805.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/631fe79d5d9e926cb635564a
        failing since 5 days (last pass: v6.0-rc4-270-gdea3dab2e6fc, first fail: v6.0-rc4-291-g83a56f559828) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
qemu_arm64-virt-gicv3-uefi   | arm64 | lab-broonie     | gcc-10   | defconfig+debug              | 1          

  Details:     https://kernelci.org/test/plan/id/631fe7ceb308c884e335566d

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+debug
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.0-rc5-168-ga477b3dec64f2/arm64/defconfig+debug/gcc-10/lab-broonie/baseline-qemu_arm64-virt-gicv3-uefi.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.0-rc5-168-ga477b3dec64f2/arm64/defconfig+debug/gcc-10/lab-broonie/baseline-qemu_arm64-virt-gicv3-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220805.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/631fe7ceb308c884e335566e
        failing since 5 days (last pass: v6.0-rc4-270-gdea3dab2e6fc, first fail: v6.0-rc4-291-g83a56f559828) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
qemu_arm64-virt-gicv3-uefi   | arm64 | lab-collabora   | gcc-10   | defconfig+debug              | 1          

  Details:     https://kernelci.org/test/plan/id/631fe79f6886e8ad20355663

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+debug
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.0-rc5-168-ga477b3dec64f2/arm64/defconfig+debug/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv3-uefi.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.0-rc5-168-ga477b3dec64f2/arm64/defconfig+debug/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv3-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220805.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/631fe79f6886e8ad20355664
        failing since 5 days (last pass: v6.0-rc4-270-gdea3dab2e6fc, first fail: v6.0-rc4-291-g83a56f559828) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
rk3399-gru-kevin             | arm64 | lab-collabora   | gcc-10   | defconfig+arm64-chromebook   | 4          

  Details:     https://kernelci.org/test/plan/id/631fe58ce46bb32002355657

  Results:     85 PASS, 7 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.0-rc5-168-ga477b3dec64f2/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-rk3399-gru-kevin.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.0-rc5-168-ga477b3dec64f2/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-rk3399-gru-kevin.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220805.0/arm64/rootfs.cpio.gz 

  * baseline.bootrr.rockchip-i2s1-probed: https://kernelci.org/test/case/id/631fe58ce46bb3200235567d
        failing since 197 days (last pass: v5.17-rc5-244-gd77a1b37f796, first fail: v5.17-rc6-176-gb4e03e0dde48)

    2022-09-13T02:05:54.332805  <8>[   39.784065] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=rockchip-i2s0-probed RESULT=pass>
    2022-09-13T02:05:55.355563  /lava-7252792/1/../bin/lava-test-case
    2022-09-13T02:05:55.365280  <8>[   40.817687] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=rockchip-i2s1-probed RESULT=fail>   

  * baseline.bootrr.cros-ec-sensors-gyro0-probed: https://kernelci.org/test/case/id/631fe58ce46bb320023556a0
        failing since 105 days (last pass: v5.18-5613-ge079cf8f6817, first fail: v5.18-11575-gceccc06b624ed)

    2022-09-13T02:05:53.191621  /lava-7252792/1/../bin/lava-test-case
    2022-09-13T02:05:53.202280  <8>[   38.653457] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=cros-ec-sensors-gyro0-probed RESULT=fail>   

  * baseline.bootrr.cros-ec-sensors-accel1-probed: https://kernelci.org/test/case/id/631fe58ce46bb320023556a1
        failing since 105 days (last pass: v5.18-5613-ge079cf8f6817, first fail: v5.18-11575-gceccc06b624ed)

    2022-09-13T02:05:51.128461  <8>[   36.577802] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=cros-ec-sensors-accel0-probed RESULT=fail>
    2022-09-13T02:05:52.151035  /lava-7252792/1/../bin/lava-test-case
    2022-09-13T02:05:52.161415  <8>[   37.612387] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=cros-ec-sensors-accel1-probed RESULT=fail>   

  * baseline.bootrr.cros-ec-sensors-accel0-probed: https://kernelci.org/test/case/id/631fe58ce46bb320023556a2
        failing since 105 days (last pass: v5.18-5613-ge079cf8f6817, first fail: v5.18-11575-gceccc06b624ed)

    2022-09-13T02:05:51.116106  /lava-7252792/1/../bin/lava-test-case   

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
rk3399-roc-pc                | arm64 | lab-clabbe      | gcc-10   | defconfig                    | 1          

  Details:     https://kernelci.org/test/plan/id/631fe9b38f4eb6a4ac355673

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.0-rc5-168-ga477b3dec64f2/arm64/defconfig/gcc-10/lab-clabbe/baseline-rk3399-roc-pc.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.0-rc5-168-ga477b3dec64f2/arm64/defconfig/gcc-10/lab-clabbe/baseline-rk3399-roc-pc.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220805.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/631fe9b38f4eb6a4ac355674
        new failure (last pass: v6.0-rc4-326-g49ccb7c6c3ca)