Subject: next/pending-fixes baseline: 531 runs, 32 regressions (v6.0-rc2-232-gffc62c393637)

From: "kernelci.org bot" <[email-masked]>
Date: Tue, 23 Aug 2022 03:48:00 -0700 (PDT)

next/pending-fixes baseline: 531 runs, 32 regressions (v6.0-rc2-232-gffc62c393637)

Regressions Summary
-------------------

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
am57xx-beagle-x15            | arm   | lab-linaro-lkft | gcc-10   | multi_v7_defconfig           | 1          
am57xx-beagle-x15            | arm   | lab-linaro-lkft | gcc-10   | multi_v7_defconfig+crypto    | 1          
am57xx-beagle-x15            | arm   | lab-linaro-lkft | gcc-10   | multi_v7_defc...MB2_KERNEL=y | 1          
am57xx-beagle-x15            | arm   | lab-linaro-lkft | gcc-10   | multi_v7_defconfig+ima       | 1          
am57xx-beagle-x15            | arm   | lab-linaro-lkft | gcc-10   | omap2plus_defconfig          | 1          
da850-lcdk                   | arm   | lab-baylibre    | gcc-10   | davinci_all_defconfig        | 1          
imx6dl-riotboard             | arm   | lab-pengutronix | gcc-10   | multi_v7_defconfig+debug     | 1          
imx6qp-wandboard-revd1       | arm   | lab-pengutronix | gcc-10   | multi_v7_defconfig+debug     | 1          
imx7d-sdb                    | arm   | lab-nxp         | gcc-10   | imx_v6_v7_defconfig          | 1          
imx7ulp-evk                  | arm   | lab-nxp         | gcc-10   | imx_v6_v7_defconfig          | 1          
kontron-pitx-imx8m           | arm64 | lab-kontron     | gcc-10   | defconfig                    | 2          
kontron-pitx-imx8m           | arm64 | lab-kontron     | gcc-10   | defconfig+crypto             | 2          
kontron-pitx-imx8m           | arm64 | lab-kontron     | gcc-10   | defconfig+ima                | 2          
kontron-pitx-imx8m           | arm64 | lab-kontron     | gcc-10   | defconfig+CON...OMIZE_BASE=y | 2          
meson-gxbb-p200              | arm64 | lab-baylibre    | gcc-10   | defconfig+CON...BIG_ENDIAN=y | 2          
mt8183-kukui-...uniper-sku16 | arm64 | lab-collabora   | gcc-10   | defconfig+arm64-chromebook   | 1          
qemu_arm-vexpress-a15        | arm   | lab-baylibre    | gcc-10   | vexpress_defconfig           | 1          
qemu_arm-vexpress-a15        | arm   | lab-broonie     | gcc-10   | vexpress_defconfig           | 1          
qemu_arm-vexpress-a9         | arm   | lab-baylibre    | gcc-10   | vexpress_defconfig           | 1          
qemu_arm-vexpress-a9         | arm   | lab-broonie     | gcc-10   | vexpress_defconfig           | 1          
qemu_arm64-virt-gicv2        | arm64 | lab-broonie     | gcc-10   | defconfig+debug              | 1          
qemu_arm64-virt-gicv3-uefi   | arm64 | lab-broonie     | gcc-10   | defconfig+debug              | 1          
rk3399-gru-kevin             | arm64 | lab-collabora   | gcc-10   | defconfig+arm64-chromebook   | 4          
sc7180-trogdo...zor-limozeen | arm64 | lab-collabora   | gcc-10   | defconfig+arm64-chromebook   | 1          

  Details:  https://kernelci.org/test/job/next/branch/pending-fixes/kernel/v6.0-rc2-232-gffc62c393637/plan/baseline/

  Test:     baseline
  Tree:     next
  Branch:   pending-fixes
  Describe: v6.0-rc2-232-gffc62c393637
  URL:      https://git.kernel.org/pub/scm/linux/kernel/git/next/linux-next.git
  SHA:      ffc62c393637b22662b3022f7534815098c84fdf 

Test Regressions
---------------- 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
am57xx-beagle-x15            | arm   | lab-linaro-lkft | gcc-10   | multi_v7_defconfig           | 1          

  Details:     https://kernelci.org/test/plan/id/630475b42d5f0b309735564e

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.0-rc2-232-gffc62c393637/arm/multi_v7_defconfig/gcc-10/lab-linaro-lkft/baseline-am57xx-beagle-x15.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.0-rc2-232-gffc62c393637/arm/multi_v7_defconfig/gcc-10/lab-linaro-lkft/baseline-am57xx-beagle-x15.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220805.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/630475b42d5f0b309735564f
        failing since 15 days (last pass: v5.19-8283-ga8bc7f656e322, first fail: v5.19-12861-g50a89f5a92e3) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
am57xx-beagle-x15            | arm   | lab-linaro-lkft | gcc-10   | multi_v7_defconfig+crypto    | 1          

  Details:     https://kernelci.org/test/plan/id/6304777605a1a08531355644

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+crypto
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.0-rc2-232-gffc62c393637/arm/multi_v7_defconfig+crypto/gcc-10/lab-linaro-lkft/baseline-am57xx-beagle-x15.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.0-rc2-232-gffc62c393637/arm/multi_v7_defconfig+crypto/gcc-10/lab-linaro-lkft/baseline-am57xx-beagle-x15.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220805.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6304777605a1a08531355645
        failing since 17 days (last pass: v5.19-8283-ga8bc7f656e322, first fail: v5.19-11387-gd91170a44a94) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
am57xx-beagle-x15            | arm   | lab-linaro-lkft | gcc-10   | multi_v7_defc...MB2_KERNEL=y | 1          

  Details:     https://kernelci.org/test/plan/id/63047841d6b81f78df35566f

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.0-rc2-232-gffc62c393637/arm/multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y/gcc-10/lab-linaro-lkft/baseline-am57xx-beagle-x15.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.0-rc2-232-gffc62c393637/arm/multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y/gcc-10/lab-linaro-lkft/baseline-am57xx-beagle-x15.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220805.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/63047841d6b81f78df355670
        failing since 17 days (last pass: v5.19-8283-ga8bc7f656e322, first fail: v5.19-11387-gd91170a44a94) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
am57xx-beagle-x15            | arm   | lab-linaro-lkft | gcc-10   | multi_v7_defconfig+ima       | 1          

  Details:     https://kernelci.org/test/plan/id/63047a9b5b758771cf355659

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+ima
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.0-rc2-232-gffc62c393637/arm/multi_v7_defconfig+ima/gcc-10/lab-linaro-lkft/baseline-am57xx-beagle-x15.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.0-rc2-232-gffc62c393637/arm/multi_v7_defconfig+ima/gcc-10/lab-linaro-lkft/baseline-am57xx-beagle-x15.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220805.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/63047a9b5b758771cf35565a
        failing since 17 days (last pass: v5.19-3879-ge7dffa5317766, first fail: v5.19-11387-gd91170a44a94) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
am57xx-beagle-x15            | arm   | lab-linaro-lkft | gcc-10   | omap2plus_defconfig          | 1          

  Details:     https://kernelci.org/test/plan/id/630476eceb71381462355678

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: omap2plus_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.0-rc2-232-gffc62c393637/arm/omap2plus_defconfig/gcc-10/lab-linaro-lkft/baseline-am57xx-beagle-x15.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.0-rc2-232-gffc62c393637/arm/omap2plus_defconfig/gcc-10/lab-linaro-lkft/baseline-am57xx-beagle-x15.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220805.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/630476eceb71381462355679
        failing since 15 days (last pass: v5.19-1483-gffa33bbcf63ea, first fail: v5.19-12861-g50a89f5a92e3) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
da850-lcdk                   | arm   | lab-baylibre    | gcc-10   | davinci_all_defconfig        | 1          

  Details:     https://kernelci.org/test/plan/id/6304743a5b87a98380355642

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: davinci_all_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.0-rc2-232-gffc62c393637/arm/davinci_all_defconfig/gcc-10/lab-baylibre/baseline-da850-lcdk.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.0-rc2-232-gffc62c393637/arm/davinci_all_defconfig/gcc-10/lab-baylibre/baseline-da850-lcdk.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220805.0/armel/rootfs.cpio.gz 

  * baseline.dmesg.alert: https://kernelci.org/test/case/id/6304743a5b87a98380355646
        failing since 211 days (last pass: v5.16-11577-gffd79fec234d, first fail: v5.17-rc1-180-g86539e2bdb99)
        3 lines

    2022-08-23T06:30:52.487493  kern  :alert : BUG: Bad page state in process kworker/u2:0  pfn:c3000
    2022-08-23T06:30:52.487713  kern  :alert : BUG: Bad page state in process kworker/u2:0  pfn:c3400
    2022-08-23T06:30:52.490551  kern  :alert : BUG: Bad page state in process kworker/u2:0  pfn:c3800
    2022-08-23T06:30:52.533520  <8><LAVA_SIGNAL_TESTCASE TEST_CASE_ID=alert RESULT=fail UNITS=lines MEASUREMENT=3>   

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
imx6dl-riotboard             | arm   | lab-pengutronix | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/63047c304c73df2a4535565c

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.0-rc2-232-gffc62c393637/arm/multi_v7_defconfig+debug/gcc-10/lab-pengutronix/baseline-imx6dl-riotboard.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.0-rc2-232-gffc62c393637/arm/multi_v7_defconfig+debug/gcc-10/lab-pengutronix/baseline-imx6dl-riotboard.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220805.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/63047c304c73df2a4535565d
        failing since 11 days (last pass: v5.19-13979-gdcb67a85d8831, first fail: v5.19-14056-g3b7c069e0e1e4) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
imx6qp-wandboard-revd1       | arm   | lab-pengutronix | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/63047bcc7f58d17485355644

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.0-rc2-232-gffc62c393637/arm/multi_v7_defconfig+debug/gcc-10/lab-pengutronix/baseline-imx6qp-wandboard-revd1.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.0-rc2-232-gffc62c393637/arm/multi_v7_defconfig+debug/gcc-10/lab-pengutronix/baseline-imx6qp-wandboard-revd1.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220805.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/63047bcc7f58d17485355645
        failing since 11 days (last pass: v5.19-13979-gdcb67a85d8831, first fail: v5.19-14056-g3b7c069e0e1e4) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
imx7d-sdb                    | arm   | lab-nxp         | gcc-10   | imx_v6_v7_defconfig          | 1          

  Details:     https://kernelci.org/test/plan/id/63047592e0be387ea3355642

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: imx_v6_v7_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.0-rc2-232-gffc62c393637/arm/imx_v6_v7_defconfig/gcc-10/lab-nxp/baseline-imx7d-sdb.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.0-rc2-232-gffc62c393637/arm/imx_v6_v7_defconfig/gcc-10/lab-nxp/baseline-imx7d-sdb.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220805.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/63047592e0be387ea3355643
        failing since 17 days (last pass: v5.19-8283-ga8bc7f656e322, first fail: v5.19-11387-gd91170a44a94) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
imx7ulp-evk                  | arm   | lab-nxp         | gcc-10   | imx_v6_v7_defconfig          | 1          

  Details:     https://kernelci.org/test/plan/id/630478f34fb00f5ad335569a

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: imx_v6_v7_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.0-rc2-232-gffc62c393637/arm/imx_v6_v7_defconfig/gcc-10/lab-nxp/baseline-imx7ulp-evk.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.0-rc2-232-gffc62c393637/arm/imx_v6_v7_defconfig/gcc-10/lab-nxp/baseline-imx7ulp-evk.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220805.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/630478f34fb00f5ad335569b
        failing since 19 days (last pass: v5.19-1483-gffa33bbcf63ea, first fail: v5.19-3879-ge7dffa5317766) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
kontron-pitx-imx8m           | arm64 | lab-kontron     | gcc-10   | defconfig                    | 2          

  Details:     https://kernelci.org/test/plan/id/63047b37c85060bab1355650

  Results:     50 PASS, 2 FAIL, 1 SKIP
  Full config: defconfig
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.0-rc2-232-gffc62c393637/arm64/defconfig/gcc-10/lab-kontron/baseline-kontron-pitx-imx8m.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.0-rc2-232-gffc62c393637/arm64/defconfig/gcc-10/lab-kontron/baseline-kontron-pitx-imx8m.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220805.0/arm64/rootfs.cpio.gz 

  * baseline.bootrr.imx6q-pcie-pcie0-probed: https://kernelci.org/test/case/id/63047b37c85060bab1355662
        failing since 15 days (last pass: v5.19-8283-ga8bc7f656e322, first fail: v5.19-12861-g50a89f5a92e3)

    2022-08-23T07:00:53.319252  /lava-158206/1/../bin/lava-test-case
    2022-08-23T07:00:53.319663  <8>[   19.385454] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=imx6q-pcie-pcie0-probed RESULT=fail>
    2022-08-23T07:00:53.319910  /lava-158206/1/../bin/lava-test-case   

  * baseline.bootrr.intel-igb-probed: https://kernelci.org/test/case/id/63047b37c85060bab1355664
        failing since 15 days (last pass: v5.19-8283-ga8bc7f656e322, first fail: v5.19-12861-g50a89f5a92e3)

    2022-08-23T07:00:54.357319  /lava-158206/1/../bin/lava-test-case
    2022-08-23T07:00:54.358332  <8>[   20.429653] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=intel-igb-probed RESULT=fail>
    2022-08-23T07:00:54.358484  /lava-158206/1/../bin/lava-test-case
    2022-08-23T07:00:54.358625  <8>[   20.449654] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=dwc3-driver-present RESULT=pass>
    2022-08-23T07:00:54.358765  /lava-158206/1/../bin/lava-test-case
    2022-08-23T07:00:54.358899  <8>[   20.470225] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=dwc3-usb0-probed RESULT=pass>
    2022-08-23T07:00:54.359035  /lava-158206/1/../bin/lava-test-case   

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
kontron-pitx-imx8m           | arm64 | lab-kontron     | gcc-10   | defconfig+crypto             | 2          

  Details:     https://kernelci.org/test/plan/id/63047c25fe76c5560c355648

  Results:     50 PASS, 2 FAIL, 1 SKIP
  Full config: defconfig+crypto
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.0-rc2-232-gffc62c393637/arm64/defconfig+crypto/gcc-10/lab-kontron/baseline-kontron-pitx-imx8m.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.0-rc2-232-gffc62c393637/arm64/defconfig+crypto/gcc-10/lab-kontron/baseline-kontron-pitx-imx8m.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220805.0/arm64/rootfs.cpio.gz 

  * baseline.bootrr.imx6q-pcie-pcie0-probed: https://kernelci.org/test/case/id/63047c25fe76c5560c35565a
        failing since 17 days (last pass: v5.19-8283-ga8bc7f656e322, first fail: v5.19-11387-gd91170a44a94)

    2022-08-23T07:05:00.950826  /lava-158213/1/../bin/lava-test-case
    2022-08-23T07:05:00.951207  <8>[   19.133858] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=imx6q-pcie-pcie0-probed RESULT=fail>
    2022-08-23T07:05:00.951458  /lava-158213/1/../bin/lava-test-case   

  * baseline.bootrr.intel-igb-probed: https://kernelci.org/test/case/id/63047c25fe76c5560c35565c
        failing since 17 days (last pass: v5.19-8283-ga8bc7f656e322, first fail: v5.19-11387-gd91170a44a94)

    2022-08-23T07:05:01.988371  /lava-158213/1/../bin/lava-test-case
    2022-08-23T07:05:01.988750  <8>[   20.178169] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=intel-igb-probed RESULT=fail>
    2022-08-23T07:05:01.989004  /lava-158213/1/../bin/lava-test-case   

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
kontron-pitx-imx8m           | arm64 | lab-kontron     | gcc-10   | defconfig+ima                | 2          

  Details:     https://kernelci.org/test/plan/id/63047e41b66a3ed3d9355648

  Results:     50 PASS, 2 FAIL, 1 SKIP
  Full config: defconfig+ima
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.0-rc2-232-gffc62c393637/arm64/defconfig+ima/gcc-10/lab-kontron/baseline-kontron-pitx-imx8m.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.0-rc2-232-gffc62c393637/arm64/defconfig+ima/gcc-10/lab-kontron/baseline-kontron-pitx-imx8m.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220805.0/arm64/rootfs.cpio.gz 

  * baseline.bootrr.imx6q-pcie-pcie0-probed: https://kernelci.org/test/case/id/63047e41b66a3ed3d935565a
        failing since 17 days (last pass: v5.19-8283-ga8bc7f656e322, first fail: v5.19-11387-gd91170a44a94)

    2022-08-23T07:13:55.278613  /lava-158231/1/../bin/lava-test-case
    2022-08-23T07:13:55.278972  <8>[   19.295312] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=imx6q-pcie-pcie0-probed RESULT=fail>
    2022-08-23T07:13:55.279160  /lava-158231/1/../bin/lava-test-case   

  * baseline.bootrr.intel-igb-probed: https://kernelci.org/test/case/id/63047e41b66a3ed3d935565c
        failing since 17 days (last pass: v5.19-8283-ga8bc7f656e322, first fail: v5.19-11387-gd91170a44a94)

    2022-08-23T07:13:56.316444  /lava-158231/1/../bin/lava-test-case
    2022-08-23T07:13:56.316851  <8>[   20.339932] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=intel-igb-probed RESULT=fail>   

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
kontron-pitx-imx8m           | arm64 | lab-kontron     | gcc-10   | defconfig+CON...OMIZE_BASE=y | 2          

  Details:     https://kernelci.org/test/plan/id/630482ce60dc08597f355671

  Results:     50 PASS, 2 FAIL, 1 SKIP
  Full config: defconfig+CONFIG_RANDOMIZE_BASE=y
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.0-rc2-232-gffc62c393637/arm64/defconfig+CONFIG_RANDOMIZE_BASE=y/gcc-10/lab-kontron/baseline-kontron-pitx-imx8m.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.0-rc2-232-gffc62c393637/arm64/defconfig+CONFIG_RANDOMIZE_BASE=y/gcc-10/lab-kontron/baseline-kontron-pitx-imx8m.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220805.0/arm64/rootfs.cpio.gz 

  * baseline.bootrr.imx6q-pcie-pcie0-probed: https://kernelci.org/test/case/id/630482ce60dc08597f355683
        failing since 17 days (last pass: v5.19-8283-ga8bc7f656e322, first fail: v5.19-11387-gd91170a44a94)

    2022-08-23T07:33:19.152857  /lava-158243/1/../bin/lava-test-case
    2022-08-23T07:33:19.153188  <8>[   19.395852] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=imx6q-pcie-pcie0-probed RESULT=fail>
    2022-08-23T07:33:19.153362  /lava-158243/1/../bin/lava-test-case   

  * baseline.bootrr.intel-igb-probed: https://kernelci.org/test/case/id/630482ce60dc08597f355685
        failing since 17 days (last pass: v5.19-8283-ga8bc7f656e322, first fail: v5.19-11387-gd91170a44a94)

    2022-08-23T07:33:20.190531  /lava-158243/1/../bin/lava-test-case
    2022-08-23T07:33:20.190837  <8>[   20.440107] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=intel-igb-probed RESULT=fail>
    2022-08-23T07:33:20.190990  /lava-158243/1/../bin/lava-test-case
    2022-08-23T07:33:20.191133  <8>[   20.460245] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=dwc3-driver-present RESULT=pass>
    2022-08-23T07:33:20.191275  /lava-158243/1/../bin/lava-test-case
    2022-08-23T07:33:20.191413  <8>[   20.480737] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=dwc3-usb0-probed RESULT=pass>
    2022-08-23T07:33:20.191551  /lava-158243/1/../bin/lava-test-case   

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
meson-gxbb-p200              | arm64 | lab-baylibre    | gcc-10   | defconfig+CON...BIG_ENDIAN=y | 2          

  Details:     https://kernelci.org/test/plan/id/6304990106180bdcb7355656

  Results:     4 PASS, 2 FAIL, 1 SKIP
  Full config: defconfig+CONFIG_CPU_BIG_ENDIAN=y
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.0-rc2-232-gffc62c393637/arm64/defconfig+CONFIG_CPU_BIG_ENDIAN=y/gcc-10/lab-baylibre/baseline-meson-gxbb-p200.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.0-rc2-232-gffc62c393637/arm64/defconfig+CONFIG_CPU_BIG_ENDIAN=y/gcc-10/lab-baylibre/baseline-meson-gxbb-p200.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220805.0/arm64be/rootfs.cpio.gz 

  * baseline.dmesg.emerg: https://kernelci.org/test/case/id/6304990106180bdcb7355659
        new failure (last pass: v6.0-rc1-607-g72d0e40cc07e)
        2 lines

    2022-08-23T09:08:03.108463  kern  :emerg : Internal error: Oops - BUG: 0 [#1] PREEMPT SMP
    2022-08-23T09:08:03.109537  kern  :emerg : Code: d2800028 d2e02809 f2e00808 17ffffd1 (d4210000<8>[   20.460387] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=emerg RESULT=fail UNITS=lines MEASUREMENT=2>
    2022-08-23T09:08:03.110613  )    

  * baseline.dmesg.crit: https://kernelci.org/test/case/id/6304990106180bdcb735565b
        new failure (last pass: v6.0-rc1-607-g72d0e40cc07e)
        1 lines

    2022-08-23T09:08:02.538287  / # 
    2022-08-23T09:08:02.655512  #
    2022-08-23T09:08:02.761703  export SHELL=/bin/sh
    2022-08-23T09:08:02.763333  
    2022-08-23T09:08:02.764504  / # #
    2022-08-23T09:08:02.868059  / # export SHELL=/bin/sh. /lava-2406132/environment
    2022-08-23T09:08:02.972025  /lava-2406132/bin/lava-test-runner /lava-2406132/0
    2022-08-23T09:08:02.977439  
    2022-08-23T09:08:02.978503  / # . /lava-2406132/environment
    2022-08-23T09:08:02.991492  / # /lava-2406132/bin/lava-test-runner /lava-2406132/0 
    ... (10 line(s) more)  

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
mt8183-kukui-...uniper-sku16 | arm64 | lab-collabora   | gcc-10   | defconfig+arm64-chromebook   | 1          

  Details:     https://kernelci.org/test/plan/id/6304796acf1a174c4335564a

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.0-rc2-232-gffc62c393637/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-mt8183-kukui-jacuzzi-juniper-sku16.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.0-rc2-232-gffc62c393637/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-mt8183-kukui-jacuzzi-juniper-sku16.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220805.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6304796acf1a174c4335564b
        failing since 17 days (last pass: v5.19-8283-ga8bc7f656e322, first fail: v5.19-11387-gd91170a44a94) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
qemu_arm-vexpress-a15        | arm   | lab-baylibre    | gcc-10   | vexpress_defconfig           | 1          

  Details:     https://kernelci.org/test/plan/id/6304765631f43f3105355642

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: vexpress_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.0-rc2-232-gffc62c393637/arm/vexpress_defconfig/gcc-10/lab-baylibre/baseline-qemu_arm-vexpress-a15.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.0-rc2-232-gffc62c393637/arm/vexpress_defconfig/gcc-10/lab-baylibre/baseline-qemu_arm-vexpress-a15.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220805.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6304765631f43f3105355643
        failing since 17 days (last pass: v5.19-8283-ga8bc7f656e322, first fail: v5.19-11387-gd91170a44a94) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
qemu_arm-vexpress-a15        | arm   | lab-broonie     | gcc-10   | vexpress_defconfig           | 1          

  Details:     https://kernelci.org/test/plan/id/630477cadb43780b0835566b

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: vexpress_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.0-rc2-232-gffc62c393637/arm/vexpress_defconfig/gcc-10/lab-broonie/baseline-qemu_arm-vexpress-a15.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.0-rc2-232-gffc62c393637/arm/vexpress_defconfig/gcc-10/lab-broonie/baseline-qemu_arm-vexpress-a15.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220805.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/630477cadb43780b0835566c
        failing since 17 days (last pass: v5.19-8283-ga8bc7f656e322, first fail: v5.19-11387-gd91170a44a94) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
qemu_arm-vexpress-a9         | arm   | lab-baylibre    | gcc-10   | vexpress_defconfig           | 1          

  Details:     https://kernelci.org/test/plan/id/630476575e8da791fd355661

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: vexpress_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.0-rc2-232-gffc62c393637/arm/vexpress_defconfig/gcc-10/lab-baylibre/baseline-qemu_arm-vexpress-a9.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.0-rc2-232-gffc62c393637/arm/vexpress_defconfig/gcc-10/lab-baylibre/baseline-qemu_arm-vexpress-a9.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220805.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/630476575e8da791fd355662
        failing since 17 days (last pass: v5.19-8283-ga8bc7f656e322, first fail: v5.19-11387-gd91170a44a94) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
qemu_arm-vexpress-a9         | arm   | lab-broonie     | gcc-10   | vexpress_defconfig           | 1          

  Details:     https://kernelci.org/test/plan/id/630477df71bd57d89d355647

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: vexpress_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.0-rc2-232-gffc62c393637/arm/vexpress_defconfig/gcc-10/lab-broonie/baseline-qemu_arm-vexpress-a9.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.0-rc2-232-gffc62c393637/arm/vexpress_defconfig/gcc-10/lab-broonie/baseline-qemu_arm-vexpress-a9.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220805.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/630477df71bd57d89d355648
        failing since 17 days (last pass: v5.19-8283-ga8bc7f656e322, first fail: v5.19-11387-gd91170a44a94) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
qemu_arm64-virt-gicv2        | arm64 | lab-broonie     | gcc-10   | defconfig+debug              | 1          

  Details:     https://kernelci.org/test/plan/id/63047c18fe76c5560c355642

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+debug
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.0-rc2-232-gffc62c393637/arm64/defconfig+debug/gcc-10/lab-broonie/baseline-qemu_arm64-virt-gicv2.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.0-rc2-232-gffc62c393637/arm64/defconfig+debug/gcc-10/lab-broonie/baseline-qemu_arm64-virt-gicv2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220805.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/63047c18fe76c5560c355643
        new failure (last pass: v6.0-rc1-285-gbb8b9a4857726) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
qemu_arm64-virt-gicv3-uefi   | arm64 | lab-broonie     | gcc-10   | defconfig+debug              | 1          

  Details:     https://kernelci.org/test/plan/id/63047c19f4ca22b2e6355643

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+debug
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.0-rc2-232-gffc62c393637/arm64/defconfig+debug/gcc-10/lab-broonie/baseline-qemu_arm64-virt-gicv3-uefi.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.0-rc2-232-gffc62c393637/arm64/defconfig+debug/gcc-10/lab-broonie/baseline-qemu_arm64-virt-gicv3-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220805.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/63047c19f4ca22b2e6355644
        new failure (last pass: v6.0-rc1-285-gbb8b9a4857726) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
rk3399-gru-kevin             | arm64 | lab-collabora   | gcc-10   | defconfig+arm64-chromebook   | 4          

  Details:     https://kernelci.org/test/plan/id/630479daa9a4bcf9f935571b

  Results:     85 PASS, 7 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.0-rc2-232-gffc62c393637/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-rk3399-gru-kevin.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.0-rc2-232-gffc62c393637/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-rk3399-gru-kevin.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220805.0/arm64/rootfs.cpio.gz 

  * baseline.bootrr.rockchip-i2s1-probed: https://kernelci.org/test/case/id/630479daa9a4bcf9f9355743
        failing since 176 days (last pass: v5.17-rc5-244-gd77a1b37f796, first fail: v5.17-rc6-176-gb4e03e0dde48)

    2022-08-23T06:55:08.672419  /lava-7098141/1/../bin/lava-test-case   

  * baseline.bootrr.cros-ec-sensors-gyro0-probed: https://kernelci.org/test/case/id/630479daa9a4bcf9f9355766
        failing since 84 days (last pass: v5.18-5613-ge079cf8f6817, first fail: v5.18-11575-gceccc06b624ed)

    2022-08-23T06:55:06.478386  /lava-7098141/1/../bin/lava-test-case   

  * baseline.bootrr.cros-ec-sensors-accel1-probed: https://kernelci.org/test/case/id/630479daa9a4bcf9f9355767
        failing since 84 days (last pass: v5.18-5613-ge079cf8f6817, first fail: v5.18-11575-gceccc06b624ed)

    2022-08-23T06:55:05.437084  /lava-7098141/1/../bin/lava-test-case
    2022-08-23T06:55:05.449355  <8>[   33.565468] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=cros-ec-sensors-accel1-probed RESULT=fail>   

  * baseline.bootrr.cros-ec-sensors-accel0-probed: https://kernelci.org/test/case/id/630479daa9a4bcf9f9355768
        failing since 84 days (last pass: v5.18-5613-ge079cf8f6817, first fail: v5.18-11575-gceccc06b624ed)

    2022-08-23T06:55:03.350267  <8>[   31.466675] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=cros-ec-sensors-driver-present RESULT=pass>
    2022-08-23T06:55:04.392448  /lava-7098141/1/../bin/lava-test-case
    2022-08-23T06:55:04.403727  <8>[   32.520538] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=cros-ec-sensors-accel0-probed RESULT=fail>   

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
sc7180-trogdo...zor-limozeen | arm64 | lab-collabora   | gcc-10   | defconfig+arm64-chromebook   | 1          

  Details:     https://kernelci.org/test/plan/id/6304789af8cb0d2ccd3556db

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.0-rc2-232-gffc62c393637/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-sc7180-trogdor-lazor-limozeen.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.0-rc2-232-gffc62c393637/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-sc7180-trogdor-lazor-limozeen.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220805.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6304789af8cb0d2ccd3556dc
        new failure (last pass: v6.0-rc1-607-g72d0e40cc07e)