Subject: next/pending-fixes baseline: 518 runs, 37 regressions (v6.2-rc6-351-gf42837eac380f)

From: "kernelci.org bot" <[email-masked]>
Date: Thu, 02 Feb 2023 19:05:37 -0800 (PST)

next/pending-fixes baseline: 518 runs, 37 regressions (v6.2-rc6-351-gf42837eac380f)

Regressions Summary
-------------------

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
am57xx-beagle-x15            | arm   | lab-linaro-lkft | gcc-10   | multi_v7_defc...CONFIG_SMP=n | 1          
am57xx-beagle-x15            | arm   | lab-linaro-lkft | gcc-10   | multi_v7_defconfig+debug     | 1          
bcm2835-rpi-b-rev2           | arm   | lab-broonie     | gcc-10   | bcm2835_defconfig            | 1          
bcm2836-rpi-2-b              | arm   | lab-collabora   | gcc-10   | bcm2835_defconfig            | 1          
cubietruck                   | arm   | lab-baylibre    | gcc-10   | multi_v7_defc...CONFIG_SMP=n | 1          
cubietruck                   | arm   | lab-baylibre    | gcc-10   | multi_v7_defconfig+ima       | 1          
cubietruck                   | arm   | lab-baylibre    | gcc-10   | multi_v7_defconfig           | 1          
da850-lcdk                   | arm   | lab-baylibre    | gcc-10   | davinci_all_defconfig        | 1          
fsl-ls1088a-rdb              | arm64 | lab-nxp         | gcc-10   | defconfig+debug              | 1          
imx53-qsrb                   | arm   | lab-pengutronix | gcc-10   | multi_v7_defc...CONFIG_SMP=n | 1          
imx53-qsrb                   | arm   | lab-pengutronix | gcc-10   | multi_v7_defconfig+ima       | 1          
imx53-qsrb                   | arm   | lab-pengutronix | gcc-10   | multi_v7_defconfig           | 1          
imx6dl-riotboard             | arm   | lab-pengutronix | gcc-10   | multi_v7_defconfig+ima       | 1          
imx6dl-riotboard             | arm   | lab-pengutronix | gcc-10   | multi_v7_defconfig+debug     | 1          
imx6dl-udoo                  | arm   | lab-broonie     | gcc-10   | imx_v6_v7_defconfig          | 1          
imx6q-udoo                   | arm   | lab-broonie     | gcc-10   | imx_v6_v7_defconfig          | 1          
imx6qp-wandboard-revd1       | arm   | lab-pengutronix | gcc-10   | multi_v7_defconfig+debug     | 1          
jetson-tk1                   | arm   | lab-baylibre    | gcc-10   | multi_v7_defc...G_ARM_LPAE=y | 1          
mt8173-elm-hana              | arm64 | lab-collabora   | gcc-10   | defconfig+arm...ok+kselftest | 1          
ox820-clouden...lug-series-3 | arm   | lab-baylibre    | gcc-10   | oxnas_v6_defconfig           | 1          
qemu_arm-virt-gicv2          | arm   | lab-baylibre    | gcc-10   | multi_v7_defconfig+debug     | 1          
qemu_arm-virt-gicv2          | arm   | lab-broonie     | gcc-10   | multi_v7_defconfig+debug     | 1          
qemu_arm-virt-gicv2          | arm   | lab-collabora   | gcc-10   | multi_v7_defconfig+debug     | 1          
qemu_arm-virt-gicv2-uefi     | arm   | lab-baylibre    | gcc-10   | multi_v7_defconfig+debug     | 1          
qemu_arm-virt-gicv2-uefi     | arm   | lab-broonie     | gcc-10   | multi_v7_defconfig+debug     | 1          
qemu_arm-virt-gicv3          | arm   | lab-baylibre    | gcc-10   | multi_v7_defconfig+debug     | 1          
qemu_arm-virt-gicv3          | arm   | lab-broonie     | gcc-10   | multi_v7_defconfig+debug     | 1          
qemu_arm-virt-gicv3-uefi     | arm   | lab-baylibre    | gcc-10   | multi_v7_defconfig+debug     | 1          
qemu_arm-virt-gicv3-uefi     | arm   | lab-broonie     | gcc-10   | multi_v7_defconfig+debug     | 1          
r8a7743-iwg20d-q7            | arm   | lab-cip         | gcc-10   | shmobile_defconfig           | 1          
rk3288-rock2-square          | arm   | lab-collabora   | gcc-10   | multi_v7_defc...G_ARM_LPAE=y | 1          
rk3288-veyron-jaq            | arm   | lab-collabora   | gcc-10   | multi_v7_defc...G_ARM_LPAE=y | 1          
stm32mp157c-dk2              | arm   | lab-baylibre    | gcc-10   | multi_v7_defc...CONFIG_SMP=n | 1          
stm32mp157c-dk2              | arm   | lab-baylibre    | gcc-10   | multi_v7_defconfig+ima       | 1          
stm32mp157c-dk2              | arm   | lab-baylibre    | gcc-10   | multi_v7_defconfig           | 1          
sun50i-h5-lib...ch-all-h3-cc | arm64 | lab-baylibre    | gcc-10   | defconfig+debug              | 1          
tegra124-nyan-big            | arm   | lab-collabora   | gcc-10   | multi_v7_defc...G_ARM_LPAE=y | 1          

  Details:  https://kernelci.org/test/job/next/branch/pending-fixes/kernel/v6.2-rc6-351-gf42837eac380f/plan/baseline/

  Test:     baseline
  Tree:     next
  Branch:   pending-fixes
  Describe: v6.2-rc6-351-gf42837eac380f
  URL:      https://git.kernel.org/pub/scm/linux/kernel/git/next/linux-next.git
  SHA:      f42837eac380fed54965d358308f8681ede196c6 

Test Regressions
---------------- 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
am57xx-beagle-x15            | arm   | lab-linaro-lkft | gcc-10   | multi_v7_defc...CONFIG_SMP=n | 1          

  Details:     https://kernelci.org/test/plan/id/63dc4254c92e2eb546915f2e

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_SMP=n
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.2-rc6-351-gf42837eac380f/arm/multi_v7_defconfig+CONFIG_SMP=n/gcc-10/lab-linaro-lkft/baseline-am57xx-beagle-x15.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.2-rc6-351-gf42837eac380f/arm/multi_v7_defconfig+CONFIG_SMP=n/gcc-10/lab-linaro-lkft/baseline-am57xx-beagle-x15.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230127.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/63dc4254c92e2eb546915f2f
        failing since 115 days (last pass: v6.0-6424-g1af0c6a154d32, first fail: v6.0-9666-g02c05e0b8d5c) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
am57xx-beagle-x15            | arm   | lab-linaro-lkft | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/63dc479e92740249ee915ecd

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.2-rc6-351-gf42837eac380f/arm/multi_v7_defconfig+debug/gcc-10/lab-linaro-lkft/baseline-am57xx-beagle-x15.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.2-rc6-351-gf42837eac380f/arm/multi_v7_defconfig+debug/gcc-10/lab-linaro-lkft/baseline-am57xx-beagle-x15.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230127.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/63dc479e92740249ee915ece
        failing since 113 days (last pass: v6.0-9666-g02c05e0b8d5c, first fail: v6.0-11312-g1778d6da389c) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
bcm2835-rpi-b-rev2           | arm   | lab-broonie     | gcc-10   | bcm2835_defconfig            | 1          

  Details:     https://kernelci.org/test/plan/id/63dc414c0b6f6adec1915eb9

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: bcm2835_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.2-rc6-351-gf42837eac380f/arm/bcm2835_defconfig/gcc-10/lab-broonie/baseline-bcm2835-rpi-b-rev2.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.2-rc6-351-gf42837eac380f/arm/bcm2835_defconfig/gcc-10/lab-broonie/baseline-bcm2835-rpi-b-rev2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230127.0/armel/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/63dc414c0b6f6adec1915ebe
        new failure (last pass: v6.2-rc6-312-g66bb7649606e3)

    2023-02-02T23:03:16.263266  + set +x
    2023-02-02T23:03:16.267096  <8>[   16.741461] <LAVA_SIGNAL_ENDRUN 0_dmesg 240087_1.5.2.4.1>
    2023-02-02T23:03:16.379922  / # #
    2023-02-02T23:03:16.482629  export SHELL=/bin/sh
    2023-02-02T23:03:16.483141  #
    2023-02-02T23:03:16.584784  / # export SHELL=/bin/sh. /lava-240087/environment
    2023-02-02T23:03:16.585203  
    2023-02-02T23:03:16.686656  / # . /lava-240087/environment/lava-240087/bin/lava-test-runner /lava-240087/1
    2023-02-02T23:03:16.687134  
    2023-02-02T23:03:16.693794  / # /lava-240087/bin/lava-test-runner /lava-240087/1 
    ... (14 line(s) more)  

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
bcm2836-rpi-2-b              | arm   | lab-collabora   | gcc-10   | bcm2835_defconfig            | 1          

  Details:     https://kernelci.org/test/plan/id/63dc41535309614988915ed7

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: bcm2835_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.2-rc6-351-gf42837eac380f/arm/bcm2835_defconfig/gcc-10/lab-collabora/baseline-bcm2836-rpi-2-b.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.2-rc6-351-gf42837eac380f/arm/bcm2835_defconfig/gcc-10/lab-collabora/baseline-bcm2836-rpi-2-b.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230127.0/armel/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/63dc41535309614988915edc
        failing since 22 days (last pass: v6.2-rc3-243-g3145d9dfed32, first fail: v6.2-rc3-296-g79fa898551af)

    2023-02-02T23:03:28.627175  / # #
    2023-02-02T23:03:28.730398  export SHELL=/bin/sh
    2023-02-02T23:03:28.731314  #
    2023-02-02T23:03:28.833509  / # export SHELL=/bin/sh. /lava-8993901/environment
    2023-02-02T23:03:28.834426  
    2023-02-02T23:03:28.936951  / # . /lava-8993901/environment/lava-8993901/bin/lava-test-runner /lava-8993901/1
    2023-02-02T23:03:28.938384  
    2023-02-02T23:03:28.947363  / # /lava-8993901/bin/lava-test-runner /lava-8993901/1
    2023-02-02T23:03:29.063109  + export 'TESTRUN_ID=1_bootrr'
    2023-02-02T23:03:29.063573  + cd /lava-8993901/1/tests/1_bootrr 
    ... (12 line(s) more)  

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
cubietruck                   | arm   | lab-baylibre    | gcc-10   | multi_v7_defc...CONFIG_SMP=n | 1          

  Details:     https://kernelci.org/test/plan/id/63dc428da2cbc870e2915eb9

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: multi_v7_defconfig+CONFIG_SMP=n
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.2-rc6-351-gf42837eac380f/arm/multi_v7_defconfig+CONFIG_SMP=n/gcc-10/lab-baylibre/baseline-cubietruck.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.2-rc6-351-gf42837eac380f/arm/multi_v7_defconfig+CONFIG_SMP=n/gcc-10/lab-baylibre/baseline-cubietruck.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230127.0/armel/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/63dc428da2cbc870e2915ebe
        failing since 16 days (last pass: v6.1-13341-g16cba743aec0, first fail: v6.2-rc4-302-g48ed69cf21b2)

    2023-02-02T23:08:51.195892  <8>[   16.634697] <LAVA_SIGNAL_ENDRUN 0_dmesg 3277189_1.5.2.4.1>
    2023-02-02T23:08:51.304181  / # #
    2023-02-02T23:08:51.407730  export SHELL=/bin/sh
    2023-02-02T23:08:51.408765  #
    2023-02-02T23:08:51.511342  / # export SHELL=/bin/sh. /lava-3277189/environment
    2023-02-02T23:08:51.512016  
    2023-02-02T23:08:51.613692  / # . /lava-3277189/environment/lava-3277189/bin/lava-test-runner /lava-3277189/1
    2023-02-02T23:08:51.615226  
    2023-02-02T23:08:51.619754  / # /lava-3277189/bin/lava-test-runner /lava-3277189/1
    2023-02-02T23:08:51.715654  + export 'TESTRUN_ID=1_bootrr' 
    ... (11 line(s) more)  

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
cubietruck                   | arm   | lab-baylibre    | gcc-10   | multi_v7_defconfig+ima       | 1          

  Details:     https://kernelci.org/test/plan/id/63dc44f8c4dc7787ea915ed1

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: multi_v7_defconfig+ima
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.2-rc6-351-gf42837eac380f/arm/multi_v7_defconfig+ima/gcc-10/lab-baylibre/baseline-cubietruck.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.2-rc6-351-gf42837eac380f/arm/multi_v7_defconfig+ima/gcc-10/lab-baylibre/baseline-cubietruck.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230127.0/armel/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/63dc44f8c4dc7787ea915ed6
        failing since 16 days (last pass: v6.1-13341-g16cba743aec0, first fail: v6.2-rc4-302-g48ed69cf21b2)

    2023-02-02T23:18:58.970802  <8>[   15.166641] <LAVA_SIGNAL_ENDRUN 0_dmesg 3277233_1.5.2.4.1>
    2023-02-02T23:18:59.076949  / # #
    2023-02-02T23:18:59.178382  export SHELL=/bin/sh
    2023-02-02T23:18:59.178762  #
    2023-02-02T23:18:59.279954  / # export SHELL=/bin/sh. /lava-3277233/environment
    2023-02-02T23:18:59.280368  
    2023-02-02T23:18:59.381680  / # . /lava-3277233/environment/lava-3277233/bin/lava-test-runner /lava-3277233/1
    2023-02-02T23:18:59.382287  
    2023-02-02T23:18:59.387897  / # /lava-3277233/bin/lava-test-runner /lava-3277233/1
    2023-02-02T23:18:59.484225  + export 'TESTRUN_ID=1_bootrr' 
    ... (11 line(s) more)  

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
cubietruck                   | arm   | lab-baylibre    | gcc-10   | multi_v7_defconfig           | 1          

  Details:     https://kernelci.org/test/plan/id/63dc4571f1d880cdf2915ebb

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: multi_v7_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.2-rc6-351-gf42837eac380f/arm/multi_v7_defconfig/gcc-10/lab-baylibre/baseline-cubietruck.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.2-rc6-351-gf42837eac380f/arm/multi_v7_defconfig/gcc-10/lab-baylibre/baseline-cubietruck.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230127.0/armel/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/63dc4571f1d880cdf2915ec0
        failing since 16 days (last pass: v6.1-13341-g16cba743aec0, first fail: v6.2-rc4-302-g48ed69cf21b2)

    2023-02-02T23:21:11.594154  + set +x
    2023-02-02T23:21:11.598237  <8>[   14.106999] <LAVA_SIGNAL_ENDRUN 0_dmesg 3277284_1.5.2.4.1>
    2023-02-02T23:21:11.706312  / # #
    2023-02-02T23:21:11.807937  export SHELL=/bin/sh
    2023-02-02T23:21:11.808389  #
    2023-02-02T23:21:11.909755  / # export SHELL=/bin/sh. /lava-3277284/environment
    2023-02-02T23:21:11.910289  
    2023-02-02T23:21:11.910511  / # <3>[   14.332566] Bluetooth: hci0: command 0xfc18 tx timeout
    2023-02-02T23:21:12.011762  . /lava-3277284/environment/lava-3277284/bin/lava-test-runner /lava-3277284/1
    2023-02-02T23:21:12.012460   
    ... (13 line(s) more)  

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
da850-lcdk                   | arm   | lab-baylibre    | gcc-10   | davinci_all_defconfig        | 1          

  Details:     https://kernelci.org/test/plan/id/63dc43cde4e357e820915ec6

  Results:     4 PASS, 2 FAIL, 1 SKIP
  Full config: davinci_all_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.2-rc6-351-gf42837eac380f/arm/davinci_all_defconfig/gcc-10/lab-baylibre/baseline-da850-lcdk.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.2-rc6-351-gf42837eac380f/arm/davinci_all_defconfig/gcc-10/lab-baylibre/baseline-da850-lcdk.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230127.0/armel/rootfs.cpio.gz 

  * baseline.dmesg.alert: https://kernelci.org/test/case/id/63dc43cde4e357e820915ece
        failing since 375 days (last pass: v5.16-11577-gffd79fec234d, first fail: v5.17-rc1-180-g86539e2bdb99)
        3 lines

    2023-02-02T23:13:54.784206  kern  :alert : BUG: Bad page state in process kworker/u2:0  pfn:c3000
    2023-02-02T23:13:54.784784  kern  :alert : BUG: Bad page state in process kworker/u2:0  pfn:c3400
    2023-02-02T23:13:54.787303  kern  :alert : BUG: Bad page state in process kworker/u2:0  pfn:c3800
    2023-02-02T23:13:54.834724  <8><LAVA_SIGNAL_TESTCASE TEST_CASE_ID=alert RESULT=fail UNITS=lines MEASUREMENT=3>   

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
fsl-ls1088a-rdb              | arm64 | lab-nxp         | gcc-10   | defconfig+debug              | 1          

  Details:     https://kernelci.org/test/plan/id/63dc46b521067b8a71915eec

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+debug
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.2-rc6-351-gf42837eac380f/arm64/defconfig+debug/gcc-10/lab-nxp/baseline-fsl-ls1088a-rdb.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.2-rc6-351-gf42837eac380f/arm64/defconfig+debug/gcc-10/lab-nxp/baseline-fsl-ls1088a-rdb.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230127.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/63dc46b521067b8a71915eed
        failing since 38 days (last pass: v6.1-rc6-391-gf445421fe4c7, first fail: v6.2-rc1-87-g81c29d2c4600) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
imx53-qsrb                   | arm   | lab-pengutronix | gcc-10   | multi_v7_defc...CONFIG_SMP=n | 1          

  Details:     https://kernelci.org/test/plan/id/63dc42384bf3d46a59915ecf

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: multi_v7_defconfig+CONFIG_SMP=n
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.2-rc6-351-gf42837eac380f/arm/multi_v7_defconfig+CONFIG_SMP=n/gcc-10/lab-pengutronix/baseline-imx53-qsrb.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.2-rc6-351-gf42837eac380f/arm/multi_v7_defconfig+CONFIG_SMP=n/gcc-10/lab-pengutronix/baseline-imx53-qsrb.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230127.0/armel/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/63dc42384bf3d46a59915ed4
        failing since 3 days (last pass: v6.1-rc8-128-gc530a9add07c, first fail: v6.2-rc6-199-g0a49732f057b)

    2023-02-02T23:07:11.259781  + set +x
    2023-02-02T23:07:11.260042  [   11.960474] <LAVA_SIGNAL_ENDRUN 0_dmesg 896550_1.5.2.3.1>
    2023-02-02T23:07:11.366238  / # #
    2023-02-02T23:07:11.467622  export SHELL=/bin/sh
    2023-02-02T23:07:11.468079  #
    2023-02-02T23:07:11.569396  / # export SHELL=/bin/sh. /lava-896550/environment
    2023-02-02T23:07:11.569771  
    2023-02-02T23:07:11.670959  / # . /lava-896550/environment/lava-896550/bin/lava-test-runner /lava-896550/1
    2023-02-02T23:07:11.671476  
    2023-02-02T23:07:11.674673  / # /lava-896550/bin/lava-test-runner /lava-896550/1 
    ... (12 line(s) more)  

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
imx53-qsrb                   | arm   | lab-pengutronix | gcc-10   | multi_v7_defconfig+ima       | 1          

  Details:     https://kernelci.org/test/plan/id/63dc434ce493efb8ad915f00

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: multi_v7_defconfig+ima
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.2-rc6-351-gf42837eac380f/arm/multi_v7_defconfig+ima/gcc-10/lab-pengutronix/baseline-imx53-qsrb.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.2-rc6-351-gf42837eac380f/arm/multi_v7_defconfig+ima/gcc-10/lab-pengutronix/baseline-imx53-qsrb.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230127.0/armel/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/63dc434ce493efb8ad915f05
        failing since 3 days (last pass: v6.1-rc8-128-gc530a9add07c, first fail: v6.2-rc6-199-g0a49732f057b)

    2023-02-02T23:11:51.159998  + set +x
    2023-02-02T23:11:51.160191  [   12.921446] <LAVA_SIGNAL_ENDRUN 0_dmesg 896563_1.5.2.3.1>
    2023-02-02T23:11:51.267255  / # #
    2023-02-02T23:11:51.368774  export SHELL=/bin/sh
    2023-02-02T23:11:51.369297  #
    2023-02-02T23:11:51.470575  / # export SHELL=/bin/sh. /lava-896563/environment
    2023-02-02T23:11:51.471026  
    2023-02-02T23:11:51.572271  / # . /lava-896563/environment/lava-896563/bin/lava-test-runner /lava-896563/1
    2023-02-02T23:11:51.572943  
    2023-02-02T23:11:51.575843  / # /lava-896563/bin/lava-test-runner /lava-896563/1 
    ... (12 line(s) more)  

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
imx53-qsrb                   | arm   | lab-pengutronix | gcc-10   | multi_v7_defconfig           | 1          

  Details:     https://kernelci.org/test/plan/id/63dc43ec8142adf910915ec4

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: multi_v7_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.2-rc6-351-gf42837eac380f/arm/multi_v7_defconfig/gcc-10/lab-pengutronix/baseline-imx53-qsrb.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.2-rc6-351-gf42837eac380f/arm/multi_v7_defconfig/gcc-10/lab-pengutronix/baseline-imx53-qsrb.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230127.0/armel/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/63dc43ec8142adf910915ec9
        failing since 3 days (last pass: v6.1-rc8-128-gc530a9add07c, first fail: v6.2-rc6-199-g0a49732f057b)

    2023-02-02T23:14:31.178767  + set +x
    2023-02-02T23:14:31.179027  [   12.916569] <LAVA_SIGNAL_ENDRUN 0_dmesg 896576_1.5.2.3.1>
    2023-02-02T23:14:31.287262  / # #
    2023-02-02T23:14:31.391250  export SHELL=/bin/sh
    2023-02-02T23:14:31.391638  #
    2023-02-02T23:14:31.498159  / # export SHELL=/bin/sh. /lava-896576/environment
    2023-02-02T23:14:31.499155  
    2023-02-02T23:14:31.601513  / # . /lava-896576/environment/lava-896576/bin/lava-test-runner /lava-896576/1
    2023-02-02T23:14:31.602278  
    2023-02-02T23:14:31.605361  / # /lava-896576/bin/lava-test-runner /lava-896576/1 
    ... (12 line(s) more)  

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
imx6dl-riotboard             | arm   | lab-pengutronix | gcc-10   | multi_v7_defconfig+ima       | 1          

  Details:     https://kernelci.org/test/plan/id/63dc4360da30ae38c8915edd

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: multi_v7_defconfig+ima
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.2-rc6-351-gf42837eac380f/arm/multi_v7_defconfig+ima/gcc-10/lab-pengutronix/baseline-imx6dl-riotboard.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.2-rc6-351-gf42837eac380f/arm/multi_v7_defconfig+ima/gcc-10/lab-pengutronix/baseline-imx6dl-riotboard.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230127.0/armel/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/63dc4360da30ae38c8915ee2
        new failure (last pass: v6.2-rc6-312-g66bb7649606e3)

    2023-02-02T23:12:12.592860  + set[   14.993283] <LAVA_SIGNAL_ENDRUN 0_dmesg 896560_1.5.2.3.1>
    2023-02-02T23:12:12.593148   +x
    2023-02-02T23:12:12.699332  / # #
    2023-02-02T23:12:12.801071  export SHELL=/bin/sh
    2023-02-02T23:12:12.801499  #
    2023-02-02T23:12:12.902717  / # export SHELL=/bin/sh. /lava-896560/environment
    2023-02-02T23:12:12.903153  
    2023-02-02T23:12:13.004458  / # . /lava-896560/environment/lava-896560/bin/lava-test-runner /lava-896560/1
    2023-02-02T23:12:13.005032  
    2023-02-02T23:12:13.008027  / # /lava-896560/bin/lava-test-runner /lava-896560/1 
    ... (12 line(s) more)  

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
imx6dl-riotboard             | arm   | lab-pengutronix | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/63dc479892740249ee915ec4

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.2-rc6-351-gf42837eac380f/arm/multi_v7_defconfig+debug/gcc-10/lab-pengutronix/baseline-imx6dl-riotboard.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.2-rc6-351-gf42837eac380f/arm/multi_v7_defconfig+debug/gcc-10/lab-pengutronix/baseline-imx6dl-riotboard.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230127.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/63dc479892740249ee915ec5
        failing since 87 days (last pass: v6.0-rc5-224-g269f27f24a11, first fail: v6.1-rc3-573-g82d05e3975f5) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
imx6dl-udoo                  | arm   | lab-broonie     | gcc-10   | imx_v6_v7_defconfig          | 1          

  Details:     https://kernelci.org/test/plan/id/63dc449529dd416994915fb7

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: imx_v6_v7_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.2-rc6-351-gf42837eac380f/arm/imx_v6_v7_defconfig/gcc-10/lab-broonie/baseline-imx6dl-udoo.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.2-rc6-351-gf42837eac380f/arm/imx_v6_v7_defconfig/gcc-10/lab-broonie/baseline-imx6dl-udoo.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230127.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/63dc449529dd416994915fb8
        failing since 148 days (last pass: v5.19-rc5-383-g73ad9bd963c1, first fail: v6.0-rc4-291-g83a56f559828) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
imx6q-udoo                   | arm   | lab-broonie     | gcc-10   | imx_v6_v7_defconfig          | 1          

  Details:     https://kernelci.org/test/plan/id/63dc44e495dec5dbf2915f3d

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: imx_v6_v7_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.2-rc6-351-gf42837eac380f/arm/imx_v6_v7_defconfig/gcc-10/lab-broonie/baseline-imx6q-udoo.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.2-rc6-351-gf42837eac380f/arm/imx_v6_v7_defconfig/gcc-10/lab-broonie/baseline-imx6q-udoo.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230127.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/63dc44e495dec5dbf2915f3e
        failing since 149 days (last pass: v6.0-rc3-415-gf29d411eb4af, first fail: v6.0-rc4-270-gdea3dab2e6fc) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
imx6qp-wandboard-revd1       | arm   | lab-pengutronix | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/63dc479992740249ee915ec7

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.2-rc6-351-gf42837eac380f/arm/multi_v7_defconfig+debug/gcc-10/lab-pengutronix/baseline-imx6qp-wandboard-revd1.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.2-rc6-351-gf42837eac380f/arm/multi_v7_defconfig+debug/gcc-10/lab-pengutronix/baseline-imx6qp-wandboard-revd1.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230127.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/63dc479992740249ee915ec8
        failing since 140 days (last pass: v6.0-rc4-291-g83a56f559828, first fail: v6.0-rc5-197-ga6a750a2f4166) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
jetson-tk1                   | arm   | lab-baylibre    | gcc-10   | multi_v7_defc...G_ARM_LPAE=y | 1          

  Details:     https://kernelci.org/test/plan/id/63dc459b941c1e15e6915eba

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.2-rc6-351-gf42837eac380f/arm/multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y/gcc-10/lab-baylibre/baseline-jetson-tk1.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.2-rc6-351-gf42837eac380f/arm/multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y/gcc-10/lab-baylibre/baseline-jetson-tk1.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230127.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/63dc459b941c1e15e6915ebb
        failing since 279 days (last pass: v5.18-rc2-366-ga3e1163f7eb1a, first fail: v5.18-rc4-464-g425675974eb3) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
mt8173-elm-hana              | arm64 | lab-collabora   | gcc-10   | defconfig+arm...ok+kselftest | 1          

  Details:     https://kernelci.org/test/plan/id/63dc4a193aa5fd3b2e915ed9

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.2-rc6-351-gf42837eac380f/arm64/defconfig+arm64-chromebook+kselftest/gcc-10/lab-collabora/baseline-mt8173-elm-hana.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.2-rc6-351-gf42837eac380f/arm64/defconfig+arm64-chromebook+kselftest/gcc-10/lab-collabora/baseline-mt8173-elm-hana.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230127.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/63dc4a193aa5fd3b2e915eda
        failing since 9 days (last pass: v6.2-rc5-157-g1f16e03afb18, first fail: v6.2-rc5-174-gc5f142de047d) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
ox820-clouden...lug-series-3 | arm   | lab-baylibre    | gcc-10   | oxnas_v6_defconfig           | 1          

  Details:     https://kernelci.org/test/plan/id/63dc40fddc0eda7e38915eed

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: oxnas_v6_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.2-rc6-351-gf42837eac380f/arm/oxnas_v6_defconfig/gcc-10/lab-baylibre/baseline-ox820-cloudengines-pogoplug-series-3.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.2-rc6-351-gf42837eac380f/arm/oxnas_v6_defconfig/gcc-10/lab-baylibre/baseline-ox820-cloudengines-pogoplug-series-3.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230127.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/63dc40fddc0eda7e38915eee
        failing since 113 days (last pass: v6.0-9666-g02c05e0b8d5c, first fail: v6.0-11312-g1778d6da389c) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
qemu_arm-virt-gicv2          | arm   | lab-baylibre    | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/63dc47ca1cbd51eb34915ec7

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.2-rc6-351-gf42837eac380f/arm/multi_v7_defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_arm-virt-gicv2.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.2-rc6-351-gf42837eac380f/arm/multi_v7_defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_arm-virt-gicv2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230127.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/63dc47ca1cbd51eb34915ec8
        failing since 113 days (last pass: v6.0-5324-g7871897dadfa9, first fail: v6.0-11312-g1778d6da389c) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
qemu_arm-virt-gicv2          | arm   | lab-broonie     | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/63dc494fc01824914f915eda

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.2-rc6-351-gf42837eac380f/arm/multi_v7_defconfig+debug/gcc-10/lab-broonie/baseline-qemu_arm-virt-gicv2.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.2-rc6-351-gf42837eac380f/arm/multi_v7_defconfig+debug/gcc-10/lab-broonie/baseline-qemu_arm-virt-gicv2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230127.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/63dc494fc01824914f915edb
        failing since 113 days (last pass: v6.0-5324-g7871897dadfa9, first fail: v6.0-11312-g1778d6da389c) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
qemu_arm-virt-gicv2          | arm   | lab-collabora   | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/63dc478e330a633c52915fa4

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.2-rc6-351-gf42837eac380f/arm/multi_v7_defconfig+debug/gcc-10/lab-collabora/baseline-qemu_arm-virt-gicv2.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.2-rc6-351-gf42837eac380f/arm/multi_v7_defconfig+debug/gcc-10/lab-collabora/baseline-qemu_arm-virt-gicv2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230127.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/63dc478e330a633c52915fa5
        failing since 113 days (last pass: v6.0-5324-g7871897dadfa9, first fail: v6.0-11312-g1778d6da389c) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
qemu_arm-virt-gicv2-uefi     | arm   | lab-baylibre    | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/63dc47c83ca9f4c023915f04

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.2-rc6-351-gf42837eac380f/arm/multi_v7_defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_arm-virt-gicv2-uefi.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.2-rc6-351-gf42837eac380f/arm/multi_v7_defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_arm-virt-gicv2-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230127.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/63dc47c83ca9f4c023915f05
        failing since 113 days (last pass: v6.0-9666-g02c05e0b8d5c, first fail: v6.0-11312-g1778d6da389c) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
qemu_arm-virt-gicv2-uefi     | arm   | lab-broonie     | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/63dc4915f4c2d7edcd915ed6

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.2-rc6-351-gf42837eac380f/arm/multi_v7_defconfig+debug/gcc-10/lab-broonie/baseline-qemu_arm-virt-gicv2-uefi.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.2-rc6-351-gf42837eac380f/arm/multi_v7_defconfig+debug/gcc-10/lab-broonie/baseline-qemu_arm-virt-gicv2-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230127.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/63dc4915f4c2d7edcd915ed7
        failing since 113 days (last pass: v6.0-9666-g02c05e0b8d5c, first fail: v6.0-11312-g1778d6da389c) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
qemu_arm-virt-gicv3          | arm   | lab-baylibre    | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/63dc47c93ca9f4c023915f09

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.2-rc6-351-gf42837eac380f/arm/multi_v7_defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_arm-virt-gicv3.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.2-rc6-351-gf42837eac380f/arm/multi_v7_defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_arm-virt-gicv3.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230127.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/63dc47c93ca9f4c023915f0a
        failing since 113 days (last pass: v6.0-9666-g02c05e0b8d5c, first fail: v6.0-11312-g1778d6da389c) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
qemu_arm-virt-gicv3          | arm   | lab-broonie     | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/63dc49295ce2049e0c915f6d

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.2-rc6-351-gf42837eac380f/arm/multi_v7_defconfig+debug/gcc-10/lab-broonie/baseline-qemu_arm-virt-gicv3.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.2-rc6-351-gf42837eac380f/arm/multi_v7_defconfig+debug/gcc-10/lab-broonie/baseline-qemu_arm-virt-gicv3.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230127.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/63dc49295ce2049e0c915f6e
        failing since 113 days (last pass: v6.0-9666-g02c05e0b8d5c, first fail: v6.0-11312-g1778d6da389c) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
qemu_arm-virt-gicv3-uefi     | arm   | lab-baylibre    | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/63dc47c63ca9f4c023915f01

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.2-rc6-351-gf42837eac380f/arm/multi_v7_defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_arm-virt-gicv3-uefi.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.2-rc6-351-gf42837eac380f/arm/multi_v7_defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_arm-virt-gicv3-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230127.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/63dc47c63ca9f4c023915f02
        failing since 113 days (last pass: v6.0-9666-g02c05e0b8d5c, first fail: v6.0-11312-g1778d6da389c) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
qemu_arm-virt-gicv3-uefi     | arm   | lab-broonie     | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/63dc4914791cf37117915eec

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.2-rc6-351-gf42837eac380f/arm/multi_v7_defconfig+debug/gcc-10/lab-broonie/baseline-qemu_arm-virt-gicv3-uefi.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.2-rc6-351-gf42837eac380f/arm/multi_v7_defconfig+debug/gcc-10/lab-broonie/baseline-qemu_arm-virt-gicv3-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230127.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/63dc4914791cf37117915eed
        failing since 113 days (last pass: v6.0-9666-g02c05e0b8d5c, first fail: v6.0-11312-g1778d6da389c) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
r8a7743-iwg20d-q7            | arm   | lab-cip         | gcc-10   | shmobile_defconfig           | 1          

  Details:     https://kernelci.org/test/plan/id/63dc40ff6487e27ce5915eb9

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: shmobile_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.2-rc6-351-gf42837eac380f/arm/shmobile_defconfig/gcc-10/lab-cip/baseline-r8a7743-iwg20d-q7.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.2-rc6-351-gf42837eac380f/arm/shmobile_defconfig/gcc-10/lab-cip/baseline-r8a7743-iwg20d-q7.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230127.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/63dc40ff6487e27ce5915eba
        failing since 1 day (last pass: v6.2-rc6-241-g70d29276a90d, first fail: v6.2-rc6-289-g1b7183933813) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
rk3288-rock2-square          | arm   | lab-collabora   | gcc-10   | multi_v7_defc...G_ARM_LPAE=y | 1          

  Details:     https://kernelci.org/test/plan/id/63dc45c93ad20aaad6915ee6

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.2-rc6-351-gf42837eac380f/arm/multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y/gcc-10/lab-collabora/baseline-rk3288-rock2-square.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.2-rc6-351-gf42837eac380f/arm/multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y/gcc-10/lab-collabora/baseline-rk3288-rock2-square.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230127.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/63dc45c93ad20aaad6915ee7
        failing since 49 days (last pass: v6.1-6378-g44d433ee7540, first fail: v6.1-10792-g244d284981da) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
rk3288-veyron-jaq            | arm   | lab-collabora   | gcc-10   | multi_v7_defc...G_ARM_LPAE=y | 1          

  Details:     https://kernelci.org/test/plan/id/63dc448f29dd416994915f1d

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.2-rc6-351-gf42837eac380f/arm/multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y/gcc-10/lab-collabora/baseline-rk3288-veyron-jaq.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.2-rc6-351-gf42837eac380f/arm/multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y/gcc-10/lab-collabora/baseline-rk3288-veyron-jaq.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230127.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/63dc448f29dd416994915f1e
        failing since 49 days (last pass: v6.1-6378-g44d433ee7540, first fail: v6.1-10792-g244d284981da) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
stm32mp157c-dk2              | arm   | lab-baylibre    | gcc-10   | multi_v7_defc...CONFIG_SMP=n | 1          

  Details:     https://kernelci.org/test/plan/id/63dc4229c2dd5b01ed915ec8

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: multi_v7_defconfig+CONFIG_SMP=n
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.2-rc6-351-gf42837eac380f/arm/multi_v7_defconfig+CONFIG_SMP=n/gcc-10/lab-baylibre/baseline-stm32mp157c-dk2.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.2-rc6-351-gf42837eac380f/arm/multi_v7_defconfig+CONFIG_SMP=n/gcc-10/lab-baylibre/baseline-stm32mp157c-dk2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230127.0/armel/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/63dc4229c2dd5b01ed915ecd
        failing since 1 day (last pass: v6.0-11312-g1778d6da389c, first fail: v6.2-rc6-289-g1b7183933813)

    2023-02-02T23:07:00.153501  <8>[   16.173932] <LAVA_SIGNAL_ENDRUN 0_dmesg 3277200_1.5.2.4.1>
    2023-02-02T23:07:00.259491  / # #
    2023-02-02T23:07:00.361421  export SHELL=/bin/sh
    2023-02-02T23:07:00.361923  #
    2023-02-02T23:07:00.463374  / # export SHELL=/bin/sh. /lava-3277200/environment
    2023-02-02T23:07:00.463786  
    2023-02-02T23:07:00.565192  / # . /lava-3277200/environment/lava-3277200/bin/lava-test-runner /lava-3277200/1
    2023-02-02T23:07:00.565853  
    2023-02-02T23:07:00.569597  / # /lava-3277200/bin/lava-test-runner /lava-3277200/1
    2023-02-02T23:07:00.640629  + export 'TESTRUN_ID=1_bootrr' 
    ... (11 line(s) more)  

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
stm32mp157c-dk2              | arm   | lab-baylibre    | gcc-10   | multi_v7_defconfig+ima       | 1          

  Details:     https://kernelci.org/test/plan/id/63dc43059f08acc364915ed3

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: multi_v7_defconfig+ima
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.2-rc6-351-gf42837eac380f/arm/multi_v7_defconfig+ima/gcc-10/lab-baylibre/baseline-stm32mp157c-dk2.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.2-rc6-351-gf42837eac380f/arm/multi_v7_defconfig+ima/gcc-10/lab-baylibre/baseline-stm32mp157c-dk2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230127.0/armel/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/63dc43059f08acc364915ed8
        failing since 1 day (last pass: v5.19-3879-ge7dffa5317766, first fail: v6.2-rc6-289-g1b7183933813)

    2023-02-02T23:10:39.158688  <8>[   15.455663] <LAVA_SIGNAL_ENDRUN 0_dmesg 3277234_1.5.2.4.1>
    2023-02-02T23:10:39.264813  / # #
    2023-02-02T23:10:39.366629  export SHELL=/bin/sh
    2023-02-02T23:10:39.367210  #
    2023-02-02T23:10:39.468756  / # export SHELL=/bin/sh. /lava-3277234/environment
    2023-02-02T23:10:39.469300  
    2023-02-02T23:10:39.570826  / # . /lava-3277234/environment/lava-3277234/bin/lava-test-runner /lava-3277234/1
    2023-02-02T23:10:39.571875  
    2023-02-02T23:10:39.574909  / # /lava-3277234/bin/lava-test-runner /lava-3277234/1
    2023-02-02T23:10:39.650707  + export 'TESTRUN_ID=1_bootrr' 
    ... (11 line(s) more)  

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
stm32mp157c-dk2              | arm   | lab-baylibre    | gcc-10   | multi_v7_defconfig           | 1          

  Details:     https://kernelci.org/test/plan/id/63dc4391d50d349448915ed5

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: multi_v7_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.2-rc6-351-gf42837eac380f/arm/multi_v7_defconfig/gcc-10/lab-baylibre/baseline-stm32mp157c-dk2.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.2-rc6-351-gf42837eac380f/arm/multi_v7_defconfig/gcc-10/lab-baylibre/baseline-stm32mp157c-dk2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230127.0/armel/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/63dc4391d50d349448915eda
        failing since 1 day (last pass: v6.0-11312-g1778d6da389c, first fail: v6.2-rc6-289-g1b7183933813)

    2023-02-02T23:13:15.345159  <8>[   12.667436] <LAVA_SIGNAL_ENDRUN 0_dmesg 3277294_1.5.2.4.1>
    2023-02-02T23:13:15.450092  / # #
    2023-02-02T23:13:15.552670  export SHELL=/bin/sh
    2023-02-02T23:13:15.553458  #
    2023-02-02T23:13:15.655403  / # export SHELL=/bin/sh. /lava-3277294/environment
    2023-02-02T23:13:15.655917  
    2023-02-02T23:13:15.757853  / # . /lava-3277294/environment/lava-3277294/bin/lava-test-runner /lava-3277294/1
    2023-02-02T23:13:15.758603  
    2023-02-02T23:13:15.762307  / # /lava-3277294/bin/lava-test-runner /lava-3277294/1
    2023-02-02T23:13:15.838263  + export 'TESTRUN_ID=1_bootrr' 
    ... (11 line(s) more)  

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
sun50i-h5-lib...ch-all-h3-cc | arm64 | lab-baylibre    | gcc-10   | defconfig+debug              | 1          

  Details:     https://kernelci.org/test/plan/id/63dc46633162e5e52d915eb9

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+debug
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.2-rc6-351-gf42837eac380f/arm64/defconfig+debug/gcc-10/lab-baylibre/baseline-sun50i-h5-libretech-all-h3-cc.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.2-rc6-351-gf42837eac380f/arm64/defconfig+debug/gcc-10/lab-baylibre/baseline-sun50i-h5-libretech-all-h3-cc.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230127.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/63dc46633162e5e52d915eba
        failing since 105 days (last pass: v6.0-10339-g565da9e84d8f, first fail: v6.1-rc1-192-gdfe701541ba9) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
tegra124-nyan-big            | arm   | lab-collabora   | gcc-10   | multi_v7_defc...G_ARM_LPAE=y | 1          

  Details:     https://kernelci.org/test/plan/id/63dc449c29dd416994915fc5

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.2-rc6-351-gf42837eac380f/arm/multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y/gcc-10/lab-collabora/baseline-tegra124-nyan-big.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.2-rc6-351-gf42837eac380f/arm/multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y/gcc-10/lab-collabora/baseline-tegra124-nyan-big.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230127.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/63dc449c29dd416994915fc6
        failing since 49 days (last pass: v6.1-6378-g44d433ee7540, first fail: v6.1-10792-g244d284981da)