Subject: next/pending-fixes baseline: 765 runs, 100 regressions (v6.3-rc6-279-g281ec23cca3f)

From: "kernelci.org bot" <[email-masked]>
Date: Fri, 14 Apr 2023 10:24:17 -0700 (PDT)

next/pending-fixes baseline: 765 runs, 100 regressions (v6.3-rc6-279-g281ec23cca3f)

Regressions Summary
-------------------

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
am57xx-beagle-x15            | arm    | lab-linaro-lkft | gcc-10   | multi_v7_defc...CONFIG_SMP=n | 1          
am57xx-beagle-x15            | arm    | lab-linaro-lkft | gcc-10   | multi_v7_defconfig+debug     | 1          
asus-C436FA-Flip-hatch       | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...ok+kselftest | 1          
asus-C436FA-Flip-hatch       | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...6-chromebook | 1          
asus-C436FA-Flip-hatch       | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...ebook+amdgpu | 1          
asus-CM1400CXA-dalboz        | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...ok+kselftest | 2          
asus-CM1400CXA-dalboz        | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...6-chromebook | 1          
asus-CM1400CXA-dalboz        | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...ebook+amdgpu | 1          
asus-cx9400-volteer          | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...ok+kselftest | 1          
asus-cx9400-volteer          | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...6-chromebook | 1          
asus-cx9400-volteer          | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...ebook+amdgpu | 1          
bcm2836-rpi-2-b              | arm    | lab-collabora   | gcc-10   | bcm2835_defconfig            | 1          
bcm2836-rpi-2-b              | arm    | lab-collabora   | gcc-10   | multi_v7_defc...MB2_KERNEL=y | 1          
beagle-xm                    | arm    | lab-baylibre    | gcc-10   | multi_v7_defc...MB2_KERNEL=y | 1          
cubietruck                   | arm    | lab-baylibre    | gcc-10   | multi_v7_defconfig           | 1          
cubietruck                   | arm    | lab-baylibre    | gcc-10   | multi_v7_defconfig+ima       | 1          
cubietruck                   | arm    | lab-baylibre    | gcc-10   | multi_v7_defconfig+crypto    | 1          
cubietruck                   | arm    | lab-baylibre    | gcc-10   | multi_v7_defc...MB2_KERNEL=y | 1          
cubietruck                   | arm    | lab-baylibre    | gcc-10   | multi_v7_defc...CONFIG_SMP=n | 1          
da850-lcdk                   | arm    | lab-baylibre    | gcc-10   | davinci_all_defconfig        | 2          
fsl-ls1088a-rdb              | arm64  | lab-nxp         | gcc-10   | defconfig+debug              | 1          
hp-11A-G6-EE-grunt           | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...6-chromebook | 1          
hp-x360-12b-c...4020-octopus | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...ok+kselftest | 1          
hp-x360-12b-c...4020-octopus | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...6-chromebook | 1          
hp-x360-12b-c...4020-octopus | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...ebook+amdgpu | 1          
hp-x360-14-G1-sona           | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...ok+kselftest | 1          
hp-x360-14-G1-sona           | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...6-chromebook | 1          
hp-x360-14-G1-sona           | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...ebook+amdgpu | 1          
hp-x360-14a-cb0001xx-zork    | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...ok+kselftest | 1          
hp-x360-14a-cb0001xx-zork    | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...6-chromebook | 1          
hp-x360-14a-cb0001xx-zork    | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...ebook+amdgpu | 1          
imx6dl-udoo                  | arm    | lab-broonie     | gcc-10   | multi_v7_defconfig+crypto    | 2          
imx6qp-wandboard-revd1       | arm    | lab-pengutronix | gcc-10   | multi_v7_defconfig+debug     | 1          
imx6ul-14x14-evk             | arm    | lab-nxp         | gcc-10   | multi_v7_defconfig+crypto    | 1          
imx7d-sdb                    | arm    | lab-nxp         | gcc-10   | multi_v7_defconfig+crypto    | 1          
imx7ulp-evk                  | arm    | lab-nxp         | gcc-10   | multi_v7_defconfig+crypto    | 1          
jetson-tk1                   | arm    | lab-baylibre    | gcc-10   | multi_v7_defc...G_ARM_LPAE=y | 1          
jh7100-starfi...isionfive-v1 | riscv  | lab-clabbe      | gcc-10   | defconfig+kselftest          | 1          
lenovo-TPad-C13-Yoga-zork    | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...ok+kselftest | 1          
lenovo-TPad-C13-Yoga-zork    | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...6-chromebook | 1          
lenovo-TPad-C13-Yoga-zork    | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...ebook+amdgpu | 1          
meson-g12a-sei510            | arm64  | lab-baylibre    | gcc-10   | defconfig+kselftest          | 1          
meson-g12a-u200              | arm64  | lab-baylibre    | gcc-10   | defconfig+kselftest          | 1          
meson-g12a-x96-max           | arm64  | lab-baylibre    | gcc-10   | defconfig+kselftest          | 1          
meson-g12b-a311d-khadas-vim3 | arm64  | lab-baylibre    | gcc-10   | defconfig+kselftest          | 1          
meson-g12b-a311d-khadas-vim3 | arm64  | lab-collabora   | gcc-10   | defconfig+kselftest          | 1          
meson-g12b-odroid-n2         | arm64  | lab-baylibre    | gcc-10   | defconfig+kselftest          | 1          
meson-gxbb-nanopi-k2         | arm64  | lab-baylibre    | gcc-10   | defconfig+kselftest          | 1          
meson-gxl-s905d-p230         | arm64  | lab-baylibre    | gcc-10   | defconfig+kselftest          | 1          
meson-gxl-s905x-khadas-vim   | arm64  | lab-baylibre    | gcc-10   | defconfig+kselftest          | 1          
meson-gxl-s905x-libretech-cc | arm64  | lab-baylibre    | gcc-10   | defconfig+kselftest          | 1          
meson-gxl-s905x-libretech-cc | arm64  | lab-broonie     | gcc-10   | defconfig+kselftest          | 1          
meson-gxl-s905x-libretech-cc | arm64  | lab-clabbe      | gcc-10   | defconfig+kselftest          | 1          
meson-gxm-khadas-vim2        | arm64  | lab-baylibre    | gcc-10   | defconfig+kselftest          | 1          
meson-sm1-khadas-vim3l       | arm64  | lab-baylibre    | gcc-10   | defconfig+kselftest          | 1          
meson-sm1-sei610             | arm64  | lab-baylibre    | gcc-10   | defconfig+kselftest          | 1          
mt8173-elm-hana              | arm64  | lab-collabora   | gcc-10   | defconfig+arm...ok+kselftest | 1          
mt8183-kukui-...uniper-sku16 | arm64  | lab-collabora   | gcc-10   | defconfig+arm...ok+kselftest | 1          
mt8183-kukui-...uniper-sku16 | arm64  | lab-collabora   | gcc-10   | defconfig+arm...ook+videodec | 3          
mt8183-kukui-...uniper-sku16 | arm64  | lab-collabora   | gcc-10   | defconfig+arm64-chromebook   | 3          
mt8192-asurada-spherion-r0   | arm64  | lab-collabora   | gcc-10   | defconfig+arm...ok+kselftest | 1          
mt8192-asurada-spherion-r0   | arm64  | lab-collabora   | gcc-10   | defconfig+arm...ook+videodec | 3          
mt8192-asurada-spherion-r0   | arm64  | lab-collabora   | gcc-10   | defconfig+arm64-chromebook   | 3          
ox820-clouden...lug-series-3 | arm    | lab-baylibre    | gcc-10   | oxnas_v6_defconfig           | 1          
qcom-qdf2400                 | arm64  | lab-linaro-lkft | gcc-10   | defconfig+arm...ok+kselftest | 1          
qcom-qdf2400                 | arm64  | lab-linaro-lkft | gcc-10   | defconfig+kselftest          | 1          
qemu_arm-virt-gicv2          | arm    | lab-baylibre    | gcc-10   | multi_v7_defconfig+debug     | 1          
qemu_arm-virt-gicv2          | arm    | lab-broonie     | gcc-10   | multi_v7_defconfig+debug     | 1          
qemu_arm-virt-gicv2          | arm    | lab-collabora   | gcc-10   | multi_v7_defconfig+debug     | 1          
qemu_arm-virt-gicv2-uefi     | arm    | lab-baylibre    | gcc-10   | multi_v7_defconfig+debug     | 1          
qemu_arm-virt-gicv2-uefi     | arm    | lab-broonie     | gcc-10   | multi_v7_defconfig+debug     | 1          
qemu_arm-virt-gicv2-uefi     | arm    | lab-collabora   | gcc-10   | multi_v7_defconfig+debug     | 1          
qemu_arm-virt-gicv3          | arm    | lab-baylibre    | gcc-10   | multi_v7_defconfig+debug     | 1          
qemu_arm-virt-gicv3          | arm    | lab-broonie     | gcc-10   | multi_v7_defconfig+debug     | 1          
qemu_arm-virt-gicv3          | arm    | lab-collabora   | gcc-10   | multi_v7_defconfig+debug     | 1          
qemu_arm-virt-gicv3-uefi     | arm    | lab-baylibre    | gcc-10   | multi_v7_defconfig+debug     | 1          
qemu_arm-virt-gicv3-uefi     | arm    | lab-broonie     | gcc-10   | multi_v7_defconfig+debug     | 1          
qemu_arm-virt-gicv3-uefi     | arm    | lab-collabora   | gcc-10   | multi_v7_defconfig+debug     | 1          
r8a7743-iwg20d-q7            | arm    | lab-cip         | gcc-10   | shmobile_defconfig           | 1          
rk3288-rock2-square          | arm    | lab-collabora   | gcc-10   | multi_v7_defc...G_ARM_LPAE=y | 1          
rk3399-gru-kevin             | arm64  | lab-collabora   | gcc-10   | defconfig+arm...ok+kselftest | 1          
rk3399-roc-pc                | arm64  | lab-clabbe      | gcc-10   | defconfig+kselftest          | 1          
rk3399-rock-pi-4b            | arm64  | lab-collabora   | gcc-10   | defconfig+kselftest          | 1          
sc7180-trogdor-kingoftown    | arm64  | lab-collabora   | gcc-10   | defconfig+arm...ok+kselftest | 1          
sc7180-trogdo...zor-limozeen | arm64  | lab-collabora   | gcc-10   | defconfig+arm...ok+kselftest | 1          
sun50i-a64-pine64-plus       | arm64  | lab-broonie     | gcc-10   | defconfig+kselftest          | 1          
sun50i-h5-lib...ch-all-h3-cc | arm64  | lab-broonie     | gcc-10   | defconfig+kselftest          | 1          
sun8i-h2-plus-orangepi-r1    | arm    | lab-baylibre    | gcc-10   | sunxi_defconfig              | 1          
sun8i-h2-plus-orangepi-zero  | arm    | lab-baylibre    | gcc-10   | sunxi_defconfig              | 1          

  Details:  https://kernelci.org/test/job/next/branch/pending-fixes/kernel/v6.3-rc6-279-g281ec23cca3f/plan/baseline/

  Test:     baseline
  Tree:     next
  Branch:   pending-fixes
  Describe: v6.3-rc6-279-g281ec23cca3f
  URL:      https://git.kernel.org/pub/scm/linux/kernel/git/next/linux-next.git
  SHA:      281ec23cca3ff60dfb7b75f49306aa473ffc36ed 

Test Regressions
---------------- 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
am57xx-beagle-x15            | arm    | lab-linaro-lkft | gcc-10   | multi_v7_defc...CONFIG_SMP=n | 1          

  Details:     https://kernelci.org/test/plan/id/643956ace8408f44f42e85e6

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_SMP=n
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm/multi_v7_defconfig+CONFIG_SMP=n/gcc-10/lab-linaro-lkft/baseline-am57xx-beagle-x15.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm/multi_v7_defconfig+CONFIG_SMP=n/gcc-10/lab-linaro-lkft/baseline-am57xx-beagle-x15.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230407.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/643956ace8408f44f42e85e7
        failing since 186 days (last pass: v6.0-6424-g1af0c6a154d32, first fail: v6.0-9666-g02c05e0b8d5c) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
am57xx-beagle-x15            | arm    | lab-linaro-lkft | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/64395c4774cda5de582e8604

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm/multi_v7_defconfig+debug/gcc-10/lab-linaro-lkft/baseline-am57xx-beagle-x15.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm/multi_v7_defconfig+debug/gcc-10/lab-linaro-lkft/baseline-am57xx-beagle-x15.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230407.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64395c4774cda5de582e8605
        failing since 184 days (last pass: v6.0-9666-g02c05e0b8d5c, first fail: v6.0-11312-g1778d6da389c) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
asus-C436FA-Flip-hatch       | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...ok+kselftest | 1          

  Details:     https://kernelci.org/test/plan/id/643950e8dfb68bf1e82e8644

  Results:     6 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook+kselftest
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/x86_64/x86_64_defconfig+x86-chromebook+kselftest/gcc-10/lab-collabora/baseline-asus-C436FA-Flip-hatch.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/x86_64/x86_64_defconfig+x86-chromebook+kselftest/gcc-10/lab-collabora/baseline-asus-C436FA-Flip-hatch.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230407.0/x86/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/643950e8dfb68bf1e82e8649
        failing since 14 days (last pass: v6.3-rc3-550-g902f54bbd6c7, first fail: v6.3-rc4-334-g60f00557d56b)

    2023-04-14T13:10:47.912624  + set +x

    2023-04-14T13:10:47.919376  <8>[   12.813342] <LAVA_SIGNAL_ENDRUN 0_dmesg 9977587_1.4.2.3.1>

    2023-04-14T13:10:48.024278  / # #

    2023-04-14T13:10:48.125352  export SHELL=/bin/sh

    2023-04-14T13:10:48.125557  #

    2023-04-14T13:10:48.226471  / # export SHELL=/bin/sh. /lava-9977587/environment

    2023-04-14T13:10:48.226700  

    2023-04-14T13:10:48.327632  / # . /lava-9977587/environment/lava-9977587/bin/lava-test-runner /lava-9977587/1

    2023-04-14T13:10:48.327962  

    2023-04-14T13:10:48.333784  / # /lava-9977587/bin/lava-test-runner /lava-9977587/1
 
    ... (12 line(s) more)  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
asus-C436FA-Flip-hatch       | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...6-chromebook | 1          

  Details:     https://kernelci.org/test/plan/id/6439523c37bd42f7f42e8602

  Results:     6 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/x86_64/x86_64_defconfig+x86-chromebook/gcc-10/lab-collabora/baseline-asus-C436FA-Flip-hatch.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/x86_64/x86_64_defconfig+x86-chromebook/gcc-10/lab-collabora/baseline-asus-C436FA-Flip-hatch.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230407.0/x86/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6439523c37bd42f7f42e8607
        failing since 16 days (last pass: v6.3-rc3-370-g8269040171a02, first fail: v6.3-rc4-214-g39ee5bf6e049)

    2023-04-14T13:16:28.713500  + set +x

    2023-04-14T13:16:28.719979  <8>[   10.183107] <LAVA_SIGNAL_ENDRUN 0_dmesg 9977916_1.4.2.3.1>

    2023-04-14T13:16:28.822984  

    2023-04-14T13:16:28.923841  / # #export SHELL=/bin/sh

    2023-04-14T13:16:28.924080  

    2023-04-14T13:16:29.025042  / # export SHELL=/bin/sh. /lava-9977916/environment

    2023-04-14T13:16:29.025285  

    2023-04-14T13:16:29.126274  / # . /lava-9977916/environment/lava-9977916/bin/lava-test-runner /lava-9977916/1

    2023-04-14T13:16:29.126634  

    2023-04-14T13:16:29.132743  / # /lava-9977916/bin/lava-test-runner /lava-9977916/1
 
    ... (12 line(s) more)  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
asus-C436FA-Flip-hatch       | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...ebook+amdgpu | 1          

  Details:     https://kernelci.org/test/plan/id/643954a892a20449d32e8652

  Results:     6 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook+amdgpu
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/x86_64/x86_64_defconfig+x86-chromebook+amdgpu/gcc-10/lab-collabora/baseline-asus-C436FA-Flip-hatch.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/x86_64/x86_64_defconfig+x86-chromebook+amdgpu/gcc-10/lab-collabora/baseline-asus-C436FA-Flip-hatch.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230407.0/x86/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/643954a892a20449d32e8657
        failing since 16 days (last pass: v6.3-rc3-550-g902f54bbd6c7, first fail: v6.3-rc4-214-g39ee5bf6e049)

    2023-04-14T13:26:52.029815  <8>[   10.409211] <LAVA_SIGNAL_ENDRUN 0_dmesg 9978131_1.4.2.3.1>

    2023-04-14T13:26:52.032904  + set +x

    2023-04-14T13:26:52.137434  / # #

    2023-04-14T13:26:52.238383  export SHELL=/bin/sh

    2023-04-14T13:26:52.238582  #

    2023-04-14T13:26:52.339548  / # export SHELL=/bin/sh. /lava-9978131/environment

    2023-04-14T13:26:52.339719  

    2023-04-14T13:26:52.440645  / # . /lava-9978131/environment/lava-9978131/bin/lava-test-runner /lava-9978131/1

    2023-04-14T13:26:52.440928  

    2023-04-14T13:26:52.446797  / # /lava-9978131/bin/lava-test-runner /lava-9978131/1
 
    ... (12 line(s) more)  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
asus-CM1400CXA-dalboz        | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...ok+kselftest | 2          

  Details:     https://kernelci.org/test/plan/id/643950dedfb68bf1e82e862b

  Results:     5 PASS, 2 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook+kselftest
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/x86_64/x86_64_defconfig+x86-chromebook+kselftest/gcc-10/lab-collabora/baseline-asus-CM1400CXA-dalboz.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/x86_64/x86_64_defconfig+x86-chromebook+kselftest/gcc-10/lab-collabora/baseline-asus-CM1400CXA-dalboz.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230407.0/x86/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/643950dedfb68bf1e82e8630
        failing since 14 days (last pass: v6.3-rc3-550-g902f54bbd6c7, first fail: v6.3-rc4-334-g60f00557d56b)

    2023-04-14T13:10:40.632550  + <8>[   14.808947] <LAVA_SIGNAL_ENDRUN 0_dmesg 9977599_1.4.2.3.1>

    2023-04-14T13:10:40.632754  set +x

    2023-04-14T13:10:40.739408  / # #

    2023-04-14T13:10:40.841829  export SHELL=/bin/sh

    2023-04-14T13:10:40.842524  #

    2023-04-14T13:10:40.944230  / # export SHELL=/bin/sh. /lava-9977599/environment

    2023-04-14T13:10:40.944888  

    2023-04-14T13:10:41.046691  / # . /lava-9977599/environment/lava-9977599/bin/lava-test-runner /lava-9977599/1

    2023-04-14T13:10:41.047734  

    2023-04-14T13:10:41.052501  / # /lava-9977599/bin/lava-test-runner /lava-9977599/1
 
    ... (12 line(s) more)  

  * baseline.dmesg.emerg: https://kernelci.org/test/case/id/643950dedfb68bf1e82e8632
        failing since 3 days (last pass: v6.3-rc5-284-g1beddc8728ad, first fail: v6.3-rc6-158-g254ff7648cb9)
        3 lines

    2023-04-14T13:10:40.605335  kern  :emerg : __common_interrupt: 1.55 No irq handler for vector

    2023-04-14T13:10:40.611920  kern  :emerg : __common_interrupt: 2.55 No irq handler for vector

    2023-04-14T13:10:40.618326  kern  :emerg : __common_interrupt: 3.55 No irq handler for vector

    2023-04-14T13:10:40.624879  <8>[   14.791677] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=emerg RESULT=fail UNITS=lines MEASUREMENT=3>

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
asus-CM1400CXA-dalboz        | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...6-chromebook | 1          

  Details:     https://kernelci.org/test/plan/id/643952317b58a692212e85e7

  Results:     6 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/x86_64/x86_64_defconfig+x86-chromebook/gcc-10/lab-collabora/baseline-asus-CM1400CXA-dalboz.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/x86_64/x86_64_defconfig+x86-chromebook/gcc-10/lab-collabora/baseline-asus-CM1400CXA-dalboz.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230407.0/x86/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/643952317b58a692212e85ec
        failing since 16 days (last pass: v6.3-rc3-370-g8269040171a02, first fail: v6.3-rc4-214-g39ee5bf6e049)

    2023-04-14T13:16:13.356713  + set<8>[   11.674131] <LAVA_SIGNAL_ENDRUN 0_dmesg 9977870_1.4.2.3.1>

    2023-04-14T13:16:13.356801   +x

    2023-04-14T13:16:13.461748  / # #

    2023-04-14T13:16:13.562842  export SHELL=/bin/sh

    2023-04-14T13:16:13.563040  #

    2023-04-14T13:16:13.664023  / # export SHELL=/bin/sh. /lava-9977870/environment

    2023-04-14T13:16:13.664245  

    2023-04-14T13:16:13.765190  / # . /lava-9977870/environment/lava-9977870/bin/lava-test-runner /lava-9977870/1

    2023-04-14T13:16:13.765488  

    2023-04-14T13:16:13.769892  / # /lava-9977870/bin/lava-test-runner /lava-9977870/1
 
    ... (12 line(s) more)  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
asus-CM1400CXA-dalboz        | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...ebook+amdgpu | 1          

  Details:     https://kernelci.org/test/plan/id/643954a01d5e0b7cfd2e85f3

  Results:     6 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook+amdgpu
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/x86_64/x86_64_defconfig+x86-chromebook+amdgpu/gcc-10/lab-collabora/baseline-asus-CM1400CXA-dalboz.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/x86_64/x86_64_defconfig+x86-chromebook+amdgpu/gcc-10/lab-collabora/baseline-asus-CM1400CXA-dalboz.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230407.0/x86/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/643954a01d5e0b7cfd2e85f8
        failing since 16 days (last pass: v6.3-rc3-550-g902f54bbd6c7, first fail: v6.3-rc4-214-g39ee5bf6e049)

    2023-04-14T13:26:41.035022  + set +x<8>[   11.664463] <LAVA_SIGNAL_ENDRUN 0_dmesg 9978150_1.4.2.3.1>

    2023-04-14T13:26:41.035608  

    2023-04-14T13:26:41.143804  / # #

    2023-04-14T13:26:41.246912  export SHELL=/bin/sh

    2023-04-14T13:26:41.247701  #

    2023-04-14T13:26:41.349917  / # export SHELL=/bin/sh. /lava-9978150/environment

    2023-04-14T13:26:41.350861  

    2023-04-14T13:26:41.453052  / # . /lava-9978150/environment/lava-9978150/bin/lava-test-runner /lava-9978150/1

    2023-04-14T13:26:41.454367  

    2023-04-14T13:26:41.459581  / # /lava-9978150/bin/lava-test-runner /lava-9978150/1
 
    ... (12 line(s) more)  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
asus-cx9400-volteer          | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...ok+kselftest | 1          

  Details:     https://kernelci.org/test/plan/id/643950f001894c499a2e862e

  Results:     6 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook+kselftest
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/x86_64/x86_64_defconfig+x86-chromebook+kselftest/gcc-10/lab-collabora/baseline-asus-cx9400-volteer.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/x86_64/x86_64_defconfig+x86-chromebook+kselftest/gcc-10/lab-collabora/baseline-asus-cx9400-volteer.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230407.0/x86/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/643950f001894c499a2e8633
        failing since 14 days (last pass: v6.3-rc3-550-g902f54bbd6c7, first fail: v6.3-rc4-334-g60f00557d56b)

    2023-04-14T13:11:00.244505  <8>[   13.476451] <LAVA_SIGNAL_ENDRUN 0_dmesg 9977601_1.4.2.3.1>

    2023-04-14T13:11:00.247782  + set +x

    2023-04-14T13:11:00.355627  / # #

    2023-04-14T13:11:00.458690  export SHELL=/bin/sh

    2023-04-14T13:11:00.459405  #

    2023-04-14T13:11:00.561264  / # export SHELL=/bin/sh. /lava-9977601/environment

    2023-04-14T13:11:00.562011  

    2023-04-14T13:11:00.663787  / # . /lava-9977601/environment/lava-9977601/bin/lava-test-runner /lava-9977601/1

    2023-04-14T13:11:00.665102  

    2023-04-14T13:11:00.670013  / # /lava-9977601/bin/lava-test-runner /lava-9977601/1
 
    ... (12 line(s) more)  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
asus-cx9400-volteer          | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...6-chromebook | 1          

  Details:     https://kernelci.org/test/plan/id/643952327b58a692212e85f2

  Results:     6 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/x86_64/x86_64_defconfig+x86-chromebook/gcc-10/lab-collabora/baseline-asus-cx9400-volteer.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/x86_64/x86_64_defconfig+x86-chromebook/gcc-10/lab-collabora/baseline-asus-cx9400-volteer.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230407.0/x86/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/643952327b58a692212e85f7
        failing since 16 days (last pass: v6.3-rc3-370-g8269040171a02, first fail: v6.3-rc4-214-g39ee5bf6e049)

    2023-04-14T13:16:18.226198  <8>[   11.455395] <LAVA_SIGNAL_ENDRUN 0_dmesg 9977873_1.4.2.3.1>

    2023-04-14T13:16:18.229168  + set +x

    2023-04-14T13:16:18.330977  

    2023-04-14T13:16:18.432045  / # #export SHELL=/bin/sh

    2023-04-14T13:16:18.432297  

    2023-04-14T13:16:18.533305  / # export SHELL=/bin/sh. /lava-9977873/environment

    2023-04-14T13:16:18.533543  

    2023-04-14T13:16:18.634509  / # . /lava-9977873/environment/lava-9977873/bin/lava-test-runner /lava-9977873/1

    2023-04-14T13:16:18.634808  

    2023-04-14T13:16:18.639706  / # /lava-9977873/bin/lava-test-runner /lava-9977873/1
 
    ... (12 line(s) more)  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
asus-cx9400-volteer          | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...ebook+amdgpu | 1          

  Details:     https://kernelci.org/test/plan/id/643954b17c7343fe942e85ee

  Results:     6 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook+amdgpu
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/x86_64/x86_64_defconfig+x86-chromebook+amdgpu/gcc-10/lab-collabora/baseline-asus-cx9400-volteer.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/x86_64/x86_64_defconfig+x86-chromebook+amdgpu/gcc-10/lab-collabora/baseline-asus-cx9400-volteer.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230407.0/x86/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/643954b17c7343fe942e85f3
        failing since 16 days (last pass: v6.3-rc3-550-g902f54bbd6c7, first fail: v6.3-rc4-214-g39ee5bf6e049)

    2023-04-14T13:26:49.896274  <8>[   10.483787] <LAVA_SIGNAL_ENDRUN 0_dmesg 9978149_1.4.2.3.1>

    2023-04-14T13:26:49.900010  + set +x

    2023-04-14T13:26:50.006017  #

    2023-04-14T13:26:50.007312  

    2023-04-14T13:26:50.109742  / # #export SHELL=/bin/sh

    2023-04-14T13:26:50.110526  

    2023-04-14T13:26:50.212665  / # export SHELL=/bin/sh. /lava-9978149/environment

    2023-04-14T13:26:50.213482  

    2023-04-14T13:26:50.315403  / # . /lava-9978149/environment/lava-9978149/bin/lava-test-runner /lava-9978149/1

    2023-04-14T13:26:50.316517  
 
    ... (13 line(s) more)  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
bcm2836-rpi-2-b              | arm    | lab-collabora   | gcc-10   | bcm2835_defconfig            | 1          

  Details:     https://kernelci.org/test/plan/id/643953323436b791e62e8613

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: bcm2835_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm/bcm2835_defconfig/gcc-10/lab-collabora/baseline-bcm2836-rpi-2-b.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm/bcm2835_defconfig/gcc-10/lab-collabora/baseline-bcm2836-rpi-2-b.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230407.0/armel/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/643953323436b791e62e8618
        failing since 92 days (last pass: v6.2-rc3-243-g3145d9dfed32, first fail: v6.2-rc3-296-g79fa898551af)

    2023-04-14T13:20:33.153257  / # #

    2023-04-14T13:20:33.255910  export SHELL=/bin/sh

    2023-04-14T13:20:33.256878  #

    2023-04-14T13:20:33.359193  / # export SHELL=/bin/sh. /lava-9977913/environment

    2023-04-14T13:20:33.360092  

    2023-04-14T13:20:33.462300  / # . /lava-9977913/environment/lava-9977913/bin/lava-test-runner /lava-9977913/1

    2023-04-14T13:20:33.463792  

    2023-04-14T13:20:33.471155  / # /lava-9977913/bin/lava-test-runner /lava-9977913/1

    2023-04-14T13:20:33.589157  + export 'TESTRUN_ID=1_bootrr'

    2023-04-14T13:20:33.589678  + cd /lava-9977913/1/tests/1_bootrr
 
    ... (12 line(s) more)  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
bcm2836-rpi-2-b              | arm    | lab-collabora   | gcc-10   | multi_v7_defc...MB2_KERNEL=y | 1          

  Details:     https://kernelci.org/test/plan/id/643958e9ae0857e8692e85fa

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm/multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y/gcc-10/lab-collabora/baseline-bcm2836-rpi-2-b.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm/multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y/gcc-10/lab-collabora/baseline-bcm2836-rpi-2-b.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230407.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/643958e9ae0857e8692e85fb
        failing since 46 days (last pass: v6.2-8700-gab98cc06b683, first fail: v6.2-12625-g13efc3a9f23b) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
beagle-xm                    | arm    | lab-baylibre    | gcc-10   | multi_v7_defc...MB2_KERNEL=y | 1          

  Details:     https://kernelci.org/test/plan/id/64395910dee194790a2e86ab

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm/multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y/gcc-10/lab-baylibre/baseline-beagle-xm.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm/multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y/gcc-10/lab-baylibre/baseline-beagle-xm.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230407.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64395910dee194790a2e86ac
        failing since 82 days (last pass: v6.2-rc4-412-g665ddd640630, first fail: v6.2-rc4-480-gb1867226dfbb) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
cubietruck                   | arm    | lab-baylibre    | gcc-10   | multi_v7_defconfig           | 1          

  Details:     https://kernelci.org/test/plan/id/643953911e0f2d335a2e8611

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: multi_v7_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm/multi_v7_defconfig/gcc-10/lab-baylibre/baseline-cubietruck.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm/multi_v7_defconfig/gcc-10/lab-baylibre/baseline-cubietruck.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230407.0/armel/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/643953911e0f2d335a2e8614
        failing since 87 days (last pass: v6.1-13341-g16cba743aec0, first fail: v6.2-rc4-302-g48ed69cf21b2)

    2023-04-14T13:21:55.626003  + set +x<8>[   14.786946] <LAVA_SIGNAL_ENDRUN 0_dmesg 3495193_1.5.2.4.1>
    2023-04-14T13:21:55.626269  
    2023-04-14T13:21:55.729808  / # #
    2023-04-14T13:21:55.831332  export SHELL=/bin/sh
    2023-04-14T13:21:55.831688  <3>[   14.846690] Bluetooth: hci0: command 0x0c03 tx timeout
    2023-04-14T13:21:55.831877  #
    2023-04-14T13:21:55.933043  / # export SHELL=/bin/sh. /lava-3495193/environment
    2023-04-14T13:21:55.933934  
    2023-04-14T13:21:56.035919  / # . /lava-3495193/environment/lava-3495193/bin/lava-test-runner /lava-3495193/1
    2023-04-14T13:21:56.037392   
    ... (13 line(s) more)  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
cubietruck                   | arm    | lab-baylibre    | gcc-10   | multi_v7_defconfig+ima       | 1          

  Details:     https://kernelci.org/test/plan/id/643955428f664701232e85e6

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: multi_v7_defconfig+ima
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm/multi_v7_defconfig+ima/gcc-10/lab-baylibre/baseline-cubietruck.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm/multi_v7_defconfig+ima/gcc-10/lab-baylibre/baseline-cubietruck.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230407.0/armel/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/643955428f664701232e85eb
        failing since 87 days (last pass: v6.1-13341-g16cba743aec0, first fail: v6.2-rc4-302-g48ed69cf21b2)

    2023-04-14T13:29:14.002636  <8>[   14.736625] <LAVA_SIGNAL_ENDRUN 0_dmesg 3495221_1.5.2.4.1>
    2023-04-14T13:29:14.107770  / # #
    2023-04-14T13:29:14.210169  export SHELL=/bin/sh
    2023-04-14T13:29:14.210743  #
    2023-04-14T13:29:14.210992  / # export SHELL=/bin/sh<3>[   14.926446] Bluetooth: hci0: command 0xfc18 tx timeout
    2023-04-14T13:29:14.312609  . /lava-3495221/environment
    2023-04-14T13:29:14.313481  
    2023-04-14T13:29:14.415557  / # . /lava-3495221/environment/lava-3495221/bin/lava-test-runner /lava-3495221/1
    2023-04-14T13:29:14.417084  
    2023-04-14T13:29:14.421322  / # /lava-3495221/bin/lava-test-runner /lava-3495221/1 
    ... (12 line(s) more)  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
cubietruck                   | arm    | lab-baylibre    | gcc-10   | multi_v7_defconfig+crypto    | 1          

  Details:     https://kernelci.org/test/plan/id/643957600689d0ed392e8603

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: multi_v7_defconfig+crypto
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm/multi_v7_defconfig+crypto/gcc-10/lab-baylibre/baseline-cubietruck.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm/multi_v7_defconfig+crypto/gcc-10/lab-baylibre/baseline-cubietruck.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230407.0/armel/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/643957600689d0ed392e8608
        failing since 87 days (last pass: v6.1-13341-g16cba743aec0, first fail: v6.2-rc4-302-g48ed69cf21b2)

    2023-04-14T13:38:16.976780  <8>[   24.168516] <LAVA_SIGNAL_ENDRUN 0_dmesg 3495390_1.5.2.4.1>
    2023-04-14T13:38:17.087070  / # #
    2023-04-14T13:38:17.189627  export SHELL=/bin/sh
    2023-04-14T13:38:17.190403  #
    2023-04-14T13:38:17.292131  / # export SHELL=/bin/sh. /lava-3495390/environment
    2023-04-14T13:38:17.292913  
    2023-04-14T13:38:17.394426  / # . /lava-3495390/environment/lava-3495390/bin/lava-test-runner /lava-3495390/1
    2023-04-14T13:38:17.395827  
    2023-04-14T13:38:17.400715  / # /lava-3495390/bin/lava-test-runner /lava-3495390/1
    2023-04-14T13:38:17.501561  + export 'TESTRUN_ID=1_bootrr' 
    ... (11 line(s) more)  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
cubietruck                   | arm    | lab-baylibre    | gcc-10   | multi_v7_defc...MB2_KERNEL=y | 1          

  Details:     https://kernelci.org/test/plan/id/64395823e5bcf6bbb22e861d

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm/multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y/gcc-10/lab-baylibre/baseline-cubietruck.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm/multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y/gcc-10/lab-baylibre/baseline-cubietruck.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230407.0/armel/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/64395823e5bcf6bbb22e8621
        failing since 87 days (last pass: v6.1-13341-g16cba743aec0, first fail: v6.2-rc4-302-g48ed69cf21b2)

    2023-04-14T13:41:40.026476  <8>[   14.875938] <LAVA_SIGNAL_ENDRUN 0_dmesg 3495415_1.5.2.4.1>
    2023-04-14T13:41:40.133351  / # #
    2023-04-14T13:41:40.235030  export SHELL=/bin/sh
    2023-04-14T13:41:40.235465  #
    2023-04-14T13:41:40.235710  / # export SHELL=/bin/sh<3>[   15.086349] Bluetooth: hci0: command 0xfc18 tx timeout
    2023-04-14T13:41:40.336921  . /lava-3495415/environment
    2023-04-14T13:41:40.337353  
    2023-04-14T13:41:40.438600  / # . /lava-3495415/environment/lava-3495415/bin/lava-test-runner /lava-3495415/1
    2023-04-14T13:41:40.439261  
    2023-04-14T13:41:40.444120  / # /lava-3495415/bin/lava-test-runner /lava-3495415/1 
    ... (12 line(s) more)  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
cubietruck                   | arm    | lab-baylibre    | gcc-10   | multi_v7_defc...CONFIG_SMP=n | 1          

  Details:     https://kernelci.org/test/plan/id/643958e5bf3e3ea0692e861e

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: multi_v7_defconfig+CONFIG_SMP=n
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm/multi_v7_defconfig+CONFIG_SMP=n/gcc-10/lab-baylibre/baseline-cubietruck.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm/multi_v7_defconfig+CONFIG_SMP=n/gcc-10/lab-baylibre/baseline-cubietruck.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230407.0/armel/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/643958e5bf3e3ea0692e8623
        failing since 87 days (last pass: v6.1-13341-g16cba743aec0, first fail: v6.2-rc4-302-g48ed69cf21b2)

    2023-04-14T13:44:58.166028  <8>[   16.633329] <LAVA_SIGNAL_ENDRUN 0_dmesg 3495429_1.5.2.4.1>
    2023-04-14T13:44:58.274270  / # #
    2023-04-14T13:44:58.375510  export SHELL=/bin/sh
    2023-04-14T13:44:58.376117  #
    2023-04-14T13:44:58.481812  / # export SHELL=/bin/sh. /lava-3495429/environment
    2023-04-14T13:44:58.482786  
    2023-04-14T13:44:58.585562  / # . /lava-3495429/environment/lava-3495429/bin/lava-test-runner /lava-3495429/1
    2023-04-14T13:44:58.586216  
    2023-04-14T13:44:58.590549  / # /lava-3495429/bin/lava-test-runner /lava-3495429/1
    2023-04-14T13:44:58.673942  + export 'TESTRUN_ID=1_bootrr' 
    ... (11 line(s) more)  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
da850-lcdk                   | arm    | lab-baylibre    | gcc-10   | davinci_all_defconfig        | 2          

  Details:     https://kernelci.org/test/plan/id/643953c4848cad0fc92e860f

  Results:     3 PASS, 3 FAIL, 1 SKIP
  Full config: davinci_all_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm/davinci_all_defconfig/gcc-10/lab-baylibre/baseline-da850-lcdk.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm/davinci_all_defconfig/gcc-10/lab-baylibre/baseline-da850-lcdk.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230407.0/armel/rootfs.cpio.gz 

  * baseline.dmesg.emerg: https://kernelci.org/test/case/id/643953c4848cad0fc92e8616
        failing since 42 days (last pass: v6.2-1218-g2d4a54ee969d, first fail: v6.2-13370-g5872d227b73f)
        30 lines

    2023-04-14T13:22:56.128067  kern  :alert : Register r6 information: NULL pointer
    2023-04-14T13:22:56.174417  kern  :alert : Register r7 information: non-paged memory
    2023-04-14T13:22:56.175274  kern  :alert : Register r8 information: slab kmalloc-512 start c4dff200 pointer offset 4 size 512
    2023-04-14T13:22:56.175931  kern  :alert : Register r9 information: non-paged memory
    2023-04-14T13:22:56.176495  kern  :alert : Register r10 information: NULL pointer
    2023-04-14T13:22:56.176990  kern  :alert : Register r11 information: 5-page vmalloc region starting at 0xbf3e2000 allocated at load_module+0x898/0x1b10
    2023-04-14T13:22:56.186525  kern  :alert : Register r12 information: non-paged memory
    2023-04-14T13:22:56.271331  kern  :emerg : Internal error: Oops: 17 [#1] PREEMPT ARM
    2023-04-14T13:22:56.272550  kern  :emerg : Process udevd (pid: 69, stack limit = 0x2f6f55ae)
    2023-04-14T13:22:56.273205  kern  :emerg : Stack: (0xc8915cf8 to 0xc8916000) 
    ... (8 line(s) more)  

  * baseline.dmesg.alert: https://kernelci.org/test/case/id/643953c4848cad0fc92e8617
        failing since 445 days (last pass: v5.16-11577-gffd79fec234d, first fail: v5.17-rc1-180-g86539e2bdb99)
        18 lines

    2023-04-14T13:22:56.080487  kern  :alert : BUG: Bad page state in process kworker/u2:0  pfn:c3400
    2023-04-14T13:22:56.081729  kern  :alert : BUG: Bad page state in process kworker/u2:0  pfn:c3800
    2023-04-14T13:22:56.082173  kern  :alert : 8<--- cut here ---
    2023-04-14T13:22:56.082593  kern  :alert : Unable to handle kernel NULL pointer dereference at virtual address 00000060 when read
    2023-04-14T13:22:56.082954  kern  :alert : [00000060] *pgd=c4a3b831, *pte=00000000, *ppte=00000000
    2023-04-14T13:22:56.083294  kern  :alert : Register r0 information: non-paged memory
    2023-04-14T13:22:56.123521  kern  :alert : Register r1 information: 2-page vmalloc region starting at 0xc8914000 allocated at kernel_clone+0x98/0x3a0
    2023-04-14T13:22:56.124452  kern  :alert : Register r2 information: non-slab/vmalloc memory
    2023-04-14T13:22:56.124903  kern  :alert : Register r3 information: non-paged memory
    2023-04-14T13:22:56.125272  kern  :alert : R<8><LAVA_SIGNAL_TESTCASE TEST_CASE_ID=alert RESULT=fail UNITS=lines MEASUREMENT=18> 
    ... (2 line(s) more)  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
fsl-ls1088a-rdb              | arm64  | lab-nxp         | gcc-10   | defconfig+debug              | 1          

  Details:     https://kernelci.org/test/plan/id/643957f3e3bf1d6dd42e86a8

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+debug
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm64/defconfig+debug/gcc-10/lab-nxp/baseline-fsl-ls1088a-rdb.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm64/defconfig+debug/gcc-10/lab-nxp/baseline-fsl-ls1088a-rdb.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230407.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/643957f3e3bf1d6dd42e86a9
        failing since 109 days (last pass: v6.1-rc6-391-gf445421fe4c7, first fail: v6.2-rc1-87-g81c29d2c4600) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
hp-11A-G6-EE-grunt           | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...6-chromebook | 1          

  Details:     https://kernelci.org/test/plan/id/64395244668c2a38052e862f

  Results:     18 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/x86_64/x86_64_defconfig+x86-chromebook/gcc-10/lab-collabora/baseline-hp-11A-G6-EE-grunt.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/x86_64/x86_64_defconfig+x86-chromebook/gcc-10/lab-collabora/baseline-hp-11A-G6-EE-grunt.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230407.0/x86/rootfs.cpio.gz 

  * baseline.bootrr.tpm-chip-is-online: https://kernelci.org/test/case/id/64395244668c2a38052e863e
        new failure (last pass: v6.3-rc6-249-g122e82851461)

    2023-04-14T13:16:28.971707  /usr/bin/tpm2_getcap

    2023-04-14T13:16:39.178101  /lava-9977874/1/../bin/lava-test-case

    2023-04-14T13:16:39.185276  <8>[   20.465098] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=tpm-chip-is-online RESULT=fail>

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
hp-x360-12b-c...4020-octopus | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...ok+kselftest | 1          

  Details:     https://kernelci.org/test/plan/id/6439531f50b02f45f82e85fb

  Results:     6 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook+kselftest
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/x86_64/x86_64_defconfig+x86-chromebook+kselftest/gcc-10/lab-collabora/baseline-hp-x360-12b-ca0010nr-n4020-octopus.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/x86_64/x86_64_defconfig+x86-chromebook+kselftest/gcc-10/lab-collabora/baseline-hp-x360-12b-ca0010nr-n4020-octopus.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230407.0/x86/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6439531f50b02f45f82e8600
        failing since 14 days (last pass: v6.3-rc3-550-g902f54bbd6c7, first fail: v6.3-rc4-334-g60f00557d56b)

    2023-04-14T13:20:09.534293  + set +x

    2023-04-14T13:20:09.541170  <8>[   15.869814] <LAVA_SIGNAL_ENDRUN 0_dmesg 9977600_1.4.2.3.1>

    2023-04-14T13:20:09.650314  / # #

    2023-04-14T13:20:09.753312  export SHELL=/bin/sh

    2023-04-14T13:20:09.754076  #

    2023-04-14T13:20:09.856117  / # export SHELL=/bin/sh. /lava-9977600/environment

    2023-04-14T13:20:09.856913  

    2023-04-14T13:20:09.958782  / # . /lava-9977600/environment/lava-9977600/bin/lava-test-runner /lava-9977600/1

    2023-04-14T13:20:09.959115  

    2023-04-14T13:20:09.964215  / # /lava-9977600/bin/lava-test-runner /lava-9977600/1
 
    ... (12 line(s) more)  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
hp-x360-12b-c...4020-octopus | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...6-chromebook | 1          

  Details:     https://kernelci.org/test/plan/id/643953d3ed5fbb41132e8642

  Results:     6 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/x86_64/x86_64_defconfig+x86-chromebook/gcc-10/lab-collabora/baseline-hp-x360-12b-ca0010nr-n4020-octopus.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/x86_64/x86_64_defconfig+x86-chromebook/gcc-10/lab-collabora/baseline-hp-x360-12b-ca0010nr-n4020-octopus.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230407.0/x86/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/643953d3ed5fbb41132e8647
        failing since 16 days (last pass: v6.3-rc3-370-g8269040171a02, first fail: v6.3-rc4-214-g39ee5bf6e049)

    2023-04-14T13:23:18.220804  + set +x

    2023-04-14T13:23:18.227331  <8>[   10.786371] <LAVA_SIGNAL_ENDRUN 0_dmesg 9977869_1.4.2.3.1>

    2023-04-14T13:23:18.334307  / # #

    2023-04-14T13:23:18.436709  export SHELL=/bin/sh

    2023-04-14T13:23:18.437316  #

    2023-04-14T13:23:18.539100  / # export SHELL=/bin/sh. /lava-9977869/environment

    2023-04-14T13:23:18.539627  

    2023-04-14T13:23:18.641290  / # . /lava-9977869/environment/lava-9977869/bin/lava-test-runner /lava-9977869/1

    2023-04-14T13:23:18.642294  

    2023-04-14T13:23:18.647646  / # /lava-9977869/bin/lava-test-runner /lava-9977869/1
 
    ... (12 line(s) more)  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
hp-x360-12b-c...4020-octopus | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...ebook+amdgpu | 1          

  Details:     https://kernelci.org/test/plan/id/643954877fca28be922e8640

  Results:     6 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook+amdgpu
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/x86_64/x86_64_defconfig+x86-chromebook+amdgpu/gcc-10/lab-collabora/baseline-hp-x360-12b-ca0010nr-n4020-octopus.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/x86_64/x86_64_defconfig+x86-chromebook+amdgpu/gcc-10/lab-collabora/baseline-hp-x360-12b-ca0010nr-n4020-octopus.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230407.0/x86/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/643954877fca28be922e8645
        failing since 16 days (last pass: v6.3-rc3-550-g902f54bbd6c7, first fail: v6.3-rc4-214-g39ee5bf6e049)

    2023-04-14T13:26:25.118356  + set +x

    2023-04-14T13:26:25.124894  <8>[   10.627077] <LAVA_SIGNAL_ENDRUN 0_dmesg 9978106_1.4.2.3.1>

    2023-04-14T13:26:25.233423  / # #

    2023-04-14T13:26:25.336026  export SHELL=/bin/sh

    2023-04-14T13:26:25.336756  #

    2023-04-14T13:26:25.438498  / # export SHELL=/bin/sh. /lava-9978106/environment

    2023-04-14T13:26:25.439214  

    2023-04-14T13:26:25.541038  / # . /lava-9978106/environment/lava-9978106/bin/lava-test-runner /lava-9978106/1

    2023-04-14T13:26:25.542229  

    2023-04-14T13:26:25.546479  / # /lava-9978106/bin/lava-test-runner /lava-9978106/1
 
    ... (12 line(s) more)  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
hp-x360-14-G1-sona           | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...ok+kselftest | 1          

  Details:     https://kernelci.org/test/plan/id/643951910127d6eadb2e85f4

  Results:     6 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook+kselftest
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/x86_64/x86_64_defconfig+x86-chromebook+kselftest/gcc-10/lab-collabora/baseline-hp-x360-14-G1-sona.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/x86_64/x86_64_defconfig+x86-chromebook+kselftest/gcc-10/lab-collabora/baseline-hp-x360-14-G1-sona.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230407.0/x86/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/643951910127d6eadb2e85f9
        failing since 14 days (last pass: v6.3-rc3-550-g902f54bbd6c7, first fail: v6.3-rc4-334-g60f00557d56b)

    2023-04-14T13:13:41.625747  + set<8>[   11.487515] <LAVA_SIGNAL_ENDRUN 0_dmesg 9977580_1.4.2.3.1>

    2023-04-14T13:13:41.625898   +x

    2023-04-14T13:13:41.731216  / # #

    2023-04-14T13:13:41.833630  export SHELL=/bin/sh

    2023-04-14T13:13:41.834471  #

    2023-04-14T13:13:41.936354  / # export SHELL=/bin/sh. /lava-9977580/environment

    2023-04-14T13:13:41.937068  

    2023-04-14T13:13:42.038790  / # . /lava-9977580/environment/lava-9977580/bin/lava-test-runner /lava-9977580/1

    2023-04-14T13:13:42.039954  

    2023-04-14T13:13:42.044646  / # /lava-9977580/bin/lava-test-runner /lava-9977580/1
 
    ... (12 line(s) more)  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
hp-x360-14-G1-sona           | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...6-chromebook | 1          

  Details:     https://kernelci.org/test/plan/id/6439523087d8672be82e85eb

  Results:     6 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/x86_64/x86_64_defconfig+x86-chromebook/gcc-10/lab-collabora/baseline-hp-x360-14-G1-sona.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/x86_64/x86_64_defconfig+x86-chromebook/gcc-10/lab-collabora/baseline-hp-x360-14-G1-sona.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230407.0/x86/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6439523087d8672be82e85f0
        failing since 16 days (last pass: v6.3-rc3-370-g8269040171a02, first fail: v6.3-rc4-214-g39ee5bf6e049)

    2023-04-14T13:16:21.609111  + set +x

    2023-04-14T13:16:21.616001  <8>[   10.633804] <LAVA_SIGNAL_ENDRUN 0_dmesg 9977877_1.4.2.3.1>

    2023-04-14T13:16:21.718598  

    2023-04-14T13:16:21.819636  / # #export SHELL=/bin/sh

    2023-04-14T13:16:21.819878  

    2023-04-14T13:16:21.920915  / # export SHELL=/bin/sh. /lava-9977877/environment

    2023-04-14T13:16:21.921122  

    2023-04-14T13:16:22.022092  / # . /lava-9977877/environment/lava-9977877/bin/lava-test-runner /lava-9977877/1

    2023-04-14T13:16:22.022372  

    2023-04-14T13:16:22.028101  / # /lava-9977877/bin/lava-test-runner /lava-9977877/1
 
    ... (12 line(s) more)  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
hp-x360-14-G1-sona           | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...ebook+amdgpu | 1          

  Details:     https://kernelci.org/test/plan/id/6439549492a20449d32e85fd

  Results:     6 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook+amdgpu
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/x86_64/x86_64_defconfig+x86-chromebook+amdgpu/gcc-10/lab-collabora/baseline-hp-x360-14-G1-sona.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/x86_64/x86_64_defconfig+x86-chromebook+amdgpu/gcc-10/lab-collabora/baseline-hp-x360-14-G1-sona.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230407.0/x86/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6439549492a20449d32e8602
        failing since 16 days (last pass: v6.3-rc3-550-g902f54bbd6c7, first fail: v6.3-rc4-214-g39ee5bf6e049)

    2023-04-14T13:26:31.860716  <8>[   10.018510] <LAVA_SIGNAL_ENDRUN 0_dmesg 9978120_1.4.2.3.1>

    2023-04-14T13:26:31.864434  + set +x

    2023-04-14T13:26:31.966129  #

    2023-04-14T13:26:32.067330  / # #export SHELL=/bin/sh

    2023-04-14T13:26:32.067539  

    2023-04-14T13:26:32.168405  / # export SHELL=/bin/sh. /lava-9978120/environment

    2023-04-14T13:26:32.168631  

    2023-04-14T13:26:32.269617  / # . /lava-9978120/environment/lava-9978120/bin/lava-test-runner /lava-9978120/1

    2023-04-14T13:26:32.269941  

    2023-04-14T13:26:32.315232  / # /lava-9978120/bin/lava-test-runner /lava-9978120/1
 
    ... (12 line(s) more)  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
hp-x360-14a-cb0001xx-zork    | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...ok+kselftest | 1          

  Details:     https://kernelci.org/test/plan/id/643950dddfb68bf1e82e8615

  Results:     5 PASS, 2 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook+kselftest
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/x86_64/x86_64_defconfig+x86-chromebook+kselftest/gcc-10/lab-collabora/baseline-hp-x360-14a-cb0001xx-zork.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/x86_64/x86_64_defconfig+x86-chromebook+kselftest/gcc-10/lab-collabora/baseline-hp-x360-14a-cb0001xx-zork.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230407.0/x86/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/643950dddfb68bf1e82e861a
        failing since 14 days (last pass: v6.3-rc3-550-g902f54bbd6c7, first fail: v6.3-rc4-334-g60f00557d56b)

    2023-04-14T13:10:34.315761  + set +x

    2023-04-14T13:10:34.319247  <8>[   14.835012] <LAVA_SIGNAL_ENDRUN 0_dmesg 9977608_1.4.2.3.1>

    2023-04-14T13:10:34.428681  / # #

    2023-04-14T13:10:34.529954  export SHELL=/bin/sh

    2023-04-14T13:10:34.530234  #

    2023-04-14T13:10:34.631157  / # export SHELL=/bin/sh. /lava-9977608/environment

    2023-04-14T13:10:34.631486  

    2023-04-14T13:10:34.732490  / # . /lava-9977608/environment/lava-9977608/bin/lava-test-runner /lava-9977608/1

    2023-04-14T13:10:34.732845  

    2023-04-14T13:10:34.737436  / # /lava-9977608/bin/lava-test-runner /lava-9977608/1
 
    ... (12 line(s) more)  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
hp-x360-14a-cb0001xx-zork    | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...6-chromebook | 1          

  Details:     https://kernelci.org/test/plan/id/64395231668c2a38052e85fd

  Results:     6 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/x86_64/x86_64_defconfig+x86-chromebook/gcc-10/lab-collabora/baseline-hp-x360-14a-cb0001xx-zork.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/x86_64/x86_64_defconfig+x86-chromebook/gcc-10/lab-collabora/baseline-hp-x360-14a-cb0001xx-zork.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230407.0/x86/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/64395231668c2a38052e8602
        failing since 16 days (last pass: v6.3-rc3-370-g8269040171a02, first fail: v6.3-rc4-214-g39ee5bf6e049)

    2023-04-14T13:16:16.729074  + set +x<8>[   11.268999] <LAVA_SIGNAL_ENDRUN 0_dmesg 9977862_1.4.2.3.1>

    2023-04-14T13:16:16.729158  

    2023-04-14T13:16:16.834060  / # #

    2023-04-14T13:16:16.935193  export SHELL=/bin/sh

    2023-04-14T13:16:16.935447  #

    2023-04-14T13:16:17.036396  / # export SHELL=/bin/sh. /lava-9977862/environment

    2023-04-14T13:16:17.036600  

    2023-04-14T13:16:17.137403  / # . /lava-9977862/environment/lava-9977862/bin/lava-test-runner /lava-9977862/1

    2023-04-14T13:16:17.137702  

    2023-04-14T13:16:17.142858  / # /lava-9977862/bin/lava-test-runner /lava-9977862/1
 
    ... (12 line(s) more)  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
hp-x360-14a-cb0001xx-zork    | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...ebook+amdgpu | 1          

  Details:     https://kernelci.org/test/plan/id/6439549f92a20449d32e863a

  Results:     6 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook+amdgpu
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/x86_64/x86_64_defconfig+x86-chromebook+amdgpu/gcc-10/lab-collabora/baseline-hp-x360-14a-cb0001xx-zork.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/x86_64/x86_64_defconfig+x86-chromebook+amdgpu/gcc-10/lab-collabora/baseline-hp-x360-14a-cb0001xx-zork.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230407.0/x86/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6439549f92a20449d32e863f
        failing since 16 days (last pass: v6.3-rc3-550-g902f54bbd6c7, first fail: v6.3-rc4-214-g39ee5bf6e049)

    2023-04-14T13:26:47.284250  + <8>[   10.959407] <LAVA_SIGNAL_ENDRUN 0_dmesg 9978139_1.4.2.3.1>

    2023-04-14T13:26:47.284333  set +x

    2023-04-14T13:26:47.388828  / # #

    2023-04-14T13:26:47.489811  export SHELL=/bin/sh

    2023-04-14T13:26:47.490007  #

    2023-04-14T13:26:47.590892  / # export SHELL=/bin/sh. /lava-9978139/environment

    2023-04-14T13:26:47.591169  

    2023-04-14T13:26:47.692080  / # . /lava-9978139/environment/lava-9978139/bin/lava-test-runner /lava-9978139/1

    2023-04-14T13:26:47.692385  

    2023-04-14T13:26:47.696896  / # /lava-9978139/bin/lava-test-runner /lava-9978139/1
 
    ... (12 line(s) more)  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
imx6dl-udoo                  | arm    | lab-broonie     | gcc-10   | multi_v7_defconfig+crypto    | 2          

  Details:     https://kernelci.org/test/plan/id/643955ebf5ff8d39a32e8606

  Results:     29 PASS, 4 FAIL, 1 SKIP
  Full config: multi_v7_defconfig+crypto
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm/multi_v7_defconfig+crypto/gcc-10/lab-broonie/baseline-imx6dl-udoo.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm/multi_v7_defconfig+crypto/gcc-10/lab-broonie/baseline-imx6dl-udoo.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230407.0/armel/rootfs.cpio.gz 

  * baseline.bootrr.sound-card: https://kernelci.org/test/case/id/643955ebf5ff8d39a32e860d
        new failure (last pass: v6.3-rc6-249-g122e82851461)

    2023-04-14T13:32:13.884533  /lava-328814/1/../bin/lava-test-case
    2023-04-14T13:32:13.913357  <8>[   38.057109] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=sound-card RESULT=fail>   

  * baseline.bootrr.sound-card-probed: https://kernelci.org/test/case/id/643955ebf5ff8d39a32e860e
        new failure (last pass: v6.3-rc6-249-g122e82851461)

    2023-04-14T13:32:12.840130  /lava-328814/1/../bin/lava-test-case
    2023-04-14T13:32:12.862163  <8>[   37.005198] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=sound-card-probed RESULT=fail>   

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
imx6qp-wandboard-revd1       | arm    | lab-pengutronix | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/64395cb8b6a12cee642e86e2

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm/multi_v7_defconfig+debug/gcc-10/lab-pengutronix/baseline-imx6qp-wandboard-revd1.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm/multi_v7_defconfig+debug/gcc-10/lab-pengutronix/baseline-imx6qp-wandboard-revd1.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230407.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64395cb8b6a12cee642e86e3
        failing since 211 days (last pass: v6.0-rc4-291-g83a56f559828, first fail: v6.0-rc5-197-ga6a750a2f4166) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
imx6ul-14x14-evk             | arm    | lab-nxp         | gcc-10   | multi_v7_defconfig+crypto    | 1          

  Details:     https://kernelci.org/test/plan/id/6439575f6ac3e009782e866d

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: multi_v7_defconfig+crypto
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm/multi_v7_defconfig+crypto/gcc-10/lab-nxp/baseline-imx6ul-14x14-evk.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm/multi_v7_defconfig+crypto/gcc-10/lab-nxp/baseline-imx6ul-14x14-evk.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230407.0/armel/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6439575f6ac3e009782e8672
        failing since 99 days (last pass: v6.1-rc4-339-g185da88d03ed, first fail: v6.2-rc2-332-g2d3ca5d07c8e)

    2023-04-14T13:38:16.817543  + set +x
    2023-04-14T13:38:16.818673  <8>[   57.441638] <LAVA_SIGNAL_ENDRUN 0_dmesg 1200110_1.5.2.4.1>
    2023-04-14T13:38:16.928744  
    2023-04-14T13:38:18.088159  / # #export SHELL=/bin/sh
    2023-04-14T13:38:18.093805  
    2023-04-14T13:38:19.640458  / # export SHELL=/bin/sh. /lava-1200110/environment
    2023-04-14T13:38:19.646103  
    2023-04-14T13:38:22.466242  / # . /lava-1200110/environment/lava-1200110/bin/lava-test-runner /lava-1200110/1
    2023-04-14T13:38:22.472484  
    2023-04-14T13:38:22.473111  / # /lava-1200110/bin/lava-test-runner /lava-1200110/1 
    ... (18 line(s) more)  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
imx7d-sdb                    | arm    | lab-nxp         | gcc-10   | multi_v7_defconfig+crypto    | 1          

  Details:     https://kernelci.org/test/plan/id/643955ba38ca178e082e85f5

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: multi_v7_defconfig+crypto
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm/multi_v7_defconfig+crypto/gcc-10/lab-nxp/baseline-imx7d-sdb.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm/multi_v7_defconfig+crypto/gcc-10/lab-nxp/baseline-imx7d-sdb.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230407.0/armel/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/643955ba38ca178e082e85fa
        failing since 99 days (last pass: v6.1-rc6-391-gf445421fe4c7, first fail: v6.2-rc2-332-g2d3ca5d07c8e)

    2023-04-14T13:31:13.624262  / # #
    2023-04-14T13:31:14.784566  export SHELL=/bin/sh
    2023-04-14T13:31:14.790249  #
    2023-04-14T13:31:16.337839  / # export SHELL=/bin/sh. /lava-1200112/environment
    2023-04-14T13:31:16.343541  
    2023-04-14T13:31:19.165020  / # . /lava-1200112/environment/lava-1200112/bin/lava-test-runner /lava-1200112/1
    2023-04-14T13:31:19.171107  
    2023-04-14T13:31:19.177808  / # /lava-1200112/bin/lava-test-runner /lava-1200112/1
    2023-04-14T13:31:19.266927  + export 'TESTRUN_ID=1_bootrr'
    2023-04-14T13:31:19.267287  + cd /lava-1200112/1/tests/1_bootrr 
    ... (21 line(s) more)  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
imx7ulp-evk                  | arm    | lab-nxp         | gcc-10   | multi_v7_defconfig+crypto    | 1          

  Details:     https://kernelci.org/test/plan/id/643957ac475d01fb552e8611

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: multi_v7_defconfig+crypto
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm/multi_v7_defconfig+crypto/gcc-10/lab-nxp/baseline-imx7ulp-evk.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm/multi_v7_defconfig+crypto/gcc-10/lab-nxp/baseline-imx7ulp-evk.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230407.0/armel/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/643957ac475d01fb552e8616
        failing since 99 days (last pass: v6.1-rc6-391-gf445421fe4c7, first fail: v6.2-rc2-332-g2d3ca5d07c8e)

    2023-04-14T13:39:13.398805  + set +x
    2023-04-14T13:39:13.399874  <8>[   66.956379] <LAVA_SIGNAL_ENDRUN 0_dmesg 1200111_1.5.2.4.1>
    2023-04-14T13:39:13.508375  / # #
    2023-04-14T13:39:14.667991  export SHELL=/bin/sh
    2023-04-14T13:39:14.673717  #
    2023-04-14T13:39:14.674034  / # export SHELL=/bin/sh
    2023-04-14T13:39:16.221283  / # . /lava-1200111/environment
    2023-04-14T13:39:19.047700  /lava-1200111/bin/lava-test-runner /lava-1200111/1
    2023-04-14T13:39:19.053812  . /lava-1200111/environment
    2023-04-14T13:39:19.054095  / # /lava-1200111/bin/lava-test-runner /lava-1200111/1 
    ... (12 line(s) more)  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
jetson-tk1                   | arm    | lab-baylibre    | gcc-10   | multi_v7_defc...G_ARM_LPAE=y | 1          

  Details:     https://kernelci.org/test/plan/id/643955f5535db898bc2e8648

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm/multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y/gcc-10/lab-baylibre/baseline-jetson-tk1.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm/multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y/gcc-10/lab-baylibre/baseline-jetson-tk1.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230407.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/643955f5535db898bc2e8649
        failing since 349 days (last pass: v5.18-rc2-366-ga3e1163f7eb1a, first fail: v5.18-rc4-464-g425675974eb3) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
jh7100-starfi...isionfive-v1 | riscv  | lab-clabbe      | gcc-10   | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/6439560ac06009f3032e85ea

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (riscv64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/riscv/defconfig+kselftest/gcc-10/lab-clabbe/baseline-jh7100-starfive-visionfive-v1.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/riscv/defconfig+kselftest/gcc-10/lab-clabbe/baseline-jh7100-starfive-visionfive-v1.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230407.0/riscv/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6439560ac06009f3032e85eb
        failing since 66 days (last pass: v6.2-rc7-120-g11b3628314a5, first fail: v6.2-rc7-136-g39693c3ba989) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
lenovo-TPad-C13-Yoga-zork    | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...ok+kselftest | 1          

  Details:     https://kernelci.org/test/plan/id/643950de01894c499a2e85e6

  Results:     6 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook+kselftest
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/x86_64/x86_64_defconfig+x86-chromebook+kselftest/gcc-10/lab-collabora/baseline-lenovo-TPad-C13-Yoga-zork.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/x86_64/x86_64_defconfig+x86-chromebook+kselftest/gcc-10/lab-collabora/baseline-lenovo-TPad-C13-Yoga-zork.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230407.0/x86/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/643950de01894c499a2e85eb
        failing since 14 days (last pass: v6.3-rc3-550-g902f54bbd6c7, first fail: v6.3-rc4-334-g60f00557d56b)

    2023-04-14T13:10:30.699373  + set<8>[   13.800113] <LAVA_SIGNAL_ENDRUN 0_dmesg 9977615_1.4.2.3.1>

    2023-04-14T13:10:30.699460   +x

    2023-04-14T13:10:30.804516  / # #

    2023-04-14T13:10:30.905486  export SHELL=/bin/sh

    2023-04-14T13:10:30.905683  #

    2023-04-14T13:10:31.006449  / # export SHELL=/bin/sh. /lava-9977615/environment

    2023-04-14T13:10:31.006609  

    2023-04-14T13:10:31.107495  / # . /lava-9977615/environment/lava-9977615/bin/lava-test-runner /lava-9977615/1

    2023-04-14T13:10:31.107770  

    2023-04-14T13:10:31.112343  / # /lava-9977615/bin/lava-test-runner /lava-9977615/1
 
    ... (12 line(s) more)  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
lenovo-TPad-C13-Yoga-zork    | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...6-chromebook | 1          

  Details:     https://kernelci.org/test/plan/id/6439522f81212053bf2e863d

  Results:     6 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/x86_64/x86_64_defconfig+x86-chromebook/gcc-10/lab-collabora/baseline-lenovo-TPad-C13-Yoga-zork.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/x86_64/x86_64_defconfig+x86-chromebook/gcc-10/lab-collabora/baseline-lenovo-TPad-C13-Yoga-zork.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230407.0/x86/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6439522f81212053bf2e8642
        failing since 16 days (last pass: v6.3-rc3-370-g8269040171a02, first fail: v6.3-rc4-214-g39ee5bf6e049)

    2023-04-14T13:16:17.417901  <8>[   11.417111] <LAVA_SIGNAL_ENDRUN 0_dmesg 9977879_1.4.2.3.1>

    2023-04-14T13:16:17.522478  / # #

    2023-04-14T13:16:17.623559  export SHELL=/bin/sh

    2023-04-14T13:16:17.623772  #

    2023-04-14T13:16:17.724680  / # export SHELL=/bin/sh. /lava-9977879/environment

    2023-04-14T13:16:17.724878  

    2023-04-14T13:16:17.825770  / # . /lava-9977879/environment/lava-9977879/bin/lava-test-runner /lava-9977879/1

    2023-04-14T13:16:17.826040  

    2023-04-14T13:16:17.830526  / # /lava-9977879/bin/lava-test-runner /lava-9977879/1

    2023-04-14T13:16:17.837138  + export 'TESTRUN_ID=1_bootrr'
 
    ... (11 line(s) more)  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
lenovo-TPad-C13-Yoga-zork    | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...ebook+amdgpu | 1          

  Details:     https://kernelci.org/test/plan/id/6439549b7fca28be922e8688

  Results:     6 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook+amdgpu
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/x86_64/x86_64_defconfig+x86-chromebook+amdgpu/gcc-10/lab-collabora/baseline-lenovo-TPad-C13-Yoga-zork.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/x86_64/x86_64_defconfig+x86-chromebook+amdgpu/gcc-10/lab-collabora/baseline-lenovo-TPad-C13-Yoga-zork.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230407.0/x86/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6439549b7fca28be922e868d
        failing since 16 days (last pass: v6.3-rc3-550-g902f54bbd6c7, first fail: v6.3-rc4-214-g39ee5bf6e049)

    2023-04-14T13:26:40.535073  <8>[   11.375077] <LAVA_SIGNAL_ENDRUN 0_dmesg 9978134_1.4.2.3.1>

    2023-04-14T13:26:40.644148  / # #

    2023-04-14T13:26:40.747052  export SHELL=/bin/sh

    2023-04-14T13:26:40.747775  #

    2023-04-14T13:26:40.849632  / # export SHELL=/bin/sh. /lava-9978134/environment

    2023-04-14T13:26:40.850320  

    2023-04-14T13:26:40.952134  / # . /lava-9978134/environment/lava-9978134/bin/lava-test-runner /lava-9978134/1

    2023-04-14T13:26:40.952470  

    2023-04-14T13:26:40.957303  / # /lava-9978134/bin/lava-test-runner /lava-9978134/1

    2023-04-14T13:26:40.964148  + export 'TESTRUN_ID=1_bootrr'
 
    ... (11 line(s) more)  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
meson-g12a-sei510            | arm64  | lab-baylibre    | gcc-10   | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/64395909e09a5bfbb62e85e7

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-g12a-sei510.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-g12a-sei510.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230407.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64395909e09a5bfbb62e85e8
        failing since 66 days (last pass: v6.2-rc7-120-g11b3628314a5, first fail: v6.2-rc7-136-g39693c3ba989) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
meson-g12a-u200              | arm64  | lab-baylibre    | gcc-10   | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/64395ba0aff4a487442e85e7

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-g12a-u200.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-g12a-u200.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230407.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64395ba0aff4a487442e85e8
        failing since 66 days (last pass: v6.2-rc7-120-g11b3628314a5, first fail: v6.2-rc7-136-g39693c3ba989) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
meson-g12a-x96-max           | arm64  | lab-baylibre    | gcc-10   | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/64395bfad942ba91b12e85ed

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-g12a-x96-max.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-g12a-x96-max.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230407.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64395bfad942ba91b12e85ee
        failing since 66 days (last pass: v6.2-rc7-120-g11b3628314a5, first fail: v6.2-rc7-136-g39693c3ba989) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
meson-g12b-a311d-khadas-vim3 | arm64  | lab-baylibre    | gcc-10   | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/64395b63413cfcf81f2e85e7

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-g12b-a311d-khadas-vim3.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-g12b-a311d-khadas-vim3.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230407.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64395b63413cfcf81f2e85e8
        failing since 66 days (last pass: v6.2-rc7-120-g11b3628314a5, first fail: v6.2-rc7-136-g39693c3ba989) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
meson-g12b-a311d-khadas-vim3 | arm64  | lab-collabora   | gcc-10   | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/643958c0efc924ec632e85ef

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm64/defconfig+kselftest/gcc-10/lab-collabora/baseline-meson-g12b-a311d-khadas-vim3.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm64/defconfig+kselftest/gcc-10/lab-collabora/baseline-meson-g12b-a311d-khadas-vim3.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230407.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/643958c0efc924ec632e85f0
        failing since 66 days (last pass: v6.2-rc7-120-g11b3628314a5, first fail: v6.2-rc7-136-g39693c3ba989) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
meson-g12b-odroid-n2         | arm64  | lab-baylibre    | gcc-10   | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/643959f8baaa4008ce2e8604

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-g12b-odroid-n2.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-g12b-odroid-n2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230407.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/643959f8baaa4008ce2e8605
        failing since 53 days (last pass: v6.2-rc8-150-g30cd52e17d48, first fail: v6.2-rc8-211-g05def2d212c6) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
meson-gxbb-nanopi-k2         | arm64  | lab-baylibre    | gcc-10   | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/64395923f5bf45e9ff2e885e

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-gxbb-nanopi-k2.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-gxbb-nanopi-k2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230407.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64395923f5bf45e9ff2e885f
        failing since 66 days (last pass: v6.2-rc7-120-g11b3628314a5, first fail: v6.2-rc7-136-g39693c3ba989) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
meson-gxl-s905d-p230         | arm64  | lab-baylibre    | gcc-10   | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/64395af0d32be760572e85f1

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-gxl-s905d-p230.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-gxl-s905d-p230.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230407.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64395af0d32be760572e85f2
        failing since 66 days (last pass: v6.2-rc6-351-gf42837eac380f, first fail: v6.2-rc7-136-g39693c3ba989) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
meson-gxl-s905x-khadas-vim   | arm64  | lab-baylibre    | gcc-10   | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/643959396100eb866b2e85ec

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-gxl-s905x-khadas-vim.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-gxl-s905x-khadas-vim.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230407.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/643959396100eb866b2e85ed
        failing since 66 days (last pass: v6.2-rc7-120-g11b3628314a5, first fail: v6.2-rc7-136-g39693c3ba989) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
meson-gxl-s905x-libretech-cc | arm64  | lab-baylibre    | gcc-10   | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/64395a8cdebd5c72132e8779

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-gxl-s905x-libretech-cc.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-gxl-s905x-libretech-cc.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230407.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64395a8cdebd5c72132e877a
        failing since 66 days (last pass: v6.2-rc7-120-g11b3628314a5, first fail: v6.2-rc7-136-g39693c3ba989) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
meson-gxl-s905x-libretech-cc | arm64  | lab-broonie     | gcc-10   | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/643958940d05fd2eb62e864f

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm64/defconfig+kselftest/gcc-10/lab-broonie/baseline-meson-gxl-s905x-libretech-cc.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm64/defconfig+kselftest/gcc-10/lab-broonie/baseline-meson-gxl-s905x-libretech-cc.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230407.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/643958940d05fd2eb62e8650
        failing since 66 days (last pass: v6.2-rc7-120-g11b3628314a5, first fail: v6.2-rc7-136-g39693c3ba989) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
meson-gxl-s905x-libretech-cc | arm64  | lab-clabbe      | gcc-10   | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/64395a2b2b8d286cb32e863d

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm64/defconfig+kselftest/gcc-10/lab-clabbe/baseline-meson-gxl-s905x-libretech-cc.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm64/defconfig+kselftest/gcc-10/lab-clabbe/baseline-meson-gxl-s905x-libretech-cc.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230407.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64395a2b2b8d286cb32e863e
        failing since 66 days (last pass: v6.2-rc7-120-g11b3628314a5, first fail: v6.2-rc7-136-g39693c3ba989) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
meson-gxm-khadas-vim2        | arm64  | lab-baylibre    | gcc-10   | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/64395925e09a5bfbb62e8603

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-gxm-khadas-vim2.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-gxm-khadas-vim2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230407.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64395925e09a5bfbb62e8604
        failing since 66 days (last pass: v6.2-rc7-120-g11b3628314a5, first fail: v6.2-rc7-136-g39693c3ba989) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
meson-sm1-khadas-vim3l       | arm64  | lab-baylibre    | gcc-10   | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/64395af6cb82f29c512e8613

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-sm1-khadas-vim3l.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-sm1-khadas-vim3l.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230407.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64395af6cb82f29c512e8614
        failing since 66 days (last pass: v6.2-rc7-120-g11b3628314a5, first fail: v6.2-rc7-136-g39693c3ba989) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
meson-sm1-sei610             | arm64  | lab-baylibre    | gcc-10   | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/6439583ecde822cea92e86d5

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-sm1-sei610.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-sm1-sei610.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230407.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6439583ecde822cea92e86d6
        failing since 66 days (last pass: v6.2-rc7-120-g11b3628314a5, first fail: v6.2-rc7-136-g39693c3ba989) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
mt8173-elm-hana              | arm64  | lab-collabora   | gcc-10   | defconfig+arm...ok+kselftest | 1          

  Details:     https://kernelci.org/test/plan/id/643954887fca28be922e8662

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm64/defconfig+arm64-chromebook+kselftest/gcc-10/lab-collabora/baseline-mt8173-elm-hana.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm64/defconfig+arm64-chromebook+kselftest/gcc-10/lab-collabora/baseline-mt8173-elm-hana.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230407.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/643954887fca28be922e8663
        failing since 80 days (last pass: v6.2-rc5-157-g1f16e03afb18, first fail: v6.2-rc5-174-gc5f142de047d) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
mt8183-kukui-...uniper-sku16 | arm64  | lab-collabora   | gcc-10   | defconfig+arm...ok+kselftest | 1          

  Details:     https://kernelci.org/test/plan/id/6439549f879aaa07262e8602

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm64/defconfig+arm64-chromebook+kselftest/gcc-10/lab-collabora/baseline-mt8183-kukui-jacuzzi-juniper-sku16.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm64/defconfig+arm64-chromebook+kselftest/gcc-10/lab-collabora/baseline-mt8183-kukui-jacuzzi-juniper-sku16.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230407.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6439549f879aaa07262e8603
        failing since 66 days (last pass: v6.2-rc7-120-g11b3628314a5, first fail: v6.2-rc7-136-g39693c3ba989) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
mt8183-kukui-...uniper-sku16 | arm64  | lab-collabora   | gcc-10   | defconfig+arm...ook+videodec | 3          

  Details:     https://kernelci.org/test/plan/id/643957a85293c820082e85fd

  Results:     166 PASS, 6 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook+videodec
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm64/defconfig+arm64-chromebook+videodec/gcc-10/lab-collabora/baseline-mt8183-kukui-jacuzzi-juniper-sku16.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm64/defconfig+arm64-chromebook+videodec/gcc-10/lab-collabora/baseline-mt8183-kukui-jacuzzi-juniper-sku16.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230407.0/arm64/rootfs.cpio.gz 

  * baseline.bootrr.panel-edp-probed: https://kernelci.org/test/case/id/643957a95293c820082e864d
        failing since 49 days (last pass: v6.2-1218-g2d4a54ee969d, first fail: v6.2-8700-gab98cc06b683)

    2023-04-14T13:39:41.090098  /lava-9978403/1/../bin/lava-test-case

    2023-04-14T13:39:41.096706  <8>[   23.373482] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=panel-edp-probed RESULT=fail>

  * baseline.bootrr.clk-mt8183-pericfg-probed: https://kernelci.org/test/case/id/643957a95293c820082e869e
        failing since 39 days (last pass: v6.2-8700-gab98cc06b683, first fail: v6.2-13684-gf93c476d9769)

    2023-04-14T13:39:38.211060  /lava-9978403/1/../bin/lava-test-case

    2023-04-14T13:39:38.221937  <8>[   20.495836] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=clk-mt8183-pericfg-probed RESULT=fail>

  * baseline.bootrr.clk-mt8183-infracfg-probed: https://kernelci.org/test/case/id/643957a95293c820082e869f
        failing since 39 days (last pass: v6.2-8700-gab98cc06b683, first fail: v6.2-13684-gf93c476d9769)

    2023-04-14T13:39:37.179978  /lava-9978403/1/../bin/lava-test-case

    2023-04-14T13:39:37.189964  <8>[   19.464380] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=clk-mt8183-infracfg-probed RESULT=fail>

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
mt8183-kukui-...uniper-sku16 | arm64  | lab-collabora   | gcc-10   | defconfig+arm64-chromebook   | 3          

  Details:     https://kernelci.org/test/plan/id/643958ac563ccc32ed2e85fc

  Results:     166 PASS, 6 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-mt8183-kukui-jacuzzi-juniper-sku16.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-mt8183-kukui-jacuzzi-juniper-sku16.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230407.0/arm64/rootfs.cpio.gz 

  * baseline.bootrr.panel-edp-probed: https://kernelci.org/test/case/id/643958ad563ccc32ed2e863c
        failing since 51 days (last pass: v6.2-rc8-211-g05def2d212c6, first fail: v6.2-3304-g34939120e353)

    2023-04-14T13:44:00.933889  /lava-9978487/1/../bin/lava-test-case

    2023-04-14T13:44:00.944949  <8>[   23.374843] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=panel-edp-probed RESULT=fail>

  * baseline.bootrr.clk-mt8183-pericfg-probed: https://kernelci.org/test/case/id/643958ad563ccc32ed2e868e
        failing since 46 days (last pass: v6.2-8700-gab98cc06b683, first fail: v6.2-12625-g13efc3a9f23b)

    2023-04-14T13:43:58.063218  /lava-9978487/1/../bin/lava-test-case

    2023-04-14T13:43:58.073749  <8>[   20.503740] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=clk-mt8183-pericfg-probed RESULT=fail>

  * baseline.bootrr.clk-mt8183-infracfg-probed: https://kernelci.org/test/case/id/643958ad563ccc32ed2e868f
        failing since 46 days (last pass: v6.2-8700-gab98cc06b683, first fail: v6.2-12625-g13efc3a9f23b)

    2023-04-14T13:43:57.036134  /lava-9978487/1/../bin/lava-test-case

    2023-04-14T13:43:57.046173  <8>[   19.475789] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=clk-mt8183-infracfg-probed RESULT=fail>

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
mt8192-asurada-spherion-r0   | arm64  | lab-collabora   | gcc-10   | defconfig+arm...ok+kselftest | 1          

  Details:     https://kernelci.org/test/plan/id/6439549dd9329ec9bd2e85f6

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm64/defconfig+arm64-chromebook+kselftest/gcc-10/lab-collabora/baseline-mt8192-asurada-spherion-r0.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm64/defconfig+arm64-chromebook+kselftest/gcc-10/lab-collabora/baseline-mt8192-asurada-spherion-r0.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230407.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6439549dd9329ec9bd2e85f7
        failing since 66 days (last pass: v6.2-rc7-120-g11b3628314a5, first fail: v6.2-rc7-136-g39693c3ba989) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
mt8192-asurada-spherion-r0   | arm64  | lab-collabora   | gcc-10   | defconfig+arm...ook+videodec | 3          

  Details:     https://kernelci.org/test/plan/id/643957be475d01fb552e861c

  Results:     177 PASS, 9 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook+videodec
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm64/defconfig+arm64-chromebook+videodec/gcc-10/lab-collabora/baseline-mt8192-asurada-spherion-r0.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm64/defconfig+arm64-chromebook+videodec/gcc-10/lab-collabora/baseline-mt8192-asurada-spherion-r0.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230407.0/arm64/rootfs.cpio.gz 

  * baseline.bootrr.clk-mt8192-pericfg-probed: https://kernelci.org/test/case/id/643957be475d01fb552e86ce
        failing since 42 days (last pass: v6.2-8700-gab98cc06b683, first fail: v6.2-13370-g5872d227b73f)

    2023-04-14T13:39:54.012509  /lava-9978407/1/../bin/lava-test-case

    2023-04-14T13:39:54.018579  <8>[   20.986369] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=clk-mt8192-pericfg-probed RESULT=fail>

  * baseline.bootrr.clk-mt8192-infracfg-probed: https://kernelci.org/test/case/id/643957be475d01fb552e86cf
        failing since 42 days (last pass: v6.2-8700-gab98cc06b683, first fail: v6.2-13370-g5872d227b73f)

    2023-04-14T13:39:52.992594  /lava-9978407/1/../bin/lava-test-case

    2023-04-14T13:39:52.999091  <8>[   19.966593] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=clk-mt8192-infracfg-probed RESULT=fail>

  * baseline.bootrr.clk-mt8192-topckgen-probed: https://kernelci.org/test/case/id/643957be475d01fb552e86d0
        failing since 42 days (last pass: v6.2-8700-gab98cc06b683, first fail: v6.2-13370-g5872d227b73f)

    2023-04-14T13:39:51.972457  /lava-9978407/1/../bin/lava-test-case

    2023-04-14T13:39:51.979325  <8>[   18.946773] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=clk-mt8192-topckgen-probed RESULT=fail>

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
mt8192-asurada-spherion-r0   | arm64  | lab-collabora   | gcc-10   | defconfig+arm64-chromebook   | 3          

  Details:     https://kernelci.org/test/plan/id/64395900ae0857e8692e86a9

  Results:     177 PASS, 9 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-mt8192-asurada-spherion-r0.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-mt8192-asurada-spherion-r0.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230407.0/arm64/rootfs.cpio.gz 

  * baseline.bootrr.clk-mt8192-pericfg-probed: https://kernelci.org/test/case/id/64395900ae0857e8692e875b
        failing since 46 days (last pass: v6.2-8700-gab98cc06b683, first fail: v6.2-12625-g13efc3a9f23b)

    2023-04-14T13:45:02.033853  /lava-9978479/1/../bin/lava-test-case

    2023-04-14T13:45:02.040372  <8>[   20.959269] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=clk-mt8192-pericfg-probed RESULT=fail>

  * baseline.bootrr.clk-mt8192-infracfg-probed: https://kernelci.org/test/case/id/64395900ae0857e8692e875c
        failing since 46 days (last pass: v6.2-8700-gab98cc06b683, first fail: v6.2-12625-g13efc3a9f23b)

    2023-04-14T13:45:01.013912  /lava-9978479/1/../bin/lava-test-case

    2023-04-14T13:45:01.020911  <8>[   19.939447] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=clk-mt8192-infracfg-probed RESULT=fail>

  * baseline.bootrr.clk-mt8192-topckgen-probed: https://kernelci.org/test/case/id/64395900ae0857e8692e875d
        failing since 46 days (last pass: v6.2-8700-gab98cc06b683, first fail: v6.2-12625-g13efc3a9f23b)

    2023-04-14T13:44:59.995013  /lava-9978479/1/../bin/lava-test-case

    2023-04-14T13:45:00.001014  <8>[   18.919700] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=clk-mt8192-topckgen-probed RESULT=fail>

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
ox820-clouden...lug-series-3 | arm    | lab-baylibre    | gcc-10   | oxnas_v6_defconfig           | 1          

  Details:     https://kernelci.org/test/plan/id/64395137fc75256a702e8601

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: oxnas_v6_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm/oxnas_v6_defconfig/gcc-10/lab-baylibre/baseline-ox820-cloudengines-pogoplug-series-3.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm/oxnas_v6_defconfig/gcc-10/lab-baylibre/baseline-ox820-cloudengines-pogoplug-series-3.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230407.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64395137fc75256a702e8602
        failing since 184 days (last pass: v6.0-9666-g02c05e0b8d5c, first fail: v6.0-11312-g1778d6da389c) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
qcom-qdf2400                 | arm64  | lab-linaro-lkft | gcc-10   | defconfig+arm...ok+kselftest | 1          

  Details:     https://kernelci.org/test/plan/id/643958b5551816ebe02e8616

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm64/defconfig+arm64-chromebook+kselftest/gcc-10/lab-linaro-lkft/baseline-qcom-qdf2400.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm64/defconfig+arm64-chromebook+kselftest/gcc-10/lab-linaro-lkft/baseline-qcom-qdf2400.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230407.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/643958b5551816ebe02e8617
        failing since 66 days (last pass: v6.2-rc7-120-g11b3628314a5, first fail: v6.2-rc7-136-g39693c3ba989) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
qcom-qdf2400                 | arm64  | lab-linaro-lkft | gcc-10   | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/64395f1ad27cc2262d2e85e6

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm64/defconfig+kselftest/gcc-10/lab-linaro-lkft/baseline-qcom-qdf2400.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm64/defconfig+kselftest/gcc-10/lab-linaro-lkft/baseline-qcom-qdf2400.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230407.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64395f1ad27cc2262d2e85e7
        failing since 66 days (last pass: v6.2-rc7-120-g11b3628314a5, first fail: v6.2-rc7-136-g39693c3ba989) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
qemu_arm-virt-gicv2          | arm    | lab-baylibre    | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/64395c5b2f1a032bd12e85fc

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm/multi_v7_defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_arm-virt-gicv2.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm/multi_v7_defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_arm-virt-gicv2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230407.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64395c5b2f1a032bd12e85fd
        failing since 184 days (last pass: v6.0-5324-g7871897dadfa9, first fail: v6.0-11312-g1778d6da389c) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
qemu_arm-virt-gicv2          | arm    | lab-broonie     | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/643962fff8d851bba82e86a3

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm/multi_v7_defconfig+debug/gcc-10/lab-broonie/baseline-qemu_arm-virt-gicv2.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm/multi_v7_defconfig+debug/gcc-10/lab-broonie/baseline-qemu_arm-virt-gicv2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230407.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/643962fff8d851bba82e86a4
        failing since 184 days (last pass: v6.0-5324-g7871897dadfa9, first fail: v6.0-11312-g1778d6da389c) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
qemu_arm-virt-gicv2          | arm    | lab-collabora   | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/64395c4bb9b3bd35162e866f

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm/multi_v7_defconfig+debug/gcc-10/lab-collabora/baseline-qemu_arm-virt-gicv2.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm/multi_v7_defconfig+debug/gcc-10/lab-collabora/baseline-qemu_arm-virt-gicv2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230407.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64395c4bb9b3bd35162e8670
        failing since 184 days (last pass: v6.0-5324-g7871897dadfa9, first fail: v6.0-11312-g1778d6da389c) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
qemu_arm-virt-gicv2-uefi     | arm    | lab-baylibre    | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/64395c5874cda5de582e861a

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm/multi_v7_defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_arm-virt-gicv2-uefi.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm/multi_v7_defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_arm-virt-gicv2-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230407.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64395c5874cda5de582e861b
        failing since 184 days (last pass: v6.0-5324-g7871897dadfa9, first fail: v6.0-11312-g1778d6da389c) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
qemu_arm-virt-gicv2-uefi     | arm    | lab-broonie     | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/643961bf966a73aefb2e85fd

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm/multi_v7_defconfig+debug/gcc-10/lab-broonie/baseline-qemu_arm-virt-gicv2-uefi.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm/multi_v7_defconfig+debug/gcc-10/lab-broonie/baseline-qemu_arm-virt-gicv2-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230407.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/643961bf966a73aefb2e85fe
        failing since 184 days (last pass: v6.0-5324-g7871897dadfa9, first fail: v6.0-11312-g1778d6da389c) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
qemu_arm-virt-gicv2-uefi     | arm    | lab-collabora   | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/64395c4df7b71484572e8603

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm/multi_v7_defconfig+debug/gcc-10/lab-collabora/baseline-qemu_arm-virt-gicv2-uefi.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm/multi_v7_defconfig+debug/gcc-10/lab-collabora/baseline-qemu_arm-virt-gicv2-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230407.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64395c4df7b71484572e8604
        failing since 184 days (last pass: v6.0-5324-g7871897dadfa9, first fail: v6.0-11312-g1778d6da389c) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
qemu_arm-virt-gicv3          | arm    | lab-baylibre    | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/64395c572f1a032bd12e85f2

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm/multi_v7_defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_arm-virt-gicv3.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm/multi_v7_defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_arm-virt-gicv3.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230407.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64395c572f1a032bd12e85f3
        failing since 184 days (last pass: v6.0-5324-g7871897dadfa9, first fail: v6.0-11312-g1778d6da389c) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
qemu_arm-virt-gicv3          | arm    | lab-broonie     | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/64396197fd1740d0622e8603

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm/multi_v7_defconfig+debug/gcc-10/lab-broonie/baseline-qemu_arm-virt-gicv3.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm/multi_v7_defconfig+debug/gcc-10/lab-broonie/baseline-qemu_arm-virt-gicv3.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230407.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64396197fd1740d0622e8604
        failing since 184 days (last pass: v6.0-5324-g7871897dadfa9, first fail: v6.0-11312-g1778d6da389c) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
qemu_arm-virt-gicv3          | arm    | lab-collabora   | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/64395c4b1bc1cf23bb2e8643

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm/multi_v7_defconfig+debug/gcc-10/lab-collabora/baseline-qemu_arm-virt-gicv3.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm/multi_v7_defconfig+debug/gcc-10/lab-collabora/baseline-qemu_arm-virt-gicv3.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230407.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64395c4b1bc1cf23bb2e8644
        failing since 184 days (last pass: v6.0-5324-g7871897dadfa9, first fail: v6.0-11312-g1778d6da389c) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
qemu_arm-virt-gicv3-uefi     | arm    | lab-baylibre    | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/64395c59f7b71484572e863c

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm/multi_v7_defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_arm-virt-gicv3-uefi.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm/multi_v7_defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_arm-virt-gicv3-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230407.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64395c59f7b71484572e863d
        failing since 184 days (last pass: v6.0-5324-g7871897dadfa9, first fail: v6.0-11312-g1778d6da389c) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
qemu_arm-virt-gicv3-uefi     | arm    | lab-broonie     | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/643961c1966a73aefb2e8603

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm/multi_v7_defconfig+debug/gcc-10/lab-broonie/baseline-qemu_arm-virt-gicv3-uefi.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm/multi_v7_defconfig+debug/gcc-10/lab-broonie/baseline-qemu_arm-virt-gicv3-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230407.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/643961c1966a73aefb2e8604
        failing since 184 days (last pass: v6.0-5324-g7871897dadfa9, first fail: v6.0-11312-g1778d6da389c) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
qemu_arm-virt-gicv3-uefi     | arm    | lab-collabora   | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/64395c4e74cda5de582e860d

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm/multi_v7_defconfig+debug/gcc-10/lab-collabora/baseline-qemu_arm-virt-gicv3-uefi.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm/multi_v7_defconfig+debug/gcc-10/lab-collabora/baseline-qemu_arm-virt-gicv3-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230407.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64395c4e74cda5de582e860e
        failing since 184 days (last pass: v6.0-5324-g7871897dadfa9, first fail: v6.0-11312-g1778d6da389c) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
r8a7743-iwg20d-q7            | arm    | lab-cip         | gcc-10   | shmobile_defconfig           | 1          

  Details:     https://kernelci.org/test/plan/id/64395263521d02991f2e86c1

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: shmobile_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm/shmobile_defconfig/gcc-10/lab-cip/baseline-r8a7743-iwg20d-q7.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm/shmobile_defconfig/gcc-10/lab-cip/baseline-r8a7743-iwg20d-q7.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230407.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64395263521d02991f2e86c2
        failing since 0 day (last pass: v6.3-rc6-158-g254ff7648cb9, first fail: v6.3-rc6-249-g122e82851461) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
rk3288-rock2-square          | arm    | lab-collabora   | gcc-10   | multi_v7_defc...G_ARM_LPAE=y | 1          

  Details:     https://kernelci.org/test/plan/id/643955a1999f7752e72e85f6

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm/multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y/gcc-10/lab-collabora/baseline-rk3288-rock2-square.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm/multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y/gcc-10/lab-collabora/baseline-rk3288-rock2-square.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230407.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/643955a1999f7752e72e85f7
        failing since 120 days (last pass: v6.1-6378-g44d433ee7540, first fail: v6.1-10792-g244d284981da) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
rk3399-gru-kevin             | arm64  | lab-collabora   | gcc-10   | defconfig+arm...ok+kselftest | 1          

  Details:     https://kernelci.org/test/plan/id/643954a06d910012e42e860d

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm64/defconfig+arm64-chromebook+kselftest/gcc-10/lab-collabora/baseline-rk3399-gru-kevin.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm64/defconfig+arm64-chromebook+kselftest/gcc-10/lab-collabora/baseline-rk3399-gru-kevin.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230407.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/643954a06d910012e42e860e
        failing since 66 days (last pass: v6.2-rc7-120-g11b3628314a5, first fail: v6.2-rc7-136-g39693c3ba989) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
rk3399-roc-pc                | arm64  | lab-clabbe      | gcc-10   | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/643958b3551816ebe02e8611

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm64/defconfig+kselftest/gcc-10/lab-clabbe/baseline-rk3399-roc-pc.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm64/defconfig+kselftest/gcc-10/lab-clabbe/baseline-rk3399-roc-pc.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230407.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/643958b3551816ebe02e8612
        failing since 66 days (last pass: v6.2-rc7-120-g11b3628314a5, first fail: v6.2-rc7-136-g39693c3ba989) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
rk3399-rock-pi-4b            | arm64  | lab-collabora   | gcc-10   | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/64395826d5a44b6e5c2e85ec

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm64/defconfig+kselftest/gcc-10/lab-collabora/baseline-rk3399-rock-pi-4b.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm64/defconfig+kselftest/gcc-10/lab-collabora/baseline-rk3399-rock-pi-4b.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230407.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64395826d5a44b6e5c2e85ed
        failing since 66 days (last pass: v6.2-rc7-120-g11b3628314a5, first fail: v6.2-rc7-136-g39693c3ba989) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
sc7180-trogdor-kingoftown    | arm64  | lab-collabora   | gcc-10   | defconfig+arm...ok+kselftest | 1          

  Details:     https://kernelci.org/test/plan/id/6439549dd9329ec9bd2e85fb

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm64/defconfig+arm64-chromebook+kselftest/gcc-10/lab-collabora/baseline-sc7180-trogdor-kingoftown.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm64/defconfig+arm64-chromebook+kselftest/gcc-10/lab-collabora/baseline-sc7180-trogdor-kingoftown.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230407.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6439549dd9329ec9bd2e85fc
        failing since 66 days (last pass: v6.2-rc7-120-g11b3628314a5, first fail: v6.2-rc7-136-g39693c3ba989) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
sc7180-trogdo...zor-limozeen | arm64  | lab-collabora   | gcc-10   | defconfig+arm...ok+kselftest | 1          

  Details:     https://kernelci.org/test/plan/id/6439549df56f3ba7512e85ee

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm64/defconfig+arm64-chromebook+kselftest/gcc-10/lab-collabora/baseline-sc7180-trogdor-lazor-limozeen.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm64/defconfig+arm64-chromebook+kselftest/gcc-10/lab-collabora/baseline-sc7180-trogdor-lazor-limozeen.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230407.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6439549df56f3ba7512e85ef
        failing since 66 days (last pass: v6.2-rc7-120-g11b3628314a5, first fail: v6.2-rc7-136-g39693c3ba989) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
sun50i-a64-pine64-plus       | arm64  | lab-broonie     | gcc-10   | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/64395c8f2dc937258b2e86b3

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm64/defconfig+kselftest/gcc-10/lab-broonie/baseline-sun50i-a64-pine64-plus.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm64/defconfig+kselftest/gcc-10/lab-broonie/baseline-sun50i-a64-pine64-plus.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230407.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64395c8f2dc937258b2e86b4
        failing since 66 days (last pass: v6.2-rc7-120-g11b3628314a5, first fail: v6.2-rc7-136-g39693c3ba989) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
sun50i-h5-lib...ch-all-h3-cc | arm64  | lab-broonie     | gcc-10   | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/6439597019c78a2fe72e85f5

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm64/defconfig+kselftest/gcc-10/lab-broonie/baseline-sun50i-h5-libretech-all-h3-cc.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm64/defconfig+kselftest/gcc-10/lab-broonie/baseline-sun50i-h5-libretech-all-h3-cc.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230407.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6439597019c78a2fe72e85f6
        failing since 65 days (last pass: v6.2-rc7-120-g11b3628314a5, first fail: v6.2-rc7-157-ga82755b498dd) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
sun8i-h2-plus-orangepi-r1    | arm    | lab-baylibre    | gcc-10   | sunxi_defconfig              | 1          

  Details:     https://kernelci.org/test/plan/id/6439571254e177c3552e85f2

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: sunxi_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm/sunxi_defconfig/gcc-10/lab-baylibre/baseline-sun8i-h2-plus-orangepi-r1.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm/sunxi_defconfig/gcc-10/lab-baylibre/baseline-sun8i-h2-plus-orangepi-r1.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230407.0/armel/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6439571254e177c3552e85f7
        failing since 71 days (last pass: v6.0-12387-ge54e01f1826aa, first fail: v6.2-rc6-289-g1b7183933813)

    2023-04-14T13:36:58.818019  <8>[    9.622721] <LAVA_SIGNAL_ENDRUN 0_dmesg 3495209_1.5.2.4.1>
    2023-04-14T13:36:58.939258  / # #
    2023-04-14T13:36:59.045135  export SHELL=/bin/sh
    2023-04-14T13:36:59.046854  #
    2023-04-14T13:36:59.150314  / # export SHELL=/bin/sh. /lava-3495209/environment
    2023-04-14T13:36:59.151962  
    2023-04-14T13:36:59.255597  / # . /lava-3495209/environment/lava-3495209/bin/lava-test-runner /lava-3495209/1
    2023-04-14T13:36:59.258739  
    2023-04-14T13:36:59.262489  / # /lava-3495209/bin/lava-test-runner /lava-3495209/1
    2023-04-14T13:36:59.400226  + export 'TESTRUN_ID=1_bootrr' 
    ... (11 line(s) more)  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
sun8i-h2-plus-orangepi-zero  | arm    | lab-baylibre    | gcc-10   | sunxi_defconfig              | 1          

  Details:     https://kernelci.org/test/plan/id/64397553d4349f5fa22e85ec

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: sunxi_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm/sunxi_defconfig/gcc-10/lab-baylibre/baseline-sun8i-h2-plus-orangepi-zero.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc6-279-g281ec23cca3f/arm/sunxi_defconfig/gcc-10/lab-baylibre/baseline-sun8i-h2-plus-orangepi-zero.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230407.0/armel/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/64397553d4349f5fa22e85f1
        failing since 42 days (last pass: v6.2-12625-g13efc3a9f23b, first fail: v6.2-13370-g5872d227b73f)

    2023-04-14T15:46:10.048746  / # #
    2023-04-14T15:46:10.154423  export SHELL=/bin/sh
    2023-04-14T15:46:10.156022  #
    2023-04-14T15:46:10.259431  / # export SHELL=/bin/sh. /lava-3495205/environment
    2023-04-14T15:46:10.261047  
    2023-04-14T15:46:10.364584  / # . /lava-3495205/environment/lava-3495205/bin/lava-test-runner /lava-3495205/1
    2023-04-14T15:46:10.367403  
    2023-04-14T15:46:10.373521  / # /lava-3495205/bin/lava-test-runner /lava-3495205/1
    2023-04-14T15:46:10.508040  + export 'TESTRUN_ID=1_bootrr'
    2023-04-14T15:46:10.509103  + cd /lava-3495205/1/tests/1_bootrr 
    ... (10 line(s) more)