Subject: next/pending-fixes baseline: 699 runs, 91 regressions (v6.3-rc5-284-g1beddc8728ad)

From: "kernelci.org bot" <[email-masked]>
Date: Thu, 06 Apr 2023 03:35:47 -0700 (PDT)

next/pending-fixes baseline: 699 runs, 91 regressions (v6.3-rc5-284-g1beddc8728ad)

Regressions Summary
-------------------

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
am57xx-beagle-x15            | arm    | lab-linaro-lkft | gcc-10   | multi_v7_defconfig+debug     | 1          
asus-C436FA-Flip-hatch       | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...6-chromebook | 1          
asus-C436FA-Flip-hatch       | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...ebook+amdgpu | 1          
asus-C436FA-Flip-hatch       | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...ok+kselftest | 1          
asus-CM1400CXA-dalboz        | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...6-chromebook | 1          
asus-CM1400CXA-dalboz        | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...ebook+amdgpu | 1          
asus-CM1400CXA-dalboz        | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...ok+kselftest | 1          
asus-cx9400-volteer          | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...6-chromebook | 1          
asus-cx9400-volteer          | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...ebook+amdgpu | 1          
asus-cx9400-volteer          | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...ok+kselftest | 1          
bcm2835-rpi-b-rev2           | arm    | lab-broonie     | gcc-10   | bcm2835_defconfig            | 1          
bcm2836-rpi-2-b              | arm    | lab-collabora   | gcc-10   | bcm2835_defconfig            | 1          
bcm2836-rpi-2-b              | arm    | lab-collabora   | gcc-10   | multi_v7_defc...MB2_KERNEL=y | 1          
cubietruck                   | arm    | lab-baylibre    | gcc-10   | multi_v7_defconfig+crypto    | 1          
cubietruck                   | arm    | lab-baylibre    | gcc-10   | multi_v7_defconfig           | 1          
cubietruck                   | arm    | lab-baylibre    | gcc-10   | multi_v7_defc...CONFIG_SMP=n | 1          
cubietruck                   | arm    | lab-baylibre    | gcc-10   | multi_v7_defconfig+ima       | 1          
cubietruck                   | arm    | lab-baylibre    | gcc-10   | multi_v7_defc...MB2_KERNEL=y | 1          
da850-lcdk                   | arm    | lab-baylibre    | gcc-10   | davinci_all_defconfig        | 2          
hp-x360-12b-c...4020-octopus | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...6-chromebook | 1          
hp-x360-12b-c...4020-octopus | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...ebook+amdgpu | 1          
hp-x360-12b-c...4020-octopus | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...ok+kselftest | 1          
hp-x360-14-G1-sona           | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...6-chromebook | 1          
hp-x360-14-G1-sona           | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...ebook+amdgpu | 1          
hp-x360-14-G1-sona           | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...ok+kselftest | 1          
hp-x360-14a-cb0001xx-zork    | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...6-chromebook | 1          
hp-x360-14a-cb0001xx-zork    | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...ebook+amdgpu | 1          
hp-x360-14a-cb0001xx-zork    | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...ok+kselftest | 1          
imx6dl-udoo                  | arm    | lab-broonie     | gcc-10   | multi_v7_defconfig           | 2          
imx6qp-wandboard-revd1       | arm    | lab-pengutronix | gcc-10   | multi_v7_defconfig+debug     | 1          
jetson-tk1                   | arm    | lab-baylibre    | gcc-10   | multi_v7_defc...G_ARM_LPAE=y | 1          
jh7100-starfi...isionfive-v1 | riscv  | lab-clabbe      | gcc-10   | defconfig+kselftest          | 1          
lenovo-TPad-C13-Yoga-zork    | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...6-chromebook | 1          
lenovo-TPad-C13-Yoga-zork    | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...ebook+amdgpu | 1          
lenovo-TPad-C13-Yoga-zork    | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...ok+kselftest | 1          
meson-g12a-u200              | arm64  | lab-baylibre    | gcc-10   | defconfig+kselftest          | 1          
meson-g12a-x96-max           | arm64  | lab-baylibre    | gcc-10   | defconfig+kselftest          | 1          
meson-g12b-a311d-khadas-vim3 | arm64  | lab-collabora   | gcc-10   | defconfig+kselftest          | 1          
meson-gxbb-nanopi-k2         | arm64  | lab-baylibre    | gcc-10   | defconfig+kselftest          | 1          
meson-gxl-s905d-p230         | arm64  | lab-baylibre    | gcc-10   | defconfig+kselftest          | 1          
meson-gxl-s905x-khadas-vim   | arm64  | lab-baylibre    | gcc-10   | defconfig+kselftest          | 1          
meson-gxl-s905x-libretech-cc | arm64  | lab-baylibre    | gcc-10   | defconfig+kselftest          | 1          
meson-gxl-s905x-libretech-cc | arm64  | lab-broonie     | gcc-10   | defconfig+kselftest          | 1          
meson-gxm-khadas-vim2        | arm64  | lab-baylibre    | gcc-10   | defconfig+kselftest          | 1          
meson-gxm-q200               | arm64  | lab-baylibre    | gcc-10   | defconfig+kselftest          | 1          
meson-sm1-khadas-vim3l       | arm64  | lab-baylibre    | gcc-10   | defconfig+CON...BIG_ENDIAN=y | 1          
mt8173-elm-hana              | arm64  | lab-collabora   | gcc-10   | defconfig+arm...ok+kselftest | 1          
mt8183-kukui-...uniper-sku16 | arm64  | lab-collabora   | gcc-10   | defconfig+arm...ok+kselftest | 1          
mt8183-kukui-...uniper-sku16 | arm64  | lab-collabora   | gcc-10   | defconfig+arm64-chromebook   | 3          
mt8183-kukui-...uniper-sku16 | arm64  | lab-collabora   | gcc-10   | defconfig+arm...ook+videodec | 3          
mt8192-asurada-spherion-r0   | arm64  | lab-collabora   | gcc-10   | defconfig+arm64-chromebook   | 3          
mt8192-asurada-spherion-r0   | arm64  | lab-collabora   | gcc-10   | defconfig+arm...ok+kselftest | 1          
mt8192-asurada-spherion-r0   | arm64  | lab-collabora   | gcc-10   | defconfig+arm...ook+videodec | 3          
ox820-clouden...lug-series-3 | arm    | lab-baylibre    | gcc-10   | oxnas_v6_defconfig           | 1          
qcom-qdf2400                 | arm64  | lab-linaro-lkft | gcc-10   | defconfig+kselftest          | 1          
qcom-qdf2400                 | arm64  | lab-linaro-lkft | gcc-10   | defconfig+arm...ok+kselftest | 1          
qemu_arm-virt-gicv2          | arm    | lab-baylibre    | gcc-10   | multi_v7_defconfig+debug     | 1          
qemu_arm-virt-gicv2          | arm    | lab-broonie     | gcc-10   | multi_v7_defconfig+debug     | 1          
qemu_arm-virt-gicv2          | arm    | lab-collabora   | gcc-10   | multi_v7_defconfig+debug     | 1          
qemu_arm-virt-gicv2-uefi     | arm    | lab-baylibre    | gcc-10   | multi_v7_defconfig+debug     | 1          
qemu_arm-virt-gicv2-uefi     | arm    | lab-broonie     | gcc-10   | multi_v7_defconfig+debug     | 1          
qemu_arm-virt-gicv2-uefi     | arm    | lab-collabora   | gcc-10   | multi_v7_defconfig+debug     | 1          
qemu_arm-virt-gicv3          | arm    | lab-baylibre    | gcc-10   | multi_v7_defconfig+debug     | 1          
qemu_arm-virt-gicv3          | arm    | lab-broonie     | gcc-10   | multi_v7_defconfig+debug     | 1          
qemu_arm-virt-gicv3          | arm    | lab-collabora   | gcc-10   | multi_v7_defconfig+debug     | 1          
qemu_arm-virt-gicv3-uefi     | arm    | lab-baylibre    | gcc-10   | multi_v7_defconfig+debug     | 1          
qemu_arm-virt-gicv3-uefi     | arm    | lab-broonie     | gcc-10   | multi_v7_defconfig+debug     | 1          
qemu_arm-virt-gicv3-uefi     | arm    | lab-collabora   | gcc-10   | multi_v7_defconfig+debug     | 1          
r8a7743-iwg20d-q7            | arm    | lab-cip         | gcc-10   | shmobile_defconfig           | 1          
rk3288-rock2-square          | arm    | lab-collabora   | gcc-10   | multi_v7_defc...G_ARM_LPAE=y | 1          
rk3288-veyron-jaq            | arm    | lab-collabora   | gcc-10   | multi_v7_defc...G_ARM_LPAE=y | 1          
rk3399-gru-kevin             | arm64  | lab-collabora   | gcc-10   | defconfig+arm...ok+kselftest | 1          
rk3399-roc-pc                | arm64  | lab-clabbe      | gcc-10   | defconfig+kselftest          | 1          
rk3399-rock-pi-4b            | arm64  | lab-collabora   | gcc-10   | defconfig+kselftest          | 1          
sc7180-trogdor-kingoftown    | arm64  | lab-collabora   | gcc-10   | defconfig+arm...ok+kselftest | 1          
sc7180-trogdo...zor-limozeen | arm64  | lab-collabora   | gcc-10   | defconfig+arm...ok+kselftest | 1          
sun50i-a64-pine64-plus       | arm64  | lab-broonie     | gcc-10   | defconfig+kselftest          | 1          
sun50i-h5-lib...ch-all-h3-cc | arm64  | lab-broonie     | gcc-10   | defconfig+kselftest          | 1          
sun8i-h2-plus-orangepi-r1    | arm    | lab-baylibre    | gcc-10   | sunxi_defconfig              | 1          
sun8i-h2-plus-orangepi-zero  | arm    | lab-baylibre    | gcc-10   | sunxi_defconfig              | 1          
sun8i-r40-bananapi-m2-ultra  | arm    | lab-clabbe      | gcc-10   | sunxi_defconfig              | 1          

  Details:  https://kernelci.org/test/job/next/branch/pending-fixes/kernel/v6.3-rc5-284-g1beddc8728ad/plan/baseline/

  Test:     baseline
  Tree:     next
  Branch:   pending-fixes
  Describe: v6.3-rc5-284-g1beddc8728ad
  URL:      https://git.kernel.org/pub/scm/linux/kernel/git/next/linux-next.git
  SHA:      1beddc8728adc4cebe4f26de448b6c93d09e4ab9 

Test Regressions
---------------- 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
am57xx-beagle-x15            | arm    | lab-linaro-lkft | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/642ea07766aa023a3779e926

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm/multi_v7_defconfig+debug/gcc-10/lab-linaro-lkft/baseline-am57xx-beagle-x15.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm/multi_v7_defconfig+debug/gcc-10/lab-linaro-lkft/baseline-am57xx-beagle-x15.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230324.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/642ea07766aa023a3779e927
        failing since 176 days (last pass: v6.0-9666-g02c05e0b8d5c, first fail: v6.0-11312-g1778d6da389c) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
asus-C436FA-Flip-hatch       | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...6-chromebook | 1          

  Details:     https://kernelci.org/test/plan/id/642e671bb96bb34f8a79e950

  Results:     6 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/x86_64/x86_64_defconfig+x86-chromebook/gcc-10/lab-collabora/baseline-asus-C436FA-Flip-hatch.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/x86_64/x86_64_defconfig+x86-chromebook/gcc-10/lab-collabora/baseline-asus-C436FA-Flip-hatch.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230324.0/x86/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/642e671bb96bb34f8a79e954
        failing since 8 days (last pass: v6.3-rc3-370-g8269040171a02, first fail: v6.3-rc4-214-g39ee5bf6e049)

    2023-04-06T06:30:29.790719  <8>[   10.038531] <LAVA_SIGNAL_ENDRUN 0_dmesg 9892316_1.4.2.3.1>

    2023-04-06T06:30:29.793994  + set +x

    2023-04-06T06:30:29.898477  / # #

    2023-04-06T06:30:29.999599  export SHELL=/bin/sh

    2023-04-06T06:30:29.999881  #

    2023-04-06T06:30:30.100901  / # export SHELL=/bin/sh. /lava-9892316/environment

    2023-04-06T06:30:30.101134  

    2023-04-06T06:30:30.202126  / # . /lava-9892316/environment/lava-9892316/bin/lava-test-runner /lava-9892316/1

    2023-04-06T06:30:30.202477  

    2023-04-06T06:30:30.208815  / # /lava-9892316/bin/lava-test-runner /lava-9892316/1
 
    ... (12 line(s) more)  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
asus-C436FA-Flip-hatch       | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...ebook+amdgpu | 1          

  Details:     https://kernelci.org/test/plan/id/642e695d559210e6f679e94a

  Results:     6 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook+amdgpu
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/x86_64/x86_64_defconfig+x86-chromebook+amdgpu/gcc-10/lab-collabora/baseline-asus-C436FA-Flip-hatch.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/x86_64/x86_64_defconfig+x86-chromebook+amdgpu/gcc-10/lab-collabora/baseline-asus-C436FA-Flip-hatch.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230324.0/x86/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/642e695d559210e6f679e94f
        failing since 8 days (last pass: v6.3-rc3-550-g902f54bbd6c7, first fail: v6.3-rc4-214-g39ee5bf6e049)

    2023-04-06T06:40:07.856218  <8>[   10.077600] <LAVA_SIGNAL_ENDRUN 0_dmesg 9892594_1.4.2.3.1>

    2023-04-06T06:40:07.859854  + set +x

    2023-04-06T06:40:07.964789  / # #

    2023-04-06T06:40:08.065584  export SHELL=/bin/sh

    2023-04-06T06:40:08.065790  #

    2023-04-06T06:40:08.166784  / # export SHELL=/bin/sh. /lava-9892594/environment

    2023-04-06T06:40:08.166981  

    2023-04-06T06:40:08.267886  / # . /lava-9892594/environment/lava-9892594/bin/lava-test-runner /lava-9892594/1

    2023-04-06T06:40:08.268303  

    2023-04-06T06:40:08.273728  / # /lava-9892594/bin/lava-test-runner /lava-9892594/1
 
    ... (13 line(s) more)  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
asus-C436FA-Flip-hatch       | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...ok+kselftest | 1          

  Details:     https://kernelci.org/test/plan/id/642e6b7e3c78b25bc679e9a0

  Results:     6 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook+kselftest
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/x86_64/x86_64_defconfig+x86-chromebook+kselftest/gcc-10/lab-collabora/baseline-asus-C436FA-Flip-hatch.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/x86_64/x86_64_defconfig+x86-chromebook+kselftest/gcc-10/lab-collabora/baseline-asus-C436FA-Flip-hatch.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230324.0/x86/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/642e6b7e3c78b25bc679e9a5
        failing since 6 days (last pass: v6.3-rc3-550-g902f54bbd6c7, first fail: v6.3-rc4-334-g60f00557d56b)

    2023-04-06T06:49:24.858189  + set +x

    2023-04-06T06:49:24.864338  <8>[   12.955408] <LAVA_SIGNAL_ENDRUN 0_dmesg 9892962_1.4.2.3.1>

    2023-04-06T06:49:24.969422  / # #

    2023-04-06T06:49:25.070524  export SHELL=/bin/sh

    2023-04-06T06:49:25.070739  #

    2023-04-06T06:49:25.171683  / # export SHELL=/bin/sh. /lava-9892962/environment

    2023-04-06T06:49:25.171906  

    2023-04-06T06:49:25.272853  / # . /lava-9892962/environment/lava-9892962/bin/lava-test-runner /lava-9892962/1

    2023-04-06T06:49:25.273182  

    2023-04-06T06:49:25.279315  / # /lava-9892962/bin/lava-test-runner /lava-9892962/1
 
    ... (12 line(s) more)  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
asus-CM1400CXA-dalboz        | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...6-chromebook | 1          

  Details:     https://kernelci.org/test/plan/id/642e66e63adce00e8279e96f

  Results:     6 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/x86_64/x86_64_defconfig+x86-chromebook/gcc-10/lab-collabora/baseline-asus-CM1400CXA-dalboz.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/x86_64/x86_64_defconfig+x86-chromebook/gcc-10/lab-collabora/baseline-asus-CM1400CXA-dalboz.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230324.0/x86/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/642e66e63adce00e8279e974
        failing since 8 days (last pass: v6.3-rc3-370-g8269040171a02, first fail: v6.3-rc4-214-g39ee5bf6e049)

    2023-04-06T06:29:40.936694  + <8>[   10.871271] <LAVA_SIGNAL_ENDRUN 0_dmesg 9892327_1.4.2.3.1>

    2023-04-06T06:29:40.937172  set +x

    2023-04-06T06:29:41.045068  / # #

    2023-04-06T06:29:41.147899  export SHELL=/bin/sh

    2023-04-06T06:29:41.148719  #

    2023-04-06T06:29:41.250727  / # export SHELL=/bin/sh. /lava-9892327/environment

    2023-04-06T06:29:41.251558  

    2023-04-06T06:29:41.353584  / # . /lava-9892327/environment/lava-9892327/bin/lava-test-runner /lava-9892327/1

    2023-04-06T06:29:41.354909  

    2023-04-06T06:29:41.359917  / # /lava-9892327/bin/lava-test-runner /lava-9892327/1
 
    ... (12 line(s) more)  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
asus-CM1400CXA-dalboz        | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...ebook+amdgpu | 1          

  Details:     https://kernelci.org/test/plan/id/642e68f621750ef82179e99e

  Results:     6 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook+amdgpu
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/x86_64/x86_64_defconfig+x86-chromebook+amdgpu/gcc-10/lab-collabora/baseline-asus-CM1400CXA-dalboz.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/x86_64/x86_64_defconfig+x86-chromebook+amdgpu/gcc-10/lab-collabora/baseline-asus-CM1400CXA-dalboz.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230324.0/x86/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/642e68f621750ef82179e9a3
        failing since 8 days (last pass: v6.3-rc3-550-g902f54bbd6c7, first fail: v6.3-rc4-214-g39ee5bf6e049)

    2023-04-06T06:38:29.989685  + set +x<8>[   11.397639] <LAVA_SIGNAL_ENDRUN 0_dmesg 9892558_1.4.2.3.1>

    2023-04-06T06:38:29.989790  

    2023-04-06T06:38:30.095120  / # #

    2023-04-06T06:38:30.197566  export SHELL=/bin/sh

    2023-04-06T06:38:30.198282  #

    2023-04-06T06:38:30.299914  / # export SHELL=/bin/sh. /lava-9892558/environment

    2023-04-06T06:38:30.300595  

    2023-04-06T06:38:30.402353  / # . /lava-9892558/environment/lava-9892558/bin/lava-test-runner /lava-9892558/1

    2023-04-06T06:38:30.403406  

    2023-04-06T06:38:30.407781  / # /lava-9892558/bin/lava-test-runner /lava-9892558/1
 
    ... (12 line(s) more)  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
asus-CM1400CXA-dalboz        | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...ok+kselftest | 1          

  Details:     https://kernelci.org/test/plan/id/642e6acf5ed31cf41279e922

  Results:     6 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook+kselftest
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/x86_64/x86_64_defconfig+x86-chromebook+kselftest/gcc-10/lab-collabora/baseline-asus-CM1400CXA-dalboz.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/x86_64/x86_64_defconfig+x86-chromebook+kselftest/gcc-10/lab-collabora/baseline-asus-CM1400CXA-dalboz.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230324.0/x86/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/642e6acf5ed31cf41279e927
        failing since 6 days (last pass: v6.3-rc3-550-g902f54bbd6c7, first fail: v6.3-rc4-334-g60f00557d56b)

    2023-04-06T06:46:24.228437  + set +x

    2023-04-06T06:46:24.231781  <8>[   15.069322] <LAVA_SIGNAL_ENDRUN 0_dmesg 9892945_1.4.2.3.1>

    2023-04-06T06:46:24.337503  / # #

    2023-04-06T06:46:24.438553  export SHELL=/bin/sh

    2023-04-06T06:46:24.438739  #

    2023-04-06T06:46:24.539698  / # export SHELL=/bin/sh. /lava-9892945/environment

    2023-04-06T06:46:24.539915  

    2023-04-06T06:46:24.640817  / # . /lava-9892945/environment/lava-9892945/bin/lava-test-runner /lava-9892945/1

    2023-04-06T06:46:24.641153  

    2023-04-06T06:46:24.646399  / # /lava-9892945/bin/lava-test-runner /lava-9892945/1
 
    ... (12 line(s) more)  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
asus-cx9400-volteer          | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...6-chromebook | 1          

  Details:     https://kernelci.org/test/plan/id/642e66ee1c73e21ac579e962

  Results:     6 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/x86_64/x86_64_defconfig+x86-chromebook/gcc-10/lab-collabora/baseline-asus-cx9400-volteer.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/x86_64/x86_64_defconfig+x86-chromebook/gcc-10/lab-collabora/baseline-asus-cx9400-volteer.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230324.0/x86/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/642e66ee1c73e21ac579e967
        failing since 8 days (last pass: v6.3-rc3-370-g8269040171a02, first fail: v6.3-rc4-214-g39ee5bf6e049)

    2023-04-06T06:29:51.703780  <8>[   10.346216] <LAVA_SIGNAL_ENDRUN 0_dmesg 9892332_1.4.2.3.1>

    2023-04-06T06:29:51.706947  + set +x

    2023-04-06T06:29:51.808574  #

    2023-04-06T06:29:51.808780  

    2023-04-06T06:29:51.909476  / # #export SHELL=/bin/sh

    2023-04-06T06:29:51.909630  

    2023-04-06T06:29:52.010509  / # export SHELL=/bin/sh. /lava-9892332/environment

    2023-04-06T06:29:52.010659  

    2023-04-06T06:29:52.111592  / # . /lava-9892332/environment/lava-9892332/bin/lava-test-runner /lava-9892332/1

    2023-04-06T06:29:52.111879  
 
    ... (13 line(s) more)  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
asus-cx9400-volteer          | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...ebook+amdgpu | 1          

  Details:     https://kernelci.org/test/plan/id/642e6a22243c5fd53379e953

  Results:     6 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook+amdgpu
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/x86_64/x86_64_defconfig+x86-chromebook+amdgpu/gcc-10/lab-collabora/baseline-asus-cx9400-volteer.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/x86_64/x86_64_defconfig+x86-chromebook+amdgpu/gcc-10/lab-collabora/baseline-asus-cx9400-volteer.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230324.0/x86/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/642e6a22243c5fd53379e958
        failing since 8 days (last pass: v6.3-rc3-550-g902f54bbd6c7, first fail: v6.3-rc4-214-g39ee5bf6e049)

    2023-04-06T06:43:28.881778  <8>[   10.362278] <LAVA_SIGNAL_ENDRUN 0_dmesg 9892552_1.4.2.3.1>

    2023-04-06T06:43:28.884844  + set +x

    2023-04-06T06:43:28.986479  #

    2023-04-06T06:43:29.087826  / # #export SHELL=/bin/sh

    2023-04-06T06:43:29.088052  

    2023-04-06T06:43:29.188993  / # export SHELL=/bin/sh. /lava-9892552/environment

    2023-04-06T06:43:29.189209  

    2023-04-06T06:43:29.290150  / # . /lava-9892552/environment/lava-9892552/bin/lava-test-runner /lava-9892552/1

    2023-04-06T06:43:29.290437  

    2023-04-06T06:43:29.295490  / # /lava-9892552/bin/lava-test-runner /lava-9892552/1
 
    ... (12 line(s) more)  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
asus-cx9400-volteer          | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...ok+kselftest | 1          

  Details:     https://kernelci.org/test/plan/id/642e6f626540aeee2679e934

  Results:     6 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook+kselftest
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/x86_64/x86_64_defconfig+x86-chromebook+kselftest/gcc-10/lab-collabora/baseline-asus-cx9400-volteer.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/x86_64/x86_64_defconfig+x86-chromebook+kselftest/gcc-10/lab-collabora/baseline-asus-cx9400-volteer.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230324.0/x86/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/642e6f626540aeee2679e939
        failing since 6 days (last pass: v6.3-rc3-550-g902f54bbd6c7, first fail: v6.3-rc4-334-g60f00557d56b)

    2023-04-06T07:06:01.365580  <8>[   13.015925] <LAVA_SIGNAL_ENDRUN 0_dmesg 9892951_1.4.2.3.1>

    2023-04-06T07:06:01.369053  + set +x

    2023-04-06T07:06:01.470946  #

    2023-04-06T07:06:01.572223  / # #export SHELL=/bin/sh

    2023-04-06T07:06:01.572442  

    2023-04-06T07:06:01.673361  / # export SHELL=/bin/sh. /lava-9892951/environment

    2023-04-06T07:06:01.673599  

    2023-04-06T07:06:01.774524  / # . /lava-9892951/environment/lava-9892951/bin/lava-test-runner /lava-9892951/1

    2023-04-06T07:06:01.774896  

    2023-04-06T07:06:01.779940  / # /lava-9892951/bin/lava-test-runner /lava-9892951/1
 
    ... (12 line(s) more)  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
bcm2835-rpi-b-rev2           | arm    | lab-broonie     | gcc-10   | bcm2835_defconfig            | 1          

  Details:     https://kernelci.org/test/plan/id/642e67bf61debecea979e922

  Results:     50 PASS, 2 FAIL, 1 SKIP
  Full config: bcm2835_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm/bcm2835_defconfig/gcc-10/lab-broonie/baseline-bcm2835-rpi-b-rev2.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm/bcm2835_defconfig/gcc-10/lab-broonie/baseline-bcm2835-rpi-b-rev2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230324.0/armel/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/642e67bf61debecea979e955
        new failure (last pass: v6.3-rc5-258-g0f20c88b6871)

    2023-04-06T06:32:45.396691  + set +x
    2023-04-06T06:32:45.400316  <8>[   17.431103] <LAVA_SIGNAL_ENDRUN 0_dmesg 289734_1.5.2.4.1>
    2023-04-06T06:32:45.536368  / # #
    2023-04-06T06:32:45.638593  export SHELL=/bin/sh
    2023-04-06T06:32:45.639108  #
    2023-04-06T06:32:45.740463  / # export SHELL=/bin/sh. /lava-289734/environment
    2023-04-06T06:32:45.741007  
    2023-04-06T06:32:45.842657  / # . /lava-289734/environment/lava-289734/bin/lava-test-runner /lava-289734/1
    2023-04-06T06:32:45.843683  
    2023-04-06T06:32:45.849726  / # /lava-289734/bin/lava-test-runner /lava-289734/1 
    ... (14 line(s) more)  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
bcm2836-rpi-2-b              | arm    | lab-collabora   | gcc-10   | bcm2835_defconfig            | 1          

  Details:     https://kernelci.org/test/plan/id/642e69204d7b88f20579e9b1

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: bcm2835_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm/bcm2835_defconfig/gcc-10/lab-collabora/baseline-bcm2836-rpi-2-b.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm/bcm2835_defconfig/gcc-10/lab-collabora/baseline-bcm2836-rpi-2-b.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230324.0/armel/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/642e69204d7b88f20579e9b6
        failing since 84 days (last pass: v6.2-rc3-243-g3145d9dfed32, first fail: v6.2-rc3-296-g79fa898551af)

    2023-04-06T06:39:12.485303  / # #

    2023-04-06T06:39:12.586959  export SHELL=/bin/sh

    2023-04-06T06:39:12.587396  #

    2023-04-06T06:39:12.688712  / # export SHELL=/bin/sh. /lava-9892452/environment

    2023-04-06T06:39:12.689142  

    2023-04-06T06:39:12.790456  / # . /lava-9892452/environment/lava-9892452/bin/lava-test-runner /lava-9892452/1

    2023-04-06T06:39:12.791217  

    2023-04-06T06:39:12.794203  / # /lava-9892452/bin/lava-test-runner /lava-9892452/1

    2023-04-06T06:39:12.918223  + export 'TESTRUN_ID=1_bootrr'

    2023-04-06T06:39:12.918500  + cd /lava-9892452/1/tests/1_bootrr
 
    ... (12 line(s) more)  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
bcm2836-rpi-2-b              | arm    | lab-collabora   | gcc-10   | multi_v7_defc...MB2_KERNEL=y | 1          

  Details:     https://kernelci.org/test/plan/id/642e703d4beea1f7e679e93d

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm/multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y/gcc-10/lab-collabora/baseline-bcm2836-rpi-2-b.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm/multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y/gcc-10/lab-collabora/baseline-bcm2836-rpi-2-b.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230324.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/642e703d4beea1f7e679e93e
        failing since 38 days (last pass: v6.2-8700-gab98cc06b683, first fail: v6.2-12625-g13efc3a9f23b) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
cubietruck                   | arm    | lab-baylibre    | gcc-10   | multi_v7_defconfig+crypto    | 1          

  Details:     https://kernelci.org/test/plan/id/642e6a22e1523337cc79e927

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: multi_v7_defconfig+crypto
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm/multi_v7_defconfig+crypto/gcc-10/lab-baylibre/baseline-cubietruck.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm/multi_v7_defconfig+crypto/gcc-10/lab-baylibre/baseline-cubietruck.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230324.0/armel/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/642e6a22e1523337cc79e92c
        failing since 78 days (last pass: v6.1-13341-g16cba743aec0, first fail: v6.2-rc4-302-g48ed69cf21b2)

    2023-04-06T06:43:25.449128  <8>[   20.897610] <LAVA_SIGNAL_ENDRUN 0_dmesg 3475390_1.5.2.4.1>
    2023-04-06T06:43:25.557922  / # #
    2023-04-06T06:43:25.659363  export SHELL=/bin/sh
    2023-04-06T06:43:25.659717  #
    2023-04-06T06:43:25.760618  / # export SHELL=/bin/sh. /lava-3475390/environment
    2023-04-06T06:43:25.761042  
    2023-04-06T06:43:25.862287  / # . /lava-3475390/environment/lava-3475390/bin/lava-test-runner /lava-3475390/1
    2023-04-06T06:43:25.863032  
    2023-04-06T06:43:25.867606  / # /lava-3475390/bin/lava-test-runner /lava-3475390/1
    2023-04-06T06:43:25.963639  + export 'TESTRUN_ID=1_bootrr' 
    ... (11 line(s) more)  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
cubietruck                   | arm    | lab-baylibre    | gcc-10   | multi_v7_defconfig           | 1          

  Details:     https://kernelci.org/test/plan/id/642e6ac171625f3cb179e9c5

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: multi_v7_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm/multi_v7_defconfig/gcc-10/lab-baylibre/baseline-cubietruck.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm/multi_v7_defconfig/gcc-10/lab-baylibre/baseline-cubietruck.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230324.0/armel/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/642e6ac171625f3cb179e9ca
        failing since 78 days (last pass: v6.1-13341-g16cba743aec0, first fail: v6.2-rc4-302-g48ed69cf21b2)

    2023-04-06T06:45:57.233904  <8>[   12.381062] <LAVA_SIGNAL_ENDRUN 0_dmesg 3475406_1.5.2.4.1>
    2023-04-06T06:45:57.342328  / # #
    2023-04-06T06:45:57.444085  export SHELL=/bin/sh
    2023-04-06T06:45:57.444420  #
    2023-04-06T06:45:57.545542  / # export SHELL=/bin/sh. /lava-3475406/environment
    2023-04-06T06:45:57.545911  
    2023-04-06T06:45:57.646862  / # . /lava-3475406/environment/lava-3475406/bin/lava-test-runner /lava-3475406/1
    2023-04-06T06:45:57.647484  
    2023-04-06T06:45:57.652331  / # /lava-3475406/bin/lava-test-runner /lava-3475406/1
    2023-04-06T06:45:57.741104  + export 'TESTRUN_ID=1_bootrr' 
    ... (11 line(s) more)  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
cubietruck                   | arm    | lab-baylibre    | gcc-10   | multi_v7_defc...CONFIG_SMP=n | 1          

  Details:     https://kernelci.org/test/plan/id/642e704935ff0e430f79eb2c

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: multi_v7_defconfig+CONFIG_SMP=n
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm/multi_v7_defconfig+CONFIG_SMP=n/gcc-10/lab-baylibre/baseline-cubietruck.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm/multi_v7_defconfig+CONFIG_SMP=n/gcc-10/lab-baylibre/baseline-cubietruck.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230324.0/armel/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/642e704935ff0e430f79eb31
        failing since 78 days (last pass: v6.1-13341-g16cba743aec0, first fail: v6.2-rc4-302-g48ed69cf21b2)

    2023-04-06T07:09:30.237606  <8>[   14.424463] <LAVA_SIGNAL_ENDRUN 0_dmesg 3475661_1.5.2.4.1>
    2023-04-06T07:09:30.344175  / # #
    2023-04-06T07:09:30.445610  export SHELL=/bin/sh
    2023-04-06T07:09:30.445937  #
    2023-04-06T07:09:30.547029  / # export SHELL=/bin/sh. /lava-3475661/environment
    2023-04-06T07:09:30.547347  
    2023-04-06T07:09:30.648551  / # . /lava-3475661/environment/lava-3475661/bin/lava-test-runner /lava-3475661/1
    2023-04-06T07:09:30.649113  
    2023-04-06T07:09:30.653625  / # /lava-3475661/bin/lava-test-runner /lava-3475661/1
    2023-04-06T07:09:30.734926  + export 'TESTRUN_ID=1_bootrr' 
    ... (11 line(s) more)  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
cubietruck                   | arm    | lab-baylibre    | gcc-10   | multi_v7_defconfig+ima       | 1          

  Details:     https://kernelci.org/test/plan/id/642e70d166af44bd2479e922

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: multi_v7_defconfig+ima
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm/multi_v7_defconfig+ima/gcc-10/lab-baylibre/baseline-cubietruck.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm/multi_v7_defconfig+ima/gcc-10/lab-baylibre/baseline-cubietruck.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230324.0/armel/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/642e70d166af44bd2479e927
        failing since 78 days (last pass: v6.1-13341-g16cba743aec0, first fail: v6.2-rc4-302-g48ed69cf21b2)

    2023-04-06T07:12:09.441902  <8>[   12.584982] <LAVA_SIGNAL_ENDRUN 0_dmesg 3475777_1.5.2.4.1>
    2023-04-06T07:12:09.448397  <3>[   12.591104] Bluetooth: hci0: command 0xfc18 tx timeout
    2023-04-06T07:12:09.558422  / # #
    2023-04-06T07:12:09.662430  export SHELL=/bin/sh
    2023-04-06T07:12:09.663314  #
    2023-04-06T07:12:09.765364  / # export SHELL=/bin/sh. /lava-3475777/environment
    2023-04-06T07:12:09.769061  
    2023-04-06T07:12:09.873269  / # . /lava-3475777/environment/lava-3475777/bin/lava-test-runner /lava-3475777/1
    2023-04-06T07:12:09.874859  
    2023-04-06T07:12:09.879306  / # /lava-3475777/bin/lava-test-runner /lava-3475777/1 
    ... (12 line(s) more)  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
cubietruck                   | arm    | lab-baylibre    | gcc-10   | multi_v7_defc...MB2_KERNEL=y | 1          

  Details:     https://kernelci.org/test/plan/id/642e717003580254fc79ea8c

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm/multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y/gcc-10/lab-baylibre/baseline-cubietruck.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm/multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y/gcc-10/lab-baylibre/baseline-cubietruck.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230324.0/armel/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/642e717103580254fc79ea91
        failing since 78 days (last pass: v6.1-13341-g16cba743aec0, first fail: v6.2-rc4-302-g48ed69cf21b2)

    2023-04-06T07:14:44.279213  <8>[   12.758952] <LAVA_SIGNAL_ENDRUN 0_dmesg 3475834_1.5.2.4.1>
    2023-04-06T07:14:44.389436  / # #
    2023-04-06T07:14:44.492989  export SHELL=/bin/sh
    2023-04-06T07:14:44.494037  #
    2023-04-06T07:14:44.596117  / # export SHELL=/bin/sh. /lava-3475834/environment
    2023-04-06T07:14:44.596578  
    2023-04-06T07:14:44.698084  / # . /lava-3475834/environment/lava-3475834/bin/lava-test-runner /lava-3475834/1
    2023-04-06T07:14:44.699933  
    2023-04-06T07:14:44.700365  / # /lava-3475834/bin/lava-test-runner /lava-3475834/1<3>[   13.165946] Bluetooth: hci0: command 0xfc18 tx timeout
    2023-04-06T07:14:44.704373   
    ... (12 line(s) more)  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
da850-lcdk                   | arm    | lab-baylibre    | gcc-10   | davinci_all_defconfig        | 2          

  Details:     https://kernelci.org/test/plan/id/642e668473488bd13079e927

  Results:     3 PASS, 3 FAIL, 1 SKIP
  Full config: davinci_all_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm/davinci_all_defconfig/gcc-10/lab-baylibre/baseline-da850-lcdk.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm/davinci_all_defconfig/gcc-10/lab-baylibre/baseline-da850-lcdk.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230324.0/armel/rootfs.cpio.gz 

  * baseline.dmesg.emerg: https://kernelci.org/test/case/id/642e668473488bd13079e92e
        failing since 34 days (last pass: v6.2-1218-g2d4a54ee969d, first fail: v6.2-13370-g5872d227b73f)
        30 lines

    2023-04-06T06:28:01.855281  kern  :alert : Register r7 information: non-paged memory
    2023-04-06T06:28:01.856036  kern  :alert : Register r8 information: slab kmalloc-512 start c4d02200 pointer offset 4 size 512
    2023-04-06T06:28:01.856614  kern  :alert : Register r9 information: non-paged memory
    2023-04-06T06:28:01.857148  kern  :alert : Register r10 information: NULL pointer
    2023-04-06T06:28:01.857565  kern  :alert : Register r11 information: 5-page vmalloc region starting at 0xbf3e2000 allocated at load_module+0x898/0x1b10
    2023-04-06T06:28:01.858535  kern  :alert : Register r12 information: non-paged memory
    2023-04-06T06:28:01.952415  kern  :emerg : Internal error: Oops: 17 [#1] PREEMPT ARM
    2023-04-06T06:28:01.953069  kern  :emerg : Process udevd (pid: 70, stack limit = 0x64eab33d)
    2023-04-06T06:28:01.953866  kern  :emerg : Stack: (0xc891dcf8 to 0xc891e000)
    2023-04-06T06:28:01.954430  kern  :emerg : dce0:                                                       c4d02200 c076f860 
    ... (7 line(s) more)  

  * baseline.dmesg.alert: https://kernelci.org/test/case/id/642e668473488bd13079e92f
        failing since 437 days (last pass: v5.16-11577-gffd79fec234d, first fail: v5.17-rc1-180-g86539e2bdb99)
        18 lines

    2023-04-06T06:28:01.763434  kern  :alert : BUG: Bad page state in process kworker/u2:0  pfn:c3400
    2023-04-06T06:28:01.764089  kern  :alert : BUG: Bad page state in process kworker/u2:0  pfn:c3800
    2023-04-06T06:28:01.764651  kern  :alert : 8<--- cut here ---
    2023-04-06T06:28:01.765210  kern  :alert : Unable to handle kernel NULL pointer dereference at virtual address 00000060 when read
    2023-04-06T06:28:01.765658  kern  :alert : [00000060] *pgd=c4a3d831, *pte=00000000, *ppte=00000000
    2023-04-06T06:28:01.766047  kern  :alert : Register r0 information: non-paged memory
    2023-04-06T06:28:01.806471  kern  :alert : Register r1 information: 2-page vmalloc region starting at 0xc891c000 allocated at kernel_clone+0x98/0x3a0
    2023-04-06T06:28:01.808391  kern  :alert : Register r2 information: non-slab/vmalloc memory
    2023-04-06T06:28:01.809035  kern  :alert : Register r3 information: non-paged memory
    2023-04-06T06:28:01.809599  kern  :alert : Register r4 infor<8><LAVA_SIGNAL_TESTCASE TEST_CASE_ID=alert RESULT=fail UNITS=lines MEASUREMENT=18> 
    ... (3 line(s) more)  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
hp-x360-12b-c...4020-octopus | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...6-chromebook | 1          

  Details:     https://kernelci.org/test/plan/id/642e66f3290cfa954879e959

  Results:     6 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/x86_64/x86_64_defconfig+x86-chromebook/gcc-10/lab-collabora/baseline-hp-x360-12b-ca0010nr-n4020-octopus.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/x86_64/x86_64_defconfig+x86-chromebook/gcc-10/lab-collabora/baseline-hp-x360-12b-ca0010nr-n4020-octopus.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230324.0/x86/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/642e66f3290cfa954879e95e
        failing since 8 days (last pass: v6.3-rc3-370-g8269040171a02, first fail: v6.3-rc4-214-g39ee5bf6e049)

    2023-04-06T06:30:02.058012  + <8>[   10.706574] <LAVA_SIGNAL_ENDRUN 0_dmesg 9892382_1.4.2.3.1>

    2023-04-06T06:30:02.058411  set +x

    2023-04-06T06:30:02.164236  #

    2023-04-06T06:30:02.265337  / # #export SHELL=/bin/sh

    2023-04-06T06:30:02.265505  

    2023-04-06T06:30:02.366561  / # export SHELL=/bin/sh. /lava-9892382/environment

    2023-04-06T06:30:02.367320  

    2023-04-06T06:30:02.468964  / # . /lava-9892382/environment/lava-9892382/bin/lava-test-runner /lava-9892382/1

    2023-04-06T06:30:02.469257  

    2023-04-06T06:30:02.474101  / # /lava-9892382/bin/lava-test-runner /lava-9892382/1
 
    ... (12 line(s) more)  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
hp-x360-12b-c...4020-octopus | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...ebook+amdgpu | 1          

  Details:     https://kernelci.org/test/plan/id/642e690e7dbf4e9eab79e985

  Results:     6 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook+amdgpu
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/x86_64/x86_64_defconfig+x86-chromebook+amdgpu/gcc-10/lab-collabora/baseline-hp-x360-12b-ca0010nr-n4020-octopus.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/x86_64/x86_64_defconfig+x86-chromebook+amdgpu/gcc-10/lab-collabora/baseline-hp-x360-12b-ca0010nr-n4020-octopus.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230324.0/x86/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/642e690e7dbf4e9eab79e98a
        failing since 8 days (last pass: v6.3-rc3-550-g902f54bbd6c7, first fail: v6.3-rc4-214-g39ee5bf6e049)

    2023-04-06T06:38:55.278214  + <8>[   10.836271] <LAVA_SIGNAL_ENDRUN 0_dmesg 9892601_1.4.2.3.1>

    2023-04-06T06:38:55.278299  set +x

    2023-04-06T06:38:55.379861  #

    2023-04-06T06:38:55.481218  / # #export SHELL=/bin/sh

    2023-04-06T06:38:55.481428  

    2023-04-06T06:38:55.582428  / # export SHELL=/bin/sh. /lava-9892601/environment

    2023-04-06T06:38:55.582625  

    2023-04-06T06:38:55.683671  / # . /lava-9892601/environment/lava-9892601/bin/lava-test-runner /lava-9892601/1

    2023-04-06T06:38:55.683970  

    2023-04-06T06:38:55.688784  / # /lava-9892601/bin/lava-test-runner /lava-9892601/1
 
    ... (12 line(s) more)  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
hp-x360-12b-c...4020-octopus | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...ok+kselftest | 1          

  Details:     https://kernelci.org/test/plan/id/642e6af9e73453e70c79e993

  Results:     6 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook+kselftest
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/x86_64/x86_64_defconfig+x86-chromebook+kselftest/gcc-10/lab-collabora/baseline-hp-x360-12b-ca0010nr-n4020-octopus.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/x86_64/x86_64_defconfig+x86-chromebook+kselftest/gcc-10/lab-collabora/baseline-hp-x360-12b-ca0010nr-n4020-octopus.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230324.0/x86/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/642e6af9e73453e70c79e998
        failing since 6 days (last pass: v6.3-rc3-550-g902f54bbd6c7, first fail: v6.3-rc4-334-g60f00557d56b)

    2023-04-06T06:46:57.361795  + set +x<8>[   15.297257] <LAVA_SIGNAL_ENDRUN 0_dmesg 9892947_1.4.2.3.1>

    2023-04-06T06:46:57.361886  

    2023-04-06T06:46:57.467754  / # #

    2023-04-06T06:46:57.568750  export SHELL=/bin/sh

    2023-04-06T06:46:57.568959  #

    2023-04-06T06:46:57.669927  / # export SHELL=/bin/sh. /lava-9892947/environment

    2023-04-06T06:46:57.670139  

    2023-04-06T06:46:57.771134  / # . /lava-9892947/environment/lava-9892947/bin/lava-test-runner /lava-9892947/1

    2023-04-06T06:46:57.771434  

    2023-04-06T06:46:57.776510  / # /lava-9892947/bin/lava-test-runner /lava-9892947/1
 
    ... (12 line(s) more)  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
hp-x360-14-G1-sona           | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...6-chromebook | 1          

  Details:     https://kernelci.org/test/plan/id/642e66d54ea8a9b82a79e962

  Results:     6 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/x86_64/x86_64_defconfig+x86-chromebook/gcc-10/lab-collabora/baseline-hp-x360-14-G1-sona.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/x86_64/x86_64_defconfig+x86-chromebook/gcc-10/lab-collabora/baseline-hp-x360-14-G1-sona.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230324.0/x86/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/642e66d54ea8a9b82a79e967
        failing since 8 days (last pass: v6.3-rc3-370-g8269040171a02, first fail: v6.3-rc4-214-g39ee5bf6e049)

    2023-04-06T06:29:25.730021  <8>[   10.589315] <LAVA_SIGNAL_ENDRUN 0_dmesg 9892368_1.4.2.3.1>

    2023-04-06T06:29:25.733774  + set +x

    2023-04-06T06:29:25.840284  

    2023-04-06T06:29:25.942443  / # #export SHELL=/bin/sh

    2023-04-06T06:29:25.943106  

    2023-04-06T06:29:26.044882  / # export SHELL=/bin/sh. /lava-9892368/environment

    2023-04-06T06:29:26.045692  

    2023-04-06T06:29:26.147457  / # . /lava-9892368/environment/lava-9892368/bin/lava-test-runner /lava-9892368/1

    2023-04-06T06:29:26.148861  

    2023-04-06T06:29:26.153657  / # /lava-9892368/bin/lava-test-runner /lava-9892368/1
 
    ... (12 line(s) more)  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
hp-x360-14-G1-sona           | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...ebook+amdgpu | 1          

  Details:     https://kernelci.org/test/plan/id/642e68e5fc94438a4579e937

  Results:     6 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook+amdgpu
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/x86_64/x86_64_defconfig+x86-chromebook+amdgpu/gcc-10/lab-collabora/baseline-hp-x360-14-G1-sona.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/x86_64/x86_64_defconfig+x86-chromebook+amdgpu/gcc-10/lab-collabora/baseline-hp-x360-14-G1-sona.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230324.0/x86/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/642e68e5fc94438a4579e93c
        failing since 8 days (last pass: v6.3-rc3-550-g902f54bbd6c7, first fail: v6.3-rc4-214-g39ee5bf6e049)

    2023-04-06T06:38:13.660362  <8>[   10.244823] <LAVA_SIGNAL_ENDRUN 0_dmesg 9892570_1.4.2.3.1>

    2023-04-06T06:38:13.663840  + set +x

    2023-04-06T06:38:13.765429  #

    2023-04-06T06:38:13.765683  

    2023-04-06T06:38:13.866686  / # #export SHELL=/bin/sh

    2023-04-06T06:38:13.866879  

    2023-04-06T06:38:13.967762  / # export SHELL=/bin/sh. /lava-9892570/environment

    2023-04-06T06:38:13.967935  

    2023-04-06T06:38:14.068847  / # . /lava-9892570/environment/lava-9892570/bin/lava-test-runner /lava-9892570/1

    2023-04-06T06:38:14.069143  
 
    ... (13 line(s) more)  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
hp-x360-14-G1-sona           | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...ok+kselftest | 1          

  Details:     https://kernelci.org/test/plan/id/642e6bda5de170036479e958

  Results:     6 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook+kselftest
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/x86_64/x86_64_defconfig+x86-chromebook+kselftest/gcc-10/lab-collabora/baseline-hp-x360-14-G1-sona.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/x86_64/x86_64_defconfig+x86-chromebook+kselftest/gcc-10/lab-collabora/baseline-hp-x360-14-G1-sona.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230324.0/x86/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/642e6bdb5de170036479e95d
        failing since 6 days (last pass: v6.3-rc3-550-g902f54bbd6c7, first fail: v6.3-rc4-334-g60f00557d56b)

    2023-04-06T06:50:58.460702  + set<8>[   12.700068] <LAVA_SIGNAL_ENDRUN 0_dmesg 9892971_1.4.2.3.1>

    2023-04-06T06:50:58.461220   +x

    2023-04-06T06:50:58.568907  / # #

    2023-04-06T06:50:58.671221  export SHELL=/bin/sh

    2023-04-06T06:50:58.671372  #

    2023-04-06T06:50:58.772278  / # export SHELL=/bin/sh. /lava-9892971/environment

    2023-04-06T06:50:58.772416  

    2023-04-06T06:50:58.873279  / # . /lava-9892971/environment/lava-9892971/bin/lava-test-runner /lava-9892971/1

    2023-04-06T06:50:58.873599  

    2023-04-06T06:50:58.878711  / # /lava-9892971/bin/lava-test-runner /lava-9892971/1
 
    ... (12 line(s) more)  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
hp-x360-14a-cb0001xx-zork    | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...6-chromebook | 1          

  Details:     https://kernelci.org/test/plan/id/642e66e68298968fc379e932

  Results:     6 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/x86_64/x86_64_defconfig+x86-chromebook/gcc-10/lab-collabora/baseline-hp-x360-14a-cb0001xx-zork.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/x86_64/x86_64_defconfig+x86-chromebook/gcc-10/lab-collabora/baseline-hp-x360-14a-cb0001xx-zork.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230324.0/x86/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/642e66e68298968fc379e937
        failing since 8 days (last pass: v6.3-rc3-370-g8269040171a02, first fail: v6.3-rc4-214-g39ee5bf6e049)

    2023-04-06T06:29:40.526023  + set<8>[   11.103736] <LAVA_SIGNAL_ENDRUN 0_dmesg 9892356_1.4.2.3.1>

    2023-04-06T06:29:40.526145   +x

    2023-04-06T06:29:40.630654  / # #

    2023-04-06T06:29:40.731711  export SHELL=/bin/sh

    2023-04-06T06:29:40.731944  #

    2023-04-06T06:29:40.832870  / # export SHELL=/bin/sh. /lava-9892356/environment

    2023-04-06T06:29:40.833110  

    2023-04-06T06:29:40.933954  / # . /lava-9892356/environment/lava-9892356/bin/lava-test-runner /lava-9892356/1

    2023-04-06T06:29:40.934248  

    2023-04-06T06:29:40.939314  / # /lava-9892356/bin/lava-test-runner /lava-9892356/1
 
    ... (12 line(s) more)  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
hp-x360-14a-cb0001xx-zork    | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...ebook+amdgpu | 1          

  Details:     https://kernelci.org/test/plan/id/642e68ee21750ef82179e946

  Results:     6 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook+amdgpu
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/x86_64/x86_64_defconfig+x86-chromebook+amdgpu/gcc-10/lab-collabora/baseline-hp-x360-14a-cb0001xx-zork.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/x86_64/x86_64_defconfig+x86-chromebook+amdgpu/gcc-10/lab-collabora/baseline-hp-x360-14a-cb0001xx-zork.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230324.0/x86/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/642e68ee21750ef82179e94b
        failing since 8 days (last pass: v6.3-rc3-550-g902f54bbd6c7, first fail: v6.3-rc4-214-g39ee5bf6e049)

    2023-04-06T06:38:18.126982  + <8>[   10.651468] <LAVA_SIGNAL_ENDRUN 0_dmesg 9892576_1.4.2.3.1>

    2023-04-06T06:38:18.127092  set +x

    2023-04-06T06:38:18.231770  / # #

    2023-04-06T06:38:18.332798  export SHELL=/bin/sh

    2023-04-06T06:38:18.332978  #

    2023-04-06T06:38:18.433874  / # export SHELL=/bin/sh. /lava-9892576/environment

    2023-04-06T06:38:18.434052  

    2023-04-06T06:38:18.535016  / # . /lava-9892576/environment/lava-9892576/bin/lava-test-runner /lava-9892576/1

    2023-04-06T06:38:18.535313  

    2023-04-06T06:38:18.539893  / # /lava-9892576/bin/lava-test-runner /lava-9892576/1
 
    ... (12 line(s) more)  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
hp-x360-14a-cb0001xx-zork    | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...ok+kselftest | 1          

  Details:     https://kernelci.org/test/plan/id/642e6ac2ccd5847e3279e92e

  Results:     5 PASS, 2 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook+kselftest
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/x86_64/x86_64_defconfig+x86-chromebook+kselftest/gcc-10/lab-collabora/baseline-hp-x360-14a-cb0001xx-zork.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/x86_64/x86_64_defconfig+x86-chromebook+kselftest/gcc-10/lab-collabora/baseline-hp-x360-14a-cb0001xx-zork.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230324.0/x86/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/642e6ac2ccd5847e3279e933
        failing since 6 days (last pass: v6.3-rc3-550-g902f54bbd6c7, first fail: v6.3-rc4-334-g60f00557d56b)

    2023-04-06T06:46:17.433831  + set +x

    2023-04-06T06:46:17.437181  <8>[   14.210546] <LAVA_SIGNAL_ENDRUN 0_dmesg 9892949_1.4.2.3.1>

    2023-04-06T06:46:17.542895  / # #

    2023-04-06T06:46:17.643775  export SHELL=/bin/sh

    2023-04-06T06:46:17.643975  #

    2023-04-06T06:46:17.744934  / # export SHELL=/bin/sh. /lava-9892949/environment

    2023-04-06T06:46:17.745172  

    2023-04-06T06:46:17.846161  / # . /lava-9892949/environment/lava-9892949/bin/lava-test-runner /lava-9892949/1

    2023-04-06T06:46:17.846540  

    2023-04-06T06:46:17.850998  / # /lava-9892949/bin/lava-test-runner /lava-9892949/1
 
    ... (12 line(s) more)  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
imx6dl-udoo                  | arm    | lab-broonie     | gcc-10   | multi_v7_defconfig           | 2          

  Details:     https://kernelci.org/test/plan/id/642e68775419fd44e979e968

  Results:     29 PASS, 4 FAIL, 1 SKIP
  Full config: multi_v7_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm/multi_v7_defconfig/gcc-10/lab-broonie/baseline-imx6dl-udoo.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm/multi_v7_defconfig/gcc-10/lab-broonie/baseline-imx6dl-udoo.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230324.0/armel/rootfs.cpio.gz 

  * baseline.bootrr.sound-card: https://kernelci.org/test/case/id/642e68775419fd44e979e971
        new failure (last pass: v6.3-rc5-258-g0f20c88b6871)

    2023-04-06T06:36:17.897438  /lava-289813/1/../bin/lava-test-case
    2023-04-06T06:36:17.925042  <8>[   26.574101] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=sound-card RESULT=fail>   

  * baseline.bootrr.sound-card-probed: https://kernelci.org/test/case/id/642e68775419fd44e979e972
        new failure (last pass: v6.3-rc5-258-g0f20c88b6871)

    2023-04-06T06:36:16.846566  /lava-289813/1/../bin/lava-test-case
    2023-04-06T06:36:16.875518  <8>[   25.523781] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=sound-card-probed RESULT=fail>   

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
imx6qp-wandboard-revd1       | arm    | lab-pengutronix | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/642e6b947d62e16b4079e92e

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm/multi_v7_defconfig+debug/gcc-10/lab-pengutronix/baseline-imx6qp-wandboard-revd1.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm/multi_v7_defconfig+debug/gcc-10/lab-pengutronix/baseline-imx6qp-wandboard-revd1.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230324.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/642e6b957d62e16b4079e92f
        failing since 202 days (last pass: v6.0-rc4-291-g83a56f559828, first fail: v6.0-rc5-197-ga6a750a2f4166) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
jetson-tk1                   | arm    | lab-baylibre    | gcc-10   | multi_v7_defc...G_ARM_LPAE=y | 1          

  Details:     https://kernelci.org/test/plan/id/642e6a5a02be86a2e879e930

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm/multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y/gcc-10/lab-baylibre/baseline-jetson-tk1.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm/multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y/gcc-10/lab-baylibre/baseline-jetson-tk1.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230324.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/642e6a5a02be86a2e879e931
        failing since 341 days (last pass: v5.18-rc2-366-ga3e1163f7eb1a, first fail: v5.18-rc4-464-g425675974eb3) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
jh7100-starfi...isionfive-v1 | riscv  | lab-clabbe      | gcc-10   | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/642e68207886daac7079e97f

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (riscv64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/riscv/defconfig+kselftest/gcc-10/lab-clabbe/baseline-jh7100-starfive-visionfive-v1.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/riscv/defconfig+kselftest/gcc-10/lab-clabbe/baseline-jh7100-starfive-visionfive-v1.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230324.0/riscv/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/642e68207886daac7079e980
        failing since 58 days (last pass: v6.2-rc7-120-g11b3628314a5, first fail: v6.2-rc7-136-g39693c3ba989) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
lenovo-TPad-C13-Yoga-zork    | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...6-chromebook | 1          

  Details:     https://kernelci.org/test/plan/id/642e66f01c73e21ac579e983

  Results:     6 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/x86_64/x86_64_defconfig+x86-chromebook/gcc-10/lab-collabora/baseline-lenovo-TPad-C13-Yoga-zork.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/x86_64/x86_64_defconfig+x86-chromebook/gcc-10/lab-collabora/baseline-lenovo-TPad-C13-Yoga-zork.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230324.0/x86/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/642e66f01c73e21ac579e988
        failing since 8 days (last pass: v6.3-rc3-370-g8269040171a02, first fail: v6.3-rc4-214-g39ee5bf6e049)

    2023-04-06T06:29:48.358860  <8>[   12.039682] <LAVA_SIGNAL_ENDRUN 0_dmesg 9892363_1.4.2.3.1>

    2023-04-06T06:29:48.463386  / # #

    2023-04-06T06:29:48.564303  export SHELL=/bin/sh

    2023-04-06T06:29:48.564449  #

    2023-04-06T06:29:48.665296  / # export SHELL=/bin/sh. /lava-9892363/environment

    2023-04-06T06:29:48.665472  

    2023-04-06T06:29:48.766341  / # . /lava-9892363/environment/lava-9892363/bin/lava-test-runner /lava-9892363/1

    2023-04-06T06:29:48.766626  

    2023-04-06T06:29:48.771180  / # /lava-9892363/bin/lava-test-runner /lava-9892363/1

    2023-04-06T06:29:48.777581  + export 'TESTRUN_ID=1_bootrr'
 
    ... (11 line(s) more)  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
lenovo-TPad-C13-Yoga-zork    | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...ebook+amdgpu | 1          

  Details:     https://kernelci.org/test/plan/id/642e68dc293819b0b779e995

  Results:     6 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook+amdgpu
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/x86_64/x86_64_defconfig+x86-chromebook+amdgpu/gcc-10/lab-collabora/baseline-lenovo-TPad-C13-Yoga-zork.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/x86_64/x86_64_defconfig+x86-chromebook+amdgpu/gcc-10/lab-collabora/baseline-lenovo-TPad-C13-Yoga-zork.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230324.0/x86/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/642e68dc293819b0b779e99a
        failing since 8 days (last pass: v6.3-rc3-550-g902f54bbd6c7, first fail: v6.3-rc4-214-g39ee5bf6e049)

    2023-04-06T06:38:05.844004  + <8>[   10.979072] <LAVA_SIGNAL_ENDRUN 0_dmesg 9892571_1.4.2.3.1>

    2023-04-06T06:38:05.844103  set +x

    2023-04-06T06:38:05.949174  / # #

    2023-04-06T06:38:06.050293  export SHELL=/bin/sh

    2023-04-06T06:38:06.050512  #

    2023-04-06T06:38:06.151439  / # export SHELL=/bin/sh. /lava-9892571/environment

    2023-04-06T06:38:06.151653  

    2023-04-06T06:38:06.252584  / # . /lava-9892571/environment/lava-9892571/bin/lava-test-runner /lava-9892571/1

    2023-04-06T06:38:06.252921  

    2023-04-06T06:38:06.257156  / # /lava-9892571/bin/lava-test-runner /lava-9892571/1
 
    ... (12 line(s) more)  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
lenovo-TPad-C13-Yoga-zork    | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...ok+kselftest | 1          

  Details:     https://kernelci.org/test/plan/id/642e6ab0f501bd547379e93f

  Results:     6 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook+kselftest
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/x86_64/x86_64_defconfig+x86-chromebook+kselftest/gcc-10/lab-collabora/baseline-lenovo-TPad-C13-Yoga-zork.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/x86_64/x86_64_defconfig+x86-chromebook+kselftest/gcc-10/lab-collabora/baseline-lenovo-TPad-C13-Yoga-zork.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230324.0/x86/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/642e6ab0f501bd547379e944
        failing since 6 days (last pass: v6.3-rc3-550-g902f54bbd6c7, first fail: v6.3-rc4-334-g60f00557d56b)

    2023-04-06T06:45:56.553304  + set +x

    2023-04-06T06:45:56.556537  <8>[   14.194492] <LAVA_SIGNAL_ENDRUN 0_dmesg 9892973_1.4.2.3.1>

    2023-04-06T06:45:56.662037  / # #

    2023-04-06T06:45:56.763082  export SHELL=/bin/sh

    2023-04-06T06:45:56.763290  #

    2023-04-06T06:45:56.864228  / # export SHELL=/bin/sh. /lava-9892973/environment

    2023-04-06T06:45:56.864517  

    2023-04-06T06:45:56.965436  / # . /lava-9892973/environment/lava-9892973/bin/lava-test-runner /lava-9892973/1

    2023-04-06T06:45:56.965726  

    2023-04-06T06:45:56.970533  / # /lava-9892973/bin/lava-test-runner /lava-9892973/1
 
    ... (12 line(s) more)  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
meson-g12a-u200              | arm64  | lab-baylibre    | gcc-10   | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/642e6c503282385c5079e941

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-g12a-u200.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-g12a-u200.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230324.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/642e6c503282385c5079e942
        failing since 58 days (last pass: v6.2-rc7-120-g11b3628314a5, first fail: v6.2-rc7-136-g39693c3ba989) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
meson-g12a-x96-max           | arm64  | lab-baylibre    | gcc-10   | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/642e6cf541fcfdb23a79e922

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-g12a-x96-max.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-g12a-x96-max.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230324.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/642e6cf541fcfdb23a79e923
        failing since 58 days (last pass: v6.2-rc7-120-g11b3628314a5, first fail: v6.2-rc7-136-g39693c3ba989) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
meson-g12b-a311d-khadas-vim3 | arm64  | lab-collabora   | gcc-10   | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/642e6aff0985cb647979e955

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm64/defconfig+kselftest/gcc-10/lab-collabora/baseline-meson-g12b-a311d-khadas-vim3.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm64/defconfig+kselftest/gcc-10/lab-collabora/baseline-meson-g12b-a311d-khadas-vim3.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230324.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/642e6aff0985cb647979e956
        failing since 58 days (last pass: v6.2-rc7-120-g11b3628314a5, first fail: v6.2-rc7-136-g39693c3ba989) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
meson-gxbb-nanopi-k2         | arm64  | lab-baylibre    | gcc-10   | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/642e6bb7ecf421d0a379e949

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-gxbb-nanopi-k2.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-gxbb-nanopi-k2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230324.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/642e6bb7ecf421d0a379e94a
        failing since 58 days (last pass: v6.2-rc7-120-g11b3628314a5, first fail: v6.2-rc7-136-g39693c3ba989) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
meson-gxl-s905d-p230         | arm64  | lab-baylibre    | gcc-10   | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/642e6c9388c1ad50b679e927

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-gxl-s905d-p230.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-gxl-s905d-p230.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230324.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/642e6c9388c1ad50b679e928
        failing since 58 days (last pass: v6.2-rc6-351-gf42837eac380f, first fail: v6.2-rc7-136-g39693c3ba989) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
meson-gxl-s905x-khadas-vim   | arm64  | lab-baylibre    | gcc-10   | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/642e6bbcecf421d0a379e94f

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-gxl-s905x-khadas-vim.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-gxl-s905x-khadas-vim.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230324.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/642e6bbcecf421d0a379e950
        failing since 58 days (last pass: v6.2-rc7-120-g11b3628314a5, first fail: v6.2-rc7-136-g39693c3ba989) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
meson-gxl-s905x-libretech-cc | arm64  | lab-baylibre    | gcc-10   | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/642e6b5d58fd8c458079e93d

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-gxl-s905x-libretech-cc.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-gxl-s905x-libretech-cc.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230324.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/642e6b5d58fd8c458079e93e
        failing since 58 days (last pass: v6.2-rc7-120-g11b3628314a5, first fail: v6.2-rc7-136-g39693c3ba989) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
meson-gxl-s905x-libretech-cc | arm64  | lab-broonie     | gcc-10   | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/642e69ca3a8d1233b079e948

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm64/defconfig+kselftest/gcc-10/lab-broonie/baseline-meson-gxl-s905x-libretech-cc.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm64/defconfig+kselftest/gcc-10/lab-broonie/baseline-meson-gxl-s905x-libretech-cc.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230324.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/642e69ca3a8d1233b079e949
        failing since 58 days (last pass: v6.2-rc7-120-g11b3628314a5, first fail: v6.2-rc7-136-g39693c3ba989) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
meson-gxm-khadas-vim2        | arm64  | lab-baylibre    | gcc-10   | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/642e6a4cd6143e855879e930

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-gxm-khadas-vim2.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-gxm-khadas-vim2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230324.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/642e6a4cd6143e855879e931
        failing since 58 days (last pass: v6.2-rc7-120-g11b3628314a5, first fail: v6.2-rc7-136-g39693c3ba989) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
meson-gxm-q200               | arm64  | lab-baylibre    | gcc-10   | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/642e78f58b12dc6aa879e981

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-gxm-q200.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-gxm-q200.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230324.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/642e78f58b12dc6aa879e982
        failing since 66 days (last pass: v6.2-rc5-286-g436294605dc5, first fail: v6.2-rc6-199-g0a49732f057b) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
meson-sm1-khadas-vim3l       | arm64  | lab-baylibre    | gcc-10   | defconfig+CON...BIG_ENDIAN=y | 1          

  Details:     https://kernelci.org/test/plan/id/642e6f8464a6bbe80b79e938

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+CONFIG_CPU_BIG_ENDIAN=y
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm64/defconfig+CONFIG_CPU_BIG_ENDIAN=y/gcc-10/lab-baylibre/baseline-meson-sm1-khadas-vim3l.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm64/defconfig+CONFIG_CPU_BIG_ENDIAN=y/gcc-10/lab-baylibre/baseline-meson-sm1-khadas-vim3l.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230324.0/arm64be/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/642e6f8464a6bbe80b79e93d
        failing since 6 days (last pass: v6.3-rc4-271-g7827aece40de, first fail: v6.3-rc4-334-g60f00557d56b)

    2023-04-06T07:06:26.206859  / # #
    2023-04-06T07:06:26.309719  export SHELL=/bin/sh
    2023-04-06T07:06:26.310610  #
    2023-04-06T07:06:26.412379  / # export SHELL=/bin/sh. /lava-3475725/environment
    2023-04-06T07:06:26.412812  
    2023-04-06T07:06:26.514078  / # . /lava-3475725/environment/lava-3475725/bin/lava-test-runner /lava-3475725/1
    2023-04-06T07:06:26.514732  
    2023-04-06T07:06:26.529742  / # /lava-3475725/bin/lava-test-runner /lava-3475725/1
    2023-04-06T07:06:26.584791  + export 'TESTRUN_ID=1_bootrr'
    2023-04-06T07:06:26.585094  + cd /lava-3475725/1/tests/1_bootrr 
    ... (16 line(s) more)  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
mt8173-elm-hana              | arm64  | lab-collabora   | gcc-10   | defconfig+arm...ok+kselftest | 1          

  Details:     https://kernelci.org/test/plan/id/642e6b016835f0d23f79e945

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm64/defconfig+arm64-chromebook+kselftest/gcc-10/lab-collabora/baseline-mt8173-elm-hana.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm64/defconfig+arm64-chromebook+kselftest/gcc-10/lab-collabora/baseline-mt8173-elm-hana.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230324.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/642e6b016835f0d23f79e946
        failing since 72 days (last pass: v6.2-rc5-157-g1f16e03afb18, first fail: v6.2-rc5-174-gc5f142de047d) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
mt8183-kukui-...uniper-sku16 | arm64  | lab-collabora   | gcc-10   | defconfig+arm...ok+kselftest | 1          

  Details:     https://kernelci.org/test/plan/id/642e6ce1174a3d4b0c79e934

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm64/defconfig+arm64-chromebook+kselftest/gcc-10/lab-collabora/baseline-mt8183-kukui-jacuzzi-juniper-sku16.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm64/defconfig+arm64-chromebook+kselftest/gcc-10/lab-collabora/baseline-mt8183-kukui-jacuzzi-juniper-sku16.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230324.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/642e6ce1174a3d4b0c79e935
        failing since 58 days (last pass: v6.2-rc7-120-g11b3628314a5, first fail: v6.2-rc7-136-g39693c3ba989) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
mt8183-kukui-...uniper-sku16 | arm64  | lab-collabora   | gcc-10   | defconfig+arm64-chromebook   | 3          

  Details:     https://kernelci.org/test/plan/id/642e6d4819431b56f679e950

  Results:     166 PASS, 6 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-mt8183-kukui-jacuzzi-juniper-sku16.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-mt8183-kukui-jacuzzi-juniper-sku16.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230324.0/arm64/rootfs.cpio.gz 

  * baseline.bootrr.panel-edp-probed: https://kernelci.org/test/case/id/642e6d4819431b56f679e9a0
        failing since 43 days (last pass: v6.2-rc8-211-g05def2d212c6, first fail: v6.2-3304-g34939120e353)

    2023-04-06T06:56:58.067521  /lava-9892905/1/../bin/lava-test-case

    2023-04-06T06:56:58.077593  <8>[   23.431148] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=panel-edp-probed RESULT=fail>

  * baseline.bootrr.clk-mt8183-infracfg-probed: https://kernelci.org/test/case/id/642e6d4819431b56f679e9f2
        failing since 38 days (last pass: v6.2-8700-gab98cc06b683, first fail: v6.2-12625-g13efc3a9f23b)

    2023-04-06T06:56:54.016575  <3>[   19.374083] Bluetooth: hci0: Opcode 0x1002 failed: -110

    2023-04-06T06:56:54.023265  <3>[   19.374207] Bluetooth: hci0: command 0x1002 tx timeout

    2023-04-06T06:56:54.171189  /lava-9892905/1/../bin/lava-test-case

    2023-04-06T06:56:54.180920  <8>[   19.534992] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=clk-mt8183-infracfg-probed RESULT=fail>

  * baseline.bootrr.clk-mt8183-pericfg-probed: https://kernelci.org/test/case/id/642e6d4819431b56f679e9f9
        failing since 38 days (last pass: v6.2-8700-gab98cc06b683, first fail: v6.2-12625-g13efc3a9f23b)

    2023-04-06T06:56:55.199032  /lava-9892905/1/../bin/lava-test-case

    2023-04-06T06:56:55.208989  <8>[   20.563520] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=clk-mt8183-pericfg-probed RESULT=fail>

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
mt8183-kukui-...uniper-sku16 | arm64  | lab-collabora   | gcc-10   | defconfig+arm...ook+videodec | 3          

  Details:     https://kernelci.org/test/plan/id/642e6dc07e399feb4679e922

  Results:     166 PASS, 6 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook+videodec
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm64/defconfig+arm64-chromebook+videodec/gcc-10/lab-collabora/baseline-mt8183-kukui-jacuzzi-juniper-sku16.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm64/defconfig+arm64-chromebook+videodec/gcc-10/lab-collabora/baseline-mt8183-kukui-jacuzzi-juniper-sku16.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230324.0/arm64/rootfs.cpio.gz 

  * baseline.bootrr.panel-edp-probed: https://kernelci.org/test/case/id/642e6dc07e399feb4679e972
        failing since 41 days (last pass: v6.2-1218-g2d4a54ee969d, first fail: v6.2-8700-gab98cc06b683)

    2023-04-06T06:58:55.377275  /lava-9893005/1/../bin/lava-test-case

    2023-04-06T06:58:55.384035  <8>[   23.500075] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=panel-edp-probed RESULT=fail>

  * baseline.bootrr.clk-mt8183-pericfg-probed: https://kernelci.org/test/case/id/642e6dc07e399feb4679e9c4
        failing since 31 days (last pass: v6.2-8700-gab98cc06b683, first fail: v6.2-13684-gf93c476d9769)

    2023-04-06T06:58:52.510660  /lava-9893005/1/../bin/lava-test-case

    2023-04-06T06:58:52.521262  <8>[   20.635521] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=clk-mt8183-pericfg-probed RESULT=fail>

  * baseline.bootrr.clk-mt8183-infracfg-probed: https://kernelci.org/test/case/id/642e6dc07e399feb4679e9c5
        failing since 31 days (last pass: v6.2-8700-gab98cc06b683, first fail: v6.2-13684-gf93c476d9769)

    2023-04-06T06:58:51.483095  /lava-9893005/1/../bin/lava-test-case

    2023-04-06T06:58:51.493454  <8>[   19.607893] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=clk-mt8183-infracfg-probed RESULT=fail>

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
mt8192-asurada-spherion-r0   | arm64  | lab-collabora   | gcc-10   | defconfig+arm64-chromebook   | 3          

  Details:     https://kernelci.org/test/plan/id/642e6b29e9eb0a7b4279e948

  Results:     177 PASS, 9 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-mt8192-asurada-spherion-r0.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-mt8192-asurada-spherion-r0.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230324.0/arm64/rootfs.cpio.gz 

  * baseline.bootrr.clk-mt8192-pericfg-probed: https://kernelci.org/test/case/id/642e6b29e9eb0a7b4279e9f8
        failing since 38 days (last pass: v6.2-8700-gab98cc06b683, first fail: v6.2-12625-g13efc3a9f23b)

    2023-04-06T06:47:42.501820  /lava-9892938/1/../bin/lava-test-case

    2023-04-06T06:47:42.508303  <8>[   20.925566] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=clk-mt8192-pericfg-probed RESULT=fail>

  * baseline.bootrr.clk-mt8192-infracfg-probed: https://kernelci.org/test/case/id/642e6b29e9eb0a7b4279e9f9
        failing since 38 days (last pass: v6.2-8700-gab98cc06b683, first fail: v6.2-12625-g13efc3a9f23b)

    2023-04-06T06:47:41.482362  /lava-9892938/1/../bin/lava-test-case

    2023-04-06T06:47:41.488839  <8>[   19.905901] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=clk-mt8192-infracfg-probed RESULT=fail>

  * baseline.bootrr.clk-mt8192-topckgen-probed: https://kernelci.org/test/case/id/642e6b29e9eb0a7b4279e9fa
        failing since 38 days (last pass: v6.2-8700-gab98cc06b683, first fail: v6.2-12625-g13efc3a9f23b)

    2023-04-06T06:47:40.462917  /lava-9892938/1/../bin/lava-test-case

    2023-04-06T06:47:40.469526  <8>[   18.886347] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=clk-mt8192-topckgen-probed RESULT=fail>

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
mt8192-asurada-spherion-r0   | arm64  | lab-collabora   | gcc-10   | defconfig+arm...ok+kselftest | 1          

  Details:     https://kernelci.org/test/plan/id/642e6b3f128a43321279e967

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm64/defconfig+arm64-chromebook+kselftest/gcc-10/lab-collabora/baseline-mt8192-asurada-spherion-r0.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm64/defconfig+arm64-chromebook+kselftest/gcc-10/lab-collabora/baseline-mt8192-asurada-spherion-r0.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230324.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/642e6b3f128a43321279e968
        failing since 58 days (last pass: v6.2-rc7-120-g11b3628314a5, first fail: v6.2-rc7-136-g39693c3ba989) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
mt8192-asurada-spherion-r0   | arm64  | lab-collabora   | gcc-10   | defconfig+arm...ook+videodec | 3          

  Details:     https://kernelci.org/test/plan/id/642e6bc81c78b0696979e928

  Results:     177 PASS, 9 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook+videodec
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm64/defconfig+arm64-chromebook+videodec/gcc-10/lab-collabora/baseline-mt8192-asurada-spherion-r0.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm64/defconfig+arm64-chromebook+videodec/gcc-10/lab-collabora/baseline-mt8192-asurada-spherion-r0.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230324.0/arm64/rootfs.cpio.gz 

  * baseline.bootrr.clk-mt8192-infracfg-probed: https://kernelci.org/test/case/id/642e6bc91c78b0696979e9c5
        failing since 34 days (last pass: v6.2-8700-gab98cc06b683, first fail: v6.2-13370-g5872d227b73f)

    2023-04-06T06:50:14.915019  /lava-9893024/1/../bin/lava-test-case

    2023-04-06T06:50:14.921663  <8>[   19.931003] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=clk-mt8192-infracfg-probed RESULT=fail>

  * baseline.bootrr.clk-mt8192-topckgen-probed: https://kernelci.org/test/case/id/642e6bc91c78b0696979e9c6
        failing since 34 days (last pass: v6.2-8700-gab98cc06b683, first fail: v6.2-13370-g5872d227b73f)

    2023-04-06T06:50:13.895896  /lava-9893024/1/../bin/lava-test-case

    2023-04-06T06:50:13.902193  <8>[   18.911167] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=clk-mt8192-topckgen-probed RESULT=fail>

  * baseline.bootrr.clk-mt8192-pericfg-probed: https://kernelci.org/test/case/id/642e6bc91c78b0696979e9d8
        failing since 34 days (last pass: v6.2-8700-gab98cc06b683, first fail: v6.2-13370-g5872d227b73f)

    2023-04-06T06:50:15.935210  /lava-9893024/1/../bin/lava-test-case

    2023-04-06T06:50:15.941413  <8>[   20.950736] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=clk-mt8192-pericfg-probed RESULT=fail>

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
ox820-clouden...lug-series-3 | arm    | lab-baylibre    | gcc-10   | oxnas_v6_defconfig           | 1          

  Details:     https://kernelci.org/test/plan/id/642e6750e5e6b27caf79e942

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: oxnas_v6_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm/oxnas_v6_defconfig/gcc-10/lab-baylibre/baseline-ox820-cloudengines-pogoplug-series-3.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm/oxnas_v6_defconfig/gcc-10/lab-baylibre/baseline-ox820-cloudengines-pogoplug-series-3.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230324.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/642e6750e5e6b27caf79e943
        failing since 176 days (last pass: v6.0-9666-g02c05e0b8d5c, first fail: v6.0-11312-g1778d6da389c) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
qcom-qdf2400                 | arm64  | lab-linaro-lkft | gcc-10   | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/642e94708e8ea77eda79e92e

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm64/defconfig+kselftest/gcc-10/lab-linaro-lkft/baseline-qcom-qdf2400.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm64/defconfig+kselftest/gcc-10/lab-linaro-lkft/baseline-qcom-qdf2400.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230324.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/642e94708e8ea77eda79e92f
        failing since 58 days (last pass: v6.2-rc7-120-g11b3628314a5, first fail: v6.2-rc7-136-g39693c3ba989) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
qcom-qdf2400                 | arm64  | lab-linaro-lkft | gcc-10   | defconfig+arm...ok+kselftest | 1          

  Details:     https://kernelci.org/test/plan/id/642e9e02b890f0d58879e9f7

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm64/defconfig+arm64-chromebook+kselftest/gcc-10/lab-linaro-lkft/baseline-qcom-qdf2400.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm64/defconfig+arm64-chromebook+kselftest/gcc-10/lab-linaro-lkft/baseline-qcom-qdf2400.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230324.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/642e9e02b890f0d58879e9f8
        failing since 58 days (last pass: v6.2-rc7-120-g11b3628314a5, first fail: v6.2-rc7-136-g39693c3ba989) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
qemu_arm-virt-gicv2          | arm    | lab-baylibre    | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/642e6afde73453e70c79e99f

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm/multi_v7_defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_arm-virt-gicv2.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm/multi_v7_defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_arm-virt-gicv2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230324.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/642e6afde73453e70c79e9a0
        failing since 176 days (last pass: v6.0-5324-g7871897dadfa9, first fail: v6.0-11312-g1778d6da389c) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
qemu_arm-virt-gicv2          | arm    | lab-broonie     | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/642e6c654202a5fa3e79e960

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm/multi_v7_defconfig+debug/gcc-10/lab-broonie/baseline-qemu_arm-virt-gicv2.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm/multi_v7_defconfig+debug/gcc-10/lab-broonie/baseline-qemu_arm-virt-gicv2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230324.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/642e6c654202a5fa3e79e961
        failing since 176 days (last pass: v6.0-5324-g7871897dadfa9, first fail: v6.0-11312-g1778d6da389c) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
qemu_arm-virt-gicv2          | arm    | lab-collabora   | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/642e6a746898a66ee479e93d

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm/multi_v7_defconfig+debug/gcc-10/lab-collabora/baseline-qemu_arm-virt-gicv2.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm/multi_v7_defconfig+debug/gcc-10/lab-collabora/baseline-qemu_arm-virt-gicv2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230324.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/642e6a746898a66ee479e93e
        failing since 176 days (last pass: v6.0-5324-g7871897dadfa9, first fail: v6.0-11312-g1778d6da389c) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
qemu_arm-virt-gicv2-uefi     | arm    | lab-baylibre    | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/642e6b3b19d14a7e1b79e93a

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm/multi_v7_defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_arm-virt-gicv2-uefi.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm/multi_v7_defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_arm-virt-gicv2-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230324.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/642e6b3b19d14a7e1b79e93b
        failing since 176 days (last pass: v6.0-5324-g7871897dadfa9, first fail: v6.0-11312-g1778d6da389c) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
qemu_arm-virt-gicv2-uefi     | arm    | lab-broonie     | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/642e6c79f90d4d2b5a79e929

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm/multi_v7_defconfig+debug/gcc-10/lab-broonie/baseline-qemu_arm-virt-gicv2-uefi.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm/multi_v7_defconfig+debug/gcc-10/lab-broonie/baseline-qemu_arm-virt-gicv2-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230324.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/642e6c79f90d4d2b5a79e92a
        failing since 176 days (last pass: v6.0-5324-g7871897dadfa9, first fail: v6.0-11312-g1778d6da389c) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
qemu_arm-virt-gicv2-uefi     | arm    | lab-collabora   | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/642e6a8971fa56bb8d79e924

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm/multi_v7_defconfig+debug/gcc-10/lab-collabora/baseline-qemu_arm-virt-gicv2-uefi.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm/multi_v7_defconfig+debug/gcc-10/lab-collabora/baseline-qemu_arm-virt-gicv2-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230324.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/642e6a8971fa56bb8d79e925
        failing since 176 days (last pass: v6.0-5324-g7871897dadfa9, first fail: v6.0-11312-g1778d6da389c) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
qemu_arm-virt-gicv3          | arm    | lab-baylibre    | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/642e6b3c25ca72ade279e934

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm/multi_v7_defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_arm-virt-gicv3.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm/multi_v7_defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_arm-virt-gicv3.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230324.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/642e6b3c25ca72ade279e935
        failing since 176 days (last pass: v6.0-5324-g7871897dadfa9, first fail: v6.0-11312-g1778d6da389c) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
qemu_arm-virt-gicv3          | arm    | lab-broonie     | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/642e6c8d88c1ad50b679e923

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm/multi_v7_defconfig+debug/gcc-10/lab-broonie/baseline-qemu_arm-virt-gicv3.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm/multi_v7_defconfig+debug/gcc-10/lab-broonie/baseline-qemu_arm-virt-gicv3.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230324.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/642e6c8d88c1ad50b679e924
        failing since 176 days (last pass: v6.0-5324-g7871897dadfa9, first fail: v6.0-11312-g1778d6da389c) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
qemu_arm-virt-gicv3          | arm    | lab-collabora   | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/642e6a8b594492e77079e930

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm/multi_v7_defconfig+debug/gcc-10/lab-collabora/baseline-qemu_arm-virt-gicv3.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm/multi_v7_defconfig+debug/gcc-10/lab-collabora/baseline-qemu_arm-virt-gicv3.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230324.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/642e6a8b594492e77079e931
        failing since 176 days (last pass: v6.0-5324-g7871897dadfa9, first fail: v6.0-11312-g1778d6da389c) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
qemu_arm-virt-gicv3-uefi     | arm    | lab-baylibre    | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/642e6b15e9eb0a7b4279e942

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm/multi_v7_defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_arm-virt-gicv3-uefi.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm/multi_v7_defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_arm-virt-gicv3-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230324.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/642e6b15e9eb0a7b4279e943
        failing since 176 days (last pass: v6.0-5324-g7871897dadfa9, first fail: v6.0-11312-g1778d6da389c) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
qemu_arm-virt-gicv3-uefi     | arm    | lab-broonie     | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/642e6c66296c45268f79e92d

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm/multi_v7_defconfig+debug/gcc-10/lab-broonie/baseline-qemu_arm-virt-gicv3-uefi.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm/multi_v7_defconfig+debug/gcc-10/lab-broonie/baseline-qemu_arm-virt-gicv3-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230324.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/642e6c66296c45268f79e92e
        failing since 176 days (last pass: v6.0-5324-g7871897dadfa9, first fail: v6.0-11312-g1778d6da389c) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
qemu_arm-virt-gicv3-uefi     | arm    | lab-collabora   | gcc-10   | multi_v7_defconfig+debug     | 1          

  Details:     https://kernelci.org/test/plan/id/642e6a886187e0d58579e924

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+debug
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm/multi_v7_defconfig+debug/gcc-10/lab-collabora/baseline-qemu_arm-virt-gicv3-uefi.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm/multi_v7_defconfig+debug/gcc-10/lab-collabora/baseline-qemu_arm-virt-gicv3-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230324.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/642e6a886187e0d58579e925
        failing since 176 days (last pass: v6.0-5324-g7871897dadfa9, first fail: v6.0-11312-g1778d6da389c) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
r8a7743-iwg20d-q7            | arm    | lab-cip         | gcc-10   | shmobile_defconfig           | 1          

  Details:     https://kernelci.org/test/plan/id/642e6a41aaa24c79f179e928

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: shmobile_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm/shmobile_defconfig/gcc-10/lab-cip/baseline-r8a7743-iwg20d-q7.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm/shmobile_defconfig/gcc-10/lab-cip/baseline-r8a7743-iwg20d-q7.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230324.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/642e6a41aaa24c79f179e929
        new failure (last pass: v6.3-rc5-258-g0f20c88b6871) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
rk3288-rock2-square          | arm    | lab-collabora   | gcc-10   | multi_v7_defc...G_ARM_LPAE=y | 1          

  Details:     https://kernelci.org/test/plan/id/642e6a38d5bb1d58a879e978

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm/multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y/gcc-10/lab-collabora/baseline-rk3288-rock2-square.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm/multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y/gcc-10/lab-collabora/baseline-rk3288-rock2-square.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230324.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/642e6a38d5bb1d58a879e979
        failing since 111 days (last pass: v6.1-6378-g44d433ee7540, first fail: v6.1-10792-g244d284981da) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
rk3288-veyron-jaq            | arm    | lab-collabora   | gcc-10   | multi_v7_defc...G_ARM_LPAE=y | 1          

  Details:     https://kernelci.org/test/plan/id/642e697011b7089a4e79e962

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm/multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y/gcc-10/lab-collabora/baseline-rk3288-veyron-jaq.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm/multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y/gcc-10/lab-collabora/baseline-rk3288-veyron-jaq.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230324.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/642e697011b7089a4e79e963
        failing since 111 days (last pass: v6.1-6378-g44d433ee7540, first fail: v6.1-10792-g244d284981da) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
rk3399-gru-kevin             | arm64  | lab-collabora   | gcc-10   | defconfig+arm...ok+kselftest | 1          

  Details:     https://kernelci.org/test/plan/id/642e6b35cdfe93637779e96d

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm64/defconfig+arm64-chromebook+kselftest/gcc-10/lab-collabora/baseline-rk3399-gru-kevin.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm64/defconfig+arm64-chromebook+kselftest/gcc-10/lab-collabora/baseline-rk3399-gru-kevin.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230324.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/642e6b35cdfe93637779e96e
        failing since 58 days (last pass: v6.2-rc7-120-g11b3628314a5, first fail: v6.2-rc7-136-g39693c3ba989) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
rk3399-roc-pc                | arm64  | lab-clabbe      | gcc-10   | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/642e6ba64e88a55fce79e933

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm64/defconfig+kselftest/gcc-10/lab-clabbe/baseline-rk3399-roc-pc.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm64/defconfig+kselftest/gcc-10/lab-clabbe/baseline-rk3399-roc-pc.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230324.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/642e6ba64e88a55fce79e934
        failing since 58 days (last pass: v6.2-rc7-120-g11b3628314a5, first fail: v6.2-rc7-136-g39693c3ba989) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
rk3399-rock-pi-4b            | arm64  | lab-collabora   | gcc-10   | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/642e69d21efb983acf79e949

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm64/defconfig+kselftest/gcc-10/lab-collabora/baseline-rk3399-rock-pi-4b.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm64/defconfig+kselftest/gcc-10/lab-collabora/baseline-rk3399-rock-pi-4b.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230324.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/642e69d21efb983acf79e94a
        failing since 58 days (last pass: v6.2-rc7-120-g11b3628314a5, first fail: v6.2-rc7-136-g39693c3ba989) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
sc7180-trogdor-kingoftown    | arm64  | lab-collabora   | gcc-10   | defconfig+arm...ok+kselftest | 1          

  Details:     https://kernelci.org/test/plan/id/642e6af76835f0d23f79e93b

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm64/defconfig+arm64-chromebook+kselftest/gcc-10/lab-collabora/baseline-sc7180-trogdor-kingoftown.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm64/defconfig+arm64-chromebook+kselftest/gcc-10/lab-collabora/baseline-sc7180-trogdor-kingoftown.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230324.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/642e6af76835f0d23f79e93c
        failing since 58 days (last pass: v6.2-rc7-120-g11b3628314a5, first fail: v6.2-rc7-136-g39693c3ba989) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
sc7180-trogdo...zor-limozeen | arm64  | lab-collabora   | gcc-10   | defconfig+arm...ok+kselftest | 1          

  Details:     https://kernelci.org/test/plan/id/642e6c4b3282385c5079e930

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm64/defconfig+arm64-chromebook+kselftest/gcc-10/lab-collabora/baseline-sc7180-trogdor-lazor-limozeen.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm64/defconfig+arm64-chromebook+kselftest/gcc-10/lab-collabora/baseline-sc7180-trogdor-lazor-limozeen.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230324.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/642e6c4b3282385c5079e931
        failing since 58 days (last pass: v6.2-rc7-120-g11b3628314a5, first fail: v6.2-rc7-136-g39693c3ba989) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
sun50i-a64-pine64-plus       | arm64  | lab-broonie     | gcc-10   | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/642e6b6eec929c51c179eb66

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm64/defconfig+kselftest/gcc-10/lab-broonie/baseline-sun50i-a64-pine64-plus.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm64/defconfig+kselftest/gcc-10/lab-broonie/baseline-sun50i-a64-pine64-plus.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230324.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/642e6b6eec929c51c179eb67
        failing since 58 days (last pass: v6.2-rc7-120-g11b3628314a5, first fail: v6.2-rc7-136-g39693c3ba989) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
sun50i-h5-lib...ch-all-h3-cc | arm64  | lab-broonie     | gcc-10   | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/642e6a94594492e77079e938

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm64/defconfig+kselftest/gcc-10/lab-broonie/baseline-sun50i-h5-libretech-all-h3-cc.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm64/defconfig+kselftest/gcc-10/lab-broonie/baseline-sun50i-h5-libretech-all-h3-cc.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230324.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/642e6a94594492e77079e939
        failing since 57 days (last pass: v6.2-rc7-120-g11b3628314a5, first fail: v6.2-rc7-157-ga82755b498dd) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
sun8i-h2-plus-orangepi-r1    | arm    | lab-baylibre    | gcc-10   | sunxi_defconfig              | 1          

  Details:     https://kernelci.org/test/plan/id/642e674a93fa9fa00a79e958

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: sunxi_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm/sunxi_defconfig/gcc-10/lab-baylibre/baseline-sun8i-h2-plus-orangepi-r1.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm/sunxi_defconfig/gcc-10/lab-baylibre/baseline-sun8i-h2-plus-orangepi-r1.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230324.0/armel/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/642e674a93fa9fa00a79e95d
        failing since 63 days (last pass: v6.0-12387-ge54e01f1826aa, first fail: v6.2-rc6-289-g1b7183933813)

    2023-04-06T06:31:27.957790  <8>[    7.438094] <LAVA_SIGNAL_ENDRUN 0_dmesg 3475119_1.5.2.4.1>
    2023-04-06T06:31:28.077334  / # #
    2023-04-06T06:31:28.183068  export SHELL=/bin/sh
    2023-04-06T06:31:28.184649  #
    2023-04-06T06:31:28.287925  / # export SHELL=/bin/sh. /lava-3475119/environment
    2023-04-06T06:31:28.289506  
    2023-04-06T06:31:28.392874  / # . /lava-3475119/environment/lava-3475119/bin/lava-test-runner /lava-3475119/1
    2023-04-06T06:31:28.395490  
    2023-04-06T06:31:28.402713  / # /lava-3475119/bin/lava-test-runner /lava-3475119/1
    2023-04-06T06:31:28.542570  + export 'TESTRUN_ID=1_bootrr' 
    ... (11 line(s) more)  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
sun8i-h2-plus-orangepi-zero  | arm    | lab-baylibre    | gcc-10   | sunxi_defconfig              | 1          

  Details:     https://kernelci.org/test/plan/id/642e7891096ce2b25f79e930

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: sunxi_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm/sunxi_defconfig/gcc-10/lab-baylibre/baseline-sun8i-h2-plus-orangepi-zero.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm/sunxi_defconfig/gcc-10/lab-baylibre/baseline-sun8i-h2-plus-orangepi-zero.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230324.0/armel/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/642e7891096ce2b25f79e935
        failing since 34 days (last pass: v6.2-12625-g13efc3a9f23b, first fail: v6.2-13370-g5872d227b73f)

    2023-04-06T07:45:06.791230  <8>[    7.345877] <LAVA_SIGNAL_ENDRUN 0_dmesg 3475118_1.5.2.4.1>
    2023-04-06T07:45:06.931480  / # #
    2023-04-06T07:45:07.037055  export SHELL=/bin/sh
    2023-04-06T07:45:07.038577  #
    2023-04-06T07:45:07.141977  / # export SHELL=/bin/sh. /lava-3475118/environment
    2023-04-06T07:45:07.143499  
    2023-04-06T07:45:07.246999  / # . /lava-3475118/environment/lava-3475118/bin/lava-test-runner /lava-3475118/1
    2023-04-06T07:45:07.249698  
    2023-04-06T07:45:07.260953  / # /lava-3475118/bin/lava-test-runner /lava-3475118/1
    2023-04-06T07:45:07.399722  + export 'TESTRUN_ID=1_bootrr' 
    ... (11 line(s) more)  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
sun8i-r40-bananapi-m2-ultra  | arm    | lab-clabbe      | gcc-10   | sunxi_defconfig              | 1          

  Details:     https://kernelci.org/test/plan/id/642e709045b65dac4379e97e

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: sunxi_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm/sunxi_defconfig/gcc-10/lab-clabbe/baseline-sun8i-r40-bananapi-m2-ultra.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc5-284-g1beddc8728ad/arm/sunxi_defconfig/gcc-10/lab-clabbe/baseline-sun8i-r40-bananapi-m2-ultra.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230324.0/armel/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/642e709045b65dac4379e983
        failing since 3 days (last pass: v6.3-rc4-334-g60f00557d56b, first fail: v6.3-rc5-173-g0a9d12dce512)

    2023-04-06T07:10:47.867496  / # #
    2023-04-06T07:10:47.970801  export SHELL=/bin/sh
    2023-04-06T07:10:47.972330  #
    2023-04-06T07:10:48.076372  / # export SHELL=/bin/sh. /lava-421487/environment
    2023-04-06T07:10:48.076964  
    2023-04-06T07:10:48.184101  / # . /lava-421487/environment/lava-421487/bin/lava-test-runner /lava-421487/1
    2023-04-06T07:10:48.188025  
    2023-04-06T07:10:48.197994  / # /lava-421487/bin/lava-test-runner /lava-421487/1
    2023-04-06T07:10:48.257120  + export 'TESTRUN_ID=1_bootrr'
    2023-04-06T07:10:48.294067  + cd /lava-421487/1/tests/1_bootrr 
    ... (10 line(s) more)