Subject: next/master baseline: 653 runs, 127 regressions (next-20230306)

From: "kernelci.org bot" <[email-masked]>
Date: Sun, 05 Mar 2023 22:01:44 -0800 (PST)

next/master baseline: 653 runs, 127 regressions (next-20230306)

Regressions Summary
-------------------

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
am57xx-beagle-x15            | arm    | lab-linaro-lkft | gcc-10     | multi_v7_defc...CONFIG_SMP=n | 1          
asus-CM1400CXA-dalboz        | x86_64 | lab-collabora   | gcc-10     | x86_64_defcon...ok+kselftest | 1          
at91-sama5d4_xplained        | arm    | lab-baylibre    | gcc-10     | sama5_defconfig              | 1          
bcm2835-rpi-b-rev2           | arm    | lab-broonie     | gcc-10     | bcm2835_defconfig            | 1          
bcm2836-rpi-2-b              | arm    | lab-collabora   | gcc-10     | multi_v7_defc...MB2_KERNEL=y | 1          
beagle-xm                    | arm    | lab-baylibre    | gcc-10     | multi_v7_defc...MB2_KERNEL=y | 1          
beagle-xm                    | arm    | lab-baylibre    | gcc-10     | omap2plus_defconfig          | 1          
cubietruck                   | arm    | lab-baylibre    | gcc-10     | multi_v7_defconfig           | 1          
cubietruck                   | arm    | lab-baylibre    | gcc-10     | multi_v7_defc...CONFIG_SMP=n | 1          
da850-lcdk                   | arm    | lab-baylibre    | gcc-10     | davinci_all_defconfig        | 1          
fsl-ls1088a-rdb              | arm64  | lab-nxp         | gcc-10     | defconfig+kselftest          | 1          
imx53-qsrb                   | arm    | lab-pengutronix | gcc-10     | multi_v7_defc...MB2_KERNEL=y | 1          
imx53-qsrb                   | arm    | lab-pengutronix | gcc-10     | multi_v7_defconfig           | 1          
imx53-qsrb                   | arm    | lab-pengutronix | gcc-10     | multi_v7_defc...CONFIG_SMP=n | 1          
jetson-tk1                   | arm    | lab-baylibre    | gcc-10     | multi_v7_defc...G_ARM_LPAE=y | 1          
jh7100-starfi...isionfive-v1 | riscv  | lab-clabbe      | clang-17   | defconfig                    | 1          
jh7100-starfi...isionfive-v1 | riscv  | lab-clabbe      | gcc-10     | defconfig                    | 1          
meson-g12a-sei510            | arm64  | lab-baylibre    | gcc-10     | defconfig+crypto             | 1          
meson-g12a-sei510            | arm64  | lab-baylibre    | gcc-10     | defconfig                    | 1          
meson-g12a-sei510            | arm64  | lab-baylibre    | gcc-10     | defconfig+ima                | 1          
meson-g12a-u200              | arm64  | lab-baylibre    | gcc-10     | defconfig+kselftest          | 1          
meson-g12a-x96-max           | arm64  | lab-baylibre    | gcc-10     | defconfig+kselftest          | 1          
meson-g12b-a311d-khadas-vim3 | arm64  | lab-baylibre    | gcc-10     | defconfig+kselftest          | 1          
meson-g12b-a311d-khadas-vim3 | arm64  | lab-collabora   | gcc-10     | defconfig+kselftest          | 1          
meson-g12b-odroid-n2         | arm64  | lab-baylibre    | gcc-10     | defconfig+kselftest          | 1          
meson-gxbb-nanopi-k2         | arm64  | lab-baylibre    | gcc-10     | defconfig+crypto             | 1          
meson-gxbb-nanopi-k2         | arm64  | lab-baylibre    | gcc-10     | defconfig                    | 1          
meson-gxbb-nanopi-k2         | arm64  | lab-baylibre    | gcc-10     | defconfig+ima                | 1          
meson-gxbb-nanopi-k2         | arm64  | lab-baylibre    | gcc-10     | defconfig+kselftest          | 1          
meson-gxl-s805x-libretech-ac | arm64  | lab-baylibre    | gcc-10     | defconfig+crypto             | 1          
meson-gxl-s805x-libretech-ac | arm64  | lab-baylibre    | gcc-10     | defconfig                    | 1          
meson-gxl-s805x-libretech-ac | arm64  | lab-baylibre    | gcc-10     | defconfig+ima                | 1          
meson-gxl-s905d-p230         | arm64  | lab-baylibre    | gcc-10     | defconfig+kselftest          | 1          
meson-gxl-s905x-khadas-vim   | arm64  | lab-baylibre    | gcc-10     | defconfig+kselftest          | 1          
meson-gxl-s905x-libretech-cc | arm64  | lab-baylibre    | gcc-10     | defconfig+kselftest          | 1          
meson-gxl-s905x-libretech-cc | arm64  | lab-broonie     | gcc-10     | defconfig+kselftest          | 1          
meson-gxl-s905x-libretech-cc | arm64  | lab-clabbe      | gcc-10     | defconfig+kselftest          | 1          
meson-gxm-khadas-vim2        | arm64  | lab-baylibre    | gcc-10     | defconfig+kselftest          | 1          
meson-sm1-sei610             | arm64  | lab-baylibre    | gcc-10     | defconfig+CON..._16K_PAGES=y | 1          
meson-sm1-sei610             | arm64  | lab-baylibre    | gcc-10     | defconfig+crypto             | 1          
meson-sm1-sei610             | arm64  | lab-baylibre    | gcc-10     | defconfig                    | 1          
meson-sm1-sei610             | arm64  | lab-baylibre    | gcc-10     | defconfig+ima                | 1          
mt8183-kukui-...uniper-sku16 | arm64  | lab-collabora   | clang-13   | cros://chrome...4-chromebook | 1          
mt8183-kukui-...uniper-sku16 | arm64  | lab-collabora   | clang-13   | cros://chrome...4-chromebook | 1          
mt8192-asurada-spherion-r0   | arm64  | lab-collabora   | gcc-10     | defconfig+arm64-chromebook   | 3          
ox820-clouden...lug-series-3 | arm    | lab-baylibre    | gcc-10     | oxnas_v6_defconfig           | 1          
qcom-qdf2400                 | arm64  | lab-linaro-lkft | gcc-10     | defconfig+kselftest          | 1          
qemu_arm-vexpress-a9         | arm    | lab-baylibre    | gcc-10     | vexpress_defconfig           | 1          
qemu_arm-vexpress-a9         | arm    | lab-broonie     | gcc-10     | vexpress_defconfig           | 1          
qemu_i386-uefi               | i386   | lab-baylibre    | gcc-10     | i386_defconfig+debug         | 1          
qemu_i386-uefi               | i386   | lab-baylibre    | gcc-10     | i386_defconfig               | 1          
qemu_i386-uefi               | i386   | lab-broonie     | gcc-10     | i386_defconfig+debug         | 1          
qemu_i386-uefi               | i386   | lab-broonie     | gcc-10     | i386_defconfig               | 1          
qemu_i386-uefi               | i386   | lab-collabora   | gcc-10     | i386_defconfig+debug         | 1          
qemu_x86_64-uefi             | x86_64 | lab-baylibre    | clang-13   | x86_64_defcon...6-chromebook | 1          
qemu_x86_64-uefi             | x86_64 | lab-broonie     | clang-13   | x86_64_defcon...6-chromebook | 1          
qemu_x86_64-uefi             | x86_64 | lab-baylibre    | gcc-10     | x86_64_defconfig             | 1          
qemu_x86_64-uefi             | x86_64 | lab-baylibre    | gcc-10     | x86_64_defcon...86_kvm_guest | 1          
qemu_x86_64-uefi             | x86_64 | lab-baylibre    | gcc-10     | x86_64_defcon...ebook+amdgpu | 1          
qemu_x86_64-uefi             | x86_64 | lab-baylibre    | gcc-10     | x86_64_defconfig+amdgpu      | 1          
qemu_x86_64-uefi             | x86_64 | lab-baylibre    | gcc-10     | x86_64_defconfig+ima         | 1          
qemu_x86_64-uefi             | x86_64 | lab-baylibre    | gcc-10     | x86_64_defconfig+crypto      | 1          
qemu_x86_64-uefi             | x86_64 | lab-baylibre    | gcc-10     | x86_64_defconfig+debug       | 1          
qemu_x86_64-uefi             | x86_64 | lab-baylibre    | gcc-10     | x86_64_defcon...6-chromebook | 1          
qemu_x86_64-uefi             | x86_64 | lab-broonie     | gcc-10     | x86_64_defconfig             | 1          
qemu_x86_64-uefi             | x86_64 | lab-broonie     | gcc-10     | x86_64_defcon...86_kvm_guest | 1          
qemu_x86_64-uefi             | x86_64 | lab-broonie     | gcc-10     | x86_64_defcon...ebook+amdgpu | 1          
qemu_x86_64-uefi             | x86_64 | lab-broonie     | gcc-10     | x86_64_defconfig+amdgpu      | 1          
qemu_x86_64-uefi             | x86_64 | lab-broonie     | gcc-10     | x86_64_defconfig+ima         | 1          
qemu_x86_64-uefi             | x86_64 | lab-broonie     | gcc-10     | x86_64_defconfig+crypto      | 1          
qemu_x86_64-uefi             | x86_64 | lab-broonie     | gcc-10     | x86_64_defconfig+debug       | 1          
qemu_x86_64-uefi             | x86_64 | lab-broonie     | gcc-10     | x86_64_defcon...6-chromebook | 1          
qemu_x86_64-uefi             | x86_64 | lab-collabora   | gcc-10     | x86_64_defconfig             | 1          
qemu_x86_64-uefi             | x86_64 | lab-collabora   | gcc-10     | x86_64_defcon...86_kvm_guest | 1          
qemu_x86_64-uefi             | x86_64 | lab-collabora   | gcc-10     | x86_64_defconfig+ima         | 1          
qemu_x86_64-uefi             | x86_64 | lab-collabora   | gcc-10     | x86_64_defconfig+crypto      | 1          
qemu_x86_64-uefi             | x86_64 | lab-baylibre    | rustc-1.62 | x86_64_defconfig+rust        | 1          
qemu_x86_64-uefi             | x86_64 | lab-baylibre    | rustc-1.62 | x86_64_defcon...rust-samples | 1          
qemu_x86_64-uefi             | x86_64 | lab-baylibre    | rustc-1.62 | x86_64_defconfig             | 1          
qemu_x86_64-uefi             | x86_64 | lab-broonie     | rustc-1.62 | x86_64_defconfig+rust        | 1          
qemu_x86_64-uefi             | x86_64 | lab-broonie     | rustc-1.62 | x86_64_defcon...rust-samples | 1          
qemu_x86_64-uefi             | x86_64 | lab-broonie     | rustc-1.62 | x86_64_defconfig             | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-baylibre    | clang-13   | x86_64_defcon...6-chromebook | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-broonie     | clang-13   | x86_64_defcon...6-chromebook | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-baylibre    | gcc-10     | x86_64_defconfig             | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-baylibre    | gcc-10     | x86_64_defcon...86_kvm_guest | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-baylibre    | gcc-10     | x86_64_defcon...ebook+amdgpu | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-baylibre    | gcc-10     | x86_64_defconfig+amdgpu      | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-baylibre    | gcc-10     | x86_64_defconfig+ima         | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-baylibre    | gcc-10     | x86_64_defconfig+crypto      | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-baylibre    | gcc-10     | x86_64_defconfig+debug       | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-baylibre    | gcc-10     | x86_64_defcon...6-chromebook | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-broonie     | gcc-10     | x86_64_defconfig             | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-broonie     | gcc-10     | x86_64_defcon...86_kvm_guest | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-broonie     | gcc-10     | x86_64_defcon...ebook+amdgpu | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-broonie     | gcc-10     | x86_64_defconfig+amdgpu      | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-broonie     | gcc-10     | x86_64_defconfig+ima         | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-broonie     | gcc-10     | x86_64_defconfig+crypto      | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-broonie     | gcc-10     | x86_64_defconfig+debug       | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-broonie     | gcc-10     | x86_64_defcon...6-chromebook | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-collabora   | gcc-10     | x86_64_defconfig             | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-collabora   | gcc-10     | x86_64_defcon...86_kvm_guest | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-collabora   | gcc-10     | x86_64_defconfig+ima         | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-collabora   | gcc-10     | x86_64_defconfig+debug       | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-baylibre    | rustc-1.62 | x86_64_defconfig+rust        | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-baylibre    | rustc-1.62 | x86_64_defcon...rust-samples | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-baylibre    | rustc-1.62 | x86_64_defconfig             | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-broonie     | rustc-1.62 | x86_64_defconfig+rust        | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-broonie     | rustc-1.62 | x86_64_defcon...rust-samples | 1          
qemu_x86_64-uefi-mixed       | x86_64 | lab-broonie     | rustc-1.62 | x86_64_defconfig             | 1          
r8a7743-iwg20d-q7            | arm    | lab-cip         | gcc-10     | shmobile_defconfig           | 1          
r8a77960-ulcb                | arm64  | lab-collabora   | gcc-10     | defconfig+crypto             | 1          
r8a77960-ulcb                | arm64  | lab-collabora   | gcc-10     | defconfig                    | 1          
r8a77960-ulcb                | arm64  | lab-collabora   | gcc-10     | defconfig+ima                | 1          
r8a77960-ulcb                | arm64  | lab-collabora   | gcc-10     | defconfig+kselftest          | 1          
rk3288-rock2-square          | arm    | lab-collabora   | gcc-10     | multi_v7_defc...G_ARM_LPAE=y | 1          
rk3288-veyron-jaq            | arm    | lab-collabora   | gcc-10     | multi_v7_defc...G_ARM_LPAE=y | 1          
rk3399-gru-kevin             | arm64  | lab-collabora   | clang-13   | cros://chrome...4-chromebook | 2          
rk3399-roc-pc                | arm64  | lab-clabbe      | gcc-10     | defconfig+kselftest          | 1          
rk3399-rock-pi-4b            | arm64  | lab-collabora   | gcc-10     | defconfig+kselftest          | 1          
sun50i-h5-lib...ch-all-h3-cc | arm64  | lab-broonie     | gcc-10     | defconfig+kselftest          | 1          
sun8i-h2-plus-orangepi-zero  | arm    | lab-baylibre    | gcc-10     | sunxi_defconfig              | 1          
sun8i-h3-libretech-all-h3-cc | arm    | lab-baylibre    | gcc-10     | sunxi_defconfig              | 1          
tegra124-nyan-big            | arm    | lab-collabora   | gcc-10     | multi_v7_defc...G_ARM_LPAE=y | 1          

  Details:  https://kernelci.org/test/job/next/branch/master/kernel/next-20230306/plan/baseline/

  Test:     baseline
  Tree:     next
  Branch:   master
  Describe: next-20230306
  URL:      https://git.kernel.org/pub/scm/linux/kernel/git/next/linux-next.git
  SHA:      dc837c1a5137a8cf2e9432c1891392b6a66f4d8d 

Test Regressions
---------------- 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
am57xx-beagle-x15            | arm    | lab-linaro-lkft | gcc-10     | multi_v7_defc...CONFIG_SMP=n | 1          

  Details:     https://kernelci.org/test/plan/id/64055aba859a6d7a068c8642

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_SMP=n
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/arm/multi_v7_defconfig+CONFIG_SMP=n/gcc-10/lab-linaro-lkft/baseline-am57xx-beagle-x15.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/arm/multi_v7_defconfig+CONFIG_SMP=n/gcc-10/lab-linaro-lkft/baseline-am57xx-beagle-x15.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64055aba859a6d7a068c8643
        failing since 169 days (last pass: next-20220915, first fail: next-20220916) 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
asus-CM1400CXA-dalboz        | x86_64 | lab-collabora   | gcc-10     | x86_64_defcon...ok+kselftest | 1          

  Details:     https://kernelci.org/test/plan/id/64054c8b5daf84bab88c867e

  Results:     6 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook+kselftest
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+x86-chromebook+kselftest/gcc-10/lab-collabora/baseline-asus-CM1400CXA-dalboz.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+x86-chromebook+kselftest/gcc-10/lab-collabora/baseline-asus-CM1400CXA-dalboz.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/x86/rootfs.cpio.gz 

  * baseline.dmesg.emerg: https://kernelci.org/test/case/id/64054c8b5daf84bab88c8681
        failing since 2 days (last pass: next-20230227, first fail: next-20230303)
        3 lines

    2023-03-06T02:14:08.739241  kern  :emerg : __common_interrupt: 1.55 No irq handler for vector

    2023-03-06T02:14:08.745623  kern  :emerg : __common_interrupt: 2.55 No irq handler for vector

    2023-03-06T02:14:08.752529  kern  :emerg : __common_interrupt: 3.55 No irq handler for vector

    2023-03-06T02:14:08.758864  <8>[   14.913423] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=emerg RESULT=fail UNITS=lines MEASUREMENT=3>

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
at91-sama5d4_xplained        | arm    | lab-baylibre    | gcc-10     | sama5_defconfig              | 1          

  Details:     https://kernelci.org/test/plan/id/64054bb2fe2aeced2d8c8649

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: sama5_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/arm/sama5_defconfig/gcc-10/lab-baylibre/baseline-at91-sama5d4_xplained.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/arm/sama5_defconfig/gcc-10/lab-baylibre/baseline-at91-sama5d4_xplained.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64054bb2fe2aeced2d8c864a
        failing since 33 days (last pass: next-20230125, first fail: next-20230131) 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
bcm2835-rpi-b-rev2           | arm    | lab-broonie     | gcc-10     | bcm2835_defconfig            | 1          

  Details:     https://kernelci.org/test/plan/id/64056934ed74e37a2c8c863b

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: bcm2835_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/arm/bcm2835_defconfig/gcc-10/lab-broonie/baseline-bcm2835-rpi-b-rev2.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/arm/bcm2835_defconfig/gcc-10/lab-broonie/baseline-bcm2835-rpi-b-rev2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/armel/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/64056934ed74e37a2c8c8644
        new failure (last pass: next-20230303)

    2023-03-06T04:16:28.978688  + set +x
    2023-03-06T04:16:28.982532  <8>[   19.044257] <LAVA_SIGNAL_ENDRUN 0_dmesg 105005_1.5.2.4.1>
    2023-03-06T04:16:29.114603  / # #
    2023-03-06T04:16:29.217097  export SHELL=/bin/sh
    2023-03-06T04:16:29.217833  #
    2023-03-06T04:16:29.319661  / # export SHELL=/bin/sh. /lava-105005/environment
    2023-03-06T04:16:29.320257  
    2023-03-06T04:16:29.422520  / # . /lava-105005/environment/lava-105005/bin/lava-test-runner /lava-105005/1
    2023-03-06T04:16:29.423646  
    2023-03-06T04:16:29.430139  / # /lava-105005/bin/lava-test-runner /lava-105005/1 
    ... (14 line(s) more)  

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
bcm2836-rpi-2-b              | arm    | lab-collabora   | gcc-10     | multi_v7_defc...MB2_KERNEL=y | 1          

  Details:     https://kernelci.org/test/plan/id/64054d07ba304316448c864e

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/arm/multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y/gcc-10/lab-collabora/baseline-bcm2836-rpi-2-b.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/arm/multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y/gcc-10/lab-collabora/baseline-bcm2836-rpi-2-b.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64054d07ba304316448c864f
        failing since 19 days (last pass: next-20230213, first fail: next-20230214) 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
beagle-xm                    | arm    | lab-baylibre    | gcc-10     | multi_v7_defc...MB2_KERNEL=y | 1          

  Details:     https://kernelci.org/test/plan/id/64054d12af6e6117798c8638

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/arm/multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y/gcc-10/lab-baylibre/baseline-beagle-xm.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/arm/multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y/gcc-10/lab-baylibre/baseline-beagle-xm.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64054d12af6e6117798c8639
        failing since 43 days (last pass: next-20230119, first fail: next-20230120) 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
beagle-xm                    | arm    | lab-baylibre    | gcc-10     | omap2plus_defconfig          | 1          

  Details:     https://kernelci.org/test/plan/id/64054e72a95775787e8c8656

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: omap2plus_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/arm/omap2plus_defconfig/gcc-10/lab-baylibre/baseline-beagle-xm.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/arm/omap2plus_defconfig/gcc-10/lab-baylibre/baseline-beagle-xm.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64054e72a95775787e8c8657
        failing since 2 days (last pass: next-20230220, first fail: next-20230303) 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
cubietruck                   | arm    | lab-baylibre    | gcc-10     | multi_v7_defconfig           | 1          

  Details:     https://kernelci.org/test/plan/id/640550bed4381283698c8663

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: multi_v7_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/arm/multi_v7_defconfig/gcc-10/lab-baylibre/baseline-cubietruck.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/arm/multi_v7_defconfig/gcc-10/lab-baylibre/baseline-cubietruck.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/armel/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/640550bed4381283698c866c
        failing since 47 days (last pass: next-20221219, first fail: next-20230117)

    2023-03-06T02:32:06.669906  <8>[   15.240161] <LAVA_SIGNAL_ENDRUN 0_dmesg 3389479_1.5.2.4.1>
    2023-03-06T02:32:06.788034  / # #
    2023-03-06T02:32:06.892009  export SHELL=/bin/sh
    2023-03-06T02:32:06.893048  #
    2023-03-06T02:32:06.995073  / # export SHELL=/bin/sh. /lava-3389479/environment
    2023-03-06T02:32:06.995947  <3>[   15.471952] Bluetooth: hci0: command 0x0c03 tx timeout
    2023-03-06T02:32:06.996449  
    2023-03-06T02:32:07.098378  / # . /lava-3389479/environment/lava-3389479/bin/lava-test-runner /lava-3389479/1
    2023-03-06T02:32:07.100107  
    2023-03-06T02:32:07.105619  / # /lava-3389479/bin/lava-test-runner /lava-3389479/1 
    ... (12 line(s) more)  

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
cubietruck                   | arm    | lab-baylibre    | gcc-10     | multi_v7_defc...CONFIG_SMP=n | 1          

  Details:     https://kernelci.org/test/plan/id/6405515adaf746b5af8c862f

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: multi_v7_defconfig+CONFIG_SMP=n
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/arm/multi_v7_defconfig+CONFIG_SMP=n/gcc-10/lab-baylibre/baseline-cubietruck.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/arm/multi_v7_defconfig+CONFIG_SMP=n/gcc-10/lab-baylibre/baseline-cubietruck.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/armel/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6405515adaf746b5af8c8638
        failing since 46 days (last pass: next-20221219, first fail: next-20230118)

    2023-03-06T02:34:42.985387  <8>[   16.660747] <LAVA_SIGNAL_ENDRUN 0_dmesg 3389491_1.5.2.4.1>
    2023-03-06T02:34:43.100695  / # #
    2023-03-06T02:34:43.204358  export SHELL=/bin/sh
    2023-03-06T02:34:43.205759  #
    2023-03-06T02:34:43.308127  / # export SHELL=/bin/sh. /lava-3389491/environment
    2023-03-06T02:34:43.309209  
    2023-03-06T02:34:43.412250  / # . /lava-3389491/environment/lava-3389491/bin/lava-test-runner /lava-3389491/1
    2023-03-06T02:34:43.414028  
    2023-03-06T02:34:43.418953  / # /lava-3389491/bin/lava-test-runner /lava-3389491/1
    2023-03-06T02:34:43.514531  + export 'TESTRUN_ID=1_bootrr' 
    ... (11 line(s) more)  

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
da850-lcdk                   | arm    | lab-baylibre    | gcc-10     | davinci_all_defconfig        | 1          

  Details:     https://kernelci.org/test/plan/id/64054b26b6ebc18a2f8c86a4

  Results:     3 PASS, 3 FAIL, 1 SKIP
  Full config: davinci_all_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/arm/davinci_all_defconfig/gcc-10/lab-baylibre/baseline-da850-lcdk.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/arm/davinci_all_defconfig/gcc-10/lab-baylibre/baseline-da850-lcdk.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/armel/rootfs.cpio.gz 

  * baseline.dmesg.emerg: https://kernelci.org/test/case/id/64054b26b6ebc18a2f8c86a7
        failing since 20 days (last pass: next-20230208, first fail: next-20230213)
        29 lines

    2023-03-06T02:08:13.960097  kern  :alert : Register r8 information: slab kmalloc-512 start c4edb200 pointer offset 4 size 512
    2023-03-06T02:08:13.993901  kern  :alert : Register r9 information: non-paged memory
    2023-03-06T02:08:13.994195  kern  :alert : Register r10 information: NULL pointer
    2023-03-06T02:08:13.994394  kern  :alert : Register r11 information: 1-page vmalloc region starting at 0xbf2a0000 allocated at load_module+0x6d4/0x18ec
    2023-03-06T02:08:13.996997  kern  :alert : Register r12 information: non-paged memory
    2023-03-06T02:08:14.101005  kern  :emerg : Internal error: Oops: 17 [#1] PREEMPT ARM
    2023-03-06T02:08:14.101545  kern  :emerg : Process udevd (pid: 64, stack limit = 0xb7c93ac6)
    2023-03-06T02:08:14.101775  kern  :emerg : Stack: (0xc88fdd08 to 0xc88fe000)
    2023-03-06T02:08:14.101974  kern  :emerg : dd00:                   c4edb200 c076f860 00000000 c03ad7f8 00000000 56944157
    2023-03-06T02:08:14.102143  kern  :emerg : dd20: 0000005d 56944157 c076f860 bf2a0220 00000000 00000000 00000000 00000001 
    ... (6 line(s) more)  

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
fsl-ls1088a-rdb              | arm64  | lab-nxp         | gcc-10     | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/6405520b791a05b9d58c866f

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/arm64/defconfig+kselftest/gcc-10/lab-nxp/baseline-fsl-ls1088a-rdb.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/arm64/defconfig+kselftest/gcc-10/lab-nxp/baseline-fsl-ls1088a-rdb.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/arm64/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6405520b791a05b9d58c8676
        failing since 23 days (last pass: next-20230209, first fail: next-20230210)

    2023-03-06T02:37:27.222616  + set +x
    2023-03-06T02:37:27.224420  [   19.667204] <LAVA_SIGNAL_ENDRUN 0_dmesg 1164882_1.5.2.4.1>
    2023-03-06T02:37:27.339337  #
    2023-03-06T02:37:27.441443  / # #export SHELL=/bin/sh
    2023-03-06T02:37:27.441899  
    2023-03-06T02:37:27.543269  / # export SHELL=/bin/sh. /lava-1164882/environment
    2023-03-06T02:37:27.543726  
    2023-03-06T02:37:27.645105  / # . /lava-1164882/environment/lava-1164882/bin/lava-test-runner /lava-1164882/1
    2023-03-06T02:37:27.645990  
    2023-03-06T02:37:27.648715  / # /lava-1164882/bin/lava-test-runner /lava-1164882/1 
    ... (12 line(s) more)  

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
imx53-qsrb                   | arm    | lab-pengutronix | gcc-10     | multi_v7_defc...MB2_KERNEL=y | 1          

  Details:     https://kernelci.org/test/plan/id/64054cba4cde97d79d8c8655

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/arm/multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y/gcc-10/lab-pengutronix/baseline-imx53-qsrb.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/arm/multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y/gcc-10/lab-pengutronix/baseline-imx53-qsrb.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/armel/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/64054cba4cde97d79d8c865e
        failing since 34 days (last pass: next-20221205, first fail: next-20230130)

    2023-03-06T02:15:02.049881  + set +x
    2023-03-06T02:15:02.050125  [   12.839491] <LAVA_SIGNAL_ENDRUN 0_dmesg 916459_1.5.2.3.1>
    2023-03-06T02:15:02.158082  / # #
    2023-03-06T02:15:02.259730  export SHELL=/bin/sh
    2023-03-06T02:15:02.260185  #
    2023-03-06T02:15:02.361367  / # export SHELL=/bin/sh. /lava-916459/environment
    2023-03-06T02:15:02.361875  
    2023-03-06T02:15:02.463416  / # . /lava-916459/environment/lava-916459/bin/lava-test-runner /lava-916459/1
    2023-03-06T02:15:02.464247  
    2023-03-06T02:15:02.467695  / # /lava-916459/bin/lava-test-runner /lava-916459/1 
    ... (11 line(s) more)  

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
imx53-qsrb                   | arm    | lab-pengutronix | gcc-10     | multi_v7_defconfig           | 1          

  Details:     https://kernelci.org/test/plan/id/640550cb3dcf7083788c8693

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: multi_v7_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/arm/multi_v7_defconfig/gcc-10/lab-pengutronix/baseline-imx53-qsrb.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/arm/multi_v7_defconfig/gcc-10/lab-pengutronix/baseline-imx53-qsrb.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/armel/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/640550cb3dcf7083788c869c
        failing since 34 days (last pass: next-20221206, first fail: next-20230130)

    2023-03-06T02:32:18.958505  + set +x
    2023-03-06T02:32:18.958647  [   13.020916] <LAVA_SIGNAL_ENDRUN 0_dmesg 916474_1.5.2.3.1>
    2023-03-06T02:32:19.065950  / # #
    2023-03-06T02:32:19.167368  export SHELL=/bin/sh
    2023-03-06T02:32:19.167825  #
    2023-03-06T02:32:19.268940  / # export SHELL=/bin/sh. /lava-916474/environment
    2023-03-06T02:32:19.269290  
    2023-03-06T02:32:19.370453  / # . /lava-916474/environment/lava-916474/bin/lava-test-runner /lava-916474/1
    2023-03-06T02:32:19.371003  
    2023-03-06T02:32:19.374015  / # /lava-916474/bin/lava-test-runner /lava-916474/1 
    ... (12 line(s) more)  

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
imx53-qsrb                   | arm    | lab-pengutronix | gcc-10     | multi_v7_defc...CONFIG_SMP=n | 1          

  Details:     https://kernelci.org/test/plan/id/6405511bacfae7b0c78c8647

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: multi_v7_defconfig+CONFIG_SMP=n
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/arm/multi_v7_defconfig+CONFIG_SMP=n/gcc-10/lab-pengutronix/baseline-imx53-qsrb.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/arm/multi_v7_defconfig+CONFIG_SMP=n/gcc-10/lab-pengutronix/baseline-imx53-qsrb.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/armel/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6405511bacfae7b0c78c8650
        failing since 34 days (last pass: next-20221206, first fail: next-20230130)

    2023-03-06T02:33:41.648555  + set +x
    2023-03-06T02:33:41.648715  [   12.156087] <LAVA_SIGNAL_ENDRUN 0_dmesg 916480_1.5.2.3.1>
    2023-03-06T02:33:41.754348  / # #
    2023-03-06T02:33:41.855619  export SHELL=/bin/sh
    2023-03-06T02:33:41.856030  #
    2023-03-06T02:33:41.957167  / # export SHELL=/bin/sh. /lava-916480/environment
    2023-03-06T02:33:41.957644  
    2023-03-06T02:33:42.058860  / # . /lava-916480/environment/lava-916480/bin/lava-test-runner /lava-916480/1
    2023-03-06T02:33:42.059351  
    2023-03-06T02:33:42.062275  / # /lava-916480/bin/lava-test-runner /lava-916480/1 
    ... (12 line(s) more)  

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
jetson-tk1                   | arm    | lab-baylibre    | gcc-10     | multi_v7_defc...G_ARM_LPAE=y | 1          

  Details:     https://kernelci.org/test/plan/id/64054e5d67b6d5df838c863f

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/arm/multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y/gcc-10/lab-baylibre/baseline-jetson-tk1.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/arm/multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y/gcc-10/lab-baylibre/baseline-jetson-tk1.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64054e5d67b6d5df838c8640
        failing since 328 days (last pass: next-20220401, first fail: next-20220411) 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
jh7100-starfi...isionfive-v1 | riscv  | lab-clabbe      | clang-17   | defconfig                    | 1          

  Details:     https://kernelci.org/test/plan/id/64054fde6152c61e768c863c

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig
  Compiler:    clang-17 (Debian clang version 17.0.0 (++20230227071825+f3b8aef242ed-1~exp1~20230227071944.577))
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/riscv/defconfig/clang-17/lab-clabbe/baseline-jh7100-starfive-visionfive-v1.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/riscv/defconfig/clang-17/lab-clabbe/baseline-jh7100-starfive-visionfive-v1.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/riscv/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64054fde6152c61e768c863d
        failing since 9 days (last pass: next-20230222, first fail: next-20230224) 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
jh7100-starfi...isionfive-v1 | riscv  | lab-clabbe      | gcc-10     | defconfig                    | 1          

  Details:     https://kernelci.org/test/plan/id/64054be1038543cdd08c8637

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig
  Compiler:    gcc-10 (riscv64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/riscv/defconfig/gcc-10/lab-clabbe/baseline-jh7100-starfive-visionfive-v1.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/riscv/defconfig/gcc-10/lab-clabbe/baseline-jh7100-starfive-visionfive-v1.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/riscv/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64054be1038543cdd08c8638
        failing since 9 days (last pass: next-20230222, first fail: next-20230224) 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-g12a-sei510            | arm64  | lab-baylibre    | gcc-10     | defconfig+crypto             | 1          

  Details:     https://kernelci.org/test/plan/id/64054e9a7e391799798c864f

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+crypto
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/arm64/defconfig+crypto/gcc-10/lab-baylibre/baseline-meson-g12a-sei510.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/arm64/defconfig+crypto/gcc-10/lab-baylibre/baseline-meson-g12a-sei510.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/arm64/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/64054e9a7e391799798c8658
        failing since 46 days (last pass: next-20230109, first fail: next-20230118)

    2023-03-06T02:23:14.337187  / # #
    2023-03-06T02:23:14.438724  export SHELL=/bin/sh
    2023-03-06T02:23:14.439391  #
    2023-03-06T02:23:14.541039  / # export SHELL=/bin/sh. /lava-3389333/environment
    2023-03-06T02:23:14.541659  <3>[  100.467929] brcmfmac: brcmf_sdio_htclk: HT Avail timeout (1000000): clkctl 0x50
    2023-03-06T02:23:14.541992  
    2023-03-06T02:23:14.643584  / # . /lava-3389333/environment/lava-3389333/bin/lava-test-runner /lava-3389333/1
    2023-03-06T02:23:14.644406  
    2023-03-06T02:23:14.661345  / # /lava-3389333/bin/lava-test-runner /lava-3389333/1
    2023-03-06T02:23:14.718419  + export 'TESTRUN_ID=1_bootrr' 
    ... (10 line(s) more)  

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-g12a-sei510            | arm64  | lab-baylibre    | gcc-10     | defconfig                    | 1          

  Details:     https://kernelci.org/test/plan/id/64054eeba77936514c8c864d

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/arm64/defconfig/gcc-10/lab-baylibre/baseline-meson-g12a-sei510.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/arm64/defconfig/gcc-10/lab-baylibre/baseline-meson-g12a-sei510.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/arm64/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/64054eeba77936514c8c8656
        failing since 46 days (last pass: next-20230109, first fail: next-20230118)

    2023-03-06T02:24:32.448373  <8>[   18.050251] <LAVA_SIGNAL_ENDRUN 0_dmesg 3389365_1.5.2.4.1>
    2023-03-06T02:24:32.552581  / # #
    2023-03-06T02:24:32.654503  export SHELL=/bin/sh
    2023-03-06T02:24:32.655305  #
    2023-03-06T02:24:32.757523  / # export SHELL=/bin/sh<3>[   18.2. /lava-3389365/environment
    2023-03-06T02:24:32.757961  81911] brcmfmac: brcmf_sdio_htclk: HT Avail timeout (1000000): clkctl 0x50
    2023-03-06T02:24:32.758195  
    2023-03-06T02:24:32.859590  / # . /lava-3389365/environment/lava-3389365/bin/lava-test-runner /lava-3389365/1
    2023-03-06T02:24:32.860285  
    2023-03-06T02:24:32.868567  / # /lava-3389365/bin/lava-test-runner /lava-3389365/1 
    ... (13 line(s) more)  

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-g12a-sei510            | arm64  | lab-baylibre    | gcc-10     | defconfig+ima                | 1          

  Details:     https://kernelci.org/test/plan/id/64054f3a9c94842b7d8c867b

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+ima
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/arm64/defconfig+ima/gcc-10/lab-baylibre/baseline-meson-g12a-sei510.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/arm64/defconfig+ima/gcc-10/lab-baylibre/baseline-meson-g12a-sei510.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/arm64/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/64054f3a9c94842b7d8c8684
        failing since 46 days (last pass: next-20230109, first fail: next-20230118)

    2023-03-06T02:25:51.829067  / # #
    2023-03-06T02:25:51.930815  export SHELL=/bin/sh
    2023-03-06T02:25:51.931239  #
    2023-03-06T02:25:52.032685  / # export SHELL=/bin/sh. /lava-3389389/environment
    2023-03-06T02:25:52.033428  <3>[   18.416579] brcmfmac: brcmf_sdio_htclk: HT Avail timeout (1000000): clkctl 0x50
    2023-03-06T02:25:52.033897  
    2023-03-06T02:25:52.135703  / # . /lava-3389389/environment/lava-3389389/bin/lava-test-runner /lava-3389389/1
    2023-03-06T02:25:52.136330  
    2023-03-06T02:25:52.151990  / # /lava-3389389/bin/lava-test-runner /lava-3389389/1
    2023-03-06T02:25:52.212926  + export 'TESTRUN_ID=1_bootrr' 
    ... (11 line(s) more)  

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-g12a-u200              | arm64  | lab-baylibre    | gcc-10     | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/640551859d08a7a30f8c8652

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-g12a-u200.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-g12a-u200.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/640551859d08a7a30f8c8653
        failing since 26 days (last pass: next-20230206, first fail: next-20230207) 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-g12a-x96-max           | arm64  | lab-baylibre    | gcc-10     | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/640551dd791a05b9d58c863d

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-g12a-x96-max.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-g12a-x96-max.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/640551dd791a05b9d58c863e
        failing since 39 days (last pass: next-20230124, first fail: next-20230125) 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-g12b-a311d-khadas-vim3 | arm64  | lab-baylibre    | gcc-10     | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/640550eb9f7e735f0e8c8648

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-g12b-a311d-khadas-vim3.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-g12b-a311d-khadas-vim3.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/640550eb9f7e735f0e8c8649
        failing since 39 days (last pass: next-20230124, first fail: next-20230125) 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-g12b-a311d-khadas-vim3 | arm64  | lab-collabora   | gcc-10     | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/6405503a9d9c6974138c8632

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/arm64/defconfig+kselftest/gcc-10/lab-collabora/baseline-meson-g12b-a311d-khadas-vim3.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/arm64/defconfig+kselftest/gcc-10/lab-collabora/baseline-meson-g12b-a311d-khadas-vim3.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6405503a9d9c6974138c8633
        failing since 39 days (last pass: next-20230124, first fail: next-20230125) 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-g12b-odroid-n2         | arm64  | lab-baylibre    | gcc-10     | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/6405503fdb877ad2f88c863b

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-g12b-odroid-n2.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-g12b-odroid-n2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6405503fdb877ad2f88c863c
        failing since 27 days (last pass: next-20230203, first fail: next-20230206) 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-gxbb-nanopi-k2         | arm64  | lab-baylibre    | gcc-10     | defconfig+crypto             | 1          

  Details:     https://kernelci.org/test/plan/id/64054e80adbdd67c248c8659

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+crypto
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/arm64/defconfig+crypto/gcc-10/lab-baylibre/baseline-meson-gxbb-nanopi-k2.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/arm64/defconfig+crypto/gcc-10/lab-baylibre/baseline-meson-gxbb-nanopi-k2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/arm64/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/64054e80adbdd67c248c8662
        failing since 46 days (last pass: next-20221130, first fail: next-20230118)

    2023-03-06T02:22:36.227211  
    2023-03-06T02:22:36.328732  / # #export SHELL=/bin/sh
    2023-03-06T02:22:36.329090  
    2023-03-06T02:22:36.430403  / # export SHELL=/bin/sh. /lava-3389322/environment
    2023-03-06T02:22:36.430761  
    2023-03-06T02:22:36.532102  / # . /lava-3389322/environment/lava-3389322/bin/lava-test-runner /lava-3389322/1
    2023-03-06T02:22:36.532784  
    2023-03-06T02:22:36.538721  / # /lava-3389322/bin/lava-test-runner /lava-3389322/1
    2023-03-06T02:22:36.570713  + export 'TESTRUN_ID=1_bootrr'
    2023-03-06T02:22:36.610501  + cd /lava-3389322/1/tests/1_bootrr 
    ... (15 line(s) more)  

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-gxbb-nanopi-k2         | arm64  | lab-baylibre    | gcc-10     | defconfig                    | 1          

  Details:     https://kernelci.org/test/plan/id/64054ee164b2a1ca448c8640

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/arm64/defconfig/gcc-10/lab-baylibre/baseline-meson-gxbb-nanopi-k2.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/arm64/defconfig/gcc-10/lab-baylibre/baseline-meson-gxbb-nanopi-k2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/arm64/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/64054ee164b2a1ca448c8649
        failing since 46 days (last pass: next-20221129, first fail: next-20230118)

    2023-03-06T02:24:22.537225  / # #
    2023-03-06T02:24:22.639380  export SHELL=/bin/sh
    2023-03-06T02:24:22.639977  #
    2023-03-06T02:24:22.741594  / # export SHELL=/bin/sh. /lava-3389347/environment
    2023-03-06T02:24:22.742110  
    2023-03-06T02:24:22.844299  / # . /lava-3389347/environment/lava-3389347/bin/lava-test-runner /lava-3389347/1
    2023-03-06T02:24:22.845385  
    2023-03-06T02:24:22.863052  / # /lava-3389347/bin/lava-test-runner /lava-3389347/1
    2023-03-06T02:24:22.922885  + export 'TESTRUN_ID=1_bootrr'
    2023-03-06T02:24:22.923566  + cd /lava-3389347/1/tests/1_bootrr 
    ... (16 line(s) more)  

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-gxbb-nanopi-k2         | arm64  | lab-baylibre    | gcc-10     | defconfig+ima                | 1          

  Details:     https://kernelci.org/test/plan/id/64054f5c459cd1cf9c8c8635

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+ima
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/arm64/defconfig+ima/gcc-10/lab-baylibre/baseline-meson-gxbb-nanopi-k2.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/arm64/defconfig+ima/gcc-10/lab-baylibre/baseline-meson-gxbb-nanopi-k2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/arm64/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/64054f5c459cd1cf9c8c863e
        failing since 46 days (last pass: next-20221130, first fail: next-20230118)

    2023-03-06T02:26:07.830474  + set +x
    2023-03-06T02:26:07.832105  <8>[   18.436433] <LAVA_SIGNAL_ENDRUN 0_dmesg 3389383_1.5.2.4.1>
    2023-03-06T02:26:07.938733  / # #
    2023-03-06T02:26:08.040502  export SHELL=/bin/sh
    2023-03-06T02:26:08.040946  #
    2023-03-06T02:26:08.142385  / # export SHELL=/bin/sh. /lava-3389383/environment
    2023-03-06T02:26:08.142833  
    2023-03-06T02:26:08.244312  / # . /lava-3389383/environment/lava-3389383/bin/lava-test-runner /lava-3389383/1
    2023-03-06T02:26:08.245131  
    2023-03-06T02:26:08.263863  / # /lava-3389383/bin/lava-test-runner /lava-3389383/1 
    ... (13 line(s) more)  

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-gxbb-nanopi-k2         | arm64  | lab-baylibre    | gcc-10     | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/640550c1b8ad88e3bd8c8633

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-gxbb-nanopi-k2.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-gxbb-nanopi-k2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/640550c1b8ad88e3bd8c8634
        failing since 26 days (last pass: next-20230206, first fail: next-20230207) 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-gxl-s805x-libretech-ac | arm64  | lab-baylibre    | gcc-10     | defconfig+crypto             | 1          

  Details:     https://kernelci.org/test/plan/id/64054ecef98aef20988c869c

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+crypto
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/arm64/defconfig+crypto/gcc-10/lab-baylibre/baseline-meson-gxl-s805x-libretech-ac.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/arm64/defconfig+crypto/gcc-10/lab-baylibre/baseline-meson-gxl-s805x-libretech-ac.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/arm64/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/64054ecef98aef20988c86a3
        failing since 12 days (last pass: next-20221130, first fail: next-20230221)

    2023-03-06T02:24:00.045146  / # #
    2023-03-06T02:24:00.146819  export SHELL=/bin/sh
    2023-03-06T02:24:00.147167  #
    2023-03-06T02:24:00.248489  / # export SHELL=/bin/sh. /lava-3389321/environment
    2023-03-06T02:24:00.248841  
    2023-03-06T02:24:00.350172  / # . /lava-3389321/environment/lava-3389321/bin/lava-test-runner /lava-3389321/1
    2023-03-06T02:24:00.350773  
    2023-03-06T02:24:00.356404  / # /lava-3389321/bin/lava-test-runner /lava-3389321/1
    2023-03-06T02:24:00.404544  + export 'TESTRUN_ID=1_bootrr'
    2023-03-06T02:24:00.439262  + cd /lava-3389321/1/tests/1_bootrr 
    ... (9 line(s) more)  

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-gxl-s805x-libretech-ac | arm64  | lab-baylibre    | gcc-10     | defconfig                    | 1          

  Details:     https://kernelci.org/test/plan/id/64054f47a4686f2a148c864c

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/arm64/defconfig/gcc-10/lab-baylibre/baseline-meson-gxl-s805x-libretech-ac.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/arm64/defconfig/gcc-10/lab-baylibre/baseline-meson-gxl-s805x-libretech-ac.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/arm64/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/64054f47a4686f2a148c8655
        failing since 12 days (last pass: next-20221129, first fail: next-20230221)

    2023-03-06T02:26:03.477700  / # #
    2023-03-06T02:26:03.579659  export SHELL=/bin/sh
    2023-03-06T02:26:03.580487  #
    2023-03-06T02:26:03.682159  / # export SHELL=/bin/sh. /lava-3389345/environment
    2023-03-06T02:26:03.682897  
    2023-03-06T02:26:03.784531  / # . /lava-3389345/environment/lava-3389345/bin/lava-test-runner /lava-3389345/1
    2023-03-06T02:26:03.785677  
    2023-03-06T02:26:03.804107  / # /lava-3389345/bin/lava-test-runner /lava-3389345/1
    2023-03-06T02:26:03.836106  + export 'TESTRUN_ID=1_bootrr'
    2023-03-06T02:26:03.874970  + cd /lava-3389345/1/tests/1_bootrr 
    ... (10 line(s) more)  

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-gxl-s805x-libretech-ac | arm64  | lab-baylibre    | gcc-10     | defconfig+ima                | 1          

  Details:     https://kernelci.org/test/plan/id/64054fbf9907c80c9e8c863a

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+ima
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/arm64/defconfig+ima/gcc-10/lab-baylibre/baseline-meson-gxl-s805x-libretech-ac.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/arm64/defconfig+ima/gcc-10/lab-baylibre/baseline-meson-gxl-s805x-libretech-ac.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/arm64/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/64054fbf9907c80c9e8c8643
        failing since 16 days (last pass: next-20221130, first fail: next-20230217)

    2023-03-06T02:27:58.053248  / # #
    2023-03-06T02:27:58.154821  export SHELL=/bin/sh
    2023-03-06T02:27:58.155306  #
    2023-03-06T02:27:58.256799  / # export SHELL=/bin/sh. /lava-3389402/environment
    2023-03-06T02:27:58.257286  
    2023-03-06T02:27:58.358814  / # . /lava-3389402/environment/lava-3389402/bin/lava-test-runner /lava-3389402/1
    2023-03-06T02:27:58.359633  
    2023-03-06T02:27:58.377703  / # /lava-3389402/bin/lava-test-runner /lava-3389402/1
    2023-03-06T02:27:58.449544  + export 'TESTRUN_ID=1_bootrr'
    2023-03-06T02:27:58.449902  + cd /lava-3389402/1/tests/1_bootrr 
    ... (10 line(s) more)  

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-gxl-s905d-p230         | arm64  | lab-baylibre    | gcc-10     | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/640551b6b0f5fba83a8c8637

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-gxl-s905d-p230.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-gxl-s905d-p230.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/640551b6b0f5fba83a8c8638
        failing since 26 days (last pass: next-20230203, first fail: next-20230207) 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-gxl-s905x-khadas-vim   | arm64  | lab-baylibre    | gcc-10     | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/64055126e3ba4255918c8643

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-gxl-s905x-khadas-vim.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-gxl-s905x-khadas-vim.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64055126e3ba4255918c8644
        failing since 26 days (last pass: next-20230206, first fail: next-20230207) 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-gxl-s905x-libretech-cc | arm64  | lab-baylibre    | gcc-10     | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/6405531b4c058e11788c8632

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-gxl-s905x-libretech-cc.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-gxl-s905x-libretech-cc.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6405531b4c058e11788c8633
        failing since 26 days (last pass: next-20230206, first fail: next-20230207) 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-gxl-s905x-libretech-cc | arm64  | lab-broonie     | gcc-10     | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/64055df47ce66cc5a48c864a

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/arm64/defconfig+kselftest/gcc-10/lab-broonie/baseline-meson-gxl-s905x-libretech-cc.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/arm64/defconfig+kselftest/gcc-10/lab-broonie/baseline-meson-gxl-s905x-libretech-cc.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64055df47ce66cc5a48c864b
        failing since 26 days (last pass: next-20230206, first fail: next-20230207) 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-gxl-s905x-libretech-cc | arm64  | lab-clabbe      | gcc-10     | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/64055171daf746b5af8c8662

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/arm64/defconfig+kselftest/gcc-10/lab-clabbe/baseline-meson-gxl-s905x-libretech-cc.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/arm64/defconfig+kselftest/gcc-10/lab-clabbe/baseline-meson-gxl-s905x-libretech-cc.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64055171daf746b5af8c8663
        failing since 26 days (last pass: next-20230206, first fail: next-20230207) 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-gxm-khadas-vim2        | arm64  | lab-baylibre    | gcc-10     | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/64055099bd243f4d458c866b

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-gxm-khadas-vim2.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-gxm-khadas-vim2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64055099bd243f4d458c866c
        failing since 26 days (last pass: next-20230206, first fail: next-20230207) 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-sm1-sei610             | arm64  | lab-baylibre    | gcc-10     | defconfig+CON..._16K_PAGES=y | 1          

  Details:     https://kernelci.org/test/plan/id/64054cf62c8c1632f18c863b

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+CONFIG_ARM64_16K_PAGES=y
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/arm64/defconfig+CONFIG_ARM64_16K_PAGES=y/gcc-10/lab-baylibre/baseline-meson-sm1-sei610.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/arm64/defconfig+CONFIG_ARM64_16K_PAGES=y/gcc-10/lab-baylibre/baseline-meson-sm1-sei610.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/arm64/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/64054cf62c8c1632f18c8644
        failing since 46 days (last pass: next-20230109, first fail: next-20230118)

    2023-03-06T02:16:13.931159  / # #
    2023-03-06T02:16:14.033146  export SHELL=/bin/sh
    2023-03-06T02:16:14.033636  #
    2023-03-06T02:16:14.135095  / # export SHELL=/bin/sh. /lava-3389283/environment
    2023-03-06T02:16:14.135938  
    2023-03-06T02:16:14.136415  / # <3>[   18.021966] brcmfmac: brcmf_sdio_htclk: HT Avail timeout (1000000): clkctl 0x50
    2023-03-06T02:16:14.238302  . /lava-3389283/environment/lava-3389283/bin/lava-test-runner /lava-3389283/1
    2023-03-06T02:16:14.239025  
    2023-03-06T02:16:14.279177  / # /lava-3389283/bin/lava-test-runner /lava-3389283/1
    2023-03-06T02:16:14.302274  + export 'TESTRUN_ID=1_bootrr' 
    ... (13 line(s) more)  

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-sm1-sei610             | arm64  | lab-baylibre    | gcc-10     | defconfig+crypto             | 1          

  Details:     https://kernelci.org/test/plan/id/64054de6251b92eb6c8c8631

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+crypto
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/arm64/defconfig+crypto/gcc-10/lab-baylibre/baseline-meson-sm1-sei610.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/arm64/defconfig+crypto/gcc-10/lab-baylibre/baseline-meson-sm1-sei610.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/arm64/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/64054de6251b92eb6c8c863a
        failing since 46 days (last pass: next-20230109, first fail: next-20230118)

    2023-03-06T02:20:17.114770  <8>[  102.807137] <LAVA_SIGNAL_ENDRUN 0_dmesg 3389315_1.5.2.4.1>
    2023-03-06T02:20:17.218883  / # #
    2023-03-06T02:20:17.320698  export SHELL=/bin/sh
    2023-03-06T02:20:17.321430  #
    2023-03-06T02:20:17.423217  / # export SHELL=/bin/sh. /lava-3389315/environment
    2023-03-06T02:20:17.423619  
    2023-03-06T02:20:17.423859  / # <3>[  103.052006] brcmfmac: brcmf_sdio_htclk: HT Avail timeout (1000000): clkctl 0x50
    2023-03-06T02:20:17.525216  . /lava-3389315/environment/lava-3389315/bin/lava-test-runner /lava-3389315/1
    2023-03-06T02:20:17.526460  
    2023-03-06T02:20:17.530578  / # /lava-3389315/bin/lava-test-runner /lava-3389315/1 
    ... (14 line(s) more)  

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-sm1-sei610             | arm64  | lab-baylibre    | gcc-10     | defconfig                    | 1          

  Details:     https://kernelci.org/test/plan/id/64054e36c9c67653118c863a

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/arm64/defconfig/gcc-10/lab-baylibre/baseline-meson-sm1-sei610.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/arm64/defconfig/gcc-10/lab-baylibre/baseline-meson-sm1-sei610.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/arm64/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/64054e36c9c67653118c8643
        failing since 46 days (last pass: next-20230109, first fail: next-20230118)

    2023-03-06T02:21:32.489920  / # #
    2023-03-06T02:21:32.591839  export SHELL=/bin/sh
    2023-03-06T02:21:32.592306  #
    2023-03-06T02:21:32.693698  / # export SHELL=/bin/sh. /lava-3389344/environment
    2023-03-06T02:21:32.694133  
    2023-03-06T02:21:32.694397  / # <3>[   18.171481] brcmfmac: brcmf_sdio_htclk: HT Avail timeout (1000000): clkctl 0x50
    2023-03-06T02:21:32.795781  . /lava-3389344/environment/lava-3389344/bin/lava-test-runner /lava-3389344/1
    2023-03-06T02:21:32.796569  
    2023-03-06T02:21:32.803469  / # /lava-3389344/bin/lava-test-runner /lava-3389344/1
    2023-03-06T02:21:32.866377  + export 'TESTRUN_ID=1_bootrr' 
    ... (14 line(s) more)  

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
meson-sm1-sei610             | arm64  | lab-baylibre    | gcc-10     | defconfig+ima                | 1          

  Details:     https://kernelci.org/test/plan/id/64054e860a34c267fa8c864e

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+ima
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/arm64/defconfig+ima/gcc-10/lab-baylibre/baseline-meson-sm1-sei610.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/arm64/defconfig+ima/gcc-10/lab-baylibre/baseline-meson-sm1-sei610.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/arm64/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/64054e860a34c267fa8c8657
        failing since 46 days (last pass: next-20230109, first fail: next-20230118)

    2023-03-06T02:22:52.040801  / # #
    2023-03-06T02:22:52.142782  export SHELL=/bin/sh
    2023-03-06T02:22:52.143547  #
    2023-03-06T02:22:52.245063  / # export SHELL=/bin/sh. /lava-3389397/environment
    2023-03-06T02:22:52.245569  
    2023-03-06T02:22:52.245865  / # <3>[   18.144625] brcmfmac: brcmf_sdio_htclk: HT Avail timeout (1000000): clkctl 0x50
    2023-03-06T02:22:52.347315  . /lava-3389397/environment/lava-3389397/bin/lava-test-runner /lava-3389397/1
    2023-03-06T02:22:52.348135  
    2023-03-06T02:22:52.361797  / # /lava-3389397/bin/lava-test-runner /lava-3389397/1
    2023-03-06T02:22:52.419744  + export 'TESTRUN_ID=1_bootrr' 
    ... (13 line(s) more)  

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
mt8183-kukui-...uniper-sku16 | arm64  | lab-collabora   | clang-13   | cros://chrome...4-chromebook | 1          

  Details:     https://kernelci.org/test/plan/id/64054da872cae5c8fe8c8687

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: cros://chromeos-5.10/arm64/chromiumos-arm64.flavour.config+arm64-chromebook
  Compiler:    clang-13 (Debian clang version 13.0.1-6~deb11u1)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/arm64/cros---chromeos-5.10-arm64-chromiumos-arm64.flavour.config+arm64-chromebook/clang-13/lab-collabora/baseline-mt8183-kukui-jacuzzi-juniper-sku16.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/arm64/cros---chromeos-5.10-arm64-chromiumos-arm64.flavour.config+arm64-chromebook/clang-13/lab-collabora/baseline-mt8183-kukui-jacuzzi-juniper-sku16.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64054da872cae5c8fe8c8688
        failing since 37 days (last pass: next-20230120, first fail: next-20230127) 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
mt8183-kukui-...uniper-sku16 | arm64  | lab-collabora   | clang-13   | cros://chrome...4-chromebook | 1          

  Details:     https://kernelci.org/test/plan/id/64054fd957fc21ff848c8632

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: cros://chromeos-5.10/arm64/chromiumos-mediatek.flavour.config+arm64-chromebook
  Compiler:    clang-13 (Debian clang version 13.0.1-6~deb11u1)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/arm64/cros---chromeos-5.10-arm64-chromiumos-mediatek.flavour.config+arm64-chromebook/clang-13/lab-collabora/baseline-mt8183-kukui-jacuzzi-juniper-sku16.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/arm64/cros---chromeos-5.10-arm64-chromiumos-mediatek.flavour.config+arm64-chromebook/clang-13/lab-collabora/baseline-mt8183-kukui-jacuzzi-juniper-sku16.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64054fd957fc21ff848c8633
        failing since 40 days (last pass: next-20230123, first fail: next-20230124) 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
mt8192-asurada-spherion-r0   | arm64  | lab-collabora   | gcc-10     | defconfig+arm64-chromebook   | 3          

  Details:     https://kernelci.org/test/plan/id/640555c7ddb717afc48c8645

  Results:     177 PASS, 9 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-mt8192-asurada-spherion-r0.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-mt8192-asurada-spherion-r0.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/arm64/rootfs.cpio.gz 

  * baseline.bootrr.clk-mt8192-pericfg-probed: https://kernelci.org/test/case/id/640555c7ddb717afc48c86fb
        failing since 31 days (last pass: next-20230130, first fail: next-20230202)

    2023-03-06T02:53:34.837935  /lava-9446204/1/../bin/lava-test-case

    2023-03-06T02:53:34.844157  <8>[   21.861917] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=clk-mt8192-pericfg-probed RESULT=fail>

  * baseline.bootrr.clk-mt8192-infracfg-probed: https://kernelci.org/test/case/id/640555c7ddb717afc48c86fc
        failing since 31 days (last pass: next-20230130, first fail: next-20230202)

    2023-03-06T02:53:33.817702  /lava-9446204/1/../bin/lava-test-case

    2023-03-06T02:53:33.824079  <8>[   20.841700] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=clk-mt8192-infracfg-probed RESULT=fail>

  * baseline.bootrr.clk-mt8192-topckgen-probed: https://kernelci.org/test/case/id/640555c7ddb717afc48c86fd
        failing since 31 days (last pass: next-20230130, first fail: next-20230202)

    2023-03-06T02:53:31.787002  andles:     0x0

    2023-03-06T02:53:31.787089    rHandle:      0

    2023-03-06T02:53:31.790313    V:            0

    2023-03-06T02:53:31.790402    Res:          0x0

    2023-03-06T02:53:31.793451  TPM2_CC_GetTestResult:

    2023-03-06T02:53:31.793541    value: 0x17C

    2023-03-06T02:53:31.796647    commandIndex: 0x17c

    2023-03-06T02:53:31.796736    reserved1:    0x0

    2023-03-06T02:53:31.800299    nv:           0

    2023-03-06T02:53:31.800387    extensive:    0
 
    ... (108 line(s) more)  

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
ox820-clouden...lug-series-3 | arm    | lab-baylibre    | gcc-10     | oxnas_v6_defconfig           | 1          

  Details:     https://kernelci.org/test/plan/id/64054adacab565f5e18c8658

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: oxnas_v6_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/arm/oxnas_v6_defconfig/gcc-10/lab-baylibre/baseline-ox820-cloudengines-pogoplug-series-3.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/arm/oxnas_v6_defconfig/gcc-10/lab-baylibre/baseline-ox820-cloudengines-pogoplug-series-3.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64054adacab565f5e18c8659
        failing since 194 days (last pass: next-20220822, first fail: next-20220823) 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qcom-qdf2400                 | arm64  | lab-linaro-lkft | gcc-10     | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/6405620eeca0cb8b578c8638

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/arm64/defconfig+kselftest/gcc-10/lab-linaro-lkft/baseline-qcom-qdf2400.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/arm64/defconfig+kselftest/gcc-10/lab-linaro-lkft/baseline-qcom-qdf2400.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6405620eeca0cb8b578c8639
        failing since 26 days (last pass: next-20230206, first fail: next-20230207) 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_arm-vexpress-a9         | arm    | lab-baylibre    | gcc-10     | vexpress_defconfig           | 1          

  Details:     https://kernelci.org/test/plan/id/64054e0f9cf5f8332e8c863c

  Results:     3 PASS, 2 FAIL, 2 SKIP
  Full config: vexpress_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/arm/vexpress_defconfig/gcc-10/lab-baylibre/baseline-qemu_arm-vexpress-a9.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/arm/vexpress_defconfig/gcc-10/lab-baylibre/baseline-qemu_arm-vexpress-a9.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/armel/rootfs.cpio.gz 

  * baseline.bootrr.all-cpus-are-online: https://kernelci.org/test/case/id/64054e0f9cf5f8332e8c8644
        failing since 18 days (last pass: next-20230214, first fail: next-20230215)

    2023-03-06T02:20:42.554388  /lava-3389373/1/../bin/lava-test-case   

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_arm-vexpress-a9         | arm    | lab-broonie     | gcc-10     | vexpress_defconfig           | 1          

  Details:     https://kernelci.org/test/plan/id/640567ecb0a4fb23da8c863d

  Results:     3 PASS, 2 FAIL, 2 SKIP
  Full config: vexpress_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/arm/vexpress_defconfig/gcc-10/lab-broonie/baseline-qemu_arm-vexpress-a9.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/arm/vexpress_defconfig/gcc-10/lab-broonie/baseline-qemu_arm-vexpress-a9.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/armel/rootfs.cpio.gz 

  * baseline.bootrr.all-cpus-are-online: https://kernelci.org/test/case/id/640567ecb0a4fb23da8c8645
        failing since 18 days (last pass: next-20230214, first fail: next-20230215)

    2023-03-06T04:11:12.524386  /lava-105134/1/../bin/lava-test-case
    2023-03-06T04:11:12.560126  <8><LAVA_SIGNAL_TESTCASE TEST_CASE_ID=all-cpus-are-online RESULT=fail>   

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_i386-uefi               | i386   | lab-baylibre    | gcc-10     | i386_defconfig+debug         | 1          

  Details:     https://kernelci.org/test/plan/id/64054d8cfeea065cfd8c8635

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: i386_defconfig+debug
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/i386/i386_defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_i386-uefi.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/i386/i386_defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_i386-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/x86/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64054d8cfeea065cfd8c8636
        failing since 19 days (last pass: next-20230210, first fail: next-20230214) 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_i386-uefi               | i386   | lab-baylibre    | gcc-10     | i386_defconfig               | 1          

  Details:     https://kernelci.org/test/plan/id/64054e1d34fa2de8058c8646

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: i386_defconfig
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/i386/i386_defconfig/gcc-10/lab-baylibre/baseline-qemu_i386-uefi.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/i386/i386_defconfig/gcc-10/lab-baylibre/baseline-qemu_i386-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/x86/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64054e1d34fa2de8058c8647
        failing since 19 days (last pass: next-20230213, first fail: next-20230214) 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_i386-uefi               | i386   | lab-broonie     | gcc-10     | i386_defconfig+debug         | 1          

  Details:     https://kernelci.org/test/plan/id/640565932d7b2eaa808c863b

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: i386_defconfig+debug
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/i386/i386_defconfig+debug/gcc-10/lab-broonie/baseline-qemu_i386-uefi.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/i386/i386_defconfig+debug/gcc-10/lab-broonie/baseline-qemu_i386-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/x86/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/640565932d7b2eaa808c863c
        failing since 19 days (last pass: next-20230210, first fail: next-20230214) 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_i386-uefi               | i386   | lab-broonie     | gcc-10     | i386_defconfig               | 1          

  Details:     https://kernelci.org/test/plan/id/6405660d969f57e2a58c8637

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: i386_defconfig
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/i386/i386_defconfig/gcc-10/lab-broonie/baseline-qemu_i386-uefi.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/i386/i386_defconfig/gcc-10/lab-broonie/baseline-qemu_i386-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/x86/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6405660d969f57e2a58c8638
        failing since 19 days (last pass: next-20230213, first fail: next-20230214) 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_i386-uefi               | i386   | lab-collabora   | gcc-10     | i386_defconfig+debug         | 1          

  Details:     https://kernelci.org/test/plan/id/64054d4cf587aefadf8c8640

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: i386_defconfig+debug
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/i386/i386_defconfig+debug/gcc-10/lab-collabora/baseline-qemu_i386-uefi.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/i386/i386_defconfig+debug/gcc-10/lab-collabora/baseline-qemu_i386-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/x86/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64054d4cf587aefadf8c8641
        failing since 19 days (last pass: next-20230210, first fail: next-20230214) 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-baylibre    | clang-13   | x86_64_defcon...6-chromebook | 1          

  Details:     https://kernelci.org/test/plan/id/64054a1ce7fc0edf288c865a

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook
  Compiler:    clang-13 (Debian clang version 13.0.1-6~deb11u1)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+x86-chromebook/clang-13/lab-baylibre/baseline-qemu_x86_64-uefi.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+x86-chromebook/clang-13/lab-baylibre/baseline-qemu_x86_64-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/x86/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64054a1ce7fc0edf288c865b
        failing since 19 days (last pass: next-20230213, first fail: next-20230214) 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-broonie     | clang-13   | x86_64_defcon...6-chromebook | 1          

  Details:     https://kernelci.org/test/plan/id/640562382652816ac78c862f

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook
  Compiler:    clang-13 (Debian clang version 13.0.1-6~deb11u1)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+x86-chromebook/clang-13/lab-broonie/baseline-qemu_x86_64-uefi.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+x86-chromebook/clang-13/lab-broonie/baseline-qemu_x86_64-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/x86/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/640562382652816ac78c8630
        failing since 19 days (last pass: next-20230213, first fail: next-20230214) 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-baylibre    | gcc-10     | x86_64_defconfig             | 1          

  Details:     https://kernelci.org/test/plan/id/64054b98331fa90dcc8c8664

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig/gcc-10/lab-baylibre/baseline-qemu_x86_64-uefi.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig/gcc-10/lab-baylibre/baseline-qemu_x86_64-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/x86/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64054b98331fa90dcc8c8665
        failing since 18 days (last pass: next-20230213, first fail: next-20230215) 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-baylibre    | gcc-10     | x86_64_defcon...86_kvm_guest | 1          

  Details:     https://kernelci.org/test/plan/id/64054c606768e026ed8c863f

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86_kvm_guest
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+x86_kvm_guest/gcc-10/lab-baylibre/baseline-qemu_x86_64-uefi.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+x86_kvm_guest/gcc-10/lab-baylibre/baseline-qemu_x86_64-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/x86/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64054c606768e026ed8c8640
        failing since 19 days (last pass: next-20230213, first fail: next-20230214) 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-baylibre    | gcc-10     | x86_64_defcon...ebook+amdgpu | 1          

  Details:     https://kernelci.org/test/plan/id/64054d2cc925126ac28c8638

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook+amdgpu
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+x86-chromebook+amdgpu/gcc-10/lab-baylibre/baseline-qemu_x86_64-uefi.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+x86-chromebook+amdgpu/gcc-10/lab-baylibre/baseline-qemu_x86_64-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/x86/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64054d2cc925126ac28c8639
        failing since 18 days (last pass: next-20230213, first fail: next-20230215) 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-baylibre    | gcc-10     | x86_64_defconfig+amdgpu      | 1          

  Details:     https://kernelci.org/test/plan/id/64054d6652a0effca68c863a

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+amdgpu
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+amdgpu/gcc-10/lab-baylibre/baseline-qemu_x86_64-uefi.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+amdgpu/gcc-10/lab-baylibre/baseline-qemu_x86_64-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/x86/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64054d6652a0effca68c863b
        failing since 19 days (last pass: next-20230213, first fail: next-20230214) 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-baylibre    | gcc-10     | x86_64_defconfig+ima         | 1          

  Details:     https://kernelci.org/test/plan/id/64054e1b9cf5f8332e8c8655

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+ima
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+ima/gcc-10/lab-baylibre/baseline-qemu_x86_64-uefi.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+ima/gcc-10/lab-baylibre/baseline-qemu_x86_64-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/x86/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64054e1b9cf5f8332e8c8656
        failing since 19 days (last pass: next-20230213, first fail: next-20230214) 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-baylibre    | gcc-10     | x86_64_defconfig+crypto      | 1          

  Details:     https://kernelci.org/test/plan/id/64054e947e391799798c862f

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+crypto
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+crypto/gcc-10/lab-baylibre/baseline-qemu_x86_64-uefi.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+crypto/gcc-10/lab-baylibre/baseline-qemu_x86_64-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/x86/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64054e947e391799798c8630
        failing since 18 days (last pass: next-20230213, first fail: next-20230215) 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-baylibre    | gcc-10     | x86_64_defconfig+debug       | 1          

  Details:     https://kernelci.org/test/plan/id/640551c4b0f5fba83a8c863c

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+debug
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_x86_64-uefi.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_x86_64-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/x86/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/640551c4b0f5fba83a8c863d
        failing since 10 days (last pass: next-20230222, first fail: next-20230223) 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-baylibre    | gcc-10     | x86_64_defcon...6-chromebook | 1          

  Details:     https://kernelci.org/test/plan/id/64055356ff71cf049d8c863d

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+x86-chromebook/gcc-10/lab-baylibre/baseline-qemu_x86_64-uefi.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+x86-chromebook/gcc-10/lab-baylibre/baseline-qemu_x86_64-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/x86/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64055356ff71cf049d8c863e
        failing since 19 days (last pass: next-20230213, first fail: next-20230214) 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-broonie     | gcc-10     | x86_64_defconfig             | 1          

  Details:     https://kernelci.org/test/plan/id/6405624b2652816ac78c8635

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig/gcc-10/lab-broonie/baseline-qemu_x86_64-uefi.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig/gcc-10/lab-broonie/baseline-qemu_x86_64-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/x86/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6405624b2652816ac78c8636
        failing since 18 days (last pass: next-20230213, first fail: next-20230215) 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-broonie     | gcc-10     | x86_64_defcon...86_kvm_guest | 1          

  Details:     https://kernelci.org/test/plan/id/640563c76a08081eb58c864c

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86_kvm_guest
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+x86_kvm_guest/gcc-10/lab-broonie/baseline-qemu_x86_64-uefi.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+x86_kvm_guest/gcc-10/lab-broonie/baseline-qemu_x86_64-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/x86/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/640563c76a08081eb58c864d
        failing since 19 days (last pass: next-20230213, first fail: next-20230214) 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-broonie     | gcc-10     | x86_64_defcon...ebook+amdgpu | 1          

  Details:     https://kernelci.org/test/plan/id/6405642b3c115be21f8c862f

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook+amdgpu
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+x86-chromebook+amdgpu/gcc-10/lab-broonie/baseline-qemu_x86_64-uefi.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+x86-chromebook+amdgpu/gcc-10/lab-broonie/baseline-qemu_x86_64-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/x86/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6405642b3c115be21f8c8630
        failing since 18 days (last pass: next-20230213, first fail: next-20230215) 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-broonie     | gcc-10     | x86_64_defconfig+amdgpu      | 1          

  Details:     https://kernelci.org/test/plan/id/6405643f3c115be21f8c8638

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+amdgpu
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+amdgpu/gcc-10/lab-broonie/baseline-qemu_x86_64-uefi.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+amdgpu/gcc-10/lab-broonie/baseline-qemu_x86_64-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/x86/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6405643f3c115be21f8c8639
        failing since 19 days (last pass: next-20230213, first fail: next-20230214) 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-broonie     | gcc-10     | x86_64_defconfig+ima         | 1          

  Details:     https://kernelci.org/test/plan/id/640565f880415210c18c867b

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+ima
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+ima/gcc-10/lab-broonie/baseline-qemu_x86_64-uefi.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+ima/gcc-10/lab-broonie/baseline-qemu_x86_64-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/x86/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/640565f880415210c18c867c
        failing since 19 days (last pass: next-20230213, first fail: next-20230214) 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-broonie     | gcc-10     | x86_64_defconfig+crypto      | 1          

  Details:     https://kernelci.org/test/plan/id/6405679c7da4ed9b138c8655

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+crypto
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+crypto/gcc-10/lab-broonie/baseline-qemu_x86_64-uefi.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+crypto/gcc-10/lab-broonie/baseline-qemu_x86_64-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/x86/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6405679c7da4ed9b138c8656
        failing since 18 days (last pass: next-20230213, first fail: next-20230215) 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-broonie     | gcc-10     | x86_64_defconfig+debug       | 1          

  Details:     https://kernelci.org/test/plan/id/64056b0ca6694eb1b78c8631

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+debug
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+debug/gcc-10/lab-broonie/baseline-qemu_x86_64-uefi.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+debug/gcc-10/lab-broonie/baseline-qemu_x86_64-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/x86/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64056b0ca6694eb1b78c8632
        failing since 10 days (last pass: next-20230222, first fail: next-20230223) 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-broonie     | gcc-10     | x86_64_defcon...6-chromebook | 1          

  Details:     https://kernelci.org/test/plan/id/64056bfc8b34e015998c8645

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+x86-chromebook/gcc-10/lab-broonie/baseline-qemu_x86_64-uefi.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+x86-chromebook/gcc-10/lab-broonie/baseline-qemu_x86_64-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/x86/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64056bfc8b34e015998c8646
        failing since 19 days (last pass: next-20230213, first fail: next-20230214) 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-collabora   | gcc-10     | x86_64_defconfig             | 1          

  Details:     https://kernelci.org/test/plan/id/64054b94331fa90dcc8c865a

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig/gcc-10/lab-collabora/baseline-qemu_x86_64-uefi.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig/gcc-10/lab-collabora/baseline-qemu_x86_64-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/x86/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64054b94331fa90dcc8c865b
        failing since 18 days (last pass: next-20230213, first fail: next-20230215) 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-collabora   | gcc-10     | x86_64_defcon...86_kvm_guest | 1          

  Details:     https://kernelci.org/test/plan/id/64054c70d916dc50718c862f

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86_kvm_guest
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+x86_kvm_guest/gcc-10/lab-collabora/baseline-qemu_x86_64-uefi.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+x86_kvm_guest/gcc-10/lab-collabora/baseline-qemu_x86_64-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/x86/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64054c70d916dc50718c8630
        failing since 19 days (last pass: next-20230213, first fail: next-20230214) 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-collabora   | gcc-10     | x86_64_defconfig+ima         | 1          

  Details:     https://kernelci.org/test/plan/id/64054dec251b92eb6c8c8641

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+ima
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+ima/gcc-10/lab-collabora/baseline-qemu_x86_64-uefi.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+ima/gcc-10/lab-collabora/baseline-qemu_x86_64-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/x86/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64054dec251b92eb6c8c8642
        failing since 19 days (last pass: next-20230213, first fail: next-20230214) 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-collabora   | gcc-10     | x86_64_defconfig+crypto      | 1          

  Details:     https://kernelci.org/test/plan/id/64054e650ba8b0174d8c862f

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+crypto
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+crypto/gcc-10/lab-collabora/baseline-qemu_x86_64-uefi.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+crypto/gcc-10/lab-collabora/baseline-qemu_x86_64-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/x86/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64054e650ba8b0174d8c8630
        failing since 18 days (last pass: next-20230213, first fail: next-20230215) 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-baylibre    | rustc-1.62 | x86_64_defconfig+rust        | 1          

  Details:     https://kernelci.org/test/plan/id/64054e54c9c67653118c8677

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+rust
  Compiler:    rustc-1.62 (Debian clang version 15.0.7)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+rust/rustc-1.62/lab-baylibre/baseline-qemu_x86_64-uefi.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+rust/rustc-1.62/lab-baylibre/baseline-qemu_x86_64-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/x86/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64054e54c9c67653118c8678
        failing since 2 days (last pass: next-20221226, first fail: next-20230303) 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-baylibre    | rustc-1.62 | x86_64_defcon...rust-samples | 1          

  Details:     https://kernelci.org/test/plan/id/640550356587861d238c862f

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+rust-samples
  Compiler:    rustc-1.62 (Debian clang version 15.0.7)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+rust-samples/rustc-1.62/lab-baylibre/baseline-qemu_x86_64-uefi.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+rust-samples/rustc-1.62/lab-baylibre/baseline-qemu_x86_64-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/x86/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/640550356587861d238c8630
        failing since 19 days (last pass: next-20230213, first fail: next-20230214) 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-baylibre    | rustc-1.62 | x86_64_defconfig             | 1          

  Details:     https://kernelci.org/test/plan/id/64055114b15209a2a78c865d

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig
  Compiler:    rustc-1.62 (Debian clang version 15.0.7)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig/rustc-1.62/lab-baylibre/baseline-qemu_x86_64-uefi.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig/rustc-1.62/lab-baylibre/baseline-qemu_x86_64-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/x86/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64055114b15209a2a78c865e
        failing since 19 days (last pass: next-20230213, first fail: next-20230214) 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-broonie     | rustc-1.62 | x86_64_defconfig+rust        | 1          

  Details:     https://kernelci.org/test/plan/id/6405675fbc820461528c8675

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+rust
  Compiler:    rustc-1.62 (Debian clang version 15.0.7)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+rust/rustc-1.62/lab-broonie/baseline-qemu_x86_64-uefi.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+rust/rustc-1.62/lab-broonie/baseline-qemu_x86_64-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/x86/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6405675fbc820461528c8676
        failing since 2 days (last pass: next-20221226, first fail: next-20230303) 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-broonie     | rustc-1.62 | x86_64_defcon...rust-samples | 1          

  Details:     https://kernelci.org/test/plan/id/64056968684d2bf5318c8630

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+rust-samples
  Compiler:    rustc-1.62 (Debian clang version 15.0.7)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+rust-samples/rustc-1.62/lab-broonie/baseline-qemu_x86_64-uefi.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+rust-samples/rustc-1.62/lab-broonie/baseline-qemu_x86_64-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/x86/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64056968684d2bf5318c8631
        failing since 19 days (last pass: next-20230213, first fail: next-20230214) 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-broonie     | rustc-1.62 | x86_64_defconfig             | 1          

  Details:     https://kernelci.org/test/plan/id/64056a583aab98a0b78c8631

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig
  Compiler:    rustc-1.62 (Debian clang version 15.0.7)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig/rustc-1.62/lab-broonie/baseline-qemu_x86_64-uefi.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig/rustc-1.62/lab-broonie/baseline-qemu_x86_64-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/x86/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64056a583aab98a0b78c8632
        failing since 19 days (last pass: next-20230213, first fail: next-20230214) 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-baylibre    | clang-13   | x86_64_defcon...6-chromebook | 1          

  Details:     https://kernelci.org/test/plan/id/64054a1bd743035b5e8c8637

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook
  Compiler:    clang-13 (Debian clang version 13.0.1-6~deb11u1)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+x86-chromebook/clang-13/lab-baylibre/baseline-qemu_x86_64-uefi-mixed.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+x86-chromebook/clang-13/lab-baylibre/baseline-qemu_x86_64-uefi-mixed.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/x86/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64054a1bd743035b5e8c8638
        failing since 19 days (last pass: next-20230213, first fail: next-20230214) 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-broonie     | clang-13   | x86_64_defcon...6-chromebook | 1          

  Details:     https://kernelci.org/test/plan/id/64056237258ca3feef8c8634

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook
  Compiler:    clang-13 (Debian clang version 13.0.1-6~deb11u1)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+x86-chromebook/clang-13/lab-broonie/baseline-qemu_x86_64-uefi-mixed.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+x86-chromebook/clang-13/lab-broonie/baseline-qemu_x86_64-uefi-mixed.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/x86/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64056237258ca3feef8c8635
        failing since 19 days (last pass: next-20230213, first fail: next-20230214) 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-baylibre    | gcc-10     | x86_64_defconfig             | 1          

  Details:     https://kernelci.org/test/plan/id/64054b998990d0f62f8c862f

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig/gcc-10/lab-baylibre/baseline-qemu_x86_64-uefi-mixed.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig/gcc-10/lab-baylibre/baseline-qemu_x86_64-uefi-mixed.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/x86/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64054b998990d0f62f8c8630
        failing since 19 days (last pass: next-20230213, first fail: next-20230214) 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-baylibre    | gcc-10     | x86_64_defcon...86_kvm_guest | 1          

  Details:     https://kernelci.org/test/plan/id/64054c618fb3f79e748c865d

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86_kvm_guest
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+x86_kvm_guest/gcc-10/lab-baylibre/baseline-qemu_x86_64-uefi-mixed.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+x86_kvm_guest/gcc-10/lab-baylibre/baseline-qemu_x86_64-uefi-mixed.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/x86/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64054c618fb3f79e748c865e
        failing since 19 days (last pass: next-20230213, first fail: next-20230214) 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-baylibre    | gcc-10     | x86_64_defcon...ebook+amdgpu | 1          

  Details:     https://kernelci.org/test/plan/id/64054d2a9c4fda89a88c8638

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook+amdgpu
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+x86-chromebook+amdgpu/gcc-10/lab-baylibre/baseline-qemu_x86_64-uefi-mixed.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+x86-chromebook+amdgpu/gcc-10/lab-baylibre/baseline-qemu_x86_64-uefi-mixed.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/x86/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64054d2a9c4fda89a88c8639
        failing since 18 days (last pass: next-20230213, first fail: next-20230215) 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-baylibre    | gcc-10     | x86_64_defconfig+amdgpu      | 1          

  Details:     https://kernelci.org/test/plan/id/64054d675c2302c7868c863f

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+amdgpu
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+amdgpu/gcc-10/lab-baylibre/baseline-qemu_x86_64-uefi-mixed.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+amdgpu/gcc-10/lab-baylibre/baseline-qemu_x86_64-uefi-mixed.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/x86/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64054d675c2302c7868c8640
        failing since 19 days (last pass: next-20230213, first fail: next-20230214) 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-baylibre    | gcc-10     | x86_64_defconfig+ima         | 1          

  Details:     https://kernelci.org/test/plan/id/64054e1c34fa2de8058c8643

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+ima
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+ima/gcc-10/lab-baylibre/baseline-qemu_x86_64-uefi-mixed.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+ima/gcc-10/lab-baylibre/baseline-qemu_x86_64-uefi-mixed.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/x86/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64054e1c34fa2de8058c8644
        failing since 19 days (last pass: next-20230213, first fail: next-20230214) 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-baylibre    | gcc-10     | x86_64_defconfig+crypto      | 1          

  Details:     https://kernelci.org/test/plan/id/64054e7eadbdd67c248c8653

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+crypto
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+crypto/gcc-10/lab-baylibre/baseline-qemu_x86_64-uefi-mixed.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+crypto/gcc-10/lab-baylibre/baseline-qemu_x86_64-uefi-mixed.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/x86/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64054e7eadbdd67c248c8654
        failing since 19 days (last pass: next-20230213, first fail: next-20230214) 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-baylibre    | gcc-10     | x86_64_defconfig+debug       | 1          

  Details:     https://kernelci.org/test/plan/id/640551c5be9acc9e8d8c863b

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+debug
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_x86_64-uefi-mixed.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_x86_64-uefi-mixed.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/x86/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/640551c5be9acc9e8d8c863c
        failing since 19 days (last pass: next-20230213, first fail: next-20230214) 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-baylibre    | gcc-10     | x86_64_defcon...6-chromebook | 1          

  Details:     https://kernelci.org/test/plan/id/64055355ff71cf049d8c863a

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+x86-chromebook/gcc-10/lab-baylibre/baseline-qemu_x86_64-uefi-mixed.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+x86-chromebook/gcc-10/lab-baylibre/baseline-qemu_x86_64-uefi-mixed.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/x86/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64055355ff71cf049d8c863b
        failing since 19 days (last pass: next-20230213, first fail: next-20230214) 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-broonie     | gcc-10     | x86_64_defconfig             | 1          

  Details:     https://kernelci.org/test/plan/id/6405625f2652816ac78c863a

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig/gcc-10/lab-broonie/baseline-qemu_x86_64-uefi-mixed.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig/gcc-10/lab-broonie/baseline-qemu_x86_64-uefi-mixed.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/x86/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6405625f2652816ac78c863b
        failing since 19 days (last pass: next-20230213, first fail: next-20230214) 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-broonie     | gcc-10     | x86_64_defcon...86_kvm_guest | 1          

  Details:     https://kernelci.org/test/plan/id/640563c88be9c64c838c8631

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86_kvm_guest
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+x86_kvm_guest/gcc-10/lab-broonie/baseline-qemu_x86_64-uefi-mixed.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+x86_kvm_guest/gcc-10/lab-broonie/baseline-qemu_x86_64-uefi-mixed.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/x86/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/640563c88be9c64c838c8632
        failing since 19 days (last pass: next-20230213, first fail: next-20230214) 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-broonie     | gcc-10     | x86_64_defcon...ebook+amdgpu | 1          

  Details:     https://kernelci.org/test/plan/id/6405641711c18fd99b8c8640

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook+amdgpu
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+x86-chromebook+amdgpu/gcc-10/lab-broonie/baseline-qemu_x86_64-uefi-mixed.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+x86-chromebook+amdgpu/gcc-10/lab-broonie/baseline-qemu_x86_64-uefi-mixed.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/x86/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6405641711c18fd99b8c8641
        failing since 18 days (last pass: next-20230213, first fail: next-20230215) 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-broonie     | gcc-10     | x86_64_defconfig+amdgpu      | 1          

  Details:     https://kernelci.org/test/plan/id/6405652fa84764fc1e8c863d

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+amdgpu
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+amdgpu/gcc-10/lab-broonie/baseline-qemu_x86_64-uefi-mixed.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+amdgpu/gcc-10/lab-broonie/baseline-qemu_x86_64-uefi-mixed.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/x86/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6405652fa84764fc1e8c863e
        failing since 19 days (last pass: next-20230213, first fail: next-20230214) 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-broonie     | gcc-10     | x86_64_defconfig+ima         | 1          

  Details:     https://kernelci.org/test/plan/id/6405660b80415210c18c86ac

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+ima
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+ima/gcc-10/lab-broonie/baseline-qemu_x86_64-uefi-mixed.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+ima/gcc-10/lab-broonie/baseline-qemu_x86_64-uefi-mixed.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/x86/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6405660b80415210c18c86ad
        failing since 19 days (last pass: next-20230213, first fail: next-20230214) 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-broonie     | gcc-10     | x86_64_defconfig+crypto      | 1          

  Details:     https://kernelci.org/test/plan/id/640567887da4ed9b138c862f

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+crypto
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+crypto/gcc-10/lab-broonie/baseline-qemu_x86_64-uefi-mixed.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+crypto/gcc-10/lab-broonie/baseline-qemu_x86_64-uefi-mixed.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/x86/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/640567887da4ed9b138c8630
        failing since 19 days (last pass: next-20230213, first fail: next-20230214) 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-broonie     | gcc-10     | x86_64_defconfig+debug       | 1          

  Details:     https://kernelci.org/test/plan/id/64056b0d1d2587dcfe8c862f

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+debug
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+debug/gcc-10/lab-broonie/baseline-qemu_x86_64-uefi-mixed.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+debug/gcc-10/lab-broonie/baseline-qemu_x86_64-uefi-mixed.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/x86/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64056b0d1d2587dcfe8c8630
        failing since 19 days (last pass: next-20230213, first fail: next-20230214) 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-broonie     | gcc-10     | x86_64_defcon...6-chromebook | 1          

  Details:     https://kernelci.org/test/plan/id/64056bd440ca2f7daa8c863e

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+x86-chromebook/gcc-10/lab-broonie/baseline-qemu_x86_64-uefi-mixed.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+x86-chromebook/gcc-10/lab-broonie/baseline-qemu_x86_64-uefi-mixed.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/x86/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64056bd440ca2f7daa8c863f
        failing since 19 days (last pass: next-20230213, first fail: next-20230214) 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-collabora   | gcc-10     | x86_64_defconfig             | 1          

  Details:     https://kernelci.org/test/plan/id/64054b95fe2aeced2d8c8631

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig/gcc-10/lab-collabora/baseline-qemu_x86_64-uefi-mixed.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig/gcc-10/lab-collabora/baseline-qemu_x86_64-uefi-mixed.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/x86/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64054b95fe2aeced2d8c8632
        failing since 19 days (last pass: next-20230213, first fail: next-20230214) 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-collabora   | gcc-10     | x86_64_defcon...86_kvm_guest | 1          

  Details:     https://kernelci.org/test/plan/id/64054c715daf84bab88c862f

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86_kvm_guest
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+x86_kvm_guest/gcc-10/lab-collabora/baseline-qemu_x86_64-uefi-mixed.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+x86_kvm_guest/gcc-10/lab-collabora/baseline-qemu_x86_64-uefi-mixed.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/x86/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64054c715daf84bab88c8630
        failing since 19 days (last pass: next-20230213, first fail: next-20230214) 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-collabora   | gcc-10     | x86_64_defconfig+ima         | 1          

  Details:     https://kernelci.org/test/plan/id/64054deed139b474b48c863a

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+ima
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+ima/gcc-10/lab-collabora/baseline-qemu_x86_64-uefi-mixed.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+ima/gcc-10/lab-collabora/baseline-qemu_x86_64-uefi-mixed.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/x86/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64054deed139b474b48c863b
        failing since 19 days (last pass: next-20230213, first fail: next-20230214) 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-collabora   | gcc-10     | x86_64_defconfig+debug       | 1          

  Details:     https://kernelci.org/test/plan/id/640551c1791a05b9d58c8633

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+debug
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+debug/gcc-10/lab-collabora/baseline-qemu_x86_64-uefi-mixed.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+debug/gcc-10/lab-collabora/baseline-qemu_x86_64-uefi-mixed.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/x86/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/640551c1791a05b9d58c8634
        failing since 19 days (last pass: next-20230213, first fail: next-20230214) 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-baylibre    | rustc-1.62 | x86_64_defconfig+rust        | 1          

  Details:     https://kernelci.org/test/plan/id/64054e6ba95775787e8c8636

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+rust
  Compiler:    rustc-1.62 (Debian clang version 15.0.7)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+rust/rustc-1.62/lab-baylibre/baseline-qemu_x86_64-uefi-mixed.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+rust/rustc-1.62/lab-baylibre/baseline-qemu_x86_64-uefi-mixed.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/x86/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64054e6ba95775787e8c8637
        failing since 2 days (last pass: next-20221226, first fail: next-20230303) 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-baylibre    | rustc-1.62 | x86_64_defcon...rust-samples | 1          

  Details:     https://kernelci.org/test/plan/id/6405504bdb877ad2f88c8641

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+rust-samples
  Compiler:    rustc-1.62 (Debian clang version 15.0.7)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+rust-samples/rustc-1.62/lab-baylibre/baseline-qemu_x86_64-uefi-mixed.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+rust-samples/rustc-1.62/lab-baylibre/baseline-qemu_x86_64-uefi-mixed.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/x86/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6405504bdb877ad2f88c8642
        failing since 19 days (last pass: next-20230213, first fail: next-20230214) 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-baylibre    | rustc-1.62 | x86_64_defconfig             | 1          

  Details:     https://kernelci.org/test/plan/id/64055113e3ba4255918c8631

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig
  Compiler:    rustc-1.62 (Debian clang version 15.0.7)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig/rustc-1.62/lab-baylibre/baseline-qemu_x86_64-uefi-mixed.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig/rustc-1.62/lab-baylibre/baseline-qemu_x86_64-uefi-mixed.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/x86/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64055113e3ba4255918c8632
        failing since 19 days (last pass: next-20230213, first fail: next-20230214) 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-broonie     | rustc-1.62 | x86_64_defconfig+rust        | 1          

  Details:     https://kernelci.org/test/plan/id/64056774e516fa78298c8651

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+rust
  Compiler:    rustc-1.62 (Debian clang version 15.0.7)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+rust/rustc-1.62/lab-broonie/baseline-qemu_x86_64-uefi-mixed.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+rust/rustc-1.62/lab-broonie/baseline-qemu_x86_64-uefi-mixed.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/x86/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64056774e516fa78298c8652
        failing since 2 days (last pass: next-20221226, first fail: next-20230303) 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-broonie     | rustc-1.62 | x86_64_defcon...rust-samples | 1          

  Details:     https://kernelci.org/test/plan/id/640569691cee5f82358c8aff

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+rust-samples
  Compiler:    rustc-1.62 (Debian clang version 15.0.7)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+rust-samples/rustc-1.62/lab-broonie/baseline-qemu_x86_64-uefi-mixed.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig+rust-samples/rustc-1.62/lab-broonie/baseline-qemu_x86_64-uefi-mixed.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/x86/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/640569691cee5f82358c8b00
        failing since 19 days (last pass: next-20230213, first fail: next-20230214) 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
qemu_x86_64-uefi-mixed       | x86_64 | lab-broonie     | rustc-1.62 | x86_64_defconfig             | 1          

  Details:     https://kernelci.org/test/plan/id/640569cc30c568cc3f8c863e

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig
  Compiler:    rustc-1.62 (Debian clang version 15.0.7)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig/rustc-1.62/lab-broonie/baseline-qemu_x86_64-uefi-mixed.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/x86_64/x86_64_defconfig/rustc-1.62/lab-broonie/baseline-qemu_x86_64-uefi-mixed.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/x86/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/640569cc30c568cc3f8c863f
        failing since 19 days (last pass: next-20230213, first fail: next-20230214) 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
r8a7743-iwg20d-q7            | arm    | lab-cip         | gcc-10     | shmobile_defconfig           | 1          

  Details:     https://kernelci.org/test/plan/id/6405516edaf746b5af8c8654

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: shmobile_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/arm/shmobile_defconfig/gcc-10/lab-cip/baseline-r8a7743-iwg20d-q7.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/arm/shmobile_defconfig/gcc-10/lab-cip/baseline-r8a7743-iwg20d-q7.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6405516edaf746b5af8c8655
        new failure (last pass: next-20230303) 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
r8a77960-ulcb                | arm64  | lab-collabora   | gcc-10     | defconfig+crypto             | 1          

  Details:     https://kernelci.org/test/plan/id/64054e244feb90596e8c8633

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+crypto
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/arm64/defconfig+crypto/gcc-10/lab-collabora/baseline-r8a77960-ulcb.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/arm64/defconfig+crypto/gcc-10/lab-collabora/baseline-r8a77960-ulcb.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/arm64/rootfs.cpio.gz 

  * baseline.bootrr.all-cpus-are-online: https://kernelci.org/test/case/id/64054e244feb90596e8c863b
        failing since 18 days (last pass: next-20230214, first fail: next-20230215)

    2023-03-06T02:21:05.649908  /lava-9445084/1/../bin/lava-test-case

    2023-03-06T02:21:05.650429  <8>[   97.373875] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=all-cpus-are-online RESULT=fail>

    2023-03-06T02:21:05.650831  /lava-9445084/1/../bin/lava-test-case

    2023-03-06T02:21:05.651178  <8>[   97.389293] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=tpm-chip-is-online RESULT=skip>

    2023-03-06T02:21:05.651561  + set +x

    2023-03-06T02:21:05.651998  <8>[   97.402392] <LAVA_SIGNAL_ENDRUN 1_bootrr 9445084_1.5.2.4.5>

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
r8a77960-ulcb                | arm64  | lab-collabora   | gcc-10     | defconfig                    | 1          

  Details:     https://kernelci.org/test/plan/id/64054e977e391799798c8635

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/arm64/defconfig/gcc-10/lab-collabora/baseline-r8a77960-ulcb.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/arm64/defconfig/gcc-10/lab-collabora/baseline-r8a77960-ulcb.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/arm64/rootfs.cpio.gz 

  * baseline.bootrr.all-cpus-are-online: https://kernelci.org/test/case/id/64054e977e391799798c863d
        failing since 18 days (last pass: next-20230214, first fail: next-20230215)

    2023-03-06T02:22:58.258819  /lava-9445099/1/../bin/lava-test-case

    2023-03-06T02:22:58.259411  <8>[   35.963212] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=all-cpus-are-online RESULT=fail>

    2023-03-06T02:22:58.259759  /lava-9445099/1/../bin/lava-test-case

    2023-03-06T02:22:58.260107  <8>[   35.978576] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=tpm-chip-is-online RESULT=skip>

    2023-03-06T02:22:58.260507  + set +x

    2023-03-06T02:22:58.260902  <8>[   35.991646] <LAVA_SIGNAL_ENDRUN 1_bootrr 9445099_1.5.2.4.5>

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
r8a77960-ulcb                | arm64  | lab-collabora   | gcc-10     | defconfig+ima                | 1          

  Details:     https://kernelci.org/test/plan/id/64054e987e391799798c8641

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+ima
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/arm64/defconfig+ima/gcc-10/lab-collabora/baseline-r8a77960-ulcb.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/arm64/defconfig+ima/gcc-10/lab-collabora/baseline-r8a77960-ulcb.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/arm64/rootfs.cpio.gz 

  * baseline.bootrr.all-cpus-are-online: https://kernelci.org/test/case/id/64054e997e391799798c8649
        failing since 16 days (last pass: next-20230214, first fail: next-20230217)

    2023-03-06T02:23:08.580256  /lava-9445123/1/../bin/lava-test-case

    2023-03-06T02:23:08.580880  <8>[   32.888531] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=all-cpus-are-online RESULT=fail>

    2023-03-06T02:23:08.581309  /lava-9445123/1/../bin/lava-test-case

    2023-03-06T02:23:08.581716  <8>[   32.904230] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=tpm-chip-is-online RESULT=skip>

    2023-03-06T02:23:08.582121  + set +x

    2023-03-06T02:23:08.582523  <8>[   32.917491] <LAVA_SIGNAL_ENDRUN 1_bootrr 9445123_1.5.2.4.5>

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
r8a77960-ulcb                | arm64  | lab-collabora   | gcc-10     | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/64054fafb013d8d9008c8641

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/arm64/defconfig+kselftest/gcc-10/lab-collabora/baseline-r8a77960-ulcb.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/arm64/defconfig+kselftest/gcc-10/lab-collabora/baseline-r8a77960-ulcb.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/arm64/rootfs.cpio.gz 

  * baseline.bootrr.all-cpus-are-online: https://kernelci.org/test/case/id/64054fafb013d8d9008c8649
        failing since 18 days (last pass: next-20230214, first fail: next-20230215)

    2023-03-06T02:27:50.131190  /lava-9445224/1/../bin/lava-test-case

    2023-03-06T02:27:50.162924  <8>[  129.716523] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=all-cpus-are-online RESULT=fail>

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
rk3288-rock2-square          | arm    | lab-collabora   | gcc-10     | multi_v7_defc...G_ARM_LPAE=y | 1          

  Details:     https://kernelci.org/test/plan/id/64054e5aef385e9bec8c862f

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/arm/multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y/gcc-10/lab-collabora/baseline-rk3288-rock2-square.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/arm/multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y/gcc-10/lab-collabora/baseline-rk3288-rock2-square.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64054e5aef385e9bec8c8630
        failing since 103 days (last pass: next-20221121, first fail: next-20221122) 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
rk3288-veyron-jaq            | arm    | lab-collabora   | gcc-10     | multi_v7_defc...G_ARM_LPAE=y | 1          

  Details:     https://kernelci.org/test/plan/id/64054d56b2069ff0bc8c863d

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/arm/multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y/gcc-10/lab-collabora/baseline-rk3288-veyron-jaq.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/arm/multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y/gcc-10/lab-collabora/baseline-rk3288-veyron-jaq.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64054d56b2069ff0bc8c863e
        failing since 103 days (last pass: next-20221121, first fail: next-20221122) 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
rk3399-gru-kevin             | arm64  | lab-collabora   | clang-13   | cros://chrome...4-chromebook | 2          

  Details:     https://kernelci.org/test/plan/id/64054ef50e9f04ec838c8631

  Results:     75 PASS, 13 FAIL, 0 SKIP
  Full config: cros://chromeos-5.10/arm64/chromiumos-rockchip64.flavour.config+arm64-chromebook
  Compiler:    clang-13 (Debian clang version 13.0.1-6~deb11u1)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/arm64/cros---chromeos-5.10-arm64-chromiumos-rockchip64.flavour.config+arm64-chromebook/clang-13/lab-collabora/baseline-rk3399-gru-kevin.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/arm64/cros---chromeos-5.10-arm64-chromiumos-rockchip64.flavour.config+arm64-chromebook/clang-13/lab-collabora/baseline-rk3399-gru-kevin.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/arm64/rootfs.cpio.gz 

  * baseline.bootrr.cros-ec-sensors-driver-present: https://kernelci.org/test/case/id/64054ef60e9f04ec838c8679
        failing since 13 days (last pass: next-20230217, first fail: next-20230220)

    2023-03-06T02:24:24.009434  <8>[   36.594629] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=cros-ec-rtc-probed RESULT=fail>

    2023-03-06T02:24:25.025214  /lava-9445150/1/../bin/lava-test-case

    2023-03-06T02:24:25.039419  <8>[   37.623666] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=cros-ec-sensors-driver-present RESULT=fail>

  * baseline.bootrr.cros-ec-rtc-probed: https://kernelci.org/test/case/id/64054ef60e9f04ec838c867a
        failing since 13 days (last pass: next-20230217, first fail: next-20230220)

    2023-03-06T02:24:23.996145  /lava-9445150/1/../bin/lava-test-case

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
rk3399-roc-pc                | arm64  | lab-clabbe      | gcc-10     | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/640550f69e3a0be0148c864f

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/arm64/defconfig+kselftest/gcc-10/lab-clabbe/baseline-rk3399-roc-pc.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/arm64/defconfig+kselftest/gcc-10/lab-clabbe/baseline-rk3399-roc-pc.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/640550f69e3a0be0148c8650
        failing since 26 days (last pass: next-20230206, first fail: next-20230207) 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
rk3399-rock-pi-4b            | arm64  | lab-collabora   | gcc-10     | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/6405502c796e7b57838c8638

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/arm64/defconfig+kselftest/gcc-10/lab-collabora/baseline-rk3399-rock-pi-4b.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/arm64/defconfig+kselftest/gcc-10/lab-collabora/baseline-rk3399-rock-pi-4b.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6405502c796e7b57838c8639
        failing since 26 days (last pass: next-20230206, first fail: next-20230207) 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
sun50i-h5-lib...ch-all-h3-cc | arm64  | lab-broonie     | gcc-10     | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/64057eb2d2859f89878c8644

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/arm64/defconfig+kselftest/gcc-10/lab-broonie/baseline-sun50i-h5-libretech-all-h3-cc.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/arm64/defconfig+kselftest/gcc-10/lab-broonie/baseline-sun50i-h5-libretech-all-h3-cc.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64057eb2d2859f89878c8645
        failing since 26 days (last pass: next-20230206, first fail: next-20230207) 

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
sun8i-h2-plus-orangepi-zero  | arm    | lab-baylibre    | gcc-10     | sunxi_defconfig              | 1          

  Details:     https://kernelci.org/test/plan/id/64054a83b085e73f738c8634

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: sunxi_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/arm/sunxi_defconfig/gcc-10/lab-baylibre/baseline-sun8i-h2-plus-orangepi-zero.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/arm/sunxi_defconfig/gcc-10/lab-baylibre/baseline-sun8i-h2-plus-orangepi-zero.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/armel/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/64054a83b085e73f738c863d
        failing since 8 days (last pass: next-20230224, first fail: next-20230225)

    2023-03-06T02:05:37.650861  <8>[    9.468600] <LAVA_SIGNAL_ENDRUN 0_dmesg 3389210_1.5.2.4.1>
    2023-03-06T02:05:37.770332  / # #
    2023-03-06T02:05:37.876091  export SHELL=/bin/sh
    2023-03-06T02:05:37.877768  #
    2023-03-06T02:05:37.981071  / # export SHELL=/bin/sh. /lava-3389210/environment
    2023-03-06T02:05:37.982720  
    2023-03-06T02:05:38.086176  / # . /lava-3389210/environment/lava-3389210/bin/lava-test-runner /lava-3389210/1
    2023-03-06T02:05:38.088998  
    2023-03-06T02:05:38.096027  / # /lava-3389210/bin/lava-test-runner /lava-3389210/1
    2023-03-06T02:05:38.207980  + export 'TESTRUN_ID=1_bootrr' 
    ... (11 line(s) more)  

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
sun8i-h3-libretech-all-h3-cc | arm    | lab-baylibre    | gcc-10     | sunxi_defconfig              | 1          

  Details:     https://kernelci.org/test/plan/id/64054a2fd743035b5e8c8649

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: sunxi_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/arm/sunxi_defconfig/gcc-10/lab-baylibre/baseline-sun8i-h3-libretech-all-h3-cc.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/arm/sunxi_defconfig/gcc-10/lab-baylibre/baseline-sun8i-h3-libretech-all-h3-cc.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/armel/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/64054a2fd743035b5e8c8652
        failing since 40 days (last pass: next-20230123, first fail: next-20230124)

    2023-03-06T02:04:05.358318  #
    2023-03-06T02:04:05.460513  / # #export SHELL=/bin/sh
    2023-03-06T02:04:05.460977  
    2023-03-06T02:04:05.562425  / # export SHELL=/bin/sh. /lava-3389211/environment
    2023-03-06T02:04:05.562861  
    2023-03-06T02:04:05.664336  / # . /lava-3389211/environment/lava-3389211/bin/lava-test-runner /lava-3389211/1
    2023-03-06T02:04:05.665068  
    2023-03-06T02:04:05.669344  / # /lava-3389211/bin/lava-test-runner /lava-3389211/1
    2023-03-06T02:04:05.828142  + export 'TESTRUN_ID=1_bootrr'
    2023-03-06T02:04:05.828509  + cd /lava-3389211/1/tests/1_bootrr 
    ... (10 line(s) more)  

platform                     | arch   | lab             | compiler   | defconfig                    | regressions
-----------------------------+--------+-----------------+------------+------------------------------+------------
tegra124-nyan-big            | arm    | lab-collabora   | gcc-10     | multi_v7_defc...G_ARM_LPAE=y | 1          

  Details:     https://kernelci.org/test/plan/id/64054d80ceeeede4848c8639

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230306/arm/multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y/gcc-10/lab-collabora/baseline-tegra124-nyan-big.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230306/arm/multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y/gcc-10/lab-collabora/baseline-tegra124-nyan-big.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230224.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64054d80ceeeede4848c863a
        failing since 102 days (last pass: next-20221121, first fail: next-20221123)