Subject: next/pending-fixes baseline: 615 runs, 71 regressions (v6.3-rc3-370-g8269040171a02)

From: "kernelci.org bot" <[email-masked]>
Date: Fri, 24 Mar 2023 03:43:28 -0700 (PDT)

next/pending-fixes baseline: 615 runs, 71 regressions (v6.3-rc3-370-g8269040171a02)

Regressions Summary
-------------------

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
am57xx-beagle-x15            | arm    | lab-linaro-lkft | gcc-10   | multi_v7_defc...CONFIG_SMP=n | 1          
asus-CM1400CXA-dalboz        | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...ok+kselftest | 1          
bcm2835-rpi-b-rev2           | arm    | lab-broonie     | gcc-10   | bcm2835_defconfig            | 1          
bcm2836-rpi-2-b              | arm    | lab-collabora   | gcc-10   | bcm2835_defconfig            | 1          
bcm2836-rpi-2-b              | arm    | lab-collabora   | gcc-10   | multi_v7_defc...MB2_KERNEL=y | 1          
beagle-xm                    | arm    | lab-baylibre    | gcc-10   | multi_v7_defc...MB2_KERNEL=y | 1          
beagle-xm                    | arm    | lab-baylibre    | gcc-10   | omap2plus_defconfig          | 1          
cubietruck                   | arm    | lab-baylibre    | gcc-10   | multi_v7_defconfig+ima       | 1          
cubietruck                   | arm    | lab-baylibre    | gcc-10   | multi_v7_defc...CONFIG_SMP=n | 1          
cubietruck                   | arm    | lab-baylibre    | gcc-10   | multi_v7_defconfig           | 1          
cubietruck                   | arm    | lab-baylibre    | gcc-10   | multi_v7_defc...MB2_KERNEL=y | 1          
cubietruck                   | arm    | lab-baylibre    | gcc-10   | multi_v7_defconfig+crypto    | 1          
da850-lcdk                   | arm    | lab-baylibre    | gcc-10   | davinci_all_defconfig        | 2          
imx6sx-sdb                   | arm    | lab-nxp         | gcc-10   | multi_v7_defconfig+crypto    | 1          
imx6ul-14x14-evk             | arm    | lab-nxp         | gcc-10   | multi_v7_defconfig+crypto    | 1          
imx7d-sdb                    | arm    | lab-nxp         | gcc-10   | multi_v7_defconfig+crypto    | 1          
imx7ulp-evk                  | arm    | lab-nxp         | gcc-10   | multi_v7_defconfig+crypto    | 1          
jetson-tk1                   | arm    | lab-baylibre    | gcc-10   | multi_v7_defc...G_ARM_LPAE=y | 1          
kontron-kbox-a-230-ls        | arm64  | lab-kontron     | gcc-10   | defconfig+crypto             | 5          
kontron-kbox-a-230-ls        | arm64  | lab-kontron     | gcc-10   | defconfig+kselftest          | 1          
meson-g12a-sei510            | arm64  | lab-baylibre    | gcc-10   | defconfig+kselftest          | 1          
meson-g12a-u200              | arm64  | lab-baylibre    | gcc-10   | defconfig+kselftest          | 1          
meson-g12a-x96-max           | arm64  | lab-baylibre    | gcc-10   | defconfig+kselftest          | 1          
meson-g12b-a311d-khadas-vim3 | arm64  | lab-baylibre    | gcc-10   | defconfig+kselftest          | 1          
meson-g12b-a311d-khadas-vim3 | arm64  | lab-collabora   | gcc-10   | defconfig+kselftest          | 1          
meson-g12b-odroid-n2         | arm64  | lab-baylibre    | gcc-10   | defconfig+kselftest          | 1          
meson-gxbb-nanopi-k2         | arm64  | lab-baylibre    | gcc-10   | defconfig+kselftest          | 1          
meson-gxl-s905d-p230         | arm64  | lab-baylibre    | gcc-10   | defconfig+kselftest          | 1          
meson-gxl-s905x-khadas-vim   | arm64  | lab-baylibre    | gcc-10   | defconfig+kselftest          | 1          
meson-gxl-s905x-libretech-cc | arm64  | lab-baylibre    | gcc-10   | defconfig+kselftest          | 1          
meson-gxl-s905x-libretech-cc | arm64  | lab-broonie     | gcc-10   | defconfig+CON...BIG_ENDIAN=y | 1          
meson-gxl-s905x-libretech-cc | arm64  | lab-broonie     | gcc-10   | defconfig+kselftest          | 1          
meson-gxm-khadas-vim2        | arm64  | lab-baylibre    | gcc-10   | defconfig+kselftest          | 1          
meson-sm1-khadas-vim3l       | arm64  | lab-baylibre    | gcc-10   | defconfig+CON...BIG_ENDIAN=y | 1          
meson-sm1-khadas-vim3l       | arm64  | lab-baylibre    | gcc-10   | defconfig+kselftest          | 1          
meson-sm1-sei610             | arm64  | lab-baylibre    | gcc-10   | defconfig+kselftest          | 1          
mt8173-elm-hana              | arm64  | lab-collabora   | gcc-10   | defconfig+arm...ok+kselftest | 1          
mt8183-kukui-...uniper-sku16 | arm64  | lab-collabora   | gcc-10   | defconfig+arm...ook+videodec | 3          
mt8183-kukui-...uniper-sku16 | arm64  | lab-collabora   | gcc-10   | defconfig+arm...ok+kselftest | 1          
mt8183-kukui-...uniper-sku16 | arm64  | lab-collabora   | gcc-10   | defconfig+arm64-chromebook   | 3          
mt8192-asurada-spherion-r0   | arm64  | lab-collabora   | gcc-10   | defconfig+arm...ook+videodec | 3          
mt8192-asurada-spherion-r0   | arm64  | lab-collabora   | gcc-10   | defconfig+arm64-chromebook   | 3          
mt8192-asurada-spherion-r0   | arm64  | lab-collabora   | gcc-10   | defconfig+arm...ok+kselftest | 1          
ox820-clouden...lug-series-3 | arm    | lab-baylibre    | gcc-10   | oxnas_v6_defconfig           | 1          
qcom-qdf2400                 | arm64  | lab-linaro-lkft | gcc-10   | defconfig+arm...ok+kselftest | 1          
qcom-qdf2400                 | arm64  | lab-linaro-lkft | gcc-10   | defconfig+kselftest          | 1          
qemu_mips-malta              | mips   | lab-collabora   | gcc-10   | malta_defconfig              | 1          
r8a7743-iwg20d-q7            | arm    | lab-cip         | gcc-10   | shmobile_defconfig           | 1          
rk3288-rock2-square          | arm    | lab-collabora   | gcc-10   | multi_v7_defc...G_ARM_LPAE=y | 1          
rk3288-veyron-jaq            | arm    | lab-collabora   | gcc-10   | multi_v7_defc...G_ARM_LPAE=y | 1          
rk3399-gru-kevin             | arm64  | lab-collabora   | gcc-10   | defconfig+arm...ok+kselftest | 1          
rk3399-roc-pc                | arm64  | lab-clabbe      | gcc-10   | defconfig+kselftest          | 1          
rk3399-rock-pi-4b            | arm64  | lab-collabora   | gcc-10   | defconfig+kselftest          | 1          
sc7180-trogdor-kingoftown    | arm64  | lab-collabora   | gcc-10   | defconfig+arm...ok+kselftest | 1          
sc7180-trogdo...zor-limozeen | arm64  | lab-collabora   | gcc-10   | defconfig+arm...ok+kselftest | 1          
sun50i-a64-pine64-plus       | arm64  | lab-broonie     | gcc-10   | defconfig+kselftest          | 1          
sun50i-h5-lib...ch-all-h3-cc | arm64  | lab-broonie     | gcc-10   | defconfig+kselftest          | 1          
sun8i-h2-plus-orangepi-zero  | arm    | lab-baylibre    | gcc-10   | sunxi_defconfig              | 1          

  Details:  https://kernelci.org/test/job/next/branch/pending-fixes/kernel/v6.3-rc3-370-g8269040171a02/plan/baseline/

  Test:     baseline
  Tree:     next
  Branch:   pending-fixes
  Describe: v6.3-rc3-370-g8269040171a02
  URL:      https://git.kernel.org/pub/scm/linux/kernel/git/next/linux-next.git
  SHA:      8269040171a02baf7b09f056d84e0c1d9814fd2d 

Test Regressions
---------------- 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
am57xx-beagle-x15            | arm    | lab-linaro-lkft | gcc-10   | multi_v7_defc...CONFIG_SMP=n | 1          

  Details:     https://kernelci.org/test/plan/id/641d55d9d466dc24ef9c954d

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_SMP=n
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm/multi_v7_defconfig+CONFIG_SMP=n/gcc-10/lab-linaro-lkft/baseline-am57xx-beagle-x15.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm/multi_v7_defconfig+CONFIG_SMP=n/gcc-10/lab-linaro-lkft/baseline-am57xx-beagle-x15.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d55d9d466dc24ef9c954e
        failing since 165 days (last pass: v6.0-6424-g1af0c6a154d32, first fail: v6.0-9666-g02c05e0b8d5c) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
asus-CM1400CXA-dalboz        | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...ok+kselftest | 1          

  Details:     https://kernelci.org/test/plan/id/641d4aa9ba94dce7bb9c9554

  Results:     6 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-chromebook+kselftest
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/x86_64/x86_64_defconfig+x86-chromebook+kselftest/gcc-10/lab-collabora/baseline-asus-CM1400CXA-dalboz.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/x86_64/x86_64_defconfig+x86-chromebook+kselftest/gcc-10/lab-collabora/baseline-asus-CM1400CXA-dalboz.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/x86/rootfs.cpio.gz 

  * baseline.dmesg.emerg: https://kernelci.org/test/case/id/641d4aa9ba94dce7bb9c9557
        failing since 9 days (last pass: v6.3-rc2-254-g7f35d1f08bb0, first fail: v6.3-rc2-307-g900e881df1ea3)
        3 lines

    2023-03-24T07:00:41.886409  kern  :emerg : __common_interrupt: 1.55 No irq handler for vector

    2023-03-24T07:00:41.892682  kern  :emerg : __common_interrupt: 2.55 No irq handler for vector

    2023-03-24T07:00:41.899520  kern  :emerg : __common_interrupt: 3.55 No irq handler for vector

    2023-03-24T07:00:41.906255  <8>[   96.049836] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=emerg RESULT=fail UNITS=lines MEASUREMENT=3>

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
bcm2835-rpi-b-rev2           | arm    | lab-broonie     | gcc-10   | bcm2835_defconfig            | 1          

  Details:     https://kernelci.org/test/plan/id/641d4538a63fcc7f8a9c9520

  Results:     50 PASS, 2 FAIL, 1 SKIP
  Full config: bcm2835_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm/bcm2835_defconfig/gcc-10/lab-broonie/baseline-bcm2835-rpi-b-rev2.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm/bcm2835_defconfig/gcc-10/lab-broonie/baseline-bcm2835-rpi-b-rev2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/armel/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/641d4538a63fcc7f8a9c9556
        failing since 9 days (last pass: v6.3-rc1-336-gbec2983895c5, first fail: v6.3-rc2-254-g7f35d1f08bb0)

    2023-03-24T06:37:21.075090  + set +x
    2023-03-24T06:37:21.079602  <8>[   18.959796] <LAVA_SIGNAL_ENDRUN 0_dmesg 220357_1.5.2.4.1>
    2023-03-24T06:37:21.211945  / # #
    2023-03-24T06:37:21.314428  export SHELL=/bin/sh
    2023-03-24T06:37:21.315004  #
    2023-03-24T06:37:21.416890  / # export SHELL=/bin/sh. /lava-220357/environment
    2023-03-24T06:37:21.417377  
    2023-03-24T06:37:21.519140  / # . /lava-220357/environment/lava-220357/bin/lava-test-runner /lava-220357/1
    2023-03-24T06:37:21.519890  
    2023-03-24T06:37:21.527111  / # /lava-220357/bin/lava-test-runner /lava-220357/1 
    ... (13 line(s) more)  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
bcm2836-rpi-2-b              | arm    | lab-collabora   | gcc-10   | bcm2835_defconfig            | 1          

  Details:     https://kernelci.org/test/plan/id/641d46411932fa1a9e9c9570

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: bcm2835_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm/bcm2835_defconfig/gcc-10/lab-collabora/baseline-bcm2836-rpi-2-b.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm/bcm2835_defconfig/gcc-10/lab-collabora/baseline-bcm2836-rpi-2-b.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/armel/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/641d46411932fa1a9e9c9579
        failing since 71 days (last pass: v6.2-rc3-243-g3145d9dfed32, first fail: v6.2-rc3-296-g79fa898551af)

    2023-03-24T06:41:51.168236  / # #

    2023-03-24T06:41:51.270443  export SHELL=/bin/sh

    2023-03-24T06:41:51.271098  #

    2023-03-24T06:41:51.372472  / # export SHELL=/bin/sh. /lava-9758571/environment

    2023-03-24T06:41:51.373033  

    2023-03-24T06:41:51.474407  / # . /lava-9758571/environment/lava-9758571/bin/lava-test-runner /lava-9758571/1

    2023-03-24T06:41:51.475396  

    2023-03-24T06:41:51.476832  / # /lava-9758571/bin/lava-test-runner /lava-9758571/1

    2023-03-24T06:41:51.601994  + export 'TESTRUN_ID=1_bootrr'

    2023-03-24T06:41:51.602394  + cd /lava-9758571/1/tests/1_bootrr
 
    ... (12 line(s) more)  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
bcm2836-rpi-2-b              | arm    | lab-collabora   | gcc-10   | multi_v7_defc...MB2_KERNEL=y | 1          

  Details:     https://kernelci.org/test/plan/id/641d4af25135ad767d9c9514

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm/multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y/gcc-10/lab-collabora/baseline-bcm2836-rpi-2-b.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm/multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y/gcc-10/lab-collabora/baseline-bcm2836-rpi-2-b.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d4af25135ad767d9c9515
        failing since 25 days (last pass: v6.2-8700-gab98cc06b683, first fail: v6.2-12625-g13efc3a9f23b) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
beagle-xm                    | arm    | lab-baylibre    | gcc-10   | multi_v7_defc...MB2_KERNEL=y | 1          

  Details:     https://kernelci.org/test/plan/id/641d4c70500c1d7b069c9505

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm/multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y/gcc-10/lab-baylibre/baseline-beagle-xm.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm/multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y/gcc-10/lab-baylibre/baseline-beagle-xm.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d4c70500c1d7b069c9506
        failing since 61 days (last pass: v6.2-rc4-412-g665ddd640630, first fail: v6.2-rc4-480-gb1867226dfbb) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
beagle-xm                    | arm    | lab-baylibre    | gcc-10   | omap2plus_defconfig          | 1          

  Details:     https://kernelci.org/test/plan/id/641d48a0db5b2317599c9509

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: omap2plus_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm/omap2plus_defconfig/gcc-10/lab-baylibre/baseline-beagle-xm.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm/omap2plus_defconfig/gcc-10/lab-baylibre/baseline-beagle-xm.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d48a0db5b2317599c950a
        failing since 15 days (last pass: v6.3-rc1-217-g03913bd4e939, first fail: v6.3-rc1-281-g08705758878ed) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
cubietruck                   | arm    | lab-baylibre    | gcc-10   | multi_v7_defconfig+ima       | 1          

  Details:     https://kernelci.org/test/plan/id/641d47267e634965f19c9521

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: multi_v7_defconfig+ima
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm/multi_v7_defconfig+ima/gcc-10/lab-baylibre/baseline-cubietruck.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm/multi_v7_defconfig+ima/gcc-10/lab-baylibre/baseline-cubietruck.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/armel/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/641d47267e634965f19c952a
        failing since 65 days (last pass: v6.1-13341-g16cba743aec0, first fail: v6.2-rc4-302-g48ed69cf21b2)

    2023-03-24T06:45:40.276314  <8>[   15.115144] <LAVA_SIGNAL_ENDRUN 0_dmesg 3440000_1.5.2.4.1>
    2023-03-24T06:45:40.388738  / # #
    2023-03-24T06:45:40.491893  export SHELL=/bin/sh
    2023-03-24T06:45:40.492254  #
    2023-03-24T06:45:40.492425  / # <3>[   15.246713] Bluetooth: hci0: command 0x0c03 tx timeout
    2023-03-24T06:45:40.593571  export SHELL=/bin/sh. /lava-3440000/environment
    2023-03-24T06:45:40.593994  
    2023-03-24T06:45:40.695275  / # . /lava-3440000/environment/lava-3440000/bin/lava-test-runner /lava-3440000/1
    2023-03-24T06:45:40.695904  
    2023-03-24T06:45:40.700906  / # /lava-3440000/bin/lava-test-runner /lava-3440000/1 
    ... (11 line(s) more)  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
cubietruck                   | arm    | lab-baylibre    | gcc-10   | multi_v7_defc...CONFIG_SMP=n | 1          

  Details:     https://kernelci.org/test/plan/id/641d4aa7bf197ce2a09c9547

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: multi_v7_defconfig+CONFIG_SMP=n
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm/multi_v7_defconfig+CONFIG_SMP=n/gcc-10/lab-baylibre/baseline-cubietruck.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm/multi_v7_defconfig+CONFIG_SMP=n/gcc-10/lab-baylibre/baseline-cubietruck.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/armel/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/641d4aa7bf197ce2a09c9550
        failing since 65 days (last pass: v6.1-13341-g16cba743aec0, first fail: v6.2-rc4-302-g48ed69cf21b2)

    2023-03-24T07:00:27.750251  <8>[   16.661407] <LAVA_SIGNAL_ENDRUN 0_dmesg 3440091_1.5.2.4.1>
    2023-03-24T07:00:27.855502  / # #
    2023-03-24T07:00:27.957032  export SHELL=/bin/sh
    2023-03-24T07:00:27.957428  #
    2023-03-24T07:00:28.058834  / # export SHELL=/bin/sh. /lava-3440091/environment
    2023-03-24T07:00:28.059342  
    2023-03-24T07:00:28.160588  / # . /lava-3440091/environment/lava-3440091/bin/lava-test-runner /lava-3440091/1
    2023-03-24T07:00:28.161236  
    2023-03-24T07:00:28.166442  / # /lava-3440091/bin/lava-test-runner /lava-3440091/1
    2023-03-24T07:00:28.256337  + export 'TESTRUN_ID=1_bootrr' 
    ... (11 line(s) more)  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
cubietruck                   | arm    | lab-baylibre    | gcc-10   | multi_v7_defconfig           | 1          

  Details:     https://kernelci.org/test/plan/id/641d4b215b75eff9a49c9661

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: multi_v7_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm/multi_v7_defconfig/gcc-10/lab-baylibre/baseline-cubietruck.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm/multi_v7_defconfig/gcc-10/lab-baylibre/baseline-cubietruck.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/armel/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/641d4b215b75eff9a49c966a
        failing since 65 days (last pass: v6.1-13341-g16cba743aec0, first fail: v6.2-rc4-302-g48ed69cf21b2)

    2023-03-24T07:02:40.018126  <8>[   15.095296] <LAVA_SIGNAL_ENDRUN 0_dmesg 3440106_1.5.2.4.1>
    2023-03-24T07:02:40.129658  / # #
    2023-03-24T07:02:40.233522  export SHELL=/bin/sh
    2023-03-24T07:02:40.234432  #
    2023-03-24T07:02:40.336319  / # export SHELL=/bin/sh. /lava-3440106/environment
    2023-03-24T07:02:40.337248  
    2023-03-24T07:02:40.439385  / # . /lava-3440106/environment/lava-3440106/bin/lava-test-runner /lava-3440106/1
    2023-03-24T07:02:40.440770  
    2023-03-24T07:02:40.441192  / # /lava-3440106/bin/lava-test-runner /lava-3440106/1<3>[   15.486758] Bluetooth: hci0: command 0x0c03 tx timeout
    2023-03-24T07:02:40.446553   
    ... (12 line(s) more)  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
cubietruck                   | arm    | lab-baylibre    | gcc-10   | multi_v7_defc...MB2_KERNEL=y | 1          

  Details:     https://kernelci.org/test/plan/id/641d4bb4f55d41a2779c9522

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm/multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y/gcc-10/lab-baylibre/baseline-cubietruck.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm/multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y/gcc-10/lab-baylibre/baseline-cubietruck.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/armel/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/641d4bb4f55d41a2779c952b
        failing since 65 days (last pass: v6.1-13341-g16cba743aec0, first fail: v6.2-rc4-302-g48ed69cf21b2)

    2023-03-24T07:05:12.897390  <8>[   15.101706] <LAVA_SIGNAL_ENDRUN 0_dmesg 3440130_1.5.2.4.1>
    2023-03-24T07:05:13.004925  / # #
    2023-03-24T07:05:13.106829  export SHELL=/bin/sh
    2023-03-24T07:05:13.107381  #
    2023-03-24T07:05:13.210795  / # export SHELL=/bin/sh. /lava-3440130/environment
    2023-03-24T07:05:13.211151  
    2023-03-24T07:05:13.312399  / # . /lava-3440130/environment/lava-3440130/bin/lava-test-runner /lava-3440130/1
    2023-03-24T07:05:13.313103  
    2023-03-24T07:05:13.313317  / # /lava-3440130/bin/lava-test-runner /lava-3440130/1<3>[   15.486414] Bluetooth: hci0: command 0x0c03 tx timeout
    2023-03-24T07:05:13.317580   
    ... (12 line(s) more)  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
cubietruck                   | arm    | lab-baylibre    | gcc-10   | multi_v7_defconfig+crypto    | 1          

  Details:     https://kernelci.org/test/plan/id/641d4c52fb5938ee979c9544

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: multi_v7_defconfig+crypto
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm/multi_v7_defconfig+crypto/gcc-10/lab-baylibre/baseline-cubietruck.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm/multi_v7_defconfig+crypto/gcc-10/lab-baylibre/baseline-cubietruck.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/armel/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/641d4c52fb5938ee979c954d
        failing since 65 days (last pass: v6.1-13341-g16cba743aec0, first fail: v6.2-rc4-302-g48ed69cf21b2)

    2023-03-24T07:07:45.429082  + set +x<8>[   24.310174] <LAVA_SIGNAL_ENDRUN 0_dmesg 3440240_1.5.2.4.1>
    2023-03-24T07:07:45.429279  
    2023-03-24T07:07:45.534987  / # #
    2023-03-24T07:07:45.636435  export SHELL=/bin/sh
    2023-03-24T07:07:45.636823  #
    2023-03-24T07:07:45.738174  / # export SHELL=/bin/sh. /lava-3440240/environment
    2023-03-24T07:07:45.738969  
    2023-03-24T07:07:45.840914  / # . /lava-3440240/environment/lava-3440240/bin/lava-test-runner /lava-3440240/1
    2023-03-24T07:07:45.842298  
    2023-03-24T07:07:45.847324  / # /lava-3440240/bin/lava-test-runner /lava-3440240/1 
    ... (12 line(s) more)  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
da850-lcdk                   | arm    | lab-baylibre    | gcc-10   | davinci_all_defconfig        | 2          

  Details:     https://kernelci.org/test/plan/id/641d41c9da9775a1749c950e

  Results:     3 PASS, 3 FAIL, 1 SKIP
  Full config: davinci_all_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm/davinci_all_defconfig/gcc-10/lab-baylibre/baseline-da850-lcdk.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm/davinci_all_defconfig/gcc-10/lab-baylibre/baseline-da850-lcdk.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/armel/rootfs.cpio.gz 

  * baseline.dmesg.emerg: https://kernelci.org/test/case/id/641d41c9da9775a1749c9511
        failing since 21 days (last pass: v6.2-1218-g2d4a54ee969d, first fail: v6.2-13370-g5872d227b73f)
        30 lines

    2023-03-24T06:22:24.079499  kern  :alert : Register r7 information: non-paged memory
    2023-03-24T06:22:24.079977  kern  :alert : Register r8 information: slab kmalloc-512 start c4e80200 pointer offset 4 size 512
    2023-03-24T06:22:24.080337  kern  :alert : Register r9 information: non-paged memory
    2023-03-24T06:22:24.080673  kern  :alert : Register r10 information: NULL pointer
    2023-03-24T06:22:24.081308  kern  :alert : Register r11 information: 5-page vmalloc region starting at 0xbf4ad000 allocated at load_module+0x898/0x1b10
    2023-03-24T06:22:24.082742  kern  :alert : Register r12 information: non-paged memory
    2023-03-24T06:22:24.170945  kern  :emerg : Internal error: Oops: 17 [#1] PREEMPT ARM
    2023-03-24T06:22:24.171479  kern  :emerg : Process udevd (pid: 65, stack limit = 0xbf7f26b8)
    2023-03-24T06:22:24.171920  kern  :emerg : Stack: (0xc8901cf8 to 0xc8902000)
    2023-03-24T06:22:24.172309  kern  :emerg : 1ce0:                                                       c4e80200 c076f860 
    ... (7 line(s) more)  

  * baseline.dmesg.alert: https://kernelci.org/test/case/id/641d41c9da9775a1749c9512
        failing since 424 days (last pass: v5.16-11577-gffd79fec234d, first fail: v5.17-rc1-180-g86539e2bdb99)
        18 lines

    2023-03-24T06:22:23.988204  kern  :alert : BUG: Bad page state in process kworker/u2:0  pfn:c3400
    2023-03-24T06:22:23.988646  kern  :alert : BUG: Bad page state in process kworker/u2:0  pfn:c3800
    2023-03-24T06:22:23.988788  kern  :alert : 8<--- cut here ---
    2023-03-24T06:22:23.988907  kern  :alert : Unable to handle kernel NULL pointer dereference at virtual address 00000060 when read
    2023-03-24T06:22:23.989020  kern  :alert : [00000060] *pgd=c49ad831, *pte=00000000, *ppte=00000000
    2023-03-24T06:22:23.989128  kern  :alert : Register r0 information: non-paged memory
    2023-03-24T06:22:24.032253  kern  :alert : Register r1 information: 2-page vmalloc region starting at 0xc8900000 allocated at kernel_clone+0x98/0x3a0
    2023-03-24T06:22:24.032914  kern  :alert : Register r2 information: non-slab/vmalloc memory
    2023-03-24T06:22:24.033815  kern  :alert : Register r3 information: non-paged memory
    2023-03-24T06:22:24.034349  kern  :alert : R<8><LAVA_SIGNAL_TESTCASE TEST_CASE_ID=alert RESULT=fail UNITS=lines MEASUREMENT=18> 
    ... (3 line(s) more)  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
imx6sx-sdb                   | arm    | lab-nxp         | gcc-10   | multi_v7_defconfig+crypto    | 1          

  Details:     https://kernelci.org/test/plan/id/641d4d3b8257cf4e239c9512

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: multi_v7_defconfig+crypto
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm/multi_v7_defconfig+crypto/gcc-10/lab-nxp/baseline-imx6sx-sdb.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm/multi_v7_defconfig+crypto/gcc-10/lab-nxp/baseline-imx6sx-sdb.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/armel/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/641d4d3b8257cf4e239c9519
        failing since 78 days (last pass: v6.1-rc4-405-g5cc6cef624e2, first fail: v6.2-rc2-332-g2d3ca5d07c8e)

    2023-03-24T07:11:34.128737  <8>[   43.353094] <LAVA_SIGNAL_ENDRUN 0_dmesg 1184885_1.5.2.4.1>
    2023-03-24T07:11:34.232783  / # #
    2023-03-24T07:11:35.392689  export SHELL=/bin/sh
    2023-03-24T07:11:35.398370  #
    2023-03-24T07:11:36.945483  / # export SHELL=/bin/sh. /lava-1184885/environment
    2023-03-24T07:11:36.951169  
    2023-03-24T07:11:39.770710  / # . /lava-1184885/environment/lava-1184885/bin/lava-test-runner /lava-1184885/1
    2023-03-24T07:11:39.777042  
    2023-03-24T07:11:39.777387  / # /lava-1184885/bin/lava-test-runner /lava-1184885/1
    2023-03-24T07:11:39.839704  + export 'TESTRUN_ID=1_bootrr' 
    ... (21 line(s) more)  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
imx6ul-14x14-evk             | arm    | lab-nxp         | gcc-10   | multi_v7_defconfig+crypto    | 1          

  Details:     https://kernelci.org/test/plan/id/641d4e1732b243d1ab9c9662

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: multi_v7_defconfig+crypto
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm/multi_v7_defconfig+crypto/gcc-10/lab-nxp/baseline-imx6ul-14x14-evk.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm/multi_v7_defconfig+crypto/gcc-10/lab-nxp/baseline-imx6ul-14x14-evk.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/armel/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/641d4e1732b243d1ab9c9669
        failing since 78 days (last pass: v6.1-rc4-339-g185da88d03ed, first fail: v6.2-rc2-332-g2d3ca5d07c8e)

    2023-03-24T07:15:19.767279  + set +x
    2023-03-24T07:15:19.768378  <8>[   58.002723] <LAVA_SIGNAL_ENDRUN 0_dmesg 1184888_1.5.2.4.1>
    2023-03-24T07:15:19.878515  / # #
    2023-03-24T07:15:21.038323  export SHELL=/bin/sh
    2023-03-24T07:15:21.044040  #
    2023-03-24T07:15:22.591885  / # export SHELL=/bin/sh. /lava-1184888/environment
    2023-03-24T07:15:22.597579  
    2023-03-24T07:15:25.419876  / # . /lava-1184888/environment/lava-1184888/bin/lava-test-runner /lava-1184888/1
    2023-03-24T07:15:25.425877  
    2023-03-24T07:15:25.426409  / # /lava-1184888/bin/lava-test-runner /lava-1184888/1 
    ... (18 line(s) more)  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
imx7d-sdb                    | arm    | lab-nxp         | gcc-10   | multi_v7_defconfig+crypto    | 1          

  Details:     https://kernelci.org/test/plan/id/641d4b79be1df0d63d9c951f

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: multi_v7_defconfig+crypto
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm/multi_v7_defconfig+crypto/gcc-10/lab-nxp/baseline-imx7d-sdb.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm/multi_v7_defconfig+crypto/gcc-10/lab-nxp/baseline-imx7d-sdb.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/armel/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/641d4b79be1df0d63d9c9526
        failing since 78 days (last pass: v6.1-rc6-391-gf445421fe4c7, first fail: v6.2-rc2-332-g2d3ca5d07c8e)

    2023-03-24T07:03:37.808176  + set<8>[   38.687769] <LAVA_SIGNAL_ENDRUN 0_dmesg 1184886_1.5.2.4.1>
    2023-03-24T07:03:37.808297   +x
    2023-03-24T07:03:37.911344  / # #
    2023-03-24T07:03:39.069656  export SHELL=/bin/sh
    2023-03-24T07:03:39.075017  #
    2023-03-24T07:03:40.620253  / # export SHELL=/bin/sh. /lava-1184886/environment
    2023-03-24T07:03:40.625651  
    2023-03-24T07:03:40.625786  / # . /lava-1184886/environment
    2023-03-24T07:03:43.444639  /lava-1184886/bin/lava-test-runner /lava-1184886/1
    2023-03-24T07:03:43.454119  / # /lava-1184886/bin/lava-test-runner /lava-1184886/1 
    ... (23 line(s) more)  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
imx7ulp-evk                  | arm    | lab-nxp         | gcc-10   | multi_v7_defconfig+crypto    | 1          

  Details:     https://kernelci.org/test/plan/id/641d4e84412adc2c3f9c9553

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: multi_v7_defconfig+crypto
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm/multi_v7_defconfig+crypto/gcc-10/lab-nxp/baseline-imx7ulp-evk.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm/multi_v7_defconfig+crypto/gcc-10/lab-nxp/baseline-imx7ulp-evk.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/armel/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/641d4e84412adc2c3f9c955a
        failing since 78 days (last pass: v6.1-rc6-391-gf445421fe4c7, first fail: v6.2-rc2-332-g2d3ca5d07c8e)

    2023-03-24T07:16:51.288509  + set +x<8>[   66.927673] <LAVA_SIGNAL_ENDRUN 0_dmesg 1184889_1.5.2.4.1>
    2023-03-24T07:16:51.288685  
    2023-03-24T07:16:51.396271  / # #
    2023-03-24T07:16:52.554308  export SHELL=/bin/sh
    2023-03-24T07:16:52.559684  #
    2023-03-24T07:16:52.559814  / # export SHELL=/bin/sh
    2023-03-24T07:16:54.105174  / # . /lava-1184889/environment
    2023-03-24T07:16:56.929087  /lava-1184889/bin/lava-test-runner /lava-1184889/1
    2023-03-24T07:16:56.934758  . /lava-1184889/environment
    2023-03-24T07:16:56.934961  / # /lava-1184889/bin/lava-test-runner /lava-1184889/1 
    ... (12 line(s) more)  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
jetson-tk1                   | arm    | lab-baylibre    | gcc-10   | multi_v7_defc...G_ARM_LPAE=y | 1          

  Details:     https://kernelci.org/test/plan/id/641d4c375c8602c5779c9554

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm/multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y/gcc-10/lab-baylibre/baseline-jetson-tk1.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm/multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y/gcc-10/lab-baylibre/baseline-jetson-tk1.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d4c375c8602c5779c9555
        failing since 328 days (last pass: v5.18-rc2-366-ga3e1163f7eb1a, first fail: v5.18-rc4-464-g425675974eb3) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
kontron-kbox-a-230-ls        | arm64  | lab-kontron     | gcc-10   | defconfig+crypto             | 5          

  Details:     https://kernelci.org/test/plan/id/641d46e128ae904a4f9c950b

  Results:     90 PASS, 5 FAIL, 1 SKIP
  Full config: defconfig+crypto
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm64/defconfig+crypto/gcc-10/lab-kontron/baseline-kontron-kbox-a-230-ls.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm64/defconfig+crypto/gcc-10/lab-kontron/baseline-kontron-kbox-a-230-ls.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/arm64/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/641d46e128ae904a4f9c9512
        failing since 29 days (last pass: v6.2-1218-g2d4a54ee969d, first fail: v6.2-6789-g74c3b2e0a611)

    2023-03-24T06:44:33.279172  / # #
    2023-03-24T06:44:33.380286  export SHELL=/bin/sh
    2023-03-24T06:44:33.380515  #
    2023-03-24T06:44:33.481464  / # export SHELL=/bin/sh. /lava-302879/environment
    2023-03-24T06:44:33.481716  
    2023-03-24T06:44:33.582687  / # . /lava-302879/environment/lava-302879/bin/lava-test-runner /lava-302879/1
    2023-03-24T06:44:33.583075  
    2023-03-24T06:44:33.593052  / # /lava-302879/bin/lava-test-runner /lava-302879/1
    2023-03-24T06:44:33.609054  + export 'TESTRUN_ID=1_bootrr'
    2023-03-24T06:44:33.653934  + <8>[   43.067440] <LAVA_SIGNAL_STARTRUN 1_bootrr 302879_1.5.2.4.5> 
    ... (17 line(s) more)  

  * baseline.bootrr.fsl_enetc-enetc2-probed: https://kernelci.org/test/case/id/641d46e128ae904a4f9c9516
        failing since 29 days (last pass: v6.2-1218-g2d4a54ee969d, first fail: v6.2-6789-g74c3b2e0a611)

    2023-03-24T06:44:35.752422  /lava-302879/1/../bin/lava-test-case
    2023-03-24T06:44:35.752907  <8>[   45.175624] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=fsl_enetc-enetc2-probed RESULT=fail>
    2023-03-24T06:44:35.753286  /lava-302879/1/../bin/lava-test-case   

  * baseline.bootrr.mscc_felix-probed: https://kernelci.org/test/case/id/641d46e128ae904a4f9c9518
        failing since 29 days (last pass: v6.2-1218-g2d4a54ee969d, first fail: v6.2-6789-g74c3b2e0a611)

    2023-03-24T06:44:36.808356  /lava-302879/1/../bin/lava-test-case
    2023-03-24T06:44:36.808878  <8>[   46.213316] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=mscc_felix-probed RESULT=fail>
    2023-03-24T06:44:36.809297  /lava-302879/1/../bin/lava-test-case
    2023-03-24T06:44:36.809612  <8>[   46.230145] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=leds-gpio-driver-present RESULT=pass>   

  * baseline.bootrr.fsl_enetc-enetc0-probed: https://kernelci.org/test/case/id/641d46e128ae904a4f9c951d
        failing since 29 days (last pass: v6.2-1218-g2d4a54ee969d, first fail: v6.2-6789-g74c3b2e0a611)

    2023-03-24T06:44:37.883398  /lava-302879/1/../bin/lava-test-case   

  * baseline.bootrr.fsl_enetc-enetc1-probed: https://kernelci.org/test/case/id/641d46e128ae904a4f9c951e
        failing since 29 days (last pass: v6.2-1218-g2d4a54ee969d, first fail: v6.2-6789-g74c3b2e0a611)

    2023-03-24T06:44:37.886621  <8>[   47.323512] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=fsl_enetc-enetc0-probed RESULT=fail>
    2023-03-24T06:44:38.943664  /lava-302879/1/../bin/lava-test-case
    2023-03-24T06:44:38.944173  <8>[   48.344581] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=fsl_enetc-enetc1-probed RESULT=fail>
    2023-03-24T06:44:38.944492  /lava-302879/1/../bin/lava-test-case   

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
kontron-kbox-a-230-ls        | arm64  | lab-kontron     | gcc-10   | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/641d4ce79c1d1c448a9c9530

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm64/defconfig+kselftest/gcc-10/lab-kontron/baseline-kontron-kbox-a-230-ls.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm64/defconfig+kselftest/gcc-10/lab-kontron/baseline-kontron-kbox-a-230-ls.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d4ce79c1d1c448a9c9531
        failing since 30 days (last pass: v6.2-1218-g2d4a54ee969d, first fail: v6.2-3304-g34939120e353) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
meson-g12a-sei510            | arm64  | lab-baylibre    | gcc-10   | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/641d4cd44df3cb7a489c95bd

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-g12a-sei510.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-g12a-sei510.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d4cd44df3cb7a489c95be
        failing since 45 days (last pass: v6.2-rc7-120-g11b3628314a5, first fail: v6.2-rc7-136-g39693c3ba989) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
meson-g12a-u200              | arm64  | lab-baylibre    | gcc-10   | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/641d4d12bfe83669209c9512

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-g12a-u200.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-g12a-u200.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d4d12bfe83669209c9513
        failing since 45 days (last pass: v6.2-rc7-120-g11b3628314a5, first fail: v6.2-rc7-136-g39693c3ba989) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
meson-g12a-x96-max           | arm64  | lab-baylibre    | gcc-10   | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/641d4d1ab33ec6e54b9c952f

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-g12a-x96-max.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-g12a-x96-max.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d4d1ab33ec6e54b9c9530
        failing since 45 days (last pass: v6.2-rc7-120-g11b3628314a5, first fail: v6.2-rc7-136-g39693c3ba989) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
meson-g12b-a311d-khadas-vim3 | arm64  | lab-baylibre    | gcc-10   | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/641d4d530ddd17a90b9c9505

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-g12b-a311d-khadas-vim3.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-g12b-a311d-khadas-vim3.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d4d530ddd17a90b9c9506
        failing since 45 days (last pass: v6.2-rc7-120-g11b3628314a5, first fail: v6.2-rc7-136-g39693c3ba989) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
meson-g12b-a311d-khadas-vim3 | arm64  | lab-collabora   | gcc-10   | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/641d4df1d2a04f9a1a9c9505

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm64/defconfig+kselftest/gcc-10/lab-collabora/baseline-meson-g12b-a311d-khadas-vim3.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm64/defconfig+kselftest/gcc-10/lab-collabora/baseline-meson-g12b-a311d-khadas-vim3.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d4df1d2a04f9a1a9c9506
        failing since 45 days (last pass: v6.2-rc7-120-g11b3628314a5, first fail: v6.2-rc7-136-g39693c3ba989) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
meson-g12b-odroid-n2         | arm64  | lab-baylibre    | gcc-10   | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/641d4ded25c9c4c3fd9c95f0

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-g12b-odroid-n2.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-g12b-odroid-n2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d4ded25c9c4c3fd9c95f1
        failing since 32 days (last pass: v6.2-rc8-150-g30cd52e17d48, first fail: v6.2-rc8-211-g05def2d212c6) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
meson-gxbb-nanopi-k2         | arm64  | lab-baylibre    | gcc-10   | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/641d4d13bfe83669209c9515

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-gxbb-nanopi-k2.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-gxbb-nanopi-k2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d4d13bfe83669209c9516
        failing since 45 days (last pass: v6.2-rc7-120-g11b3628314a5, first fail: v6.2-rc7-136-g39693c3ba989) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
meson-gxl-s905d-p230         | arm64  | lab-baylibre    | gcc-10   | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/641d4d4f794b79bb409c9505

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-gxl-s905d-p230.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-gxl-s905d-p230.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d4d4f794b79bb409c9506
        failing since 45 days (last pass: v6.2-rc6-351-gf42837eac380f, first fail: v6.2-rc7-136-g39693c3ba989) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
meson-gxl-s905x-khadas-vim   | arm64  | lab-baylibre    | gcc-10   | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/641d4d11bfe83669209c950f

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-gxl-s905x-khadas-vim.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-gxl-s905x-khadas-vim.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d4d11bfe83669209c9510
        failing since 45 days (last pass: v6.2-rc7-120-g11b3628314a5, first fail: v6.2-rc7-136-g39693c3ba989) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
meson-gxl-s905x-libretech-cc | arm64  | lab-baylibre    | gcc-10   | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/641d4f6a4f49c0e4b79c9538

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-gxl-s905x-libretech-cc.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-gxl-s905x-libretech-cc.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d4f6a4f49c0e4b79c9539
        failing since 45 days (last pass: v6.2-rc7-120-g11b3628314a5, first fail: v6.2-rc7-136-g39693c3ba989) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
meson-gxl-s905x-libretech-cc | arm64  | lab-broonie     | gcc-10   | defconfig+CON...BIG_ENDIAN=y | 1          

  Details:     https://kernelci.org/test/plan/id/641d4ba1bf331395b39c9582

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+CONFIG_CPU_BIG_ENDIAN=y
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm64/defconfig+CONFIG_CPU_BIG_ENDIAN=y/gcc-10/lab-broonie/baseline-meson-gxl-s905x-libretech-cc.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm64/defconfig+CONFIG_CPU_BIG_ENDIAN=y/gcc-10/lab-broonie/baseline-meson-gxl-s905x-libretech-cc.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/arm64be/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d4ba1bf331395b39c9583
        new failure (last pass: v6.3-rc3-288-g2dc3fa9ff5523) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
meson-gxl-s905x-libretech-cc | arm64  | lab-broonie     | gcc-10   | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/641d4e3bc6e421eb4d9c963f

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm64/defconfig+kselftest/gcc-10/lab-broonie/baseline-meson-gxl-s905x-libretech-cc.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm64/defconfig+kselftest/gcc-10/lab-broonie/baseline-meson-gxl-s905x-libretech-cc.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d4e3bc6e421eb4d9c9640
        failing since 45 days (last pass: v6.2-rc7-120-g11b3628314a5, first fail: v6.2-rc7-136-g39693c3ba989) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
meson-gxm-khadas-vim2        | arm64  | lab-baylibre    | gcc-10   | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/641d4d630ddd17a90b9c9522

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-gxm-khadas-vim2.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-gxm-khadas-vim2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d4d630ddd17a90b9c9523
        failing since 45 days (last pass: v6.2-rc7-120-g11b3628314a5, first fail: v6.2-rc7-136-g39693c3ba989) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
meson-sm1-khadas-vim3l       | arm64  | lab-baylibre    | gcc-10   | defconfig+CON...BIG_ENDIAN=y | 1          

  Details:     https://kernelci.org/test/plan/id/641d4ac8f4fba1be7a9c9508

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+CONFIG_CPU_BIG_ENDIAN=y
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm64/defconfig+CONFIG_CPU_BIG_ENDIAN=y/gcc-10/lab-baylibre/baseline-meson-sm1-khadas-vim3l.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm64/defconfig+CONFIG_CPU_BIG_ENDIAN=y/gcc-10/lab-baylibre/baseline-meson-sm1-khadas-vim3l.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/arm64be/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/641d4ac8f4fba1be7a9c9511
        new failure (last pass: v6.3-rc3-288-g2dc3fa9ff5523)

    2023-03-24T07:01:12.575417  / # #
    2023-03-24T07:01:12.677284  export SHELL=/bin/sh
    2023-03-24T07:01:12.677753  #<3>[   18.412609] mmc2: tuning execution failed: -5
    2023-03-24T07:01:12.677971  <3>[   18.412656] mmc2: error -5 whilst initialising SDIO card
    2023-03-24T07:01:12.678140  
    2023-03-24T07:01:12.779271  / # export SHELL=/bin/sh. /lava-3440142/environment
    2023-03-24T07:01:12.780646  
    2023-03-24T07:01:12.881752  / # . /lava-3440142/environment/lava-3440142/bin/lava-test-runner /lava-3440142/1
    2023-03-24T07:01:12.882256  
    2023-03-24T07:01:12.892596  / # /lava-3440142/bin/lava-test-runner /lava-3440142/1 
    ... (18 line(s) more)  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
meson-sm1-khadas-vim3l       | arm64  | lab-baylibre    | gcc-10   | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/641d4e22be54158f7b9c9510

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-sm1-khadas-vim3l.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-sm1-khadas-vim3l.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d4e22be54158f7b9c9511
        failing since 45 days (last pass: v6.2-rc7-120-g11b3628314a5, first fail: v6.2-rc7-136-g39693c3ba989) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
meson-sm1-sei610             | arm64  | lab-baylibre    | gcc-10   | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/641d4cd54df3cb7a489c95c3

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-sm1-sei610.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-sm1-sei610.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d4cd54df3cb7a489c95c4
        failing since 45 days (last pass: v6.2-rc7-120-g11b3628314a5, first fail: v6.2-rc7-136-g39693c3ba989) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
mt8173-elm-hana              | arm64  | lab-collabora   | gcc-10   | defconfig+arm...ok+kselftest | 1          

  Details:     https://kernelci.org/test/plan/id/641d4ca7f9fddcb8369c952b

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm64/defconfig+arm64-chromebook+kselftest/gcc-10/lab-collabora/baseline-mt8173-elm-hana.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm64/defconfig+arm64-chromebook+kselftest/gcc-10/lab-collabora/baseline-mt8173-elm-hana.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d4ca7f9fddcb8369c952c
        failing since 59 days (last pass: v6.2-rc5-157-g1f16e03afb18, first fail: v6.2-rc5-174-gc5f142de047d) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
mt8183-kukui-...uniper-sku16 | arm64  | lab-collabora   | gcc-10   | defconfig+arm...ook+videodec | 3          

  Details:     https://kernelci.org/test/plan/id/641d4af8484fea36769c9505

  Results:     166 PASS, 6 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook+videodec
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm64/defconfig+arm64-chromebook+videodec/gcc-10/lab-collabora/baseline-mt8183-kukui-jacuzzi-juniper-sku16.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm64/defconfig+arm64-chromebook+videodec/gcc-10/lab-collabora/baseline-mt8183-kukui-jacuzzi-juniper-sku16.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/arm64/rootfs.cpio.gz 

  * baseline.bootrr.panel-edp-probed: https://kernelci.org/test/case/id/641d4af8484fea36769c953d
        failing since 28 days (last pass: v6.2-1218-g2d4a54ee969d, first fail: v6.2-8700-gab98cc06b683)

    2023-03-24T07:02:01.888870  /lava-9759053/1/../bin/lava-test-case

    2023-03-24T07:02:01.898890  <8>[   23.375521] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=panel-edp-probed RESULT=fail>

  * baseline.bootrr.clk-mt8183-pericfg-probed: https://kernelci.org/test/case/id/641d4af8484fea36769c9595
        failing since 18 days (last pass: v6.2-8700-gab98cc06b683, first fail: v6.2-13684-gf93c476d9769)

    2023-03-24T07:01:59.037487  /lava-9759053/1/../bin/lava-test-case

    2023-03-24T07:01:59.047412  <8>[   20.523849] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=clk-mt8183-pericfg-probed RESULT=fail>

  * baseline.bootrr.clk-mt8183-infracfg-probed: https://kernelci.org/test/case/id/641d4af8484fea36769c9596
        failing since 18 days (last pass: v6.2-8700-gab98cc06b683, first fail: v6.2-13684-gf93c476d9769)

    2023-03-24T07:01:58.007139  /lava-9759053/1/../bin/lava-test-case

    2023-03-24T07:01:58.017263  <8>[   19.493991] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=clk-mt8183-infracfg-probed RESULT=fail>

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
mt8183-kukui-...uniper-sku16 | arm64  | lab-collabora   | gcc-10   | defconfig+arm...ok+kselftest | 1          

  Details:     https://kernelci.org/test/plan/id/641d4c23800571f3459c951c

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm64/defconfig+arm64-chromebook+kselftest/gcc-10/lab-collabora/baseline-mt8183-kukui-jacuzzi-juniper-sku16.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm64/defconfig+arm64-chromebook+kselftest/gcc-10/lab-collabora/baseline-mt8183-kukui-jacuzzi-juniper-sku16.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d4c23800571f3459c951d
        failing since 45 days (last pass: v6.2-rc7-120-g11b3628314a5, first fail: v6.2-rc7-136-g39693c3ba989) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
mt8183-kukui-...uniper-sku16 | arm64  | lab-collabora   | gcc-10   | defconfig+arm64-chromebook   | 3          

  Details:     https://kernelci.org/test/plan/id/641d4c886e8abf9d659c9520

  Results:     166 PASS, 6 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-mt8183-kukui-jacuzzi-juniper-sku16.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-mt8183-kukui-jacuzzi-juniper-sku16.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/arm64/rootfs.cpio.gz 

  * baseline.bootrr.panel-edp-probed: https://kernelci.org/test/case/id/641d4c886e8abf9d659c955b
        failing since 30 days (last pass: v6.2-rc8-211-g05def2d212c6, first fail: v6.2-3304-g34939120e353)

    2023-03-24T07:08:46.185141  /lava-9759162/1/../bin/lava-test-case

    2023-03-24T07:08:46.191409  <8>[   23.403795] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=panel-edp-probed RESULT=fail>

  * baseline.bootrr.clk-mt8183-pericfg-probed: https://kernelci.org/test/case/id/641d4c886e8abf9d659c95ad
        failing since 25 days (last pass: v6.2-8700-gab98cc06b683, first fail: v6.2-12625-g13efc3a9f23b)

    2023-03-24T07:08:43.328300  /lava-9759162/1/../bin/lava-test-case

    2023-03-24T07:08:43.338019  <8>[   20.548249] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=clk-mt8183-pericfg-probed RESULT=fail>

  * baseline.bootrr.clk-mt8183-infracfg-probed: https://kernelci.org/test/case/id/641d4c886e8abf9d659c95ae
        failing since 25 days (last pass: v6.2-8700-gab98cc06b683, first fail: v6.2-12625-g13efc3a9f23b)

    2023-03-24T07:08:42.300796  /lava-9759162/1/../bin/lava-test-case

    2023-03-24T07:08:42.310997  <8>[   19.521321] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=clk-mt8183-infracfg-probed RESULT=fail>

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
mt8192-asurada-spherion-r0   | arm64  | lab-collabora   | gcc-10   | defconfig+arm...ook+videodec | 3          

  Details:     https://kernelci.org/test/plan/id/641d4b2d7611d870f39c951f

  Results:     177 PASS, 9 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook+videodec
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm64/defconfig+arm64-chromebook+videodec/gcc-10/lab-collabora/baseline-mt8192-asurada-spherion-r0.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm64/defconfig+arm64-chromebook+videodec/gcc-10/lab-collabora/baseline-mt8192-asurada-spherion-r0.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/arm64/rootfs.cpio.gz 

  * baseline.bootrr.clk-mt8192-pericfg-probed: https://kernelci.org/test/case/id/641d4b2d7611d870f39c95d5
        failing since 21 days (last pass: v6.2-8700-gab98cc06b683, first fail: v6.2-13370-g5872d227b73f)

    2023-03-24T07:02:42.855247  /lava-9759048/1/../bin/lava-test-case

    2023-03-24T07:02:42.861823  <8>[   20.957795] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=clk-mt8192-pericfg-probed RESULT=fail>

  * baseline.bootrr.clk-mt8192-infracfg-probed: https://kernelci.org/test/case/id/641d4b2d7611d870f39c95d6
        failing since 21 days (last pass: v6.2-8700-gab98cc06b683, first fail: v6.2-13370-g5872d227b73f)

    2023-03-24T07:02:41.835989  /lava-9759048/1/../bin/lava-test-case

    2023-03-24T07:02:41.842693  <8>[   19.938422] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=clk-mt8192-infracfg-probed RESULT=fail>

  * baseline.bootrr.clk-mt8192-topckgen-probed: https://kernelci.org/test/case/id/641d4b2d7611d870f39c95d7
        failing since 21 days (last pass: v6.2-8700-gab98cc06b683, first fail: v6.2-13370-g5872d227b73f)

    2023-03-24T07:02:40.816738  /lava-9759048/1/../bin/lava-test-case

    2023-03-24T07:02:40.823714  <8>[   18.919163] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=clk-mt8192-topckgen-probed RESULT=fail>

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
mt8192-asurada-spherion-r0   | arm64  | lab-collabora   | gcc-10   | defconfig+arm64-chromebook   | 3          

  Details:     https://kernelci.org/test/plan/id/641d4be18df3e074f59c9508

  Results:     177 PASS, 9 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-mt8192-asurada-spherion-r0.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-mt8192-asurada-spherion-r0.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/arm64/rootfs.cpio.gz 

  * baseline.bootrr.clk-mt8192-pericfg-probed: https://kernelci.org/test/case/id/641d4be18df3e074f59c95be
        failing since 25 days (last pass: v6.2-8700-gab98cc06b683, first fail: v6.2-12625-g13efc3a9f23b)

    2023-03-24T07:05:40.568102  /lava-9759136/1/../bin/lava-test-case

    2023-03-24T07:05:40.574490  <8>[   21.010398] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=clk-mt8192-pericfg-probed RESULT=fail>

  * baseline.bootrr.clk-mt8192-infracfg-probed: https://kernelci.org/test/case/id/641d4be18df3e074f59c95bf
        failing since 25 days (last pass: v6.2-8700-gab98cc06b683, first fail: v6.2-12625-g13efc3a9f23b)

    2023-03-24T07:05:39.548707  /lava-9759136/1/../bin/lava-test-case

    2023-03-24T07:05:39.555372  <8>[   19.990987] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=clk-mt8192-infracfg-probed RESULT=fail>

  * baseline.bootrr.clk-mt8192-topckgen-probed: https://kernelci.org/test/case/id/641d4be18df3e074f59c95c0
        failing since 25 days (last pass: v6.2-8700-gab98cc06b683, first fail: v6.2-12625-g13efc3a9f23b)

    2023-03-24T07:05:38.528922  /lava-9759136/1/../bin/lava-test-case

    2023-03-24T07:05:38.535316  <8>[   18.971259] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=clk-mt8192-topckgen-probed RESULT=fail>

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
mt8192-asurada-spherion-r0   | arm64  | lab-collabora   | gcc-10   | defconfig+arm...ok+kselftest | 1          

  Details:     https://kernelci.org/test/plan/id/641d4c2a2d9889abe59c9505

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm64/defconfig+arm64-chromebook+kselftest/gcc-10/lab-collabora/baseline-mt8192-asurada-spherion-r0.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm64/defconfig+arm64-chromebook+kselftest/gcc-10/lab-collabora/baseline-mt8192-asurada-spherion-r0.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d4c2a2d9889abe59c9506
        failing since 45 days (last pass: v6.2-rc7-120-g11b3628314a5, first fail: v6.2-rc7-136-g39693c3ba989) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
ox820-clouden...lug-series-3 | arm    | lab-baylibre    | gcc-10   | oxnas_v6_defconfig           | 1          

  Details:     https://kernelci.org/test/plan/id/641d4246a5337784589c953d

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: oxnas_v6_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm/oxnas_v6_defconfig/gcc-10/lab-baylibre/baseline-ox820-cloudengines-pogoplug-series-3.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm/oxnas_v6_defconfig/gcc-10/lab-baylibre/baseline-ox820-cloudengines-pogoplug-series-3.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d4246a5337784589c953e
        failing since 163 days (last pass: v6.0-9666-g02c05e0b8d5c, first fail: v6.0-11312-g1778d6da389c) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
qcom-qdf2400                 | arm64  | lab-linaro-lkft | gcc-10   | defconfig+arm...ok+kselftest | 1          

  Details:     https://kernelci.org/test/plan/id/641d6cf8c38e7e26659c9506

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm64/defconfig+arm64-chromebook+kselftest/gcc-10/lab-linaro-lkft/baseline-qcom-qdf2400.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm64/defconfig+arm64-chromebook+kselftest/gcc-10/lab-linaro-lkft/baseline-qcom-qdf2400.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d6cf8c38e7e26659c9507
        failing since 45 days (last pass: v6.2-rc7-120-g11b3628314a5, first fail: v6.2-rc7-136-g39693c3ba989) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
qcom-qdf2400                 | arm64  | lab-linaro-lkft | gcc-10   | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/641d7323efb73c8e949c9507

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm64/defconfig+kselftest/gcc-10/lab-linaro-lkft/baseline-qcom-qdf2400.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm64/defconfig+kselftest/gcc-10/lab-linaro-lkft/baseline-qcom-qdf2400.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d7323efb73c8e949c9508
        failing since 45 days (last pass: v6.2-rc7-120-g11b3628314a5, first fail: v6.2-rc7-136-g39693c3ba989) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
qemu_mips-malta              | mips   | lab-collabora   | gcc-10   | malta_defconfig              | 1          

  Details:     https://kernelci.org/test/plan/id/641d44fe078efaecd69c9529

  Results:     4 PASS, 1 FAIL, 2 SKIP
  Full config: malta_defconfig
  Compiler:    gcc-10 (mips-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/mips/malta_defconfig/gcc-10/lab-collabora/baseline-qemu_mips-malta.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/mips/malta_defconfig/gcc-10/lab-collabora/baseline-qemu_mips-malta.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/mipsel/rootfs.cpio.gz 

  * baseline.dmesg.alert: https://kernelci.org/test/case/id/641d44fe078efaecd69c952d
        failing since 2 days (last pass: v6.3-rc3-188-g9f7814c09ae60, first fail: v6.3-rc3-224-ga0d6a906c6a2)
        1 lines

    2023-03-24T06:36:22.827528  kern  :alert : CPU 0 Unable to handle kernel paging request at virtual address e7f61d78, epc == 801ff8c8, ra == 8020228c
    2023-03-24T06:36:22.827794  

    2023-03-24T06:36:22.856181  <8><LAVA_SIGNAL_TESTCASE TEST_CASE_ID=alert RESULT=fail UNITS=lines MEASUREMENT=1>
    2023-03-24T06:36:22.856440  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
r8a7743-iwg20d-q7            | arm    | lab-cip         | gcc-10   | shmobile_defconfig           | 1          

  Details:     https://kernelci.org/test/plan/id/641d45c7409febc7969c9506

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: shmobile_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm/shmobile_defconfig/gcc-10/lab-cip/baseline-r8a7743-iwg20d-q7.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm/shmobile_defconfig/gcc-10/lab-cip/baseline-r8a7743-iwg20d-q7.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d45c7409febc7969c9507
        new failure (last pass: v6.3-rc3-288-g2dc3fa9ff5523) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
rk3288-rock2-square          | arm    | lab-collabora   | gcc-10   | multi_v7_defc...G_ARM_LPAE=y | 1          

  Details:     https://kernelci.org/test/plan/id/641d4c46be42e1113a9c951c

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm/multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y/gcc-10/lab-collabora/baseline-rk3288-rock2-square.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm/multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y/gcc-10/lab-collabora/baseline-rk3288-rock2-square.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d4c46be42e1113a9c951d
        failing since 98 days (last pass: v6.1-6378-g44d433ee7540, first fail: v6.1-10792-g244d284981da) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
rk3288-veyron-jaq            | arm    | lab-collabora   | gcc-10   | multi_v7_defc...G_ARM_LPAE=y | 1          

  Details:     https://kernelci.org/test/plan/id/641d4b1b5b75eff9a49c9632

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm/multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y/gcc-10/lab-collabora/baseline-rk3288-veyron-jaq.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm/multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y/gcc-10/lab-collabora/baseline-rk3288-veyron-jaq.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d4b1b5b75eff9a49c9633
        failing since 98 days (last pass: v6.1-6378-g44d433ee7540, first fail: v6.1-10792-g244d284981da) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
rk3399-gru-kevin             | arm64  | lab-collabora   | gcc-10   | defconfig+arm...ok+kselftest | 1          

  Details:     https://kernelci.org/test/plan/id/641d4c6e30f9ca4d739c9564

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm64/defconfig+arm64-chromebook+kselftest/gcc-10/lab-collabora/baseline-rk3399-gru-kevin.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm64/defconfig+arm64-chromebook+kselftest/gcc-10/lab-collabora/baseline-rk3399-gru-kevin.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d4c6e30f9ca4d739c9565
        failing since 45 days (last pass: v6.2-rc7-120-g11b3628314a5, first fail: v6.2-rc7-136-g39693c3ba989) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
rk3399-roc-pc                | arm64  | lab-clabbe      | gcc-10   | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/641d4d743cc1e7e6be9c954c

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm64/defconfig+kselftest/gcc-10/lab-clabbe/baseline-rk3399-roc-pc.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm64/defconfig+kselftest/gcc-10/lab-clabbe/baseline-rk3399-roc-pc.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d4d743cc1e7e6be9c954d
        failing since 45 days (last pass: v6.2-rc7-120-g11b3628314a5, first fail: v6.2-rc7-136-g39693c3ba989) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
rk3399-rock-pi-4b            | arm64  | lab-collabora   | gcc-10   | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/641d4cf23b37f865f59c958f

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm64/defconfig+kselftest/gcc-10/lab-collabora/baseline-rk3399-rock-pi-4b.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm64/defconfig+kselftest/gcc-10/lab-collabora/baseline-rk3399-rock-pi-4b.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d4cf23b37f865f59c9590
        failing since 45 days (last pass: v6.2-rc7-120-g11b3628314a5, first fail: v6.2-rc7-136-g39693c3ba989) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
sc7180-trogdor-kingoftown    | arm64  | lab-collabora   | gcc-10   | defconfig+arm...ok+kselftest | 1          

  Details:     https://kernelci.org/test/plan/id/641d4c43fb5938ee979c951f

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm64/defconfig+arm64-chromebook+kselftest/gcc-10/lab-collabora/baseline-sc7180-trogdor-kingoftown.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm64/defconfig+arm64-chromebook+kselftest/gcc-10/lab-collabora/baseline-sc7180-trogdor-kingoftown.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d4c43fb5938ee979c9520
        failing since 45 days (last pass: v6.2-rc7-120-g11b3628314a5, first fail: v6.2-rc7-136-g39693c3ba989) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
sc7180-trogdo...zor-limozeen | arm64  | lab-collabora   | gcc-10   | defconfig+arm...ok+kselftest | 1          

  Details:     https://kernelci.org/test/plan/id/641d4bfe7c49d058839c9514

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm64/defconfig+arm64-chromebook+kselftest/gcc-10/lab-collabora/baseline-sc7180-trogdor-lazor-limozeen.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm64/defconfig+arm64-chromebook+kselftest/gcc-10/lab-collabora/baseline-sc7180-trogdor-lazor-limozeen.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d4bfe7c49d058839c9515
        failing since 45 days (last pass: v6.2-rc7-120-g11b3628314a5, first fail: v6.2-rc7-136-g39693c3ba989) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
sun50i-a64-pine64-plus       | arm64  | lab-broonie     | gcc-10   | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/641d4d1f45300bbca89c950d

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm64/defconfig+kselftest/gcc-10/lab-broonie/baseline-sun50i-a64-pine64-plus.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm64/defconfig+kselftest/gcc-10/lab-broonie/baseline-sun50i-a64-pine64-plus.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d4d1f45300bbca89c950e
        failing since 45 days (last pass: v6.2-rc7-120-g11b3628314a5, first fail: v6.2-rc7-136-g39693c3ba989) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
sun50i-h5-lib...ch-all-h3-cc | arm64  | lab-broonie     | gcc-10   | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/641d4ce14df3cb7a489c961d

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm64/defconfig+kselftest/gcc-10/lab-broonie/baseline-sun50i-h5-libretech-all-h3-cc.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm64/defconfig+kselftest/gcc-10/lab-broonie/baseline-sun50i-h5-libretech-all-h3-cc.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/641d4ce14df3cb7a489c961e
        failing since 44 days (last pass: v6.2-rc7-120-g11b3628314a5, first fail: v6.2-rc7-157-ga82755b498dd) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
sun8i-h2-plus-orangepi-zero  | arm    | lab-baylibre    | gcc-10   | sunxi_defconfig              | 1          

  Details:     https://kernelci.org/test/plan/id/641d4677a0d31baf089c95a0

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: sunxi_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm/sunxi_defconfig/gcc-10/lab-baylibre/baseline-sun8i-h2-plus-orangepi-zero.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.3-rc3-370-g8269040171a02/arm/sunxi_defconfig/gcc-10/lab-baylibre/baseline-sun8i-h2-plus-orangepi-zero.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230310.0/armel/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/641d4677a0d31baf089c95a9
        failing since 21 days (last pass: v6.2-12625-g13efc3a9f23b, first fail: v6.2-13370-g5872d227b73f)

    2023-03-24T06:42:52.590566  <8>[    9.636415] <LAVA_SIGNAL_ENDRUN 0_dmesg 3439984_1.5.2.4.1>
    2023-03-24T06:42:52.709673  / # #
    2023-03-24T06:42:52.815196  export SHELL=/bin/sh
    2023-03-24T06:42:52.816698  #
    2023-03-24T06:42:52.920026  / # export SHELL=/bin/sh. /lava-3439984/environment
    2023-03-24T06:42:52.921601  
    2023-03-24T06:42:53.024961  / # . /lava-3439984/environment/lava-3439984/bin/lava-test-runner /lava-3439984/1
    2023-03-24T06:42:53.027595  
    2023-03-24T06:42:53.035321  / # /lava-3439984/bin/lava-test-runner /lava-3439984/1
    2023-03-24T06:42:53.177202  + export 'TESTRUN_ID=1_bootrr' 
    ... (11 line(s) more)