Subject: next/master baseline: 378 runs, 39 regressions (next-20240212)

From: "kernelci.org bot" <[email-masked]>
Date: Mon, 12 Feb 2024 02:31:29 -0800 (PST)

next/master baseline: 378 runs, 39 regressions (next-20240212)

Regressions Summary
-------------------

platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
at91-sama5d4_xplained        | arm   | lab-baylibre  | gcc-10   | sama5_defconfig              | 1          
bcm2836-rpi-2-b              | arm   | lab-collabora | gcc-10   | bcm2835_defconfig            | 1          
bcm2836-rpi-2-b              | arm   | lab-collabora | gcc-10   | multi_v7_defc...MB2_KERNEL=y | 1          
beagle-xm                    | arm   | lab-baylibre  | gcc-10   | multi_v7_defc...MB2_KERNEL=y | 1          
jetson-tk1                   | arm   | lab-baylibre  | gcc-10   | multi_v7_defc...G_ARM_LPAE=y | 1          
k3-am625-sk                  | arm64 | lab-baylibre  | gcc-10   | defconfig+kselftest          | 1          
k3-j721e-sk                  | arm64 | lab-baylibre  | gcc-10   | defconfig+kselftest          | 1          
kontron-kbox-a-230-ls        | arm64 | lab-kontron   | gcc-10   | defconfig+CON...OMIZE_BASE=y | 5          
kontron-kbox-a-230-ls        | arm64 | lab-kontron   | gcc-10   | defconfig+kselftest          | 1          
kontron-sl28-var3-ads2       | arm64 | lab-kontron   | gcc-10   | defconfig+CON...OMIZE_BASE=y | 2          
kontron-sl28-var3-ads2       | arm64 | lab-kontron   | gcc-10   | defconfig+kselftest          | 1          
meson-g12b-odroid-n2         | arm64 | lab-baylibre  | gcc-10   | defconfig+kselftest          | 2          
meson-gxl-s905x-libretech-cc | arm64 | lab-broonie   | gcc-10   | defconfig+kselftest          | 1          
meson-gxl-s905x-libretech-cc | arm64 | lab-clabbe    | gcc-10   | defconfig+kselftest          | 1          
qemu_arm64-virt-gicv2        | arm64 | lab-baylibre  | gcc-10   | defconfig+debug              | 1          
qemu_arm64-virt-gicv2        | arm64 | lab-collabora | gcc-10   | defconfig+debug              | 1          
qemu_arm64-virt-gicv2-uefi   | arm64 | lab-baylibre  | gcc-10   | defconfig+debug              | 1          
qemu_arm64-virt-gicv2-uefi   | arm64 | lab-collabora | gcc-10   | defconfig+debug              | 1          
qemu_riscv64                 | riscv | lab-baylibre  | gcc-10   | defconfig+debug              | 1          
rk3288-rock2-square          | arm   | lab-collabora | gcc-10   | multi_v7_defc...G_ARM_LPAE=y | 1          
rk3288-veyron-jaq            | arm   | lab-collabora | gcc-10   | multi_v7_defc...G_ARM_LPAE=y | 1          
rk3399-roc-pc                | arm64 | lab-broonie   | gcc-10   | defconfig+CON...OMIZE_BASE=y | 1          
sun50i-h6-orangepi-one-plus  | arm64 | lab-clabbe    | gcc-10   | defconfig+kselftest          | 1          
sun50i-h6-pine-h64           | arm64 | lab-clabbe    | gcc-10   | defconfig+kselftest          | 1          
sun50i-h6-pine-h64           | arm64 | lab-collabora | gcc-10   | defconfig+kselftest          | 1          
sun7i-a20-cubieboard2        | arm   | lab-baylibre  | gcc-10   | multi_v7_defc...MB2_KERNEL=y | 1          
sun7i-a20-cubieboard2        | arm   | lab-baylibre  | gcc-10   | multi_v7_defc...CONFIG_SMP=n | 1          
sun7i-a20-cubieboard2        | arm   | lab-baylibre  | gcc-10   | multi_v7_defconfig           | 1          
sun7i-a20-cubieboard2        | arm   | lab-clabbe    | gcc-10   | multi_v7_defc...MB2_KERNEL=y | 1          
sun7i-a20-cubieboard2        | arm   | lab-clabbe    | gcc-10   | multi_v7_defc...CONFIG_SMP=n | 1          
sun7i-a20-cubieboard2        | arm   | lab-clabbe    | gcc-10   | multi_v7_defconfig           | 1          
sun8i-h2-plus...ch-all-h3-cc | arm   | lab-baylibre  | gcc-10   | sunxi_defconfig              | 1          
zynqmp-zcu102                | arm64 | lab-cip       | gcc-10   | defconfig+debug              | 1          

  Details:  https://kernelci.org/test/job/next/branch/master/kernel/next-20240212/plan/baseline/

  Test:     baseline
  Tree:     next
  Branch:   master
  Describe: next-20240212
  URL:      https://git.kernel.org/pub/scm/linux/kernel/git/next/linux-next.git
  SHA:      ae00c445390b349e070a64dc62f08aa878db7248 

Test Regressions
---------------- 

platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
at91-sama5d4_xplained        | arm   | lab-baylibre  | gcc-10   | sama5_defconfig              | 1          

  Details:     https://kernelci.org/test/plan/id/65c9b4ccd528fad0b18e1e9e

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: sama5_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20240212/arm/sama5_defconfig/gcc-10/lab-baylibre/baseline-at91-sama5d4_xplained.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240212/arm/sama5_defconfig/gcc-10/lab-baylibre/baseline-at91-sama5d4_xplained.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/65c9b4ccd528fad0b18e1e9f
        failing since 376 days (last pass: next-20230125, first fail: next-20230131) 

platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
bcm2836-rpi-2-b              | arm   | lab-collabora | gcc-10   | bcm2835_defconfig            | 1          

  Details:     https://kernelci.org/test/plan/id/65c9bc0d87c9fa0a818e1e7c

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: bcm2835_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20240212/arm/bcm2835_defconfig/gcc-10/lab-collabora/baseline-bcm2836-rpi-2-b.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240212/arm/bcm2835_defconfig/gcc-10/lab-collabora/baseline-bcm2836-rpi-2-b.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/65c9bc0d87c9fa0a818e1e7d
        failing since 252 days (last pass: next-20230601, first fail: next-20230605) 

platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
bcm2836-rpi-2-b              | arm   | lab-collabora | gcc-10   | multi_v7_defc...MB2_KERNEL=y | 1          

  Details:     https://kernelci.org/test/plan/id/65c9b70e6bb8700c2e8e1f81

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20240212/arm/multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y/gcc-10/lab-collabora/baseline-bcm2836-rpi-2-b.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240212/arm/multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y/gcc-10/lab-collabora/baseline-bcm2836-rpi-2-b.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/65c9b70e6bb8700c2e8e1f82
        failing since 320 days (last pass: next-20230327, first fail: next-20230328) 

platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
beagle-xm                    | arm   | lab-baylibre  | gcc-10   | multi_v7_defc...MB2_KERNEL=y | 1          

  Details:     https://kernelci.org/test/plan/id/65c9b8faece612f85e8e1e9f

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20240212/arm/multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y/gcc-10/lab-baylibre/baseline-beagle-xm.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240212/arm/multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y/gcc-10/lab-baylibre/baseline-beagle-xm.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/65c9b8faece612f85e8e1ea0
        failing since 318 days (last pass: next-20230330, first fail: next-20230331) 

platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
jetson-tk1                   | arm   | lab-baylibre  | gcc-10   | multi_v7_defc...G_ARM_LPAE=y | 1          

  Details:     https://kernelci.org/test/plan/id/65c9bdf8d1fafc48368e1eee

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20240212/arm/multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y/gcc-10/lab-baylibre/baseline-jetson-tk1.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240212/arm/multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y/gcc-10/lab-baylibre/baseline-jetson-tk1.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/65c9bdf8d1fafc48368e1eef
        failing since 671 days (last pass: next-20220401, first fail: next-20220411) 

platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
k3-am625-sk                  | arm64 | lab-baylibre  | gcc-10   | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/65c9c40d2a511518968e1e79

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20240212/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-k3-am625-sk.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240212/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-k3-am625-sk.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/65c9c40d2a511518968e1e7a
        failing since 94 days (last pass: next-20231103, first fail: next-20231110) 

platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
k3-j721e-sk                  | arm64 | lab-baylibre  | gcc-10   | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/65c9c39701dce8bac68e1ee0

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20240212/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-k3-j721e-sk.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240212/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-k3-j721e-sk.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/65c9c39701dce8bac68e1ee1
        failing since 101 days (last pass: next-20231025, first fail: next-20231103) 

platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
kontron-kbox-a-230-ls        | arm64 | lab-kontron   | gcc-10   | defconfig+CON...OMIZE_BASE=y | 5          

  Details:     https://kernelci.org/test/plan/id/65c9bcebc46e8872128e1e94

  Results:     90 PASS, 5 FAIL, 1 SKIP
  Full config: defconfig+CONFIG_RANDOMIZE_BASE=y
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20240212/arm64/defconfig+CONFIG_RANDOMIZE_BASE=y/gcc-10/lab-kontron/baseline-kontron-kbox-a-230-ls.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240212/arm64/defconfig+CONFIG_RANDOMIZE_BASE=y/gcc-10/lab-kontron/baseline-kontron-kbox-a-230-ls.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/65c9bcebc46e8872128e1e97
        failing since 60 days (last pass: next-20231208, first fail: next-20231213)

    2024-02-12T06:38:17.198767  / #
    2024-02-12T06:38:17.300897  # #export SHELL=/bin/sh
    2024-02-12T06:38:17.301667  
    2024-02-12T06:38:17.403082  / # export SHELL=/bin/sh. /lava-428606/environment
    2024-02-12T06:38:17.403811  
    2024-02-12T06:38:17.505094  / # . /lava-428606/environment/lava-428606/bin/lava-test-runner /lava-428606/1
    2024-02-12T06:38:17.506572  
    2024-02-12T06:38:17.509816  / # /lava-428606/bin/lava-test-runner /lava-428606/1
    2024-02-12T06:38:17.569326  + export 'TESTRUN_ID=1_bootrr'
    2024-02-12T06:38:17.569764  + <8>[   21.066682] <LAVA_SIGNAL_STARTRUN 1_bootrr 428606_1.5.2.4.5> 
    ... (17 line(s) more)  

  * baseline.bootrr.fsl_enetc-enetc2-probed: https://kernelci.org/test/case/id/65c9bcebc46e8872128e1e9b
        failing since 60 days (last pass: next-20231208, first fail: next-20231213)

    2024-02-12T06:38:19.675238  /lava-428606/1/../bin/lava-test-case
    2024-02-12T06:38:19.675669  <8>[   23.173682] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=fsl_enetc-enetc2-probed RESULT=fail>
    2024-02-12T06:38:19.675975  /lava-428606/1/../bin/lava-test-case   

  * baseline.bootrr.mscc_felix-probed: https://kernelci.org/test/case/id/65c9bcebc46e8872128e1e9d
        failing since 60 days (last pass: next-20231208, first fail: next-20231213)

    2024-02-12T06:38:20.737182  /lava-428606/1/../bin/lava-test-case
    2024-02-12T06:38:20.737647  <8>[   24.212479] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=mscc_felix-probed RESULT=fail>
    2024-02-12T06:38:20.738083  /lava-428606/1/../bin/lava-test-case
    2024-02-12T06:38:20.738372  <8>[   24.230370] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=leds-gpio-driver-present RESULT=pass>
    2024-02-12T06:38:20.738648  /lava-428606/1/../bin/lava-test-case   

  * baseline.bootrr.fsl_enetc-enetc0-probed: https://kernelci.org/test/case/id/65c9bcebc46e8872128e1ea2
        failing since 60 days (last pass: next-20231208, first fail: next-20231213)

    2024-02-12T06:38:21.815313  /lava-428606/1/../bin/lava-test-case   

  * baseline.bootrr.fsl_enetc-enetc1-probed: https://kernelci.org/test/case/id/65c9bcebc46e8872128e1ea3
        failing since 60 days (last pass: next-20231208, first fail: next-20231213)

    2024-02-12T06:38:21.818516  <8>[   25.331341] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=fsl_enetc-enetc0-probed RESULT=fail>
    2024-02-12T06:38:22.879400  /lava-428606/1/../bin/lava-test-case
    2024-02-12T06:38:22.879875  <8>[   26.353017] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=fsl_enetc-enetc1-probed RESULT=fail>
    2024-02-12T06:38:22.880151  /lava-428606/1/../bin/lava-test-case   

platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
kontron-kbox-a-230-ls        | arm64 | lab-kontron   | gcc-10   | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/65c9c3cc412738c0ba8e1e9e

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20240212/arm64/defconfig+kselftest/gcc-10/lab-kontron/baseline-kontron-kbox-a-230-ls.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240212/arm64/defconfig+kselftest/gcc-10/lab-kontron/baseline-kontron-kbox-a-230-ls.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/65c9c3cc412738c0ba8e1e9f
        failing since 59 days (last pass: next-20231205, first fail: next-20231215) 

platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
kontron-sl28-var3-ads2       | arm64 | lab-kontron   | gcc-10   | defconfig+CON...OMIZE_BASE=y | 2          

  Details:     https://kernelci.org/test/plan/id/65c9bcedc46e8872128e1ef5

  Results:     101 PASS, 2 FAIL, 1 SKIP
  Full config: defconfig+CONFIG_RANDOMIZE_BASE=y
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20240212/arm64/defconfig+CONFIG_RANDOMIZE_BASE=y/gcc-10/lab-kontron/baseline-kontron-sl28-var3-ads2.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240212/arm64/defconfig+CONFIG_RANDOMIZE_BASE=y/gcc-10/lab-kontron/baseline-kontron-sl28-var3-ads2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/65c9bcedc46e8872128e1ef8
        failing since 60 days (last pass: next-20231208, first fail: next-20231213)

    2024-02-12T06:38:16.954786  / # #
    2024-02-12T06:38:17.056830  export SHELL=/bin/sh
    2024-02-12T06:38:17.057571  #
    2024-02-12T06:38:17.158867  / # export SHELL=/bin/sh. /lava-428608/environment
    2024-02-12T06:38:17.159454  
    2024-02-12T06:38:17.260759  / # . /lava-428608/environment/lava-428608/bin/lava-test-runner /lava-428608/1
    2024-02-12T06:38:17.261965  
    2024-02-12T06:38:17.302109  / # /lava-428608/bin/lava-test-runner /lava-428608/1
    2024-02-12T06:38:17.335104  + export 'TESTRUN_ID=1_bootrr'
    2024-02-12T06:38:17.335558  + <8>[   20.966182] <LAVA_SIGNAL_STARTRUN 1_bootrr 428608_1.5.2.4.5> 
    ... (13 line(s) more)  

  * baseline.bootrr.fsl_enetc-enetc0-probed: https://kernelci.org/test/case/id/65c9bcedc46e8872128e1f0b
        failing since 60 days (last pass: next-20231208, first fail: next-20231213)

    2024-02-12T06:38:19.769448  /lava-428608/1/../bin/lava-test-case
    2024-02-12T06:38:19.769940  <8>[   23.389730] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=fsl_enetc-enetc0-probed RESULT=fail>
    2024-02-12T06:38:19.770254  /lava-428608/1/../bin/lava-test-case   

platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
kontron-sl28-var3-ads2       | arm64 | lab-kontron   | gcc-10   | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/65c9c2f055500007258e1e7e

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20240212/arm64/defconfig+kselftest/gcc-10/lab-kontron/baseline-kontron-sl28-var3-ads2.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240212/arm64/defconfig+kselftest/gcc-10/lab-kontron/baseline-kontron-sl28-var3-ads2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/65c9c2f055500007258e1e7f
        failing since 59 days (last pass: next-20231205, first fail: next-20231215) 

platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
meson-g12b-odroid-n2         | arm64 | lab-baylibre  | gcc-10   | defconfig+kselftest          | 2          

  Details:     https://kernelci.org/test/plan/id/65c9c358d4497a1dc18e1e7e

  Results:     4 PASS, 2 FAIL, 1 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20240212/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-g12b-odroid-n2.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240212/arm64/defconfig+kselftest/gcc-10/lab-baylibre/baseline-meson-g12b-odroid-n2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz 

  * baseline.dmesg.emerg: https://kernelci.org/test/case/id/65c9c358d4497a1dc18e1e85
        failing since 68 days (last pass: next-20231120, first fail: next-20231205)
        2 lines

    2024-02-12T07:05:36.886002  kern  :alert :   EA = 0, S1PTW = 0
    2024-02-12T07:05:36.886396  kern  :alert :   FSC = 0x04: level 0 translation fault
    2024-02-12T07:05:36.886747  kern  :alert : Data abort info:
    2024-02-12T07:05:36.924517  kern  :alert :   ISV = 0, ISS = 0x00000004, ISS2 = 0x00000000
    2024-02-12T07:05:36.925171  kern  :alert :   CM = 0, WnR = 0, TnD = 0, TagAccess = 0
    2024-02-12T07:05:36.925577  kern  :alert :   GCS = 0, Overlay = 0, DirtyBit = 0, Xs = 0
    2024-02-12T07:05:36.925944  kern  :alert : [cccccccccccccccc] address between user and kernel address ranges
    2024-02-12T07:05:36.926631  kern  :emerg : Internal error: Oops: 000000009<8>[   19.787498] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=emerg RESULT=fail UNITS=lines MEASUREMENT=2>
    2024-02-12T07:05:36.927036  6000004 [#1] PREEMPT SMP   

  * baseline.dmesg.alert: https://kernelci.org/test/case/id/65c9c358d4497a1dc18e1e86
        failing since 68 days (last pass: next-20231120, first fail: next-20231205)
        12 lines

    2024-02-12T07:05:36.881570  kern  :alert : Unable to handle kernel paging request at virtual address cccccccccccccccc
    2024-02-12T07:05:36.882204  kern  :alert : Mem abort info:
    2024-02-12T07:05:36.882600  kern  :alert :   ESR = 0x0000000096000004
    2024-02-12T07:05:36.882961  kern  :alert :   EC = 0x25: DABT (current EL), IL = 32 bits<8>[   19.739976] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=alert RESULT=fail UNITS=lines MEASUREMENT=12>
    2024-02-12T07:05:36.883319  
    2024-02-12T07:05:36.883745  kern  :alert :   SET = 0, FnV = 0   

platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
meson-gxl-s905x-libretech-cc | arm64 | lab-broonie   | gcc-10   | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/65c9c34cd4497a1dc18e1e79

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20240212/arm64/defconfig+kselftest/gcc-10/lab-broonie/baseline-meson-gxl-s905x-libretech-cc.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240212/arm64/defconfig+kselftest/gcc-10/lab-broonie/baseline-meson-gxl-s905x-libretech-cc.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/65c9c34cd4497a1dc18e1e7a
        failing since 369 days (last pass: next-20230206, first fail: next-20230207) 

platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
meson-gxl-s905x-libretech-cc | arm64 | lab-clabbe    | gcc-10   | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/65c9c3406128c808268e1ea1

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20240212/arm64/defconfig+kselftest/gcc-10/lab-clabbe/baseline-meson-gxl-s905x-libretech-cc.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240212/arm64/defconfig+kselftest/gcc-10/lab-clabbe/baseline-meson-gxl-s905x-libretech-cc.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/65c9c3406128c808268e1ea2
        failing since 369 days (last pass: next-20230206, first fail: next-20230207) 

platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
qemu_arm64-virt-gicv2        | arm64 | lab-baylibre  | gcc-10   | defconfig+debug              | 1          

  Details:     https://kernelci.org/test/plan/id/65c9bf67fe2656def88e1e8f

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+debug
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20240212/arm64/defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_arm64-virt-gicv2.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240212/arm64/defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_arm64-virt-gicv2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/65c9bf67fe2656def88e1e90
        failing since 25 days (last pass: next-20240109, first fail: next-20240117) 

platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
qemu_arm64-virt-gicv2        | arm64 | lab-collabora | gcc-10   | defconfig+debug              | 1          

  Details:     https://kernelci.org/test/plan/id/65c9bf79606b3046c58e1e9e

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+debug
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20240212/arm64/defconfig+debug/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv2.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240212/arm64/defconfig+debug/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/65c9bf79606b3046c58e1e9f
        failing since 25 days (last pass: next-20240109, first fail: next-20240117) 

platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
qemu_arm64-virt-gicv2-uefi   | arm64 | lab-baylibre  | gcc-10   | defconfig+debug              | 1          

  Details:     https://kernelci.org/test/plan/id/65c9bf6671fde6a5268e1eac

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+debug
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20240212/arm64/defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_arm64-virt-gicv2-uefi.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240212/arm64/defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_arm64-virt-gicv2-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/65c9bf6671fde6a5268e1ead
        failing since 25 days (last pass: next-20240109, first fail: next-20240117) 

platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
qemu_arm64-virt-gicv2-uefi   | arm64 | lab-collabora | gcc-10   | defconfig+debug              | 1          

  Details:     https://kernelci.org/test/plan/id/65c9bf77fe2656def88e1e94

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+debug
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20240212/arm64/defconfig+debug/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv2-uefi.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240212/arm64/defconfig+debug/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv2-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/65c9bf77fe2656def88e1e95
        failing since 25 days (last pass: next-20240109, first fail: next-20240117) 

platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
qemu_riscv64                 | riscv | lab-baylibre  | gcc-10   | defconfig+debug              | 1          

  Details:     https://kernelci.org/test/plan/id/65c9b8e71a66fbb9a38e1e9a

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+debug
  Compiler:    gcc-10 (riscv64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20240212/riscv/defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_riscv64.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240212/riscv/defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_riscv64.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/riscv/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/65c9b8e71a66fbb9a38e1e9b
        failing since 4 days (last pass: next-20240206, first fail: next-20240207) 

platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
rk3288-rock2-square          | arm   | lab-collabora | gcc-10   | multi_v7_defc...G_ARM_LPAE=y | 1          

  Details:     https://kernelci.org/test/plan/id/65c9be8e0236c422788e1ec4

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20240212/arm/multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y/gcc-10/lab-collabora/baseline-rk3288-rock2-square.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240212/arm/multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y/gcc-10/lab-collabora/baseline-rk3288-rock2-square.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/65c9be8e0236c422788e1ec5
        failing since 446 days (last pass: next-20221121, first fail: next-20221122) 

platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
rk3288-veyron-jaq            | arm   | lab-collabora | gcc-10   | multi_v7_defc...G_ARM_LPAE=y | 1          

  Details:     https://kernelci.org/test/plan/id/65c9bd8aacf6e717498e1eae

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20240212/arm/multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y/gcc-10/lab-collabora/baseline-rk3288-veyron-jaq.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240212/arm/multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y/gcc-10/lab-collabora/baseline-rk3288-veyron-jaq.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/65c9bd8aacf6e717498e1eaf
        failing since 446 days (last pass: next-20221121, first fail: next-20221122) 

platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
rk3399-roc-pc                | arm64 | lab-broonie   | gcc-10   | defconfig+CON...OMIZE_BASE=y | 1          

  Details:     https://kernelci.org/test/plan/id/65c9bde8d1fafc48368e1ee8

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+CONFIG_RANDOMIZE_BASE=y
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20240212/arm64/defconfig+CONFIG_RANDOMIZE_BASE=y/gcc-10/lab-broonie/baseline-rk3399-roc-pc.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240212/arm64/defconfig+CONFIG_RANDOMIZE_BASE=y/gcc-10/lab-broonie/baseline-rk3399-roc-pc.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/65c9bde8d1fafc48368e1ee9
        failing since 4 days (last pass: next-20240125, first fail: next-20240207) 

platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
sun50i-h6-orangepi-one-plus  | arm64 | lab-clabbe    | gcc-10   | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/65c9c3f46ea31641bd8e1eb5

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20240212/arm64/defconfig+kselftest/gcc-10/lab-clabbe/baseline-sun50i-h6-orangepi-one-plus.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240212/arm64/defconfig+kselftest/gcc-10/lab-clabbe/baseline-sun50i-h6-orangepi-one-plus.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/65c9c3f56ea31641bd8e1eb6
        failing since 121 days (last pass: next-20230125, first fail: next-20231013) 

platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
sun50i-h6-pine-h64           | arm64 | lab-clabbe    | gcc-10   | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/65c9c30432db50cd958e1e82

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20240212/arm64/defconfig+kselftest/gcc-10/lab-clabbe/baseline-sun50i-h6-pine-h64.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240212/arm64/defconfig+kselftest/gcc-10/lab-clabbe/baseline-sun50i-h6-pine-h64.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/65c9c30432db50cd958e1e83
        failing since 367 days (last pass: next-20230127, first fail: next-20230210) 

platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
sun50i-h6-pine-h64           | arm64 | lab-collabora | gcc-10   | defconfig+kselftest          | 1          

  Details:     https://kernelci.org/test/plan/id/65c9c2ee599c6e41058e1e8a

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20240212/arm64/defconfig+kselftest/gcc-10/lab-collabora/baseline-sun50i-h6-pine-h64.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240212/arm64/defconfig+kselftest/gcc-10/lab-collabora/baseline-sun50i-h6-pine-h64.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/65c9c2ee599c6e41058e1e8b
        failing since 367 days (last pass: next-20230127, first fail: next-20230210) 

platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
sun7i-a20-cubieboard2        | arm   | lab-baylibre  | gcc-10   | multi_v7_defc...MB2_KERNEL=y | 1          

  Details:     https://kernelci.org/test/plan/id/65c9b6c80ad55dccea8e1eb4

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20240212/arm/multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y/gcc-10/lab-baylibre/baseline-sun7i-a20-cubieboard2.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240212/arm/multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y/gcc-10/lab-baylibre/baseline-sun7i-a20-cubieboard2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/armel/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/65c9b6c80ad55dccea8e1eb9
        failing since 250 days (last pass: next-20230517, first fail: next-20230607)

    2024-02-12T06:12:13.477391  <8>[   13.938639] <LAVA_SIGNAL_ENDRUN 0_dmesg 3926049_1.5.2.4.1>
    2024-02-12T06:12:13.585048  / # #
    2024-02-12T06:12:13.687772  export SHELL=/bin/sh
    2024-02-12T06:12:13.688847  #
    2024-02-12T06:12:13.790302  / # export SHELL=/bin/sh. /lava-3926049/environment
    2024-02-12T06:12:13.791218  
    2024-02-12T06:12:13.892983  / # . /lava-3926049/environment/lava-3926049/bin/lava-test-runner /lava-3926049/1
    2024-02-12T06:12:13.894328  
    2024-02-12T06:12:13.908243  / # /lava-3926049/bin/lava-test-runner /lava-3926049/1
    2024-02-12T06:12:14.029160  + export 'TESTRUN_ID=1_bootrr' 
    ... (11 line(s) more)  

platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
sun7i-a20-cubieboard2        | arm   | lab-baylibre  | gcc-10   | multi_v7_defc...CONFIG_SMP=n | 1          

  Details:     https://kernelci.org/test/plan/id/65c9bd08b483cfb3c88e1e7e

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: multi_v7_defconfig+CONFIG_SMP=n
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20240212/arm/multi_v7_defconfig+CONFIG_SMP=n/gcc-10/lab-baylibre/baseline-sun7i-a20-cubieboard2.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240212/arm/multi_v7_defconfig+CONFIG_SMP=n/gcc-10/lab-baylibre/baseline-sun7i-a20-cubieboard2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/armel/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/65c9bd08b483cfb3c88e1e83
        failing since 250 days (last pass: next-20230525, first fail: next-20230607)

    2024-02-12T06:38:47.204675  / # #
    2024-02-12T06:38:47.307161  export SHELL=/bin/sh
    2024-02-12T06:38:47.308025  #
    2024-02-12T06:38:47.409351  / # export SHELL=/bin/sh. /lava-3926103/environment
    2024-02-12T06:38:47.410156  
    2024-02-12T06:38:47.511531  / # . /lava-3926103/environment/lava-3926103/bin/lava-test-runner /lava-3926103/1
    2024-02-12T06:38:47.512809  
    2024-02-12T06:38:47.528395  / # /lava-3926103/bin/lava-test-runner /lava-3926103/1
    2024-02-12T06:38:47.637479  + export 'TESTRUN_ID=1_bootrr'
    2024-02-12T06:38:47.638373  + cd /lava-3926103/1/tests/1_bootrr 
    ... (10 line(s) more)  

platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
sun7i-a20-cubieboard2        | arm   | lab-baylibre  | gcc-10   | multi_v7_defconfig           | 1          

  Details:     https://kernelci.org/test/plan/id/65c9bda6f52ceccf978e1e7a

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: multi_v7_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20240212/arm/multi_v7_defconfig/gcc-10/lab-baylibre/baseline-sun7i-a20-cubieboard2.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240212/arm/multi_v7_defconfig/gcc-10/lab-baylibre/baseline-sun7i-a20-cubieboard2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/armel/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/65c9bda6f52ceccf978e1e7f
        failing since 250 days (last pass: next-20230525, first fail: next-20230607)

    2024-02-12T06:41:29.011971  + set +x<8>[   14.389606] <LAVA_SIGNAL_ENDRUN 0_dmesg 3926110_1.5.2.4.1>
    2024-02-12T06:41:29.012440  
    2024-02-12T06:41:29.120962  / # #
    2024-02-12T06:41:29.223608  export SHELL=/bin/sh
    2024-02-12T06:41:29.224524  #
    2024-02-12T06:41:29.326052  / # export SHELL=/bin/sh. /lava-3926110/environment
    2024-02-12T06:41:29.326966  
    2024-02-12T06:41:29.428626  / # . /lava-3926110/environment/lava-3926110/bin/lava-test-runner /lava-3926110/1
    2024-02-12T06:41:29.430245  
    2024-02-12T06:41:29.443101  / # /lava-3926110/bin/lava-test-runner /lava-3926110/1 
    ... (12 line(s) more)  

platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
sun7i-a20-cubieboard2        | arm   | lab-clabbe    | gcc-10   | multi_v7_defc...MB2_KERNEL=y | 1          

  Details:     https://kernelci.org/test/plan/id/65c9b7d846d824c24e8e1e7b

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20240212/arm/multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y/gcc-10/lab-clabbe/baseline-sun7i-a20-cubieboard2.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240212/arm/multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y/gcc-10/lab-clabbe/baseline-sun7i-a20-cubieboard2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/armel/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/65c9b7d846d824c24e8e1e80
        failing since 250 days (last pass: next-20230517, first fail: next-20230607)

    2024-02-12T06:16:37.991397  + set +x
    2024-02-12T06:16:37.993141  [   19.979933] <LAVA_SIGNAL_ENDRUN 0_dmesg 457802_1.5.2.4.1>
    2024-02-12T06:16:38.102865  / # #
    2024-02-12T06:16:38.204421  export SHELL=/bin/sh
    2024-02-12T06:16:38.204931  #
    2024-02-12T06:16:38.305896  / # export SHELL=/bin/sh. /lava-457802/environment
    2024-02-12T06:16:38.306481  
    2024-02-12T06:16:38.407480  / # . /lava-457802/environment/lava-457802/bin/lava-test-runner /lava-457802/1
    2024-02-12T06:16:38.408317  
    2024-02-12T06:16:38.411297  / # /lava-457802/bin/lava-test-runner /lava-457802/1 
    ... (12 line(s) more)  

platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
sun7i-a20-cubieboard2        | arm   | lab-clabbe    | gcc-10   | multi_v7_defc...CONFIG_SMP=n | 1          

  Details:     https://kernelci.org/test/plan/id/65c9bd78a9919e8f958e1e79

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: multi_v7_defconfig+CONFIG_SMP=n
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20240212/arm/multi_v7_defconfig+CONFIG_SMP=n/gcc-10/lab-clabbe/baseline-sun7i-a20-cubieboard2.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240212/arm/multi_v7_defconfig+CONFIG_SMP=n/gcc-10/lab-clabbe/baseline-sun7i-a20-cubieboard2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/armel/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/65c9bd78a9919e8f958e1e7e
        failing since 250 days (last pass: next-20230525, first fail: next-20230607)

    2024-02-12T06:40:41.793843  + set +x
    2024-02-12T06:40:41.795685  [   24.237022] <LAVA_SIGNAL_ENDRUN 0_dmesg 457809_1.5.2.4.1>
    2024-02-12T06:40:41.903877  / # #
    2024-02-12T06:40:42.005627  export SHELL=/bin/sh
    2024-02-12T06:40:42.006367  #
    2024-02-12T06:40:42.107500  / # export SHELL=/bin/sh. /lava-457809/environment
    2024-02-12T06:40:42.108129  
    2024-02-12T06:40:42.209131  / # . /lava-457809/environment/lava-457809/bin/lava-test-runner /lava-457809/1
    2024-02-12T06:40:42.209978  
    2024-02-12T06:40:42.212529  / # /lava-457809/bin/lava-test-runner /lava-457809/1 
    ... (12 line(s) more)  

platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
sun7i-a20-cubieboard2        | arm   | lab-clabbe    | gcc-10   | multi_v7_defconfig           | 1          

  Details:     https://kernelci.org/test/plan/id/65c9be0497f5ccbecb8e1e8a

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: multi_v7_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20240212/arm/multi_v7_defconfig/gcc-10/lab-clabbe/baseline-sun7i-a20-cubieboard2.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240212/arm/multi_v7_defconfig/gcc-10/lab-clabbe/baseline-sun7i-a20-cubieboard2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/armel/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/65c9be0497f5ccbecb8e1e8f
        failing since 250 days (last pass: next-20230525, first fail: next-20230607)

    2024-02-12T06:42:44.423312  + set +x
    2024-02-12T06:42:44.425063  [   20.604597] <LAVA_SIGNAL_ENDRUN 0_dmesg 457810_1.5.2.4.1>
    2024-02-12T06:42:44.534432  / # #
    2024-02-12T06:42:44.636396  export SHELL=/bin/sh
    2024-02-12T06:42:44.637026  #
    2024-02-12T06:42:44.738172  / # export SHELL=/bin/sh. /lava-457810/environment
    2024-02-12T06:42:44.738813  
    2024-02-12T06:42:44.839911  / # . /lava-457810/environment/lava-457810/bin/lava-test-runner /lava-457810/1
    2024-02-12T06:42:44.840931  
    2024-02-12T06:42:44.843626  / # /lava-457810/bin/lava-test-runner /lava-457810/1 
    ... (12 line(s) more)  

platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
sun8i-h2-plus...ch-all-h3-cc | arm   | lab-baylibre  | gcc-10   | sunxi_defconfig              | 1          

  Details:     https://kernelci.org/test/plan/id/65c9b9ff84460172e88e1e8e

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: sunxi_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20240212/arm/sunxi_defconfig/gcc-10/lab-baylibre/baseline-sun8i-h2-plus-libretech-all-h3-cc.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240212/arm/sunxi_defconfig/gcc-10/lab-baylibre/baseline-sun8i-h2-plus-libretech-all-h3-cc.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/armel/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/65c9b9ff84460172e88e1e93
        failing since 62 days (last pass: next-20231208, first fail: next-20231211)

    2024-02-12T06:25:51.741509  / # #
    2024-02-12T06:25:51.842654  export SHELL=/bin/sh
    2024-02-12T06:25:51.843150  #
    2024-02-12T06:25:51.944191  / # export SHELL=/bin/sh. /lava-3926100/environment
    2024-02-12T06:25:51.944693  
    2024-02-12T06:25:52.045749  / # . /lava-3926100/environment/lava-3926100/bin/lava-test-runner /lava-3926100/1
    2024-02-12T06:25:52.046383  
    2024-02-12T06:25:52.054753  / # /lava-3926100/bin/lava-test-runner /lava-3926100/1
    2024-02-12T06:25:52.134804  + export 'TESTRUN_ID=1_bootrr'
    2024-02-12T06:25:52.150807  + cd /lava-3926100/1/tests/1_bootrr 
    ... (10 line(s) more)  

platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
zynqmp-zcu102                | arm64 | lab-cip       | gcc-10   | defconfig+debug              | 1          

  Details:     https://kernelci.org/test/plan/id/65c9bf29da5e058d718e1e7a

  Results:     4 PASS, 2 FAIL, 1 SKIP
  Full config: defconfig+debug
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20240212/arm64/defconfig+debug/gcc-10/lab-cip/baseline-zynqmp-zcu102.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240212/arm64/defconfig+debug/gcc-10/lab-cip/baseline-zynqmp-zcu102.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz 

  * baseline.dmesg.emerg: https://kernelci.org/test/case/id/65c9bf29da5e058d718e1e81
        failing since 25 days (last pass: next-20240109, first fail: next-20240117)
        1 lines

    2024-02-12T06:47:50.583778  kern  :emerg : watchdog: BUG: soft lockup - CPU#1 stuck for 53s! [kworker/u16:2:57]
    2024-02-12T06:47:50.800736  <8>[  116.298947][  T195] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=emerg RESULT=fail UNITS=lines MEASUREMENT=1>