Subject: next/master baseline: 331 runs, 44 regressions (next-20240325)

From: "kernelci.org bot" <[email-masked]>
Date: Mon, 25 Mar 2024 00:34:25 -0700 (PDT)

next/master baseline: 331 runs, 44 regressions (next-20240325)

Regressions Summary
-------------------

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
acer-R721T-grunt             | x86_64 | lab-collabora   | gcc-10   | x86_64_defconfig+x86-board   | 1          
acer-R721T-grunt             | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...rd+kselftest | 1          
at91-sama5d4_xplained        | arm    | lab-baylibre    | clang-17 | multi_v7_defconfig           | 1          
at91-sama5d4_xplained        | arm    | lab-baylibre    | gcc-10   | multi_v7_defc...MB2_KERNEL=y | 1          
at91-sama5d4_xplained        | arm    | lab-baylibre    | gcc-10   | sama5_defconfig              | 1          
bcm2836-rpi-2-b              | arm    | lab-collabora   | gcc-10   | bcm2835_defconfig            | 1          
bcm2836-rpi-2-b              | arm    | lab-collabora   | gcc-10   | multi_v7_defc...MB2_KERNEL=y | 1          
beagle-xm                    | arm    | lab-baylibre    | gcc-10   | multi_v7_defc...MB2_KERNEL=y | 1          
beagle-xm                    | arm    | lab-baylibre    | gcc-10   | omap2plus_defconfig          | 1          
hp-11A-G6-EE-grunt           | x86_64 | lab-collabora   | gcc-10   | x86_64_defconfig+x86-board   | 1          
hp-11A-G6-EE-grunt           | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...rd+kselftest | 1          
hp-14-db0003na-grunt         | x86_64 | lab-collabora   | gcc-10   | x86_64_defconfig+x86-board   | 1          
hp-14-db0003na-grunt         | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...rd+kselftest | 1          
imx6dl-riotboard             | arm    | lab-pengutronix | gcc-10   | multi_v7_defconfig           | 1          
imx8mm-innocomm-wb15-evk     | arm64  | lab-pengutronix | clang-17 | defconfig+CON..._64K_PAGES=y | 1          
jetson-tk1                   | arm    | lab-baylibre    | gcc-10   | multi_v7_defconfig           | 1          
jetson-tk1                   | arm    | lab-baylibre    | gcc-10   | multi_v7_defc...G_ARM_LPAE=y | 1          
k3-j721e-sk                  | arm64  | lab-baylibre    | clang-17 | defconfig+CON..._64K_PAGES=y | 1          
kontron-kbox-a-230-ls        | arm64  | lab-kontron     | clang-17 | defconfig+CON..._64K_PAGES=y | 5          
mt8173-elm-hana              | arm64  | lab-collabora   | gcc-10   | defconfig+arm...ok+kselftest | 1          
mt8173-elm-hana              | arm64  | lab-collabora   | gcc-10   | defconfig+arm64-chromebook   | 2          
mt8192-asurada-spherion-r0   | arm64  | lab-collabora   | gcc-10   | defconfig+arm...ok+kselftest | 1          
r8a7743-iwg20d-q7            | arm    | lab-cip         | gcc-10   | shmobile_defconfig           | 1          
rk3288-rock2-square          | arm    | lab-collabora   | clang-17 | multi_v7_defconfig           | 1          
rk3288-rock2-square          | arm    | lab-collabora   | gcc-10   | multi_v7_defc...G_ARM_LPAE=y | 1          
rk3288-veyron-jaq            | arm    | lab-collabora   | gcc-10   | multi_v7_defc...G_ARM_LPAE=y | 1          
sc7180-trogdor-kingoftown    | arm64  | lab-collabora   | gcc-10   | defconfig+arm...ok+kselftest | 1          
sc7180-trogdo...zor-limozeen | arm64  | lab-collabora   | gcc-10   | defconfig+arm...ok+kselftest | 1          
sun50i-h6-pine-h64           | arm64  | lab-clabbe      | clang-17 | defconfig+CON..._64K_PAGES=y | 1          
sun50i-h6-pine-h64           | arm64  | lab-collabora   | clang-17 | defconfig+CON..._64K_PAGES=y | 1          
sun7i-a20-cubieboard2        | arm    | lab-baylibre    | clang-17 | multi_v7_defconfig           | 1          
sun7i-a20-cubieboard2        | arm    | lab-clabbe      | clang-17 | multi_v7_defconfig           | 1          
sun7i-a20-cubieboard2        | arm    | lab-baylibre    | gcc-10   | multi_v7_defconfig           | 1          
sun7i-a20-cubieboard2        | arm    | lab-baylibre    | gcc-10   | multi_v7_defc...MB2_KERNEL=y | 1          
sun7i-a20-cubieboard2        | arm    | lab-baylibre    | gcc-10   | multi_v7_defc...CONFIG_SMP=n | 1          
sun7i-a20-cubieboard2        | arm    | lab-clabbe      | gcc-10   | multi_v7_defconfig           | 1          
sun7i-a20-cubieboard2        | arm    | lab-clabbe      | gcc-10   | multi_v7_defc...MB2_KERNEL=y | 1          
sun7i-a20-cubieboard2        | arm    | lab-clabbe      | gcc-10   | multi_v7_defc...CONFIG_SMP=n | 1          
zynqmp-zcu102                | arm64  | lab-cip         | gcc-10   | defconfig+arm...ok+kselftest | 1          

  Details:  https://kernelci.org/test/job/next/branch/master/kernel/next-20240325/plan/baseline/

  Test:     baseline
  Tree:     next
  Branch:   master
  Describe: next-20240325
  URL:      https://git.kernel.org/pub/scm/linux/kernel/git/next/linux-next.git
  SHA:      1fdad13606e104ff103ca19d2d660830cb36d43e 

Test Regressions
---------------- 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
acer-R721T-grunt             | x86_64 | lab-collabora   | gcc-10   | x86_64_defconfig+x86-board   | 1          

  Details:     https://kernelci.org/test/plan/id/6600eb240def76ba544c42db

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-board
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20240325/x86_64/x86_64_defconfig+x86-board/gcc-10/lab-collabora/baseline-acer-R721T-grunt.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240325/x86_64/x86_64_defconfig+x86-board/gcc-10/lab-collabora/baseline-acer-R721T-grunt.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230703.0/x86/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6600eb240def76ba544c42dc
        failing since 25 days (last pass: next-20240226, first fail: next-20240228) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
acer-R721T-grunt             | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...rd+kselftest | 1          

  Details:     https://kernelci.org/test/plan/id/6600efbfac1eae88c54c464d

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-board+kselftest
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20240325/x86_64/x86_64_defconfig+x86-board+kselftest/gcc-10/lab-collabora/baseline-acer-R721T-grunt.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240325/x86_64/x86_64_defconfig+x86-board+kselftest/gcc-10/lab-collabora/baseline-acer-R721T-grunt.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230703.0/x86/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6600efbfac1eae88c54c464e
        failing since 19 days (last pass: next-20240226, first fail: next-20240305) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
at91-sama5d4_xplained        | arm    | lab-baylibre    | clang-17 | multi_v7_defconfig           | 1          

  Details:     https://kernelci.org/test/plan/id/6600f675d8be4567594c42e7

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig
  Compiler:    clang-17 (Debian clang version 17.0.6 (++20231208085823+6009708b4367-1~exp1~20231208085918.75))
  Plain log:   https://storage.kernelci.org//next/master/next-20240325/arm/multi_v7_defconfig/clang-17/lab-baylibre/baseline-at91-sama5d4_xplained.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240325/arm/multi_v7_defconfig/clang-17/lab-baylibre/baseline-at91-sama5d4_xplained.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230703.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6600f675d8be4567594c42e8
        failing since 3 days (last pass: next-20240125, first fail: next-20240321) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
at91-sama5d4_xplained        | arm    | lab-baylibre    | gcc-10   | multi_v7_defc...MB2_KERNEL=y | 1          

  Details:     https://kernelci.org/test/plan/id/6600f404c02ae6b64d4c4326

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20240325/arm/multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y/gcc-10/lab-baylibre/baseline-at91-sama5d4_xplained.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240325/arm/multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y/gcc-10/lab-baylibre/baseline-at91-sama5d4_xplained.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230703.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6600f404c02ae6b64d4c4327
        new failure (last pass: next-20240322) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
at91-sama5d4_xplained        | arm    | lab-baylibre    | gcc-10   | sama5_defconfig              | 1          

  Details:     https://kernelci.org/test/plan/id/6600e71adfd825672d4c42fb

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: sama5_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20240325/arm/sama5_defconfig/gcc-10/lab-baylibre/baseline-at91-sama5d4_xplained.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240325/arm/sama5_defconfig/gcc-10/lab-baylibre/baseline-at91-sama5d4_xplained.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230703.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6600e71adfd825672d4c42fc
        failing since 418 days (last pass: next-20230125, first fail: next-20230131) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
bcm2836-rpi-2-b              | arm    | lab-collabora   | gcc-10   | bcm2835_defconfig            | 1          

  Details:     https://kernelci.org/test/plan/id/6600f2028a7028b5ff4c42df

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: bcm2835_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20240325/arm/bcm2835_defconfig/gcc-10/lab-collabora/baseline-bcm2836-rpi-2-b.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240325/arm/bcm2835_defconfig/gcc-10/lab-collabora/baseline-bcm2836-rpi-2-b.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230703.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6600f2028a7028b5ff4c42e0
        failing since 293 days (last pass: next-20230601, first fail: next-20230605) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
bcm2836-rpi-2-b              | arm    | lab-collabora   | gcc-10   | multi_v7_defc...MB2_KERNEL=y | 1          

  Details:     https://kernelci.org/test/plan/id/6600f33060214ea12c4c42dc

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20240325/arm/multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y/gcc-10/lab-collabora/baseline-bcm2836-rpi-2-b.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240325/arm/multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y/gcc-10/lab-collabora/baseline-bcm2836-rpi-2-b.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230703.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6600f33060214ea12c4c42dd
        failing since 362 days (last pass: next-20230327, first fail: next-20230328) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
beagle-xm                    | arm    | lab-baylibre    | gcc-10   | multi_v7_defc...MB2_KERNEL=y | 1          

  Details:     https://kernelci.org/test/plan/id/6600f450218fc48cf84c430d

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20240325/arm/multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y/gcc-10/lab-baylibre/baseline-beagle-xm.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240325/arm/multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y/gcc-10/lab-baylibre/baseline-beagle-xm.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230703.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6600f450218fc48cf84c430e
        failing since 359 days (last pass: next-20230330, first fail: next-20230331) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
beagle-xm                    | arm    | lab-baylibre    | gcc-10   | omap2plus_defconfig          | 1          

  Details:     https://kernelci.org/test/plan/id/6600f3ebc02ae6b64d4c4312

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: omap2plus_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20240325/arm/omap2plus_defconfig/gcc-10/lab-baylibre/baseline-beagle-xm.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240325/arm/omap2plus_defconfig/gcc-10/lab-baylibre/baseline-beagle-xm.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230703.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6600f3ebc02ae6b64d4c4313
        new failure (last pass: next-20240322) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
hp-11A-G6-EE-grunt           | x86_64 | lab-collabora   | gcc-10   | x86_64_defconfig+x86-board   | 1          

  Details:     https://kernelci.org/test/plan/id/6600eb2b0def76ba544c42ea

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-board
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20240325/x86_64/x86_64_defconfig+x86-board/gcc-10/lab-collabora/baseline-hp-11A-G6-EE-grunt.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240325/x86_64/x86_64_defconfig+x86-board/gcc-10/lab-collabora/baseline-hp-11A-G6-EE-grunt.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230703.0/x86/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6600eb2b0def76ba544c42eb
        failing since 25 days (last pass: next-20240226, first fail: next-20240228) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
hp-11A-G6-EE-grunt           | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...rd+kselftest | 1          

  Details:     https://kernelci.org/test/plan/id/6600efa2ea189da49c4c42da

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-board+kselftest
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20240325/x86_64/x86_64_defconfig+x86-board+kselftest/gcc-10/lab-collabora/baseline-hp-11A-G6-EE-grunt.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240325/x86_64/x86_64_defconfig+x86-board+kselftest/gcc-10/lab-collabora/baseline-hp-11A-G6-EE-grunt.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230703.0/x86/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6600efa2ea189da49c4c42db
        failing since 19 days (last pass: next-20240226, first fail: next-20240305) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
hp-14-db0003na-grunt         | x86_64 | lab-collabora   | gcc-10   | x86_64_defconfig+x86-board   | 1          

  Details:     https://kernelci.org/test/plan/id/6600eb2529f3f7e2404c4331

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-board
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20240325/x86_64/x86_64_defconfig+x86-board/gcc-10/lab-collabora/baseline-hp-14-db0003na-grunt.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240325/x86_64/x86_64_defconfig+x86-board/gcc-10/lab-collabora/baseline-hp-14-db0003na-grunt.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230703.0/x86/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6600eb2529f3f7e2404c4332
        failing since 25 days (last pass: next-20240226, first fail: next-20240228) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
hp-14-db0003na-grunt         | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...rd+kselftest | 1          

  Details:     https://kernelci.org/test/plan/id/6600efabac1eae88c54c4623

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-board+kselftest
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20240325/x86_64/x86_64_defconfig+x86-board+kselftest/gcc-10/lab-collabora/baseline-hp-14-db0003na-grunt.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240325/x86_64/x86_64_defconfig+x86-board+kselftest/gcc-10/lab-collabora/baseline-hp-14-db0003na-grunt.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230703.0/x86/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6600efabac1eae88c54c4624
        failing since 19 days (last pass: next-20240226, first fail: next-20240305) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
imx6dl-riotboard             | arm    | lab-pengutronix | gcc-10   | multi_v7_defconfig           | 1          

  Details:     https://kernelci.org/test/plan/id/6600ea1d4b30fe9af14c42e4

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: multi_v7_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20240325/arm/multi_v7_defconfig/gcc-10/lab-pengutronix/baseline-imx6dl-riotboard.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240325/arm/multi_v7_defconfig/gcc-10/lab-pengutronix/baseline-imx6dl-riotboard.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230703.0/armel/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6600ea1d4b30fe9af14c42ed
        new failure (last pass: next-20240322)

    2024-03-25T03:00:31.254411  + set[   15.851391] <LAVA_SIGNAL_ENDRUN 0_dmesg 1036813_1.5.2.3.1>
    2024-03-25T03:00:31.254585   +x
    2024-03-25T03:00:31.359909  / # #
    2024-03-25T03:00:31.461078  export SHELL=/bin/sh
    2024-03-25T03:00:31.461569  #
    2024-03-25T03:00:31.562307  / # export SHELL=/bin/sh. /lava-1036813/environment
    2024-03-25T03:00:31.562723  
    2024-03-25T03:00:31.663483  / # . /lava-1036813/environment/lava-1036813/bin/lava-test-runner /lava-1036813/1
    2024-03-25T03:00:31.664044  
    2024-03-25T03:00:31.667180  / # /lava-1036813/bin/lava-test-runner /lava-1036813/1 
    ... (12 line(s) more)  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
imx8mm-innocomm-wb15-evk     | arm64  | lab-pengutronix | clang-17 | defconfig+CON..._64K_PAGES=y | 1          

  Details:     https://kernelci.org/test/plan/id/6600ed9648c066e6944c4303

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+CONFIG_ARM64_64K_PAGES=y
  Compiler:    clang-17 (Debian clang version 17.0.6 (++20231208085823+6009708b4367-1~exp1~20231208085918.75))
  Plain log:   https://storage.kernelci.org//next/master/next-20240325/arm64/defconfig+CONFIG_ARM64_64K_PAGES=y/clang-17/lab-pengutronix/baseline-imx8mm-innocomm-wb15-evk.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240325/arm64/defconfig+CONFIG_ARM64_64K_PAGES=y/clang-17/lab-pengutronix/baseline-imx8mm-innocomm-wb15-evk.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230703.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6600ed9648c066e6944c4304
        new failure (last pass: next-20240226) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
jetson-tk1                   | arm    | lab-baylibre    | gcc-10   | multi_v7_defconfig           | 1          

  Details:     https://kernelci.org/test/plan/id/6600ea1d5b3a67bded4c42e1

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20240325/arm/multi_v7_defconfig/gcc-10/lab-baylibre/baseline-jetson-tk1.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240325/arm/multi_v7_defconfig/gcc-10/lab-baylibre/baseline-jetson-tk1.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230703.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6600ea1d5b3a67bded4c42e2
        failing since 4 days (last pass: next-20240315, first fail: next-20240320) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
jetson-tk1                   | arm    | lab-baylibre    | gcc-10   | multi_v7_defc...G_ARM_LPAE=y | 1          

  Details:     https://kernelci.org/test/plan/id/6600f57b555b9058fe4c4382

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20240325/arm/multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y/gcc-10/lab-baylibre/baseline-jetson-tk1.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240325/arm/multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y/gcc-10/lab-baylibre/baseline-jetson-tk1.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230703.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6600f57b555b9058fe4c4383
        failing since 713 days (last pass: next-20220401, first fail: next-20220411) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
k3-j721e-sk                  | arm64  | lab-baylibre    | clang-17 | defconfig+CON..._64K_PAGES=y | 1          

  Details:     https://kernelci.org/test/plan/id/6600eeea1cdbc462364c42f2

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+CONFIG_ARM64_64K_PAGES=y
  Compiler:    clang-17 (Debian clang version 17.0.6 (++20231208085823+6009708b4367-1~exp1~20231208085918.75))
  Plain log:   https://storage.kernelci.org//next/master/next-20240325/arm64/defconfig+CONFIG_ARM64_64K_PAGES=y/clang-17/lab-baylibre/baseline-k3-j721e-sk.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240325/arm64/defconfig+CONFIG_ARM64_64K_PAGES=y/clang-17/lab-baylibre/baseline-k3-j721e-sk.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230703.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6600eeea1cdbc462364c42f3
        new failure (last pass: next-20240226) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
kontron-kbox-a-230-ls        | arm64  | lab-kontron     | clang-17 | defconfig+CON..._64K_PAGES=y | 5          

  Details:     https://kernelci.org/test/plan/id/6600ed94e953fc8fff4c42ed

  Results:     90 PASS, 5 FAIL, 1 SKIP
  Full config: defconfig+CONFIG_ARM64_64K_PAGES=y
  Compiler:    clang-17 (Debian clang version 17.0.6 (++20231208085823+6009708b4367-1~exp1~20231208085918.75))
  Plain log:   https://storage.kernelci.org//next/master/next-20240325/arm64/defconfig+CONFIG_ARM64_64K_PAGES=y/clang-17/lab-kontron/baseline-kontron-kbox-a-230-ls.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240325/arm64/defconfig+CONFIG_ARM64_64K_PAGES=y/clang-17/lab-kontron/baseline-kontron-kbox-a-230-ls.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230703.0/arm64/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6600ed94e953fc8fff4c42f4
        failing since 101 days (last pass: next-20231208, first fail: next-20231214)

    2024-03-25T03:20:30.888435  / # #
    2024-03-25T03:20:30.990574  export SHELL=/bin/sh
    2024-03-25T03:20:30.991298  #
    2024-03-25T03:20:31.092619  / # export SHELL=/bin/sh. /lava-447002/environment
    2024-03-25T03:20:31.093345  
    2024-03-25T03:20:31.194655  / # . /lava-447002/environment/lava-447002/bin/lava-test-runner /lava-447002/1
    2024-03-25T03:20:31.195827  
    2024-03-25T03:20:31.200495  / # /lava-447002/bin/lava-test-runner /lava-447002/1
    2024-03-25T03:20:31.260058  + export 'TESTRUN_ID=1_bootrr'
    2024-03-25T03:20:31.260518  + <8>[   20.753712] <LAVA_SIGNAL_STARTRUN 1_bootrr 447002_1.5.2.4.5> 
    ... (16 line(s) more)  

  * baseline.bootrr.fsl_enetc-enetc2-probed: https://kernelci.org/test/case/id/6600ed94e953fc8fff4c42f8
        failing since 101 days (last pass: next-20231208, first fail: next-20231214)

    2024-03-25T03:20:33.363143  /lava-447002/1/../bin/lava-test-case
    2024-03-25T03:20:33.363573  <8>[   22.857566] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=fsl_enetc-enetc2-probed RESULT=fail>
    2024-03-25T03:20:33.364000  /lava-447002/1/../bin/lava-test-case   

  * baseline.bootrr.mscc_felix-probed: https://kernelci.org/test/case/id/6600ed94e953fc8fff4c42fa
        failing since 101 days (last pass: next-20231208, first fail: next-20231214)

    2024-03-25T03:20:34.419944  /lava-447002/1/../bin/lava-test-case
    2024-03-25T03:20:34.420393  <8>[   23.895108] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=mscc_felix-probed RESULT=fail>
    2024-03-25T03:20:34.420691  /lava-447002/1/../bin/lava-test-case
    2024-03-25T03:20:34.420910  <8>[   23.911997] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=leds-gpio-driver-present RESULT=pass>
    2024-03-25T03:20:34.421124  /lava-447002/1/../bin/lava-test-case   

  * baseline.bootrr.fsl_enetc-enetc0-probed: https://kernelci.org/test/case/id/6600ed94e953fc8fff4c42ff
        failing since 101 days (last pass: next-20231208, first fail: next-20231214)

    2024-03-25T03:20:35.492828  /lava-447002/1/../bin/lava-test-case   

  * baseline.bootrr.fsl_enetc-enetc1-probed: https://kernelci.org/test/case/id/6600ed94e953fc8fff4c4300
        failing since 101 days (last pass: next-20231208, first fail: next-20231214)

    2024-03-25T03:20:35.496127  <8>[   25.004763] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=fsl_enetc-enetc0-probed RESULT=fail>
    2024-03-25T03:20:36.555171  /lava-447002/1/../bin/lava-test-case
    2024-03-25T03:20:36.555625  <8>[   26.026819] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=fsl_enetc-enetc1-probed RESULT=fail>
    2024-03-25T03:20:36.555921  /lava-447002/1/../bin/lava-test-case
    2024-03-25T03:20:36.556144  <8>[   26.043907] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=fsl_enetc_mdio-driver-present RESULT=pass>
    2024-03-25T03:20:36.556357  /lava-447002/1/../bin/lava-test-case   

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
mt8173-elm-hana              | arm64  | lab-collabora   | gcc-10   | defconfig+arm...ok+kselftest | 1          

  Details:     https://kernelci.org/test/plan/id/6600eb6a511ca9893e4c4325

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20240325/arm64/defconfig+arm64-chromebook+kselftest/gcc-10/lab-collabora/baseline-mt8173-elm-hana.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240325/arm64/defconfig+arm64-chromebook+kselftest/gcc-10/lab-collabora/baseline-mt8173-elm-hana.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230703.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6600eb6a511ca9893e4c4326
        new failure (last pass: next-20240320) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
mt8173-elm-hana              | arm64  | lab-collabora   | gcc-10   | defconfig+arm64-chromebook   | 2          

  Details:     https://kernelci.org/test/plan/id/6600eb8c6263a13bd64c42f7

  Results:     27 PASS, 2 FAIL, 1 SKIP
  Full config: defconfig+arm64-chromebook
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20240325/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-mt8173-elm-hana.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240325/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-mt8173-elm-hana.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230703.0/arm64/rootfs.cpio.gz 

  * baseline.bootrr.armv8-pmu-a72-probed: https://kernelci.org/test/case/id/6600eb8c6263a13bd64c4312
        failing since 38 days (last pass: next-20240214, first fail: next-20240215)

    2024-03-25T03:12:52.324931  /lava-13144069/1/../bin/lava-test-case

  * baseline.bootrr.armv8-pmu-a53-probed: https://kernelci.org/test/case/id/6600eb8c6263a13bd64c4313
        failing since 38 days (last pass: next-20240214, first fail: next-20240215)

    2024-03-25T03:12:51.295052  /lava-13144069/1/../bin/lava-test-case

    2024-03-25T03:12:51.304536  <8>[   31.147585] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=armv8-pmu-a53-probed RESULT=fail>

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
mt8192-asurada-spherion-r0   | arm64  | lab-collabora   | gcc-10   | defconfig+arm...ok+kselftest | 1          

  Details:     https://kernelci.org/test/plan/id/6600eb8a6263a13bd64c42ea

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20240325/arm64/defconfig+arm64-chromebook+kselftest/gcc-10/lab-collabora/baseline-mt8192-asurada-spherion-r0.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240325/arm64/defconfig+arm64-chromebook+kselftest/gcc-10/lab-collabora/baseline-mt8192-asurada-spherion-r0.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230703.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6600eb8a6263a13bd64c42eb
        new failure (last pass: next-20240320) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
r8a7743-iwg20d-q7            | arm    | lab-cip         | gcc-10   | shmobile_defconfig           | 1          

  Details:     https://kernelci.org/test/plan/id/6600ee44f74fafb7674c42ec

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: shmobile_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20240325/arm/shmobile_defconfig/gcc-10/lab-cip/baseline-r8a7743-iwg20d-q7.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240325/arm/shmobile_defconfig/gcc-10/lab-cip/baseline-r8a7743-iwg20d-q7.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230703.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6600ee44f74fafb7674c42ed
        new failure (last pass: next-20240322) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
rk3288-rock2-square          | arm    | lab-collabora   | clang-17 | multi_v7_defconfig           | 1          

  Details:     https://kernelci.org/test/plan/id/6600f703f19b3a51d44c4303

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig
  Compiler:    clang-17 (Debian clang version 17.0.6 (++20231208085823+6009708b4367-1~exp1~20231208085918.75))
  Plain log:   https://storage.kernelci.org//next/master/next-20240325/arm/multi_v7_defconfig/clang-17/lab-collabora/baseline-rk3288-rock2-square.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240325/arm/multi_v7_defconfig/clang-17/lab-collabora/baseline-rk3288-rock2-square.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230703.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6600f703f19b3a51d44c4304
        failing since 3 days (last pass: next-20240315, first fail: next-20240321) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
rk3288-rock2-square          | arm    | lab-collabora   | gcc-10   | multi_v7_defc...G_ARM_LPAE=y | 1          

  Details:     https://kernelci.org/test/plan/id/6600f5afa3b4cb75f44c42f1

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20240325/arm/multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y/gcc-10/lab-collabora/baseline-rk3288-rock2-square.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240325/arm/multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y/gcc-10/lab-collabora/baseline-rk3288-rock2-square.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230703.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6600f5afa3b4cb75f44c42f2
        failing since 488 days (last pass: next-20221121, first fail: next-20221122) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
rk3288-veyron-jaq            | arm    | lab-collabora   | gcc-10   | multi_v7_defc...G_ARM_LPAE=y | 1          

  Details:     https://kernelci.org/test/plan/id/6600f4ab140d3b1c794c42eb

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20240325/arm/multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y/gcc-10/lab-collabora/baseline-rk3288-veyron-jaq.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240325/arm/multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y/gcc-10/lab-collabora/baseline-rk3288-veyron-jaq.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230703.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6600f4ab140d3b1c794c42ec
        failing since 488 days (last pass: next-20221121, first fail: next-20221122) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
sc7180-trogdor-kingoftown    | arm64  | lab-collabora   | gcc-10   | defconfig+arm...ok+kselftest | 1          

  Details:     https://kernelci.org/test/plan/id/6600eb7dd224ff9b9d4c4336

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20240325/arm64/defconfig+arm64-chromebook+kselftest/gcc-10/lab-collabora/baseline-sc7180-trogdor-kingoftown.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240325/arm64/defconfig+arm64-chromebook+kselftest/gcc-10/lab-collabora/baseline-sc7180-trogdor-kingoftown.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230703.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6600eb7dd224ff9b9d4c4337
        new failure (last pass: next-20240320) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
sc7180-trogdo...zor-limozeen | arm64  | lab-collabora   | gcc-10   | defconfig+arm...ok+kselftest | 1          

  Details:     https://kernelci.org/test/plan/id/6600eb72d224ff9b9d4c42ec

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20240325/arm64/defconfig+arm64-chromebook+kselftest/gcc-10/lab-collabora/baseline-sc7180-trogdor-lazor-limozeen.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240325/arm64/defconfig+arm64-chromebook+kselftest/gcc-10/lab-collabora/baseline-sc7180-trogdor-lazor-limozeen.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230703.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6600eb72d224ff9b9d4c42ed
        new failure (last pass: next-20240320) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
sun50i-h6-pine-h64           | arm64  | lab-clabbe      | clang-17 | defconfig+CON..._64K_PAGES=y | 1          

  Details:     https://kernelci.org/test/plan/id/6600ed830b05e7a3154c4324

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+CONFIG_ARM64_64K_PAGES=y
  Compiler:    clang-17 (Debian clang version 17.0.6 (++20231208085823+6009708b4367-1~exp1~20231208085918.75))
  Plain log:   https://storage.kernelci.org//next/master/next-20240325/arm64/defconfig+CONFIG_ARM64_64K_PAGES=y/clang-17/lab-clabbe/baseline-sun50i-h6-pine-h64.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240325/arm64/defconfig+CONFIG_ARM64_64K_PAGES=y/clang-17/lab-clabbe/baseline-sun50i-h6-pine-h64.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230703.0/arm64/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6600ed830b05e7a3154c432d
        failing since 166 days (last pass: v6.3-rc6-12018-gd3f2cd248191, first fail: next-20231010)

    2024-03-25T03:20:12.087190  <8>[   18.779450] <LAVA_SIGNAL_ENDRUN 0_dmesg 463711_1.5.2.4.1>
    2024-03-25T03:20:12.190587  / # #
    2024-03-25T03:20:12.292053  export SHELL=/bin/sh
    2024-03-25T03:20:12.292522  #
    2024-03-25T03:20:12.393577  / # export SHELL=/bin/sh. /lava-463711/environment
    2024-03-25T03:20:12.394036  
    2024-03-25T03:20:12.494972  / # . /lava-463711/environment/lava-463711/bin/lava-test-runner /lava-463711/1
    2024-03-25T03:20:12.495655  
    2024-03-25T03:20:12.502956  / # /lava-463711/bin/lava-test-runner /lava-463711/1
    2024-03-25T03:20:12.581989  + export 'TESTRUN_ID=1_bootrr' 
    ... (12 line(s) more)  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
sun50i-h6-pine-h64           | arm64  | lab-collabora   | clang-17 | defconfig+CON..._64K_PAGES=y | 1          

  Details:     https://kernelci.org/test/plan/id/6600ed9f48c066e6944c433f

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+CONFIG_ARM64_64K_PAGES=y
  Compiler:    clang-17 (Debian clang version 17.0.6 (++20231208085823+6009708b4367-1~exp1~20231208085918.75))
  Plain log:   https://storage.kernelci.org//next/master/next-20240325/arm64/defconfig+CONFIG_ARM64_64K_PAGES=y/clang-17/lab-collabora/baseline-sun50i-h6-pine-h64.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240325/arm64/defconfig+CONFIG_ARM64_64K_PAGES=y/clang-17/lab-collabora/baseline-sun50i-h6-pine-h64.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230703.0/arm64/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6600ed9f48c066e6944c4348
        failing since 166 days (last pass: v6.3-rc6-12018-gd3f2cd248191, first fail: next-20231010)

    2024-03-25T03:20:54.296713  / # #

    2024-03-25T03:20:54.399029  export SHELL=/bin/sh

    2024-03-25T03:20:54.399779  #

    2024-03-25T03:20:54.501223  / # export SHELL=/bin/sh. /lava-13144174/environment

    2024-03-25T03:20:54.501973  

    2024-03-25T03:20:54.603455  / # . /lava-13144174/environment/lava-13144174/bin/lava-test-runner /lava-13144174/1

    2024-03-25T03:20:54.604692  

    2024-03-25T03:20:54.621517  / # /lava-13144174/bin/lava-test-runner /lava-13144174/1

    2024-03-25T03:20:54.692322  + export 'TESTRUN_ID=1_bootrr'

    2024-03-25T03:20:54.692803  + cd /lava-1314417<8>[   19.397685] <LAVA_SIGNAL_STARTRUN 1_bootrr 13144174_1.5.2.4.5>
 
    ... (11 line(s) more)  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
sun7i-a20-cubieboard2        | arm    | lab-baylibre    | clang-17 | multi_v7_defconfig           | 1          

  Details:     https://kernelci.org/test/plan/id/6600f57d555b9058fe4c4385

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: multi_v7_defconfig
  Compiler:    clang-17 (Debian clang version 17.0.6 (++20231208085823+6009708b4367-1~exp1~20231208085918.75))
  Plain log:   https://storage.kernelci.org//next/master/next-20240325/arm/multi_v7_defconfig/clang-17/lab-baylibre/baseline-sun7i-a20-cubieboard2.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240325/arm/multi_v7_defconfig/clang-17/lab-baylibre/baseline-sun7i-a20-cubieboard2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230703.0/armel/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6600f57d555b9058fe4c438e
        failing since 291 days (last pass: next-20230525, first fail: next-20230607)

    2024-03-25T03:54:10.260961  / ##
    2024-03-25T03:54:10.368795  export SHELL=/bin/sh
    2024-03-25T03:54:10.369654   #
    2024-03-25T03:54:10.471212  / # export SHELL=/bin/sh. /lava-3963999/environment
    2024-03-25T03:54:10.472372  
    2024-03-25T03:54:10.574021  / # . /lava-3963999/environment/lava-3963999/bin/lava-test-runner /lava-3963999/1
    2024-03-25T03:54:10.576162  
    2024-03-25T03:54:10.620420  / # /lava-3963999/bin/lava-test-runner /lava-3963999/1
    2024-03-25T03:54:10.712786  + export 'TESTRUN_ID=1_bootrr'
    2024-03-25T03:54:10.714006  + cd /lava-3963999/1/tests/1_bootrr 
    ... (10 line(s) more)  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
sun7i-a20-cubieboard2        | arm    | lab-clabbe      | clang-17 | multi_v7_defconfig           | 1          

  Details:     https://kernelci.org/test/plan/id/6600f581dd8b08b5024c42de

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: multi_v7_defconfig
  Compiler:    clang-17 (Debian clang version 17.0.6 (++20231208085823+6009708b4367-1~exp1~20231208085918.75))
  Plain log:   https://storage.kernelci.org//next/master/next-20240325/arm/multi_v7_defconfig/clang-17/lab-clabbe/baseline-sun7i-a20-cubieboard2.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240325/arm/multi_v7_defconfig/clang-17/lab-clabbe/baseline-sun7i-a20-cubieboard2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230703.0/armel/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6600f581dd8b08b5024c42e7
        failing since 291 days (last pass: next-20230525, first fail: next-20230607)

    2024-03-25T03:54:17.863366  + set +x
    2024-03-25T03:54:17.865144  [   20.873521] <LAVA_SIGNAL_ENDRUN 0_dmesg 463725_1.5.2.4.1>
    2024-03-25T03:54:17.973736  / # #
    2024-03-25T03:54:18.075293  export SHELL=/bin/sh
    2024-03-25T03:54:18.075825  #
    2024-03-25T03:54:18.176784  / # export SHELL=/bin/sh. /lava-463725/environment
    2024-03-25T03:54:18.177289  
    2024-03-25T03:54:18.278295  / # . /lava-463725/environment/lava-463725/bin/lava-test-runner /lava-463725/1
    2024-03-25T03:54:18.279108  
    2024-03-25T03:54:18.282165  / # /lava-463725/bin/lava-test-runner /lava-463725/1 
    ... (12 line(s) more)  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
sun7i-a20-cubieboard2        | arm    | lab-baylibre    | gcc-10   | multi_v7_defconfig           | 1          

  Details:     https://kernelci.org/test/plan/id/6600ea1e93f16b14af4c42da

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: multi_v7_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20240325/arm/multi_v7_defconfig/gcc-10/lab-baylibre/baseline-sun7i-a20-cubieboard2.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240325/arm/multi_v7_defconfig/gcc-10/lab-baylibre/baseline-sun7i-a20-cubieboard2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230703.0/armel/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6600ea1e93f16b14af4c42e3
        failing since 297 days (last pass: next-20230530, first fail: next-20230601)

    2024-03-25T03:01:07.361459  <8>[   12.219286] <LAVA_SIGNAL_ENDRUN 0_dmesg 3963758_1.5.2.4.1>
    2024-03-25T03:01:07.471615  / # #
    2024-03-25T03:01:07.574853  export SHELL=/bin/sh
    2024-03-25T03:01:07.576028  #
    2024-03-25T03:01:07.678059  / # export SHELL=/bin/sh. /lava-3963758/environment
    2024-03-25T03:01:07.679063  
    2024-03-25T03:01:07.780812  / # . /lava-3963758/environment/lava-3963758/bin/lava-test-runner /lava-3963758/1
    2024-03-25T03:01:07.782404  
    2024-03-25T03:01:07.824651  / # /lava-3963758/bin/lava-test-runner /lava-3963758/1
    2024-03-25T03:01:07.922417  + export 'TESTRUN_ID=1_bootrr' 
    ... (11 line(s) more)  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
sun7i-a20-cubieboard2        | arm    | lab-baylibre    | gcc-10   | multi_v7_defc...MB2_KERNEL=y | 1          

  Details:     https://kernelci.org/test/plan/id/6600f31127ad4d7db64c430b

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20240325/arm/multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y/gcc-10/lab-baylibre/baseline-sun7i-a20-cubieboard2.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240325/arm/multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y/gcc-10/lab-baylibre/baseline-sun7i-a20-cubieboard2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230703.0/armel/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6600f31127ad4d7db64c4314
        failing since 291 days (last pass: next-20230517, first fail: next-20230607)

    2024-03-25T03:43:55.309994  <8>[   13.876809] <LAVA_SIGNAL_ENDRUN 0_dmesg 3963956_1.5.2.4.1>
    2024-03-25T03:43:55.419199  / # #
    2024-03-25T03:43:55.522407  export SHELL=/bin/sh
    2024-03-25T03:43:55.523566  #
    2024-03-25T03:43:55.625385  / # export SHELL=/bin/sh. /lava-3963956/environment
    2024-03-25T03:43:55.626468  
    2024-03-25T03:43:55.728108  / # . /lava-3963956/environment/lava-3963956/bin/lava-test-runner /lava-3963956/1
    2024-03-25T03:43:55.729721  
    2024-03-25T03:43:55.741351  / # /lava-3963956/bin/lava-test-runner /lava-3963956/1
    2024-03-25T03:43:55.862196  + export 'TESTRUN_ID=1_bootrr' 
    ... (11 line(s) more)  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
sun7i-a20-cubieboard2        | arm    | lab-baylibre    | gcc-10   | multi_v7_defc...CONFIG_SMP=n | 1          

  Details:     https://kernelci.org/test/plan/id/6600f7481630f1e4214c43c8

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: multi_v7_defconfig+CONFIG_SMP=n
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20240325/arm/multi_v7_defconfig+CONFIG_SMP=n/gcc-10/lab-baylibre/baseline-sun7i-a20-cubieboard2.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240325/arm/multi_v7_defconfig+CONFIG_SMP=n/gcc-10/lab-baylibre/baseline-sun7i-a20-cubieboard2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230703.0/armel/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6600f7491630f1e4214c43d1
        failing since 291 days (last pass: next-20230525, first fail: next-20230607)

    2024-03-25T04:02:00.935226  <8>[   16.574181] <LAVA_SIGNAL_ENDRUN 0_dmesg 3964032_1.5.2.4.1>
    2024-03-25T04:02:01.039491  / # #
    2024-03-25T04:02:01.140505  export SHELL=/bin/sh
    2024-03-25T04:02:01.140862  #
    2024-03-25T04:02:01.241596  / # export SHELL=/bin/sh. /lava-3964032/environment
    2024-03-25T04:02:01.241951  
    2024-03-25T04:02:01.342608  / # . /lava-3964032/environment/lava-3964032/bin/lava-test-runner /lava-3964032/1
    2024-03-25T04:02:01.343155  
    2024-03-25T04:02:01.387958  / # /lava-3964032/bin/lava-test-runner /lava-3964032/1
    2024-03-25T04:02:01.432926  + export 'TESTRUN_ID=1_bootrr' 
    ... (11 line(s) more)  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
sun7i-a20-cubieboard2        | arm    | lab-clabbe      | gcc-10   | multi_v7_defconfig           | 1          

  Details:     https://kernelci.org/test/plan/id/6600ea1ee3a8688f054c42ee

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: multi_v7_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20240325/arm/multi_v7_defconfig/gcc-10/lab-clabbe/baseline-sun7i-a20-cubieboard2.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240325/arm/multi_v7_defconfig/gcc-10/lab-clabbe/baseline-sun7i-a20-cubieboard2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230703.0/armel/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6600ea1ee3a8688f054c42f7
        failing since 297 days (last pass: next-20230530, first fail: next-20230601)

    2024-03-25T03:00:39.668181  + set +x[   20.584585] <LAVA_SIGNAL_ENDRUN 0_dmesg 463699_1.5.2.4.1>
    2024-03-25T03:00:39.668489  
    2024-03-25T03:00:39.776023  / # #
    2024-03-25T03:00:39.877631  export SHELL=/bin/sh
    2024-03-25T03:00:39.878202  #
    2024-03-25T03:00:39.979206  / # export SHELL=/bin/sh. /lava-463699/environment
    2024-03-25T03:00:39.979850  
    2024-03-25T03:00:40.081009  / # . /lava-463699/environment/lava-463699/bin/lava-test-runner /lava-463699/1
    2024-03-25T03:00:40.081930  
    2024-03-25T03:00:40.084561  / # /lava-463699/bin/lava-test-runner /lava-463699/1 
    ... (12 line(s) more)  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
sun7i-a20-cubieboard2        | arm    | lab-clabbe      | gcc-10   | multi_v7_defc...MB2_KERNEL=y | 1          

  Details:     https://kernelci.org/test/plan/id/6600f3018665d64dc34c435f

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20240325/arm/multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y/gcc-10/lab-clabbe/baseline-sun7i-a20-cubieboard2.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240325/arm/multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y/gcc-10/lab-clabbe/baseline-sun7i-a20-cubieboard2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230703.0/armel/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6600f3018665d64dc34c4368
        failing since 291 days (last pass: next-20230517, first fail: next-20230607)

    2024-03-25T03:43:43.322037  + set +x
    2024-03-25T03:43:43.323863  [   21.333040] <LAVA_SIGNAL_ENDRUN 0_dmesg 463720_1.5.2.4.1>
    2024-03-25T03:43:43.432037  / # #
    2024-03-25T03:43:43.533564  export SHELL=/bin/sh
    2024-03-25T03:43:43.534083  #
    2024-03-25T03:43:43.635077  / # export SHELL=/bin/sh. /lava-463720/environment
    2024-03-25T03:43:43.635592  
    2024-03-25T03:43:43.736584  / # . /lava-463720/environment/lava-463720/bin/lava-test-runner /lava-463720/1
    2024-03-25T03:43:43.737399  
    2024-03-25T03:43:43.740241  / # /lava-463720/bin/lava-test-runner /lava-463720/1 
    ... (12 line(s) more)  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
sun7i-a20-cubieboard2        | arm    | lab-clabbe      | gcc-10   | multi_v7_defc...CONFIG_SMP=n | 1          

  Details:     https://kernelci.org/test/plan/id/6600f74d1630f1e4214c43d3

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: multi_v7_defconfig+CONFIG_SMP=n
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20240325/arm/multi_v7_defconfig+CONFIG_SMP=n/gcc-10/lab-clabbe/baseline-sun7i-a20-cubieboard2.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240325/arm/multi_v7_defconfig+CONFIG_SMP=n/gcc-10/lab-clabbe/baseline-sun7i-a20-cubieboard2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230703.0/armel/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/6600f74d1630f1e4214c43dc
        failing since 291 days (last pass: next-20230525, first fail: next-20230607)

    2024-03-25T04:02:07.374223  + set +x
    2024-03-25T04:02:07.376012  [   24.303903] <LAVA_SIGNAL_ENDRUN 0_dmesg 463732_1.5.2.4.1>
    2024-03-25T04:02:07.484022  / # #
    2024-03-25T04:02:07.585538  export SHELL=/bin/sh
    2024-03-25T04:02:07.586055  #
    2024-03-25T04:02:07.687020  / # export SHELL=/bin/sh. /lava-463732/environment
    2024-03-25T04:02:07.687529  
    2024-03-25T04:02:07.788516  / # . /lava-463732/environment/lava-463732/bin/lava-test-runner /lava-463732/1
    2024-03-25T04:02:07.789335  
    2024-03-25T04:02:07.791895  / # /lava-463732/bin/lava-test-runner /lava-463732/1 
    ... (12 line(s) more)  

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
zynqmp-zcu102                | arm64  | lab-cip         | gcc-10   | defconfig+arm...ok+kselftest | 1          

  Details:     https://kernelci.org/test/plan/id/6600eb39c2ac72ff154c4305

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook+kselftest
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20240325/arm64/defconfig+arm64-chromebook+kselftest/gcc-10/lab-cip/baseline-zynqmp-zcu102.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240325/arm64/defconfig+arm64-chromebook+kselftest/gcc-10/lab-cip/baseline-zynqmp-zcu102.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230703.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6600eb39c2ac72ff154c4306
        new failure (last pass: next-20240320)