Subject: next/master baseline: 304 runs, 34 regressions (next-20240304)

From: "kernelci.org bot" <[email-masked]>
Date: Mon, 04 Mar 2024 02:33:08 -0800 (PST)

next/master baseline: 304 runs, 34 regressions (next-20240304)

Regressions Summary
-------------------

platform                     | arch   | lab           | compiler | defconfig                    | regressions
-----------------------------+--------+---------------+----------+------------------------------+------------
acer-R721T-grunt             | x86_64 | lab-collabora | gcc-10   | x86_64_defconfig+x86-board   | 1          
bcm2836-rpi-2-b              | arm    | lab-collabora | gcc-10   | bcm2835_defconfig            | 1          
hp-11A-G6-EE-grunt           | x86_64 | lab-collabora | gcc-10   | x86_64_defconfig+x86-board   | 1          
hp-14-db0003na-grunt         | x86_64 | lab-collabora | gcc-10   | x86_64_defconfig+x86-board   | 1          
kontron-kbox-a-230-ls        | arm64  | lab-kontron   | gcc-10   | defconfig+videodec           | 5          
kontron-kbox-a-230-ls        | arm64  | lab-kontron   | gcc-10   | defconfig+CON...OMIZE_BASE=y | 5          
kontron-sl28-var3-ads2       | arm64  | lab-kontron   | gcc-10   | defconfig+videodec           | 2          
kontron-sl28-var3-ads2       | arm64  | lab-kontron   | gcc-10   | defconfig+CON...OMIZE_BASE=y | 2          
meson-sm1-s90...libretech-cc | arm64  | lab-broonie   | gcc-10   | defconfig+CON...BIG_ENDIAN=y | 1          
meson-sm1-s90...libretech-cc | arm64  | lab-broonie   | gcc-10   | defconfig+CON..._64K_PAGES=y | 1          
mt8173-elm-hana              | arm64  | lab-collabora | gcc-10   | defconfig+arm...ook+videodec | 2          
mt8173-elm-hana              | arm64  | lab-collabora | gcc-10   | defconfig+arm64-chromebook   | 2          
mt8183-kukui-...uniper-sku16 | arm64  | lab-collabora | gcc-10   | defconfig+arm...ook+videodec | 1          
mt8183-kukui-...uniper-sku16 | arm64  | lab-collabora | gcc-10   | defconfig+arm64-chromebook   | 1          
mt8195-cherry-tomato-r2      | arm64  | lab-collabora | gcc-10   | defconfig+arm64-chromebook   | 1          
qemu_arm64-virt-gicv2-uefi   | arm64  | lab-broonie   | gcc-10   | defconfig+CON..._64K_PAGES=y | 1          
qemu_arm64-virt-gicv2-uefi   | arm64  | lab-collabora | gcc-10   | defconfig+CON..._64K_PAGES=y | 1          
qemu_arm64-virt-gicv3-uefi   | arm64  | lab-broonie   | gcc-10   | defconfig+CON..._64K_PAGES=y | 1          
qemu_arm64-virt-gicv3-uefi   | arm64  | lab-collabora | gcc-10   | defconfig+CON..._64K_PAGES=y | 1          
r8a7743-iwg20d-q7            | arm    | lab-cip       | gcc-10   | shmobile_defconfig           | 1          
r8a779m1-ulcb                | arm64  | lab-collabora | gcc-10   | defconfig+CON...OMIZE_BASE=y | 1          
sc7180-trogdo...zor-limozeen | arm64  | lab-collabora | gcc-10   | defconfig+arm64-chromebook   | 1          

  Details:  https://kernelci.org/test/job/next/branch/master/kernel/next-20240304/plan/baseline/

  Test:     baseline
  Tree:     next
  Branch:   master
  Describe: next-20240304
  URL:      https://git.kernel.org/pub/scm/linux/kernel/git/next/linux-next.git
  SHA:      67908bf6954b7635d33760ff6dfc189fc26ccc89 

Test Regressions
---------------- 

platform                     | arch   | lab           | compiler | defconfig                    | regressions
-----------------------------+--------+---------------+----------+------------------------------+------------
acer-R721T-grunt             | x86_64 | lab-collabora | gcc-10   | x86_64_defconfig+x86-board   | 1          

  Details:     https://kernelci.org/test/plan/id/65e569b1ac31a7bdfb63702f

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-board
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20240304/x86_64/x86_64_defconfig+x86-board/gcc-10/lab-collabora/baseline-acer-R721T-grunt.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240304/x86_64/x86_64_defconfig+x86-board/gcc-10/lab-collabora/baseline-acer-R721T-grunt.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/x86/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/65e569b1ac31a7bdfb637030
        failing since 4 days (last pass: next-20240226, first fail: next-20240228) 

platform                     | arch   | lab           | compiler | defconfig                    | regressions
-----------------------------+--------+---------------+----------+------------------------------+------------
bcm2836-rpi-2-b              | arm    | lab-collabora | gcc-10   | bcm2835_defconfig            | 1          

  Details:     https://kernelci.org/test/plan/id/65e56b0619916c590663706b

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: bcm2835_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20240304/arm/bcm2835_defconfig/gcc-10/lab-collabora/baseline-bcm2836-rpi-2-b.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240304/arm/bcm2835_defconfig/gcc-10/lab-collabora/baseline-bcm2836-rpi-2-b.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/65e56b0619916c590663706c
        failing since 273 days (last pass: next-20230601, first fail: next-20230605) 

platform                     | arch   | lab           | compiler | defconfig                    | regressions
-----------------------------+--------+---------------+----------+------------------------------+------------
hp-11A-G6-EE-grunt           | x86_64 | lab-collabora | gcc-10   | x86_64_defconfig+x86-board   | 1          

  Details:     https://kernelci.org/test/plan/id/65e569a4ac31a7bdfb637025

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-board
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20240304/x86_64/x86_64_defconfig+x86-board/gcc-10/lab-collabora/baseline-hp-11A-G6-EE-grunt.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240304/x86_64/x86_64_defconfig+x86-board/gcc-10/lab-collabora/baseline-hp-11A-G6-EE-grunt.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/x86/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/65e569a4ac31a7bdfb637026
        failing since 4 days (last pass: next-20240226, first fail: next-20240228) 

platform                     | arch   | lab           | compiler | defconfig                    | regressions
-----------------------------+--------+---------------+----------+------------------------------+------------
hp-14-db0003na-grunt         | x86_64 | lab-collabora | gcc-10   | x86_64_defconfig+x86-board   | 1          

  Details:     https://kernelci.org/test/plan/id/65e569a2ac31a7bdfb637017

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86-board
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20240304/x86_64/x86_64_defconfig+x86-board/gcc-10/lab-collabora/baseline-hp-14-db0003na-grunt.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240304/x86_64/x86_64_defconfig+x86-board/gcc-10/lab-collabora/baseline-hp-14-db0003na-grunt.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/x86/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/65e569a2ac31a7bdfb637018
        failing since 4 days (last pass: next-20240226, first fail: next-20240228) 

platform                     | arch   | lab           | compiler | defconfig                    | regressions
-----------------------------+--------+---------------+----------+------------------------------+------------
kontron-kbox-a-230-ls        | arm64  | lab-kontron   | gcc-10   | defconfig+videodec           | 5          

  Details:     https://kernelci.org/test/plan/id/65e563f26481603634637037

  Results:     90 PASS, 5 FAIL, 1 SKIP
  Full config: defconfig+videodec
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20240304/arm64/defconfig+videodec/gcc-10/lab-kontron/baseline-kontron-kbox-a-230-ls.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240304/arm64/defconfig+videodec/gcc-10/lab-kontron/baseline-kontron-kbox-a-230-ls.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/65e563f3648160363463703e
        failing since 82 days (last pass: next-20231207, first fail: next-20231212)

    2024-03-04T06:02:01.148785  <8>[   20.441826] <LAVA_SIGNAL_ENDRUN 0_dmesg 438467_1.5.2.4.1>
    2024-03-04T06:02:01.253899  / # #
    2024-03-04T06:02:01.355896  export SHELL=/bin/sh
    2024-03-04T06:02:01.356681  #
    2024-03-04T06:02:01.458112  / # export SHELL=/bin/sh. /lava-438467/environment
    2024-03-04T06:02:01.458879  
    2024-03-04T06:02:01.560310  / # . /lava-438467/environment/lava-438467/bin/lava-test-runner /lava-438467/1
    2024-03-04T06:02:01.561570  
    2024-03-04T06:02:01.580875  / # /lava-438467/bin/lava-test-runner /lava-438467/1
    2024-03-04T06:02:01.624822  + export 'TESTRUN_ID=1_bootrr' 
    ... (18 line(s) more)  

  * baseline.bootrr.fsl_enetc-enetc2-probed: https://kernelci.org/test/case/id/65e563f36481603634637042
        failing since 82 days (last pass: next-20231207, first fail: next-20231212)

    2024-03-04T06:02:03.731313  /lava-438467/1/../bin/lava-test-case
    2024-03-04T06:02:03.731791  <8>[   23.007237] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=fsl_enetc-enetc2-probed RESULT=fail>
    2024-03-04T06:02:03.732089  /lava-438467/1/../bin/lava-test-case   

  * baseline.bootrr.mscc_felix-probed: https://kernelci.org/test/case/id/65e563f36481603634637044
        failing since 82 days (last pass: next-20231207, first fail: next-20231212)

    2024-03-04T06:02:04.792011  /lava-438467/1/../bin/lava-test-case
    2024-03-04T06:02:04.792431  <8>[   24.045281] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=mscc_felix-probed RESULT=fail>
    2024-03-04T06:02:04.792740  /lava-438467/1/../bin/lava-test-case
    2024-03-04T06:02:04.793024  <8>[   24.062793] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=leds-gpio-driver-present RESULT=pass>   

  * baseline.bootrr.fsl_enetc-enetc0-probed: https://kernelci.org/test/case/id/65e563f36481603634637049
        failing since 82 days (last pass: next-20231207, first fail: next-20231212)

    2024-03-04T06:02:05.868012  /lava-438467/1/../bin/lava-test-case   

  * baseline.bootrr.fsl_enetc-enetc1-probed: https://kernelci.org/test/case/id/65e563f3648160363463704a
        failing since 82 days (last pass: next-20231207, first fail: next-20231212)

    2024-03-04T06:02:05.871180  <8>[   25.160665] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=fsl_enetc-enetc0-probed RESULT=fail>
    2024-03-04T06:02:06.925270  /lava-438467/1/../bin/lava-test-case   

platform                     | arch   | lab           | compiler | defconfig                    | regressions
-----------------------------+--------+---------------+----------+------------------------------+------------
kontron-kbox-a-230-ls        | arm64  | lab-kontron   | gcc-10   | defconfig+CON...OMIZE_BASE=y | 5          

  Details:     https://kernelci.org/test/plan/id/65e565bdf1db1e5f5f637016

  Results:     90 PASS, 5 FAIL, 1 SKIP
  Full config: defconfig+CONFIG_RANDOMIZE_BASE=y
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20240304/arm64/defconfig+CONFIG_RANDOMIZE_BASE=y/gcc-10/lab-kontron/baseline-kontron-kbox-a-230-ls.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240304/arm64/defconfig+CONFIG_RANDOMIZE_BASE=y/gcc-10/lab-kontron/baseline-kontron-kbox-a-230-ls.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/65e565bdf1db1e5f5f63701d
        failing since 81 days (last pass: next-20231208, first fail: next-20231213)

    2024-03-04T06:09:41.484918  / # #
    2024-03-04T06:09:41.585486  export SHELL=/bin/sh
    2024-03-04T06:09:41.585680  #
    2024-03-04T06:09:41.686129  / # export SHELL=/bin/sh. /lava-438485/environment
    2024-03-04T06:09:41.686367  
    2024-03-04T06:09:41.786826  / # . /lava-438485/environment/lava-438485/bin/lava-test-runner /lava-438485/1
    2024-03-04T06:09:41.787106  
    2024-03-04T06:09:41.799546  / # /lava-438485/bin/lava-test-runner /lava-438485/1
    2024-03-04T06:09:41.850067  + export 'TESTRUN_ID=1_bootrr'
    2024-03-04T06:09:41.850156  + <8>[   20.676037] <LAVA_SIGNAL_STARTRUN 1_bootrr 438485_1.5.2.4.5> 
    ... (14 line(s) more)  

  * baseline.bootrr.fsl_enetc-enetc2-probed: https://kernelci.org/test/case/id/65e565bdf1db1e5f5f637021
        failing since 81 days (last pass: next-20231208, first fail: next-20231213)

    2024-03-04T06:09:43.958368  /lava-438485/1/../bin/lava-test-case   

  * baseline.bootrr.mscc_felix-probed: https://kernelci.org/test/case/id/65e565bdf1db1e5f5f637023
        failing since 81 days (last pass: next-20231208, first fail: next-20231213)

    2024-03-04T06:09:45.020475  /lava-438485/1/../bin/lava-test-case
    2024-03-04T06:09:45.020614  <8>[   23.824409] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=mscc_felix-probed RESULT=fail>
    2024-03-04T06:09:45.020715  /lava-438485/1/../bin/lava-test-case
    2024-03-04T06:09:45.020800  <8>[   23.843453] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=leds-gpio-driver-present RESULT=pass>
    2024-03-04T06:09:45.020883  /lava-438485/1/../bin/lava-test-case
    2024-03-04T06:09:45.020964  <8>[   23.862858] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=leds-gpio-probed RESULT=pass>
    2024-03-04T06:09:45.021043  /lava-438485/1/../bin/lava-test-case   

  * baseline.bootrr.fsl_enetc-enetc0-probed: https://kernelci.org/test/case/id/65e565bdf1db1e5f5f637028
        failing since 81 days (last pass: next-20231208, first fail: next-20231213)

    2024-03-04T06:09:46.096588  /lava-438485/1/../bin/lava-test-case   

  * baseline.bootrr.fsl_enetc-enetc1-probed: https://kernelci.org/test/case/id/65e565bdf1db1e5f5f637029
        failing since 81 days (last pass: next-20231208, first fail: next-20231213)

    2024-03-04T06:09:46.099775  <8>[   24.940307] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=fsl_enetc-enetc0-probed RESULT=fail>
    2024-03-04T06:09:47.155851  /lava-438485/1/../bin/lava-test-case
    2024-03-04T06:09:47.156323  <8>[   25.962653] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=fsl_enetc-enetc1-probed RESULT=fail>
    2024-03-04T06:09:47.156689  /lava-438485/1/../bin/lava-test-case   

platform                     | arch   | lab           | compiler | defconfig                    | regressions
-----------------------------+--------+---------------+----------+------------------------------+------------
kontron-sl28-var3-ads2       | arm64  | lab-kontron   | gcc-10   | defconfig+videodec           | 2          

  Details:     https://kernelci.org/test/plan/id/65e563f10f10201c79637015

  Results:     101 PASS, 2 FAIL, 1 SKIP
  Full config: defconfig+videodec
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20240304/arm64/defconfig+videodec/gcc-10/lab-kontron/baseline-kontron-sl28-var3-ads2.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240304/arm64/defconfig+videodec/gcc-10/lab-kontron/baseline-kontron-sl28-var3-ads2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/65e563f10f10201c7963701c
        failing since 82 days (last pass: next-20231207, first fail: next-20231212)

    2024-03-04T06:02:14.128525  / # #
    2024-03-04T06:02:14.230489  export SHELL=/bin/sh
    2024-03-04T06:02:14.231298  #
    2024-03-04T06:02:14.332817  / # export SHELL=/bin/sh. /lava-438465/environment
    2024-03-04T06:02:14.333571  
    2024-03-04T06:02:14.435108  / # . /lava-438465/environment/lava-438465/bin/lava-test-runner /lava-438465/1
    2024-03-04T06:02:14.436321  
    2024-03-04T06:02:14.440254  / # /lava-438465/bin/lava-test-runner /lava-438465/1
    2024-03-04T06:02:14.509477  + export 'TESTRUN_ID=1_bootrr'
    2024-03-04T06:02:14.509960  + <8>[   20.975659] <LAVA_SIGNAL_STARTRUN 1_bootrr 438465_1.5.2.4.5> 
    ... (13 line(s) more)  

  * baseline.bootrr.fsl_enetc-enetc0-probed: https://kernelci.org/test/case/id/65e563f10f10201c7963702f
        failing since 82 days (last pass: next-20231207, first fail: next-20231212)

    2024-03-04T06:02:16.939312  /lava-438465/1/../bin/lava-test-case
    2024-03-04T06:02:16.939756  <8>[   23.395897] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=fsl_enetc-enetc0-probed RESULT=fail>
    2024-03-04T06:02:16.940052  /lava-438465/1/../bin/lava-test-case   

platform                     | arch   | lab           | compiler | defconfig                    | regressions
-----------------------------+--------+---------------+----------+------------------------------+------------
kontron-sl28-var3-ads2       | arm64  | lab-kontron   | gcc-10   | defconfig+CON...OMIZE_BASE=y | 2          

  Details:     https://kernelci.org/test/plan/id/65e565f9e04a516c8d637038

  Results:     101 PASS, 2 FAIL, 1 SKIP
  Full config: defconfig+CONFIG_RANDOMIZE_BASE=y
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20240304/arm64/defconfig+CONFIG_RANDOMIZE_BASE=y/gcc-10/lab-kontron/baseline-kontron-sl28-var3-ads2.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240304/arm64/defconfig+CONFIG_RANDOMIZE_BASE=y/gcc-10/lab-kontron/baseline-kontron-sl28-var3-ads2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/65e565fae04a516c8d63703f
        failing since 81 days (last pass: next-20231208, first fail: next-20231213)

    2024-03-04T06:10:45.979189  / # #
    2024-03-04T06:10:46.080067  export SHELL=/bin/sh
    2024-03-04T06:10:46.080339  #
    2024-03-04T06:10:46.180906  / # export SHELL=/bin/sh. /lava-438483/environment
    2024-03-04T06:10:46.181330  
    2024-03-04T06:10:46.281968  / # . /lava-438483/environment/lava-438483/bin/lava-test-runner /lava-438483/1
    2024-03-04T06:10:46.282381  
    2024-03-04T06:10:46.292703  / # /lava-438483/bin/lava-test-runner /lava-438483/1
    2024-03-04T06:10:46.337949  + export 'TESTRUN_ID=1_bootrr'
    2024-03-04T06:10:46.353581  + <8>[   20.960023] <LAVA_SIGNAL_STARTRUN 1_bootrr 438483_1.5.2.4.5> 
    ... (13 line(s) more)  

  * baseline.bootrr.fsl_enetc-enetc0-probed: https://kernelci.org/test/case/id/65e565fae04a516c8d637052
        failing since 81 days (last pass: next-20231208, first fail: next-20231213)

    2024-03-04T06:10:48.795278  /lava-438483/1/../bin/lava-test-case
    2024-03-04T06:10:48.795607  <8>[   23.386139] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=fsl_enetc-enetc0-probed RESULT=fail>
    2024-03-04T06:10:48.795913  /lava-438483/1/../bin/lava-test-case
    2024-03-04T06:10:48.796150  <8>[   23.404112] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=fsl_enetc_mdio-driver-present RESULT=pass>
    2024-03-04T06:10:48.796341  /lava-438483/1/../bin/lava-test-case
    2024-03-04T06:10:48.796526  <8>[   23.423736] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=fsl_enetc_mdio-probed RESULT=pass>
    2024-03-04T06:10:48.796709  /lava-438483/1/../bin/lava-test-case   

platform                     | arch   | lab           | compiler | defconfig                    | regressions
-----------------------------+--------+---------------+----------+------------------------------+------------
meson-sm1-s90...libretech-cc | arm64  | lab-broonie   | gcc-10   | defconfig+CON...BIG_ENDIAN=y | 1          

  Details:     https://kernelci.org/test/plan/id/65e565dea1992cf202637052

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+CONFIG_CPU_BIG_ENDIAN=y
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20240304/arm64/defconfig+CONFIG_CPU_BIG_ENDIAN=y/gcc-10/lab-broonie/baseline-meson-sm1-s905d3-libretech-cc.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240304/arm64/defconfig+CONFIG_CPU_BIG_ENDIAN=y/gcc-10/lab-broonie/baseline-meson-sm1-s905d3-libretech-cc.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64be/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/65e565dea1992cf202637053
        new failure (last pass: next-20240226) 

platform                     | arch   | lab           | compiler | defconfig                    | regressions
-----------------------------+--------+---------------+----------+------------------------------+------------
meson-sm1-s90...libretech-cc | arm64  | lab-broonie   | gcc-10   | defconfig+CON..._64K_PAGES=y | 1          

  Details:     https://kernelci.org/test/plan/id/65e567330e830447d8637057

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+CONFIG_ARM64_64K_PAGES=y
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20240304/arm64/defconfig+CONFIG_ARM64_64K_PAGES=y/gcc-10/lab-broonie/baseline-meson-sm1-s905d3-libretech-cc.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240304/arm64/defconfig+CONFIG_ARM64_64K_PAGES=y/gcc-10/lab-broonie/baseline-meson-sm1-s905d3-libretech-cc.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/65e567330e830447d8637058
        new failure (last pass: next-20240223) 

platform                     | arch   | lab           | compiler | defconfig                    | regressions
-----------------------------+--------+---------------+----------+------------------------------+------------
mt8173-elm-hana              | arm64  | lab-collabora | gcc-10   | defconfig+arm...ook+videodec | 2          

  Details:     https://kernelci.org/test/plan/id/65e570455053a4cda963703d

  Results:     27 PASS, 2 FAIL, 1 SKIP
  Full config: defconfig+arm64-chromebook+videodec
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20240304/arm64/defconfig+arm64-chromebook+videodec/gcc-10/lab-collabora/baseline-mt8173-elm-hana.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240304/arm64/defconfig+arm64-chromebook+videodec/gcc-10/lab-collabora/baseline-mt8173-elm-hana.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz 

  * baseline.bootrr.armv8-pmu-a72-probed: https://kernelci.org/test/case/id/65e570455053a4cda9637054
        failing since 17 days (last pass: next-20240213, first fail: next-20240216)

    2024-03-04T06:54:42.681043  /lava-12931933/1/../bin/lava-test-case

    2024-03-04T06:54:42.689445  <8>[   31.088100] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=armv8-pmu-a72-probed RESULT=fail>

  * baseline.bootrr.armv8-pmu-a53-probed: https://kernelci.org/test/case/id/65e570455053a4cda9637055
        failing since 17 days (last pass: next-20240213, first fail: next-20240216)

    2024-03-04T06:54:41.651272  /lava-12931933/1/../bin/lava-test-case

    2024-03-04T06:54:41.662491  <8>[   30.060615] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=armv8-pmu-a53-probed RESULT=fail>

platform                     | arch   | lab           | compiler | defconfig                    | regressions
-----------------------------+--------+---------------+----------+------------------------------+------------
mt8173-elm-hana              | arm64  | lab-collabora | gcc-10   | defconfig+arm64-chromebook   | 2          

  Details:     https://kernelci.org/test/plan/id/65e57324d4f8b3d10263707d

  Results:     27 PASS, 2 FAIL, 1 SKIP
  Full config: defconfig+arm64-chromebook
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20240304/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-mt8173-elm-hana.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240304/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-mt8173-elm-hana.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz 

  * baseline.bootrr.armv8-pmu-a72-probed: https://kernelci.org/test/case/id/65e57324d4f8b3d102637094
        failing since 17 days (last pass: next-20240214, first fail: next-20240215)

    2024-03-04T07:06:56.674278  <8>[   30.538337] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=armv8-pmu-a53-probed RESULT=fail>

    2024-03-04T07:06:57.693968  /lava-12932032/1/../bin/lava-test-case

    2024-03-04T07:06:57.702756  <8>[   31.566818] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=armv8-pmu-a72-probed RESULT=fail>

  * baseline.bootrr.armv8-pmu-a53-probed: https://kernelci.org/test/case/id/65e57324d4f8b3d102637095
        failing since 17 days (last pass: next-20240214, first fail: next-20240215)

    2024-03-04T07:06:56.664203  /lava-12932032/1/../bin/lava-test-case

platform                     | arch   | lab           | compiler | defconfig                    | regressions
-----------------------------+--------+---------------+----------+------------------------------+------------
mt8183-kukui-...uniper-sku16 | arm64  | lab-collabora | gcc-10   | defconfig+arm...ook+videodec | 1          

  Details:     https://kernelci.org/test/plan/id/65e57135c1158e4020637018

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook+videodec
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20240304/arm64/defconfig+arm64-chromebook+videodec/gcc-10/lab-collabora/baseline-mt8183-kukui-jacuzzi-juniper-sku16.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240304/arm64/defconfig+arm64-chromebook+videodec/gcc-10/lab-collabora/baseline-mt8183-kukui-jacuzzi-juniper-sku16.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/65e57135c1158e4020637019
        new failure (last pass: next-20240216) 

platform                     | arch   | lab           | compiler | defconfig                    | regressions
-----------------------------+--------+---------------+----------+------------------------------+------------
mt8183-kukui-...uniper-sku16 | arm64  | lab-collabora | gcc-10   | defconfig+arm64-chromebook   | 1          

  Details:     https://kernelci.org/test/plan/id/65e57392c0baf172f8637132

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20240304/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-mt8183-kukui-jacuzzi-juniper-sku16.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240304/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-mt8183-kukui-jacuzzi-juniper-sku16.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/65e57392c0baf172f8637133
        new failure (last pass: next-20240215) 

platform                     | arch   | lab           | compiler | defconfig                    | regressions
-----------------------------+--------+---------------+----------+------------------------------+------------
mt8195-cherry-tomato-r2      | arm64  | lab-collabora | gcc-10   | defconfig+arm64-chromebook   | 1          

  Details:     https://kernelci.org/test/plan/id/65e572a2fde2abcf4e637059

  Results:     3 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20240304/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-mt8195-cherry-tomato-r2.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240304/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-mt8195-cherry-tomato-r2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/65e572a2fde2abcf4e63705e
        failing since 17 days (last pass: next-20240214, first fail: next-20240215)

    2024-03-04T07:04:48.165539  / # <6>[   17

    2024-03-04T07:04:48.165876  .031030] mtk-mdp3 14f25000.dma-controller: Adding to iommu group 2

    2024-03-04T07:04:48.165950  <6>[   17.038398] mediatek-disp-ethdr 1c114000.hdr-engine: Adding to iommu group 3

    2024-03-04T07:04:48.166014  <6>[   17.046107] mediatek-mdp-rdma 1c104000.dma-controller: Adding to iommu group 3

    2024-03-04T07:04:48.166073  <6>[   17.053871] mediatek-mdp-rdma 1c105000.dma-controller: Adding to iommu group 3

    2024-03-04T07:04:48.166129  <6>[   17.061616] mediatek-mdp-rdma 1c106000.dma-controller: Adding to iommu group 3

    2024-03-04T07:04:48.166184  <6>[   17.069338] mediatek-mdp-rdma 1c107000.dma-controller: Adding to iommu group 3

    2024-03-04T07:04:48.166466  <6>[   17.077055] mediatek-mdp-rdma 1c108000.dma-controller: Adding to iommu group 3

    2024-03-04T07:04:48.208858  <6>[   17.084760] mediatek-mdp-rdma 1c109000.dma-controller: Adding to iommu group 3

    2024-03-04T07:04:48.208949  <6>[   17.092470] mediatek-mdp-rdma 1c10a000.dma-controller: Adding to iommu group 3
 
    ... (81 line(s) more)  

platform                     | arch   | lab           | compiler | defconfig                    | regressions
-----------------------------+--------+---------------+----------+------------------------------+------------
qemu_arm64-virt-gicv2-uefi   | arm64  | lab-broonie   | gcc-10   | defconfig+CON..._64K_PAGES=y | 1          

  Details:     https://kernelci.org/test/plan/id/65e5653f427569b358637046

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+CONFIG_ARM64_64K_PAGES=y
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20240304/arm64/defconfig+CONFIG_ARM64_64K_PAGES=y/gcc-10/lab-broonie/baseline-qemu_arm64-virt-gicv2-uefi.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240304/arm64/defconfig+CONFIG_ARM64_64K_PAGES=y/gcc-10/lab-broonie/baseline-qemu_arm64-virt-gicv2-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/65e5653f427569b358637047
        new failure (last pass: next-20240226) 

platform                     | arch   | lab           | compiler | defconfig                    | regressions
-----------------------------+--------+---------------+----------+------------------------------+------------
qemu_arm64-virt-gicv2-uefi   | arm64  | lab-collabora | gcc-10   | defconfig+CON..._64K_PAGES=y | 1          

  Details:     https://kernelci.org/test/plan/id/65e56509c8c8e0507b63704a

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+CONFIG_ARM64_64K_PAGES=y
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20240304/arm64/defconfig+CONFIG_ARM64_64K_PAGES=y/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv2-uefi.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240304/arm64/defconfig+CONFIG_ARM64_64K_PAGES=y/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv2-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/65e56509c8c8e0507b63704b
        new failure (last pass: next-20240226) 

platform                     | arch   | lab           | compiler | defconfig                    | regressions
-----------------------------+--------+---------------+----------+------------------------------+------------
qemu_arm64-virt-gicv3-uefi   | arm64  | lab-broonie   | gcc-10   | defconfig+CON..._64K_PAGES=y | 1          

  Details:     https://kernelci.org/test/plan/id/65e565146c03d24f3563702a

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+CONFIG_ARM64_64K_PAGES=y
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20240304/arm64/defconfig+CONFIG_ARM64_64K_PAGES=y/gcc-10/lab-broonie/baseline-qemu_arm64-virt-gicv3-uefi.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240304/arm64/defconfig+CONFIG_ARM64_64K_PAGES=y/gcc-10/lab-broonie/baseline-qemu_arm64-virt-gicv3-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/65e565146c03d24f3563702b
        new failure (last pass: next-20240226) 

platform                     | arch   | lab           | compiler | defconfig                    | regressions
-----------------------------+--------+---------------+----------+------------------------------+------------
qemu_arm64-virt-gicv3-uefi   | arm64  | lab-collabora | gcc-10   | defconfig+CON..._64K_PAGES=y | 1          

  Details:     https://kernelci.org/test/plan/id/65e564e3c674c799b663703d

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+CONFIG_ARM64_64K_PAGES=y
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20240304/arm64/defconfig+CONFIG_ARM64_64K_PAGES=y/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv3-uefi.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240304/arm64/defconfig+CONFIG_ARM64_64K_PAGES=y/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv3-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/65e564e3c674c799b663703e
        new failure (last pass: next-20240226) 

platform                     | arch   | lab           | compiler | defconfig                    | regressions
-----------------------------+--------+---------------+----------+------------------------------+------------
r8a7743-iwg20d-q7            | arm    | lab-cip       | gcc-10   | shmobile_defconfig           | 1          

  Details:     https://kernelci.org/test/plan/id/65e565f9a1992cf202637092

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: shmobile_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20240304/arm/shmobile_defconfig/gcc-10/lab-cip/baseline-r8a7743-iwg20d-q7.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240304/arm/shmobile_defconfig/gcc-10/lab-cip/baseline-r8a7743-iwg20d-q7.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/65e565f9a1992cf202637093
        new failure (last pass: next-20240301) 

platform                     | arch   | lab           | compiler | defconfig                    | regressions
-----------------------------+--------+---------------+----------+------------------------------+------------
r8a779m1-ulcb                | arm64  | lab-collabora | gcc-10   | defconfig+CON...OMIZE_BASE=y | 1          

  Details:     https://kernelci.org/test/plan/id/65e57133c1158e4020637015

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+CONFIG_RANDOMIZE_BASE=y
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20240304/arm64/defconfig+CONFIG_RANDOMIZE_BASE=y/gcc-10/lab-collabora/baseline-r8a779m1-ulcb.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240304/arm64/defconfig+CONFIG_RANDOMIZE_BASE=y/gcc-10/lab-collabora/baseline-r8a779m1-ulcb.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/65e57133c1158e4020637016
        new failure (last pass: next-20240221) 

platform                     | arch   | lab           | compiler | defconfig                    | regressions
-----------------------------+--------+---------------+----------+------------------------------+------------
sc7180-trogdo...zor-limozeen | arm64  | lab-collabora | gcc-10   | defconfig+arm64-chromebook   | 1          

  Details:     https://kernelci.org/test/plan/id/65e57392799d5b10b5637014

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20240304/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-sc7180-trogdor-lazor-limozeen.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20240304/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-sc7180-trogdor-lazor-limozeen.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/65e57392799d5b10b5637015
        new failure (last pass: next-20240215)