Subject: next/master baseline: 499 runs, 21 regressions (next-20230106)

From: "kernelci.org bot" <[email-masked]>
Date: Thu, 05 Jan 2023 23:44:59 -0800 (PST)

next/master baseline: 499 runs, 21 regressions (next-20230106)

Regressions Summary
-------------------

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
am57xx-beagle-x15            | arm   | lab-linaro-lkft | gcc-10   | multi_v7_defc...CONFIG_SMP=n | 1          
bcm2835-rpi-b-rev2           | arm   | lab-broonie     | gcc-10   | bcm2835_defconfig            | 1          
fsl-ls1088a-rdb              | arm64 | lab-nxp         | clang-16 | defconfig+CON..._64K_PAGES=y | 1          
fsl-ls1088a-rdb              | arm64 | lab-nxp         | clang-16 | defconfig                    | 1          
imx6dl-udoo                  | arm   | lab-broonie     | gcc-10   | imx_v6_v7_defconfig          | 1          
imx6q-udoo                   | arm   | lab-broonie     | gcc-10   | imx_v6_v7_defconfig          | 1          
imx8mp-evk                   | arm64 | lab-nxp         | clang-16 | defconfig+CON..._64K_PAGES=y | 1          
imx8mp-evk                   | arm64 | lab-nxp         | clang-16 | defconfig                    | 1          
imx8mp-evk                   | arm64 | lab-nxp         | gcc-10   | defconfig                    | 1          
imx8mp-evk                   | arm64 | lab-nxp         | gcc-10   | defconfig+CON...OMIZE_BASE=y | 1          
imx8mp-evk                   | arm64 | lab-nxp         | gcc-10   | defconfig+CON..._64K_PAGES=y | 1          
imx8mp-evk                   | arm64 | lab-nxp         | gcc-10   | defconfig+ima                | 1          
kontron-pitx-imx8m           | arm64 | lab-kontron     | clang-16 | defconfig+CON..._64K_PAGES=y | 1          
kontron-pitx-imx8m           | arm64 | lab-kontron     | gcc-10   | defconfig+CON..._64K_PAGES=y | 1          
meson-gxl-s905x-libretech-cc | arm64 | lab-broonie     | clang-16 | defconfig                    | 1          
meson-gxl-s905x-libretech-cc | arm64 | lab-broonie     | gcc-10   | defconfig+ima                | 2          
mt8192-asurada-spherion-r0   | arm64 | lab-collabora   | clang-13 | cros://chrome...4-chromebook | 1          
ox820-clouden...lug-series-3 | arm   | lab-baylibre    | gcc-10   | oxnas_v6_defconfig           | 1          
qemu_mips-malta              | mips  | lab-collabora   | gcc-10   | malta_defconfig              | 1          
r8a7743-iwg20d-q7            | arm   | lab-cip         | gcc-10   | shmobile_defconfig           | 1          

  Details:  https://kernelci.org/test/job/next/branch/master/kernel/next-20230106/plan/baseline/

  Test:     baseline
  Tree:     next
  Branch:   master
  Describe: next-20230106
  URL:      https://git.kernel.org/pub/scm/linux/kernel/git/next/linux-next.git
  SHA:      469a89fd3bb73bb2eea628da2b3e0f695f80b7ce 

Test Regressions
---------------- 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
am57xx-beagle-x15            | arm   | lab-linaro-lkft | gcc-10   | multi_v7_defc...CONFIG_SMP=n | 1          

  Details:     https://kernelci.org/test/plan/id/63b7b628651b947b4a4eee20

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_SMP=n
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230106/arm/multi_v7_defconfig+CONFIG_SMP=n/gcc-10/lab-linaro-lkft/baseline-am57xx-beagle-x15.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230106/arm/multi_v7_defconfig+CONFIG_SMP=n/gcc-10/lab-linaro-lkft/baseline-am57xx-beagle-x15.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221230.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/63b7b629651b947b4a4eee21
        failing since 110 days (last pass: next-20220915, first fail: next-20220916) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
bcm2835-rpi-b-rev2           | arm   | lab-broonie     | gcc-10   | bcm2835_defconfig            | 1          

  Details:     https://kernelci.org/test/plan/id/63b79b7d4e8ba317334eee33

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: bcm2835_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230106/arm/bcm2835_defconfig/gcc-10/lab-broonie/baseline-bcm2835-rpi-b-rev2.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230106/arm/bcm2835_defconfig/gcc-10/lab-broonie/baseline-bcm2835-rpi-b-rev2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221230.0/armel/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/63b79b7d4e8ba317334eee38
        failing since 0 day (last pass: next-20221017, first fail: next-20230105)

    2023-01-06T03:54:20.964846  + set +x
    2023-01-06T03:54:20.968031  <8>[   17.467627] <LAVA_SIGNAL_ENDRUN 0_dmesg 57971_1.5.2.4.1>
    2023-01-06T03:54:21.080520  / # #
    2023-01-06T03:54:21.185090  export SHELL=/bin/sh
    2023-01-06T03:54:21.186180  #
    2023-01-06T03:54:21.288498  / # export SHELL=/bin/sh. /lava-57971/environment
    2023-01-06T03:54:21.289203  
    2023-01-06T03:54:21.391423  / # . /lava-57971/environment/lava-57971/bin/lava-test-runner /lava-57971/1
    2023-01-06T03:54:21.392641  
    2023-01-06T03:54:21.399202  / # /lava-57971/bin/lava-test-runner /lava-57971/1 
    ... (14 line(s) more)  

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
fsl-ls1088a-rdb              | arm64 | lab-nxp         | clang-16 | defconfig+CON..._64K_PAGES=y | 1          

  Details:     https://kernelci.org/test/plan/id/63b7a156021ba442a44eeeca

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+CONFIG_ARM64_64K_PAGES=y
  Compiler:    clang-16 (Debian clang version 16.0.0 (++20230102071821+31000211e011-1~exp1~20230102071919.518))
  Plain log:   https://storage.kernelci.org//next/master/next-20230106/arm64/defconfig+CONFIG_ARM64_64K_PAGES=y/clang-16/lab-nxp/baseline-fsl-ls1088a-rdb.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230106/arm64/defconfig+CONFIG_ARM64_64K_PAGES=y/clang-16/lab-nxp/baseline-fsl-ls1088a-rdb.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221230.0/arm64/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/63b7a156021ba442a44eeecf
        new failure (last pass: next-20221125)

    2023-01-06T04:19:23.914132  [   21.430353] <LAVA_SIGNAL_ENDRUN 0_dmesg 1130309_1.5.2.4.1>
    2023-01-06T04:19:24.020340  / # #
    2023-01-06T04:19:24.121651  export SHELL=/bin/sh
    2023-01-06T04:19:24.121999  #
    2023-01-06T04:19:24.222962  / # export SHELL=/bin/sh. /lava-1130309/environment
    2023-01-06T04:19:24.223324  
    2023-01-06T04:19:24.324374  / # . /lava-1130309/environment/lava-1130309/bin/lava-test-runner /lava-1130309/1
    2023-01-06T04:19:24.324885  
    2023-01-06T04:19:24.326767  / # /lava-1130309/bin/lava-test-runner /lava-1130309/1
    2023-01-06T04:19:24.351606  + export 'TESTRUN_ID=1_bootrr' 
    ... (11 line(s) more)  

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
fsl-ls1088a-rdb              | arm64 | lab-nxp         | clang-16 | defconfig                    | 1          

  Details:     https://kernelci.org/test/plan/id/63b7a26124766d89c24eee19

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig
  Compiler:    clang-16 (Debian clang version 16.0.0 (++20230102071821+31000211e011-1~exp1~20230102071919.518))
  Plain log:   https://storage.kernelci.org//next/master/next-20230106/arm64/defconfig/clang-16/lab-nxp/baseline-fsl-ls1088a-rdb.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230106/arm64/defconfig/clang-16/lab-nxp/baseline-fsl-ls1088a-rdb.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221230.0/arm64/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/63b7a26124766d89c24eee1e
        new failure (last pass: next-20221124)

    2023-01-06T04:22:13.582466  [   23.277730] <LAVA_SIGNAL_ENDRUN 0_dmesg 1130310_1.5.2.4.1>
    2023-01-06T04:22:13.690322  / # #
    2023-01-06T04:22:13.791993  export SHELL=/bin/sh
    2023-01-06T04:22:13.792406  #
    2023-01-06T04:22:13.893555  / # export SHELL=/bin/sh. /lava-1130310/environment
    2023-01-06T04:22:13.894004  
    2023-01-06T04:22:13.995227  / # . /lava-1130310/environment/lava-1130310/bin/lava-test-runner /lava-1130310/1
    2023-01-06T04:22:13.996095  
    2023-01-06T04:22:13.998018  / # /lava-1130310/bin/lava-test-runner /lava-1130310/1
    2023-01-06T04:22:14.018034  + export 'TESTRUN_ID=1_bootrr' 
    ... (11 line(s) more)  

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
imx6dl-udoo                  | arm   | lab-broonie     | gcc-10   | imx_v6_v7_defconfig          | 1          

  Details:     https://kernelci.org/test/plan/id/63b7a06c15ad74afd84eee72

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: imx_v6_v7_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230106/arm/imx_v6_v7_defconfig/gcc-10/lab-broonie/baseline-imx6dl-udoo.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230106/arm/imx_v6_v7_defconfig/gcc-10/lab-broonie/baseline-imx6dl-udoo.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221230.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/63b7a06c15ad74afd84eee73
        failing since 209 days (last pass: next-20220607, first fail: next-20220610) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
imx6q-udoo                   | arm   | lab-broonie     | gcc-10   | imx_v6_v7_defconfig          | 1          

  Details:     https://kernelci.org/test/plan/id/63b79ff29ef9f8610e4eee24

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: imx_v6_v7_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230106/arm/imx_v6_v7_defconfig/gcc-10/lab-broonie/baseline-imx6q-udoo.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230106/arm/imx_v6_v7_defconfig/gcc-10/lab-broonie/baseline-imx6q-udoo.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221230.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/63b79ff29ef9f8610e4eee25
        failing since 120 days (last pass: next-20220831, first fail: next-20220907) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
imx8mp-evk                   | arm64 | lab-nxp         | clang-16 | defconfig+CON..._64K_PAGES=y | 1          

  Details:     https://kernelci.org/test/plan/id/63b7a25c3c1a7dba994eee38

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+CONFIG_ARM64_64K_PAGES=y
  Compiler:    clang-16 (Debian clang version 16.0.0 (++20230102071821+31000211e011-1~exp1~20230102071919.518))
  Plain log:   https://storage.kernelci.org//next/master/next-20230106/arm64/defconfig+CONFIG_ARM64_64K_PAGES=y/clang-16/lab-nxp/baseline-imx8mp-evk.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230106/arm64/defconfig+CONFIG_ARM64_64K_PAGES=y/clang-16/lab-nxp/baseline-imx8mp-evk.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221230.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/63b7a25c3c1a7dba994eee39
        new failure (last pass: next-20221125) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
imx8mp-evk                   | arm64 | lab-nxp         | clang-16 | defconfig                    | 1          

  Details:     https://kernelci.org/test/plan/id/63b7a3eba2afc4ad4a4eeee0

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig
  Compiler:    clang-16 (Debian clang version 16.0.0 (++20230102071821+31000211e011-1~exp1~20230102071919.518))
  Plain log:   https://storage.kernelci.org//next/master/next-20230106/arm64/defconfig/clang-16/lab-nxp/baseline-imx8mp-evk.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230106/arm64/defconfig/clang-16/lab-nxp/baseline-imx8mp-evk.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221230.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/63b7a3eba2afc4ad4a4eeee1
        failing since 0 day (last pass: next-20221124, first fail: next-20230105) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
imx8mp-evk                   | arm64 | lab-nxp         | gcc-10   | defconfig                    | 1          

  Details:     https://kernelci.org/test/plan/id/63b79e95f9a786a87b4eee32

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230106/arm64/defconfig/gcc-10/lab-nxp/baseline-imx8mp-evk.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230106/arm64/defconfig/gcc-10/lab-nxp/baseline-imx8mp-evk.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221230.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/63b79e95f9a786a87b4eee33
        failing since 0 day (last pass: next-20221125, first fail: next-20230105) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
imx8mp-evk                   | arm64 | lab-nxp         | gcc-10   | defconfig+CON...OMIZE_BASE=y | 1          

  Details:     https://kernelci.org/test/plan/id/63b7a09e0c01d07f934eee19

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+CONFIG_RANDOMIZE_BASE=y
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230106/arm64/defconfig+CONFIG_RANDOMIZE_BASE=y/gcc-10/lab-nxp/baseline-imx8mp-evk.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230106/arm64/defconfig+CONFIG_RANDOMIZE_BASE=y/gcc-10/lab-nxp/baseline-imx8mp-evk.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221230.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/63b7a09e0c01d07f934eee1a
        failing since 0 day (last pass: next-20221226, first fail: next-20230105) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
imx8mp-evk                   | arm64 | lab-nxp         | gcc-10   | defconfig+CON..._64K_PAGES=y | 1          

  Details:     https://kernelci.org/test/plan/id/63b7a59b784a217dca4eeead

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+CONFIG_ARM64_64K_PAGES=y
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230106/arm64/defconfig+CONFIG_ARM64_64K_PAGES=y/gcc-10/lab-nxp/baseline-imx8mp-evk.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230106/arm64/defconfig+CONFIG_ARM64_64K_PAGES=y/gcc-10/lab-nxp/baseline-imx8mp-evk.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221230.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/63b7a59b784a217dca4eeeae
        failing since 0 day (last pass: next-20221226, first fail: next-20230105) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
imx8mp-evk                   | arm64 | lab-nxp         | gcc-10   | defconfig+ima                | 1          

  Details:     https://kernelci.org/test/plan/id/63b7a7e398a4a903c24eee2a

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+ima
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230106/arm64/defconfig+ima/gcc-10/lab-nxp/baseline-imx8mp-evk.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230106/arm64/defconfig+ima/gcc-10/lab-nxp/baseline-imx8mp-evk.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221230.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/63b7a7e398a4a903c24eee2b
        failing since 0 day (last pass: next-20221226, first fail: next-20230105) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
kontron-pitx-imx8m           | arm64 | lab-kontron     | clang-16 | defconfig+CON..._64K_PAGES=y | 1          

  Details:     https://kernelci.org/test/plan/id/63b7a174b568fb33924eee33

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+CONFIG_ARM64_64K_PAGES=y
  Compiler:    clang-16 (Debian clang version 16.0.0 (++20230102071821+31000211e011-1~exp1~20230102071919.518))
  Plain log:   https://storage.kernelci.org//next/master/next-20230106/arm64/defconfig+CONFIG_ARM64_64K_PAGES=y/clang-16/lab-kontron/baseline-kontron-pitx-imx8m.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230106/arm64/defconfig+CONFIG_ARM64_64K_PAGES=y/clang-16/lab-kontron/baseline-kontron-pitx-imx8m.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221230.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/63b7a174b568fb33924eee34
        failing since 65 days (last pass: next-20221028, first fail: next-20221101) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
kontron-pitx-imx8m           | arm64 | lab-kontron     | gcc-10   | defconfig+CON..._64K_PAGES=y | 1          

  Details:     https://kernelci.org/test/plan/id/63b7a585784a217dca4eee3b

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+CONFIG_ARM64_64K_PAGES=y
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230106/arm64/defconfig+CONFIG_ARM64_64K_PAGES=y/gcc-10/lab-kontron/baseline-kontron-pitx-imx8m.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230106/arm64/defconfig+CONFIG_ARM64_64K_PAGES=y/gcc-10/lab-kontron/baseline-kontron-pitx-imx8m.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221230.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/63b7a585784a217dca4eee3c
        failing since 57 days (last pass: next-20221107, first fail: next-20221109) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
meson-gxl-s905x-libretech-cc | arm64 | lab-broonie     | clang-16 | defconfig                    | 1          

  Details:     https://kernelci.org/test/plan/id/63b7a185743f0937d94eeebf

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig
  Compiler:    clang-16 (Debian clang version 16.0.0 (++20230102071821+31000211e011-1~exp1~20230102071919.518))
  Plain log:   https://storage.kernelci.org//next/master/next-20230106/arm64/defconfig/clang-16/lab-broonie/baseline-meson-gxl-s905x-libretech-cc.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230106/arm64/defconfig/clang-16/lab-broonie/baseline-meson-gxl-s905x-libretech-cc.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221230.0/arm64/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/63b7a185743f0937d94eeec4
        new failure (last pass: next-20230105)

    2023-01-06T04:20:05.983479  <8>[   18.406216] <LAVA_SIGNAL_ENDRUN 0_dmesg 58209_1.5.2.4.1>
    2023-01-06T04:20:06.092546  / # #
    2023-01-06T04:20:06.195566  export SHELL=/bin/sh
    2023-01-06T04:20:06.196475  #
    2023-01-06T04:20:06.298530  / # export SHELL=/bin/sh. /lava-58209/environment
    2023-01-06T04:20:06.299401  
    2023-01-06T04:20:06.401534  / # . /lava-58209/environment/lava-58209/bin/lava-test-runner /lava-58209/1
    2023-01-06T04:20:06.402864  
    2023-01-06T04:20:06.407037  / # /lava-58209/bin/lava-test-runner /lava-58209/1
    2023-01-06T04:20:06.445444  + export 'TESTRUN_ID=1_bootrr' 
    ... (12 line(s) more)  

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
meson-gxl-s905x-libretech-cc | arm64 | lab-broonie     | gcc-10   | defconfig+ima                | 2          

  Details:     https://kernelci.org/test/plan/id/63b7a65faff2f094ec4eee19

  Results:     4 PASS, 2 FAIL, 1 SKIP
  Full config: defconfig+ima
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230106/arm64/defconfig+ima/gcc-10/lab-broonie/baseline-meson-gxl-s905x-libretech-cc.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230106/arm64/defconfig+ima/gcc-10/lab-broonie/baseline-meson-gxl-s905x-libretech-cc.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221230.0/arm64/rootfs.cpio.gz 

  * baseline.dmesg.emerg: https://kernelci.org/test/case/id/63b7a65faff2f094ec4eee20
        new failure (last pass: next-20230105)
        2 lines

    2023-01-06T04:40:51.589373  :alert :   ESR = 0x0000000096000004
    2023-01-06T04:40:51.594894  kern  :alert :   EC = 0x25: DABT (current EL), IL = 32 bits
    2023-01-06T04:40:51.600400  kern  :alert :   SET = 0, FnV = 0
    2023-01-06T04:40:51.600861  kern  :alert :   EA = 0, S1PTW = 0
    2023-01-06T04:40:51.606099  kern  :alert :   FSC = 0x04: level 0 translation fault
    2023-01-06T04:40:51.616907  kern  :ale<8>[   18.464736] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=emerg RESULT=fail UNITS=lines MEASUREMENT=2>   

  * baseline.dmesg.alert: https://kernelci.org/test/case/id/63b7a65faff2f094ec4eee21
        new failure (last pass: next-20230105)
        12 lines

    2023-01-06T04:40:51.574722  kern  :alert : Unable to handle kernel paging request at virtual address fffffffffffffff8
    2023-01-06T04:40:51.575107  kern  :alert : Mem abort info:
    2023-01-06T04:40:51.583919  kern  <8>[   18.435694] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=alert RESULT=fail UNITS=lines MEASUREMENT=12>   

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
mt8192-asurada-spherion-r0   | arm64 | lab-collabora   | clang-13 | cros://chrome...4-chromebook | 1          

  Details:     https://kernelci.org/test/plan/id/63b79fa9284476bb424eee2d

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: cros://chromeos-5.10/arm64/chromiumos-mediatek.flavour.config+arm64-chromebook
  Compiler:    clang-13 (Debian clang version 13.0.1-6~deb11u1)
  Plain log:   https://storage.kernelci.org//next/master/next-20230106/arm64/cros---chromeos-5.10-arm64-chromiumos-mediatek.flavour.config+arm64-chromebook/clang-13/lab-collabora/baseline-mt8192-asurada-spherion-r0.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230106/arm64/cros---chromeos-5.10-arm64-chromiumos-mediatek.flavour.config+arm64-chromebook/clang-13/lab-collabora/baseline-mt8192-asurada-spherion-r0.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221230.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/63b79fa9284476bb424eee2e
        failing since 23 days (last pass: next-20221208, first fail: next-20221213) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
ox820-clouden...lug-series-3 | arm   | lab-baylibre    | gcc-10   | oxnas_v6_defconfig           | 1          

  Details:     https://kernelci.org/test/plan/id/63b79e13c097189aa54eee35

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: oxnas_v6_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230106/arm/oxnas_v6_defconfig/gcc-10/lab-baylibre/baseline-ox820-cloudengines-pogoplug-series-3.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230106/arm/oxnas_v6_defconfig/gcc-10/lab-baylibre/baseline-ox820-cloudengines-pogoplug-series-3.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221230.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/63b79e13c097189aa54eee36
        failing since 135 days (last pass: next-20220822, first fail: next-20220823) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
qemu_mips-malta              | mips  | lab-collabora   | gcc-10   | malta_defconfig              | 1          

  Details:     https://kernelci.org/test/plan/id/63b7a0244868fc435a4eee7b

  Results:     4 PASS, 1 FAIL, 2 SKIP
  Full config: malta_defconfig
  Compiler:    gcc-10 (mips-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230106/mips/malta_defconfig/gcc-10/lab-collabora/baseline-qemu_mips-malta.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230106/mips/malta_defconfig/gcc-10/lab-collabora/baseline-qemu_mips-malta.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221230.0/mipsel/rootfs.cpio.gz 

  * baseline.dmesg.alert: https://kernelci.org/test/case/id/63b7a0244868fc435a4eee83
        new failure (last pass: next-20230105)
        1 lines

    2023-01-06T04:14:14.869094  kern  :alert : CPU 0 Unable to handle kernel paging request at virtual address 1bb1d2fc, epc == 80203944, ra == 80206294
    2023-01-06T04:14:14.869497  
    2023-01-06T04:14:14.904289  <8><LAVA_SIGNAL_TESTCASE TEST_CASE_ID=alert RESULT=fail UNITS=lines MEASUREMENT=1>
    2023-01-06T04:14:14.904753     

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
r8a7743-iwg20d-q7            | arm   | lab-cip         | gcc-10   | shmobile_defconfig           | 1          

  Details:     https://kernelci.org/test/plan/id/63b7a03b8bcc4f819b4eee45

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: shmobile_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20230106/arm/shmobile_defconfig/gcc-10/lab-cip/baseline-r8a7743-iwg20d-q7.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20230106/arm/shmobile_defconfig/gcc-10/lab-cip/baseline-r8a7743-iwg20d-q7.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221230.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/63b7a03b8bcc4f819b4eee46
        new failure (last pass: next-20230105)