Subject: next/master baseline: 383 runs, 52 regressions (next-20220426)

From: "kernelci.org bot" <[email-masked]>
Date: Tue, 26 Apr 2022 22:58:29 -0700 (PDT)

next/master baseline: 383 runs, 52 regressions (next-20220426)

Regressions Summary
-------------------

platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
beagle-xm                    | arm   | lab-baylibre  | clang-14 | multi_v7_defconfig           | 1          
hifive-unleashed-a00         | riscv | lab-baylibre  | gcc-10   | defconfig                    | 1          
imx8mn-ddr4-evk              | arm64 | lab-baylibre  | gcc-10   | defconfig+CON...OMIZE_BASE=y | 1          
imx8mn-ddr4-evk              | arm64 | lab-baylibre  | gcc-10   | defconfig                    | 1          
kontron-kbox-a-230-ls        | arm64 | lab-kontron   | clang-14 | defconfig                    | 1          
kontron-kbox-a-230-ls        | arm64 | lab-kontron   | gcc-10   | defconfig+CON..._64K_PAGES=y | 1          
kontron-kbox-a-230-ls        | arm64 | lab-kontron   | gcc-10   | defconfig+ima                | 1          
kontron-kbox-a-230-ls        | arm64 | lab-kontron   | gcc-10   | defconfig+CON...OMIZE_BASE=y | 1          
kontron-kbox-a-230-ls        | arm64 | lab-kontron   | gcc-10   | defconfig                    | 1          
kontron-kbox-a-230-ls        | arm64 | lab-kontron   | gcc-10   | defconfig+crypto             | 1          
kontron-pitx-imx8m           | arm64 | lab-kontron   | clang-14 | defconfig                    | 1          
kontron-pitx-imx8m           | arm64 | lab-kontron   | gcc-10   | defconfig+ima                | 1          
odroid-xu3                   | arm   | lab-collabora | gcc-10   | multi_v7_defc...MB2_KERNEL=y | 1          
rk3399-gru-kevin             | arm64 | lab-collabora | gcc-10   | defconfig+arm64-chromebook   | 13         
sun50i-a64-pine64-plus       | arm64 | lab-broonie   | gcc-10   | defconfig                    | 1          
sun50i-a64-pine64-plus       | arm64 | lab-broonie   | gcc-10   | defconfig+crypto             | 1          
sun50i-h6-pine-h64           | arm64 | lab-baylibre  | clang-14 | defconfig+CON..._64K_PAGES=y | 1          
sun50i-h6-pine-h64           | arm64 | lab-baylibre  | clang-14 | defconfig                    | 1          
sun50i-h6-pine-h64           | arm64 | lab-collabora | clang-14 | defconfig+CON..._64K_PAGES=y | 1          
sun50i-h6-pine-h64           | arm64 | lab-collabora | clang-14 | defconfig                    | 1          
sun50i-h6-pine-h64           | arm64 | lab-baylibre  | gcc-10   | defconfig+CON..._64K_PAGES=y | 1          
sun50i-h6-pine-h64           | arm64 | lab-baylibre  | gcc-10   | defconfig+ima                | 1          
sun50i-h6-pine-h64           | arm64 | lab-baylibre  | gcc-10   | defconfig+CON...OMIZE_BASE=y | 1          
sun50i-h6-pine-h64           | arm64 | lab-baylibre  | gcc-10   | defconfig                    | 1          
sun50i-h6-pine-h64           | arm64 | lab-baylibre  | gcc-10   | defconfig+crypto             | 1          
sun50i-h6-pine-h64           | arm64 | lab-collabora | gcc-10   | defconfig+CON..._64K_PAGES=y | 1          
sun50i-h6-pine-h64           | arm64 | lab-collabora | gcc-10   | defconfig+ima                | 1          
sun50i-h6-pine-h64           | arm64 | lab-collabora | gcc-10   | defconfig+CON...OMIZE_BASE=y | 1          
sun50i-h6-pine-h64           | arm64 | lab-collabora | gcc-10   | defconfig                    | 1          
sun50i-h6-pine-h64           | arm64 | lab-collabora | gcc-10   | defconfig+crypto             | 1          
sun7i-a20-olinuxino-lime2    | arm   | lab-baylibre  | clang-14 | multi_v7_defconfig           | 1          
sun7i-a20-olinuxino-lime2    | arm   | lab-baylibre  | gcc-10   | multi_v7_defc...CONFIG_SMP=n | 1          
sun7i-a20-olinuxino-lime2    | arm   | lab-baylibre  | gcc-10   | multi_v7_defc...MB2_KERNEL=y | 1          
sun7i-a20-olinuxino-lime2    | arm   | lab-baylibre  | gcc-10   | sunxi_defconfig              | 1          
sun8i-h2-plus...ch-all-h3-cc | arm   | lab-baylibre  | gcc-10   | multi_v7_defc...MB2_KERNEL=y | 1          
sun8i-h2-plus...ch-all-h3-cc | arm   | lab-baylibre  | gcc-10   | sunxi_defconfig              | 1          
sun8i-h2-plus-orangepi-zero  | arm   | lab-baylibre  | gcc-10   | multi_v7_defc...MB2_KERNEL=y | 1          
sun8i-h3-bananapi-m2-plus    | arm   | lab-baylibre  | gcc-10   | sunxi_defconfig              | 1          
sun8i-h3-libretech-all-h3-cc | arm   | lab-baylibre  | gcc-10   | multi_v7_defc...MB2_KERNEL=y | 1          
sun8i-h3-libretech-all-h3-cc | arm   | lab-baylibre  | gcc-10   | sunxi_defconfig              | 1          

  Details:  https://kernelci.org/test/job/next/branch/master/kernel/next-20220426/plan/baseline/

  Test:     baseline
  Tree:     next
  Branch:   master
  Describe: next-20220426
  URL:      https://git.kernel.org/pub/scm/linux/kernel/git/next/linux-next.git
  SHA:      088fb7eff3496e0f61fdf68bda89b81a4d0a4434 

Test Regressions
---------------- 

platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
beagle-xm                    | arm   | lab-baylibre  | clang-14 | multi_v7_defconfig           | 1          

  Details:     https://kernelci.org/test/plan/id/6268a66370015903f6ff9472

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig
  Compiler:    clang-14 (Debian clang version 14.0.1-++20220423123016+9a3e81e1f91f-1~exp1~20220423003106.122)
  Plain log:   https://storage.kernelci.org//next/master/next-20220426/arm/multi_v7_defconfig/clang-14/lab-baylibre/baseline-beagle-xm.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220426/arm/multi_v7_defconfig/clang-14/lab-baylibre/baseline-beagle-xm.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220422.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6268a66370015903f6ff9473
        failing since 26 days (last pass: next-20220328, first fail: next-20220329) 

platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
hifive-unleashed-a00         | riscv | lab-baylibre  | gcc-10   | defconfig                    | 1          

  Details:     https://kernelci.org/test/plan/id/6268a3cbff029f8de0ff945a

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig
  Compiler:    gcc-10 (riscv64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220426/riscv/defconfig/gcc-10/lab-baylibre/baseline-hifive-unleashed-a00.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220426/riscv/defconfig/gcc-10/lab-baylibre/baseline-hifive-unleashed-a00.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220422.0/riscv/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6268a3cbff029f8de0ff945b
        failing since 181 days (last pass: next-20211026, first fail: next-20211027) 

platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
imx8mn-ddr4-evk              | arm64 | lab-baylibre  | gcc-10   | defconfig+CON...OMIZE_BASE=y | 1          

  Details:     https://kernelci.org/test/plan/id/6268a559315e902736ff94d1

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+CONFIG_RANDOMIZE_BASE=y
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220426/arm64/defconfig+CONFIG_RANDOMIZE_BASE=y/gcc-10/lab-baylibre/baseline-imx8mn-ddr4-evk.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220426/arm64/defconfig+CONFIG_RANDOMIZE_BASE=y/gcc-10/lab-baylibre/baseline-imx8mn-ddr4-evk.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220422.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6268a559315e902736ff94d2
        new failure (last pass: next-20220422) 

platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
imx8mn-ddr4-evk              | arm64 | lab-baylibre  | gcc-10   | defconfig                    | 1          

  Details:     https://kernelci.org/test/plan/id/6268a6ea585e0bd24dff9501

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220426/arm64/defconfig/gcc-10/lab-baylibre/baseline-imx8mn-ddr4-evk.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220426/arm64/defconfig/gcc-10/lab-baylibre/baseline-imx8mn-ddr4-evk.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220422.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6268a6ea585e0bd24dff9502
        new failure (last pass: next-20220422) 

platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
kontron-kbox-a-230-ls        | arm64 | lab-kontron   | clang-14 | defconfig                    | 1          

  Details:     https://kernelci.org/test/plan/id/6268a7236f291ff218ff94b3

  Results:     93 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig
  Compiler:    clang-14 (Debian clang version 14.0.1-++20220423123016+9a3e81e1f91f-1~exp1~20220423003106.122)
  Plain log:   https://storage.kernelci.org//next/master/next-20220426/arm64/defconfig/clang-14/lab-kontron/baseline-kontron-kbox-a-230-ls.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220426/arm64/defconfig/clang-14/lab-kontron/baseline-kontron-kbox-a-230-ls.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220422.0/arm64/rootfs.cpio.gz 

  * baseline.bootrr.mscc_felix-probed: https://kernelci.org/test/case/id/6268a7236f291ff218ff94bf
        failing since 12 days (last pass: next-20220411, first fail: next-20220414)

    2022-04-27T02:14:35.920836  /lava-112707/1/../bin/lava-test-case
    2022-04-27T02:14:35.965176  <8>[   17.013105] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=mscc_felix-probed RESULT=fail>
    2022-04-27T02:14:35.965580  /lava-112707/1/../bin/lava-test-case
    2022-04-27T02:14:35.965818  <8>[   17.025740] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=leds-gpio-driver-present RESULT=pass>
    2022-04-27T02:14:35.966050  /lava-112707/1/../bin/lava-test-case   

platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
kontron-kbox-a-230-ls        | arm64 | lab-kontron   | gcc-10   | defconfig+CON..._64K_PAGES=y | 1          

  Details:     https://kernelci.org/test/plan/id/6268a29b3e2e4ec8acff950a

  Results:     94 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+CONFIG_ARM64_64K_PAGES=y
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220426/arm64/defconfig+CONFIG_ARM64_64K_PAGES=y/gcc-10/lab-kontron/baseline-kontron-kbox-a-230-ls.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220426/arm64/defconfig+CONFIG_ARM64_64K_PAGES=y/gcc-10/lab-kontron/baseline-kontron-kbox-a-230-ls.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220422.0/arm64/rootfs.cpio.gz 

  * baseline.bootrr.mscc_felix-probed: https://kernelci.org/test/case/id/6268a29b3e2e4ec8acff9517
        failing since 13 days (last pass: next-20220411, first fail: next-20220413)

    2022-04-27T01:54:24.582468  /lava-112674/1/../bin/lava-test-case
    2022-04-27T01:54:24.627118  <8>[   15.922530] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=mscc_felix-probed RESULT=fail>
    2022-04-27T01:54:24.627424  /lava-112674/1/../bin/lava-test-case
    2022-04-27T01:54:24.627582  <8>[   15.933891] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=leds-gpio-driver-present RESULT=pass>
    2022-04-27T01:54:24.627735  /lava-112674/1/../bin/lava-test-case   

platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
kontron-kbox-a-230-ls        | arm64 | lab-kontron   | gcc-10   | defconfig+ima                | 1          

  Details:     https://kernelci.org/test/plan/id/6268a3897ea0b40278ff94b7

  Results:     93 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+ima
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220426/arm64/defconfig+ima/gcc-10/lab-kontron/baseline-kontron-kbox-a-230-ls.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220426/arm64/defconfig+ima/gcc-10/lab-kontron/baseline-kontron-kbox-a-230-ls.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220422.0/arm64/rootfs.cpio.gz 

  * baseline.bootrr.mscc_felix-probed: https://kernelci.org/test/case/id/6268a3897ea0b40278ff94c3
        failing since 13 days (last pass: next-20220411, first fail: next-20220413)

    2022-04-27T01:59:24.542558  /lava-112679/1/../bin/lava-test-case
    2022-04-27T01:59:24.586467  <8>[   16.534148] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=mscc_felix-probed RESULT=fail>
    2022-04-27T01:59:24.586867  /lava-112679/1/../bin/lava-test-case
    2022-04-27T01:59:24.587099  <8>[   16.546658] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=leds-gpio-driver-present RESULT=pass>
    2022-04-27T01:59:24.587326  /lava-112679/1/../bin/lava-test-case   

platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
kontron-kbox-a-230-ls        | arm64 | lab-kontron   | gcc-10   | defconfig+CON...OMIZE_BASE=y | 1          

  Details:     https://kernelci.org/test/plan/id/6268a4a310809c513dff9461

  Results:     94 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+CONFIG_RANDOMIZE_BASE=y
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220426/arm64/defconfig+CONFIG_RANDOMIZE_BASE=y/gcc-10/lab-kontron/baseline-kontron-kbox-a-230-ls.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220426/arm64/defconfig+CONFIG_RANDOMIZE_BASE=y/gcc-10/lab-kontron/baseline-kontron-kbox-a-230-ls.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220422.0/arm64/rootfs.cpio.gz 

  * baseline.bootrr.mscc_felix-probed: https://kernelci.org/test/case/id/6268a4a310809c513dff946e
        failing since 13 days (last pass: next-20220411, first fail: next-20220413)

    2022-04-27T02:04:03.260679  /lava-112690/1/../bin/lava-test-case
    2022-04-27T02:04:03.305059  <8>[   15.809328] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=mscc_felix-probed RESULT=fail>
    2022-04-27T02:04:03.305619  /lava-112690/1/../bin/lava-test-case
    2022-04-27T02:04:03.307288  <8>[   15.821780] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=leds-gpio-driver-present RESULT=pass>
    2022-04-27T02:04:03.307532  /lava-112690/1/../bin/lava-test-case
    2022-04-27T02:04:03.307682  <8>[   15.834514] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=leds-gpio-probed RESULT=pass>
    2022-04-27T02:04:03.307877  /lava-112690/1/../bin/lava-test-case   

platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
kontron-kbox-a-230-ls        | arm64 | lab-kontron   | gcc-10   | defconfig                    | 1          

  Details:     https://kernelci.org/test/plan/id/6268a556315e902736ff946d

  Results:     94 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220426/arm64/defconfig/gcc-10/lab-kontron/baseline-kontron-kbox-a-230-ls.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220426/arm64/defconfig/gcc-10/lab-kontron/baseline-kontron-kbox-a-230-ls.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220422.0/arm64/rootfs.cpio.gz 

  * baseline.bootrr.mscc_felix-probed: https://kernelci.org/test/case/id/6268a556315e902736ff947a
        failing since 13 days (last pass: next-20220411, first fail: next-20220413)

    2022-04-27T02:07:03.916876  /lava-112695/1/../bin/lava-test-case
    2022-04-27T02:07:03.961854  <8>[   15.777256] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=mscc_felix-probed RESULT=fail>
    2022-04-27T02:07:03.962208  /lava-112695/1/../bin/lava-test-case
    2022-04-27T02:07:03.963575  <8>[   15.790045] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=leds-gpio-driver-present RESULT=pass>
    2022-04-27T02:07:03.963763  /lava-112695/1/../bin/lava-test-case   

platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
kontron-kbox-a-230-ls        | arm64 | lab-kontron   | gcc-10   | defconfig+crypto             | 1          

  Details:     https://kernelci.org/test/plan/id/6268a7725a6440b623ff94f5

  Results:     94 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+crypto
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220426/arm64/defconfig+crypto/gcc-10/lab-kontron/baseline-kontron-kbox-a-230-ls.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220426/arm64/defconfig+crypto/gcc-10/lab-kontron/baseline-kontron-kbox-a-230-ls.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220422.0/arm64/rootfs.cpio.gz 

  * baseline.bootrr.mscc_felix-probed: https://kernelci.org/test/case/id/6268a7735a6440b623ff9502
        failing since 12 days (last pass: next-20220411, first fail: next-20220414)

    2022-04-27T02:16:07.124603  /lava-112712/1/../bin/lava-test-case
    2022-04-27T02:16:07.168104  <8>[   16.862071] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=mscc_felix-probed RESULT=fail>
    2022-04-27T02:16:07.168448  /lava-112712/1/../bin/lava-test-case   

platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
kontron-pitx-imx8m           | arm64 | lab-kontron   | clang-14 | defconfig                    | 1          

  Details:     https://kernelci.org/test/plan/id/6268a646da6f09f1c8ff9461

  Results:     50 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig
  Compiler:    clang-14 (Debian clang version 14.0.1-++20220423123016+9a3e81e1f91f-1~exp1~20220423003106.122)
  Plain log:   https://storage.kernelci.org//next/master/next-20220426/arm64/defconfig/clang-14/lab-kontron/baseline-kontron-pitx-imx8m.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220426/arm64/defconfig/clang-14/lab-kontron/baseline-kontron-pitx-imx8m.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220422.0/arm64/rootfs.cpio.gz 

  * baseline.bootrr.dwc3-usb1-probed: https://kernelci.org/test/case/id/6268a646da6f09f1c8ff9477
        new failure (last pass: next-20220422)

    2022-04-27T02:11:02.521917  /lava-112703/1/../bin/lava-test-case
    2022-04-27T02:11:02.522296  <8>[   14.754966] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=dwc3-usb1-probed RESULT=fail>
    2022-04-27T02:11:02.522535  /lava-112703/1/../bin/lava-test-case   

platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
kontron-pitx-imx8m           | arm64 | lab-kontron   | gcc-10   | defconfig+ima                | 1          

  Details:     https://kernelci.org/test/plan/id/6268a39e7ea0b40278ff953b

  Results:     50 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig+ima
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220426/arm64/defconfig+ima/gcc-10/lab-kontron/baseline-kontron-pitx-imx8m.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220426/arm64/defconfig+ima/gcc-10/lab-kontron/baseline-kontron-pitx-imx8m.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220422.0/arm64/rootfs.cpio.gz 

  * baseline.bootrr.dwc3-usb1-probed: https://kernelci.org/test/case/id/6268a39e7ea0b40278ff9551
        new failure (last pass: next-20220422)

    2022-04-27T01:59:42.527825  /lava-112682/1/../bin/lava-test-case
    2022-04-27T01:59:42.528254  <8>[   14.834975] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=dwc3-usb1-probed RESULT=fail>   

platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
odroid-xu3                   | arm   | lab-collabora | gcc-10   | multi_v7_defc...MB2_KERNEL=y | 1          

  Details:     https://kernelci.org/test/plan/id/6268b84eec176a1202ff9468

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220426/arm/multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y/gcc-10/lab-collabora/baseline-odroid-xu3.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220426/arm/multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y/gcc-10/lab-collabora/baseline-odroid-xu3.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220422.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6268b84eec176a1202ff9469
        failing since 48 days (last pass: next-20220308, first fail: next-20220309) 

platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
rk3399-gru-kevin             | arm64 | lab-collabora | gcc-10   | defconfig+arm64-chromebook   | 13         

  Details:     https://kernelci.org/test/plan/id/6268a446db47db85ddff946a

  Results:     74 PASS, 17 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220426/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-rk3399-gru-kevin.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220426/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-rk3399-gru-kevin.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220422.0/arm64/rootfs.cpio.gz 

  * baseline.bootrr.rockchip-typec-phy1-probed: https://kernelci.org/test/case/id/6268a446db47db85ddff9476
        new failure (last pass: next-20220421)

    2022-04-27T02:02:27.734165  <8>[   49.877803] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=rockchip-typec-phy0-probed RESULT=fail>
    2022-04-27T02:02:28.736117  /lava-6185638/1/../bin/lava-test-case
    2022-04-27T02:02:28.748685  <8>[   50.895935] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=rockchip-typec-phy1-probed RESULT=fail>   

  * baseline.bootrr.rockchip-typec-phy0-probed: https://kernelci.org/test/case/id/6268a446db47db85ddff9477
        new failure (last pass: next-20220421)

    2022-04-27T02:02:27.717924  /lava-6185638/1/../bin/lava-test-case   

  * baseline.bootrr.hdmi-audio-codec-probed: https://kernelci.org/test/case/id/6268a446db47db85ddff94a9
        new failure (last pass: next-20220421)

    2022-04-27T02:02:24.885436  /lava-6185638/1/../bin/lava-test-case   

  * baseline.bootrr.hdmi-audio-codec-driver-present: https://kernelci.org/test/case/id/6268a446db47db85ddff94aa
        new failure (last pass: next-20220421)

    2022-04-27T02:02:22.861975  <8>[   45.008490] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=cros-ec-sysfs-attr-version RESULT=pass>
    2022-04-27T02:02:23.867065  /lava-6185638/1/../bin/lava-test-case
    2022-04-27T02:02:23.881119  <8>[   46.026692] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=hdmi-audio-codec-driver-present RESULT=fail>   

  * baseline.bootrr.cros-ec-sysfs-attr-kb_wake_angle: https://kernelci.org/test/case/id/6268a446db47db85ddff94ac
        new failure (last pass: next-20220421)

    2022-04-27T02:02:22.832629  /lava-6185638/1/../bin/lava-test-case   

  * baseline.bootrr.cros-ec-sensorhub-probed: https://kernelci.org/test/case/id/6268a446db47db85ddff94b0
        new failure (last pass: next-20220421)

    2022-04-27T02:02:20.754487  <8>[   42.899537] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=cros-ec-sensorhub-driver-present RESULT=pass>
    2022-04-27T02:02:21.758765  /lava-6185638/1/../bin/lava-test-case
    2022-04-27T02:02:21.772784  <8>[   43.917840] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=cros-ec-sensorhub-probed RESULT=fail>   

  * baseline.bootrr.cros-ec-sensors-gyro0-probed: https://kernelci.org/test/case/id/6268a446db47db85ddff94b2
        new failure (last pass: next-20220421)

    2022-04-27T02:02:20.724174  /lava-6185638/1/../bin/lava-test-case
    2022-04-27T02:02:20.737076  <8>[   42.883243] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=cros-ec-sensors-gyro0-probed RESULT=fail>   

  * baseline.bootrr.cros-ec-sensors-accel1-probed: https://kernelci.org/test/case/id/6268a446db47db85ddff94b3
        new failure (last pass: next-20220421)

    2022-04-27T02:02:19.705448  /lava-6185638/1/../bin/lava-test-case
    2022-04-27T02:02:19.721197  <8>[   41.864811] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=cros-ec-sensors-accel1-probed RESULT=fail>   

  * baseline.bootrr.cros-ec-sensors-accel0-probed: https://kernelci.org/test/case/id/6268a446db47db85ddff94b4
        new failure (last pass: next-20220421)

    2022-04-27T02:02:17.673302  <8>[   39.817296] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=cros-ec-sensors-driver-present RESULT=fail>
    2022-04-27T02:02:18.687730  /lava-6185638/1/../bin/lava-test-case
    2022-04-27T02:02:18.701193  <8>[   40.846936] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=cros-ec-sensors-accel0-probed RESULT=fail>   

  * baseline.bootrr.cros-ec-sensors-driver-present: https://kernelci.org/test/case/id/6268a446db47db85ddff94b5
        new failure (last pass: next-20220421)

    2022-04-27T02:02:17.657612  /lava-6185638/1/../bin/lava-test-case   

  * baseline.bootrr.cros-ec-rtc-probed: https://kernelci.org/test/case/id/6268a446db47db85ddff94b6
        new failure (last pass: next-20220421)

    2022-04-27T02:02:15.636651  <8>[   37.782988] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=cros-ec-rtc-driver-present RESULT=pass>
    2022-04-27T02:02:16.640517  /lava-6185638/1/../bin/lava-test-case
    2022-04-27T02:02:16.651880  <8>[   38.800252] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=cros-ec-rtc-probed RESULT=fail>   

  * baseline.bootrr.cros-ec-keyb-probed: https://kernelci.org/test/case/id/6268a446db47db85ddff94bb
        new failure (last pass: next-20220421)

    2022-04-27T02:02:15.559451  /lava-6185638/1/../bin/lava-test-case
    2022-04-27T02:02:15.572018  <8>[   37.719018] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=cros-ec-keyb-probed RESULT=fail>   

  * baseline.bootrr.cros-ec-debugfs-attr-console_log: https://kernelci.org/test/case/id/6268a446db47db85ddff94c2
        new failure (last pass: next-20220421)

    2022-04-27T02:02:13.440376  <8>[   35.584590] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=cros-ec-debugfs-probed RESULT=pass>
    2022-04-27T02:02:14.440622  /lava-6185638/1/../bin/lava-test-case   

platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
sun50i-a64-pine64-plus       | arm64 | lab-broonie   | gcc-10   | defconfig                    | 1          

  Details:     https://kernelci.org/test/plan/id/6268a5d619c0a10d1aff9487

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220426/arm64/defconfig/gcc-10/lab-broonie/baseline-sun50i-a64-pine64-plus.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220426/arm64/defconfig/gcc-10/lab-broonie/baseline-sun50i-a64-pine64-plus.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220422.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6268a5d619c0a10d1aff9488
        new failure (last pass: next-20220422) 

platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
sun50i-a64-pine64-plus       | arm64 | lab-broonie   | gcc-10   | defconfig+crypto             | 1          

  Details:     https://kernelci.org/test/plan/id/6268a81b4400326eb8ff9459

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+crypto
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220426/arm64/defconfig+crypto/gcc-10/lab-broonie/baseline-sun50i-a64-pine64-plus.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220426/arm64/defconfig+crypto/gcc-10/lab-broonie/baseline-sun50i-a64-pine64-plus.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220422.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6268a81b4400326eb8ff945a
        new failure (last pass: next-20220421) 

platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
sun50i-h6-pine-h64           | arm64 | lab-baylibre  | clang-14 | defconfig+CON..._64K_PAGES=y | 1          

  Details:     https://kernelci.org/test/plan/id/6268a93ce8973c9b39ff94a4

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+CONFIG_ARM64_64K_PAGES=y
  Compiler:    clang-14 (Debian clang version 14.0.1-++20220423123016+9a3e81e1f91f-1~exp1~20220423003106.122)
  Plain log:   https://storage.kernelci.org//next/master/next-20220426/arm64/defconfig+CONFIG_ARM64_64K_PAGES=y/clang-14/lab-baylibre/baseline-sun50i-h6-pine-h64.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220426/arm64/defconfig+CONFIG_ARM64_64K_PAGES=y/clang-14/lab-baylibre/baseline-sun50i-h6-pine-h64.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220422.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6268a93ce8973c9b39ff94a5
        failing since 6 days (last pass: next-20220414, first fail: next-20220420) 

platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
sun50i-h6-pine-h64           | arm64 | lab-baylibre  | clang-14 | defconfig                    | 1          

  Details:     https://kernelci.org/test/plan/id/6268aaa594a8ef2d59ff9464

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig
  Compiler:    clang-14 (Debian clang version 14.0.1-++20220423123016+9a3e81e1f91f-1~exp1~20220423003106.122)
  Plain log:   https://storage.kernelci.org//next/master/next-20220426/arm64/defconfig/clang-14/lab-baylibre/baseline-sun50i-h6-pine-h64.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220426/arm64/defconfig/clang-14/lab-baylibre/baseline-sun50i-h6-pine-h64.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220422.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6268aaa594a8ef2d59ff9465
        failing since 6 days (last pass: next-20220414, first fail: next-20220420) 

platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
sun50i-h6-pine-h64           | arm64 | lab-collabora | clang-14 | defconfig+CON..._64K_PAGES=y | 1          

  Details:     https://kernelci.org/test/plan/id/6268a83848fc1e6368ff9459

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+CONFIG_ARM64_64K_PAGES=y
  Compiler:    clang-14 (Debian clang version 14.0.1-++20220423123016+9a3e81e1f91f-1~exp1~20220423003106.122)
  Plain log:   https://storage.kernelci.org//next/master/next-20220426/arm64/defconfig+CONFIG_ARM64_64K_PAGES=y/clang-14/lab-collabora/baseline-sun50i-h6-pine-h64.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220426/arm64/defconfig+CONFIG_ARM64_64K_PAGES=y/clang-14/lab-collabora/baseline-sun50i-h6-pine-h64.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220422.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6268a83848fc1e6368ff945a
        failing since 6 days (last pass: next-20220414, first fail: next-20220420) 

platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
sun50i-h6-pine-h64           | arm64 | lab-collabora | clang-14 | defconfig                    | 1          

  Details:     https://kernelci.org/test/plan/id/6268a84b48fc1e6368ff947d

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig
  Compiler:    clang-14 (Debian clang version 14.0.1-++20220423123016+9a3e81e1f91f-1~exp1~20220423003106.122)
  Plain log:   https://storage.kernelci.org//next/master/next-20220426/arm64/defconfig/clang-14/lab-collabora/baseline-sun50i-h6-pine-h64.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220426/arm64/defconfig/clang-14/lab-collabora/baseline-sun50i-h6-pine-h64.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220422.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6268a84b48fc1e6368ff947e
        failing since 6 days (last pass: next-20220414, first fail: next-20220420) 

platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
sun50i-h6-pine-h64           | arm64 | lab-baylibre  | gcc-10   | defconfig+CON..._64K_PAGES=y | 1          

  Details:     https://kernelci.org/test/plan/id/6268a374ab5886ed63ff9483

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+CONFIG_ARM64_64K_PAGES=y
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220426/arm64/defconfig+CONFIG_ARM64_64K_PAGES=y/gcc-10/lab-baylibre/baseline-sun50i-h6-pine-h64.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220426/arm64/defconfig+CONFIG_ARM64_64K_PAGES=y/gcc-10/lab-baylibre/baseline-sun50i-h6-pine-h64.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220422.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6268a374ab5886ed63ff9484
        failing since 7 days (last pass: next-20220414, first fail: next-20220419) 

platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
sun50i-h6-pine-h64           | arm64 | lab-baylibre  | gcc-10   | defconfig+ima                | 1          

  Details:     https://kernelci.org/test/plan/id/6268a4f1f998cc6d4cff9484

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+ima
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220426/arm64/defconfig+ima/gcc-10/lab-baylibre/baseline-sun50i-h6-pine-h64.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220426/arm64/defconfig+ima/gcc-10/lab-baylibre/baseline-sun50i-h6-pine-h64.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220422.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6268a4f1f998cc6d4cff9485
        failing since 7 days (last pass: next-20220413, first fail: next-20220419) 

platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
sun50i-h6-pine-h64           | arm64 | lab-baylibre  | gcc-10   | defconfig+CON...OMIZE_BASE=y | 1          

  Details:     https://kernelci.org/test/plan/id/6268a66d55aeaca113ff9465

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+CONFIG_RANDOMIZE_BASE=y
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220426/arm64/defconfig+CONFIG_RANDOMIZE_BASE=y/gcc-10/lab-baylibre/baseline-sun50i-h6-pine-h64.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220426/arm64/defconfig+CONFIG_RANDOMIZE_BASE=y/gcc-10/lab-baylibre/baseline-sun50i-h6-pine-h64.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220422.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6268a66d55aeaca113ff9466
        failing since 6 days (last pass: next-20220414, first fail: next-20220420) 

platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
sun50i-h6-pine-h64           | arm64 | lab-baylibre  | gcc-10   | defconfig                    | 1          

  Details:     https://kernelci.org/test/plan/id/6268a7d44706b96869ff9464

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220426/arm64/defconfig/gcc-10/lab-baylibre/baseline-sun50i-h6-pine-h64.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220426/arm64/defconfig/gcc-10/lab-baylibre/baseline-sun50i-h6-pine-h64.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220422.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6268a7d44706b96869ff9465
        failing since 7 days (last pass: next-20220414, first fail: next-20220419) 

platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
sun50i-h6-pine-h64           | arm64 | lab-baylibre  | gcc-10   | defconfig+crypto             | 1          

  Details:     https://kernelci.org/test/plan/id/6268ac0d41d2a306d6ff9463

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+crypto
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220426/arm64/defconfig+crypto/gcc-10/lab-baylibre/baseline-sun50i-h6-pine-h64.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220426/arm64/defconfig+crypto/gcc-10/lab-baylibre/baseline-sun50i-h6-pine-h64.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220422.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6268ac0d41d2a306d6ff9464
        failing since 7 days (last pass: next-20220414, first fail: next-20220419) 

platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
sun50i-h6-pine-h64           | arm64 | lab-collabora | gcc-10   | defconfig+CON..._64K_PAGES=y | 1          

  Details:     https://kernelci.org/test/plan/id/6268a3817ea0b40278ff946e

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+CONFIG_ARM64_64K_PAGES=y
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220426/arm64/defconfig+CONFIG_ARM64_64K_PAGES=y/gcc-10/lab-collabora/baseline-sun50i-h6-pine-h64.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220426/arm64/defconfig+CONFIG_ARM64_64K_PAGES=y/gcc-10/lab-collabora/baseline-sun50i-h6-pine-h64.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220422.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6268a3817ea0b40278ff946f
        failing since 7 days (last pass: next-20220414, first fail: next-20220419) 

platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
sun50i-h6-pine-h64           | arm64 | lab-collabora | gcc-10   | defconfig+ima                | 1          

  Details:     https://kernelci.org/test/plan/id/6268a4c710809c513dff94d3

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+ima
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220426/arm64/defconfig+ima/gcc-10/lab-collabora/baseline-sun50i-h6-pine-h64.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220426/arm64/defconfig+ima/gcc-10/lab-collabora/baseline-sun50i-h6-pine-h64.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220422.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6268a4c710809c513dff94d4
        failing since 7 days (last pass: next-20220413, first fail: next-20220419) 

platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
sun50i-h6-pine-h64           | arm64 | lab-collabora | gcc-10   | defconfig+CON...OMIZE_BASE=y | 1          

  Details:     https://kernelci.org/test/plan/id/6268a515892f10be03ff9459

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+CONFIG_RANDOMIZE_BASE=y
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220426/arm64/defconfig+CONFIG_RANDOMIZE_BASE=y/gcc-10/lab-collabora/baseline-sun50i-h6-pine-h64.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220426/arm64/defconfig+CONFIG_RANDOMIZE_BASE=y/gcc-10/lab-collabora/baseline-sun50i-h6-pine-h64.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220422.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6268a515892f10be03ff945a
        failing since 6 days (last pass: next-20220414, first fail: next-20220420) 

platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
sun50i-h6-pine-h64           | arm64 | lab-collabora | gcc-10   | defconfig                    | 1          

  Details:     https://kernelci.org/test/plan/id/6268a6accd9cf5bb86ff94a9

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220426/arm64/defconfig/gcc-10/lab-collabora/baseline-sun50i-h6-pine-h64.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220426/arm64/defconfig/gcc-10/lab-collabora/baseline-sun50i-h6-pine-h64.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220422.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6268a6accd9cf5bb86ff94aa
        failing since 7 days (last pass: next-20220414, first fail: next-20220419) 

platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
sun50i-h6-pine-h64           | arm64 | lab-collabora | gcc-10   | defconfig+crypto             | 1          

  Details:     https://kernelci.org/test/plan/id/6268aa08948ffe400aff9459

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+crypto
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220426/arm64/defconfig+crypto/gcc-10/lab-collabora/baseline-sun50i-h6-pine-h64.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220426/arm64/defconfig+crypto/gcc-10/lab-collabora/baseline-sun50i-h6-pine-h64.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220422.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6268aa08948ffe400aff945a
        failing since 7 days (last pass: next-20220414, first fail: next-20220419) 

platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
sun7i-a20-olinuxino-lime2    | arm   | lab-baylibre  | clang-14 | multi_v7_defconfig           | 1          

  Details:     https://kernelci.org/test/plan/id/6268abae805ce575faff9475

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig
  Compiler:    clang-14 (Debian clang version 14.0.1-++20220423123016+9a3e81e1f91f-1~exp1~20220423003106.122)
  Plain log:   https://storage.kernelci.org//next/master/next-20220426/arm/multi_v7_defconfig/clang-14/lab-baylibre/baseline-sun7i-a20-olinuxino-lime2.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220426/arm/multi_v7_defconfig/clang-14/lab-baylibre/baseline-sun7i-a20-olinuxino-lime2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220422.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6268abae805ce575faff9476
        failing since 13 days (last pass: next-20220411, first fail: next-20220413) 

platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
sun7i-a20-olinuxino-lime2    | arm   | lab-baylibre  | gcc-10   | multi_v7_defc...CONFIG_SMP=n | 1          

  Details:     https://kernelci.org/test/plan/id/6268a65de95c643033ff946a

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_SMP=n
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220426/arm/multi_v7_defconfig+CONFIG_SMP=n/gcc-10/lab-baylibre/baseline-sun7i-a20-olinuxino-lime2.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220426/arm/multi_v7_defconfig+CONFIG_SMP=n/gcc-10/lab-baylibre/baseline-sun7i-a20-olinuxino-lime2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220422.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6268a65de95c643033ff946b
        failing since 13 days (last pass: next-20220411, first fail: next-20220413) 

platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
sun7i-a20-olinuxino-lime2    | arm   | lab-baylibre  | gcc-10   | multi_v7_defc...MB2_KERNEL=y | 1          

  Details:     https://kernelci.org/test/plan/id/6268a7c64caf490f72ff945f

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220426/arm/multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y/gcc-10/lab-baylibre/baseline-sun7i-a20-olinuxino-lime2.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220426/arm/multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y/gcc-10/lab-baylibre/baseline-sun7i-a20-olinuxino-lime2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220422.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6268a7c64caf490f72ff9460
        failing since 13 days (last pass: next-20220411, first fail: next-20220413) 

platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
sun7i-a20-olinuxino-lime2    | arm   | lab-baylibre  | gcc-10   | sunxi_defconfig              | 1          

  Details:     https://kernelci.org/test/plan/id/6268a0f9c6f1f689a5ff9464

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: sunxi_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220426/arm/sunxi_defconfig/gcc-10/lab-baylibre/baseline-sun7i-a20-olinuxino-lime2.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220426/arm/sunxi_defconfig/gcc-10/lab-baylibre/baseline-sun7i-a20-olinuxino-lime2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220422.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6268a0f9c6f1f689a5ff9465
        failing since 13 days (last pass: next-20220411, first fail: next-20220413) 

platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
sun8i-h2-plus...ch-all-h3-cc | arm   | lab-baylibre  | gcc-10   | multi_v7_defc...MB2_KERNEL=y | 1          

  Details:     https://kernelci.org/test/plan/id/6268a5f0073ddf70f8ff9459

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220426/arm/multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y/gcc-10/lab-baylibre/baseline-sun8i-h2-plus-libretech-all-h3-cc.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220426/arm/multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y/gcc-10/lab-baylibre/baseline-sun8i-h2-plus-libretech-all-h3-cc.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220422.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6268a5f0073ddf70f8ff945a
        new failure (last pass: next-20220422) 

platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
sun8i-h2-plus...ch-all-h3-cc | arm   | lab-baylibre  | gcc-10   | sunxi_defconfig              | 1          

  Details:     https://kernelci.org/test/plan/id/6268a10370ecc32082ff947d

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: sunxi_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220426/arm/sunxi_defconfig/gcc-10/lab-baylibre/baseline-sun8i-h2-plus-libretech-all-h3-cc.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220426/arm/sunxi_defconfig/gcc-10/lab-baylibre/baseline-sun8i-h2-plus-libretech-all-h3-cc.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220422.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6268a10370ecc32082ff947e
        new failure (last pass: next-20220422) 

platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
sun8i-h2-plus-orangepi-zero  | arm   | lab-baylibre  | gcc-10   | multi_v7_defc...MB2_KERNEL=y | 1          

  Details:     https://kernelci.org/test/plan/id/6268a6aee95c643033ff94a6

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220426/arm/multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y/gcc-10/lab-baylibre/baseline-sun8i-h2-plus-orangepi-zero.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220426/arm/multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y/gcc-10/lab-baylibre/baseline-sun8i-h2-plus-orangepi-zero.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220422.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6268a6aee95c643033ff94a7
        new failure (last pass: next-20220422) 

platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
sun8i-h3-bananapi-m2-plus    | arm   | lab-baylibre  | gcc-10   | sunxi_defconfig              | 1          

  Details:     https://kernelci.org/test/plan/id/6268a0f33def2be096ff9477

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: sunxi_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220426/arm/sunxi_defconfig/gcc-10/lab-baylibre/baseline-sun8i-h3-bananapi-m2-plus.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220426/arm/sunxi_defconfig/gcc-10/lab-baylibre/baseline-sun8i-h3-bananapi-m2-plus.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220422.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6268a0f33def2be096ff9478
        new failure (last pass: next-20220422) 

platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
sun8i-h3-libretech-all-h3-cc | arm   | lab-baylibre  | gcc-10   | multi_v7_defc...MB2_KERNEL=y | 1          

  Details:     https://kernelci.org/test/plan/id/6268a519892f10be03ff9465

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220426/arm/multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y/gcc-10/lab-baylibre/baseline-sun8i-h3-libretech-all-h3-cc.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220426/arm/multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y/gcc-10/lab-baylibre/baseline-sun8i-h3-libretech-all-h3-cc.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220422.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6268a519892f10be03ff9466
        new failure (last pass: next-20220422) 

platform                     | arch  | lab           | compiler | defconfig                    | regressions
-----------------------------+-------+---------------+----------+------------------------------+------------
sun8i-h3-libretech-all-h3-cc | arm   | lab-baylibre  | gcc-10   | sunxi_defconfig              | 1          

  Details:     https://kernelci.org/test/plan/id/6268a0f53def2be096ff9485

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: sunxi_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220426/arm/sunxi_defconfig/gcc-10/lab-baylibre/baseline-sun8i-h3-libretech-all-h3-cc.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220426/arm/sunxi_defconfig/gcc-10/lab-baylibre/baseline-sun8i-h3-libretech-all-h3-cc.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20220422.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6268a0f53def2be096ff9486
        new failure (last pass: next-20220422)