Subject: next/master baseline: 657 runs, 70 regressions (next-20220106)

From: "kernelci.org bot" <[email-masked]>
Date: Thu, 06 Jan 2022 17:15:36 -0800 (PST)

next/master baseline: 657 runs, 70 regressions (next-20220106)

Regressions Summary
-------------------

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
bcm2711-rpi-4-b              | arm64  | lab-collabora   | gcc-10   | defconfig                    | 1          
bcm2711-rpi-4-b              | arm64  | lab-collabora   | gcc-10   | defconfig+CON...OMIZE_BASE=y | 1          
bcm2711-rpi-4-b              | arm64  | lab-collabora   | gcc-10   | defconfig+crypto             | 1          
bcm2711-rpi-4-b              | arm64  | lab-linaro-lkft | gcc-10   | defconfig                    | 1          
bcm2711-rpi-4-b              | arm64  | lab-linaro-lkft | gcc-10   | defconfig+CON...OMIZE_BASE=y | 1          
bcm2711-rpi-4-b              | arm64  | lab-linaro-lkft | gcc-10   | defconfig+crypto             | 1          
bcm2836-rpi-2-b              | arm    | lab-collabora   | gcc-10   | bcm2835_defconfig            | 1          
bcm2836-rpi-2-b              | arm    | lab-collabora   | gcc-10   | multi_v7_defc...MB2_KERNEL=y | 1          
kontron-kbox-a-230-ls        | arm64  | lab-kontron     | gcc-10   | defconfig                    | 2          
kontron-kbox-a-230-ls        | arm64  | lab-kontron     | gcc-10   | defconfig+CON...OMIZE_BASE=y | 2          
kontron-kbox-a-230-ls        | arm64  | lab-kontron     | gcc-10   | defconfig+CON..._64K_PAGES=y | 8          
kontron-kbox-a-230-ls        | arm64  | lab-kontron     | gcc-10   | defconfig+crypto             | 2          
kontron-sl28-var3-ads2       | arm64  | lab-kontron     | gcc-10   | defconfig                    | 2          
kontron-sl28-var3-ads2       | arm64  | lab-kontron     | gcc-10   | defconfig+CON...OMIZE_BASE=y | 2          
kontron-sl28-var3-ads2       | arm64  | lab-kontron     | gcc-10   | defconfig+CON..._64K_PAGES=y | 2          
kontron-sl28-var3-ads2       | arm64  | lab-kontron     | gcc-10   | defconfig+crypto             | 2          
meson-g12a-sei510            | arm64  | lab-baylibre    | gcc-10   | defconfig+CON..._64K_PAGES=y | 1          
meson-g12a-u200              | arm64  | lab-baylibre    | gcc-10   | defconfig+CON..._64K_PAGES=y | 1          
meson-g12a-x96-max           | arm64  | lab-baylibre    | gcc-10   | defconfig+CON..._64K_PAGES=y | 1          
meson-g12b-a311d-khadas-vim3 | arm64  | lab-baylibre    | gcc-10   | defconfig+CON..._64K_PAGES=y | 1          
meson-g12b-a311d-khadas-vim3 | arm64  | lab-collabora   | gcc-10   | defconfig+CON..._64K_PAGES=y | 1          
meson-g12b-odroid-n2         | arm64  | lab-baylibre    | gcc-10   | defconfig+CON..._64K_PAGES=y | 1          
meson-gxl-s905d-p230         | arm64  | lab-baylibre    | gcc-10   | defconfig+CON..._64K_PAGES=y | 1          
meson-gxl-s905x-libretech-cc | arm64  | lab-clabbe      | gcc-10   | defconfig+CON..._64K_PAGES=y | 1          
meson-gxm-khadas-vim2        | arm64  | lab-baylibre    | gcc-10   | defconfig+CON..._64K_PAGES=y | 1          
meson-sm1-khadas-vim3l       | arm64  | lab-baylibre    | gcc-10   | defconfig+CON..._64K_PAGES=y | 1          
meson-sm1-sei610             | arm64  | lab-baylibre    | gcc-10   | defconfig+CON..._64K_PAGES=y | 1          
qemu_arm64-virt-gicv2-uefi   | arm64  | lab-baylibre    | gcc-10   | defconfig+debug              | 1          
qemu_arm64-virt-gicv2-uefi   | arm64  | lab-cip         | gcc-10   | defconfig+debug              | 1          
qemu_arm64-virt-gicv2-uefi   | arm64  | lab-collabora   | gcc-10   | defconfig+debug              | 1          
qemu_arm64-virt-gicv2-uefi   | arm64  | lab-collabora   | gcc-10   | defconfig+CON..._64K_PAGES=y | 1          
qemu_arm64-virt-gicv2-uefi   | arm64  | lab-linaro-lkft | gcc-10   | defconfig+debug              | 1          
qemu_arm64-virt-gicv2-uefi   | arm64  | lab-linaro-lkft | gcc-10   | defconfig+CON..._64K_PAGES=y | 1          
qemu_arm64-virt-gicv3-uefi   | arm64  | lab-baylibre    | gcc-10   | defconfig+debug              | 1          
qemu_arm64-virt-gicv3-uefi   | arm64  | lab-cip         | gcc-10   | defconfig+debug              | 1          
qemu_arm64-virt-gicv3-uefi   | arm64  | lab-collabora   | gcc-10   | defconfig+debug              | 1          
qemu_arm64-virt-gicv3-uefi   | arm64  | lab-collabora   | gcc-10   | defconfig+CON..._64K_PAGES=y | 1          
qemu_arm64-virt-gicv3-uefi   | arm64  | lab-linaro-lkft | gcc-10   | defconfig+debug              | 1          
qemu_arm64-virt-gicv3-uefi   | arm64  | lab-linaro-lkft | gcc-10   | defconfig+CON..._64K_PAGES=y | 1          
qemu_x86_64-uefi             | x86_64 | lab-cip         | clang-14 | x86_64_defconfig             | 1          
r8a774c0-ek874               | arm64  | lab-cip         | gcc-10   | defconfig                    | 2          
r8a774c0-ek874               | arm64  | lab-cip         | gcc-10   | defconfig+CON...OMIZE_BASE=y | 2          
r8a774c0-ek874               | arm64  | lab-cip         | gcc-10   | defconfig+CON..._64K_PAGES=y | 1          
r8a774c0-ek874               | arm64  | lab-cip         | gcc-10   | defconfig+crypto             | 2          
r8a774c0-ek874               | arm64  | lab-cip         | gcc-10   | defconfig+arm64-chromebook   | 2          
tegra124-nyan-big            | arm    | lab-collabora   | gcc-10   | multi_v7_defconfig           | 1          
tegra124-nyan-big            | arm    | lab-collabora   | gcc-10   | multi_v7_defc...MB2_KERNEL=y | 1          
zynqmp-zcu102                | arm64  | lab-cip         | gcc-10   | defconfig                    | 1          
zynqmp-zcu102                | arm64  | lab-cip         | gcc-10   | defconfig+debug              | 1          
zynqmp-zcu102                | arm64  | lab-cip         | gcc-10   | defconfig+CON...OMIZE_BASE=y | 1          
zynqmp-zcu102                | arm64  | lab-cip         | gcc-10   | defconfig+CON..._64K_PAGES=y | 1          
zynqmp-zcu102                | arm64  | lab-cip         | gcc-10   | defconfig+crypto             | 1          

  Details:  https://kernelci.org/test/job/next/branch/master/kernel/next-20220106/plan/baseline/

  Test:     baseline
  Tree:     next
  Branch:   master
  Describe: next-20220106
  URL:      https://git.kernel.org/pub/scm/linux/kernel/git/next/linux-next.git
  SHA:      3770333b3f8cb7c9110889853afaa49777c26ea7 

Test Regressions
---------------- 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
bcm2711-rpi-4-b              | arm64  | lab-collabora   | gcc-10   | defconfig                    | 1          

  Details:     https://kernelci.org/test/plan/id/61d75bbb8eb17dfc01ef673d

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig/gcc-10/lab-collabora/baseline-bcm2711-rpi-4-b.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig/gcc-10/lab-collabora/baseline-bcm2711-rpi-4-b.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20211210.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/61d75bbb8eb17dfc01ef673e
        failing since 2 days (last pass: next-20211224, first fail: next-20220104) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
bcm2711-rpi-4-b              | arm64  | lab-collabora   | gcc-10   | defconfig+CON...OMIZE_BASE=y | 1          

  Details:     https://kernelci.org/test/plan/id/61d75d9c0c3c22185eef6761

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+CONFIG_RANDOMIZE_BASE=y
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig+config_randomize_base=y/gcc-10/lab-collabora/baseline-bcm2711-rpi-4-b.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig+config_randomize_base=y/gcc-10/lab-collabora/baseline-bcm2711-rpi-4-b.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20211210.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/61d75d9c0c3c22185eef6762
        failing since 2 days (last pass: next-20211223, first fail: next-20220104) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
bcm2711-rpi-4-b              | arm64  | lab-collabora   | gcc-10   | defconfig+crypto             | 1          

  Details:     https://kernelci.org/test/plan/id/61d760a911d3645e49ef6740

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+crypto
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig+crypto/gcc-10/lab-collabora/baseline-bcm2711-rpi-4-b.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig+crypto/gcc-10/lab-collabora/baseline-bcm2711-rpi-4-b.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20211210.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/61d760a911d3645e49ef6741
        failing since 2 days (last pass: next-20211224, first fail: next-20220104) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
bcm2711-rpi-4-b              | arm64  | lab-linaro-lkft | gcc-10   | defconfig                    | 1          

  Details:     https://kernelci.org/test/plan/id/61d75ba5bd9eeb867aef6747

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig/gcc-10/lab-linaro-lkft/baseline-bcm2711-rpi-4-b.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig/gcc-10/lab-linaro-lkft/baseline-bcm2711-rpi-4-b.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20211210.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/61d75ba5bd9eeb867aef6748
        failing since 2 days (last pass: next-20211224, first fail: next-20220104) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
bcm2711-rpi-4-b              | arm64  | lab-linaro-lkft | gcc-10   | defconfig+CON...OMIZE_BASE=y | 1          

  Details:     https://kernelci.org/test/plan/id/61d75d9f0c3c22185eef6765

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+CONFIG_RANDOMIZE_BASE=y
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig+config_randomize_base=y/gcc-10/lab-linaro-lkft/baseline-bcm2711-rpi-4-b.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig+config_randomize_base=y/gcc-10/lab-linaro-lkft/baseline-bcm2711-rpi-4-b.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20211210.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/61d75d9f0c3c22185eef6766
        failing since 2 days (last pass: next-20211223, first fail: next-20220104) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
bcm2711-rpi-4-b              | arm64  | lab-linaro-lkft | gcc-10   | defconfig+crypto             | 1          

  Details:     https://kernelci.org/test/plan/id/61d76097c8ef9cdb3eef6767

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+crypto
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig+crypto/gcc-10/lab-linaro-lkft/baseline-bcm2711-rpi-4-b.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig+crypto/gcc-10/lab-linaro-lkft/baseline-bcm2711-rpi-4-b.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20211210.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/61d76097c8ef9cdb3eef6768
        failing since 2 days (last pass: next-20211224, first fail: next-20220104) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
bcm2836-rpi-2-b              | arm    | lab-collabora   | gcc-10   | bcm2835_defconfig            | 1          

  Details:     https://kernelci.org/test/plan/id/61d75e26dc0eabec5aef6766

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: bcm2835_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220106/arm/bcm2835_defconfig/gcc-10/lab-collabora/baseline-bcm2836-rpi-2-b.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220106/arm/bcm2835_defconfig/gcc-10/lab-collabora/baseline-bcm2836-rpi-2-b.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20211210.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/61d75e26dc0eabec5aef6767
        failing since 2 days (last pass: next-20211224, first fail: next-20220104) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
bcm2836-rpi-2-b              | arm    | lab-collabora   | gcc-10   | multi_v7_defc...MB2_KERNEL=y | 1          

  Details:     https://kernelci.org/test/plan/id/61d767d44355e2ad9eef6766

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220106/arm/multi_v7_defconfig+config_thumb2_kernel=y/gcc-10/lab-collabora/baseline-bcm2836-rpi-2-b.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220106/arm/multi_v7_defconfig+config_thumb2_kernel=y/gcc-10/lab-collabora/baseline-bcm2836-rpi-2-b.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20211210.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/61d767d44355e2ad9eef6767
        failing since 13 days (last pass: next-20211223, first fail: next-20211224) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
kontron-kbox-a-230-ls        | arm64  | lab-kontron     | gcc-10   | defconfig                    | 2          

  Details:     https://kernelci.org/test/plan/id/61d75b8941730aeda4ef6769

  Results:     91 PASS, 2 FAIL, 0 SKIP
  Full config: defconfig
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig/gcc-10/lab-kontron/baseline-kontron-kbox-a-230-ls.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig/gcc-10/lab-kontron/baseline-kontron-kbox-a-230-ls.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20211210.0/arm64/rootfs.cpio.gz 

  * baseline.bootrr.ftm-alarm-driver-present: https://kernelci.org/test/case/id/61d75b8941730aeda4ef67ae
        failing since 19 days (last pass: next-20211216, first fail: next-20211217)

    2022-01-06T21:13:21.588939  /lava-74485/1/../bin/lava-test-case   

  * baseline.bootrr.ftm-alarm-probed: https://kernelci.org/test/case/id/61d75b8941730aeda4ef67af
        failing since 19 days (last pass: next-20211216, first fail: next-20211217)

    2022-01-06T21:13:21.592044  <8>[   16.993131] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=ftm-alarm-driver-present RESULT=fail>
    2022-01-06T21:13:22.639397  /lava-74485/1/../bin/lava-test-case
    2022-01-06T21:13:22.639798  <8>[   18.013037] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=ftm-alarm-probed RESULT=fail>
    2022-01-06T21:13:22.640043  /lava-74485/1/../bin/lava-test-case
    2022-01-06T21:13:22.640270  <8>[   18.028391] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=simple-mfd-i2c-driver-present RESULT=pass>   

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
kontron-kbox-a-230-ls        | arm64  | lab-kontron     | gcc-10   | defconfig+CON...OMIZE_BASE=y | 2          

  Details:     https://kernelci.org/test/plan/id/61d76050ebd55b5b99ef674a

  Results:     91 PASS, 2 FAIL, 0 SKIP
  Full config: defconfig+CONFIG_RANDOMIZE_BASE=y
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig+config_randomize_base=y/gcc-10/lab-kontron/baseline-kontron-kbox-a-230-ls.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig+config_randomize_base=y/gcc-10/lab-kontron/baseline-kontron-kbox-a-230-ls.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20211210.0/arm64/rootfs.cpio.gz 

  * baseline.bootrr.ftm-alarm-driver-present: https://kernelci.org/test/case/id/61d76050ebd55b5b99ef678f
        failing since 16 days (last pass: next-20211216, first fail: next-20211221)

    2022-01-06T21:33:45.186515  /lava-74498/1/../bin/lava-test-case   

  * baseline.bootrr.ftm-alarm-probed: https://kernelci.org/test/case/id/61d76051ebd55b5b99ef6790
        failing since 16 days (last pass: next-20211216, first fail: next-20211221)

    2022-01-06T21:33:45.189567  <8>[   16.372816] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=ftm-alarm-driver-present RESULT=fail>
    2022-01-06T21:33:46.236774  /lava-74498/1/../bin/lava-test-case
    2022-01-06T21:33:46.237166  <8>[   17.391615] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=ftm-alarm-probed RESULT=fail>   

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
kontron-kbox-a-230-ls        | arm64  | lab-kontron     | gcc-10   | defconfig+CON..._64K_PAGES=y | 8          

  Details:     https://kernelci.org/test/plan/id/61d760b31f413080e9ef6741

  Results:     85 PASS, 8 FAIL, 0 SKIP
  Full config: defconfig+CONFIG_ARM64_64K_PAGES=y
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig+config_arm64_64k_pages=y/gcc-10/lab-kontron/baseline-kontron-kbox-a-230-ls.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig+config_arm64_64k_pages=y/gcc-10/lab-kontron/baseline-kontron-kbox-a-230-ls.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20211210.0/arm64/rootfs.cpio.gz 

  * baseline.bootrr.caam-probed: https://kernelci.org/test/case/id/61d760b31f413080e9ef6777
        failing since 1 day (last pass: next-20211224, first fail: next-20220105)

    2022-01-06T21:35:30.984088  /lava-74503/1/../bin/lava-test-case
    2022-01-06T21:35:30.987237  <8>[   17.601634] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=caam-probed RESULT=fail>   

  * baseline.bootrr.caam_jr-driver-present: https://kernelci.org/test/case/id/61d760b31f413080e9ef6778
        failing since 1 day (last pass: next-20211224, first fail: next-20220105)

    2022-01-06T21:35:32.008475  /lava-74503/1/../bin/lava-test-case
    2022-01-06T21:35:32.011582  <8>[   18.620706] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=caam_jr-driver-present RESULT=fail>   

  * baseline.bootrr.caam_jr-jr0-probed: https://kernelci.org/test/case/id/61d760b31f413080e9ef6779
        failing since 1 day (last pass: next-20211224, first fail: next-20220105)

    2022-01-06T21:35:33.021385  /lava-74503/1/../bin/lava-test-case
    2022-01-06T21:35:33.024417  <8>[   19.639214] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=caam_jr-jr0-probed RESULT=fail>   

  * baseline.bootrr.caam_jr-jr1-probed: https://kernelci.org/test/case/id/61d760b31f413080e9ef677a
        failing since 1 day (last pass: next-20211224, first fail: next-20220105)

    2022-01-06T21:35:34.040555  /lava-74503/1/../bin/lava-test-case
    2022-01-06T21:35:34.043618  <8>[   20.657882] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=caam_jr-jr1-probed RESULT=fail>   

  * baseline.bootrr.caam_jr-jr2-probed: https://kernelci.org/test/case/id/61d760b31f413080e9ef677b
        failing since 1 day (last pass: next-20211224, first fail: next-20220105)

    2022-01-06T21:35:35.059465  /lava-74503/1/../bin/lava-test-case
    2022-01-06T21:35:35.065443  <8>[   21.677232] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=caam_jr-jr2-probed RESULT=fail>   

  * baseline.bootrr.caam_jr-jr3-probed: https://kernelci.org/test/case/id/61d760b31f413080e9ef677c
        failing since 1 day (last pass: next-20211224, first fail: next-20220105)

    2022-01-06T21:35:36.116559  /lava-74503/1/../bin/lava-test-case
    2022-01-06T21:35:36.116854  <8>[   22.696487] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=caam_jr-jr3-probed RESULT=fail>
    2022-01-06T21:35:36.117009  /lava-74503/1/../bin/lava-test-case
    2022-01-06T21:35:36.117152  <8>[   22.713109] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=sp805-wdt-driver-present RESULT=pass>
    2022-01-06T21:35:36.117298  /lava-74503/1/../bin/lava-test-case
    2022-01-06T21:35:36.117436  <8>[   22.729148] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=sp805-wdt-watchdog0-probed RESULT=pass>
    2022-01-06T21:35:36.117571  /lava-74503/1/../bin/lava-test-case   

  * baseline.bootrr.ftm-alarm-driver-present: https://kernelci.org/test/case/id/61d760b31f413080e9ef6786
        failing since 17 days (last pass: next-20211216, first fail: next-20211220)

    2022-01-06T21:35:37.248096  /lava-74503/1/../bin/lava-test-case   

  * baseline.bootrr.ftm-alarm-probed: https://kernelci.org/test/case/id/61d760b31f413080e9ef6787
        failing since 17 days (last pass: next-20211216, first fail: next-20211220)

    2022-01-06T21:35:37.251223  <8>[   23.860510] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=ftm-alarm-driver-present RESULT=fail>
    2022-01-06T21:35:38.300236  /lava-74503/1/../bin/lava-test-case
    2022-01-06T21:35:38.300644  <8>[   24.879670] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=ftm-alarm-probed RESULT=fail>   

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
kontron-kbox-a-230-ls        | arm64  | lab-kontron     | gcc-10   | defconfig+crypto             | 2          

  Details:     https://kernelci.org/test/plan/id/61d762a7ef37b7f193ef677e

  Results:     91 PASS, 2 FAIL, 0 SKIP
  Full config: defconfig+crypto
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig+crypto/gcc-10/lab-kontron/baseline-kontron-kbox-a-230-ls.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig+crypto/gcc-10/lab-kontron/baseline-kontron-kbox-a-230-ls.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20211210.0/arm64/rootfs.cpio.gz 

  * baseline.bootrr.ftm-alarm-driver-present: https://kernelci.org/test/case/id/61d762a7ef37b7f193ef67c3
        failing since 16 days (last pass: next-20211216, first fail: next-20211221)

    2022-01-06T21:43:32.309069  /lava-74511/1/../bin/lava-test-case   

  * baseline.bootrr.ftm-alarm-probed: https://kernelci.org/test/case/id/61d762a7ef37b7f193ef67c4
        failing since 16 days (last pass: next-20211216, first fail: next-20211221)

    2022-01-06T21:43:32.311859  <8>[   17.818802] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=ftm-alarm-driver-present RESULT=fail>
    2022-01-06T21:43:33.358125  /lava-74511/1/../bin/lava-test-case
    2022-01-06T21:43:33.358416  <8>[   18.838234] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=ftm-alarm-probed RESULT=fail>
    2022-01-06T21:43:33.358566  /lava-74511/1/../bin/lava-test-case
    2022-01-06T21:43:33.358705  <8>[   18.854097] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=simple-mfd-i2c-driver-present RESULT=pass>
    2022-01-06T21:43:33.358846  /lava-74511/1/../bin/lava-test-case
    2022-01-06T21:43:33.359065  <8>[   18.869945] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=simple-mfd-i2c-probed RESULT=pass>
    2022-01-06T21:43:33.359210  /lava-74511/1/../bin/lava-test-case   

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
kontron-sl28-var3-ads2       | arm64  | lab-kontron     | gcc-10   | defconfig                    | 2          

  Details:     https://kernelci.org/test/plan/id/61d75b61fab2eef69def675b

  Results:     99 PASS, 2 FAIL, 0 SKIP
  Full config: defconfig
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig/gcc-10/lab-kontron/baseline-kontron-sl28-var3-ads2.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig/gcc-10/lab-kontron/baseline-kontron-sl28-var3-ads2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20211210.0/arm64/rootfs.cpio.gz 

  * baseline.bootrr.ftm-alarm-driver-present: https://kernelci.org/test/case/id/61d75b61fab2eef69def67a7
        failing since 19 days (last pass: next-20211216, first fail: next-20211217)

    2022-01-06T21:12:59.414021  /lava-74486/1/../bin/lava-test-case   

  * baseline.bootrr.ftm-alarm-probed: https://kernelci.org/test/case/id/61d75b61fab2eef69def67a8
        failing since 19 days (last pass: next-20211216, first fail: next-20211217)

    2022-01-06T21:12:59.419219  <8>[   13.574594] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=ftm-alarm-driver-present RESULT=fail>
    2022-01-06T21:13:00.467562  /lava-74486/1/../bin/lava-test-case
    2022-01-06T21:13:00.470241  <8>[   14.593998] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=ftm-alarm-probed RESULT=fail>
    2022-01-06T21:13:00.474052  /lava-74486/1/../bin/lava-test-case
    2022-01-06T21:13:00.474928  <8>[   14.609888] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=simple-mfd-i2c-driver-present RESULT=pass>
    2022-01-06T21:13:00.475679  /lava-74486/1/../bin/lava-test-case
    2022-01-06T21:13:00.475873  <8>[   14.627515] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=simple-mfd-i2c-probed RESULT=pass>
    2022-01-06T21:13:00.476051  /lava-74486/1/../bin/lava-test-case   

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
kontron-sl28-var3-ads2       | arm64  | lab-kontron     | gcc-10   | defconfig+CON...OMIZE_BASE=y | 2          

  Details:     https://kernelci.org/test/plan/id/61d75f10c33ca46c5def6745

  Results:     99 PASS, 2 FAIL, 0 SKIP
  Full config: defconfig+CONFIG_RANDOMIZE_BASE=y
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig+config_randomize_base=y/gcc-10/lab-kontron/baseline-kontron-sl28-var3-ads2.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig+config_randomize_base=y/gcc-10/lab-kontron/baseline-kontron-sl28-var3-ads2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20211210.0/arm64/rootfs.cpio.gz 

  * baseline.bootrr.ftm-alarm-driver-present: https://kernelci.org/test/case/id/61d75f10c33ca46c5def6791
        failing since 16 days (last pass: next-20211216, first fail: next-20211221)

    2022-01-06T21:28:23.492408  /lava-74496/1/../bin/lava-test-case   

  * baseline.bootrr.ftm-alarm-probed: https://kernelci.org/test/case/id/61d75f10c33ca46c5def6792
        failing since 16 days (last pass: next-20211216, first fail: next-20211221)

    2022-01-06T21:28:23.495846  <8>[   13.546206] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=ftm-alarm-driver-present RESULT=fail>
    2022-01-06T21:28:24.541822  /lava-74496/1/../bin/lava-test-case
    2022-01-06T21:28:24.542220  <8>[   14.564861] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=ftm-alarm-probed RESULT=fail>
    2022-01-06T21:28:24.542459  /lava-74496/1/../bin/lava-test-case
    2022-01-06T21:28:24.542685  <8>[   14.580738] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=simple-mfd-i2c-driver-present RESULT=pass>   

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
kontron-sl28-var3-ads2       | arm64  | lab-kontron     | gcc-10   | defconfig+CON..._64K_PAGES=y | 2          

  Details:     https://kernelci.org/test/plan/id/61d760ee7f0c415d37ef676a

  Results:     99 PASS, 2 FAIL, 0 SKIP
  Full config: defconfig+CONFIG_ARM64_64K_PAGES=y
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig+config_arm64_64k_pages=y/gcc-10/lab-kontron/baseline-kontron-sl28-var3-ads2.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig+config_arm64_64k_pages=y/gcc-10/lab-kontron/baseline-kontron-sl28-var3-ads2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20211210.0/arm64/rootfs.cpio.gz 

  * baseline.bootrr.ftm-alarm-driver-present: https://kernelci.org/test/case/id/61d760ee7f0c415d37ef67b6
        failing since 17 days (last pass: next-20211216, first fail: next-20211220)

    2022-01-06T21:36:31.891758  /lava-74502/1/../bin/lava-test-case   

  * baseline.bootrr.ftm-alarm-probed: https://kernelci.org/test/case/id/61d760ee7f0c415d37ef67b7
        failing since 17 days (last pass: next-20211216, first fail: next-20211220)

    2022-01-06T21:36:31.894833  <8>[   14.005888] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=ftm-alarm-driver-present RESULT=fail>
    2022-01-06T21:36:32.946989  /lava-74502/1/../bin/lava-test-case
    2022-01-06T21:36:32.947654  <8>[   15.025442] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=ftm-alarm-probed RESULT=fail>
    2022-01-06T21:36:32.947976  /lava-74502/1/../bin/lava-test-case
    2022-01-06T21:36:32.948214  <8>[   15.041411] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=simple-mfd-i2c-driver-present RESULT=pass>
    2022-01-06T21:36:32.948447  /lava-74502/1/../bin/lava-test-case
    2022-01-06T21:36:32.948763  <8>[   15.060165] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=simple-mfd-i2c-probed RESULT=pass>
    2022-01-06T21:36:32.949035  /lava-74502/1/../bin/lava-test-case   

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
kontron-sl28-var3-ads2       | arm64  | lab-kontron     | gcc-10   | defconfig+crypto             | 2          

  Details:     https://kernelci.org/test/plan/id/61d76153580b61af8eef674c

  Results:     99 PASS, 2 FAIL, 0 SKIP
  Full config: defconfig+crypto
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig+crypto/gcc-10/lab-kontron/baseline-kontron-sl28-var3-ads2.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig+crypto/gcc-10/lab-kontron/baseline-kontron-sl28-var3-ads2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20211210.0/arm64/rootfs.cpio.gz 

  * baseline.bootrr.ftm-alarm-driver-present: https://kernelci.org/test/case/id/61d76153580b61af8eef6798
        failing since 16 days (last pass: next-20211216, first fail: next-20211221)

    2022-01-06T21:38:14.721632  <8>[   12.527371] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=rcpm-probed RESULT=pass>
    2022-01-06T21:38:15.739962  /lava-74510/1/../bin/lava-test-case   

  * baseline.bootrr.ftm-alarm-probed: https://kernelci.org/test/case/id/61d76153580b61af8eef6799
        failing since 16 days (last pass: next-20211216, first fail: next-20211221)

    2022-01-06T21:38:15.743125  <8>[   13.546728] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=ftm-alarm-driver-present RESULT=fail>
    2022-01-06T21:38:16.789047  /lava-74510/1/../bin/lava-test-case
    2022-01-06T21:38:16.789426  <8>[   14.565358] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=ftm-alarm-probed RESULT=fail>   

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
meson-g12a-sei510            | arm64  | lab-baylibre    | gcc-10   | defconfig+CON..._64K_PAGES=y | 1          

  Details:     https://kernelci.org/test/plan/id/61d75e8c30776ba690ef675f

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+CONFIG_ARM64_64K_PAGES=y
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig+config_arm64_64k_pages=y/gcc-10/lab-baylibre/baseline-meson-g12a-sei510.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig+config_arm64_64k_pages=y/gcc-10/lab-baylibre/baseline-meson-g12a-sei510.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20211210.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/61d75e8c30776ba690ef6760
        failing since 2 days (last pass: next-20211224, first fail: next-20220104) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
meson-g12a-u200              | arm64  | lab-baylibre    | gcc-10   | defconfig+CON..._64K_PAGES=y | 1          

  Details:     https://kernelci.org/test/plan/id/61d75ed2881e501e12ef6753

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+CONFIG_ARM64_64K_PAGES=y
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig+config_arm64_64k_pages=y/gcc-10/lab-baylibre/baseline-meson-g12a-u200.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig+config_arm64_64k_pages=y/gcc-10/lab-baylibre/baseline-meson-g12a-u200.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20211210.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/61d75ed2881e501e12ef6754
        failing since 2 days (last pass: next-20211224, first fail: next-20220104) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
meson-g12a-x96-max           | arm64  | lab-baylibre    | gcc-10   | defconfig+CON..._64K_PAGES=y | 1          

  Details:     https://kernelci.org/test/plan/id/61d75ed59a98e003a7ef6753

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+CONFIG_ARM64_64K_PAGES=y
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig+config_arm64_64k_pages=y/gcc-10/lab-baylibre/baseline-meson-g12a-x96-max.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig+config_arm64_64k_pages=y/gcc-10/lab-baylibre/baseline-meson-g12a-x96-max.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20211210.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/61d75ed59a98e003a7ef6754
        failing since 2 days (last pass: next-20211224, first fail: next-20220104) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
meson-g12b-a311d-khadas-vim3 | arm64  | lab-baylibre    | gcc-10   | defconfig+CON..._64K_PAGES=y | 1          

  Details:     https://kernelci.org/test/plan/id/61d75eeb0ae8b54d08ef6776

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+CONFIG_ARM64_64K_PAGES=y
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig+config_arm64_64k_pages=y/gcc-10/lab-baylibre/baseline-meson-g12b-a311d-khadas-vim3.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig+config_arm64_64k_pages=y/gcc-10/lab-baylibre/baseline-meson-g12b-a311d-khadas-vim3.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20211210.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/61d75eeb0ae8b54d08ef6777
        failing since 1 day (last pass: next-20211224, first fail: next-20220105) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
meson-g12b-a311d-khadas-vim3 | arm64  | lab-collabora   | gcc-10   | defconfig+CON..._64K_PAGES=y | 1          

  Details:     https://kernelci.org/test/plan/id/61d75ea4a6c5584762ef6752

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+CONFIG_ARM64_64K_PAGES=y
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig+config_arm64_64k_pages=y/gcc-10/lab-collabora/baseline-meson-g12b-a311d-khadas-vim3.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig+config_arm64_64k_pages=y/gcc-10/lab-collabora/baseline-meson-g12b-a311d-khadas-vim3.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20211210.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/61d75ea4a6c5584762ef6753
        failing since 1 day (last pass: next-20211224, first fail: next-20220105) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
meson-g12b-odroid-n2         | arm64  | lab-baylibre    | gcc-10   | defconfig+CON..._64K_PAGES=y | 1          

  Details:     https://kernelci.org/test/plan/id/61d75ed80ae8b54d08ef6758

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+CONFIG_ARM64_64K_PAGES=y
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig+config_arm64_64k_pages=y/gcc-10/lab-baylibre/baseline-meson-g12b-odroid-n2.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig+config_arm64_64k_pages=y/gcc-10/lab-baylibre/baseline-meson-g12b-odroid-n2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20211210.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/61d75ed80ae8b54d08ef6759
        failing since 2 days (last pass: next-20211224, first fail: next-20220104) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
meson-gxl-s905d-p230         | arm64  | lab-baylibre    | gcc-10   | defconfig+CON..._64K_PAGES=y | 1          

  Details:     https://kernelci.org/test/plan/id/61d76a8e4e37843c5aef6745

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+CONFIG_ARM64_64K_PAGES=y
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig+config_arm64_64k_pages=y/gcc-10/lab-baylibre/baseline-meson-gxl-s905d-p230.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig+config_arm64_64k_pages=y/gcc-10/lab-baylibre/baseline-meson-gxl-s905d-p230.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20211210.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/61d76a8e4e37843c5aef6746
        failing since 2 days (last pass: next-20211118, first fail: next-20220104) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
meson-gxl-s905x-libretech-cc | arm64  | lab-clabbe      | gcc-10   | defconfig+CON..._64K_PAGES=y | 1          

  Details:     https://kernelci.org/test/plan/id/61d75ee80ae8b54d08ef675f

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+CONFIG_ARM64_64K_PAGES=y
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig+config_arm64_64k_pages=y/gcc-10/lab-clabbe/baseline-meson-gxl-s905x-libretech-cc.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig+config_arm64_64k_pages=y/gcc-10/lab-clabbe/baseline-meson-gxl-s905x-libretech-cc.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20211210.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/61d75ee80ae8b54d08ef6760
        failing since 2 days (last pass: next-20211224, first fail: next-20220104) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
meson-gxm-khadas-vim2        | arm64  | lab-baylibre    | gcc-10   | defconfig+CON..._64K_PAGES=y | 1          

  Details:     https://kernelci.org/test/plan/id/61d7791c588c3c3f12ef677d

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+CONFIG_ARM64_64K_PAGES=y
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig+config_arm64_64k_pages=y/gcc-10/lab-baylibre/baseline-meson-gxm-khadas-vim2.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig+config_arm64_64k_pages=y/gcc-10/lab-baylibre/baseline-meson-gxm-khadas-vim2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20211210.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/61d7791c588c3c3f12ef677e
        failing since 2 days (last pass: next-20211224, first fail: next-20220104) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
meson-sm1-khadas-vim3l       | arm64  | lab-baylibre    | gcc-10   | defconfig+CON..._64K_PAGES=y | 1          

  Details:     https://kernelci.org/test/plan/id/61d75efb4160a5f9c0ef674d

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+CONFIG_ARM64_64K_PAGES=y
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig+config_arm64_64k_pages=y/gcc-10/lab-baylibre/baseline-meson-sm1-khadas-vim3l.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig+config_arm64_64k_pages=y/gcc-10/lab-baylibre/baseline-meson-sm1-khadas-vim3l.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20211210.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/61d75efb4160a5f9c0ef674e
        failing since 2 days (last pass: next-20211224, first fail: next-20220104) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
meson-sm1-sei610             | arm64  | lab-baylibre    | gcc-10   | defconfig+CON..._64K_PAGES=y | 1          

  Details:     https://kernelci.org/test/plan/id/61d75ed6881e501e12ef6759

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+CONFIG_ARM64_64K_PAGES=y
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig+config_arm64_64k_pages=y/gcc-10/lab-baylibre/baseline-meson-sm1-sei610.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig+config_arm64_64k_pages=y/gcc-10/lab-baylibre/baseline-meson-sm1-sei610.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20211210.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/61d75ed6881e501e12ef675a
        failing since 2 days (last pass: next-20211224, first fail: next-20220104) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
qemu_arm64-virt-gicv2-uefi   | arm64  | lab-baylibre    | gcc-10   | defconfig+debug              | 1          

  Details:     https://kernelci.org/test/plan/id/61d75c2afe5d363993ef6768

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+debug
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_arm64-virt-gicv2-uefi.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_arm64-virt-gicv2-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20211210.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/61d75c2afe5d363993ef6769
        failing since 23 days (last pass: v5.16-rc4-6579-gea922272cbe5, first fail: v5.16-rc5-6644-gbcd5ddb85fad) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
qemu_arm64-virt-gicv2-uefi   | arm64  | lab-cip         | gcc-10   | defconfig+debug              | 1          

  Details:     https://kernelci.org/test/plan/id/61d75dd799239ee507ef674a

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+debug
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig+debug/gcc-10/lab-cip/baseline-qemu_arm64-virt-gicv2-uefi.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig+debug/gcc-10/lab-cip/baseline-qemu_arm64-virt-gicv2-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20211210.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/61d75dd799239ee507ef674b
        failing since 23 days (last pass: v5.16-rc4-6579-gea922272cbe5, first fail: v5.16-rc5-6644-gbcd5ddb85fad) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
qemu_arm64-virt-gicv2-uefi   | arm64  | lab-collabora   | gcc-10   | defconfig+debug              | 1          

  Details:     https://kernelci.org/test/plan/id/61d75c1aebc6362fadef6761

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+debug
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig+debug/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv2-uefi.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig+debug/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv2-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20211210.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/61d75c1aebc6362fadef6762
        failing since 23 days (last pass: v5.16-rc4-6579-gea922272cbe5, first fail: v5.16-rc5-6644-gbcd5ddb85fad) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
qemu_arm64-virt-gicv2-uefi   | arm64  | lab-collabora   | gcc-10   | defconfig+CON..._64K_PAGES=y | 1          

  Details:     https://kernelci.org/test/plan/id/61d75e8e30776ba690ef6765

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+CONFIG_ARM64_64K_PAGES=y
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig+config_arm64_64k_pages=y/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv2-uefi.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig+config_arm64_64k_pages=y/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv2-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20211210.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/61d75e8e30776ba690ef6766
        failing since 1 day (last pass: next-20211224, first fail: next-20220104) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
qemu_arm64-virt-gicv2-uefi   | arm64  | lab-linaro-lkft | gcc-10   | defconfig+debug              | 1          

  Details:     https://kernelci.org/test/plan/id/61d75c0febc6362fadef6743

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+debug
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig+debug/gcc-10/lab-linaro-lkft/baseline-qemu_arm64-virt-gicv2-uefi.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig+debug/gcc-10/lab-linaro-lkft/baseline-qemu_arm64-virt-gicv2-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20211210.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/61d75c0febc6362fadef6744
        failing since 23 days (last pass: v5.16-rc4-6579-gea922272cbe5, first fail: v5.16-rc5-6644-gbcd5ddb85fad) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
qemu_arm64-virt-gicv2-uefi   | arm64  | lab-linaro-lkft | gcc-10   | defconfig+CON..._64K_PAGES=y | 1          

  Details:     https://kernelci.org/test/plan/id/61d75e8c30776ba690ef6762

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+CONFIG_ARM64_64K_PAGES=y
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig+config_arm64_64k_pages=y/gcc-10/lab-linaro-lkft/baseline-qemu_arm64-virt-gicv2-uefi.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig+config_arm64_64k_pages=y/gcc-10/lab-linaro-lkft/baseline-qemu_arm64-virt-gicv2-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20211210.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/61d75e8c30776ba690ef6763
        failing since 1 day (last pass: next-20211224, first fail: next-20220104) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
qemu_arm64-virt-gicv3-uefi   | arm64  | lab-baylibre    | gcc-10   | defconfig+debug              | 1          

  Details:     https://kernelci.org/test/plan/id/61d75c17ebc6362fadef6755

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+debug
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_arm64-virt-gicv3-uefi.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_arm64-virt-gicv3-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20211210.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/61d75c17ebc6362fadef6756
        failing since 22 days (last pass: v5.16-rc5-6644-gbcd5ddb85fad, first fail: next-20211214) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
qemu_arm64-virt-gicv3-uefi   | arm64  | lab-cip         | gcc-10   | defconfig+debug              | 1          

  Details:     https://kernelci.org/test/plan/id/61d75c6ee38f68cd91ef6749

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+debug
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig+debug/gcc-10/lab-cip/baseline-qemu_arm64-virt-gicv3-uefi.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig+debug/gcc-10/lab-cip/baseline-qemu_arm64-virt-gicv3-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20211210.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/61d75c6ee38f68cd91ef674a
        failing since 22 days (last pass: v5.16-rc5-6644-gbcd5ddb85fad, first fail: next-20211214) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
qemu_arm64-virt-gicv3-uefi   | arm64  | lab-collabora   | gcc-10   | defconfig+debug              | 1          

  Details:     https://kernelci.org/test/plan/id/61d75c18ebc6362fadef675b

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+debug
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig+debug/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv3-uefi.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig+debug/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv3-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20211210.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/61d75c18ebc6362fadef675c
        failing since 22 days (last pass: v5.16-rc5-6644-gbcd5ddb85fad, first fail: next-20211214) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
qemu_arm64-virt-gicv3-uefi   | arm64  | lab-collabora   | gcc-10   | defconfig+CON..._64K_PAGES=y | 1          

  Details:     https://kernelci.org/test/plan/id/61d75e8b30776ba690ef675c

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+CONFIG_ARM64_64K_PAGES=y
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig+config_arm64_64k_pages=y/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv3-uefi.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig+config_arm64_64k_pages=y/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv3-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20211210.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/61d75e8b30776ba690ef675d
        failing since 1 day (last pass: next-20211224, first fail: next-20220104) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
qemu_arm64-virt-gicv3-uefi   | arm64  | lab-linaro-lkft | gcc-10   | defconfig+debug              | 1          

  Details:     https://kernelci.org/test/plan/id/61d75c0ea076796c11ef6755

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+debug
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig+debug/gcc-10/lab-linaro-lkft/baseline-qemu_arm64-virt-gicv3-uefi.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig+debug/gcc-10/lab-linaro-lkft/baseline-qemu_arm64-virt-gicv3-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20211210.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/61d75c0ea076796c11ef6756
        failing since 22 days (last pass: v5.16-rc5-6644-gbcd5ddb85fad, first fail: next-20211214) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
qemu_arm64-virt-gicv3-uefi   | arm64  | lab-linaro-lkft | gcc-10   | defconfig+CON..._64K_PAGES=y | 1          

  Details:     https://kernelci.org/test/plan/id/61d75e7a8c618b3cd2ef6764

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+CONFIG_ARM64_64K_PAGES=y
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig+config_arm64_64k_pages=y/gcc-10/lab-linaro-lkft/baseline-qemu_arm64-virt-gicv3-uefi.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig+config_arm64_64k_pages=y/gcc-10/lab-linaro-lkft/baseline-qemu_arm64-virt-gicv3-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20211210.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/61d75e7a8c618b3cd2ef6765
        failing since 1 day (last pass: next-20211224, first fail: next-20220104) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
qemu_x86_64-uefi             | x86_64 | lab-cip         | clang-14 | x86_64_defconfig             | 1          

  Details:     https://kernelci.org/test/plan/id/61d75de6991f80e03cef6753

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig
  Compiler:    clang-14 (Debian clang version 14.0.0-++20220103071835+5527139302d9-1~exp1~20220103071942.109)
  Plain log:   https://storage.kernelci.org//next/master/next-20220106/x86_64/x86_64_defconfig/clang-14/lab-cip/baseline-qemu_x86_64-uefi.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220106/x86_64/x86_64_defconfig/clang-14/lab-cip/baseline-qemu_x86_64-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20211210.0/x86/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/61d75de6991f80e03cef6754
        new failure (last pass: next-20220104) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
r8a774c0-ek874               | arm64  | lab-cip         | gcc-10   | defconfig                    | 2          

  Details:     https://kernelci.org/test/plan/id/61d75ca03b06e6484bef67b7

  Results:     4 PASS, 2 FAIL, 0 SKIP
  Full config: defconfig
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig/gcc-10/lab-cip/baseline-r8a774c0-ek874.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig/gcc-10/lab-cip/baseline-r8a774c0-ek874.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20211210.0/arm64/rootfs.cpio.gz 

  * baseline.dmesg.emerg: https://kernelci.org/test/case/id/61d75ca03b06e6484bef67ba
        failing since 2 days (last pass: next-20211224, first fail: next-20220104)
        2 lines

    2022-01-06T21:17:51.585962  kern  :alert :   ISV = 0, ISS = 0x00000006
    2022-01-06T21:17:51.586070  kern  :alert :   CM = 0, WnR = 0
    2022-01-06T21:17:51.586191  kern  :alert : user pgtable: 4k pages<8>[   15.615922] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=emerg RESULT=fail UNITS=lines MEASUREMENT=2>
    2022-01-06T21:17:51.586296  , 48-bit VAs, pgdp=000000007f84c000
    2022-01-06T21:17:51.586378  ker<8>[   15.628094] <LAVA_SIGNAL_ENDRUN 0_dmesg 591206_1.5.2.4.1>
    2022-01-06T21:17:51.586458  n  :alert : [0000000000000000] pgd=080000007f90a003
    2022-01-06T21:17:51.586537  kern  :emerg : Internal error: Oops: 96000006 [#1] PREEMPT SMP   

  * baseline.dmesg.alert: https://kernelci.org/test/case/id/61d75ca03b06e6484bef67bb
        failing since 2 days (last pass: next-20211224, first fail: next-20220104)
        12 lines

    2022-01-06T21:17:51.542734  kern  :alert : Unable to handle kernel NULL pointer dereference at virtual address 0000000000000000
    2022-01-06T21:17:51.542859  kern  :alert : Mem abort info:
    2022-01-06T21:17:51.542951  ker<8>[   15.575025] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=alert RESULT=fail UNITS=lines MEASUREMENT=12>
    2022-01-06T21:17:51.543076  n  :alert :   ESR = 0x96000006
    2022-01-06T21:17:51.543176  kern  :alert :   EC = 0x25: DABT (current EL), IL = 32 bits
    2022-01-06T21:17:51.543258  kern  :alert :   SET = 0, FnV = 0
    2022-01-06T21:17:51.543336  kern  :alert :   EA = 0, S1PTW = 0
    2022-01-06T21:17:51.543413  kern  :alert :   FSC = 0x06: level 2 translation fault
    2022-01-06T21:17:51.543490  kern  :alert : Data abort info:   

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
r8a774c0-ek874               | arm64  | lab-cip         | gcc-10   | defconfig+CON...OMIZE_BASE=y | 2          

  Details:     https://kernelci.org/test/plan/id/61d763e2ee4dd87becef675e

  Results:     4 PASS, 2 FAIL, 0 SKIP
  Full config: defconfig+CONFIG_RANDOMIZE_BASE=y
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig+config_randomize_base=y/gcc-10/lab-cip/baseline-r8a774c0-ek874.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig+config_randomize_base=y/gcc-10/lab-cip/baseline-r8a774c0-ek874.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20211210.0/arm64/rootfs.cpio.gz 

  * baseline.dmesg.emerg: https://kernelci.org/test/case/id/61d763e2ee4dd87becef6761
        failing since 2 days (last pass: next-20211223, first fail: next-20220104)
        2 lines

    2022-01-06T21:49:02.142549  kern  :alert :   SET = 0, FnV = 0
    2022-01-06T21:49:02.142640  kern  :alert :   EA = 0, S1PTW = 0
    2022-01-06T21:49:02.142719  kern  :alert :   FSC = 0x06: level 2 translation fault
    2022-01-06T21:49:02.142796  kern  :alert : Data abort info:
    2022-01-06T21:49:02.184828  kern  :alert :   ISV = 0, ISS = 0x00000006
    2022-01-06T21:49:02.184950  kern  :alert :   CM = 0, WnR = 0
    2022-01-06T21:49:02.185063  kern  :alert : user pgtable: 4k pages<8>[   16.163555] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=emerg RESULT=fail UNITS=lines MEASUREMENT=2>
    2022-01-06T21:49:02.185181  , 48-bit VAs, pgdp=000000007f9b9000
    2022-01-06T21:49:02.185285  ker<8>[   16.175647] <LAVA_SIGNAL_ENDRUN 0_dmesg 591253_1.5.2.4.1>
    2022-01-06T21:49:02.185386  n  :alert : [0000000000000000] pgd=080000007f9ba003, p4d=080000007f9ba003, pud=080000004fb5d003, pmd=0000000000000000 
    ... (1 line(s) more)  

  * baseline.dmesg.alert: https://kernelci.org/test/case/id/61d763e2ee4dd87becef6762
        failing since 2 days (last pass: next-20211223, first fail: next-20220104)
        12 lines

    2022-01-06T21:49:02.141625  kern  :alert : Unable to handle kernel NULL pointer dereference at virtual address 0000000000000000
    2022-01-06T21:49:02.141745  kern  :alert : Mem abort info:
    2022-01-06T21:49:02.141834  ker<8>[   16.122684] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=alert RESULT=fail UNITS=lines MEASUREMENT=12>
    2022-01-06T21:49:02.141917  n  :alert :   ESR = 0x96000006
    2022-01-06T21:49:02.141998  kern  :alert :   EC = 0x25: DABT (current EL), IL = 32 bits   

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
r8a774c0-ek874               | arm64  | lab-cip         | gcc-10   | defconfig+CON..._64K_PAGES=y | 1          

  Details:     https://kernelci.org/test/plan/id/61d76510007a0efd1bef6756

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+CONFIG_ARM64_64K_PAGES=y
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig+config_arm64_64k_pages=y/gcc-10/lab-cip/baseline-r8a774c0-ek874.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig+config_arm64_64k_pages=y/gcc-10/lab-cip/baseline-r8a774c0-ek874.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20211210.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/61d76510007a0efd1bef6757
        failing since 2 days (last pass: next-20211224, first fail: next-20220104) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
r8a774c0-ek874               | arm64  | lab-cip         | gcc-10   | defconfig+crypto             | 2          

  Details:     https://kernelci.org/test/plan/id/61d766db5e73723340ef675e

  Results:     4 PASS, 2 FAIL, 0 SKIP
  Full config: defconfig+crypto
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig+crypto/gcc-10/lab-cip/baseline-r8a774c0-ek874.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig+crypto/gcc-10/lab-cip/baseline-r8a774c0-ek874.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20211210.0/arm64/rootfs.cpio.gz 

  * baseline.dmesg.emerg: https://kernelci.org/test/case/id/61d766db5e73723340ef6761
        failing since 2 days (last pass: next-20211224, first fail: next-20220104)
        2 lines

    2022-01-06T22:01:37.776954  kern  :alert :   ISV = 0, ISS = 0x00000006
    2022-01-06T22:01:37.777078  kern  :alert :   CM = 0, WnR = 0
    2022-01-06T22:01:37.777219  kern  :alert : user pgtable: <8>[   16.164708] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=emerg RESULT=fail UNITS=lines MEASUREMENT=2>
    2022-01-06T22:01:37.777329  4k pages, 48-bit VAs, pgdp=000000007fa01<8>[   16.176701] <LAVA_SIGNAL_ENDRUN 0_dmesg 591318_1.5.2.4.1>
    2022-01-06T22:01:37.777436  000
    2022-01-06T22:01:37.777521  kern  :alert : [0000000000000000] pgd=080000007fa02003, p4d=080000007fa02003, pud=080000007fa03003, pmd=0000000000000000
    2022-01-06T22:01:37.777604  kern  :emerg : Internal error: Oops: 96000006 [#1] PREEMPT SMP   

  * baseline.dmesg.alert: https://kernelci.org/test/case/id/61d766db5e73723340ef6762
        failing since 2 days (last pass: next-20211224, first fail: next-20220104)
        12 lines

    2022-01-06T22:01:37.733784  kern  :alert : Unable to handle kernel NULL pointer dereference at virtual address 0000000000000000
    2022-01-06T22:01:37.733894  kern  :alert : Mem abort info:
    2022-01-06T22:01:37.734014  ker<8>[   16.124346] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=alert RESULT=fail UNITS=lines MEASUREMENT=12>
    2022-01-06T22:01:37.734101  n  :alert :   ESR = 0x96000006
    2022-01-06T22:01:37.734183  kern  :alert :   EC = 0x25: DABT (current EL), IL = 32 bits
    2022-01-06T22:01:37.734262  kern  :alert :   SET = 0, FnV = 0
    2022-01-06T22:01:37.734365  kern  :alert :   EA = 0, S1PTW = 0
    2022-01-06T22:01:37.734442  kern  :alert :   FSC = 0x06: level 2 translation fault
    2022-01-06T22:01:37.734517  kern  :alert : Data abort info:   

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
r8a774c0-ek874               | arm64  | lab-cip         | gcc-10   | defconfig+arm64-chromebook   | 2          

  Details:     https://kernelci.org/test/plan/id/61d7687e6f9c72ab2aef6755

  Results:     4 PASS, 2 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig+arm64-chromebook/gcc-10/lab-cip/baseline-r8a774c0-ek874.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig+arm64-chromebook/gcc-10/lab-cip/baseline-r8a774c0-ek874.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20211210.0/arm64/rootfs.cpio.gz 

  * baseline.dmesg.emerg: https://kernelci.org/test/case/id/61d7687e6f9c72ab2aef6758
        failing since 2 days (last pass: next-20211223, first fail: next-20220104)
        2 lines

    2022-01-06T22:08:44.686813  kern  :alert :   ISV = 0, ISS = 0x00000006
    2022-01-06T22:08:44.686938  kern  :alert :   CM = 0, WnR = 0
    2022-01-06T22:08:44.687050  kern  :alert : user pgtable: 4k pages<8>[   15.696431] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=emerg RESULT=fail UNITS=lines MEASUREMENT=2>
    2022-01-06T22:08:44.687159  , 48-bit VAs, pgdp=000000007fa04000
    2022-01-06T22:08:44.687262  ker<8>[   15.708084] <LAVA_SIGNAL_ENDRUN 0_dmesg 591343_1.5.2.4.1>
    2022-01-06T22:08:44.687364  n  :alert : [0000000000000000] pgd=080000007fa05003, p4d=080000007fa05003, pud=080000007fa06003, pmd=0000000000000000
    2022-01-06T22:08:44.687448  kern  :emerg : Internal error: Oops: 96000006 [#1] PREEMPT SMP   

  * baseline.dmesg.alert: https://kernelci.org/test/case/id/61d7687e6f9c72ab2aef6759
        failing since 2 days (last pass: next-20211223, first fail: next-20220104)
        12 lines

    2022-01-06T22:08:44.643633  kern  :alert : Unable to handle kernel NULL pointer dereference at virtual address 0000000000000000
    2022-01-06T22:08:44.643752  kern  :alert : Mem abort info:
    2022-01-06T22:08:44.643841  ker<8>[   15.655350] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=alert RESULT=fail UNITS=lines MEASUREMENT=12>
    2022-01-06T22:08:44.643925  n  :alert :   ESR = 0x96000006
    2022-01-06T22:08:44.644006  kern  :alert :   EC = 0x25: DABT (current EL), IL = 32 bits
    2022-01-06T22:08:44.644085  kern  :alert :   SET = 0, FnV = 0
    2022-01-06T22:08:44.644162  kern  :alert :   EA = 0, S1PTW = 0
    2022-01-06T22:08:44.644238  kern  :alert :   FSC = 0x06: level 2 translation fault
    2022-01-06T22:08:44.644313  kern  :alert : Data abort info:   

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
tegra124-nyan-big            | arm    | lab-collabora   | gcc-10   | multi_v7_defconfig           | 1          

  Details:     https://kernelci.org/test/plan/id/61d7643e0c71489949ef6751

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220106/arm/multi_v7_defconfig/gcc-10/lab-collabora/baseline-tegra124-nyan-big.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220106/arm/multi_v7_defconfig/gcc-10/lab-collabora/baseline-tegra124-nyan-big.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20211210.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/61d7643e0c71489949ef6752
        failing since 1 day (last pass: next-20211222, first fail: next-20220105) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
tegra124-nyan-big            | arm    | lab-collabora   | gcc-10   | multi_v7_defc...MB2_KERNEL=y | 1          

  Details:     https://kernelci.org/test/plan/id/61d7737c63c9023b8eef673e

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220106/arm/multi_v7_defconfig+config_thumb2_kernel=y/gcc-10/lab-collabora/baseline-tegra124-nyan-big.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220106/arm/multi_v7_defconfig+config_thumb2_kernel=y/gcc-10/lab-collabora/baseline-tegra124-nyan-big.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20211210.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/61d7737c63c9023b8eef673f
        failing since 1 day (last pass: next-20211223, first fail: next-20220105) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
zynqmp-zcu102                | arm64  | lab-cip         | gcc-10   | defconfig                    | 1          

  Details:     https://kernelci.org/test/plan/id/61d75ba6adb6716966ef675b

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig/gcc-10/lab-cip/baseline-zynqmp-zcu102.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig/gcc-10/lab-cip/baseline-zynqmp-zcu102.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20211210.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/61d75ba6adb6716966ef675c
        failing since 44 days (last pass: next-20211118, first fail: next-20211123) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
zynqmp-zcu102                | arm64  | lab-cip         | gcc-10   | defconfig+debug              | 1          

  Details:     https://kernelci.org/test/plan/id/61d75d2247c25c3871ef6761

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+debug
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig+debug/gcc-10/lab-cip/baseline-zynqmp-zcu102.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig+debug/gcc-10/lab-cip/baseline-zynqmp-zcu102.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20211210.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/61d75d2247c25c3871ef6762
        failing since 44 days (last pass: next-20211118, first fail: next-20211123) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
zynqmp-zcu102                | arm64  | lab-cip         | gcc-10   | defconfig+CON...OMIZE_BASE=y | 1          

  Details:     https://kernelci.org/test/plan/id/61d75dae0c3c22185eef676b

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+CONFIG_RANDOMIZE_BASE=y
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig+config_randomize_base=y/gcc-10/lab-cip/baseline-zynqmp-zcu102.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig+config_randomize_base=y/gcc-10/lab-cip/baseline-zynqmp-zcu102.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20211210.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/61d75dae0c3c22185eef676c
        failing since 44 days (last pass: next-20211118, first fail: next-20211123) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
zynqmp-zcu102                | arm64  | lab-cip         | gcc-10   | defconfig+CON..._64K_PAGES=y | 1          

  Details:     https://kernelci.org/test/plan/id/61d75fb75b66d01db2ef6760

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+CONFIG_ARM64_64K_PAGES=y
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig+config_arm64_64k_pages=y/gcc-10/lab-cip/baseline-zynqmp-zcu102.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig+config_arm64_64k_pages=y/gcc-10/lab-cip/baseline-zynqmp-zcu102.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20211210.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/61d75fb75b66d01db2ef6761
        failing since 44 days (last pass: next-20211118, first fail: next-20211123) 

platform                     | arch   | lab             | compiler | defconfig                    | regressions
-----------------------------+--------+-----------------+----------+------------------------------+------------
zynqmp-zcu102                | arm64  | lab-cip         | gcc-10   | defconfig+crypto             | 1          

  Details:     https://kernelci.org/test/plan/id/61d760bb11d3645e49ef675c

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+crypto
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig+crypto/gcc-10/lab-cip/baseline-zynqmp-zcu102.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20220106/arm64/defconfig+crypto/gcc-10/lab-cip/baseline-zynqmp-zcu102.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20211210.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/61d760bb11d3645e49ef675d
        failing since 44 days (last pass: next-20211118, first fail: next-20211123)