Subject: next/master baseline: 877 runs, 30 regressions (v5.16-rc5-6644-gbcd5ddb85fad)

From: "kernelci.org bot" <[email-masked]>
Date: Tue, 14 Dec 2021 01:39:59 -0800 (PST)

next/master baseline: 877 runs, 30 regressions (v5.16-rc5-6644-gbcd5ddb85fad)

Regressions Summary
-------------------

platform                   | arch   | lab             | compiler | defconfig                    | regressions
---------------------------+--------+-----------------+----------+------------------------------+------------
bcm2711-rpi-4-b            | arm64  | lab-collabora   | clang-13 | defconfig                    | 1          
bcm2711-rpi-4-b            | arm64  | lab-collabora   | clang-13 | defconfig+CON..._64K_PAGES=y | 1          
bcm2711-rpi-4-b            | arm64  | lab-linaro-lkft | clang-13 | defconfig                    | 1          
bcm2711-rpi-4-b            | arm64  | lab-linaro-lkft | clang-13 | defconfig+CON..._64K_PAGES=y | 1          
bcm2711-rpi-4-b            | arm64  | lab-collabora   | gcc-10   | defconfig+CON...OMIZE_BASE=y | 1          
bcm2711-rpi-4-b            | arm64  | lab-collabora   | gcc-10   | defconfig+ima                | 1          
bcm2711-rpi-4-b            | arm64  | lab-collabora   | gcc-10   | defconfig+arm64-chromebook   | 1          
bcm2711-rpi-4-b            | arm64  | lab-collabora   | gcc-10   | defconfig+crypto             | 1          
bcm2711-rpi-4-b            | arm64  | lab-collabora   | gcc-10   | defconfig                    | 1          
bcm2711-rpi-4-b            | arm64  | lab-linaro-lkft | gcc-10   | defconfig+CON...OMIZE_BASE=y | 1          
bcm2711-rpi-4-b            | arm64  | lab-linaro-lkft | gcc-10   | defconfig+arm64-chromebook   | 1          
bcm2711-rpi-4-b            | arm64  | lab-linaro-lkft | gcc-10   | defconfig+crypto             | 1          
bcm2711-rpi-4-b            | arm64  | lab-linaro-lkft | gcc-10   | defconfig                    | 1          
bcm2836-rpi-2-b            | arm    | lab-collabora   | gcc-10   | bcm2835_defconfig            | 1          
beagle-xm                  | arm    | lab-baylibre    | clang-13 | multi_v7_defconfig           | 1          
minnowboard-turbot-E3826   | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...86_kvm_guest | 1          
minnowboard-turbot-E3826   | x86_64 | lab-collabora   | gcc-10   | x86_64_defconfig             | 1          
qemu_arm64-virt-gicv2-uefi | arm64  | lab-baylibre    | gcc-10   | defconfig+debug              | 1          
qemu_arm64-virt-gicv2-uefi | arm64  | lab-collabora   | gcc-10   | defconfig+debug              | 1          
qemu_arm64-virt-gicv2-uefi | arm64  | lab-linaro-lkft | gcc-10   | defconfig+debug              | 1          
r8a77950-salvator-x        | arm64  | lab-baylibre    | gcc-10   | defconfig+crypto             | 1          
sun50i-a64-bananapi-m64    | arm64  | lab-clabbe      | gcc-10   | defconfig                    | 1          
zynqmp-zcu102              | arm64  | lab-cip         | clang-13 | defconfig                    | 1          
zynqmp-zcu102              | arm64  | lab-cip         | clang-13 | defconfig+CON..._64K_PAGES=y | 1          
zynqmp-zcu102              | arm64  | lab-cip         | gcc-10   | defconfig+CON...OMIZE_BASE=y | 1          
zynqmp-zcu102              | arm64  | lab-cip         | gcc-10   | defconfig+ima                | 1          
zynqmp-zcu102              | arm64  | lab-cip         | gcc-10   | defconfig+crypto             | 1          
zynqmp-zcu102              | arm64  | lab-cip         | gcc-10   | defconfig+CON..._64K_PAGES=y | 1          
zynqmp-zcu102              | arm64  | lab-cip         | gcc-10   | defconfig                    | 1          
zynqmp-zcu102              | arm64  | lab-cip         | gcc-10   | defconfig+debug              | 1          

  Details:  https://kernelci.org/test/job/next/branch/master/kernel/v5.16-rc5-6644-gbcd5ddb85fad/plan/baseline/

  Test:     baseline
  Tree:     next
  Branch:   master
  Describe: v5.16-rc5-6644-gbcd5ddb85fad
  URL:      https://git.kernel.org/pub/scm/linux/kernel/git/next/linux-next.git
  SHA:      bcd5ddb85fad453da26afd5b3fca8ad931b5253d 

Test Regressions
---------------- 

platform                   | arch   | lab             | compiler | defconfig                    | regressions
---------------------------+--------+-----------------+----------+------------------------------+------------
bcm2711-rpi-4-b            | arm64  | lab-collabora   | clang-13 | defconfig                    | 1          

  Details:     https://kernelci.org/test/plan/id/61b82ec5c5cb0dba5839712c

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig
  Compiler:    clang-13 (Debian clang version 13.0.1-++20211124042950+19b8368225dc-1~exp1~20211124043523.27)
  Plain log:   https://storage.kernelci.org//next/master/v5.16-rc5-6644-gbcd5ddb85fad/arm64/defconfig/clang-13/lab-collabora/baseline-bcm2711-rpi-4-b.txt
  HTML log:    https://storage.kernelci.org//next/master/v5.16-rc5-6644-gbcd5ddb85fad/arm64/defconfig/clang-13/lab-collabora/baseline-bcm2711-rpi-4-b.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20211210.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/61b82ec5c5cb0dba5839712d
        new failure (last pass: v5.16-rc4-6579-gea922272cbe5) 

platform                   | arch   | lab             | compiler | defconfig                    | regressions
---------------------------+--------+-----------------+----------+------------------------------+------------
bcm2711-rpi-4-b            | arm64  | lab-collabora   | clang-13 | defconfig+CON..._64K_PAGES=y | 1          

  Details:     https://kernelci.org/test/plan/id/61b82ef0caef089bcb397128

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+CONFIG_ARM64_64K_PAGES=y
  Compiler:    clang-13 (Debian clang version 13.0.1-++20211124042950+19b8368225dc-1~exp1~20211124043523.27)
  Plain log:   https://storage.kernelci.org//next/master/v5.16-rc5-6644-gbcd5ddb85fad/arm64/defconfig+CONFIG_ARM64_64K_PAGES=y/clang-13/lab-collabora/baseline-bcm2711-rpi-4-b.txt
  HTML log:    https://storage.kernelci.org//next/master/v5.16-rc5-6644-gbcd5ddb85fad/arm64/defconfig+CONFIG_ARM64_64K_PAGES=y/clang-13/lab-collabora/baseline-bcm2711-rpi-4-b.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20211210.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/61b82ef0caef089bcb397129
        new failure (last pass: v5.16-rc4-6579-gea922272cbe5) 

platform                   | arch   | lab             | compiler | defconfig                    | regressions
---------------------------+--------+-----------------+----------+------------------------------+------------
bcm2711-rpi-4-b            | arm64  | lab-linaro-lkft | clang-13 | defconfig                    | 1          

  Details:     https://kernelci.org/test/plan/id/61b82e94f3e2b6534439713a

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig
  Compiler:    clang-13 (Debian clang version 13.0.1-++20211124042950+19b8368225dc-1~exp1~20211124043523.27)
  Plain log:   https://storage.kernelci.org//next/master/v5.16-rc5-6644-gbcd5ddb85fad/arm64/defconfig/clang-13/lab-linaro-lkft/baseline-bcm2711-rpi-4-b.txt
  HTML log:    https://storage.kernelci.org//next/master/v5.16-rc5-6644-gbcd5ddb85fad/arm64/defconfig/clang-13/lab-linaro-lkft/baseline-bcm2711-rpi-4-b.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20211210.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/61b82e94f3e2b6534439713b
        new failure (last pass: v5.16-rc4-6579-gea922272cbe5) 

platform                   | arch   | lab             | compiler | defconfig                    | regressions
---------------------------+--------+-----------------+----------+------------------------------+------------
bcm2711-rpi-4-b            | arm64  | lab-linaro-lkft | clang-13 | defconfig+CON..._64K_PAGES=y | 1          

  Details:     https://kernelci.org/test/plan/id/61b82ecfb9a99c50f8397148

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+CONFIG_ARM64_64K_PAGES=y
  Compiler:    clang-13 (Debian clang version 13.0.1-++20211124042950+19b8368225dc-1~exp1~20211124043523.27)
  Plain log:   https://storage.kernelci.org//next/master/v5.16-rc5-6644-gbcd5ddb85fad/arm64/defconfig+CONFIG_ARM64_64K_PAGES=y/clang-13/lab-linaro-lkft/baseline-bcm2711-rpi-4-b.txt
  HTML log:    https://storage.kernelci.org//next/master/v5.16-rc5-6644-gbcd5ddb85fad/arm64/defconfig+CONFIG_ARM64_64K_PAGES=y/clang-13/lab-linaro-lkft/baseline-bcm2711-rpi-4-b.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20211210.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/61b82ecfb9a99c50f8397149
        new failure (last pass: v5.16-rc4-6579-gea922272cbe5) 

platform                   | arch   | lab             | compiler | defconfig                    | regressions
---------------------------+--------+-----------------+----------+------------------------------+------------
bcm2711-rpi-4-b            | arm64  | lab-collabora   | gcc-10   | defconfig+CON...OMIZE_BASE=y | 1          

  Details:     https://kernelci.org/test/plan/id/61b8285f7bb4151b5b397134

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+CONFIG_RANDOMIZE_BASE=y
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/v5.16-rc5-6644-gbcd5ddb85fad/arm64/defconfig+CONFIG_RANDOMIZE_BASE=y/gcc-10/lab-collabora/baseline-bcm2711-rpi-4-b.txt
  HTML log:    https://storage.kernelci.org//next/master/v5.16-rc5-6644-gbcd5ddb85fad/arm64/defconfig+CONFIG_RANDOMIZE_BASE=y/gcc-10/lab-collabora/baseline-bcm2711-rpi-4-b.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20211210.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/61b8285f7bb4151b5b397135
        new failure (last pass: v5.16-rc4-6579-gea922272cbe5) 

platform                   | arch   | lab             | compiler | defconfig                    | regressions
---------------------------+--------+-----------------+----------+------------------------------+------------
bcm2711-rpi-4-b            | arm64  | lab-collabora   | gcc-10   | defconfig+ima                | 1          

  Details:     https://kernelci.org/test/plan/id/61b8288992e62ec00c39714e

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+ima
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/v5.16-rc5-6644-gbcd5ddb85fad/arm64/defconfig+ima/gcc-10/lab-collabora/baseline-bcm2711-rpi-4-b.txt
  HTML log:    https://storage.kernelci.org//next/master/v5.16-rc5-6644-gbcd5ddb85fad/arm64/defconfig+ima/gcc-10/lab-collabora/baseline-bcm2711-rpi-4-b.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20211210.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/61b8288992e62ec00c39714f
        new failure (last pass: v5.16-rc4-6579-gea922272cbe5) 

platform                   | arch   | lab             | compiler | defconfig                    | regressions
---------------------------+--------+-----------------+----------+------------------------------+------------
bcm2711-rpi-4-b            | arm64  | lab-collabora   | gcc-10   | defconfig+arm64-chromebook   | 1          

  Details:     https://kernelci.org/test/plan/id/61b829f1cc178b51f9397120

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/v5.16-rc5-6644-gbcd5ddb85fad/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-bcm2711-rpi-4-b.txt
  HTML log:    https://storage.kernelci.org//next/master/v5.16-rc5-6644-gbcd5ddb85fad/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-bcm2711-rpi-4-b.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20211210.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/61b829f1cc178b51f9397121
        new failure (last pass: v5.16-rc4-6579-gea922272cbe5) 

platform                   | arch   | lab             | compiler | defconfig                    | regressions
---------------------------+--------+-----------------+----------+------------------------------+------------
bcm2711-rpi-4-b            | arm64  | lab-collabora   | gcc-10   | defconfig+crypto             | 1          

  Details:     https://kernelci.org/test/plan/id/61b82a54c0f6a4daa2397146

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+crypto
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/v5.16-rc5-6644-gbcd5ddb85fad/arm64/defconfig+crypto/gcc-10/lab-collabora/baseline-bcm2711-rpi-4-b.txt
  HTML log:    https://storage.kernelci.org//next/master/v5.16-rc5-6644-gbcd5ddb85fad/arm64/defconfig+crypto/gcc-10/lab-collabora/baseline-bcm2711-rpi-4-b.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20211210.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/61b82a54c0f6a4daa2397147
        new failure (last pass: v5.16-rc4-6579-gea922272cbe5) 

platform                   | arch   | lab             | compiler | defconfig                    | regressions
---------------------------+--------+-----------------+----------+------------------------------+------------
bcm2711-rpi-4-b            | arm64  | lab-collabora   | gcc-10   | defconfig                    | 1          

  Details:     https://kernelci.org/test/plan/id/61b82d74d1cb1580af397145

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/v5.16-rc5-6644-gbcd5ddb85fad/arm64/defconfig/gcc-10/lab-collabora/baseline-bcm2711-rpi-4-b.txt
  HTML log:    https://storage.kernelci.org//next/master/v5.16-rc5-6644-gbcd5ddb85fad/arm64/defconfig/gcc-10/lab-collabora/baseline-bcm2711-rpi-4-b.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20211210.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/61b82d74d1cb1580af397146
        new failure (last pass: v5.16-rc4-6579-gea922272cbe5) 

platform                   | arch   | lab             | compiler | defconfig                    | regressions
---------------------------+--------+-----------------+----------+------------------------------+------------
bcm2711-rpi-4-b            | arm64  | lab-linaro-lkft | gcc-10   | defconfig+CON...OMIZE_BASE=y | 1          

  Details:     https://kernelci.org/test/plan/id/61b828527bb4151b5b39712e

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+CONFIG_RANDOMIZE_BASE=y
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/v5.16-rc5-6644-gbcd5ddb85fad/arm64/defconfig+CONFIG_RANDOMIZE_BASE=y/gcc-10/lab-linaro-lkft/baseline-bcm2711-rpi-4-b.txt
  HTML log:    https://storage.kernelci.org//next/master/v5.16-rc5-6644-gbcd5ddb85fad/arm64/defconfig+CONFIG_RANDOMIZE_BASE=y/gcc-10/lab-linaro-lkft/baseline-bcm2711-rpi-4-b.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20211210.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/61b828527bb4151b5b39712f
        new failure (last pass: v5.16-rc4-6579-gea922272cbe5) 

platform                   | arch   | lab             | compiler | defconfig                    | regressions
---------------------------+--------+-----------------+----------+------------------------------+------------
bcm2711-rpi-4-b            | arm64  | lab-linaro-lkft | gcc-10   | defconfig+arm64-chromebook   | 1          

  Details:     https://kernelci.org/test/plan/id/61b829e2c09a55f68c39715a

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/v5.16-rc5-6644-gbcd5ddb85fad/arm64/defconfig+arm64-chromebook/gcc-10/lab-linaro-lkft/baseline-bcm2711-rpi-4-b.txt
  HTML log:    https://storage.kernelci.org//next/master/v5.16-rc5-6644-gbcd5ddb85fad/arm64/defconfig+arm64-chromebook/gcc-10/lab-linaro-lkft/baseline-bcm2711-rpi-4-b.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20211210.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/61b829e2c09a55f68c39715b
        new failure (last pass: v5.16-rc4-6579-gea922272cbe5) 

platform                   | arch   | lab             | compiler | defconfig                    | regressions
---------------------------+--------+-----------------+----------+------------------------------+------------
bcm2711-rpi-4-b            | arm64  | lab-linaro-lkft | gcc-10   | defconfig+crypto             | 1          

  Details:     https://kernelci.org/test/plan/id/61b82a3f3d45f41237397190

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+crypto
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/v5.16-rc5-6644-gbcd5ddb85fad/arm64/defconfig+crypto/gcc-10/lab-linaro-lkft/baseline-bcm2711-rpi-4-b.txt
  HTML log:    https://storage.kernelci.org//next/master/v5.16-rc5-6644-gbcd5ddb85fad/arm64/defconfig+crypto/gcc-10/lab-linaro-lkft/baseline-bcm2711-rpi-4-b.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20211210.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/61b82a3f3d45f41237397191
        new failure (last pass: v5.16-rc4-6579-gea922272cbe5) 

platform                   | arch   | lab             | compiler | defconfig                    | regressions
---------------------------+--------+-----------------+----------+------------------------------+------------
bcm2711-rpi-4-b            | arm64  | lab-linaro-lkft | gcc-10   | defconfig                    | 1          

  Details:     https://kernelci.org/test/plan/id/61b82d67cf0d1d19fd39719b

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/v5.16-rc5-6644-gbcd5ddb85fad/arm64/defconfig/gcc-10/lab-linaro-lkft/baseline-bcm2711-rpi-4-b.txt
  HTML log:    https://storage.kernelci.org//next/master/v5.16-rc5-6644-gbcd5ddb85fad/arm64/defconfig/gcc-10/lab-linaro-lkft/baseline-bcm2711-rpi-4-b.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20211210.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/61b82d67cf0d1d19fd39719c
        new failure (last pass: v5.16-rc4-6579-gea922272cbe5) 

platform                   | arch   | lab             | compiler | defconfig                    | regressions
---------------------------+--------+-----------------+----------+------------------------------+------------
bcm2836-rpi-2-b            | arm    | lab-collabora   | gcc-10   | bcm2835_defconfig            | 1          

  Details:     https://kernelci.org/test/plan/id/61b832f7fa5901cbb8397125

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: bcm2835_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/v5.16-rc5-6644-gbcd5ddb85fad/arm/bcm2835_defconfig/gcc-10/lab-collabora/baseline-bcm2836-rpi-2-b.txt
  HTML log:    https://storage.kernelci.org//next/master/v5.16-rc5-6644-gbcd5ddb85fad/arm/bcm2835_defconfig/gcc-10/lab-collabora/baseline-bcm2836-rpi-2-b.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20211210.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/61b832f7fa5901cbb8397126
        new failure (last pass: v5.16-rc4-6579-gea922272cbe5) 

platform                   | arch   | lab             | compiler | defconfig                    | regressions
---------------------------+--------+-----------------+----------+------------------------------+------------
beagle-xm                  | arm    | lab-baylibre    | clang-13 | multi_v7_defconfig           | 1          

  Details:     https://kernelci.org/test/plan/id/61b82ce30bb1e21a9339711f

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig
  Compiler:    clang-13 (Debian clang version 13.0.1-++20211124042950+19b8368225dc-1~exp1~20211124043523.27)
  Plain log:   https://storage.kernelci.org//next/master/v5.16-rc5-6644-gbcd5ddb85fad/arm/multi_v7_defconfig/clang-13/lab-baylibre/baseline-beagle-xm.txt
  HTML log:    https://storage.kernelci.org//next/master/v5.16-rc5-6644-gbcd5ddb85fad/arm/multi_v7_defconfig/clang-13/lab-baylibre/baseline-beagle-xm.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20211210.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/61b82ce30bb1e21a93397120
        failing since 13 days (last pass: next-20211129, first fail: next-20211130) 

platform                   | arch   | lab             | compiler | defconfig                    | regressions
---------------------------+--------+-----------------+----------+------------------------------+------------
minnowboard-turbot-E3826   | x86_64 | lab-collabora   | gcc-10   | x86_64_defcon...86_kvm_guest | 1          

  Details:     https://kernelci.org/test/plan/id/61b825b6b1d5658e79397176

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig+x86_kvm_guest
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/v5.16-rc5-6644-gbcd5ddb85fad/x86_64/x86_64_defconfig+x86_kvm_guest/gcc-10/lab-collabora/baseline-minnowboard-turbot-E3826.txt
  HTML log:    https://storage.kernelci.org//next/master/v5.16-rc5-6644-gbcd5ddb85fad/x86_64/x86_64_defconfig+x86_kvm_guest/gcc-10/lab-collabora/baseline-minnowboard-turbot-E3826.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20211210.0/x86/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/61b825b6b1d5658e79397177
        new failure (last pass: v5.16-rc4-6579-gea922272cbe5) 

platform                   | arch   | lab             | compiler | defconfig                    | regressions
---------------------------+--------+-----------------+----------+------------------------------+------------
minnowboard-turbot-E3826   | x86_64 | lab-collabora   | gcc-10   | x86_64_defconfig             | 1          

  Details:     https://kernelci.org/test/plan/id/61b829c7ec300f205b39712e

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: x86_64_defconfig
  Compiler:    gcc-10 (gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/v5.16-rc5-6644-gbcd5ddb85fad/x86_64/x86_64_defconfig/gcc-10/lab-collabora/baseline-minnowboard-turbot-E3826.txt
  HTML log:    https://storage.kernelci.org//next/master/v5.16-rc5-6644-gbcd5ddb85fad/x86_64/x86_64_defconfig/gcc-10/lab-collabora/baseline-minnowboard-turbot-E3826.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20211210.0/x86/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/61b829c7ec300f205b39712f
        new failure (last pass: v5.16-rc4-6579-gea922272cbe5) 

platform                   | arch   | lab             | compiler | defconfig                    | regressions
---------------------------+--------+-----------------+----------+------------------------------+------------
qemu_arm64-virt-gicv2-uefi | arm64  | lab-baylibre    | gcc-10   | defconfig+debug              | 1          

  Details:     https://kernelci.org/test/plan/id/61b83664bfbd15b7d939712d

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+debug
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/v5.16-rc5-6644-gbcd5ddb85fad/arm64/defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_arm64-virt-gicv2-uefi.txt
  HTML log:    https://storage.kernelci.org//next/master/v5.16-rc5-6644-gbcd5ddb85fad/arm64/defconfig+debug/gcc-10/lab-baylibre/baseline-qemu_arm64-virt-gicv2-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20211210.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/61b83664bfbd15b7d939712e
        new failure (last pass: v5.16-rc4-6579-gea922272cbe5) 

platform                   | arch   | lab             | compiler | defconfig                    | regressions
---------------------------+--------+-----------------+----------+------------------------------+------------
qemu_arm64-virt-gicv2-uefi | arm64  | lab-collabora   | gcc-10   | defconfig+debug              | 1          

  Details:     https://kernelci.org/test/plan/id/61b833b8f0b3caa25a39712b

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+debug
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/v5.16-rc5-6644-gbcd5ddb85fad/arm64/defconfig+debug/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv2-uefi.txt
  HTML log:    https://storage.kernelci.org//next/master/v5.16-rc5-6644-gbcd5ddb85fad/arm64/defconfig+debug/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv2-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20211210.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/61b833b8f0b3caa25a39712c
        new failure (last pass: v5.16-rc4-6579-gea922272cbe5) 

platform                   | arch   | lab             | compiler | defconfig                    | regressions
---------------------------+--------+-----------------+----------+------------------------------+------------
qemu_arm64-virt-gicv2-uefi | arm64  | lab-linaro-lkft | gcc-10   | defconfig+debug              | 1          

  Details:     https://kernelci.org/test/plan/id/61b8417dc2f7933c43397123

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+debug
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/v5.16-rc5-6644-gbcd5ddb85fad/arm64/defconfig+debug/gcc-10/lab-linaro-lkft/baseline-qemu_arm64-virt-gicv2-uefi.txt
  HTML log:    https://storage.kernelci.org//next/master/v5.16-rc5-6644-gbcd5ddb85fad/arm64/defconfig+debug/gcc-10/lab-linaro-lkft/baseline-qemu_arm64-virt-gicv2-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20211210.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/61b8417dc2f7933c43397124
        new failure (last pass: v5.16-rc4-6579-gea922272cbe5) 

platform                   | arch   | lab             | compiler | defconfig                    | regressions
---------------------------+--------+-----------------+----------+------------------------------+------------
r8a77950-salvator-x        | arm64  | lab-baylibre    | gcc-10   | defconfig+crypto             | 1          

  Details:     https://kernelci.org/test/plan/id/61b8449c414278ca6e397141

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+crypto
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/v5.16-rc5-6644-gbcd5ddb85fad/arm64/defconfig+crypto/gcc-10/lab-baylibre/baseline-r8a77950-salvator-x.txt
  HTML log:    https://storage.kernelci.org//next/master/v5.16-rc5-6644-gbcd5ddb85fad/arm64/defconfig+crypto/gcc-10/lab-baylibre/baseline-r8a77950-salvator-x.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20211210.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/61b8449c414278ca6e397142
        new failure (last pass: v5.16-rc4-6579-gea922272cbe5) 

platform                   | arch   | lab             | compiler | defconfig                    | regressions
---------------------------+--------+-----------------+----------+------------------------------+------------
sun50i-a64-bananapi-m64    | arm64  | lab-clabbe      | gcc-10   | defconfig                    | 1          

  Details:     https://kernelci.org/test/plan/id/61b82f6a0918dcc64a39711e

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/v5.16-rc5-6644-gbcd5ddb85fad/arm64/defconfig/gcc-10/lab-clabbe/baseline-sun50i-a64-bananapi-m64.txt
  HTML log:    https://storage.kernelci.org//next/master/v5.16-rc5-6644-gbcd5ddb85fad/arm64/defconfig/gcc-10/lab-clabbe/baseline-sun50i-a64-bananapi-m64.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20211210.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/61b82f6a0918dcc64a39711f
        new failure (last pass: v5.16-rc4-6579-gea922272cbe5) 

platform                   | arch   | lab             | compiler | defconfig                    | regressions
---------------------------+--------+-----------------+----------+------------------------------+------------
zynqmp-zcu102              | arm64  | lab-cip         | clang-13 | defconfig                    | 1          

  Details:     https://kernelci.org/test/plan/id/61b8316236f193c18c397132

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig
  Compiler:    clang-13 (Debian clang version 13.0.1-++20211124042950+19b8368225dc-1~exp1~20211124043523.27)
  Plain log:   https://storage.kernelci.org//next/master/v5.16-rc5-6644-gbcd5ddb85fad/arm64/defconfig/clang-13/lab-cip/baseline-zynqmp-zcu102.txt
  HTML log:    https://storage.kernelci.org//next/master/v5.16-rc5-6644-gbcd5ddb85fad/arm64/defconfig/clang-13/lab-cip/baseline-zynqmp-zcu102.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20211210.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/61b8316236f193c18c397133
        failing since 19 days (last pass: next-20211118, first fail: next-20211124) 

platform                   | arch   | lab             | compiler | defconfig                    | regressions
---------------------------+--------+-----------------+----------+------------------------------+------------
zynqmp-zcu102              | arm64  | lab-cip         | clang-13 | defconfig+CON..._64K_PAGES=y | 1          

  Details:     https://kernelci.org/test/plan/id/61b8328d248ca8c69839712b

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+CONFIG_ARM64_64K_PAGES=y
  Compiler:    clang-13 (Debian clang version 13.0.1-++20211124042950+19b8368225dc-1~exp1~20211124043523.27)
  Plain log:   https://storage.kernelci.org//next/master/v5.16-rc5-6644-gbcd5ddb85fad/arm64/defconfig+CONFIG_ARM64_64K_PAGES=y/clang-13/lab-cip/baseline-zynqmp-zcu102.txt
  HTML log:    https://storage.kernelci.org//next/master/v5.16-rc5-6644-gbcd5ddb85fad/arm64/defconfig+CONFIG_ARM64_64K_PAGES=y/clang-13/lab-cip/baseline-zynqmp-zcu102.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20211210.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/61b8328d248ca8c69839712c
        failing since 20 days (last pass: next-20211118, first fail: next-20211123) 

platform                   | arch   | lab             | compiler | defconfig                    | regressions
---------------------------+--------+-----------------+----------+------------------------------+------------
zynqmp-zcu102              | arm64  | lab-cip         | gcc-10   | defconfig+CON...OMIZE_BASE=y | 1          

  Details:     https://kernelci.org/test/plan/id/61b82852389713915539715e

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+CONFIG_RANDOMIZE_BASE=y
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/v5.16-rc5-6644-gbcd5ddb85fad/arm64/defconfig+CONFIG_RANDOMIZE_BASE=y/gcc-10/lab-cip/baseline-zynqmp-zcu102.txt
  HTML log:    https://storage.kernelci.org//next/master/v5.16-rc5-6644-gbcd5ddb85fad/arm64/defconfig+CONFIG_RANDOMIZE_BASE=y/gcc-10/lab-cip/baseline-zynqmp-zcu102.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20211210.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/61b82852389713915539715f
        failing since 20 days (last pass: next-20211118, first fail: next-20211123) 

platform                   | arch   | lab             | compiler | defconfig                    | regressions
---------------------------+--------+-----------------+----------+------------------------------+------------
zynqmp-zcu102              | arm64  | lab-cip         | gcc-10   | defconfig+ima                | 1          

  Details:     https://kernelci.org/test/plan/id/61b828caeddd3c4a80397120

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+ima
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/v5.16-rc5-6644-gbcd5ddb85fad/arm64/defconfig+ima/gcc-10/lab-cip/baseline-zynqmp-zcu102.txt
  HTML log:    https://storage.kernelci.org//next/master/v5.16-rc5-6644-gbcd5ddb85fad/arm64/defconfig+ima/gcc-10/lab-cip/baseline-zynqmp-zcu102.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20211210.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/61b828caeddd3c4a80397121
        failing since 20 days (last pass: next-20211118, first fail: next-20211123) 

platform                   | arch   | lab             | compiler | defconfig                    | regressions
---------------------------+--------+-----------------+----------+------------------------------+------------
zynqmp-zcu102              | arm64  | lab-cip         | gcc-10   | defconfig+crypto             | 1          

  Details:     https://kernelci.org/test/plan/id/61b82a5ac0f6a4daa2397164

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+crypto
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/v5.16-rc5-6644-gbcd5ddb85fad/arm64/defconfig+crypto/gcc-10/lab-cip/baseline-zynqmp-zcu102.txt
  HTML log:    https://storage.kernelci.org//next/master/v5.16-rc5-6644-gbcd5ddb85fad/arm64/defconfig+crypto/gcc-10/lab-cip/baseline-zynqmp-zcu102.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20211210.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/61b82a5ac0f6a4daa2397165
        failing since 20 days (last pass: next-20211118, first fail: next-20211123) 

platform                   | arch   | lab             | compiler | defconfig                    | regressions
---------------------------+--------+-----------------+----------+------------------------------+------------
zynqmp-zcu102              | arm64  | lab-cip         | gcc-10   | defconfig+CON..._64K_PAGES=y | 1          

  Details:     https://kernelci.org/test/plan/id/61b82d79d1cb1580af397148

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+CONFIG_ARM64_64K_PAGES=y
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/v5.16-rc5-6644-gbcd5ddb85fad/arm64/defconfig+CONFIG_ARM64_64K_PAGES=y/gcc-10/lab-cip/baseline-zynqmp-zcu102.txt
  HTML log:    https://storage.kernelci.org//next/master/v5.16-rc5-6644-gbcd5ddb85fad/arm64/defconfig+CONFIG_ARM64_64K_PAGES=y/gcc-10/lab-cip/baseline-zynqmp-zcu102.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20211210.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/61b82d79d1cb1580af397149
        failing since 20 days (last pass: next-20211118, first fail: next-20211123) 

platform                   | arch   | lab             | compiler | defconfig                    | regressions
---------------------------+--------+-----------------+----------+------------------------------+------------
zynqmp-zcu102              | arm64  | lab-cip         | gcc-10   | defconfig                    | 1          

  Details:     https://kernelci.org/test/plan/id/61b82e4195df70d8b339712f

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/v5.16-rc5-6644-gbcd5ddb85fad/arm64/defconfig/gcc-10/lab-cip/baseline-zynqmp-zcu102.txt
  HTML log:    https://storage.kernelci.org//next/master/v5.16-rc5-6644-gbcd5ddb85fad/arm64/defconfig/gcc-10/lab-cip/baseline-zynqmp-zcu102.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20211210.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/61b82e4195df70d8b3397130
        failing since 20 days (last pass: next-20211118, first fail: next-20211123) 

platform                   | arch   | lab             | compiler | defconfig                    | regressions
---------------------------+--------+-----------------+----------+------------------------------+------------
zynqmp-zcu102              | arm64  | lab-cip         | gcc-10   | defconfig+debug              | 1          

  Details:     https://kernelci.org/test/plan/id/61b82ff959d8450cad39714d

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+debug
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/v5.16-rc5-6644-gbcd5ddb85fad/arm64/defconfig+debug/gcc-10/lab-cip/baseline-zynqmp-zcu102.txt
  HTML log:    https://storage.kernelci.org//next/master/v5.16-rc5-6644-gbcd5ddb85fad/arm64/defconfig+debug/gcc-10/lab-cip/baseline-zynqmp-zcu102.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20211210.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/61b82ff959d8450cad39714e
        failing since 20 days (last pass: next-20211118, first fail: next-20211123)