Subject: next/pending-fixes baseline: 614 runs, 31 regressions (v5.14-10891-g7e703ab62392)

From: "kernelci.org bot" <[email-masked]>
Date: Thu, 09 Sep 2021 21:35:51 -0700 (PDT)

next/pending-fixes baseline: 614 runs, 31 regressions (v5.14-10891-g7e703ab62392)

Regressions Summary
-------------------

platform                | arch  | lab             | compiler | defconfig                    | regressions
------------------------+-------+-----------------+----------+------------------------------+------------
bcm2836-rpi-2-b         | arm   | lab-collabora   | gcc-8    | multi_v7_defc...CONFIG_SMP=n | 1          
bcm2837-rpi-3-b         | arm64 | lab-baylibre    | gcc-8    | defconfig                    | 1          
bcm2837-rpi-3-b         | arm64 | lab-baylibre    | gcc-8    | defconfig+CON...OMIZE_BASE=y | 1          
beagle-xm               | arm   | lab-baylibre    | gcc-8    | multi_v7_defconfig+ima       | 1          
beagle-xm               | arm   | lab-baylibre    | gcc-8    | multi_v7_defconfig           | 1          
beagle-xm               | arm   | lab-baylibre    | gcc-8    | multi_v7_defc...CONFIG_SMP=n | 1          
beagle-xm               | arm   | lab-baylibre    | gcc-8    | omap2plus_defconfig          | 1          
hip07-d05               | arm64 | lab-collabora   | gcc-8    | defconfig                    | 1          
hip07-d05               | arm64 | lab-collabora   | gcc-8    | defconfig+CON...OMIZE_BASE=y | 1          
imx6q-sabresd           | arm   | lab-nxp         | gcc-8    | imx_v6_v7_defconfig          | 1          
imx8mn-ddr4-evk         | arm64 | lab-nxp         | gcc-8    | defconfig                    | 2          
imx8mp-evk              | arm64 | lab-nxp         | gcc-8    | defconfig+crypto             | 1          
imx8mp-evk              | arm64 | lab-nxp         | gcc-8    | defconfig                    | 1          
imx8mp-evk              | arm64 | lab-nxp         | gcc-8    | defconfig+CON...OMIZE_BASE=y | 1          
qemu_arm-versatilepb    | arm   | lab-baylibre    | gcc-8    | versatile_defconfig          | 1          
qemu_arm-versatilepb    | arm   | lab-broonie     | gcc-8    | versatile_defconfig          | 1          
qemu_arm-versatilepb    | arm   | lab-cip         | gcc-8    | versatile_defconfig          | 1          
qemu_arm-versatilepb    | arm   | lab-collabora   | gcc-8    | versatile_defconfig          | 1          
qemu_arm-versatilepb    | arm   | lab-linaro-lkft | gcc-8    | versatile_defconfig          | 1          
rk3288-veyron-jaq       | arm   | lab-collabora   | gcc-8    | multi_v7_defconfig+ima       | 1          
rk3288-veyron-jaq       | arm   | lab-collabora   | gcc-8    | multi_v7_defconfig+crypto    | 1          
rk3288-veyron-jaq       | arm   | lab-collabora   | gcc-8    | multi_v7_defc...G_ARM_LPAE=y | 1          
rk3288-veyron-jaq       | arm   | lab-collabora   | gcc-8    | multi_v7_defconfig           | 1          
rk3288-veyron-jaq       | arm   | lab-collabora   | gcc-8    | multi_v7_defc...CONFIG_SMP=n | 1          
rk3399-gru-kevin        | arm64 | lab-collabora   | gcc-8    | defconfig                    | 2          
rk3399-gru-kevin        | arm64 | lab-collabora   | gcc-8    | defconfig+CON...OMIZE_BASE=y | 2          
sun50i-a64-bananapi-m64 | arm64 | lab-clabbe      | gcc-8    | defconfig+ima                | 1          
sun50i-a64-bananapi-m64 | arm64 | lab-clabbe      | gcc-8    | defconfig                    | 1          

  Details:  https://kernelci.org/test/job/next/branch/pending-fixes/kernel/v5.14-10891-g7e703ab62392/plan/baseline/

  Test:     baseline
  Tree:     next
  Branch:   pending-fixes
  Describe: v5.14-10891-g7e703ab62392
  URL:      https://git.kernel.org/pub/scm/linux/kernel/git/next/linux-next.git
  SHA:      7e703ab62392862840640d00acf80f478bfb0a8d 

Test Regressions
---------------- 

platform                | arch  | lab             | compiler | defconfig                    | regressions
------------------------+-------+-----------------+----------+------------------------------+------------
bcm2836-rpi-2-b         | arm   | lab-collabora   | gcc-8    | multi_v7_defc...CONFIG_SMP=n | 1          

  Details:     https://kernelci.org/test/plan/id/613aae4d0f9315f8c1d59672

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_SMP=n
  Compiler:    gcc-8 (arm-linux-gnueabihf-gcc (Debian 8.3.0-2) 8.3.0)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v5.14-10891-g7e703ab62392/arm/multi_v7_defconfig+CONFIG_SMP=n/gcc-8/lab-collabora/baseline-bcm2836-rpi-2-b.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v5.14-10891-g7e703ab62392/arm/multi_v7_defconfig+CONFIG_SMP=n/gcc-8/lab-collabora/baseline-bcm2836-rpi-2-b.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/kci-2020.05-6-g8983f3b738df/armel/baseline/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/613aae4d0f9315f8c1d59673
        failing since 217 days (last pass: v5.11-rc6-256-gf889022827dc, first fail: v5.11-rc6-298-g490f4659faae) 

platform                | arch  | lab             | compiler | defconfig                    | regressions
------------------------+-------+-----------------+----------+------------------------------+------------
bcm2837-rpi-3-b         | arm64 | lab-baylibre    | gcc-8    | defconfig                    | 1          

  Details:     https://kernelci.org/test/plan/id/613aaa1b831cde6708d597a3

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig
  Compiler:    gcc-8 (aarch64-linux-gnu-gcc (Debian 8.3.0-2) 8.3.0)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v5.14-10891-g7e703ab62392/arm64/defconfig/gcc-8/lab-baylibre/baseline-bcm2837-rpi-3-b.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v5.14-10891-g7e703ab62392/arm64/defconfig/gcc-8/lab-baylibre/baseline-bcm2837-rpi-3-b.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/kci-2020.05-6-g8983f3b738df/arm64/baseline/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/613aaa1b831cde6708d597a4
        failing since 65 days (last pass: v5.13-3495-gfbf137d9483a, first fail: v5.13-11972-g079b16c442fd) 

platform                | arch  | lab             | compiler | defconfig                    | regressions
------------------------+-------+-----------------+----------+------------------------------+------------
bcm2837-rpi-3-b         | arm64 | lab-baylibre    | gcc-8    | defconfig+CON...OMIZE_BASE=y | 1          

  Details:     https://kernelci.org/test/plan/id/613aab83212317c670d59671

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+CONFIG_RANDOMIZE_BASE=y
  Compiler:    gcc-8 (aarch64-linux-gnu-gcc (Debian 8.3.0-2) 8.3.0)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v5.14-10891-g7e703ab62392/arm64/defconfig+CONFIG_RANDOMIZE_BASE=y/gcc-8/lab-baylibre/baseline-bcm2837-rpi-3-b.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v5.14-10891-g7e703ab62392/arm64/defconfig+CONFIG_RANDOMIZE_BASE=y/gcc-8/lab-baylibre/baseline-bcm2837-rpi-3-b.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/kci-2020.05-6-g8983f3b738df/arm64/baseline/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/613aab83212317c670d59672
        failing since 65 days (last pass: v5.13-3495-gfbf137d9483a, first fail: v5.13-11972-g079b16c442fd) 

platform                | arch  | lab             | compiler | defconfig                    | regressions
------------------------+-------+-----------------+----------+------------------------------+------------
beagle-xm               | arm   | lab-baylibre    | gcc-8    | multi_v7_defconfig+ima       | 1          

  Details:     https://kernelci.org/test/plan/id/613aa50e906344cb57d59685

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+ima
  Compiler:    gcc-8 (arm-linux-gnueabihf-gcc (Debian 8.3.0-2) 8.3.0)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v5.14-10891-g7e703ab62392/arm/multi_v7_defconfig+ima/gcc-8/lab-baylibre/baseline-beagle-xm.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v5.14-10891-g7e703ab62392/arm/multi_v7_defconfig+ima/gcc-8/lab-baylibre/baseline-beagle-xm.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/kci-2020.05-6-g8983f3b738df/armel/baseline/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/613aa50e906344cb57d59686
        failing since 1 day (last pass: v5.14-10251-gfd7f1d781c08, first fail: v5.14-10568-g1006eb19726f) 

platform                | arch  | lab             | compiler | defconfig                    | regressions
------------------------+-------+-----------------+----------+------------------------------+------------
beagle-xm               | arm   | lab-baylibre    | gcc-8    | multi_v7_defconfig           | 1          

  Details:     https://kernelci.org/test/plan/id/613aa6db0e8e8f87b8d5968f

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig
  Compiler:    gcc-8 (arm-linux-gnueabihf-gcc (Debian 8.3.0-2) 8.3.0)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v5.14-10891-g7e703ab62392/arm/multi_v7_defconfig/gcc-8/lab-baylibre/baseline-beagle-xm.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v5.14-10891-g7e703ab62392/arm/multi_v7_defconfig/gcc-8/lab-baylibre/baseline-beagle-xm.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/kci-2020.05-6-g8983f3b738df/armel/baseline/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/613aa6db0e8e8f87b8d59690
        new failure (last pass: v5.14-10568-g1006eb19726f) 

platform                | arch  | lab             | compiler | defconfig                    | regressions
------------------------+-------+-----------------+----------+------------------------------+------------
beagle-xm               | arm   | lab-baylibre    | gcc-8    | multi_v7_defc...CONFIG_SMP=n | 1          

  Details:     https://kernelci.org/test/plan/id/613aa997da64ee1c11d59666

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_SMP=n
  Compiler:    gcc-8 (arm-linux-gnueabihf-gcc (Debian 8.3.0-2) 8.3.0)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v5.14-10891-g7e703ab62392/arm/multi_v7_defconfig+CONFIG_SMP=n/gcc-8/lab-baylibre/baseline-beagle-xm.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v5.14-10891-g7e703ab62392/arm/multi_v7_defconfig+CONFIG_SMP=n/gcc-8/lab-baylibre/baseline-beagle-xm.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/kci-2020.05-6-g8983f3b738df/armel/baseline/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/613aa997da64ee1c11d59667
        failing since 59 days (last pass: v5.10-rc7-201-gc9b6935dc4f4, first fail: v5.14-rc1-225-g25a1eba130d1) 

platform                | arch  | lab             | compiler | defconfig                    | regressions
------------------------+-------+-----------------+----------+------------------------------+------------
beagle-xm               | arm   | lab-baylibre    | gcc-8    | omap2plus_defconfig          | 1          

  Details:     https://kernelci.org/test/plan/id/613aa82f3985dd4a42d59665

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: omap2plus_defconfig
  Compiler:    gcc-8 (arm-linux-gnueabihf-gcc (Debian 8.3.0-2) 8.3.0)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v5.14-10891-g7e703ab62392/arm/omap2plus_defconfig/gcc-8/lab-baylibre/baseline-beagle-xm.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v5.14-10891-g7e703ab62392/arm/omap2plus_defconfig/gcc-8/lab-baylibre/baseline-beagle-xm.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/kci-2020.05-6-g8983f3b738df/armel/baseline/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/613aa82f3985dd4a42d59666
        failing since 6 days (last pass: v5.14-6828-g521f6987a116, first fail: v5.14-8174-g2f453ff3ea7f) 

platform                | arch  | lab             | compiler | defconfig                    | regressions
------------------------+-------+-----------------+----------+------------------------------+------------
hip07-d05               | arm64 | lab-collabora   | gcc-8    | defconfig                    | 1          

  Details:     https://kernelci.org/test/plan/id/613ab3853f416d1a3bd59681

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig
  Compiler:    gcc-8 (aarch64-linux-gnu-gcc (Debian 8.3.0-2) 8.3.0)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v5.14-10891-g7e703ab62392/arm64/defconfig/gcc-8/lab-collabora/baseline-hip07-d05.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v5.14-10891-g7e703ab62392/arm64/defconfig/gcc-8/lab-collabora/baseline-hip07-d05.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/kci-2020.05-6-g8983f3b738df/arm64/baseline/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/613ab3853f416d1a3bd59682
        failing since 70 days (last pass: v5.13-rc7-277-gfd6ae26c403a, first fail: v5.13-2793-g5c4584a79cad) 

platform                | arch  | lab             | compiler | defconfig                    | regressions
------------------------+-------+-----------------+----------+------------------------------+------------
hip07-d05               | arm64 | lab-collabora   | gcc-8    | defconfig+CON...OMIZE_BASE=y | 1          

  Details:     https://kernelci.org/test/plan/id/613ab7e998742e9651d59673

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+CONFIG_RANDOMIZE_BASE=y
  Compiler:    gcc-8 (aarch64-linux-gnu-gcc (Debian 8.3.0-2) 8.3.0)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v5.14-10891-g7e703ab62392/arm64/defconfig+CONFIG_RANDOMIZE_BASE=y/gcc-8/lab-collabora/baseline-hip07-d05.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v5.14-10891-g7e703ab62392/arm64/defconfig+CONFIG_RANDOMIZE_BASE=y/gcc-8/lab-collabora/baseline-hip07-d05.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/kci-2020.05-6-g8983f3b738df/arm64/baseline/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/613ab7e998742e9651d59674
        failing since 65 days (last pass: v5.13-1843-g646572bd9313, first fail: v5.13-11972-g079b16c442fd) 

platform                | arch  | lab             | compiler | defconfig                    | regressions
------------------------+-------+-----------------+----------+------------------------------+------------
imx6q-sabresd           | arm   | lab-nxp         | gcc-8    | imx_v6_v7_defconfig          | 1          

  Details:     https://kernelci.org/test/plan/id/613aa71e6b8789417ed59670

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: imx_v6_v7_defconfig
  Compiler:    gcc-8 (arm-linux-gnueabihf-gcc (Debian 8.3.0-2) 8.3.0)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v5.14-10891-g7e703ab62392/arm/imx_v6_v7_defconfig/gcc-8/lab-nxp/baseline-imx6q-sabresd.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v5.14-10891-g7e703ab62392/arm/imx_v6_v7_defconfig/gcc-8/lab-nxp/baseline-imx6q-sabresd.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/kci-2020.05-6-g8983f3b738df/armel/baseline/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/613aa71e6b8789417ed59671
        failing since 319 days (last pass: v5.9-13195-g0281c5220c40, first fail: v5.9-14860-gd56fc2efcc70) 

platform                | arch  | lab             | compiler | defconfig                    | regressions
------------------------+-------+-----------------+----------+------------------------------+------------
imx8mn-ddr4-evk         | arm64 | lab-nxp         | gcc-8    | defconfig                    | 2          

  Details:     https://kernelci.org/test/plan/id/613aa978988c05559dd596ca

  Results:     4 PASS, 2 FAIL, 0 SKIP
  Full config: defconfig
  Compiler:    gcc-8 (aarch64-linux-gnu-gcc (Debian 8.3.0-2) 8.3.0)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v5.14-10891-g7e703ab62392/arm64/defconfig/gcc-8/lab-nxp/baseline-imx8mn-ddr4-evk.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v5.14-10891-g7e703ab62392/arm64/defconfig/gcc-8/lab-nxp/baseline-imx8mn-ddr4-evk.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/kci-2020.05-6-g8983f3b738df/arm64/baseline/rootfs.cpio.gz 

  * baseline.dmesg.alert: https://kernelci.org/test/case/id/613aa978988c05559dd596d1
        new failure (last pass: v5.14-10568-g1006eb19726f)
        12 lines

    2021-09-10T00:40:10.345443  kern  :alert : Unable to handle kernel NULL pointer dereference <8>[   14.525347] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=alert RESULT=fail UNITS=lines MEASUREMENT=12>
    2021-09-10T00:40:10.345927  at virtual address 0000000000000098   

  * baseline.dmesg.emerg: https://kernelci.org/test/case/id/613aa978988c05559dd596d2
        new failure (last pass: v5.14-10568-g1006eb19726f)
        2 lines

    2021-09-10T00:40:10.347575  kern  :alert : Mem abort info:
    2021-09-10T00:40:10.347963  kern  :alert :   ESR = 0x96000046
    2021-09-10T00:40:10.348228  kern  :alert :   EC = 0x25: DABT (current EL), IL = 32 bits
    2021-09-10T00:40:10.348475  kern  :alert :   SET = 0, FnV = 0
    2021-09-10T00:40:10.348985  kern  :alert :   EA<8>[   14.551067] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=emerg RESULT=fail UNITS=lines MEASUREMENT=2>
    2021-09-10T00:40:10.349269   = 0, S1PTW = 0   

platform                | arch  | lab             | compiler | defconfig                    | regressions
------------------------+-------+-----------------+----------+------------------------------+------------
imx8mp-evk              | arm64 | lab-nxp         | gcc-8    | defconfig+crypto             | 1          

  Details:     https://kernelci.org/test/plan/id/613aab6c1c03343facd5968d

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+crypto
  Compiler:    gcc-8 (aarch64-linux-gnu-gcc (Debian 8.3.0-2) 8.3.0)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v5.14-10891-g7e703ab62392/arm64/defconfig+crypto/gcc-8/lab-nxp/baseline-imx8mp-evk.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v5.14-10891-g7e703ab62392/arm64/defconfig+crypto/gcc-8/lab-nxp/baseline-imx8mp-evk.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/kci-2020.05-6-g8983f3b738df/arm64/baseline/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/613aab6c1c03343facd5968e
        new failure (last pass: v5.14-10568-g1006eb19726f) 

platform                | arch  | lab             | compiler | defconfig                    | regressions
------------------------+-------+-----------------+----------+------------------------------+------------
imx8mp-evk              | arm64 | lab-nxp         | gcc-8    | defconfig                    | 1          

  Details:     https://kernelci.org/test/plan/id/613aae030f9315f8c1d59665

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig
  Compiler:    gcc-8 (aarch64-linux-gnu-gcc (Debian 8.3.0-2) 8.3.0)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v5.14-10891-g7e703ab62392/arm64/defconfig/gcc-8/lab-nxp/baseline-imx8mp-evk.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v5.14-10891-g7e703ab62392/arm64/defconfig/gcc-8/lab-nxp/baseline-imx8mp-evk.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/kci-2020.05-6-g8983f3b738df/arm64/baseline/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/613aae030f9315f8c1d59666
        failing since 7 days (last pass: v5.14-619-gacb79da497df, first fail: v5.14-6828-g521f6987a116) 

platform                | arch  | lab             | compiler | defconfig                    | regressions
------------------------+-------+-----------------+----------+------------------------------+------------
imx8mp-evk              | arm64 | lab-nxp         | gcc-8    | defconfig+CON...OMIZE_BASE=y | 1          

  Details:     https://kernelci.org/test/plan/id/613aafcb01fa68617cd59665

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+CONFIG_RANDOMIZE_BASE=y
  Compiler:    gcc-8 (aarch64-linux-gnu-gcc (Debian 8.3.0-2) 8.3.0)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v5.14-10891-g7e703ab62392/arm64/defconfig+CONFIG_RANDOMIZE_BASE=y/gcc-8/lab-nxp/baseline-imx8mp-evk.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v5.14-10891-g7e703ab62392/arm64/defconfig+CONFIG_RANDOMIZE_BASE=y/gcc-8/lab-nxp/baseline-imx8mp-evk.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/kci-2020.05-6-g8983f3b738df/arm64/baseline/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/613aafcb01fa68617cd59666
        failing since 4 days (last pass: v5.14-8174-g2f453ff3ea7f, first fail: v5.14-9800-g9a811bf862bf) 

platform                | arch  | lab             | compiler | defconfig                    | regressions
------------------------+-------+-----------------+----------+------------------------------+------------
qemu_arm-versatilepb    | arm   | lab-baylibre    | gcc-8    | versatile_defconfig          | 1          

  Details:     https://kernelci.org/test/plan/id/613aa76f881a812156d5968e

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: versatile_defconfig
  Compiler:    gcc-8 (arm-linux-gnueabihf-gcc (Debian 8.3.0-2) 8.3.0)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v5.14-10891-g7e703ab62392/arm/versatile_defconfig/gcc-8/lab-baylibre/baseline-qemu_arm-versatilepb.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v5.14-10891-g7e703ab62392/arm/versatile_defconfig/gcc-8/lab-baylibre/baseline-qemu_arm-versatilepb.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/kci-2020.05-6-g8983f3b738df/armel/baseline/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/613aa76f881a812156d5968f
        failing since 297 days (last pass: v5.10-rc3-420-g5364e201065c, first fail: v5.10-rc3-639-ga24d51ed9363) 

platform                | arch  | lab             | compiler | defconfig                    | regressions
------------------------+-------+-----------------+----------+------------------------------+------------
qemu_arm-versatilepb    | arm   | lab-broonie     | gcc-8    | versatile_defconfig          | 1          

  Details:     https://kernelci.org/test/plan/id/613acdd2035a21b243d59667

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: versatile_defconfig
  Compiler:    gcc-8 (arm-linux-gnueabihf-gcc (Debian 8.3.0-2) 8.3.0)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v5.14-10891-g7e703ab62392/arm/versatile_defconfig/gcc-8/lab-broonie/baseline-qemu_arm-versatilepb.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v5.14-10891-g7e703ab62392/arm/versatile_defconfig/gcc-8/lab-broonie/baseline-qemu_arm-versatilepb.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/kci-2020.05-6-g8983f3b738df/armel/baseline/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/613acdd2035a21b243d59668
        failing since 297 days (last pass: v5.10-rc3-420-g5364e201065c, first fail: v5.10-rc3-639-ga24d51ed9363) 

platform                | arch  | lab             | compiler | defconfig                    | regressions
------------------------+-------+-----------------+----------+------------------------------+------------
qemu_arm-versatilepb    | arm   | lab-cip         | gcc-8    | versatile_defconfig          | 1          

  Details:     https://kernelci.org/test/plan/id/613aa9168cb6600a95d59675

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: versatile_defconfig
  Compiler:    gcc-8 (arm-linux-gnueabihf-gcc (Debian 8.3.0-2) 8.3.0)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v5.14-10891-g7e703ab62392/arm/versatile_defconfig/gcc-8/lab-cip/baseline-qemu_arm-versatilepb.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v5.14-10891-g7e703ab62392/arm/versatile_defconfig/gcc-8/lab-cip/baseline-qemu_arm-versatilepb.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/kci-2020.05-6-g8983f3b738df/armel/baseline/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/613aa9168cb6600a95d59676
        failing since 297 days (last pass: v5.10-rc3-420-g5364e201065c, first fail: v5.10-rc3-639-ga24d51ed9363) 

platform                | arch  | lab             | compiler | defconfig                    | regressions
------------------------+-------+-----------------+----------+------------------------------+------------
qemu_arm-versatilepb    | arm   | lab-collabora   | gcc-8    | versatile_defconfig          | 1          

  Details:     https://kernelci.org/test/plan/id/613aac0b51fbbf0481d59680

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: versatile_defconfig
  Compiler:    gcc-8 (arm-linux-gnueabihf-gcc (Debian 8.3.0-2) 8.3.0)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v5.14-10891-g7e703ab62392/arm/versatile_defconfig/gcc-8/lab-collabora/baseline-qemu_arm-versatilepb.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v5.14-10891-g7e703ab62392/arm/versatile_defconfig/gcc-8/lab-collabora/baseline-qemu_arm-versatilepb.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/kci-2020.05-6-g8983f3b738df/armel/baseline/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/613aac0b51fbbf0481d59681
        failing since 297 days (last pass: v5.10-rc3-420-g5364e201065c, first fail: v5.10-rc3-639-ga24d51ed9363) 

platform                | arch  | lab             | compiler | defconfig                    | regressions
------------------------+-------+-----------------+----------+------------------------------+------------
qemu_arm-versatilepb    | arm   | lab-linaro-lkft | gcc-8    | versatile_defconfig          | 1          

  Details:     https://kernelci.org/test/plan/id/613ac13fb6db25a4fad596a9

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: versatile_defconfig
  Compiler:    gcc-8 (arm-linux-gnueabihf-gcc (Debian 8.3.0-2) 8.3.0)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v5.14-10891-g7e703ab62392/arm/versatile_defconfig/gcc-8/lab-linaro-lkft/baseline-qemu_arm-versatilepb.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v5.14-10891-g7e703ab62392/arm/versatile_defconfig/gcc-8/lab-linaro-lkft/baseline-qemu_arm-versatilepb.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/kci-2020.05-6-g8983f3b738df/armel/baseline/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/613ac13fb6db25a4fad596aa
        failing since 297 days (last pass: v5.10-rc3-420-g5364e201065c, first fail: v5.10-rc3-639-ga24d51ed9363) 

platform                | arch  | lab             | compiler | defconfig                    | regressions
------------------------+-------+-----------------+----------+------------------------------+------------
rk3288-veyron-jaq       | arm   | lab-collabora   | gcc-8    | multi_v7_defconfig+ima       | 1          

  Details:     https://kernelci.org/test/plan/id/613aca94aaa07c80e2d59672

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+ima
  Compiler:    gcc-8 (arm-linux-gnueabihf-gcc (Debian 8.3.0-2) 8.3.0)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v5.14-10891-g7e703ab62392/arm/multi_v7_defconfig+ima/gcc-8/lab-collabora/baseline-rk3288-veyron-jaq.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v5.14-10891-g7e703ab62392/arm/multi_v7_defconfig+ima/gcc-8/lab-collabora/baseline-rk3288-veyron-jaq.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/kci-2020.05-6-g8983f3b738df/armel/baseline/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/613aca94aaa07c80e2d59673
        failing since 7 days (last pass: v5.14-rc7-111-g9541ebae8a1d, first fail: v5.14-6828-g521f6987a116) 

platform                | arch  | lab             | compiler | defconfig                    | regressions
------------------------+-------+-----------------+----------+------------------------------+------------
rk3288-veyron-jaq       | arm   | lab-collabora   | gcc-8    | multi_v7_defconfig+crypto    | 1          

  Details:     https://kernelci.org/test/plan/id/613acafb56a3b1b656d59671

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+crypto
  Compiler:    gcc-8 (arm-linux-gnueabihf-gcc (Debian 8.3.0-2) 8.3.0)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v5.14-10891-g7e703ab62392/arm/multi_v7_defconfig+crypto/gcc-8/lab-collabora/baseline-rk3288-veyron-jaq.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v5.14-10891-g7e703ab62392/arm/multi_v7_defconfig+crypto/gcc-8/lab-collabora/baseline-rk3288-veyron-jaq.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/kci-2020.05-6-g8983f3b738df/armel/baseline/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/613acafb56a3b1b656d59672
        failing since 7 days (last pass: v5.14-rc7-111-g9541ebae8a1d, first fail: v5.14-6828-g521f6987a116) 

platform                | arch  | lab             | compiler | defconfig                    | regressions
------------------------+-------+-----------------+----------+------------------------------+------------
rk3288-veyron-jaq       | arm   | lab-collabora   | gcc-8    | multi_v7_defc...G_ARM_LPAE=y | 1          

  Details:     https://kernelci.org/test/plan/id/613acdce7a9e6685f1d59670

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y
  Compiler:    gcc-8 (arm-linux-gnueabihf-gcc (Debian 8.3.0-2) 8.3.0)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v5.14-10891-g7e703ab62392/arm/multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y/gcc-8/lab-collabora/baseline-rk3288-veyron-jaq.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v5.14-10891-g7e703ab62392/arm/multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y/gcc-8/lab-collabora/baseline-rk3288-veyron-jaq.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/kci-2020.05-6-g8983f3b738df/armel/baseline/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/613acdce7a9e6685f1d59671
        failing since 7 days (last pass: v5.14-rc7-111-g9541ebae8a1d, first fail: v5.14-6828-g521f6987a116) 

platform                | arch  | lab             | compiler | defconfig                    | regressions
------------------------+-------+-----------------+----------+------------------------------+------------
rk3288-veyron-jaq       | arm   | lab-collabora   | gcc-8    | multi_v7_defconfig           | 1          

  Details:     https://kernelci.org/test/plan/id/613ad2fcd241c5b3e2d59666

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig
  Compiler:    gcc-8 (arm-linux-gnueabihf-gcc (Debian 8.3.0-2) 8.3.0)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v5.14-10891-g7e703ab62392/arm/multi_v7_defconfig/gcc-8/lab-collabora/baseline-rk3288-veyron-jaq.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v5.14-10891-g7e703ab62392/arm/multi_v7_defconfig/gcc-8/lab-collabora/baseline-rk3288-veyron-jaq.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/kci-2020.05-6-g8983f3b738df/armel/baseline/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/613ad2fcd241c5b3e2d59667
        failing since 7 days (last pass: v5.14-rc7-111-g9541ebae8a1d, first fail: v5.14-6828-g521f6987a116) 

platform                | arch  | lab             | compiler | defconfig                    | regressions
------------------------+-------+-----------------+----------+------------------------------+------------
rk3288-veyron-jaq       | arm   | lab-collabora   | gcc-8    | multi_v7_defc...CONFIG_SMP=n | 1          

  Details:     https://kernelci.org/test/plan/id/613ad6485b1aed004dd59665

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_SMP=n
  Compiler:    gcc-8 (arm-linux-gnueabihf-gcc (Debian 8.3.0-2) 8.3.0)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v5.14-10891-g7e703ab62392/arm/multi_v7_defconfig+CONFIG_SMP=n/gcc-8/lab-collabora/baseline-rk3288-veyron-jaq.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v5.14-10891-g7e703ab62392/arm/multi_v7_defconfig+CONFIG_SMP=n/gcc-8/lab-collabora/baseline-rk3288-veyron-jaq.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/kci-2020.05-6-g8983f3b738df/armel/baseline/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/613ad6485b1aed004dd59666
        failing since 7 days (last pass: v5.14-rc7-72-geeb46b4d4bd9, first fail: v5.14-6828-g521f6987a116) 

platform                | arch  | lab             | compiler | defconfig                    | regressions
------------------------+-------+-----------------+----------+------------------------------+------------
rk3399-gru-kevin        | arm64 | lab-collabora   | gcc-8    | defconfig                    | 2          

  Details:     https://kernelci.org/test/plan/id/613aaee87499b25dd2d59672

  Results:     89 PASS, 2 FAIL, 0 SKIP
  Full config: defconfig
  Compiler:    gcc-8 (aarch64-linux-gnu-gcc (Debian 8.3.0-2) 8.3.0)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v5.14-10891-g7e703ab62392/arm64/defconfig/gcc-8/lab-collabora/baseline-rk3399-gru-kevin.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v5.14-10891-g7e703ab62392/arm64/defconfig/gcc-8/lab-collabora/baseline-rk3399-gru-kevin.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/kci-2020.05-6-g8983f3b738df/arm64/baseline/rootfs.cpio.gz 

  * baseline.bootrr.rockchip-usb2phy1-probed: https://kernelci.org/test/case/id/613aaee87499b25dd2d59678
        failing since 59 days (last pass: v5.13-12625-g5f5e6a60f828, first fail: v5.14-rc1-225-g25a1eba130d1)

    2021-09-10T01:03:20.124739  /lava-4487513/1/../bin/lava-test-case
    2021-09-10T01:03:20.136206  <8>[   52.576864] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=rockchip-usb2phy1-probed RESULT=fail>   

  * baseline.bootrr.rockchip-usb2phy0-probed: https://kernelci.org/test/case/id/613aaee87499b25dd2d59679
        failing since 59 days (last pass: v5.13-12625-g5f5e6a60f828, first fail: v5.14-rc1-225-g25a1eba130d1)

    2021-09-10T01:03:19.089563  /lava-4487513/1/../bin/lava-test-case
    2021-09-10T01:03:19.101137  <8>[   51.541669] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=rockchip-usb2phy0-probed RESULT=fail>   

platform                | arch  | lab             | compiler | defconfig                    | regressions
------------------------+-------+-----------------+----------+------------------------------+------------
rk3399-gru-kevin        | arm64 | lab-collabora   | gcc-8    | defconfig+CON...OMIZE_BASE=y | 2          

  Details:     https://kernelci.org/test/plan/id/613aaf76cf65b3814fd59665

  Results:     89 PASS, 2 FAIL, 0 SKIP
  Full config: defconfig+CONFIG_RANDOMIZE_BASE=y
  Compiler:    gcc-8 (aarch64-linux-gnu-gcc (Debian 8.3.0-2) 8.3.0)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v5.14-10891-g7e703ab62392/arm64/defconfig+CONFIG_RANDOMIZE_BASE=y/gcc-8/lab-collabora/baseline-rk3399-gru-kevin.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v5.14-10891-g7e703ab62392/arm64/defconfig+CONFIG_RANDOMIZE_BASE=y/gcc-8/lab-collabora/baseline-rk3399-gru-kevin.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/kci-2020.05-6-g8983f3b738df/arm64/baseline/rootfs.cpio.gz 

  * baseline.bootrr.rockchip-usb2phy1-probed: https://kernelci.org/test/case/id/613aaf76cf65b3814fd5966b
        failing since 59 days (last pass: v5.13-12625-g5f5e6a60f828, first fail: v5.14-rc1-225-g25a1eba130d1)

    2021-09-10T01:05:48.280633  /lava-4487535/1/../bin/lava-test-case   

  * baseline.bootrr.rockchip-usb2phy0-probed: https://kernelci.org/test/case/id/613aaf76cf65b3814fd5966c
        failing since 59 days (last pass: v5.13-12625-g5f5e6a60f828, first fail: v5.14-rc1-225-g25a1eba130d1)

    2021-09-10T01:05:47.244024  /lava-4487535/1/../bin/lava-test-case
    2021-09-10T01:05:47.255873  <8>[   51.552629] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=rockchip-usb2phy0-probed RESULT=fail>   

platform                | arch  | lab             | compiler | defconfig                    | regressions
------------------------+-------+-----------------+----------+------------------------------+------------
sun50i-a64-bananapi-m64 | arm64 | lab-clabbe      | gcc-8    | defconfig+ima                | 1          

  Details:     https://kernelci.org/test/plan/id/613aa7a8accebebd91d59682

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+ima
  Compiler:    gcc-8 (aarch64-linux-gnu-gcc (Debian 8.3.0-2) 8.3.0)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v5.14-10891-g7e703ab62392/arm64/defconfig+ima/gcc-8/lab-clabbe/baseline-sun50i-a64-bananapi-m64.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v5.14-10891-g7e703ab62392/arm64/defconfig+ima/gcc-8/lab-clabbe/baseline-sun50i-a64-bananapi-m64.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/kci-2020.05-6-g8983f3b738df/arm64/baseline/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/613aa7a8accebebd91d59683
        failing since 3 days (last pass: v5.14-9800-g9a811bf862bf, first fail: v5.14-9872-gea617cdef108) 

platform                | arch  | lab             | compiler | defconfig                    | regressions
------------------------+-------+-----------------+----------+------------------------------+------------
sun50i-a64-bananapi-m64 | arm64 | lab-clabbe      | gcc-8    | defconfig                    | 1          

  Details:     https://kernelci.org/test/plan/id/613aa9d8a031e0dda2d59691

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig
  Compiler:    gcc-8 (aarch64-linux-gnu-gcc (Debian 8.3.0-2) 8.3.0)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v5.14-10891-g7e703ab62392/arm64/defconfig/gcc-8/lab-clabbe/baseline-sun50i-a64-bananapi-m64.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v5.14-10891-g7e703ab62392/arm64/defconfig/gcc-8/lab-clabbe/baseline-sun50i-a64-bananapi-m64.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/kci-2020.05-6-g8983f3b738df/arm64/baseline/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/613aa9d8a031e0dda2d59692
        failing since 1 day (last pass: v5.14-9872-gea617cdef108, first fail: v5.14-10568-g1006eb19726f)