Subject: next/pending-fixes baseline: 61 runs, 19 regressions (v6.5-rc3-350-gb917f578dc45d)

From: "kernelci.org bot" <[email-masked]>
Date: Wed, 26 Jul 2023 20:31:02 -0700 (PDT)

next/pending-fixes baseline: 61 runs, 19 regressions (v6.5-rc3-350-gb917f578dc45d)

Regressions Summary
-------------------

platform                     | arch  | lab             | compiler | defconfig | regressions
-----------------------------+-------+-----------------+----------+-----------+------------
fsl-ls1028a-rdb              | arm64 | lab-nxp         | gcc-10   | defconfig | 1          
fsl-ls2088a-rdb              | arm64 | lab-nxp         | gcc-10   | defconfig | 1          
fsl-lx2160a-rdb              | arm64 | lab-nxp         | gcc-10   | defconfig | 1          
imx8mm-innocomm-wb15-evk     | arm64 | lab-pengutronix | gcc-10   | defconfig | 1          
kontron-sl28-var3-ads2       | arm64 | lab-kontron     | gcc-10   | defconfig | 1          
qemu_arm64-virt-gicv2        | arm64 | lab-broonie     | gcc-10   | defconfig | 1          
qemu_arm64-virt-gicv2        | arm64 | lab-collabora   | gcc-10   | defconfig | 1          
qemu_arm64-virt-gicv2-uefi   | arm64 | lab-broonie     | gcc-10   | defconfig | 1          
qemu_arm64-virt-gicv2-uefi   | arm64 | lab-collabora   | gcc-10   | defconfig | 1          
qemu_arm64-virt-gicv3        | arm64 | lab-broonie     | gcc-10   | defconfig | 1          
qemu_arm64-virt-gicv3        | arm64 | lab-collabora   | gcc-10   | defconfig | 1          
qemu_arm64-virt-gicv3-uefi   | arm64 | lab-broonie     | gcc-10   | defconfig | 1          
qemu_arm64-virt-gicv3-uefi   | arm64 | lab-collabora   | gcc-10   | defconfig | 1          
r8a774c0-ek874               | arm64 | lab-cip         | gcc-10   | defconfig | 1          
r8a77960-ulcb                | arm64 | lab-collabora   | gcc-10   | defconfig | 1          
r8a779m1-ulcb                | arm64 | lab-collabora   | gcc-10   | defconfig | 1          
sun50i-a64-pine64-plus       | arm64 | lab-broonie     | gcc-10   | defconfig | 1          
sun50i-h5-lib...ch-all-h3-cc | arm64 | lab-broonie     | gcc-10   | defconfig | 1          
sun50i-h6-pine-h64           | arm64 | lab-collabora   | gcc-10   | defconfig | 1          

  Details:  https://kernelci.org/test/job/next/branch/pending-fixes/kernel/v6.5-rc3-350-gb917f578dc45d/plan/baseline/

  Test:     baseline
  Tree:     next
  Branch:   pending-fixes
  Describe: v6.5-rc3-350-gb917f578dc45d
  URL:      https://git.kernel.org/pub/scm/linux/kernel/git/next/linux-next.git
  SHA:      b917f578dc45de7c9e1e7265353aac5537513acf 

Test Regressions
---------------- 

platform                     | arch  | lab             | compiler | defconfig | regressions
-----------------------------+-------+-----------------+----------+-----------+------------
fsl-ls1028a-rdb              | arm64 | lab-nxp         | gcc-10   | defconfig | 1          

  Details:     https://kernelci.org/test/plan/id/64c1b4d356a53f4bfb8ace1c

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.5-rc3-350-gb917f578dc45d/arm64/defconfig/gcc-10/lab-nxp/baseline-fsl-ls1028a-rdb.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.5-rc3-350-gb917f578dc45d/arm64/defconfig/gcc-10/lab-nxp/baseline-fsl-ls1028a-rdb.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64c1b4d356a53f4bfb8ace1d
        new failure (last pass: v6.5-rc2-295-ge510699ebeee) 

platform                     | arch  | lab             | compiler | defconfig | regressions
-----------------------------+-------+-----------------+----------+-----------+------------
fsl-ls2088a-rdb              | arm64 | lab-nxp         | gcc-10   | defconfig | 1          

  Details:     https://kernelci.org/test/plan/id/64c1b484bad149b01b8acede

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.5-rc3-350-gb917f578dc45d/arm64/defconfig/gcc-10/lab-nxp/baseline-fsl-ls2088a-rdb.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.5-rc3-350-gb917f578dc45d/arm64/defconfig/gcc-10/lab-nxp/baseline-fsl-ls2088a-rdb.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/64c1b484bad149b01b8acee1
        failing since 12 days (last pass: v6.0-rc4-326-g49ccb7c6c3ca, first fail: v6.4-11141-g4556f2dbce0d)

    2023-07-27T00:04:11.177304  + [   12.767810] <LAVA_SIGNAL_ENDRUN 0_dmesg 1238745_1.5.2.4.1>
    2023-07-27T00:04:11.177582  set +x
    2023-07-27T00:04:11.282997  
    2023-07-27T00:04:11.384265  / # #export SHELL=/bin/sh
    2023-07-27T00:04:11.384657  
    2023-07-27T00:04:11.485621  / # export SHELL=/bin/sh. /lava-1238745/environment
    2023-07-27T00:04:11.486014  
    2023-07-27T00:04:11.587008  / # . /lava-1238745/environment/lava-1238745/bin/lava-test-runner /lava-1238745/1
    2023-07-27T00:04:11.587718  
    2023-07-27T00:04:11.591642  / # /lava-1238745/bin/lava-test-runner /lava-1238745/1 
    ... (12 line(s) more)  

platform                     | arch  | lab             | compiler | defconfig | regressions
-----------------------------+-------+-----------------+----------+-----------+------------
fsl-lx2160a-rdb              | arm64 | lab-nxp         | gcc-10   | defconfig | 1          

  Details:     https://kernelci.org/test/plan/id/64c1b57442117e04d28ace28

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.5-rc3-350-gb917f578dc45d/arm64/defconfig/gcc-10/lab-nxp/baseline-fsl-lx2160a-rdb.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.5-rc3-350-gb917f578dc45d/arm64/defconfig/gcc-10/lab-nxp/baseline-fsl-lx2160a-rdb.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64c1b57442117e04d28ace29
        new failure (last pass: v6.5-rc2-295-ge510699ebeee) 

platform                     | arch  | lab             | compiler | defconfig | regressions
-----------------------------+-------+-----------------+----------+-----------+------------
imx8mm-innocomm-wb15-evk     | arm64 | lab-pengutronix | gcc-10   | defconfig | 1          

  Details:     https://kernelci.org/test/plan/id/64c1b40ee82ff842d98ace36

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.5-rc3-350-gb917f578dc45d/arm64/defconfig/gcc-10/lab-pengutronix/baseline-imx8mm-innocomm-wb15-evk.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.5-rc3-350-gb917f578dc45d/arm64/defconfig/gcc-10/lab-pengutronix/baseline-imx8mm-innocomm-wb15-evk.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64c1b40ee82ff842d98ace37
        new failure (last pass: v6.5-rc2-295-ge510699ebeee) 

platform                     | arch  | lab             | compiler | defconfig | regressions
-----------------------------+-------+-----------------+----------+-----------+------------
kontron-sl28-var3-ads2       | arm64 | lab-kontron     | gcc-10   | defconfig | 1          

  Details:     https://kernelci.org/test/plan/id/64c1b434c0adf9f7e48ace8c

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.5-rc3-350-gb917f578dc45d/arm64/defconfig/gcc-10/lab-kontron/baseline-kontron-sl28-var3-ads2.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.5-rc3-350-gb917f578dc45d/arm64/defconfig/gcc-10/lab-kontron/baseline-kontron-sl28-var3-ads2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64c1b434c0adf9f7e48ace8d
        new failure (last pass: v6.5-rc2-295-ge510699ebeee) 

platform                     | arch  | lab             | compiler | defconfig | regressions
-----------------------------+-------+-----------------+----------+-----------+------------
qemu_arm64-virt-gicv2        | arm64 | lab-broonie     | gcc-10   | defconfig | 1          

  Details:     https://kernelci.org/test/plan/id/64c1b55c42117e04d28ace21

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.5-rc3-350-gb917f578dc45d/arm64/defconfig/gcc-10/lab-broonie/baseline-qemu_arm64-virt-gicv2.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.5-rc3-350-gb917f578dc45d/arm64/defconfig/gcc-10/lab-broonie/baseline-qemu_arm64-virt-gicv2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64c1b55c42117e04d28ace22
        new failure (last pass: v6.5-rc2-295-ge510699ebeee) 

platform                     | arch  | lab             | compiler | defconfig | regressions
-----------------------------+-------+-----------------+----------+-----------+------------
qemu_arm64-virt-gicv2        | arm64 | lab-collabora   | gcc-10   | defconfig | 1          

  Details:     https://kernelci.org/test/plan/id/64c1b3ffe82ff842d98ace30

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.5-rc3-350-gb917f578dc45d/arm64/defconfig/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv2.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.5-rc3-350-gb917f578dc45d/arm64/defconfig/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64c1b3ffe82ff842d98ace31
        new failure (last pass: v6.5-rc2-295-ge510699ebeee) 

platform                     | arch  | lab             | compiler | defconfig | regressions
-----------------------------+-------+-----------------+----------+-----------+------------
qemu_arm64-virt-gicv2-uefi   | arm64 | lab-broonie     | gcc-10   | defconfig | 1          

  Details:     https://kernelci.org/test/plan/id/64c1b4d0bad149b01b8acf03

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.5-rc3-350-gb917f578dc45d/arm64/defconfig/gcc-10/lab-broonie/baseline-qemu_arm64-virt-gicv2-uefi.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.5-rc3-350-gb917f578dc45d/arm64/defconfig/gcc-10/lab-broonie/baseline-qemu_arm64-virt-gicv2-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64c1b4d0bad149b01b8acf04
        new failure (last pass: v6.5-rc2-295-ge510699ebeee) 

platform                     | arch  | lab             | compiler | defconfig | regressions
-----------------------------+-------+-----------------+----------+-----------+------------
qemu_arm64-virt-gicv2-uefi   | arm64 | lab-collabora   | gcc-10   | defconfig | 1          

  Details:     https://kernelci.org/test/plan/id/64c1b3fec0adf9f7e48ace55

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.5-rc3-350-gb917f578dc45d/arm64/defconfig/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv2-uefi.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.5-rc3-350-gb917f578dc45d/arm64/defconfig/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv2-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64c1b3fec0adf9f7e48ace56
        new failure (last pass: v6.5-rc2-295-ge510699ebeee) 

platform                     | arch  | lab             | compiler | defconfig | regressions
-----------------------------+-------+-----------------+----------+-----------+------------
qemu_arm64-virt-gicv3        | arm64 | lab-broonie     | gcc-10   | defconfig | 1          

  Details:     https://kernelci.org/test/plan/id/64c1b5852901c68cf98ace1d

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.5-rc3-350-gb917f578dc45d/arm64/defconfig/gcc-10/lab-broonie/baseline-qemu_arm64-virt-gicv3.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.5-rc3-350-gb917f578dc45d/arm64/defconfig/gcc-10/lab-broonie/baseline-qemu_arm64-virt-gicv3.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64c1b5852901c68cf98ace1e
        new failure (last pass: v6.5-rc2-295-ge510699ebeee) 

platform                     | arch  | lab             | compiler | defconfig | regressions
-----------------------------+-------+-----------------+----------+-----------+------------
qemu_arm64-virt-gicv3        | arm64 | lab-collabora   | gcc-10   | defconfig | 1          

  Details:     https://kernelci.org/test/plan/id/64c1b401af9f6222db8ace1d

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.5-rc3-350-gb917f578dc45d/arm64/defconfig/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv3.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.5-rc3-350-gb917f578dc45d/arm64/defconfig/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv3.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64c1b401af9f6222db8ace1e
        new failure (last pass: v6.5-rc2-295-ge510699ebeee) 

platform                     | arch  | lab             | compiler | defconfig | regressions
-----------------------------+-------+-----------------+----------+-----------+------------
qemu_arm64-virt-gicv3-uefi   | arm64 | lab-broonie     | gcc-10   | defconfig | 1          

  Details:     https://kernelci.org/test/plan/id/64c1b4f956a53f4bfb8ace21

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.5-rc3-350-gb917f578dc45d/arm64/defconfig/gcc-10/lab-broonie/baseline-qemu_arm64-virt-gicv3-uefi.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.5-rc3-350-gb917f578dc45d/arm64/defconfig/gcc-10/lab-broonie/baseline-qemu_arm64-virt-gicv3-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64c1b4f956a53f4bfb8ace22
        new failure (last pass: v6.5-rc2-295-ge510699ebeee) 

platform                     | arch  | lab             | compiler | defconfig | regressions
-----------------------------+-------+-----------------+----------+-----------+------------
qemu_arm64-virt-gicv3-uefi   | arm64 | lab-collabora   | gcc-10   | defconfig | 1          

  Details:     https://kernelci.org/test/plan/id/64c1b415e82ff842d98ace3b

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.5-rc3-350-gb917f578dc45d/arm64/defconfig/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv3-uefi.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.5-rc3-350-gb917f578dc45d/arm64/defconfig/gcc-10/lab-collabora/baseline-qemu_arm64-virt-gicv3-uefi.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64c1b415e82ff842d98ace3c
        new failure (last pass: v6.5-rc2-295-ge510699ebeee) 

platform                     | arch  | lab             | compiler | defconfig | regressions
-----------------------------+-------+-----------------+----------+-----------+------------
r8a774c0-ek874               | arm64 | lab-cip         | gcc-10   | defconfig | 1          

  Details:     https://kernelci.org/test/plan/id/64c1b48fbad149b01b8aceea

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.5-rc3-350-gb917f578dc45d/arm64/defconfig/gcc-10/lab-cip/baseline-r8a774c0-ek874.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.5-rc3-350-gb917f578dc45d/arm64/defconfig/gcc-10/lab-cip/baseline-r8a774c0-ek874.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/64c1b48fbad149b01b8aceed
        failing since 8 days (last pass: v6.5-rc1-374-g7758824d54f7, first fail: v6.5-rc2-246-gefabeaa08ef1)

    2023-07-27T00:04:10.953847  / # #
    2023-07-27T00:04:12.414092  export SHELL=/bin/sh
    2023-07-27T00:04:12.434553  #
    2023-07-27T00:04:12.434752  / # export SHELL=/bin/sh
    2023-07-27T00:04:14.319594  / # . /lava-989462/environment
    2023-07-27T00:04:17.776559  /lava-989462/bin/lava-test-runner /lava-989462/1
    2023-07-27T00:04:17.797310  . /lava-989462/environment
    2023-07-27T00:04:17.797418  / # /lava-989462/bin/lava-test-runner /lava-989462/1
    2023-07-27T00:04:17.880656  + export 'TESTRUN_ID=1_bootrr'
    2023-07-27T00:04:17.880872  + cd /lava-989462/1/tests/1_bootrr 
    ... (26 line(s) more)  

platform                     | arch  | lab             | compiler | defconfig | regressions
-----------------------------+-------+-----------------+----------+-----------+------------
r8a77960-ulcb                | arm64 | lab-collabora   | gcc-10   | defconfig | 1          

  Details:     https://kernelci.org/test/plan/id/64c1b401ae8ec9968d8ace2c

  Results:     4 PASS, 2 FAIL, 1 SKIP
  Full config: defconfig
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.5-rc3-350-gb917f578dc45d/arm64/defconfig/gcc-10/lab-collabora/baseline-r8a77960-ulcb.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.5-rc3-350-gb917f578dc45d/arm64/defconfig/gcc-10/lab-collabora/baseline-r8a77960-ulcb.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/64c1b401ae8ec9968d8ace31
        failing since 8 days (last pass: v6.5-rc1-374-g7758824d54f7, first fail: v6.5-rc2-246-gefabeaa08ef1)

    2023-07-27T00:03:32.602975  / # #

    2023-07-27T00:03:32.705183  export SHELL=/bin/sh

    2023-07-27T00:03:32.705957  #<6>[   17.925268] mc: Linux media interface: v0.10

    2023-07-27T00:03:32.706367  

    2023-07-27T00:03:32.706632  / # <6>[   17.971464] videodev: Linux video capture interface: v2.00

    2023-07-27T00:03:32.706871  export SHELL=/bin/sh<6>[   18.004298] rcar_fdp1 fe940000.fdp1: Device registered as /dev/video2

    2023-07-27T00:03:32.808096  . /lava-11148130/environment

    2023-07-27T00:03:32.808845  

    2023-07-27T00:03:32.910352  / # . /lava-11148130/environment/lava-11148130/bin/lava-test-runner /lava-11148130/1

    2023-07-27T00:03:32.911563  <6>[   18.119504] rcar-dw-hdmi fead0000.hdmi: Detected HDMI TX controller v2.01a with HDCP (DWC HDMI 2.0 TX PHY)
 
    ... (16 line(s) more)  

platform                     | arch  | lab             | compiler | defconfig | regressions
-----------------------------+-------+-----------------+----------+-----------+------------
r8a779m1-ulcb                | arm64 | lab-collabora   | gcc-10   | defconfig | 1          

  Details:     https://kernelci.org/test/plan/id/64c1b426c0adf9f7e48ace7c

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.5-rc3-350-gb917f578dc45d/arm64/defconfig/gcc-10/lab-collabora/baseline-r8a779m1-ulcb.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.5-rc3-350-gb917f578dc45d/arm64/defconfig/gcc-10/lab-collabora/baseline-r8a779m1-ulcb.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/64c1b426c0adf9f7e48ace81
        failing since 8 days (last pass: v6.5-rc1-374-g7758824d54f7, first fail: v6.5-rc2-246-gefabeaa08ef1)

    2023-07-27T00:02:37.637472  / # #

    2023-07-27T00:02:38.717460  export SHELL=/bin/sh

    2023-07-27T00:02:38.718781  #

    2023-07-27T00:02:40.207899  / # export SHELL=/bin/sh. /lava-11148133/environment

    2023-07-27T00:02:40.209871  

    2023-07-27T00:02:42.935575  / # . /lava-11148133/environment/lava-11148133/bin/lava-test-runner /lava-11148133/1

    2023-07-27T00:02:42.938050  

    2023-07-27T00:02:42.945726  / # /lava-11148133/bin/lava-test-runner /lava-11148133/1

    2023-07-27T00:02:43.008466  + export 'TESTRUN_ID=1_bootrr'

    2023-07-27T00:02:43.008977  + cd /lava-111481<8>[   28.236022] <LAVA_SIGNAL_STARTRUN 1_bootrr 11148133_1.5.2.4.5>
 
    ... (39 line(s) more)  

platform                     | arch  | lab             | compiler | defconfig | regressions
-----------------------------+-------+-----------------+----------+-----------+------------
sun50i-a64-pine64-plus       | arm64 | lab-broonie     | gcc-10   | defconfig | 1          

  Details:     https://kernelci.org/test/plan/id/64c1b50756a53f4bfb8ace25

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.5-rc3-350-gb917f578dc45d/arm64/defconfig/gcc-10/lab-broonie/baseline-sun50i-a64-pine64-plus.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.5-rc3-350-gb917f578dc45d/arm64/defconfig/gcc-10/lab-broonie/baseline-sun50i-a64-pine64-plus.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64c1b50756a53f4bfb8ace26
        failing since 23 days (last pass: v6.4-4072-ge8f5f1933319, first fail: v6.4-10301-g9e106c7d604e) 

platform                     | arch  | lab             | compiler | defconfig | regressions
-----------------------------+-------+-----------------+----------+-----------+------------
sun50i-h5-lib...ch-all-h3-cc | arm64 | lab-broonie     | gcc-10   | defconfig | 1          

  Details:     https://kernelci.org/test/plan/id/64c1b42bc0adf9f7e48ace89

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.5-rc3-350-gb917f578dc45d/arm64/defconfig/gcc-10/lab-broonie/baseline-sun50i-h5-libretech-all-h3-cc.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.5-rc3-350-gb917f578dc45d/arm64/defconfig/gcc-10/lab-broonie/baseline-sun50i-h5-libretech-all-h3-cc.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/64c1b42bc0adf9f7e48ace8a
        failing since 7 days (last pass: v6.5-rc2-246-gefabeaa08ef1, first fail: v6.5-rc2-295-ge510699ebeee) 

platform                     | arch  | lab             | compiler | defconfig | regressions
-----------------------------+-------+-----------------+----------+-----------+------------
sun50i-h6-pine-h64           | arm64 | lab-collabora   | gcc-10   | defconfig | 1          

  Details:     https://kernelci.org/test/plan/id/64c1b415ae8ec9968d8ace48

  Results:     5 PASS, 1 FAIL, 1 SKIP
  Full config: defconfig
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/pending-fixes/v6.5-rc3-350-gb917f578dc45d/arm64/defconfig/gcc-10/lab-collabora/baseline-sun50i-h6-pine-h64.txt
  HTML log:    https://storage.kernelci.org//next/pending-fixes/v6.5-rc3-350-gb917f578dc45d/arm64/defconfig/gcc-10/lab-collabora/baseline-sun50i-h6-pine-h64.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20230623.0/arm64/rootfs.cpio.gz 

  * baseline.bootrr.deferred-probe-empty: https://kernelci.org/test/case/id/64c1b415ae8ec9968d8ace4d
        failing since 8 days (last pass: v6.5-rc1-374-g7758824d54f7, first fail: v6.5-rc2-246-gefabeaa08ef1)

    2023-07-27T00:03:44.015206  / # #

    2023-07-27T00:03:44.117320  export SHELL=/bin/sh

    2023-07-27T00:03:44.118028  <4>[   15.953461] dwmac-sun8i: probe of 5020000.ethernet failed with error -110

    2023-07-27T00:03:44.118391  #

    2023-07-27T00:03:44.118657  / # <6>[   16.053262] ax88179_178a 1-1:1.0 eth0: register 'ax88179_178a' at usb-5311000.usb-1, ASIX AX88179 USB 3.0 Gigabit Ethernet, 8c:ae:4c:e1:5d:0b

    2023-07-27T00:03:44.118898  <6>[   16.066375] usbcore: registered new interface driver ax88179_178a

    2023-07-27T00:03:44.220093  export SHELL=/bin/sh. /lava-11148121/environment

    2023-07-27T00:03:44.220801  

    2023-07-27T00:03:44.322277  / # . /lava-11148121/environment/lava-11148121/bin/lava-test-runner /lava-11148121/1

    2023-07-27T00:03:44.323359  
 
    ... (14 line(s) more)