Subject: next/master baseline: 726 runs, 22 regressions (next-20221020)

From: "kernelci.org bot" <[email-masked]>
Date: Thu, 20 Oct 2022 00:49:07 -0700 (PDT)

next/master baseline: 726 runs, 22 regressions (next-20221020)

Regressions Summary
-------------------

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
am57xx-beagle-x15            | arm   | lab-linaro-lkft | gcc-10   | multi_v7_defc...CONFIG_SMP=n | 1          
jetson-tk1                   | arm   | lab-baylibre    | clang-16 | multi_v7_defconfig           | 1          
jetson-tk1                   | arm   | lab-baylibre    | gcc-10   | multi_v7_defc...MB2_KERNEL=y | 2          
jetson-tk1                   | arm   | lab-baylibre    | gcc-10   | multi_v7_defc...CONFIG_SMP=n | 2          
jetson-tk1                   | arm   | lab-baylibre    | gcc-10   | multi_v7_defc...G_ARM_LPAE=y | 1          
jetson-tk1                   | arm   | lab-baylibre    | gcc-10   | multi_v7_defconfig           | 2          
jetson-tk1                   | arm   | lab-baylibre    | gcc-10   | tegra_defconfig              | 1          
kontron-pitx-imx8m           | arm64 | lab-kontron     | clang-16 | defconfig+CON..._64K_PAGES=y | 1          
kontron-pitx-imx8m           | arm64 | lab-kontron     | gcc-10   | defconfig+CON..._64K_PAGES=y | 1          
meson-gxbb-nanopi-k2         | arm64 | lab-baylibre    | gcc-10   | defconfig+CON...BIG_ENDIAN=y | 2          
mt8183-kukui-...uniper-sku16 | arm64 | lab-collabora   | clang-13 | cros://chrome...4-chromebook | 1          
mt8183-kukui-...uniper-sku16 | arm64 | lab-collabora   | clang-13 | defconfig+arm64-chromebook   | 1          
mt8183-kukui-...uniper-sku16 | arm64 | lab-collabora   | gcc-10   | defconfig+arm64-chromebook   | 1          
ox820-clouden...lug-series-3 | arm   | lab-baylibre    | gcc-10   | oxnas_v6_defconfig           | 1          
rk3399-gru-kevin             | arm64 | lab-collabora   | clang-13 | cros://chrome...4-chromebook | 3          
rk3399-rock-pi-4b            | arm64 | lab-collabora   | gcc-10   | defconfig+crypto             | 1          

  Details:  https://kernelci.org/test/job/next/branch/master/kernel/next-20221020/plan/baseline/

  Test:     baseline
  Tree:     next
  Branch:   master
  Describe: next-20221020
  URL:      https://git.kernel.org/pub/scm/linux/kernel/git/next/linux-next.git
  SHA:      acee3e83b493505058d1e48fce167f623dac1a05 

Test Regressions
---------------- 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
am57xx-beagle-x15            | arm   | lab-linaro-lkft | gcc-10   | multi_v7_defc...CONFIG_SMP=n | 1          

  Details:     https://kernelci.org/test/plan/id/6350ca00ed0fd5296f5e5b57

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_SMP=n
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221020/arm/multi_v7_defconfig+CONFIG_SMP=n/gcc-10/lab-linaro-lkft/baseline-am57xx-beagle-x15.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221020/arm/multi_v7_defconfig+CONFIG_SMP=n/gcc-10/lab-linaro-lkft/baseline-am57xx-beagle-x15.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221007.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6350ca00ed0fd5296f5e5b58
        failing since 32 days (last pass: next-20220915, first fail: next-20220916) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
jetson-tk1                   | arm   | lab-baylibre    | clang-16 | multi_v7_defconfig           | 1          

  Details:     https://kernelci.org/test/plan/id/6350dc2c6a486b88c55e5bb6

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig
  Compiler:    clang-16 (Debian clang version 16.0.0-++20221005071926+a3a9b0743e31-1~exp1~20221005072024.410)
  Plain log:   https://storage.kernelci.org//next/master/next-20221020/arm/multi_v7_defconfig/clang-16/lab-baylibre/baseline-jetson-tk1.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221020/arm/multi_v7_defconfig/clang-16/lab-baylibre/baseline-jetson-tk1.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221007.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6350dc2c6a486b88c55e5bb7
        failing since 57 days (last pass: next-20220822, first fail: next-20220823) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
jetson-tk1                   | arm   | lab-baylibre    | gcc-10   | multi_v7_defc...MB2_KERNEL=y | 2          

  Details:     https://kernelci.org/test/plan/id/6350ce5cde6ee1b9c75e5b7f

  Results:     4 PASS, 2 FAIL, 1 SKIP
  Full config: multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221020/arm/multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y/gcc-10/lab-baylibre/baseline-jetson-tk1.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221020/arm/multi_v7_defconfig+CONFIG_THUMB2_KERNEL=y/gcc-10/lab-baylibre/baseline-jetson-tk1.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221007.0/armel/rootfs.cpio.gz 

  * baseline.dmesg.emerg: https://kernelci.org/test/case/id/6350ce5cde6ee1b9c75e5b82
        failing since 7 days (last pass: next-20220923, first fail: next-20221012)
        45 lines

    2022-10-20T04:27:47.452554  kern  :alert : Register r1 information: 2-page vmalloc region starting at 0xf0ec4000 allocated at kernel_clone+0x41/0x298
    2022-10-20T04:27:47.490661  kern  :alert : Register r2 information: NULL pointer
    2022-10-20T04:27:47.491403  kern  :alert : Register r3 information: NULL pointer
    2022-10-20T04:27:47.491758  kern  :alert : Register r4 information: slab kmalloc-1k start c217f400 pointer offset 16 size 1024
    2022-10-20T04:27:47.491983  kern  :alert : Register r5 information: 7-page vmalloc region starting at 0xbf84e000 allocated at load_module+0x69f/0x15a4
    2022-10-20T04:27:47.492198  kern  :alert : Register r6 information: slab kmalloc-1k start c2d0f400 pointer offset 0
    2022-10-20T04:27:47.533671  kern  :alert : Register r7 information: slab kmalloc-512 start c2f22800 pointer offset 64 size 512
    2022-10-20T04:27:47.534556  kern  :alert : Register r8 information:
    2022-10-20T04:27:47.535479  kern  :alert : Register r9 information: slab kmalloc-512 start c2f22800 pointer offset 64 size 512
    2022-10-20T04:27:47.536047  kern  :alert : Register r10 information: NULL pointer 
    ... (38 line(s) more)  

  * baseline.dmesg.alert: https://kernelci.org/test/case/id/6350ce5cde6ee1b9c75e5b83
        failing since 7 days (last pass: next-20220923, first fail: next-20221012)
        16 lines

    2022-10-20T04:27:47.447555  kern  :alert : 8<--- cut here ---
    2022-10-20T04:27:47.448636  kern  :alert : Unable to handle kernel NULL pointer dereferen<8>[   16.654315] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=alert RESULT=fail UNITS=lines MEASUREMENT=16>
    2022-10-20T04:27:47.449104  ce at virtual address 00000000
    2022-10-20T04:27:47.449568  kern  :alert : [00000000] *pgd=f826c835
    2022-10-20T04:27:47.450053  kern  :alert : Register r0 information: slab kmalloc-1k start c2d0f400 pointer offset 0 size 1024   

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
jetson-tk1                   | arm   | lab-baylibre    | gcc-10   | multi_v7_defc...CONFIG_SMP=n | 2          

  Details:     https://kernelci.org/test/plan/id/6350d20a2dc5ff08425e5b44

  Results:     4 PASS, 2 FAIL, 1 SKIP
  Full config: multi_v7_defconfig+CONFIG_SMP=n
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221020/arm/multi_v7_defconfig+CONFIG_SMP=n/gcc-10/lab-baylibre/baseline-jetson-tk1.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221020/arm/multi_v7_defconfig+CONFIG_SMP=n/gcc-10/lab-baylibre/baseline-jetson-tk1.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221007.0/armel/rootfs.cpio.gz 

  * baseline.dmesg.emerg: https://kernelci.org/test/case/id/6350d20a2dc5ff08425e5b47
        failing since 22 days (last pass: next-20220921, first fail: next-20220927)
        45 lines

    2022-10-20T04:43:33.062834  kern  :alert : [00000000] *pgd=f8377835
    2022-10-20T04:43:33.063069  kern  :alert : Register r0 information: slab kmalloc-1k start c4bf3000 pointer offset 0 size 1024
    2022-10-20T04:43:33.063266  kern  :alert : Register r1 information: 2-page vmalloc region starting at 0xf0dc0000 allocated at kernel_clone+0x8c/0x310
    2022-10-20T04:43:33.063424  kern  :alert : Register r2 information: NULL pointer
    2022-10-20T04:43:33.063615  kern  :alert : Register r3 information: NULL pointer
    2022-10-20T04:43:33.104278  kern  :alert : Register r4 information: slab kmalloc-1k start c20b2400 pointer offset 16 size 1024
    2022-10-20T04:43:33.104902  kern  :alert : Register r5 information: 6-page vmalloc region starting at 0xbf0e0000 allocated at load_module+0x994/0x1cec
    2022-10-20T04:43:33.105251  kern  :alert : Register r6 information: slab kmalloc-1k start c4bf3000 pointer offset 0 size 1024
    2022-10-20T04:43:33.105530  kern  :alert : Register r7 information: slab kmalloc-512 start c2a4b400 pointer offset 64 size 512
    2022-10-20T04:43:33.107502  kern  :alert : Register r8 information: slab task_struct start c2982580 pointer offset 0 
    ... (40 line(s) more)  

  * baseline.dmesg.alert: https://kernelci.org/test/case/id/6350d20a2dc5ff08425e5b48
        failing since 22 days (last pass: next-20220921, first fail: next-20220927)
        16 lines

    2022-10-20T04:43:33.061249  kern  :alert : Unable to handle kerne<8>[   18.381340] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=alert RESULT=fail UNITS=lines MEASUREMENT=16>
    2022-10-20T04:43:33.061624  l NULL pointer dereference at virtual address 00000000   

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
jetson-tk1                   | arm   | lab-baylibre    | gcc-10   | multi_v7_defc...G_ARM_LPAE=y | 1          

  Details:     https://kernelci.org/test/plan/id/6350d26c37cc3ddb035e5b3e

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221020/arm/multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y/gcc-10/lab-baylibre/baseline-jetson-tk1.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221020/arm/multi_v7_defconfig+CONFIG_EFI=y+CONFIG_ARM_LPAE=y/gcc-10/lab-baylibre/baseline-jetson-tk1.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221007.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6350d26c37cc3ddb035e5b3f
        failing since 191 days (last pass: next-20220401, first fail: next-20220411) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
jetson-tk1                   | arm   | lab-baylibre    | gcc-10   | multi_v7_defconfig           | 2          

  Details:     https://kernelci.org/test/plan/id/6350d43847694c63115e5b94

  Results:     4 PASS, 2 FAIL, 1 SKIP
  Full config: multi_v7_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221020/arm/multi_v7_defconfig/gcc-10/lab-baylibre/baseline-jetson-tk1.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221020/arm/multi_v7_defconfig/gcc-10/lab-baylibre/baseline-jetson-tk1.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221007.0/armel/rootfs.cpio.gz 

  * baseline.dmesg.emerg: https://kernelci.org/test/case/id/6350d43847694c63115e5b97
        failing since 22 days (last pass: next-20220923, first fail: next-20220927)
        45 lines

    2022-10-20T04:52:53.759990  kern  :alert : Register r2 information: NULL pointer
    2022-10-20T04:52:53.760953  kern  :alert : Register r3 information: NULL pointer
    2022-10-20T04:52:53.761406  kern  :alert : Register r4 information: slab kmalloc-1k start c217f400 pointer offset 16 size 1024
    2022-10-20T04:52:53.761737  kern  :alert : Register r5 information: 6-page vmalloc region starting at 0xbf13f000 allocated at load_module+0x99c/0x1e04
    2022-10-20T04:52:53.762148  kern  :alert : Register r6 information: slab kmalloc-1k start c281e000 pointer offset 0 size 1024
    2022-10-20T04:52:53.802905  kern  :alert : Register r7 information: slab kmalloc-512 start c4bd0e00 pointer offset 64 size 512
    2022-10-20T04:52:53.803867  kern  :alert : Register r8 information: slab task_struct start c2156e80 pointer offset 0
    2022-10-20T04:52:53.804361  kern  :alert : Register r9 information: slab kmalloc-512 start c4bd0e00 pointer offset 64 size 512
    2022-10-20T04:52:53.804773  kern  :alert : Register r10 information: NULL pointer
    2022-10-20T04:52:53.805163  kern  :alert : Register r11 information: NULL pointer 
    ... (43 line(s) more)  

  * baseline.dmesg.alert: https://kernelci.org/test/case/id/6350d43847694c63115e5b98
        failing since 22 days (last pass: next-20220923, first fail: next-20220927)
        16 lines

    2022-10-20T04:52:53.717096  kern  :alert : 8<--- cut here ---
    2022-10-20T04:52:53.718188  kern  :alert : Unable to handle kernel NULL pointer dereference at virtual ad<8>[   16.656664] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=alert RESULT=fail UNITS=lines MEASUREMENT=16>
    2022-10-20T04:52:53.719062  dress 00000000
    2022-10-20T04:52:53.719667  kern  :alert : [00000000] *pgd=f83fc835
    2022-10-20T04:52:53.721765  kern  :alert : Register r0 information: slab kmalloc-1k start c281e000 pointer offset 0 size 1024
    2022-10-20T04:52:53.722404  kern  :alert : Register r1 information: 2-page vmalloc region starting at 0xf0ea0000 allocated at kernel_clone+0x8c/0x360   

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
jetson-tk1                   | arm   | lab-baylibre    | gcc-10   | tegra_defconfig              | 1          

  Details:     https://kernelci.org/test/plan/id/6350cdd8c5dfb464aa5e5b68

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: tegra_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221020/arm/tegra_defconfig/gcc-10/lab-baylibre/baseline-jetson-tk1.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221020/arm/tegra_defconfig/gcc-10/lab-baylibre/baseline-jetson-tk1.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221007.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6350cdd8c5dfb464aa5e5b69
        new failure (last pass: next-20221019) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
kontron-pitx-imx8m           | arm64 | lab-kontron     | clang-16 | defconfig+CON..._64K_PAGES=y | 1          

  Details:     https://kernelci.org/test/plan/id/6350c90e8a36041ed95e5b70

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+CONFIG_ARM64_64K_PAGES=y
  Compiler:    clang-16 (Debian clang version 16.0.0-++20221005071926+a3a9b0743e31-1~exp1~20221005072024.410)
  Plain log:   https://storage.kernelci.org//next/master/next-20221020/arm64/defconfig+CONFIG_ARM64_64K_PAGES=y/clang-16/lab-kontron/baseline-kontron-pitx-imx8m.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221020/arm64/defconfig+CONFIG_ARM64_64K_PAGES=y/clang-16/lab-kontron/baseline-kontron-pitx-imx8m.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221007.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6350c90e8a36041ed95e5b71
        failing since 14 days (last pass: next-20220923, first fail: next-20221005) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
kontron-pitx-imx8m           | arm64 | lab-kontron     | gcc-10   | defconfig+CON..._64K_PAGES=y | 1          

  Details:     https://kernelci.org/test/plan/id/6350cb2b12bd98b2b15e5b74

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+CONFIG_ARM64_64K_PAGES=y
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221020/arm64/defconfig+CONFIG_ARM64_64K_PAGES=y/gcc-10/lab-kontron/baseline-kontron-pitx-imx8m.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221020/arm64/defconfig+CONFIG_ARM64_64K_PAGES=y/gcc-10/lab-kontron/baseline-kontron-pitx-imx8m.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221007.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6350cb2b12bd98b2b15e5b75
        failing since 7 days (last pass: next-20221011, first fail: next-20221012) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
meson-gxbb-nanopi-k2         | arm64 | lab-baylibre    | gcc-10   | defconfig+CON...BIG_ENDIAN=y | 2          

  Details:     https://kernelci.org/test/plan/id/6350d25e96461063ba5e5b93

  Results:     4 PASS, 2 FAIL, 1 SKIP
  Full config: defconfig+CONFIG_CPU_BIG_ENDIAN=y
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221020/arm64/defconfig+CONFIG_CPU_BIG_ENDIAN=y/gcc-10/lab-baylibre/baseline-meson-gxbb-nanopi-k2.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221020/arm64/defconfig+CONFIG_CPU_BIG_ENDIAN=y/gcc-10/lab-baylibre/baseline-meson-gxbb-nanopi-k2.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221007.0/arm64be/rootfs.cpio.gz 

  * baseline.dmesg.emerg: https://kernelci.org/test/case/id/6350d25e96461063ba5e5b96
        new failure (last pass: next-20221010)
        2 lines

    2022-10-20T04:44:44.671522  kern  :alert :   EC = 0x25: DABT (current EL), IL = 32 bits
    2022-10-20T04:44:44.671755  kern  :alert :   SET = 0, FnV = 0
    2022-10-20T04:44:44.671971  kern  :alert :   EA <8>[   19.302340] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=emerg RESULT=fail UNITS=lines MEASUREMENT=2>
    2022-10-20T04:44:44.672184  = 0, S1PTW = 0
    2022-10-20T04:44:44.672413  kern  <8>[   19.310214] <LAVA_SIGNAL_ENDRUN 0_dmesg 2707423_1.5.2.4.1>   

  * baseline.dmesg.alert: https://kernelci.org/test/case/id/6350d25e96461063ba5e5b97
        new failure (last pass: next-20221010)
        12 lines

    2022-10-20T04:44:44.631319  kern  :alert : Mem abort info:
    2022-10-20T04:44:44.669949  kern  <8>[   19.277871] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=alert RESULT=fail UNITS=lines MEASUREMENT=12>
    2022-10-20T04:44:44.670290  :alert :   ESR = 0x0000000096000005   

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
mt8183-kukui-...uniper-sku16 | arm64 | lab-collabora   | clang-13 | cros://chrome...4-chromebook | 1          

  Details:     https://kernelci.org/test/plan/id/6350ca563cf905ad585e5b9a

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: cros://chromeos-5.10/arm64/chromiumos-arm64.flavour.config+arm64-chromebook
  Compiler:    clang-13 (Debian clang version 13.0.1-6~deb11u1)
  Plain log:   https://storage.kernelci.org//next/master/next-20221020/arm64/cros---chromeos-5.10-arm64-chromiumos-arm64.flavour.config+arm64-chromebook/clang-13/lab-collabora/baseline-mt8183-kukui-jacuzzi-juniper-sku16.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221020/arm64/cros---chromeos-5.10-arm64-chromiumos-arm64.flavour.config+arm64-chromebook/clang-13/lab-collabora/baseline-mt8183-kukui-jacuzzi-juniper-sku16.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221007.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6350ca563cf905ad585e5b9b
        failing since 97 days (last pass: next-20220705, first fail: next-20220714) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
mt8183-kukui-...uniper-sku16 | arm64 | lab-collabora   | clang-13 | defconfig+arm64-chromebook   | 1          

  Details:     https://kernelci.org/test/plan/id/6350cabdf0ef5945f75e5b50

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook
  Compiler:    clang-13 (Debian clang version 13.0.1-6~deb11u1)
  Plain log:   https://storage.kernelci.org//next/master/next-20221020/arm64/defconfig+arm64-chromebook/clang-13/lab-collabora/baseline-mt8183-kukui-jacuzzi-juniper-sku16.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221020/arm64/defconfig+arm64-chromebook/clang-13/lab-collabora/baseline-mt8183-kukui-jacuzzi-juniper-sku16.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221007.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6350cabdf0ef5945f75e5b51
        failing since 160 days (last pass: next-20220506, first fail: next-20220512) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
mt8183-kukui-...uniper-sku16 | arm64 | lab-collabora   | gcc-10   | defconfig+arm64-chromebook   | 1          

  Details:     https://kernelci.org/test/plan/id/6350cc1018b1d1ade65e5b51

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+arm64-chromebook
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221020/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-mt8183-kukui-jacuzzi-juniper-sku16.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221020/arm64/defconfig+arm64-chromebook/gcc-10/lab-collabora/baseline-mt8183-kukui-jacuzzi-juniper-sku16.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221007.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6350cc1018b1d1ade65e5b52
        failing since 125 days (last pass: next-20220610, first fail: next-20220616) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
ox820-clouden...lug-series-3 | arm   | lab-baylibre    | gcc-10   | oxnas_v6_defconfig           | 1          

  Details:     https://kernelci.org/test/plan/id/6350c6edd4aedb383c5e5b4f

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: oxnas_v6_defconfig
  Compiler:    gcc-10 (arm-linux-gnueabihf-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221020/arm/oxnas_v6_defconfig/gcc-10/lab-baylibre/baseline-ox820-cloudengines-pogoplug-series-3.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221020/arm/oxnas_v6_defconfig/gcc-10/lab-baylibre/baseline-ox820-cloudengines-pogoplug-series-3.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221007.0/armel/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6350c6edd4aedb383c5e5b50
        failing since 57 days (last pass: next-20220822, first fail: next-20220823) 

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
rk3399-gru-kevin             | arm64 | lab-collabora   | clang-13 | cros://chrome...4-chromebook | 3          

  Details:     https://kernelci.org/test/plan/id/6350c9a0d9c245f71c5e5b6b

  Results:     71 PASS, 21 FAIL, 0 SKIP
  Full config: cros://chromeos-5.10/arm64/chromiumos-arm64.flavour.config+arm64-chromebook
  Compiler:    clang-13 (Debian clang version 13.0.1-6~deb11u1)
  Plain log:   https://storage.kernelci.org//next/master/next-20221020/arm64/cros---chromeos-5.10-arm64-chromiumos-arm64.flavour.config+arm64-chromebook/clang-13/lab-collabora/baseline-rk3399-gru-kevin.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221020/arm64/cros---chromeos-5.10-arm64-chromiumos-arm64.flavour.config+arm64-chromebook/clang-13/lab-collabora/baseline-rk3399-gru-kevin.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221007.0/arm64/rootfs.cpio.gz 

  * baseline.bootrr.cros-ec-sensors-gyro0-probed: https://kernelci.org/test/case/id/6350c9a0d9c245f71c5e5bb2
        failing since 2 days (last pass: next-20221013, first fail: next-20221017)

    2022-10-20T04:07:37.517434  <8>[   91.710620] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=cros-ec-sensors-accel1-probed RESULT=fail>
    2022-10-20T04:07:38.536373  /lava-7653282/1/../bin/lava-test-case
    2022-10-20T04:07:38.549181  <8>[   92.743020] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=cros-ec-sensors-gyro0-probed RESULT=fail>   

  * baseline.bootrr.cros-ec-sensors-accel1-probed: https://kernelci.org/test/case/id/6350c9a0d9c245f71c5e5bb3
        failing since 2 days (last pass: next-20221013, first fail: next-20221017)

    2022-10-20T04:07:36.490521  <8>[   90.683771] <LAVA_SIGNAL_TESTCASE TEST_CASE_ID=cros-ec-sensors-accel0-probed RESULT=fail>
    2022-10-20T04:07:37.505456  /lava-7653282/1/../bin/lava-test-case   

  * baseline.bootrr.cros-ec-sensors-accel0-probed: https://kernelci.org/test/case/id/6350c9a0d9c245f71c5e5bb4
        failing since 2 days (last pass: next-20221013, first fail: next-20221017)

    2022-10-20T04:07:36.476886  /lava-7653282/1/../bin/lava-test-case   

platform                     | arch  | lab             | compiler | defconfig                    | regressions
-----------------------------+-------+-----------------+----------+------------------------------+------------
rk3399-rock-pi-4b            | arm64 | lab-collabora   | gcc-10   | defconfig+crypto             | 1          

  Details:     https://kernelci.org/test/plan/id/6350cdf6e9033efd995e5b3a

  Results:     0 PASS, 1 FAIL, 0 SKIP
  Full config: defconfig+crypto
  Compiler:    gcc-10 (aarch64-linux-gnu-gcc (Debian 10.2.1-6) 10.2.1 20210110)
  Plain log:   https://storage.kernelci.org//next/master/next-20221020/arm64/defconfig+crypto/gcc-10/lab-collabora/baseline-rk3399-rock-pi-4b.txt
  HTML log:    https://storage.kernelci.org//next/master/next-20221020/arm64/defconfig+crypto/gcc-10/lab-collabora/baseline-rk3399-rock-pi-4b.html
  Rootfs:      http://storage.kernelci.org/images/rootfs/buildroot/buildroot-baseline/20221007.0/arm64/rootfs.cpio.gz 

  * baseline.login: https://kernelci.org/test/case/id/6350cdf6e9033efd995e5b3b
        new failure (last pass: next-20221019)