fix(performance): tune benchmark durations based on actual runtimes

fix(performance): increase timeouts for long-running benchmarks
Merge pull request 'chore(ci): 规范化格式' (#125 ) from dev into main
2026-08-24 23:24:33 +08:00 · 2026-08-24 13:38:30 +08:00 · 2026-08-19 08:43:43 +00:00 · 2026-08-19 16:23:44 +08:00 · 2026-08-19 16:23:32 +08:00
25 changed files with 182 additions and 187 deletions
@@ -26,10 +26,4 @@ execute:
  how: tmt

 report:
-  how: display
-
-finish:
-  how: shell
-  script:
-    - rm -rf /tmp/ltp-posix
-    - rm -f /tmp/.beakerlib_ltp_posix_suite
+  how: display
@@ -120,6 +120,7 @@ ltpPosixSetup() {

    fi

+    rlCleanupAppend "ltpPosixCleanup"

 }

@@ -1,63 +1,63 @@
-# Functional test - Package tests
-
-This directory contains functional test cases for each package, Uses ACL sub-directory structure standard.
-
-## Test coverage overview
-
- **202 packages**, **561 test cases**, **1,692 functional points**
- All test scripts have been verified on openEuler RISC-V server
- See [Functional test coverage details](../../docs/coverage/functional-coverage.md)
-
-## directory structure
-
-```
-tests/functional/
-├── main.fmf # Shared configuration (All subdirectories inherit)
-├── README.md # this file
-└── pkgs/ # RPM Package functional tests
- ├── main.fmf # Shared configuration
- ├── acl/ # acl Package tests (Reference standard)
- │ ├── main.fmf
- │ ├── test.sh
- │ └── test_acl_*/ # Sub-test directories
- ├── attr/ # attr Package tests
- │ ├── main.fmf
- │ ├── test.sh
- │ └── test_attr_*/ # Sub-test directories
- └──... # More package tests
-```
-
-## Test structure specification (Refer to ACL)
-
-Each package test directory contains:
- `main.fmf` -- Package-level metadata configuration
- `test.sh` -- Package-level main test script
- `test_<pkg>_<feature>/` -- Sub-test directories split by functional point
- - `main.fmf` -- Sub-test metadata
- - `test.sh` -- Sub-test script
-
-## Add new package test
-
-1. Create directory `tests/functional/pkgs/<package_name>/`
-2. create `main.fmf` (Refer to `pkgs/acl/main.fmf`)
-3. create `test.sh` (Refer to template)
-4. Create sub-test directories by functional point
-
-## Run tests
-
-```bash
-tmt run plan --name /plans/functional test --name /tests/functional/<package_name>
-```
- Metadata files are uniformly named `main.fmf`
-
-## Test coverage progress
-
-| soft | Status | Number of test cases | Notes |
-|--------|------|-----------|------|
-| acl | ✅ Complete | 27+ | First example package |
-|... | To be added | - | - |
-
-## Reference documentation
-
- Package test writing guide:`.trellis/tasks/06-09-acl/package-test-guide.md`
- tmt Official documentation:https://tmt.readthedocs.io/
+# Functional test - Package tests
+
+This directory contains functional test cases for each package, Uses ACL sub-directory structure standard.
+
+## Test coverage overview
+
+- **202 packages**, **561 test cases**, **1,692 functional points**
+- All test scripts have been verified on openEuler RISC-V server
+- See [Functional test coverage details](../../docs/coverage/functional-coverage.md)
+
+## directory structure
+
+```
+tests/functional/
+├── main.fmf # Shared configuration (All subdirectories inherit)
+├── README.md # this file
+└── pkgs/ # RPM Package functional tests
+ ├── main.fmf # Shared configuration
+ ├── acl/ # acl Package tests (Reference standard)
+ │ ├── main.fmf
+ │ ├── test.sh
+ │ └── test_acl_*/ # Sub-test directories
+ ├── attr/ # attr Package tests
+ │ ├── main.fmf
+ │ ├── test.sh
+ │ └── test_attr_*/ # Sub-test directories
+ └──... # More package tests
+```
+
+## Test structure specification (Refer to ACL)
+
+Each package test directory contains:
+- `main.fmf` -- Package-level metadata configuration
+- `test.sh` -- Package-level main test script
+- `test_<pkg>_<feature>/` -- Sub-test directories split by functional point
+ - `main.fmf` -- Sub-test metadata
+ - `test.sh` -- Sub-test script
+
+## Add new package test
+
+1. Create directory `tests/functional/pkgs/<package_name>/`
+2. create `main.fmf` (Refer to `pkgs/acl/main.fmf`)
+3. create `test.sh` (Refer to template)
+4. Create sub-test directories by functional point
+
+## Run tests
+
+```bash
+tmt run plan --name /plans/functional test --name /tests/functional/<package_name>
+```
+- Metadata files are uniformly named `main.fmf`
+
+## Test coverage progress
+
+| soft | Status | Number of test cases | Notes |
+|--------|------|-----------|------|
+| acl | ✅ Complete | 27+ | First example package |
+|... | To be added | - | - |
+
+## Reference documentation
+
+- Package test writing guide:`.trellis/tasks/06-09-acl/package-test-guide.md`
+- tmt Official documentation:https://tmt.readthedocs.io/
@@ -1,13 +1,13 @@
-summary: Functional test - dejagnu - GCC compiletestwith
-test: ./test.sh
-tag:
- - functional
- - compiler
- - dejagnu
-duration: 10m
-tier: 2
-path: /tests/functional/compiler/dejagnu/test_dejagnu_gcc_test
-require:
- - dejagnu
- - gcc
- - beakerlib
+summary: Functional test - dejagnu - GCC compiletestwith
+test: ./test.sh
+tag:
+ - functional
+ - compiler
+ - dejagnu
+duration: 10m
+tier: 2
+path: /tests/functional/compiler/dejagnu/test_dejagnu_gcc_test
+require:
+ - dejagnu
+ - gcc
+ - beakerlib
@@ -1,13 +1,13 @@
-summary: Functional test - dejagnu - G++ compiletestwith
-test: ./test.sh
-tag:
- - functional
- - compiler
- - dejagnu
-duration: 10m
-tier: 2
-path: /tests/functional/compiler/dejagnu/test_dejagnu_gxx_test
-require:
- - dejagnu
- - gcc-c++
- - beakerlib
+summary: Functional test - dejagnu - G++ compiletestwith
+test: ./test.sh
+tag:
+ - functional
+ - compiler
+ - dejagnu
+duration: 10m
+tier: 2
+path: /tests/functional/compiler/dejagnu/test_dejagnu_gxx_test
+require:
+ - dejagnu
+ - gcc-c++
+ - beakerlib
@@ -1,12 +1,12 @@
-summary: Functional test - dejagnu - runtest availablecheck
-test: ./test.sh
-tag:
- - functional
- - compiler
- - dejagnu
-duration: 5m
-tier: 2
-path: /tests/functional/compiler/dejagnu/test_dejagnu_runtest_check
-require:
- - dejagnu
- - beakerlib
+summary: Functional test - dejagnu - runtest availablecheck
+test: ./test.sh
+tag:
+ - functional
+ - compiler
+ - dejagnu
+duration: 5m
+tier: 2
+path: /tests/functional/compiler/dejagnu/test_dejagnu_runtest_check
+require:
+ - dejagnu
+ - beakerlib
@@ -1,7 +1,7 @@
-summary: Functional test - dejagnu - warning (-Wall/-Wextra/-Werror/-pedantic)
-test: ./test.sh
-tag: [functional, compiler, dejagnu]
-duration: 5m
-tier: 2
-path: /tests/functional/compiler/dejagnu/test_dejagnu_warnings
-require: [dejagnu, gcc, clang, beakerlib]
+summary: Functional test - dejagnu - warning (-Wall/-Wextra/-Werror/-pedantic)
+test: ./test.sh
+tag: [functional, compiler, dejagnu]
+duration: 5m
+tier: 2
+path: /tests/functional/compiler/dejagnu/test_dejagnu_warnings
+require: [dejagnu, gcc, clang, beakerlib]
@@ -1,13 +1,13 @@
-summary: Functional test - Jotai programcompiletest
-tag:
- - functional
- - compiler
- - jotai
-duration: 15m
-tier: 2
-path: /tests/functional/compiler/jotai
-require:
- - beakerlib
- - gcc
- - clang
- - git
+summary: Functional test - Jotai programcompiletest
+tag:
+ - functional
+ - compiler
+ - jotai
+duration: 15m
+tier: 2
+path: /tests/functional/compiler/jotai
+require:
+ - beakerlib
+ - gcc
+ - clang
+ - git
@@ -1,14 +1,14 @@
-summary: Functional test - jotai - Environmentandrepolibrary
-test: ./test.sh
-tag:
- - functional
- - compiler
- - jotai
-duration: 5m
-tier: 2
-path: /tests/functional/compiler/jotai/test_jotai_setup
-require:
- - gcc
- - clang
- - git
- - beakerlib
+summary: Functional test - jotai - Environmentandrepolibrary
+test: ./test.sh
+tag:
+ - functional
+ - compiler
+ - jotai
+duration: 5m
+tier: 2
+path: /tests/functional/compiler/jotai/test_jotai_setup
+require:
+ - gcc
+ - clang
+ - git
+ - beakerlib
@@ -1,14 +1,14 @@
-summary: Functional test - yarpgen - source codebuildand
-test: ./test.sh
-tag:
- - functional
- - compiler
- - yarpgen
-duration: 10m
-tier: 2
-path: /tests/functional/compiler/yarpgen/test_yarpgen_build
-require:
- - gcc-c++
- - cmake
- - git
- - beakerlib
+summary: Functional test - yarpgen - source codebuildand
+test: ./test.sh
+tag:
+ - functional
+ - compiler
+ - yarpgen
+duration: 10m
+tier: 2
+path: /tests/functional/compiler/yarpgen/test_yarpgen_build
+require:
+ - gcc-c++
+ - cmake
+ - git
+ - beakerlib
@@ -1,7 +1,7 @@
-summary: Functional test - yarpgen - multifileseparate compilation + C/C++ link
-test: ./test.sh
-tag: [functional, compiler, yarpgen]
-duration: 5m
-tier: 2
-path: /tests/functional/compiler/yarpgen/test_yarpgen_multifile
-require: [gcc, gcc-c++, clang, beakerlib]
+summary: Functional test - yarpgen - multifileseparate compilation + C/C++ link
+test: ./test.sh
+tag: [functional, compiler, yarpgen]
+duration: 5m
+tier: 2
+path: /tests/functional/compiler/yarpgen/test_yarpgen_multifile
+require: [gcc, gcc-c++, clang, beakerlib]
@@ -1,11 +1,11 @@
-summary: Functional test - kernel - LTP test
-tag:
- - functional
- - kernel
- - realtime
- - ltp
-duration: 30m
-tier: 1
-path: /tests/functional/kernel/realtime
-require:
- - beakerlib
+summary: Functional test - kernel - LTP test
+tag:
+ - functional
+ - kernel
+ - realtime
+ - ltp
+duration: 30m
+tier: 1
+path: /tests/functional/kernel/realtime
+require:
+ - beakerlib
@@ -4,7 +4,7 @@ tag:
 - performance
 - kernel
 - mmtests
-duration: 30m
+duration: 90m
 tier: 1
 path: /tests/performance/mmtests/test_mmtests_io_blogbench
 require:
@@ -4,7 +4,7 @@ tag:
 - performance
 - kernel
 - mmtests
-duration: 30m
+duration: 120m
 tier: 1
 path: /tests/performance/mmtests/test_mmtests_io_trunc
 require:
@@ -4,7 +4,7 @@ tag:
 - performance
 - kernel
 - mmtests
-duration: 30m
+duration: 60m
 tier: 1
 path: /tests/performance/mmtests/test_mmtests_memdb_redis_benchmark_small
 require:
@@ -4,7 +4,7 @@ tag:
 - performance
 - kernel
 - mmtests
-duration: 30m
+duration: 55m
 tier: 1
 path: /tests/performance/mmtests/test_mmtests_pagereclaim_stutterp
 require:
@@ -4,7 +4,7 @@ tag:
 - performance
 - kernel
 - mmtests
-duration: 30m
+duration: 45m
 tier: 1
 path: /tests/performance/mmtests/test_mmtests_workload_ebizzy
 require:
@@ -4,7 +4,7 @@ tag:
 - performance
 - kernel
 - mmtests
-duration: 30m
+duration: 60m
 tier: 1
 path: /tests/performance/mmtests/test_mmtests_workload_usemem_stress_numa_compact
 require:
@@ -4,7 +4,7 @@ tag:
 - performance
 - kernel
 - mmtests
-duration: 30m
+duration: 120m
 tier: 1
 path: /tests/performance/mmtests/test_mmtests_workload_will_it_scale_io_processes
 require:
@@ -4,7 +4,7 @@ tag:
 - performance
 - kernel
 - mmtests
-duration: 30m
+duration: 120m
 tier: 1
 path: /tests/performance/mmtests/test_mmtests_workload_will_it_scale_io_threads
 require:
@@ -4,7 +4,7 @@ tag:
 - performance
 - kernel
 - mmtests
-duration: 30m
+duration: 55m
 tier: 1
 path: /tests/performance/mmtests/test_mmtests_workload_will_it_scale_sys_processes
 require:
@@ -3,7 +3,7 @@ test: ./test.sh
 tag:
 - performance
 - unixbench
-duration: 10m
+duration: 35m
 tier: 2
 path: /tests/performance/unixbench/test_unixbench_half_cpu
 require:
@@ -3,7 +3,7 @@ test: ./test.sh
 tag:
 - performance
 - unixbench
-duration: 10m
+duration: 35m
 tier: 2
 path: /tests/performance/unixbench/test_unixbench_multi_thread
 require:
@@ -3,7 +3,7 @@ test: ./test.sh
 tag:
 - performance
 - unixbench
-duration: 10m
+duration: 20m
 tier: 2
 path: /tests/performance/unixbench/test_unixbench_quick_mode
 require:
@@ -3,7 +3,7 @@ test: ./test.sh
 tag:
 - performance
 - unixbench
-duration: 10m
+duration: 35m
 tier: 2
 path: /tests/performance/unixbench/test_unixbench_single_thread
 require:
Author	SHA1	Message	Date
chainsx	a93d402209	fix(performance): tune benchmark durations based on actual runtimes	2026-08-24 23:24:33 +08:00
chainsx	eabca18075	fix(performance): increase timeouts for long-running benchmarks	2026-08-24 13:38:30 +08:00
redrose2100	653327ee0c	Merge pull request 'chore(ci): 规范化格式' (#125 ) from dev into main Reviewed-on: woqidaideshi/openruyi-autotest#125	2026-08-19 08:43:43 +00:00
honghua	0c4a2bce72	Merge branch 'main' of ssh://git.openruyi.cn:54865/woqidaideshi/openruyi-autotest	2026-08-19 16:23:44 +08:00
honghua	593a557da5	chore(fmf): normalize remaining CRLF files to LF per .gitattributes	2026-08-19 16:23:32 +08:00