Compare commits

..
Author SHA1 Message Date
chainsx a337f204d4 fix(tests): remove top-level local from test scripts 2026-09-20 19:32:21 +08:00
woqidaideshi 9d8a140b68 Merge pull request 'fix(performance): adjust benchmark timeouts based on measured runtime' (#127) from chainsx/openruyi-autotest:fix-performance-timeouts-final into main
Reviewed-on: woqidaideshi/openruyi-autotest#127
2026-09-03 10:25:38 +00:00
chainsx 1d7340e96e fix(performance): adjust benchmark timeouts and fix MMTests exit parsing 2026-09-03 16:03:51 +08:00
woqidaideshi 9f0b3f5935 Merge pull request 'fix(security): set reasonable timeout for cve tests' (#130) from chainsx/openruyi-autotest:fix-security-cve-timeouts into main
Reviewed-on: woqidaideshi/openruyi-autotest#130
2026-09-01 07:44:30 +00:00
chainsx 1fb30e5398 fix(security): set reasonable timeout for cve tests 2026-08-27 00:13:55 +08:00
woqidaideshi fac8213444 Merge pull request 'feat: add cmake test for editorconfig-core-c fltk-devel spirv-cross-devel' (#128) from cmake_all_new into main
Reviewed-on: woqidaideshi/openruyi-autotest#128
2026-08-25 07:34:23 +00:00
woqidaideshi 74b4eb4ef2 feat: add three test cases for missing -static
This reverts commit f7ab0a24d4.
2026-08-25 03:28:27 -04:00
woqidaideshi 1c44966f8b Merge pull request 'fix(functional): fix cmake and blktests tests' (#126) from chainsx/openruyi-autotest:fix-functional-realtime-skip into main
Reviewed-on: woqidaideshi/openruyi-autotest#126
2026-08-25 02:09:35 +00:00
chainsx 166498ad14 fix(functional): fix cmake and blktests tests 2026-08-22 23:27:36 +08:00
redrose2100 653327ee0c Merge pull request 'chore(ci): 规范化格式' (#125) from dev into main
Reviewed-on: woqidaideshi/openruyi-autotest#125
2026-08-19 08:43:43 +00:00
honghua 0c4a2bce72 Merge branch 'main' of ssh://git.openruyi.cn:54865/woqidaideshi/openruyi-autotest 2026-08-19 16:23:44 +08:00
honghua 593a557da5 chore(fmf): normalize remaining CRLF files to LF per .gitattributes 2026-08-19 16:23:32 +08:00
woqidaideshi 27061e6998 Merge pull request 'fix: tests/functional/cmake:test_flang22_cmake_verify: find_package mlir clang' (#122) from cmake_all_new into main
Reviewed-on: woqidaideshi/openruyi-autotest#122
2026-08-17 09:44:46 +00:00
redrose2100 28f3537fee Merge pull request 'feat(k8s): sonobuoy-based k8s feature test suite' (#120) from 2026_08_12_1-k8s-feature-tests into main
Reviewed-on: woqidaideshi/openruyi-autotest#120
2026-08-17 05:38:35 +00:00
honghua 22d4200131 docs(user-guide): remove section 10 (k8s feature tests) - k8s cases now use standard flow 2026-08-17 13:30:02 +08:00
honghua e96a5cc0de chore(fmf): normalize line endings to LF per .gitattributes 2026-08-17 12:28:33 +08:00
honghua 68fe8a888f fix(docs): restore user guide section 10 (k8s feature tests) from PR120 base 2026-08-17 12:19:39 +08:00
honghua c5179e7810 Reapply "merge: merge origin/main (PR #119 removed k8s tests) into feature branch, keep k8s suite in feature branch"
This reverts commit c43bf658c2.
2026-08-17 12:19:38 +08:00
honghua c43bf658c2 Revert "merge: merge origin/main (PR #119 removed k8s tests) into feature branch, keep k8s suite in feature branch"
This reverts commit bca1403d90, reversing
changes made to 1fe92117f7.
2026-08-17 12:17:26 +08:00
honghua bca1403d90 merge: merge origin/main (PR #119 removed k8s tests) into feature branch, keep k8s suite in feature branch 2026-08-17 12:15:57 +08:00
honghua 1fe92117f7 fix(k8s): use sonobuoy results --mode=report for assertions
Detailed mode emits per-item JSON (status=pass) with no summary lines, so the Passed/Failed/Total/Status assertions never matched. Switch to report mode (default) which prints 'Passed: 2 / Failed: 0 / Total: 2 / Status: passed' summary; also drop unsupported --kubeconfig from the results command.
2026-08-14 16:13:59 +08:00
honghua fdb39411f0 feat(k8s): rewrite k8s feature suite with smoke-only cases (cluster_ready + sonobuoy_smoke)
- Replace conformance-based 39-case suite with 2 smoke cases
- test_k8s_cluster_ready: precheck kubectl, kubeconfig, node Ready status
- test_k8s_sonobuoy_smoke: sonobuoy run/retrieve/results full loop, expect Passed: 2, Failed: 0
- lib.sh: sonobuoy install/remove with reference counting (flag-file pattern),
  direct-evidence style, run locally on master node (no SSH relay)
- main.fmf per case with tag feature/k8s
2026-08-14 09:46:25 +08:00
woqidaideshi 3b45cf8824 fix: tests/functional/cmake:test_flang22_cmake_verify: find_package mlir clang 2026-08-13 18:06:21 +08:00
honghua 154a5589d8 fix(k8s): replace 95% pass-rate threshold with per-item result attribution
Per the agreed design (6.3): drop the >=95% pass-rate gate for the 35
conformance focus groups. Instead each failed/timeout item from
`sonobuoy results --mode=detailed` (JSONL) is classified individually:

- matches KNOWN_UNSUPPORTED (RISC-V unsupported, env-overridable,
  empty by default) -> `tmt-report-result "/<test>" SKIP` subresult,
  which does not fail the case
- anything else -> `tmt-report-result "/<test>" FAIL` subresult and
  real_failures++

The case passes iff real_failures == 0. Test names are sanitized
(single quotes -> underscore) before use in tmt-report-result.
2026-08-13 13:32:58 +08:00
honghua 060fd0e9b0 fix(k8s): single-quote e2e-focus inside cmd to survive rlRun eval
rlRun evals its command string (src/testing.sh: eval "$__INTERNAL_rlRun_command").
A literal double quote inside $cmd was re-parsed by eval, splitting the
argument and even causing syntax errors on regex parens:
  syntax error near unexpected token '('
Verified with real bash (Git bash) end-to-end:
  eval -> hwRunOnServer -> printf %q -> remote sh -c -> sonobuoy argv
Single quotes inside $cmd survive eval as literal chars and are re-parsed
only on the remote side, keeping --e2e-focus regex intact.

Affects: 35 conformance cases + sig_network + sig_storage test.sh.
2026-08-13 11:05:18 +08:00
honghua f1f021c723 feat(k8s): add sonobuoy-based k8s feature test suite (39 cases)
Replace the old kubectl-equivalent k8s suite with a Sonobuoy direct-evidence
version (design docs/tasks/.../2026_08_12_1-k8s-feature-tests/design.md):
- 1x quick mode (sonobuoy run --mode quick)
- 35x non-disruptive-conformance groups with explicit --e2e-focus regex
  covering the official v1.35 conformance list (441/441 tests)
- 1x systemd-logs plugin collection
- 2x custom e2e focus runs (sig-network / sig-storage)

Shared lib.sh manages the sonobuoy CLI binary lifecycle on the master node
(reference-counted: install once, uninstall when last case finishes).
Each test.sh calls sonobuoy CLI commands directly (script direct-evidence).
2026-08-13 10:47:49 +08:00
105 changed files with 1178 additions and 537 deletions
+11
View File
@@ -0,0 +1,11 @@
summary: K8s feature tests - cluster ready precheck
test: ./test.sh
tag:
- feature
- k8s
- cluster
duration: 5m
tier: 1
path: /tests/feature/k8s/cluster_ready
require:
- beakerlib
+53
View File
@@ -0,0 +1,53 @@
#!/bin/bash
# K8s feature test: cluster ready precheck
# Verify the RISC-V K8s cluster is ready before running sonobuoy smoke:
# - kubectl CLI available
# - kubeconfig readable (admin.conf)
# - kubectl can reach the cluster API
# - all nodes are Ready (expect 2: master + worker)
#
# Runs LOCALLY on the K8s master node (tmt provision: local).
. /usr/share/beakerlib/beakerlib.sh || exit 1
K8S_KUBECONFIG="/etc/kubernetes/admin.conf"
EXPECT_NODES=2
rlJournalStart
rlPhaseStartSetup "Environment setup"
rlRun "id" 0 "Current user"
rlRun "uname -m" 0 "Architecture (expect riscv64)"
rlPhaseEnd
rlPhaseStartTest "K8s cluster ready precheck"
# 1. kubectl CLI available
rlRun "command -v kubectl" 0 "kubectl CLI is available"
# 2. kubeconfig exists and readable
if [ ! -r "$K8S_KUBECONFIG" ]; then
rlFail "kubeconfig not readable: $K8S_KUBECONFIG"
else
rlPass "kubeconfig readable: $K8S_KUBECONFIG"
fi
# 3. kubectl can reach the cluster API
rlRun "kubectl --kubeconfig=$K8S_KUBECONFIG version --client" 0 "kubectl client version"
rlRun "kubectl --kubeconfig=$K8S_KUBECONFIG cluster-info" 0 "Cluster API reachable"
# 4. All nodes Ready (expect 2)
node_count=$(kubectl --kubeconfig=$K8S_KUBECONFIG get nodes --no-headers 2>/dev/null | wc -l)
ready_count=$(kubectl --kubeconfig=$K8S_KUBECONFIG get nodes --no-headers 2>/dev/null | awk '{print $2}' | grep -c '^Ready$')
rlLogInfo "Node count: $node_count, Ready count: $ready_count (expect $EXPECT_NODES)"
if [ "$node_count" -eq "$EXPECT_NODES" ] && [ "$ready_count" -eq "$EXPECT_NODES" ]; then
rlPass "All $EXPECT_NODES nodes are Ready"
else
rlFail "Expected $EXPECT_NODES Ready nodes, got $node_count total / $ready_count Ready"
kubectl --kubeconfig=$K8S_KUBECONFIG get nodes -o wide
fi
rlPhaseEnd
rlPhaseStartCleanup "Clean up test environment"
rlPhaseEnd
rlJournalPrintText
rlJournalEnd
+137
View File
@@ -0,0 +1,137 @@
# library-prefix = k8s
#
# K8s suite-level shared library
# Provides sonobuoy CLI installation/removal with reference counting,
# and smoke plugin manifest download.
#
# All functions run LOCALLY on the K8s master node (tmt provision: local).
# No SSH remote invocation is involved.
#
# Sonobuoy facts (verified):
# - CLI: sonobuoy-v0.57.3-riscv64, SHA256 0f5642a5ecbecc79e79aa3a1ab015c2e77d0027c51938fee7d5ac9d8dfd166be
# - Source: https://nexus.osssc.ac.cn/repository/openruyi-k8s/v1.35.5/sonobuoy/bin/sonobuoy-v0.57.3-riscv64
# - Smoke plugin manifest:
# https://nexus.osssc.ac.cn/repository/openruyi-k8s/v1.35.5/manifests/openruyi-riscv-sonobuoy-smoke.yaml
#
# Usage:
# . "$(dirname "$0")/../lib.sh" # from cluster_ready/ or sonobuoy_smoke/
# k8sLibSetup # in Setup phase
# k8sFetchSmokePlugin # fetch plugin manifest to /tmp
# k8sLibCleanup # registered via rlCleanupAppend
K8S_FLAG="/tmp/.beakerlib_k8s_suite"
SONOBUOY_VERSION="v0.57.3"
SONOBUOY_BIN="sonobuoy-${SONOBUOY_VERSION}-riscv64"
SONOBUOY_INSTALL="/usr/local/bin/sonobuoy"
SONOBUOY_SHA256="0f5642a5ecbecc79e79aa3a1ab015c2e77d0027c51938fee7d5ac9d8dfd166be"
SONOBUOY_URL="https://nexus.osssc.ac.cn/repository/openruyi-k8s/v1.35.5/sonobuoy/bin/${SONOBUOY_BIN}"
K8S_SMOKE_PLUGIN="/tmp/openruyi-riscv-sonobuoy-smoke.yaml"
K8S_SMOKE_PLUGIN_URL="https://nexus.osssc.ac.cn/repository/openruyi-k8s/v1.35.5/manifests/openruyi-riscv-sonobuoy-smoke.yaml"
K8S_KUBECONFIG="/etc/kubernetes/admin.conf"
# Download sonobuoy CLI, verify SHA256, install to /usr/local/bin.
# Returns 0 on success, 1 on failure (after retries).
_k8sInstallSonobuoy() {
local attempts=0
while [ "$attempts" -lt 2 ]; do
attempts=$((attempts + 1))
rlLogInfo "Downloading sonobuoy (attempt $attempts/2): $SONOBUOY_URL"
if rlRun "curl -fsSL -o /tmp/$SONOBUOY_BIN '$SONOBUOY_URL'" 0 "Download sonobuoy"; then
break
fi
done
if [ ! -f "/tmp/$SONOBUOY_BIN" ]; then
rlFail "Sonobuoy download failed after retries"
return 1
fi
# Verify SHA256
local actual
actual=$(sha256sum "/tmp/$SONOBUOY_BIN" | awk '{print $1}')
if [ "$actual" != "$SONOBUOY_SHA256" ]; then
rlLogWarning "SHA256 mismatch (got $actual), re-downloading once"
rm -f "/tmp/$SONOBUOY_BIN"
rlRun "curl -fsSL -o /tmp/$SONOBUOY_BIN '$SONOBUOY_URL'" 0 "Re-download sonobuoy"
actual=$(sha256sum "/tmp/$SONOBUOY_BIN" | awk '{print $1}')
if [ "$actual" != "$SONOBUOY_SHA256" ]; then
rlFail "Sonobuoy SHA256 verification failed"
rm -f "/tmp/$SONOBUOY_BIN"
return 1
fi
fi
rlRun "install -m 0755 /tmp/$SONOBUOY_BIN '$SONOBUOY_INSTALL'" 0 "Install sonobuoy to /usr/local/bin"
rm -f "/tmp/$SONOBUOY_BIN"
return 0
}
# Download the official smoke plugin manifest to /tmp.
# Returns 0 on success, 1 on failure.
k8sFetchSmokePlugin() {
rlRun "curl -fsSL -o '$K8S_SMOKE_PLUGIN' '$K8S_SMOKE_PLUGIN_URL'" 0 "Download smoke plugin manifest"
if [ ! -s "$K8S_SMOKE_PLUGIN" ]; then
rlFail "Smoke plugin manifest is empty or missing"
return 1
fi
rlLogInfo "Smoke plugin manifest ready: $K8S_SMOKE_PLUGIN"
return 0
}
# Suite-level setup with reference counting.
# Install sonobuoy only once across all cases; register cleanup.
k8sLibSetup() {
if [ ! -f "$K8S_FLAG" ]; then
# First case in suite: install sonobuoy
if ! _k8sInstallSonobuoy; then
rlFail "Sonobuoy installation failed (setup FAIL, case SKIP)"
return 1
fi
rlRun "sonobuoy version" 0 "Verify sonobuoy CLI"
echo "ref=1" > "$K8S_FLAG"
else
local ref
ref=$(grep "^ref=" "$K8S_FLAG" | cut -d= -f2)
ref=$((ref + 1))
sed -i "s/^ref=.*/ref=$ref/" "$K8S_FLAG"
fi
rlCleanupAppend "k8sLibCleanup"
return 0
}
# Suite-level cleanup with reference counting.
# Remove sonobuoy only when the last case finishes.
k8sLibCleanup() {
if [ ! -f "$K8S_FLAG" ]; then return 0; fi
local ref
ref=$(grep "^ref=" "$K8S_FLAG" | cut -d= -f2)
ref=$((ref - 1))
if [ "$ref" -le 0 ]; then
rm -f "$K8S_FLAG"
rlRun "rm -f '$SONOBUOY_INSTALL'" 0 "Remove sonobuoy binary"
rlLogInfo "K8s suite cleanup complete"
else
sed -i "s/^ref=.*/ref=$ref/" "$K8S_FLAG"
rlLogInfo "K8s suite retained (still have $ref test(s) not completed)"
fi
}
+8
View File
@@ -0,0 +1,8 @@
summary: K8s feature tests
tag:
- feature
duration: 30m
tier: 1
path: /tests/feature/k8s
require:
- beakerlib
+11
View File
@@ -0,0 +1,11 @@
summary: K8s feature tests - sonobuoy smoke
test: ./test.sh
tag:
- feature
- k8s
- sonobuoy
duration: 20m
tier: 1
path: /tests/feature/k8s/sonobuoy_smoke
require:
- beakerlib
+74
View File
@@ -0,0 +1,74 @@
#!/bin/bash
# K8s feature test: sonobuoy smoke
# Run the official openruyi-riscv sonobuoy smoke plugin against the cluster:
# sonobuoy delete -> run -> retrieve -> results (full closed loop)
# Expect: Total: 2, Passed: 2, Failed: 0, every node status: passed
#
# Runs LOCALLY on the K8s master node (tmt provision: local).
# Sonobuoy CLI calls are written out explicitly (no hidden wrappers).
. /usr/share/beakerlib/beakerlib.sh || exit 1
. "$(dirname "$0")/../lib.sh"
SONOBUOY_CMD="/usr/local/bin/sonobuoy"
KUBECONFIG="/etc/kubernetes/admin.conf"
SMOKE_PLUGIN="/tmp/openruyi-riscv-sonobuoy-smoke.yaml"
RESULTS_DIR="/tmp"
RESULTS_TAR="$RESULTS_DIR/k8s-smoke-results.tar.gz"
RESULTS_LOG="$RESULTS_DIR/k8s-smoke-results.txt"
SONOBUOY_IMAGE="localhost/sonobuoy/sonobuoy:v0.57.3-riscv64"
EXPECT_TOTAL=2
EXPECT_PASSED=2
EXPECT_FAILED=0
# Add sudo prefix when not running as root (kubeconfig + /usr/local/bin are root-owned)
SUDO_PREFIX=""
if [ "$(id -u)" -ne 0 ]; then
SUDO_PREFIX="sudo -n"
fi
rlJournalStart
rlPhaseStartSetup "Environment setup"
k8sLibSetup
k8sFetchSmokePlugin
rlRun "kubectl --kubeconfig=$KUBECONFIG get nodes" 0 "List cluster nodes"
rlRun "cd $RESULTS_DIR" 0 "Enter results directory"
rlPhaseEnd
rlPhaseStartTest "Sonobuoy smoke test (full loop)"
# 1. Clean any leftovers from previous runs
rlRun "$SUDO_PREFIX $SONOBUOY_CMD delete --wait --kubeconfig=$KUBECONFIG || true" 0 "Clean previous sonobuoy resources"
# 2. Run the smoke plugin (DaemonSet, one pod per node), wait for completion
rlRun "$SUDO_PREFIX $SONOBUOY_CMD run \
--sonobuoy-image $SONOBUOY_IMAGE \
--plugin $SMOKE_PLUGIN \
--image-pull-policy Never \
--wait \
--kubeconfig=$KUBECONFIG" 0 "Run sonobuoy smoke plugin (--wait)"
# 3. Retrieve results archive (note: -f name is saved under CWD, so cd to /tmp first)
rlRun "$SUDO_PREFIX $SONOBUOY_CMD retrieve -f $(basename $RESULTS_TAR) --kubeconfig=$KUBECONFIG" 0 "Retrieve results archive"
rlAssertExists "$RESULTS_TAR"
# 4. Parse results (report mode)
rlRun "set -o pipefail; $SUDO_PREFIX $SONOBUOY_CMD results $RESULTS_TAR --mode=report 2>&1 | tee $RESULTS_LOG" 0 "Parse sonobuoy results (report mode)"
# 5. Assert summary counts
rlAssertGrep "Passed: $EXPECT_PASSED" "$RESULTS_LOG"
rlAssertGrep "Failed: $EXPECT_FAILED" "$RESULTS_LOG"
rlAssertGrep "Total: $EXPECT_TOTAL" "$RESULTS_LOG"
# 6. Assert every node passed
rlAssertGrep "Status: passed" "$RESULTS_LOG"
rlPhaseEnd
rlPhaseStartCleanup "Clean up test environment"
# Remove cluster resources (distinct from binary removal in k8sLibCleanup)
rlRun "$SUDO_PREFIX $SONOBUOY_CMD delete --wait --kubeconfig=$KUBECONFIG || true" 0 "Delete sonobuoy cluster resources"
rlRun "rm -f $RESULTS_TAR $RESULTS_LOG" 0 "Remove results archive and log"
rlPhaseEnd
rlJournalPrintText
rlJournalEnd
+63 -63
View File
@@ -1,63 +1,63 @@
# Functional test - Package tests
This directory contains functional test cases for each package, Uses ACL sub-directory structure standard.
## Test coverage overview
- **202 packages**, **561 test cases**, **1,692 functional points**
- All test scripts have been verified on openEuler RISC-V server
- See [Functional test coverage details](../../docs/coverage/functional-coverage.md)
## directory structure
```
tests/functional/
├── main.fmf # Shared configuration (All subdirectories inherit)
├── README.md # this file
└── pkgs/ # RPM Package functional tests
├── main.fmf # Shared configuration
├── acl/ # acl Package tests (Reference standard)
│ ├── main.fmf
│ ├── test.sh
│ └── test_acl_*/ # Sub-test directories
├── attr/ # attr Package tests
│ ├── main.fmf
│ ├── test.sh
│ └── test_attr_*/ # Sub-test directories
└──... # More package tests
```
## Test structure specification (Refer to ACL)
Each package test directory contains:
- `main.fmf` -- Package-level metadata configuration
- `test.sh` -- Package-level main test script
- `test_<pkg>_<feature>/` -- Sub-test directories split by functional point
- `main.fmf` -- Sub-test metadata
- `test.sh` -- Sub-test script
## Add new package test
1. Create directory `tests/functional/pkgs/<package_name>/`
2. create `main.fmf` (Refer to `pkgs/acl/main.fmf`)
3. create `test.sh` (Refer to template)
4. Create sub-test directories by functional point
## Run tests
```bash
tmt run plan --name /plans/functional test --name /tests/functional/<package_name>
```
- Metadata files are uniformly named `main.fmf`
## Test coverage progress
| soft | Status | Number of test cases | Notes |
|--------|------|-----------|------|
| acl | ✅ Complete | 27+ | First example package |
|... | To be added | - | - |
## Reference documentation
- Package test writing guide:`.trellis/tasks/06-09-acl/package-test-guide.md`
- tmt Official documentation:https://tmt.readthedocs.io/
# Functional test - Package tests
This directory contains functional test cases for each package, Uses ACL sub-directory structure standard.
## Test coverage overview
- **202 packages**, **561 test cases**, **1,692 functional points**
- All test scripts have been verified on openEuler RISC-V server
- See [Functional test coverage details](../../docs/coverage/functional-coverage.md)
## directory structure
```
tests/functional/
├── main.fmf # Shared configuration (All subdirectories inherit)
├── README.md # this file
└── pkgs/ # RPM Package functional tests
├── main.fmf # Shared configuration
├── acl/ # acl Package tests (Reference standard)
│ ├── main.fmf
│ ├── test.sh
│ └── test_acl_*/ # Sub-test directories
├── attr/ # attr Package tests
│ ├── main.fmf
│ ├── test.sh
│ └── test_attr_*/ # Sub-test directories
└──... # More package tests
```
## Test structure specification (Refer to ACL)
Each package test directory contains:
- `main.fmf` -- Package-level metadata configuration
- `test.sh` -- Package-level main test script
- `test_<pkg>_<feature>/` -- Sub-test directories split by functional point
- `main.fmf` -- Sub-test metadata
- `test.sh` -- Sub-test script
## Add new package test
1. Create directory `tests/functional/pkgs/<package_name>/`
2. create `main.fmf` (Refer to `pkgs/acl/main.fmf`)
3. create `test.sh` (Refer to template)
4. Create sub-test directories by functional point
## Run tests
```bash
tmt run plan --name /plans/functional test --name /tests/functional/<package_name>
```
- Metadata files are uniformly named `main.fmf`
## Test coverage progress
| soft | Status | Number of test cases | Notes |
|--------|------|-----------|------|
| acl | ✅ Complete | 27+ | First example package |
|... | To be added | - | - |
## Reference documentation
- Package test writing guide:`.trellis/tasks/06-09-acl/package-test-guide.md`
- tmt Official documentation:https://tmt.readthedocs.io/
@@ -0,0 +1,16 @@
summary: Functional test - editorconfig-core-c-devel cmake verify
test: ./test.sh
tag:
- functional
- cmake
- editorconfig-core-c
duration: 10m
tier: 2
path: /tests/functional/cmake/test_editorconfig-core-c-devel_cmake_verify
require:
- editorconfig-core-c-devel
- editorconfig-core-c-static
- cmake
- gcc
- beakerlib
- gcc-c++
@@ -0,0 +1,58 @@
#!/bin/bash
# Functional test: editorconfig-core-c-devel - cmake export integrity verification
# Verify that all files referenced by .cmake files provided by the package actually exist
#
# Verification principle:
# find_package(CONFIG) -> *Config.cmake -> *Targets.cmake
# Targets.cmake referencing non-existent .a/.so will cause cmake configuration to fail directly
. /usr/share/beakerlib/beakerlib.sh || exit 1
PKG="editorconfig-core-c-devel"
rlJournalStart
rlPhaseStartSetup "Environment Setup"
TmpDir=$(mktemp -d)
rlRun "cd $TmpDir" 0 "Enter temporary test directory"
CMAKE_COUNT=$(rpm -ql "$PKG" 2>/dev/null | grep -c '\.cmake$' || echo 0)
rlLogInfo "$PKG provides $CMAKE_COUNT .cmake file(s)"
rlPhaseEnd
rlPhaseStartTest "find_package(CONFIG) - Verify cmake export integrity"
if [ "$CMAKE_COUNT" -eq 0 ]; then
rlLogWarning "$PKG provides no .cmake files, skipping cmake verification"
else
# --- find_package(EditorConfig) ---
cat > "$TmpDir/CMakeLists.txt" << 'EOF'
cmake_minimum_required(VERSION 3.13.4)
project(cmake_verify
VERSION "0.1"
LANGUAGES C CXX)
find_package(EditorConfig REQUIRED CONFIG)
message(STATUS "find_package(EditorConfig) succeeded")
EOF
rlLogInfo "Verifying find_package(EditorConfig CONFIG) ..."
rm -rf "$TmpDir/build_0"
if rlRun "cmake -S $TmpDir -B $TmpDir/build_0" 0 \
"cmake configuration (find_package EditorConfig CONFIG)"; then
rlPass "find_package(EditorConfig CONFIG) verification passed"
else
rlFail "find_package(EditorConfig CONFIG) verification failed"
fi
fi
rlPhaseEnd
rlPhaseStartCleanup "Clean up test environment"
rlRun "cd /" 0 "Leave test directory"
if [ -n "$TmpDir" ] && [ -d "$TmpDir" ]; then
rlRun "rm -rf $TmpDir" 0 "Clean up temporary test directory"
fi
rlPhaseEnd
rlJournalPrintText
rlJournalEnd
@@ -10,6 +10,9 @@ path: /tests/functional/cmake/test_flang22_cmake_verify
require:
- flang22
- flang22-static
- clang22-devel
- mlir22-devel
- llvm22-devel
- cmake
- gcc
- beakerlib
@@ -24,15 +24,19 @@ rlJournalStart
rlLogWarning "$PKG provides no .cmake files, skipping cmake verification"
else
# --- find_package(Flang) ---
# Flang depends on LLVM, Clang, and MLIR imported targets.
# Explicitly find them first so that FlangConfig.cmake can resolve
# clang-cpp, MLIR, and MLIRTestAnalysis targets.
cat > "$TmpDir/CMakeLists.txt" << 'EOF'
cmake_minimum_required(VERSION 3.13.4)
project(cmake_verify
VERSION "0.1"
LANGUAGES C CXX)
find_package(Flang REQUIRED CONFIG
PATHS /usr/lib64/llvm22/lib/cmake/flang
NO_DEFAULT_PATH)
list(APPEND CMAKE_PREFIX_PATH "/usr/lib64/llvm22")
find_package(Clang REQUIRED CONFIG)
find_package(MLIR REQUIRED CONFIG)
find_package(Flang REQUIRED CONFIG)
message(STATUS "find_package(Flang) succeeded")
EOF
@@ -0,0 +1,17 @@
summary: Functional test - fltk-devel cmake verify
test: ./test.sh
tag:
- functional
- cmake
- fltk
duration: 10m
tier: 2
path: /tests/functional/cmake/test_fltk-devel_cmake_verify
require:
- fltk-devel
- fltk-static
- fltk-fluid
- cmake
- gcc
- beakerlib
- gcc-c++
@@ -0,0 +1,58 @@
#!/bin/bash
# Functional test: fltk-devel - cmake export integrity verification
# Verify that all files referenced by .cmake files provided by the package actually exist
#
# Verification principle:
# find_package(CONFIG) -> *Config.cmake -> *Targets.cmake
# Targets.cmake referencing non-existent .a/.so will cause cmake configuration to fail directly
. /usr/share/beakerlib/beakerlib.sh || exit 1
PKG="fltk-devel"
rlJournalStart
rlPhaseStartSetup "Environment Setup"
TmpDir=$(mktemp -d)
rlRun "cd $TmpDir" 0 "Enter temporary test directory"
CMAKE_COUNT=$(rpm -ql "$PKG" 2>/dev/null | grep -c '\.cmake$' || echo 0)
rlLogInfo "$PKG provides $CMAKE_COUNT .cmake file(s)"
rlPhaseEnd
rlPhaseStartTest "find_package(CONFIG) - Verify cmake export integrity"
if [ "$CMAKE_COUNT" -eq 0 ]; then
rlLogWarning "$PKG provides no .cmake files, skipping cmake verification"
else
# --- find_package(FLTK) ---
cat > "$TmpDir/CMakeLists.txt" << 'EOF'
cmake_minimum_required(VERSION 3.13.4)
project(cmake_verify
VERSION "0.1"
LANGUAGES C CXX)
find_package(FLTK REQUIRED CONFIG)
message(STATUS "find_package(FLTK) succeeded")
EOF
rlLogInfo "Verifying find_package(FLTK CONFIG) ..."
rm -rf "$TmpDir/build_0"
if rlRun "cmake -S $TmpDir -B $TmpDir/build_0" 0 \
"cmake configuration (find_package FLTK CONFIG)"; then
rlPass "find_package(FLTK CONFIG) verification passed"
else
rlFail "find_package(FLTK CONFIG) verification failed"
fi
fi
rlPhaseEnd
rlPhaseStartCleanup "Clean up test environment"
rlRun "cd /" 0 "Leave test directory"
if [ -n "$TmpDir" ] && [ -d "$TmpDir" ]; then
rlRun "rm -rf $TmpDir" 0 "Clean up temporary test directory"
fi
rlPhaseEnd
rlJournalPrintText
rlJournalEnd
@@ -6,7 +6,7 @@ tag:
- qt6-qttools
duration: 10m
tier: 2
path: /tests/functional/pkgs/cmake_batch/generated/test_qt6-qttools-devel_cmake_verify
path: /tests/functional/cmake/test_qt6-qttools-devel_cmake_verify
require:
- qt6-qttools-devel
- qt6-doctools
@@ -0,0 +1,16 @@
summary: Functional test - spirv-cross-devel cmake verify
test: ./test.sh
tag:
- functional
- cmake
- spirv-cross
duration: 10m
tier: 2
path: /tests/functional/cmake/test_spirv-cross-devel_cmake_verify
require:
- spirv-cross-devel
- spirv-cross-static
- cmake
- gcc
- beakerlib
- gcc-c++
@@ -0,0 +1,247 @@
#!/bin/bash
# Functional test: spirv-cross-devel - cmake export integrity verification
# Verify that all files referenced by .cmake files provided by the package actually exist
#
# Verification principle:
# find_package(CONFIG) -> *Config.cmake -> *Targets.cmake
# Targets.cmake referencing non-existent .a/.so will cause cmake configuration to fail directly
. /usr/share/beakerlib/beakerlib.sh || exit 1
PKG="spirv-cross-devel"
rlJournalStart
rlPhaseStartSetup "Environment Setup"
TmpDir=$(mktemp -d)
rlRun "cd $TmpDir" 0 "Enter temporary test directory"
CMAKE_COUNT=$(rpm -ql "$PKG" 2>/dev/null | grep -c '\.cmake$' || echo 0)
rlLogInfo "$PKG provides $CMAKE_COUNT .cmake file(s)"
rlPhaseEnd
rlPhaseStartTest "find_package(CONFIG) - Verify cmake export integrity"
if [ "$CMAKE_COUNT" -eq 0 ]; then
rlLogWarning "$PKG provides no .cmake files, skipping cmake verification"
else
# --- find_package(spirv_cross_c) ---
# spirv_cross_c depends on: glsl, hlsl, msl, cpp, reflect
# glsl/hlsl/msl/cpp depend on: core
cat > "$TmpDir/CMakeLists.txt" << 'EOF'
cmake_minimum_required(VERSION 3.13.4)
project(cmake_verify
VERSION "0.1"
LANGUAGES C CXX)
find_package(spirv_cross_core REQUIRED CONFIG)
find_package(spirv_cross_glsl REQUIRED CONFIG)
find_package(spirv_cross_hlsl REQUIRED CONFIG)
find_package(spirv_cross_msl REQUIRED CONFIG)
find_package(spirv_cross_cpp REQUIRED CONFIG)
find_package(spirv_cross_reflect REQUIRED CONFIG)
find_package(spirv_cross_c REQUIRED CONFIG)
message(STATUS "find_package(spirv_cross_c) succeeded")
EOF
rlLogInfo "Verifying find_package(spirv_cross_c CONFIG) ..."
rm -rf "$TmpDir/build_0"
if rlRun "cmake -S $TmpDir -B $TmpDir/build_0" 0 \
"cmake configuration (find_package spirv_cross_c CONFIG)"; then
rlPass "find_package(spirv_cross_c CONFIG) verification passed"
else
rlFail "find_package(spirv_cross_c CONFIG) verification failed"
fi
# --- find_package(spirv_cross_c_shared) ---
cat > "$TmpDir/CMakeLists.txt" << 'EOF'
cmake_minimum_required(VERSION 3.13.4)
project(cmake_verify
VERSION "0.1"
LANGUAGES C CXX)
find_package(spirv_cross_c_shared REQUIRED CONFIG)
message(STATUS "find_package(spirv_cross_c_shared) succeeded")
EOF
rlLogInfo "Verifying find_package(spirv_cross_c_shared CONFIG) ..."
rm -rf "$TmpDir/build_1"
if rlRun "cmake -S $TmpDir -B $TmpDir/build_1" 0 \
"cmake configuration (find_package spirv_cross_c_shared CONFIG)"; then
rlPass "find_package(spirv_cross_c_shared CONFIG) verification passed"
else
rlFail "find_package(spirv_cross_c_shared CONFIG) verification failed"
fi
# --- find_package(spirv_cross_core) ---
cat > "$TmpDir/CMakeLists.txt" << 'EOF'
cmake_minimum_required(VERSION 3.13.4)
project(cmake_verify
VERSION "0.1"
LANGUAGES C CXX)
find_package(spirv_cross_core REQUIRED CONFIG)
message(STATUS "find_package(spirv_cross_core) succeeded")
EOF
rlLogInfo "Verifying find_package(spirv_cross_core CONFIG) ..."
rm -rf "$TmpDir/build_2"
if rlRun "cmake -S $TmpDir -B $TmpDir/build_2" 0 \
"cmake configuration (find_package spirv_cross_core CONFIG)"; then
rlPass "find_package(spirv_cross_core CONFIG) verification passed"
else
rlFail "find_package(spirv_cross_core CONFIG) verification failed"
fi
# --- find_package(spirv_cross_cpp) ---
# spirv_cross_cpp depends on: glsl -> core
cat > "$TmpDir/CMakeLists.txt" << 'EOF'
cmake_minimum_required(VERSION 3.13.4)
project(cmake_verify
VERSION "0.1"
LANGUAGES C CXX)
find_package(spirv_cross_core REQUIRED CONFIG)
find_package(spirv_cross_glsl REQUIRED CONFIG)
find_package(spirv_cross_cpp REQUIRED CONFIG)
message(STATUS "find_package(spirv_cross_cpp) succeeded")
EOF
rlLogInfo "Verifying find_package(spirv_cross_cpp CONFIG) ..."
rm -rf "$TmpDir/build_3"
if rlRun "cmake -S $TmpDir -B $TmpDir/build_3" 0 \
"cmake configuration (find_package spirv_cross_cpp CONFIG)"; then
rlPass "find_package(spirv_cross_cpp CONFIG) verification passed"
else
rlFail "find_package(spirv_cross_cpp CONFIG) verification failed"
fi
# --- find_package(spirv_cross_glsl) ---
# spirv_cross_glsl depends on: core
cat > "$TmpDir/CMakeLists.txt" << 'EOF'
cmake_minimum_required(VERSION 3.13.4)
project(cmake_verify
VERSION "0.1"
LANGUAGES C CXX)
find_package(spirv_cross_core REQUIRED CONFIG)
find_package(spirv_cross_glsl REQUIRED CONFIG)
message(STATUS "find_package(spirv_cross_glsl) succeeded")
EOF
rlLogInfo "Verifying find_package(spirv_cross_glsl CONFIG) ..."
rm -rf "$TmpDir/build_4"
if rlRun "cmake -S $TmpDir -B $TmpDir/build_4" 0 \
"cmake configuration (find_package spirv_cross_glsl CONFIG)"; then
rlPass "find_package(spirv_cross_glsl CONFIG) verification passed"
else
rlFail "find_package(spirv_cross_glsl CONFIG) verification failed"
fi
# --- find_package(spirv_cross_hlsl) ---
# spirv_cross_hlsl depends on: glsl -> core
cat > "$TmpDir/CMakeLists.txt" << 'EOF'
cmake_minimum_required(VERSION 3.13.4)
project(cmake_verify
VERSION "0.1"
LANGUAGES C CXX)
find_package(spirv_cross_core REQUIRED CONFIG)
find_package(spirv_cross_glsl REQUIRED CONFIG)
find_package(spirv_cross_hlsl REQUIRED CONFIG)
message(STATUS "find_package(spirv_cross_hlsl) succeeded")
EOF
rlLogInfo "Verifying find_package(spirv_cross_hlsl CONFIG) ..."
rm -rf "$TmpDir/build_5"
if rlRun "cmake -S $TmpDir -B $TmpDir/build_5" 0 \
"cmake configuration (find_package spirv_cross_hlsl CONFIG)"; then
rlPass "find_package(spirv_cross_hlsl CONFIG) verification passed"
else
rlFail "find_package(spirv_cross_hlsl CONFIG) verification failed"
fi
# --- find_package(spirv_cross_msl) ---
# spirv_cross_msl depends on: glsl -> core
cat > "$TmpDir/CMakeLists.txt" << 'EOF'
cmake_minimum_required(VERSION 3.13.4)
project(cmake_verify
VERSION "0.1"
LANGUAGES C CXX)
find_package(spirv_cross_core REQUIRED CONFIG)
find_package(spirv_cross_glsl REQUIRED CONFIG)
find_package(spirv_cross_msl REQUIRED CONFIG)
message(STATUS "find_package(spirv_cross_msl) succeeded")
EOF
rlLogInfo "Verifying find_package(spirv_cross_msl CONFIG) ..."
rm -rf "$TmpDir/build_6"
if rlRun "cmake -S $TmpDir -B $TmpDir/build_6" 0 \
"cmake configuration (find_package spirv_cross_msl CONFIG)"; then
rlPass "find_package(spirv_cross_msl CONFIG) verification passed"
else
rlFail "find_package(spirv_cross_msl CONFIG) verification failed"
fi
# --- find_package(spirv_cross_reflect) ---
cat > "$TmpDir/CMakeLists.txt" << 'EOF'
cmake_minimum_required(VERSION 3.13.4)
project(cmake_verify
VERSION "0.1"
LANGUAGES C CXX)
find_package(spirv_cross_reflect REQUIRED CONFIG)
message(STATUS "find_package(spirv_cross_reflect) succeeded")
EOF
rlLogInfo "Verifying find_package(spirv_cross_reflect CONFIG) ..."
rm -rf "$TmpDir/build_7"
if rlRun "cmake -S $TmpDir -B $TmpDir/build_7" 0 \
"cmake configuration (find_package spirv_cross_reflect CONFIG)"; then
rlPass "find_package(spirv_cross_reflect CONFIG) verification passed"
else
rlFail "find_package(spirv_cross_reflect CONFIG) verification failed"
fi
# --- find_package(spirv_cross_util) ---
# spirv_cross_util depends on: core
cat > "$TmpDir/CMakeLists.txt" << 'EOF'
cmake_minimum_required(VERSION 3.13.4)
project(cmake_verify
VERSION "0.1"
LANGUAGES C CXX)
find_package(spirv_cross_core REQUIRED CONFIG)
find_package(spirv_cross_util REQUIRED CONFIG)
message(STATUS "find_package(spirv_cross_util) succeeded")
EOF
rlLogInfo "Verifying find_package(spirv_cross_util CONFIG) ..."
rm -rf "$TmpDir/build_8"
if rlRun "cmake -S $TmpDir -B $TmpDir/build_8" 0 \
"cmake configuration (find_package spirv_cross_util CONFIG)"; then
rlPass "find_package(spirv_cross_util CONFIG) verification passed"
else
rlFail "find_package(spirv_cross_util CONFIG) verification failed"
fi
fi
rlPhaseEnd
rlPhaseStartCleanup "Clean up test environment"
rlRun "cd /" 0 "Leave test directory"
if [ -n "$TmpDir" ] && [ -d "$TmpDir" ]; then
rlRun "rm -rf $TmpDir" 0 "Clean up temporary test directory"
fi
rlPhaseEnd
rlJournalPrintText
rlJournalEnd
@@ -61,10 +61,10 @@ rlJournalStart
rlPhaseStartTest "differential testing"
local diff_failures=0
diff_failures=0
local total_tests=0
total_tests=0
@@ -73,19 +73,19 @@ rlJournalStart
for i in 1 2 3; do
local src="csmith_diff_${i}.c"
src="csmith_diff_${i}.c"
local gcc_bin="csmith_diff_${i}_gcc"
gcc_bin="csmith_diff_${i}_gcc"
local clang_bin="csmith_diff_${i}_clang"
clang_bin="csmith_diff_${i}_clang"
local gcc_out="csmith_diff_${i}_gcc_out.txt"
gcc_out="csmith_diff_${i}_gcc_out.txt"
local clang_out="csmith_diff_${i}_clang_out.txt"
clang_out="csmith_diff_${i}_clang_out.txt"
@@ -154,7 +154,7 @@ rlJournalStart
timeout 10./"$gcc_bin" > "$gcc_out" 2>/tmp/csmith_gcc_runerr_${i}.txt
local gcc_run_rc=$?
gcc_run_rc=$?
@@ -166,7 +166,7 @@ rlJournalStart
timeout 10./"$clang_bin" > "$clang_out" 2>/tmp/csmith_clang_runerr_${i}.txt
local clang_run_rc=$?
clang_run_rc=$?
@@ -199,7 +199,7 @@ rlJournalStart
# Check for runtime errors
local has_error=0
has_error=0
if grep -qi "segmentation fault\|core dumped\|stack smash\|buffer overflow" /tmp/csmith_gcc_runerr_${i}.txt 2>/dev/null; then
@@ -44,7 +44,7 @@ rlJournalStart
gcc -O2 csmith_test.c -o csmith_gcc -w 2>/tmp/csmith_gcc_err.txt
local gcc_rc=$?
gcc_rc=$?
rlRun "echo \"GCC exit: $gcc_rc\"" 0 "GCC compileexit code: $gcc_rc"
@@ -78,7 +78,6 @@ rlJournalStart
if [ -s /tmp/csmith_gcc_err.txt ]; then
local warn_count
warn_count=$(grep -c "warning:" /tmp/csmith_gcc_err.txt 2>/dev/null || echo 0)
@@ -104,7 +103,7 @@ rlJournalStart
clang -O2 csmith_test.c -o csmith_clang -w 2>/tmp/csmith_clang_err.txt
local clang_rc=$?
clang_rc=$?
rlRun "echo \"Clang exit: $clang_rc\"" 0 "Clang compileexit code: $clang_rc"
@@ -134,7 +133,6 @@ rlJournalStart
if [ -s /tmp/csmith_clang_err.txt ]; then
local warn_count
warn_count=$(grep -c "warning:" /tmp/csmith_clang_err.txt 2>/dev/null || echo 0)
@@ -60,7 +60,6 @@ rlJournalStart
if [ -s random1.c ]; then
local lines
lines=$(wc -l < random1.c)
@@ -88,7 +88,7 @@ CEOF
timeout 5./overflow_gcc >/tmp/overflow_gcc.txt 2>&1
local rc=$?
rc=$?
rlLogInfo "overflow programexit code: $rc"
@@ -1,13 +1,13 @@
summary: Functional test - dejagnu - GCC compiletestwith
test: ./test.sh
tag:
- functional
- compiler
- dejagnu
duration: 10m
tier: 2
path: /tests/functional/compiler/dejagnu/test_dejagnu_gcc_test
require:
- dejagnu
- gcc
- beakerlib
summary: Functional test - dejagnu - GCC compiletestwith
test: ./test.sh
tag:
- functional
- compiler
- dejagnu
duration: 10m
tier: 2
path: /tests/functional/compiler/dejagnu/test_dejagnu_gcc_test
require:
- dejagnu
- gcc
- beakerlib
@@ -132,7 +132,7 @@ EEOF
runtest --tool gcc gcc.dg/dejagnu_test.exp 2>&1 | tee /tmp/dejagnu_gcc_run.log
local rc=${PIPESTATUS[0]}
rc=${PIPESTATUS[0]}
@@ -152,7 +152,6 @@ EEOF
if grep -q "^PASS:" gcc.sum; then
local pass_count
pass_count=$(grep -c "^PASS:" gcc.sum)
@@ -170,7 +169,6 @@ EEOF
if grep -q "^FAIL:" gcc.sum; then
local fail_count
fail_count=$(grep -c "^FAIL:" gcc.sum)
@@ -1,13 +1,13 @@
summary: Functional test - dejagnu - G++ compiletestwith
test: ./test.sh
tag:
- functional
- compiler
- dejagnu
duration: 10m
tier: 2
path: /tests/functional/compiler/dejagnu/test_dejagnu_gxx_test
require:
- dejagnu
- gcc-c++
- beakerlib
summary: Functional test - dejagnu - G++ compiletestwith
test: ./test.sh
tag:
- functional
- compiler
- dejagnu
duration: 10m
tier: 2
path: /tests/functional/compiler/dejagnu/test_dejagnu_gxx_test
require:
- dejagnu
- gcc-c++
- beakerlib
@@ -150,7 +150,7 @@ EEOF
runtest --tool g++ g++.dg/dejagnu_gxx_test.exp 2>&1 | tee /tmp/dejagnu_gxx_run.log
local rc=${PIPESTATUS[0]}
rc=${PIPESTATUS[0]}
@@ -164,7 +164,6 @@ EEOF
if grep -q "^PASS:" g++.sum; then
local pass_count
pass_count=$(grep -c "^PASS:" g++.sum)
@@ -180,7 +179,6 @@ EEOF
if grep -q "^FAIL:" g++.sum; then
local fail_count
fail_count=$(grep -c "^FAIL:" g++.sum)
@@ -1,12 +1,12 @@
summary: Functional test - dejagnu - runtest availablecheck
test: ./test.sh
tag:
- functional
- compiler
- dejagnu
duration: 5m
tier: 2
path: /tests/functional/compiler/dejagnu/test_dejagnu_runtest_check
require:
- dejagnu
- beakerlib
summary: Functional test - dejagnu - runtest availablecheck
test: ./test.sh
tag:
- functional
- compiler
- dejagnu
duration: 5m
tier: 2
path: /tests/functional/compiler/dejagnu/test_dejagnu_runtest_check
require:
- dejagnu
- beakerlib
@@ -70,7 +70,7 @@ rlJournalStart
runtest 2>&1 | tee /tmp/dejagnu_noargs.txt
local rc=$?
rc=$?
if [ "$rc" -ne 0 ]; then
@@ -1,7 +1,7 @@
summary: Functional test - dejagnu - warning (-Wall/-Wextra/-Werror/-pedantic)
test: ./test.sh
tag: [functional, compiler, dejagnu]
duration: 5m
tier: 2
path: /tests/functional/compiler/dejagnu/test_dejagnu_warnings
require: [dejagnu, gcc, clang, beakerlib]
summary: Functional test - dejagnu - warning (-Wall/-Wextra/-Werror/-pedantic)
test: ./test.sh
tag: [functional, compiler, dejagnu]
duration: 5m
tier: 2
path: /tests/functional/compiler/dejagnu/test_dejagnu_warnings
require: [dejagnu, gcc, clang, beakerlib]
+13 -13
View File
@@ -1,13 +1,13 @@
summary: Functional test - Jotai programcompiletest
tag:
- functional
- compiler
- jotai
duration: 15m
tier: 2
path: /tests/functional/compiler/jotai
require:
- beakerlib
- gcc
- clang
- git
summary: Functional test - Jotai programcompiletest
tag:
- functional
- compiler
- jotai
duration: 15m
tier: 2
path: /tests/functional/compiler/jotai
require:
- beakerlib
- gcc
- clang
- git
@@ -1,14 +1,14 @@
summary: Functional test - jotai - Environmentandrepolibrary
test: ./test.sh
tag:
- functional
- compiler
- jotai
duration: 5m
tier: 2
path: /tests/functional/compiler/jotai/test_jotai_setup
require:
- gcc
- clang
- git
- beakerlib
summary: Functional test - jotai - Environmentandrepolibrary
test: ./test.sh
tag:
- functional
- compiler
- jotai
duration: 5m
tier: 2
path: /tests/functional/compiler/jotai/test_jotai_setup
require:
- gcc
- clang
- git
- beakerlib
@@ -1,14 +1,14 @@
summary: Functional test - yarpgen - source codebuildand
test: ./test.sh
tag:
- functional
- compiler
- yarpgen
duration: 10m
tier: 2
path: /tests/functional/compiler/yarpgen/test_yarpgen_build
require:
- gcc-c++
- cmake
- git
- beakerlib
summary: Functional test - yarpgen - source codebuildand
test: ./test.sh
tag:
- functional
- compiler
- yarpgen
duration: 10m
tier: 2
path: /tests/functional/compiler/yarpgen/test_yarpgen_build
require:
- gcc-c++
- cmake
- git
- beakerlib
@@ -118,7 +118,7 @@ rlJournalStart
# checkGenerateoutputfile
local gen_files=0
gen_files=0
for f in init.h func.cpp driver.cpp; do
@@ -64,10 +64,10 @@ rlJournalStart
rlPhaseStartTest "differential testing"
local diff_failures=0
diff_failures=0
local total_tests=0
total_tests=0
@@ -136,7 +136,7 @@ rlJournalStart
g++ -fPIC func.cpp driver.cpp -o test_gxx -O2 2>/tmp/yarpgen_diff_gxx_err_${round}.txt
local gxx_rc=$?
gxx_rc=$?
@@ -148,7 +148,7 @@ rlJournalStart
clang++ -fPIC func.cpp driver.cpp -o test_clang -O2 2>/tmp/yarpgen_diff_clang_err_${round}.txt
local clang_rc=$?
clang_rc=$?
@@ -202,7 +202,7 @@ rlJournalStart
timeout 10./test_gxx > gxx_output.txt 2>/tmp/yarpgen_run_gxx_${round}.txt
local gxx_run_rc=$?
gxx_run_rc=$?
@@ -211,7 +211,7 @@ rlJournalStart
timeout 10./test_clang > clang_output.txt 2>/tmp/yarpgen_run_clang_${round}.txt
local clang_run_rc=$?
clang_run_rc=$?
@@ -74,7 +74,6 @@ rlJournalStart
rlRun "file./yarpgen_gxx_O0 | grep -i elf" 0 "G++ -O0 Output is ELF"
local warn_O0
warn_O0=$(grep -c "warning:" /tmp/yarpgen_gxx_O0_err.txt 2>/dev/null || echo 0)
@@ -92,7 +91,6 @@ rlJournalStart
rlPass "G++ -O2 Compile succeeded"
local warn_O2
warn_O2=$(grep -c "warning:" /tmp/yarpgen_gxx_O2_err.txt 2>/dev/null || echo 0)
@@ -116,7 +114,6 @@ rlJournalStart
rlPass "G++ -O3 Compile succeeded"
local warn_O3
warn_O3=$(grep -c "warning:" /tmp/yarpgen_gxx_O3_err.txt 2>/dev/null || echo 0)
@@ -158,7 +155,6 @@ rlJournalStart
rlPass "Clang -O2 Compile succeeded"
local warn_O2
warn_O2=$(grep -c "warning:" /tmp/yarpgen_clang_O2_err.txt 2>/dev/null || echo 0)
@@ -178,7 +174,6 @@ rlJournalStart
rlPass "Clang -O3 Compile succeeded"
local warn_O3
warn_O3=$(grep -c "warning:" /tmp/yarpgen_clang_O3_err.txt 2>/dev/null || echo 0)
@@ -1,7 +1,7 @@
summary: Functional test - yarpgen - multifileseparate compilation + C/C++ link
test: ./test.sh
tag: [functional, compiler, yarpgen]
duration: 5m
tier: 2
path: /tests/functional/compiler/yarpgen/test_yarpgen_multifile
require: [gcc, gcc-c++, clang, beakerlib]
summary: Functional test - yarpgen - multifileseparate compilation + C/C++ link
test: ./test.sh
tag: [functional, compiler, yarpgen]
duration: 5m
tier: 2
path: /tests/functional/compiler/yarpgen/test_yarpgen_multifile
require: [gcc, gcc-c++, clang, beakerlib]
+1 -1
View File
@@ -96,7 +96,7 @@ EOF" 2>/dev/null || true
timeout --signal=KILL --kill-after=10 600 \
bash./check "$test_name" 2>&1 | tee "$out"
bash ./check "$test_name" 2>&1 | tee "$out"
local rc=${PIPESTATUS[0]}
@@ -4,7 +4,7 @@ tag:
- functional
- kernel
- blktests
duration: 5m
duration: 15m
tier: 2
path: /tests/functional/kernel/blktests/scsi/test_blktests_scsi_007
require:
+11 -11
View File
@@ -1,11 +1,11 @@
summary: Functional test - kernel - LTP test
tag:
- functional
- kernel
- realtime
- ltp
duration: 30m
tier: 1
path: /tests/functional/kernel/realtime
require:
- beakerlib
summary: Functional test - kernel - LTP test
tag:
- functional
- kernel
- realtime
- ltp
duration: 30m
tier: 1
path: /tests/functional/kernel/realtime
require:
- beakerlib
@@ -5,7 +5,7 @@ tag:
- kernel
- realtime
- ltp
duration: 30m
duration: 10m
tier: 1
path: /tests/functional/kernel/realtime/test_realtime_pi_tests
require:
@@ -5,7 +5,7 @@ tag:
- kernel
- realtime
- ltp
duration: 30m
duration: 10m
tier: 1
path: /tests/functional/kernel/realtime/test_realtime_rt_migrate
require:
+10 -10
View File
@@ -1,10 +1,10 @@
summary: Functional test - audit system
tag:
- functional
- audit
duration: 5m
tier: 1
path: /tests/functional/pkgs/audit
require:
- audit
- beakerlib
summary: Functional test - audit system
tag:
- functional
- audit
duration: 5m
tier: 1
path: /tests/functional/pkgs/audit
require:
- audit
- beakerlib
@@ -1,11 +1,11 @@
summary: Functional test - bzip2 - compress
test: ./test.sh
tag:
- functional
- bzip2
duration: 2m
tier: 1
path: /tests/functional/pkgs/bzip2/test_bzip2_compress
require:
- beakerlib
summary: Functional test - bzip2 - compress
test: ./test.sh
tag:
- functional
- bzip2
duration: 2m
tier: 1
path: /tests/functional/pkgs/bzip2/test_bzip2_compress
require:
- beakerlib
@@ -1,11 +1,11 @@
summary: Functional test - cloud-utils-growpart partition expansion - /partitioninfo
test: ./test.sh
tag:
- functional
- cloud-utils-growpart
duration: 2m
tier: 1
path: /tests/functional/pkgs/cloud-utils-growpart/test_cloud_utils_growpart_disk_partition_info
require:
- cloud-utils-growpart
summary: Functional test - cloud-utils-growpart partition expansion - /partitioninfo
test: ./test.sh
tag:
- functional
- cloud-utils-growpart
duration: 2m
tier: 1
path: /tests/functional/pkgs/cloud-utils-growpart/test_cloud_utils_growpart_disk_partition_info
require:
- cloud-utils-growpart
- beakerlib
@@ -1,11 +1,11 @@
summary: Functional test - cloud-utils-growpart partition expansion - retryrun(noactual)
test: ./test.sh
tag:
- functional
- cloud-utils-growpart
duration: 2m
tier: 1
path: /tests/functional/pkgs/cloud-utils-growpart/test_cloud_utils_growpart_dry_run__no_actual_resize
require:
- cloud-utils-growpart
summary: Functional test - cloud-utils-growpart partition expansion - retryrun(noactual)
test: ./test.sh
tag:
- functional
- cloud-utils-growpart
duration: 2m
tier: 1
path: /tests/functional/pkgs/cloud-utils-growpart/test_cloud_utils_growpart_dry_run__no_actual_resize
require:
- cloud-utils-growpart
- beakerlib
@@ -1,11 +1,11 @@
summary: Functional test - cloud-utils-growpart partition expansion - andversion
test: ./test.sh
tag:
- functional
- cloud-utils-growpart
duration: 2m
tier: 1
path: /tests/functional/pkgs/cloud-utils-growpart/test_cloud_utils_growpart_help_and_version
require:
- cloud-utils-growpart
summary: Functional test - cloud-utils-growpart partition expansion - andversion
test: ./test.sh
tag:
- functional
- cloud-utils-growpart
duration: 2m
tier: 1
path: /tests/functional/pkgs/cloud-utils-growpart/test_cloud_utils_growpart_help_and_version
require:
- cloud-utils-growpart
- beakerlib
@@ -1,11 +1,11 @@
summary: Functional test - cmake - basicCMakeitems
test: ./test.sh
tag:
- functional
- cmake
duration: 2m
tier: 1
path: /tests/functional/pkgs/cmake/test_cmake_basic_cmake_project
require:
- cmake
summary: Functional test - cmake - basicCMakeitems
test: ./test.sh
tag:
- functional
- cmake
duration: 2m
tier: 1
path: /tests/functional/pkgs/cmake/test_cmake_basic_cmake_project
require:
- cmake
- beakerlib
@@ -1,11 +1,11 @@
summary: Functional test - coreutils - environment variables and time env printenv printf
test: ./test.sh
tag:
- functional
- coreutils
duration: 2m
tier: 1
path: /tests/functional/pkgs/coreutils/test_coreutils_environment_and_time__env__printenv__date__printf
require:
- coreutils
summary: Functional test - coreutils - environment variables and time env printenv printf
test: ./test.sh
tag:
- functional
- coreutils
duration: 2m
tier: 1
path: /tests/functional/pkgs/coreutils/test_coreutils_environment_and_time__env__printenv__date__printf
require:
- coreutils
- beakerlib
+10 -10
View File
@@ -1,10 +1,10 @@
summary: Functional test - curl download
tag:
- functional
- curl
duration: 5m
tier: 1
path: /tests/functional/pkgs/curl
require:
- curl
- beakerlib
summary: Functional test - curl download
tag:
- functional
- curl
duration: 5m
tier: 1
path: /tests/functional/pkgs/curl
require:
- curl
- beakerlib
+10 -10
View File
@@ -1,10 +1,10 @@
summary: Functional test - debugedit debuginfo
tag:
- functional
- debugedit
duration: 5m
tier: 1
path: /tests/functional/pkgs/debugedit
require:
- debugedit
- beakerlib
summary: Functional test - debugedit debuginfo
tag:
- functional
- debugedit
duration: 5m
tier: 1
path: /tests/functional/pkgs/debugedit
require:
- debugedit
- beakerlib
+10 -10
View File
@@ -1,10 +1,10 @@
summary: Functional test - GMP countlibrary
tag:
- functional
- gmp
duration: 5m
tier: 1
path: /tests/functional/pkgs/gmp
require:
- gmp
- beakerlib
summary: Functional test - GMP countlibrary
tag:
- functional
- gmp
duration: 5m
tier: 1
path: /tests/functional/pkgs/gmp
require:
- gmp
- beakerlib
@@ -1,11 +1,11 @@
summary: Functional test - grep - fixed stringsextract f
test: ./test.sh
tag:
- functional
- grep
duration: 2m
tier: 1
path: /tests/functional/pkgs/grep/test_grep_fixed_strings___f
require:
- grep
summary: Functional test - grep - fixed stringsextract f
test: ./test.sh
tag:
- functional
- grep
duration: 2m
tier: 1
path: /tests/functional/pkgs/grep/test_grep_fixed_strings___f
require:
- grep
- beakerlib
+10 -10
View File
@@ -1,10 +1,10 @@
summary: Functional test - ISL integerlibrary
tag:
- functional
- isl
duration: 5m
tier: 1
path: /tests/functional/pkgs/isl
require:
- isl
- beakerlib
summary: Functional test - ISL integerlibrary
tag:
- functional
- isl
duration: 5m
tier: 1
path: /tests/functional/pkgs/isl
require:
- isl
- beakerlib
+10 -10
View File
@@ -1,10 +1,10 @@
summary: Functional test - labwc Waylandfunctionality verification
tag:
- functional
- labwc
duration: 5m
tier: 1
path: /tests/functional/pkgs/labwc
require:
- labwc
- beakerlib
summary: Functional test - labwc Waylandfunctionality verification
tag:
- functional
- labwc
duration: 5m
tier: 1
path: /tests/functional/pkgs/labwc
require:
- labwc
- beakerlib
@@ -24,7 +24,7 @@ rlJournalStart
rlPhaseStartTest "Direct I/O vs Buffered read"
local testfile="$TmpDir/cache_read.dat"
testfile="$TmpDir/cache_read.dat"
dd if=/dev/zero of="$testfile" bs=1M count=512 2>/dev/null
@@ -42,7 +42,7 @@ rlJournalStart
_fioDropCaches
local log="$TmpDir/buf_cold.log"
log="$TmpDir/buf_cold.log"
fio --name=buf_cold --filename="$testfile" --direct=0 \
@@ -50,7 +50,6 @@ rlJournalStart
--ioengine=sync --runtime=15 2>&1 | tee "$log"
local bw1 cpu1
bw1=$(grep "READ:" "$log" | grep -oP 'bw=\K[\d.]+[KMG]iB/s' | head -1)
@@ -62,7 +61,7 @@ rlJournalStart
# Buffered (second read, warm cache)
local log="$TmpDir/buf_warm.log"
log="$TmpDir/buf_warm.log"
fio --name=buf_warm --filename="$testfile" --direct=0 \
@@ -70,7 +69,6 @@ rlJournalStart
--ioengine=sync --runtime=15 2>&1 | tee "$log"
local bw2 cpu2
bw2=$(grep "READ:" "$log" | grep -oP 'bw=\K[\d.]+[KMG]iB/s' | head -1)
@@ -84,7 +82,7 @@ rlJournalStart
_fioDropCaches
local log="$TmpDir/direct.log"
log="$TmpDir/direct.log"
fio --name=direct --filename="$testfile" --direct=1 \
@@ -92,7 +90,6 @@ rlJournalStart
--ioengine=libaio --runtime=15 2>&1 | tee "$log"
local bw3 cpu3
bw3=$(grep "READ:" "$log" | grep -oP 'bw=\K[\d.]+[KMG]iB/s' | head -1)
@@ -132,9 +129,9 @@ rlJournalStart
# Buffered write
local testfile="$TmpDir/buf_write.dat"
testfile="$TmpDir/buf_write.dat"
local log="$TmpDir/buf_write.log"
log="$TmpDir/buf_write.log"
fio --name=buf_write --filename="$testfile" --direct=0 \
@@ -142,7 +139,6 @@ rlJournalStart
--ioengine=sync --runtime=15 2>&1 | tee "$log"
local bw1 cpu1
bw1=$(grep "WRITE:" "$log" | grep -oP 'bw=\K[\d.]+[KMG]iB/s' | head -1)
@@ -158,9 +154,9 @@ rlJournalStart
_fioDropCaches
local testfile="$TmpDir/dir_write.dat"
testfile="$TmpDir/dir_write.dat"
local log="$TmpDir/dir_write.log"
log="$TmpDir/dir_write.log"
fio --name=dir_write --filename="$testfile" --direct=1 \
@@ -168,7 +164,6 @@ rlJournalStart
--ioengine=libaio --runtime=15 2>&1 | tee "$log"
local bw2 cpu2
bw2=$(grep "WRITE:" "$log" | grep -oP 'bw=\K[\d.]+[KMG]iB/s' | head -1)
@@ -24,7 +24,7 @@ rlJournalStart
rlPhaseStartTest "random readand (numjobs)"
local testfile="$TmpDir/scale.dat"
testfile="$TmpDir/scale.dat"
dd if=/dev/zero of="$testfile" bs=1M count=512 2>/dev/null
@@ -42,7 +42,7 @@ rlJournalStart
_fioDropCaches
local log="$TmpDir/scale_nj${nj}.log"
log="$TmpDir/scale_nj${nj}.log"
fio --name=scale_nj${nj} --filename="$testfile" --direct=1 \
@@ -52,7 +52,6 @@ rlJournalStart
local iops bw
iops=$(grep "read:" "$log" | grep -oP 'IOPS=\K[\d.]+k?' | head -1)
@@ -66,7 +65,6 @@ rlJournalStart
# verify 8 jobs IOPS > 1 job IOPS ()
local iops1 iops8
iops1=$(grep "read:" "$TmpDir/scale_nj1.log" | grep -oP 'IOPS=\K[\d.]+' | head -1)
@@ -88,7 +86,7 @@ rlJournalStart
rlPhaseStartTest "sequential readand"
local testfile="$TmpDir/scale_seq.dat"
testfile="$TmpDir/scale_seq.dat"
dd if=/dev/zero of="$testfile" bs=1M count=512 2>/dev/null
@@ -106,7 +104,7 @@ rlJournalStart
_fioDropCaches
local log="$TmpDir/scale_seq_nj${nj}.log"
log="$TmpDir/scale_seq_nj${nj}.log"
fio --name=scale_seq_nj${nj} --filename="$testfile" --direct=1 \
@@ -116,7 +114,6 @@ rlJournalStart
local bw cpu
bw=$(grep "READ:" "$log" | grep -oP 'bw=\K[\d.]+[KMG]iB/s' | head -1)
@@ -18,7 +18,7 @@ rlJournalStart
rlRun "cd $TmpDir" 0 ""
local testfile="$TmpDir/latency.dat"
testfile="$TmpDir/latency.dat"
dd if=/dev/zero of="$testfile" bs=1M count=256 2>/dev/null
@@ -40,7 +40,7 @@ rlJournalStart
_fioDropCaches
local log="$TmpDir/lat_qd${qd}.log"
log="$TmpDir/lat_qd${qd}.log"
fio --name=lat_qd${qd} --filename="$testfile" --direct=1 \
@@ -50,7 +50,6 @@ rlJournalStart
local avg p50 p99
avg=$(grep -A1 "lat (" "$log" | grep -oP 'avg=\K[\d.]+' | head -1)
@@ -82,7 +81,7 @@ rlJournalStart
_fioDropCaches
local log="$TmpDir/lat_bs${bs}k.log"
log="$TmpDir/lat_bs${bs}k.log"
fio --name=lat_bs${bs}k --filename="$testfile" --direct=1 \
@@ -92,7 +91,6 @@ rlJournalStart
local avg iops
avg=$(grep -A1 "lat (" "$log" | grep -oP 'avg=\K[\d.]+' | head -1)
@@ -24,9 +24,9 @@ rlJournalStart
rlPhaseStartTest "datalibraryload (70R/30W, BS=8K)"
local testfile="$TmpDir/db_workload.dat"
testfile="$TmpDir/db_workload.dat"
local log="$TmpDir/db_randrw.log"
log="$TmpDir/db_randrw.log"
@@ -68,9 +68,9 @@ rlJournalStart
rlPhaseStartTest "Web serverload (80R/20W, BS=4K)"
local testfile="$TmpDir/web_workload.dat"
testfile="$TmpDir/web_workload.dat"
local log="$TmpDir/web_randrw.log"
log="$TmpDir/web_randrw.log"
@@ -116,9 +116,9 @@ rlJournalStart
for ratio in 50 70 90; do
local testfile="$TmpDir/rw${ratio}.dat"
testfile="$TmpDir/rw${ratio}.dat"
local log="$TmpDir/rw${ratio}.log"
log="$TmpDir/rw${ratio}.log"
_fioDropCaches
@@ -132,7 +132,6 @@ rlJournalStart
local riops wiop bw
riops=$(grep "read:" "$log" | grep -oP 'IOPS=\K[\d.]+k?' | head -1)
@@ -24,7 +24,7 @@ rlJournalStart
rlPhaseStartTest "random read IOPS (different block sizes)"
local testfile="$TmpDir/randread.dat"
testfile="$TmpDir/randread.dat"
dd if=/dev/zero of="$testfile" bs=1M count=256 2>/dev/null
@@ -34,7 +34,7 @@ rlJournalStart
_fioDropCaches
local log="$TmpDir/randread_${bs}k.log"
log="$TmpDir/randread_${bs}k.log"
rlLogInfo "=== random read BS=${bs}K ==="
@@ -46,7 +46,6 @@ rlJournalStart
local iops bw
iops=$(grep "read:" "$log" | grep -oP 'IOPS=\K[\d.]+k?' | head -1)
@@ -70,7 +69,7 @@ rlJournalStart
_fioDropCaches
local log="$TmpDir/randwrite_${bs}k.log"
log="$TmpDir/randwrite_${bs}k.log"
rlLogInfo "=== randomwrite BS=${bs}K ==="
@@ -82,7 +81,6 @@ rlJournalStart
local iops bw
iops=$(grep "write:" "$log" | grep -oP 'IOPS=\K[\d.]+k?' | head -1)
@@ -26,7 +26,7 @@ rlJournalStart
rlPhaseStartTest "sequential read throughput (different block sizes)"
local testfile="$TmpDir/seq_read.dat"
testfile="$TmpDir/seq_read.dat"
# preCreate test file (512MB)
@@ -38,7 +38,7 @@ rlJournalStart
_fioDropCaches
local log="$TmpDir/seq_read_${bs}k.log"
log="$TmpDir/seq_read_${bs}k.log"
rlLogInfo "=== sequential read BS=${bs}K ==="
@@ -52,7 +52,6 @@ rlJournalStart
# extractbandwidth
local bw
bw=$(grep "READ:" "$log" | grep -oP 'bw=\K[\d.]+[KMG]iB/s' | head -1)
@@ -80,7 +79,7 @@ rlJournalStart
_fioDropCaches
local log="$TmpDir/seq_write_${bs}k.log"
log="$TmpDir/seq_write_${bs}k.log"
rlLogInfo "=== sequential write BS=${bs}K ==="
@@ -92,7 +91,6 @@ rlJournalStart
local bw
bw=$(grep "WRITE:" "$log" | grep -oP 'bw=\K[\d.]+[KMG]iB/s' | head -1)
@@ -28,7 +28,7 @@ rlJournalStart
rlPhaseStartTest "Auto Mode (-a) file"
local log="$TmpDir/iozone_auto_small.log"
log="$TmpDir/iozone_auto_small.log"
# -a: auto mode, -c: include close, 64m file
@@ -62,7 +62,7 @@ rlJournalStart
sync && echo 3 | sudo tee /proc/sys/vm/drop_caches > /dev/null 2>&1 || true
local log="$TmpDir/iozone_auto_medium.log"
log="$TmpDir/iozone_auto_medium.log"
rlRun "iozone -a -c -s 256m -r 16k -f $TmpDir/iozone_test2.dat 2>&1 | tee $log" 0 "iozone -a -s 256m -r 16k"
@@ -26,7 +26,7 @@ rlJournalStart
rlPhaseStartTest "Direct I/O vs Normal comparison"
local testfile="$TmpDir/iozone_dio.dat"
testfile="$TmpDir/iozone_dio.dat"
@@ -70,11 +70,9 @@ rlJournalStart
# comparisonanalysis
local normal_write
normal_write=$(grep -E '^\s+[0-9]+\s+[0-9]+' /tmp/iozone_normal.txt | awk '{print $3}' | head -1)
local direct_write
direct_write=$(grep -E '^\s+[0-9]+\s+[0-9]+' /tmp/iozone_direct.txt | awk '{print $3}' | head -1)
@@ -30,17 +30,17 @@ rlJournalStart
rlPhaseStartTest "multifilesizetest"
local sizes="64 128 256 512"
sizes="64 128 256 512"
local throughputs=()
throughputs=()
for sz in $sizes; do
local testfile="$TmpDir/iozone_${sz}m.dat"
testfile="$TmpDir/iozone_${sz}m.dat"
local log="$TmpDir/iozone_${sz}m.log"
log="$TmpDir/iozone_${sz}m.log"
@@ -64,7 +64,6 @@ rlJournalStart
# extract write
local write_kbps
write_kbps=$(grep -E '^\s+[0-9]+\s+[0-9]+' "$log" | awk '{print $3}' | head -1)
@@ -26,9 +26,9 @@ rlJournalStart
rlPhaseStartTest "all modes I/O test"
local testfile="$TmpDir/iozone_full.dat"
testfile="$TmpDir/iozone_full.dat"
local log="$TmpDir/iozone_full.log"
log="$TmpDir/iozone_full.log"
@@ -60,7 +60,7 @@ rlJournalStart
rlPhaseStartTest "differentrecordsizecomparison"
local rec_sizes="4 16 64 256 1024"
rec_sizes="4 16 64 256 1024"
echo ""
@@ -72,9 +72,9 @@ rlJournalStart
for rs in $rec_sizes; do
local testfile="$TmpDir/iozone_r${rs}k.dat"
testfile="$TmpDir/iozone_r${rs}k.dat"
local log="$TmpDir/iozone_r${rs}k.log"
log="$TmpDir/iozone_r${rs}k.log"
@@ -84,7 +84,6 @@ rlJournalStart
local w r
w=$(grep -E '^\s+[0-9]+\s+[0-9]+' "$log" | awk '{print $3}' | head -1)
@@ -28,9 +28,9 @@ rlJournalStart
rlPhaseStartTest "sequential write throughput"
local testfile="$TmpDir/seq_write.dat"
testfile="$TmpDir/seq_write.dat"
local log="$TmpDir/seq_write.log"
log="$TmpDir/seq_write.log"
@@ -48,13 +48,11 @@ rlJournalStart
local write_kbps
write_kbps=$(grep -E '^\s+[0-9]+\s+[0-9]+' "$log" | awk '{print $3}' | head -1)
if [ -n "$write_kbps" ] && [ "$write_kbps" != "0" ]; then
local write_mbps
write_mbps=$(awk "BEGIN {printf \"%.1f\", ${write_kbps}/1024}" 2>/dev/null)
@@ -78,9 +76,9 @@ rlJournalStart
# writefile, sequential read
local testfile="$TmpDir/seq_read.dat"
testfile="$TmpDir/seq_read.dat"
local log="$TmpDir/seq_read.log"
log="$TmpDir/seq_read.log"
@@ -106,13 +104,11 @@ rlJournalStart
local read_kbps
read_kbps=$(grep -E '^\s+[0-9]+\s+[0-9]+' "$log" | awk '{print $5}' | head -1)
if [ -n "$read_kbps" ] && [ "$read_kbps" != "0" ]; then
local read_mbps
read_mbps=$(awk "BEGIN {printf \"%.1f\", ${read_kbps}/1024}" 2>/dev/null)
@@ -136,9 +132,9 @@ rlJournalStart
# simultaneouslyreadwrite, readwrite
local testfile="$TmpDir/rw_ratio.dat"
testfile="$TmpDir/rw_ratio.dat"
local log="$TmpDir/rw_ratio.log"
log="$TmpDir/rw_ratio.log"
@@ -148,7 +144,6 @@ rlJournalStart
local w r
w=$(grep -E '^\s+[0-9]+\s+[0-9]+' "$log" | awk '{print $3}' | head -1)
@@ -158,7 +153,6 @@ rlJournalStart
if [ -n "$w" ] && [ -n "$r" ] && [ "$w" != "0" ]; then
local ratio
ratio=$(awk "BEGIN {printf \"%.2f\", ${r}/${w}}" 2>/dev/null)
@@ -56,7 +56,7 @@ rlJournalStart
./bin/lat_tcp -s 2>&1 &
local tcp_pid=$!
tcp_pid=$!
sleep 1
@@ -74,7 +74,7 @@ rlJournalStart
./bin/lat_udp -s 2>&1 &
local udp_pid=$!
udp_pid=$!
sleep 1
@@ -114,7 +114,6 @@ rlJournalStart
for op in rd wr rdwr cp fwr frd fcp bzero bcopy; do
local out
out=$(./bin/bw_mem 16M "$op" 2>&1 | tail -1)
+1 -1
View File
@@ -116,7 +116,7 @@ _mmtestsRunCase() {
local exit_lines
exit_lines=$(grep "test exit:" "$out" 2>/dev/null)
exit_lines=$(grep '^test exit :: ' "$out" 2>/dev/null)
if [ -z "$exit_lines" ]; then
@@ -4,7 +4,7 @@ tag:
- performance
- kernel
- mmtests
duration: 30m
duration: 90m
tier: 1
path: /tests/performance/mmtests/test_mmtests_io_blogbench
require:
@@ -4,7 +4,7 @@ tag:
- performance
- kernel
- mmtests
duration: 30m
duration: 120m
tier: 1
path: /tests/performance/mmtests/test_mmtests_io_trunc
require:
@@ -4,7 +4,7 @@ tag:
- performance
- kernel
- mmtests
duration: 30m
duration: 60m
tier: 1
path: /tests/performance/mmtests/test_mmtests_memdb_redis_benchmark_small
require:
@@ -4,7 +4,7 @@ tag:
- performance
- kernel
- mmtests
duration: 30m
duration: 55m
tier: 1
path: /tests/performance/mmtests/test_mmtests_pagereclaim_stutterp
require:
@@ -4,7 +4,7 @@ tag:
- performance
- kernel
- mmtests
duration: 30m
duration: 45m
tier: 1
path: /tests/performance/mmtests/test_mmtests_workload_ebizzy
require:
@@ -4,7 +4,7 @@ tag:
- performance
- kernel
- mmtests
duration: 30m
duration: 60m
tier: 1
path: /tests/performance/mmtests/test_mmtests_workload_usemem_stress_numa_compact
require:
@@ -4,7 +4,7 @@ tag:
- performance
- kernel
- mmtests
duration: 30m
duration: 120m
tier: 1
path: /tests/performance/mmtests/test_mmtests_workload_will_it_scale_io_processes
require:
@@ -4,7 +4,7 @@ tag:
- performance
- kernel
- mmtests
duration: 30m
duration: 120m
tier: 1
path: /tests/performance/mmtests/test_mmtests_workload_will_it_scale_io_threads
require:
@@ -4,7 +4,7 @@ tag:
- performance
- kernel
- mmtests
duration: 30m
duration: 55m
tier: 1
path: /tests/performance/mmtests/test_mmtests_workload_will_it_scale_sys_processes
require:
@@ -20,7 +20,6 @@ rlJournalStart
# getsize
local l1_kb l2_kb l3_kb
l1_kb=$(lscpu 2>/dev/null | grep "L1d cache" | grep -oP '\d+' | head -1)
@@ -54,9 +53,9 @@ rlJournalStart
for elems in 10000 100000 500000 1000000 5000000 10000000; do
local name="stream_${elems}"
name="stream_${elems}"
local log="/tmp/${name}.log"
log="/tmp/${name}.log"
@@ -74,7 +73,6 @@ rlJournalStart
OMP_NUM_THREADS=1./"$name" > "$log" 2>&1
local triad
triad=$(grep "^Triad:" "$log" | awk '{print $2}' | head -1)
@@ -82,9 +80,9 @@ rlJournalStart
# datain
local bytes=$((elems * 8 * 3)) # 3 arrays × 8 bytes
bytes=$((elems * 8 * 3)) # 3 arrays × 8 bytes
local fit="DRAM"
fit="DRAM"
if [ -n "$l3_kb" ] && [ "$bytes" -le $((l3_kb * 1024)) ]; then fit="L3"; fi
@@ -32,7 +32,6 @@ rlJournalStart
fi
local elems
elems=$(grep "^array_size=" "$STREAM_FLAG" 2>/dev/null | cut -d= -f2)
@@ -56,7 +55,7 @@ rlJournalStart
for compiler in gcc clang; do
local bin="stream_${compiler}"
bin="stream_${compiler}"
"$compiler" -O3 -fopenmp -DSTREAM_ARRAY_SIZE=$elems -DNTIMES=15 \
@@ -66,13 +65,12 @@ rlJournalStart
if [ -x "$bin" ]; then
local log="/tmp/stream_${compiler}.log"
log="/tmp/stream_${compiler}.log"
OMP_NUM_THREADS=1./"$bin" > "$log" 2>&1
local copy scale add triad
copy=$(grep "^Copy:" "$log" | awk '{print $2}' | head -1)
@@ -124,7 +122,7 @@ rlJournalStart
for opt in O2 O3 Ofast; do
local bin="stream_gcc_${opt}"
bin="stream_gcc_${opt}"
gcc -${opt} -fopenmp -DSTREAM_ARRAY_SIZE=$elems -DNTIMES=15 \
@@ -134,13 +132,12 @@ rlJournalStart
if [ -x "$bin" ]; then
local log="/tmp/stream_gcc_${opt}.log"
log="/tmp/stream_gcc_${opt}.log"
OMP_NUM_THREADS=1./"$bin" > "$log" 2>&1
local copy scale add triad
copy=$(grep "^Copy:" "$log" | awk '{print $2}' | head -1)
@@ -18,7 +18,7 @@ rlJournalStart
rlRun "cd $TmpDir" 0 ""
local max_cores=$(nproc)
max_cores=$(nproc)
rlLogInfo "CPU corecount: $max_cores"
@@ -34,7 +34,7 @@ rlJournalStart
printf "%-8s %-15s %-15s %-15s\n" "Cores" "Triad(MB/s)" "Copy(MB/s)" ""
local single_bw=""
single_bw=""
@@ -46,7 +46,7 @@ rlJournalStart
local log="/tmp/stream_${t}core.log"
log="/tmp/stream_${t}core.log"
rlLogInfo "=== ${t} core TRIAD ==="
@@ -56,7 +56,6 @@ rlJournalStart
local triad copy
triad=$(grep "^Triad:" "$log" | awk '{print $2}' | head -1)
@@ -72,7 +71,7 @@ rlJournalStart
fi
local eff="N/A"
eff="N/A"
if [ -n "$single_bw" ] && [ "$single_bw" != "0" ]; then
@@ -28,7 +28,7 @@ rlJournalStart
rlPhaseStartTest "single-core COPY (1R+1W)"
local log="/tmp/stream_copy.log"
log="/tmp/stream_copy.log"
export OMP_NUM_THREADS=1
@@ -36,7 +36,6 @@ rlJournalStart
rlRun "cat $log" 0 "STREAM COPY full output"
local bw
bw=$(grep "^Copy:" "$log" | awk '{print $2}' | head -1)
@@ -62,7 +61,7 @@ rlJournalStart
local log="/tmp/stream_scale.log"
log="/tmp/stream_scale.log"
export OMP_NUM_THREADS=1
@@ -70,7 +69,6 @@ rlJournalStart
rlRun "cat $log" 0 "STREAM SCALE full output"
local bw
bw=$(grep "^Scale:" "$log" | awk '{print $2}' | head -1)
@@ -82,7 +80,7 @@ rlJournalStart
rlPhaseStartTest "single-core ADD (2R+1W)"
local log="/tmp/stream_add.log"
log="/tmp/stream_add.log"
export OMP_NUM_THREADS=1
@@ -90,7 +88,6 @@ rlJournalStart
rlRun "cat $log" 0 "STREAM ADD full output"
local bw
bw=$(grep "^Add:" "$log" | awk '{print $2}' | head -1)
@@ -102,7 +99,7 @@ rlJournalStart
rlPhaseStartTest "single-core TRIAD (2R+1W,)"
local log="/tmp/stream_triad.log"
log="/tmp/stream_triad.log"
export OMP_NUM_THREADS=1
@@ -118,7 +115,6 @@ rlJournalStart
local bw
bw=$(grep "^Triad:" "$log" | awk '{print $2}' | head -1)
@@ -24,7 +24,7 @@ rlJournalStart
rlPhaseStartTest "single-core CPU"
local log="/tmp/sb_cpu_1.log"
log="/tmp/sb_cpu_1.log"
rlLogInfo "=== CPU single-core (--threads=1) ==="
@@ -32,7 +32,6 @@ rlJournalStart
_sysbenchParse "$log"
local eps
eps=$(grep "events per second" "$log" | grep -oP '[\d.]+' | head -1)
@@ -44,9 +43,9 @@ rlJournalStart
rlPhaseStartTest "multi-core CPU"
local cores=$(nproc)
cores=$(nproc)
local log="/tmp/sb_cpu_n.log"
log="/tmp/sb_cpu_n.log"
rlLogInfo "=== CPU multi-core (--threads=$cores) ==="
@@ -54,7 +53,6 @@ rlJournalStart
_sysbenchParse "$log"
local eps
eps=$(grep "events per second" "$log" | grep -oP '[\d.]+' | head -1)
@@ -66,7 +64,6 @@ rlJournalStart
rlPhaseStartTest "single-core vs multi-core comparison"
local eps1 epsN
eps1=$(grep "events per second" /tmp/sb_cpu_1.log | grep -oP '[\d.]+' | head -1)
@@ -18,9 +18,9 @@ rlJournalStart
rlRun "cd $TmpDir" 0 ""
local cores=$(nproc)
cores=$(nproc)
local data_dir="$TmpDir/sb_fileio"
data_dir="$TmpDir/sb_fileio"
mkdir -p "$data_dir"
@@ -46,7 +46,7 @@ rlJournalStart
local log="/tmp/sb_fileio_${mode}.log"
log="/tmp/sb_fileio_${mode}.log"
@@ -68,7 +68,6 @@ rlJournalStart
local bw iops
bw=$(grep "MiB/sec" "$log" | grep -oP '[\d.]+' | head -1)
@@ -18,7 +18,7 @@ rlJournalStart
rlRun "cd $TmpDir" 0 ""
local cores=$(nproc)
cores=$(nproc)
rlPhaseEnd
@@ -36,7 +36,7 @@ rlJournalStart
for op in read write; do
local log="/tmp/sb_mem_seq_${op}.log"
log="/tmp/sb_mem_seq_${op}.log"
sysbench --threads=$cores --memory-block-size=1M --memory-total-size=10000G \
@@ -46,7 +46,6 @@ rlJournalStart
local bw
bw=$(grep "MiB/sec" "$log" | grep -oP '[\d.]+' | head -1)
@@ -72,7 +71,7 @@ rlJournalStart
for op in read write; do
local log="/tmp/sb_mem_rnd_${op}.log"
log="/tmp/sb_mem_rnd_${op}.log"
sysbench --threads=$cores --memory-block-size=8K --memory-total-size=200G \
@@ -82,7 +81,6 @@ rlJournalStart
local bw
bw=$(grep "MiB/sec" "$log" | grep -oP '[\d.]+' | head -1)
@@ -18,7 +18,7 @@ rlJournalStart
rlRun "cd $TmpDir" 0 ""
local cores=$(nproc)
cores=$(nproc)
rlPhaseEnd
@@ -36,7 +36,7 @@ rlJournalStart
for mn in 64 512 1024 2048; do
local log="/tmp/sb_mutex_${mn}.log"
log="/tmp/sb_mutex_${mn}.log"
sysbench --threads=$cores --mutex-num=$mn --mutex-loops=50000 \
@@ -46,7 +46,6 @@ rlJournalStart
local eps lat locks
eps=$(grep "events per second" "$log" | grep -oP '[\d.]+' | head -1)
@@ -18,7 +18,7 @@ rlJournalStart
rlRun "cd $TmpDir" 0 ""
local cores=$(nproc)
cores=$(nproc)
rlPhaseEnd
@@ -36,7 +36,7 @@ rlJournalStart
for locks in 8 $cores $((cores * 2)); do
local log="/tmp/sb_threads_${locks}.log"
log="/tmp/sb_threads_${locks}.log"
sysbench --threads=$cores --thread-locks=$locks --time=30 \
@@ -44,7 +44,6 @@ rlJournalStart
local eps lat fair
eps=$(grep "events per second" "$log" | grep -oP '[\d.]+' | head -1)
@@ -3,7 +3,7 @@ test: ./test.sh
tag:
- performance
- unixbench
duration: 10m
duration: 35m
tier: 2
path: /tests/performance/unixbench/test_unixbench_half_cpu
require:
@@ -3,7 +3,7 @@ test: ./test.sh
tag:
- performance
- unixbench
duration: 10m
duration: 35m
tier: 2
path: /tests/performance/unixbench/test_unixbench_multi_thread
require:
@@ -3,7 +3,7 @@ test: ./test.sh
tag:
- performance
- unixbench
duration: 10m
duration: 20m
tier: 2
path: /tests/performance/unixbench/test_unixbench_quick_mode
require:
@@ -3,7 +3,7 @@ test: ./test.sh
tag:
- performance
- unixbench
duration: 10m
duration: 35m
tier: 2
path: /tests/performance/unixbench/test_unixbench_single_thread
require:
@@ -28,7 +28,7 @@ rlJournalStart
rlPhaseStartTest "combined stress: CPU+MEM+PROC"
local log="$TmpDir/combo1.log"
log="$TmpDir/combo1.log"
# simultaneously CPU(2thread) + VM(128M) + FORK(2thread)
@@ -58,11 +58,11 @@ rlJournalStart
# useDocumentation recommends 13 workload (time)
local log="$TmpDir/combo2.log"
log="$TmpDir/combo2.log"
local workloads="cpu context fork get mmap vm-splice wait zombie"
workloads="cpu context fork get mmap vm-splice wait zombie"
local args=""
args=""
for w in $workloads; do args="$args --$w 1"; done
@@ -76,7 +76,6 @@ rlJournalStart
# count passed count
local passed
passed=$(grep -oP 'passed:\s*\K\d+' "$log" | awk '{s+=$1} END {print s}')
@@ -92,7 +91,6 @@ rlJournalStart
# confirmnofailed
local failed
failed=$(grep -oP 'failed:\s*\K\d+' "$log" | awk '{s+=$1} END {print s}')
@@ -112,7 +110,7 @@ rlJournalStart
rlPhaseStartTest "metrics analysis"
local log="$TmpDir/combo1.log"
log="$TmpDir/combo1.log"
# analysis usr/sys time
@@ -122,7 +120,6 @@ rlJournalStart
# usr time shouldtotaltime
local total_usr total_sys
total_usr=$(grep -oP 'usr time\s+\K[\d.]+' "$log" | head -1)
@@ -28,11 +28,11 @@ rlJournalStart
rlPhaseStartTest "CPU stress rampthread"
local bogo_vals=()
bogo_vals=()
for t in 1 2 4; do
local log="$TmpDir/cpu_${t}.log"
log="$TmpDir/cpu_${t}.log"
rlRun "stress-ng --cpu $t --timeout 30s --metrics-brief --log-file $log 2>&1 | tail -5" 0 "CPU $t thread"
@@ -42,7 +42,6 @@ rlJournalStart
# extract bogo ops/s
local bogo
bogo=$(grep "cpu" "$log" | grep -oP '\d+\.?\d*(?=\s*\(\s*real)' | head -1)
@@ -28,7 +28,7 @@ rlJournalStart
rlPhaseStartTest "HDD stress (IO)"
local log="$TmpDir/hdd.log"
log="$TmpDir/hdd.log"
rlRun "stress-ng --hdd 2 --hdd-bytes 32M --temp-path $TmpDir/io_test --timeout 30s --metrics-brief --log-file $log 2>&1 | tail -5" 0 "--hdd 2"
@@ -42,7 +42,7 @@ rlJournalStart
# aio needs libaio supports, possiblesystemnot supported
local log="$TmpDir/aio.log"
log="$TmpDir/aio.log"
stress-ng --aio 2 --timeout 20s --metrics-brief --log-file "$log" 2>&1 | tail -5
@@ -64,7 +64,7 @@ rlJournalStart
rlPhaseStartTest "GETDENT stress (directory)"
local log="$TmpDir/getdent.log"
log="$TmpDir/getdent.log"
rlRun "stress-ng --getdent 2 --timeout 20s --metrics-brief --log-file $log 2>&1 | tail -5" 0 "--getdent 2"
@@ -26,7 +26,7 @@ rlJournalStart
rlPhaseStartTest "MATRIX stress ()"
local log="$TmpDir/matrix.log"
log="$TmpDir/matrix.log"
rlRun "stress-ng --matrix 2 --timeout 30s --metrics-brief --log-file $log 2>&1 | tail -5" 0 "--matrix 2"
@@ -36,7 +36,6 @@ rlJournalStart
if grep -q "matrix" "$log"; then
local usr sys
usr=$(grep "matrix" "$log" | awk '{for(i=1;i<=NF;i++){if($i~/^[0-9.]+$/&&$(i-1)~/secs/)print $i}}' | head -1)
@@ -50,7 +49,7 @@ rlJournalStart
rlPhaseStartTest "AF-ALG stress (kernelcrypto)"
local log="$TmpDir/af_alg.log"
log="$TmpDir/af_alg.log"
stress-ng --af-alg 2 --timeout 20s --metrics-brief --log-file "$log" 2>&1 | tail -5
@@ -72,7 +71,7 @@ rlJournalStart
rlPhaseStartTest "VM-SPLICE stress (pipe splice)"
local log="$TmpDir/vm_splice.log"
log="$TmpDir/vm_splice.log"
stress-ng --vm-splice 2 --timeout 20s --metrics-brief --log-file "$log" 2>&1 | tail -5
@@ -96,7 +95,7 @@ rlJournalStart
#: itemswillExceptionsignalhandlepath, possiblehaspreerror
local log="$TmpDir/bad_altstack.log"
log="$TmpDir/bad_altstack.log"
rlRun "stress-ng --bad-altstack 1 --timeout 10s --metrics-brief --log-file $log 2>&1 | tail -5" 0 "--bad-altstack 1"
@@ -26,7 +26,7 @@ rlJournalStart
rlPhaseStartTest "VM stress (memory)"
local log="$TmpDir/vm.log"
log="$TmpDir/vm.log"
rlRun "stress-ng --vm 2 --vm-bytes 128M --timeout 30s --metrics-brief --log-file $log 2>&1 | tail -5" 0 "--vm 2x128M"
@@ -38,7 +38,7 @@ rlJournalStart
rlPhaseStartTest "MMAP stress"
local log="$TmpDir/mmap.log"
log="$TmpDir/mmap.log"
rlRun "stress-ng --mmap 2 --timeout 30s --metrics-brief --log-file $log 2>&1 | tail -5" 0 "--mmap 2"
@@ -50,7 +50,7 @@ rlJournalStart
rlPhaseStartTest "MADVISE stress"
local log="$TmpDir/madvise.log"
log="$TmpDir/madvise.log"
rlRun "stress-ng --madvise 2 --timeout 30s --metrics-brief --log-file $log 2>&1 | tail -5" 0 "--madvise 2"
@@ -62,7 +62,7 @@ rlJournalStart
rlPhaseStartTest "Memory combined stress"
local log="$TmpDir/mem_combo.log"
log="$TmpDir/mem_combo.log"
# simultaneously VM + MMAP
@@ -26,7 +26,7 @@ rlJournalStart
rlPhaseStartTest "FORK stress"
local log="$TmpDir/fork.log"
log="$TmpDir/fork.log"
rlRun "stress-ng --fork 4 --timeout 30s --metrics-brief --log-file $log 2>&1 | tail -5" 0 "--fork 4"
@@ -42,7 +42,7 @@ rlJournalStart
rlPhaseStartTest "CONTEXT switch stress"
local log="$TmpDir/context.log"
log="$TmpDir/context.log"
rlRun "stress-ng --context 4 --timeout 30s --metrics-brief --log-file $log 2>&1 | tail -5" 0 "--context 4"
@@ -56,7 +56,7 @@ rlJournalStart
# zombie willproducedprocesspost, possiblehaspreerror
local log="$TmpDir/zombie.log"
log="$TmpDir/zombie.log"
rlRun "stress-ng --zombie 2 --timeout 15s --metrics-brief --log-file $log 2>&1 | tail -5" 0 "--zombie 2"
@@ -68,7 +68,7 @@ rlJournalStart
rlPhaseStartTest "WAIT stress (get/gettid)"
local log="$TmpDir/wait.log"
log="$TmpDir/wait.log"
# --get: callwith getpid/getppid
@@ -36,13 +36,13 @@ rlJournalStart
rlPhaseStartTest "system callstest"
local log_file="$TmpDir/trinity_basic.log"
log_file="$TmpDir/trinity_basic.log"
# by non- root userrun trinity, time 60s
timeout 70 sudo -u "$TRINITY_USER" trinity -q -N 99999 > "$log_file" 2>&1
local rc=$?
rc=$?
rlLogInfo "Trinity exit code: $rc"
@@ -40,11 +40,11 @@ rlJournalStart
rlPhaseStartTest "excludeall syscall"
local log="$TmpDir/trinity_exclude.log"
log="$TmpDir/trinity_exclude.log"
# build -x parameter
local exclude_args=""
exclude_args=""
for call in $DANGEROUS; do
@@ -56,7 +56,7 @@ rlJournalStart
timeout 45 sudo -u "$TRINITY_USER" trinity -q $exclude_args -N 20000 > "$log" 2>&1
local rc=$?
rc=$?
@@ -78,7 +78,7 @@ rlJournalStart
# verifyexcludecallwithnotexport
local leak=0
leak=0
for call in $DANGEROUS; do
@@ -24,7 +24,6 @@ rlJournalStart
chmod 777 "$TmpDir"
local cores
cores=$(nproc)
@@ -36,13 +35,12 @@ rlJournalStart
rlPhaseStartTest "singleprocess baseline"
local log1="$TmpDir/trinity_1proc.log"
log1="$TmpDir/trinity_1proc.log"
timeout 30 sudo -u "$TRINITY_USER" trinity -q -C 1 -N 5000 > "$log1" 2>&1
local rc1=$?
rc1=$?
local calls1
calls1=$(grep -c "succeeded\|completed" "$log1" 2>/dev/null || echo "N/A")
@@ -56,11 +54,11 @@ rlJournalStart
rlPhaseStartTest "multiprocessandlines ($cores cores)"
local log_multi="$TmpDir/trinity_multi.log"
log_multi="$TmpDir/trinity_multi.log"
timeout 30 sudo -u "$TRINITY_USER" trinity -q -C "$cores" -N 10000 > "$log_multi" 2>&1
local rc_multi=$?
rc_multi=$?
rlLogInfo "multiprocess ($cores): exit=$rc_multi"
@@ -26,7 +26,6 @@ rlJournalStart
chmod 777 "$TmpDir"
local cores
cores=$(nproc)
@@ -36,13 +35,13 @@ rlJournalStart
rlPhaseStartTest "mode -qq -l off"
local log="$TmpDir/trinity_stress.log"
log="$TmpDir/trinity_stress.log"
# Documentation recommends: trinity -qq -l off -C$(nproc)
timeout 45 sudo -u "$TRINITY_USER" trinity -qq -l off -C "$cores" > "$log" 2>&1
local rc=$?
rc=$?
@@ -30,9 +30,8 @@ rlJournalStart
# security syscall: onlyreadnowith
local safe_pattern="getpid|getuid|getgid|geteuid|getegid|getppid|gettimeofday|time|clock_gettime|getcpu|uname|sysinfo|getrandom|read|write|close|brk|arch_prctl"
safe_pattern="getpid|getuid|getgid|geteuid|getegid|getppid|gettimeofday|time|clock_gettime|getcpu|uname|sysinfo|getrandom|read|write|close|brk|arch_prctl"
local safe_count
safe_count=$(grep -ciE "$safe_pattern" /tmp/trinity_syscalls.txt || echo 0)
@@ -42,9 +41,8 @@ rlJournalStart
# syscall: possiblesystem
local dangerous_pattern="reboot|shutdown|kill|init_module|delete_module|mount|umount|mkmod|swapon|swapoff|ioperm|iopl"
dangerous_pattern="reboot|shutdown|kill|init_module|delete_module|mount|umount|mkmod|swapon|swapoff|ioperm|iopl"
local dangerous_count
dangerous_count=$(grep -ciE "$dangerous_pattern" /tmp/trinity_syscalls.txt || echo 0)
@@ -54,7 +52,6 @@ rlJournalStart
# network syscall
local net_count
net_count=$(grep -ciE "socket|bind|connect|listen|accept|send|recv" /tmp/trinity_syscalls.txt || echo 0)
@@ -64,7 +61,6 @@ rlJournalStart
# file syscall
local file_count
file_count=$(grep -ciE "open|creat|read|write|close|stat|fstat|lseek|mkdir|rmdir|unlink|rename|link|symlink|chmod|chown" /tmp/trinity_syscalls.txt || echo 0)
@@ -74,7 +70,6 @@ rlJournalStart
# process syscall
local proc_count
proc_count=$(grep -ciE "fork|vfork|clone|execve|exit|wait4|kill|ptrace|capget|capset|prctl|seccomp" /tmp/trinity_syscalls.txt || echo 0)
@@ -84,7 +79,6 @@ rlJournalStart
# memory syscall
local mem_count
mem_count=$(grep -ciE "mmap|munmap|mprotect|mremap|brk|mlock|mlockall|msync|madvise|mincore" /tmp/trinity_syscalls.txt || echo 0)
@@ -100,7 +94,6 @@ rlJournalStart
rlPhaseStartTest " syscall"
local arch
arch=$(uname -m)
@@ -112,7 +105,6 @@ rlJournalStart
trinity -L 2>&1 | grep -i "riscv" | head -10
local riscv_count
riscv_count=$(trinity -L 2>&1 | grep -ci "riscv" || echo 0)
@@ -32,9 +32,9 @@ rlJournalStart
rlPhaseStartTest "vssecurity syscall"
local safe_calls="getpid getuid getgid geteuid getppid gettimeofday clock_gettime nanosleep getcpu getrandom uname sysinfo"
safe_calls="getpid getuid getgid geteuid getppid gettimeofday clock_gettime nanosleep getcpu getrandom uname sysinfo"
local tested=0
tested=0
@@ -46,11 +46,11 @@ rlJournalStart
rlLogInfo "test syscall: $call"
local log="$TmpDir/trinity_${call}.log"
log="$TmpDir/trinity_${call}.log"
timeout 15 sudo -u "$TRINITY_USER" trinity -q -c "$call" -N 1000 > "$log" 2>&1
local rc=$?
rc=$?
tested=$((tested + 1))

Some files were not shown because too many files have changed in this diff Show More