11 Commits

Author SHA1 Message Date
Petr Šplíchal d054522ef5 Try again with extended duration 2020-10-15 09:38:38 +02:00
Petr Šplíchal 1f2d9ef3ef Enable all available tests from the tmt repo 2020-10-12 15:23:47 +02:00
Petr Šplíchal f23ac4624f Release tmt-1.0 2020-10-07 16:11:17 +02:00
Miroslav Vadkerti 32d41831b1 Enable gating of Fedora Rawide on functional tests
Note that there is no better way right now specify product version.

Internal reference RHELWF-1796

Signed-off-by: Miroslav Vadkerti <mvadkert@redhat.com>
2020-09-16 12:36:27 +02:00
Petr Šplíchal ae336d6f01 Release tmt-0.21 2020-09-08 09:52:11 +02:00
Petr Šplíchal 318ef17a50 Enable the initial set of tests for tmt 2020-09-07 17:47:27 +02:00
Petr Šplíchal 146337ef76 Release tmt-0.20 2020-07-28 17:32:29 +02:00
Petr Šplíchal b13b513c17 Release tmt-0.19 2020-06-12 10:27:39 +02:00
Petr Šplíchal 06f7516526 Release tmt-0.18 2020-06-01 22:18:50 +02:00
Miro Hrončok a14ce8cfe4 Rebuilt for Python 3.9 2020-05-26 03:52:02 +02:00
Petr Šplíchal f56b571e4c Import tmt-0.17 2020-05-23 12:20:43 +02:00
7 changed files with 262 additions and 24 deletions
+1
View File
@@ -0,0 +1 @@
1
+6
View File
@@ -3,3 +3,9 @@
/tmt-0.8.tar.gz
/tmt-0.11.tar.gz
/tmt-0.12.tar.gz
/tmt-0.17.tar.gz
/tmt-0.18.tar.gz
/tmt-0.19.tar.gz
/tmt-0.20.tar.gz
/tmt-0.21.tar.gz
/tmt-1.0.tar.gz
+8
View File
@@ -0,0 +1,8 @@
--- !Policy
product_versions:
# note rawhide not yet supported properly :(
- fedora-34
decision_context: bodhi_update_push_testing
subject_type: koji_build
rules:
- !PassingTestCaseRule {test_case_name: fedora-ci.koji-build.tier0-tf.functional}
+7
View File
@@ -0,0 +1,7 @@
summary: Essential command line features
discover:
how: fmf
url: https://github.com/psss/tmt
ref: duration
execute:
how: beakerlib
+3
View File
@@ -0,0 +1,3 @@
summary: Minimal smoke test
execute:
script: tmt --help
+1 -1
View File
@@ -1 +1 @@
SHA512 (tmt-0.12.tar.gz) = 21eee30ca5a8f059407a53e6d991b77e5cd72bfb15976babf8c7ff49286c462ce0cbdff1c2b3473d35b9d773af9dfe027ed069f671cc9dd1c29b1cedf38fdc13
SHA512 (tmt-1.0.tar.gz) = 98cfa96e0f872a40e72d108e90a0f594563301f4ae1df8b30c53a229e96b998bcb6ae0287aec01c7f3ce231671e94cdcb6d43fac81b3c3e1036b8151b7bec78f
+236 -23
View File
@@ -1,10 +1,11 @@
Name: tmt
Version: 0.12
Version: 1.0
Release: 1%{?dist}
Summary: Test Management Tool
License: MIT
BuildArch: noarch
%{?kernel_arches:ExclusiveArch: %{kernel_arches} noarch}
URL: https://github.com/psss/tmt
Source0: https://github.com/psss/tmt/releases/download/%{version}/tmt-%{version}.tar.gz
@@ -26,7 +27,7 @@ Source0: https://github.com/psss/tmt/releases/download/%{version}/tmt-%{version}
# Main tmt package requires the Python module
Requires: python%{python3_pkgversion}-%{name} == %{version}-%{release}
Requires: git-core
Requires: git-core sshpass
%description
The tmt Python module and command line tool implement the test
@@ -56,30 +57,38 @@ The tmt Python module and command line tool implement the test
metadata specification (L1 and L2) and allows easy test execution.
This package contains the Python 3 module.
%package container
%package provision-container
Summary: Container provisioner for the Test Management Tool
Obsoletes: tmt-container < 0.17
Requires: tmt == %{version}-%{release}
Requires: ansible podman
%description container
All dependencies of the Test Management Tool required to run tests
in a container environment.
%description provision-container
Dependencies required to run tests in a container environment.
%package testcloud
Summary: Libvirt (via testcloud) provisioner for the Test Management Tool
%package provision-virtual
Summary: Virtual machine provisioner for the Test Management Tool
Obsoletes: tmt-testcloud < 0.17
Requires: tmt == %{version}-%{release}
Requires: ansible python%{python3_pkgversion}-testcloud openssh-clients rsync
Requires: python%{python3_pkgversion}-testcloud >= 0.3.5
Requires: ansible openssh-clients rsync
%description testcloud
All dependencies of the Test Management Tool required to run tests
in a libvirt environment provisioned using testcloud.
%description provision-virtual
Dependencies required to run tests in a local virtual machine.
%package test-convert
Summary: Test import and export dependencies
Requires: make python3-nitrate python3-html2text
%description test-convert
Additional dependencies needed for test metadata import and export.
%package all
Summary: Extra dependencies for the Test Management Tool
Requires: tmt >= %{version}
Requires: tmt-container >= %{version}
Requires: tmt-testcloud >= %{version}
Requires: vagrant python3-nitrate make
Requires: tmt-provision-container >= %{version}
Requires: tmt-provision-virtual >= %{version}
Requires: tmt-test-convert >= %{version}
%description all
All extra dependencies of the Test Management Tool. Install this
@@ -116,11 +125,12 @@ install -pm 644 bin/complete %{buildroot}/etc/bash_completion.d/tmt
export LANG=en_US.utf-8
%endif
%{__python3} -m pytest -vv
%{__python3} -m pytest -vv -m 'not web'
%{!?_licensedir:%global license %%doc}
%files
%{_mandir}/man1/*
%{_bindir}/%{name}
@@ -128,26 +138,229 @@ export LANG=en_US.utf-8
%license LICENSE
/etc/bash_completion.d/tmt
%files -n python%{python3_pkgversion}-%{name}
%{python3_sitelib}/%{name}/
%{python3_sitelib}/%{name}-*.egg-info/
%license LICENSE
%exclude %{python3_sitelib}/%{name}/steps/provision/{,__pycache__/}{podman,testcloud}.*
%files provision-container
%{python3_sitelib}/%{name}/steps/provision/{,__pycache__/}podman.*
%files container
%files provision-virtual
%{python3_sitelib}/%{name}/steps/provision/{,__pycache__/}testcloud.*
%files test-convert
%license LICENSE
%files testcloud
%license LICENSE
%files all
%license LICENSE
%changelog
* Wed Oct 07 2020 Petr Šplíchal <psplicha@redhat.com> - 1.0-1
- Correctly handle framework for new plans and tests
- Move runtest.sh adjustments into a single function
- Add the executable permission to runtest.sh
- Less strict removing sourcing of rhts-environment
- Use metadata directory as the default for path
- Implement the new L1 attribute 'framework'
- Explicitly enable copr_build for pull requests
- Handle missing library in existing repository
- Update the overall tmt description and examples
- Enable builds from master in the main copr repo
- Merge packit config for copr builds from master
- Use packit repository for copr builds from master
- Gracefully handle invalid test output
- Build in COPR for master via packit
- Add hint about caching the dnf package metadata
- Add two hints about easy login for experimenting
- Merge debug messages for the minute plugin [#361]
- Adjust the minute provision debug messages wording
- Use the internal tmt executor by default
- Add more debug messages to minute provision
- Remove the remaining 'tmt test convert' references
- Prevent shebang mangling for detached executor
- Merge the minute and install plugin docs [#345]
- Adjust the minute and install plugin documentation
- Merge the manual test import documentation [#347]
- Adjust the manual test documentation wording
- Merge rhts-environment source line removal [#344]
- Adjust rhts-environment source line removal
- Add missing extra-* keys to the test import
- Add docs for manual case import
- Disable authentication when fetching libraries
- Document the install prepare method
- Document the minute provision method
- Remove sourcing of rhts-environment in runtest.sh
- Add minute to supported provision methods of prepare
* Mon Sep 07 2020 Petr Šplíchal <psplicha@redhat.com> - 0.21-1
- Adjust manual test case import from nitrate [#319]
- Move the test convert deps into a separate package
- Support importing manual test cases from Nitrate
- Merge the non-zero exit codes for linting errors
- Fix several test export issues [fix #337]
- Adjust distro checks, remove the dry parameter
- Generalized Guest.details() [fix #310]
- Adjust the test coverage for tmt plan/test lint
- Update documentation with virtualization tips
- Make sure the duration timer is always canceled
- Merge the new retry_session functionality [#328]
- Exit with non-zero code if linting fails
- Merge fix for the double fmf extension [#327]
- Prevent koji from trying to build packages on i686
- Retry requests in case of network failure
- Avoid double fmf extension when creating plans and stories
- Improve the maximum test duration handling
- Remove vagrant from tmt-all recommended packages
- Detect beakerlib libraries from recommend as well
- Simplify packit custom create archive command
- Make the httpd test example a bit more interesting
- Append dots to fix tmt run --help message summary
- Document multiple configs and extending steps
* Tue Jul 28 2020 Petr Šplíchal <psplicha@redhat.com> - 0.20-1
- Move libraries handling into a separate module
- Adjust loading variables from YAML files [#316]
- Support environment variables from YAML files
- Give a nice error for expired kerberos [fix #57]
- Merge Guest relocation and documentation [#307]
- Describe essential Guest methods in more detail
- Update test import story and documentation
- Merge extra-task as summary in test export [#304]
- Move default plan handling into a single method
- Move the Guest class from base to steps.provision
- Save root in run.yaml
- Document L1 metadata defined in the discover step
- Improve Makefile editing during test import
- Use extra-task as summary in test export
- Mention default methods in the step help message
- Handle invalid url when library provided as fmf id
- Allow library git clone to fail
* Fri Jun 12 2020 Petr Šplíchal <psplicha@redhat.com> - 0.19-1
- Make the discover step a little bit more secure
- Improve basic and verbose output of tmt plan show
- Improve default plan handling and more [fix #287]
- Adjust the compose check retry in testcloud
- Retry Fedora compose check in testcloud [fix #275]
- Update development section and library example
- Support fetching beakerlib libraries in discover
- Add nitrate to the setup.py extra requires
- Add a workflow-tomorrow integration test example
- Add 'duration' into the test results specification
* Mon Jun 01 2020 Petr Šplíchal <psplicha@redhat.com> - 0.18-1
- Add virtual plans for supported provision methods
- Implement description in 'tmt plan show' as well
- Implement tmt run --remove to remove workdir
- Extend the login/step test to cover failed command
- Do not fail upon command fail in interactive mode
- Implement the internal tmt execute step method
- Move all prepare/install tests to tier level 3
- Merge the new manual test specification [#247]
- Merge the new L1 attribute 'recommend' [#265]
- Adjust the manual test specification and examples
- Implement 'recommend' for installing soft requires
- State explicitly that execution is finished
- Simplify beakerlib template, add test for init
- Manual test case specification and examples
- Implement exit codes, handle no tests [fix #246]
- Merge the interactive shell login command [#258]
- Adjust support for shortened 1MT image names
- New login command to provide a shell on guest
- Add support for shortened 1MT image names
- Add support for running tests without defined plan
- Ignore save() in the execute step unit test
- Update the default run example with fresh output
- Show kernel version only in verbose mode
* Sat May 23 2020 Petr Šplíchal <psplicha@redhat.com> - 0.17-1
- Use emulator_path instead of hard-coded qemu path
- Improve a bit the --force option description
- Use consistent naming for provision subpackages
- Add 'mock' to extra requires (needed to make docs)
- Move podman and testcloud plugins into subpackages
- Enable epel for packit build & testing farm
- Move vagrant from requires to recommends (tmt-all)
* Mon May 18 2020 Petr Šplíchal <psplicha@redhat.com> - 0.16-1
- Merge the fix and test for run --force [#245]
- Merge the improved display report [#241]
- Adjust the display report plugin verbose output
- Adjust general plan linking and component check
- Clean up the run workdir if --force provided
- More verbose modes for report --how display
- Link plans, handle missing components in export
- Import and listify of contact
- Disable Tier 3 tests by default (need bare metal)
- Move Tier 0 tests into a separate directory
- Merge the new 1minutetip provision plugin [#225]
- Adjust the 1minutetip provision plugin
- Add support for tmt run --after and --before (#237)
- Support string in test component, require and tag (#233)
- Add support for installing local rpm packages
- Add 1minutetip provision plugin
- Implement tmt run --since, --until and --skip (#236)
- Merge pull request #234 from psss/testcloud-aliases
- Update the last run id at the very end of run
- Support short Fedora compose aliases in testcloud
- Convert the finish step into dynamic plugins
- Convert the report step into dynamic plugins
- Convert the execute step into dynamic plugins
- Escape package names during installation
- Deduplicate inherited keys in test import [fix #8]
* Wed Apr 29 2020 Petr Šplíchal <psplicha@redhat.com> - 0.15-1
- Implement executing the last run using --last
- Adjust support for modifying plan templates
- Add a way how to edit values in a new template
- Explicitly mention supported distros in the docs
- Convert provision/prepare into dynamic plugins
- Describe difference between --verbose and --debug
- Support fmf name references in docs, update spec
- Support multiple verbose/debug levels [fix #191]
- Remove forgotten 'Core' section from stories
- Implement Plugin.show() for a full dynamic support
- Improve the workdir handling in the Common class
* Thu Apr 16 2020 Petr Šplíchal <psplicha@redhat.com> - 0.14-1
- Workaround yaml key sorting on rhel-8 [fix #207]
- Fix test discovery from the execute step scripts
- Merge discover step documentation and fixes [#204]
- Document the discover step, fix issues, add tests
- Simplify the minimal example, adjust tests
- Move fmf_id() to Node class, minor adjustments
- Allow to print fmf identifier in tmt tests show
- Merge manual tests story and examples [#198]
- Add a story and examples describing manual tests
- Sync more extra-* attributes when exporting [#199]
- Enable checks for essential test attributes
- Handle require in Dicovery
- Store imported metadata in a sane order [fix #86]
- Enable Python 3.8 in Travis, update classifiers
- Add missing 'require' attribute to the Test class
- Fix long environment for run.sh [fix #126]
- Merge dynamic plugins and wake up support [#186]
- Implement dynamic plugins and options [fix #135]
- Suggest using 'tmt init' when metadata not found
- Merge improved import of tier from tags [#187]
- Adjust tier import from test case tags
- Merge tmt test export --nitrate --create [#185]
- Adjust suppport for creating new nitrate testcases
- Allow creation of nitrate cases when exporting
- Create tier attribute from multiple Tier tags
- Fix run.sh to work with RHEL/CentOS 7 as well
- Implement wake up for Run, Step and Discover
* Wed Apr 01 2020 Petr Šplíchal <psplicha@redhat.com> - 0.13-1
- Merge the improved test import checks [#179]
- Adjust checks for missing metadata
- Add checks for missing metadata.
- Implement public_git_url() for git url conversion
- Define required attributes and duration default
* Wed Mar 25 2020 Petr Šplíchal <psplicha@redhat.com> - 0.12-1
- Import the testcloud module when needed [fix #175]
- Update implementation coverage of stories & spec