936a157117
Currently, the titles of the manuals are rendered with a pair of empty parentheses and no section title: toolbox(1)() toolbox(1)() NAME toolbox - Tool for containerized command line environments... However, they should be: toolbox(1) General Commands Manual toolbox(1) NAME toolbox - Tool for containerized command line environments... This is because the troff generated by go-md2man from Markdown has a faulty invocation of the .TH macro [1]: .nh .TH toolbox(1) .SH NAME .PP toolbox - Tool for containerized command line environments on Linux It should be: .nh .TH toolbox 1 .SH NAME .PP toolbox - Tool for containerized command line environments on Linux Original patch from Andrew Denton for Podman [2]. [1] https://www.gnu.org/software/groff/manual/groff.html [2] Podman commit 63c779a857b55b00 https://github.com/containers/podman/pull/15621 https://github.com/containers/toolbox/pull/1210 |
||
---|---|---|
.. | ||
libs | ||
000-setup.bats | ||
001-version.bats | ||
002-help.bats | ||
101-create.bats | ||
102-list.bats | ||
103-container.bats | ||
104-run.bats | ||
105-enter.bats | ||
106-rm.bats | ||
107-rmi.bats | ||
108-completion.bats | ||
999-teardown.bats | ||
README.md |
System tests
These tests are built with BATS (Bash Automated Testing System).
The tests are meant to ensure that Toolbox's functionality remains stable throughout updates of both Toolbox and Podman/libpod.
The tests are set up in a way that does not affect the host environment. Running them won't remove any existing containers or images.
Dependencies
awk
bats
GNU coreutils
httpd-tools
openssl
podman
skopeo
toolbox
These tests use a few standard libraries for bats
which help with clarity
and consistency. The libraries are bats-support
and bats-assert. These libraries are
provided as git submodules in the libs
directory. Make sure both are present.
How to run the tests
First, make sure you have all the dependencies installed.
- Enter the toolbox root folder
- Invoke command
bats ./test/system/
and the test suite should fire up
Mocking of images is done automatically to prevent potential networking issues and to speed up the cases.
By default the test suite uses the system versions of podman
, skopeo
and
toolbox
.
If you have a podman
, skopeo
or toolbox
installed in a nonstandard
location then you can use the PODMAN
, SKOPEO
and TOOLBOX
environmental
variables to set the path to the binaries. So the command to invoke the test
suite could look something like this: PODMAN=/usr/libexec/podman TOOLBOX=./toolbox bats ./test/system/
.
When running the tests, make sure the test suite: [job]
jobs are successful.
These jobs set up the whole environment and are a strict requirement for other
jobs to run correctly.
Writing tests
Environmental variables
- Inspect top part of
libs/helpers.bats
for a list of helper environmental variables
Naming convention
- All tests should follow the nomenclature:
[command]: <test description>...
- When the test is expected to fail, start the test description with "Try to..."
- When the test is to give a non obvious output, it should be put in parenthesis at the end of the title
Examples:
@test "create: Create the default container"
@test "rm: Try to remove a non-existent container"
Test case environment
- All the tests start with a clean system (no images or containers) to make sure
that there are no dependencies between tests and they are really isolated. Use
the
setup()
andteardown()
functions for that purpose.
Image registry
-
The system tests set up an OCI image registry for testing purposes -
localhost:50000
. The registry requires authentication. There is one account present:user
(password:user
) -
The registry contains by default only one image:
fedora-toolbox:34
Example pull of the fedora-toolbox:34
image:
$PODMAN login --username user --password user "$DOCKER_REG_URI"
$PODMAN pull "$DOCKER_REG_URI/fedora-toolbox:34"