cri-o/test
Nalin Dahyabhai 4ebcd650e0 Force use of the "vfs" driver when testing on AUFS
Basically none of the clever storage drivers will work when we're on top
of AUFS, so if we find ourselves in that situation when running tests,
default to storage options of "--storage-driver vfs".

Signed-off-by: Nalin Dahyabhai <nalin@redhat.com>
2017-07-20 17:29:38 -04:00
..
bin2img server: store and use image's stop signal to stop containers 2017-05-27 10:21:04 +02:00
checkseccomp seccomp: use Prctl() from x/sys/unix 2017-07-18 15:34:23 +02:00
copyimg vendor: upgrade containers/storage 2017-05-17 22:18:07 +02:00
testdata test: hostport network test 2017-06-22 15:46:15 -07:00
apparmor.bats Fix remnants of ocid -> crio rename 2017-05-15 15:05:58 -07:00
cgroups.bats test: Add test for pids limit 2017-07-11 19:17:48 -07:00
ctr.bats test: Use cgroupfs for tests 2017-07-05 17:29:32 -07:00
helpers.bash Force use of the "vfs" driver when testing on AUFS 2017-07-20 17:29:38 -04:00
image.bats test: use nginx:alpine when testing pull-by-digest 2017-05-28 20:33:55 +02:00
image_volume.bats test: Add a test for image volumes bind mount option 2017-07-14 16:57:38 -07:00
kpod.bats Add kpod push command 2017-07-20 11:12:40 -04:00
network.bats test: hostport network test 2017-06-22 15:46:15 -07:00
plugin_test_args.bash sandbox: pass correct pod Namespace/Name to network plugins and fix id/name ordering 2017-05-05 23:55:37 -05:00
pod.bats server: adhere to CRI for sandbox stop/remove 2017-06-15 23:08:30 +02:00
policy.json Integrate containers/storage 2017-01-18 10:23:30 -05:00
README.md Fix remnants of ocid -> crio rename 2017-05-15 15:05:58 -07:00
restore.bats server: adhere to CRI for sandbox stop/remove 2017-06-15 23:08:30 +02:00
runtimeversion.bats Rename ocid to crio. 2017-05-12 09:56:06 -04:00
seccomp.bats server: standardize on naming 2017-06-22 11:55:03 +02:00
test_runner.sh add tests skeleton 2016-09-24 00:37:07 +02:00

CRIO Integration Tests

Integration tests provide end-to-end testing of CRIO.

Note that integration tests do not replace unit tests.

As a rule of thumb, code should be tested thoroughly with unit tests. Integration tests on the other hand are meant to test a specific feature end to end.

Integration tests are written in bash using the bats framework.

Running integration tests

Containerized tests

The easiest way to run integration tests is with Docker:

$ make integration

To run a single test bucket:

$ make integration TESTFLAGS="runtimeversion.bats"

On your host

To run the integration tests on your host, you will first need to setup a development environment plus bats For example:

$ cd ~/go/src/github.com
$ git clone https://github.com/sstephenson/bats.git
$ cd bats
$ ./install.sh /usr/local

You will also need to install the CNI plugins as the the default pod test template runs without host networking:

$ go get github.com/containernetworking/cni
$ cd "$GOPATH/src/github.com/containernetworking/cni"
$ git checkout -q d4bbce1865270cd2d2be558d6a23e63d314fe769
$ ./build.sh \
$ mkdir -p /opt/cni/bin \
$ cp bin/* /opt/cni/bin/

Then you can run the tests on your host:

$ sudo make localintegration

To run a single test bucket:

$ make localintegration TESTFLAGS="runtimeversion.bats"

Or you can just run them directly using bats

$ sudo bats test

Runtime selection

Tests on the host will run with runc as the default runtime. However you can select other OCI compatible runtimes by setting the RUNTIME environment variable.

For example one could use the Clear Containers runtime instead of runc:

make localintegration RUNTIME=cc-oci-runtime

Writing integration tests

[Helper functions] (https://github.com/kubernetes-incubator/crio/blob/master/test/helpers.bash) are provided in order to facilitate writing tests.

#!/usr/bin/env bats

# This will load the helpers.
load helpers

# setup is called at the beginning of every test.
function setup() {
}

# teardown is called at the end of every test.
function teardown() {
	cleanup_test
}

@test "crioctl runtimeversion" {
	start_crio
	crioctl runtimeversion
	[ "$status" -eq 0 ]
}