An open and reliable container runtime
Go to file
Derek McGowan 856b038437 Merge pull request #1253 from stevvooe/alpha2
release: prepare for v1.0.0-alpha2
2017-07-26 15:45:24 -07:00
api Merge pull request #1246 from stevvooe/events-refactor 2017-07-26 08:31:12 -04:00
archive Update tar path resolution 2017-07-24 17:51:47 -07:00
cmd Merge pull request #1246 from stevvooe/events-refactor 2017-07-26 08:31:12 -04:00
containers support using multiple snapshotters simultaneously 2017-07-12 11:16:12 -07:00
content metadata: defer ingest lock to backend 2017-07-24 12:20:34 -07:00
design Rewrite imports for new github org 2017-04-03 14:05:44 -07:00
differ Add namespace content store in metadata 2017-07-11 11:11:10 -07:00
docs retrying pr for website to satify cncf guidelines 2017-06-16 14:30:31 -07:00
errdefs Update errdefs.ErrInvalidArgument message 2017-07-21 18:19:51 +02:00
events events: refactor event distribution 2017-07-25 15:08:09 -07:00
filters correct some misspellings to make Go Report more happy 2017-07-19 17:31:14 +08:00
fs update to github.com/sirupsen/logrus v1.0.0 2017-07-21 15:39:14 -07:00
gc fix typo I found in this repo 2017-01-20 01:18:26 +08:00
identifiers namespaces, identifiers: split validation 2017-07-12 14:46:47 -07:00
images correct some misspellings to make Go Report more happy 2017-07-19 17:31:14 +08:00
linux events: refactor event distribution 2017-07-25 15:08:09 -07:00
log update to github.com/sirupsen/logrus v1.0.0 2017-07-21 15:39:14 -07:00
metadata metadata: defer ingest lock to backend 2017-07-24 12:20:34 -07:00
metrics/cgroups events: refactor event distribution 2017-07-25 15:08:09 -07:00
mount Loop umount'ing rootfs until there are no more mounts 2017-07-20 10:50:08 +01:00
namespaces namespaces, identifiers: split validation 2017-07-12 14:46:47 -07:00
oci package for manipulating OCI images 2017-06-14 06:49:56 +00:00
plugin events: refactor event distribution 2017-07-25 15:08:09 -07:00
progress cmd/dist: implement fetch prototype 2017-03-02 17:36:01 -08:00
reaper Handle start process errors in reaper 2017-06-16 16:03:13 -07:00
reference fix some typos for reference/reference.go 2017-07-18 16:10:03 +08:00
remotes update to github.com/sirupsen/logrus v1.0.0 2017-07-21 15:39:14 -07:00
reports Fix sublist in dev report 2017-06-26 10:58:05 -07:00
rootfs Add documentation to rootfs functions 2017-07-12 13:59:17 -07:00
runtime Move typeurl registrations to runtime package 2017-07-21 18:19:51 +02:00
server events: refactor event distribution 2017-07-25 15:08:09 -07:00
services Merge pull request #1246 from stevvooe/events-refactor 2017-07-26 08:31:12 -04:00
snapshot Update storage kind test 2017-07-25 13:59:16 -07:00
sys Use Prctl() and associated constants from x/sys/unix 2017-07-19 10:30:12 +02:00
testutil Update integration test to support windows 2017-07-21 18:19:51 +02:00
typeurl Panic when registering the same type but diff urls 2017-07-24 15:51:09 -04:00
vendor Revendor hcsshim and go-winio 2017-07-25 12:03:44 -07:00
version release: prepare for v1.0.0-alpha2 2017-07-26 15:23:24 -07:00
windows events: refactor event distribution 2017-07-25 15:08:09 -07:00
.appveyor.yml Disable coverage tests on Windows CI 2017-07-24 21:39:08 +02:00
.gitignore Add initial containerd *Client 2017-05-24 14:08:58 -07:00
.travis.yml .travis.yml: run go build -i 2017-07-18 10:20:21 +00:00
BUILDING.md Claim Go 1.8.x version requirement in BUILDING.md 2017-07-19 02:50:28 -04:00
CONTRIBUTING.md fix typo I found in this repo 2017-01-20 01:18:26 +08:00
LICENSE.code Update readme and version to 0.1.0 2016-03-21 13:01:28 -07:00
LICENSE.docs Update copyright and license 2015-12-18 00:08:16 +01:00
MAINTAINERS Update with preferred email address 2017-05-17 14:09:15 -04:00
Makefile Merge pull request #1196 from mlaventure/update-windows-runtime 2017-07-21 15:12:53 -07:00
NOTICE Update readme and documentation for release 2015-12-16 12:15:22 -08:00
Protobuild.toml Improve the comment 2017-07-22 12:39:34 +08:00
README.md client: rename rootfs to snapshot in "With" functions 2017-07-25 15:24:06 -07:00
ROADMAP.md Replace roadmap with link to milestones 2017-07-24 13:42:35 -04:00
RUNC.md Update runc and runtime-spec dependencies 2017-06-27 11:44:38 -07:00
SCOPE.md Update readme 2017-06-20 13:19:53 -07:00
benchmark_test.go client: rename rootfs to snapshot in "With" functions 2017-07-25 15:24:06 -07:00
checkpoint_test.go client: rename rootfs to snapshot in "With" functions 2017-07-25 15:24:06 -07:00
client.go client: rename rootfs to snapshot in "With" functions 2017-07-25 15:24:06 -07:00
client_test.go Update dependencies for logrus rename 2017-07-21 16:14:03 -07:00
client_unix.go Update ctr so it works again on windows 2017-07-21 18:19:48 +02:00
client_unix_test.go Update integration test to support windows 2017-07-21 18:19:51 +02:00
client_windows.go Update ctr so it works again on windows 2017-07-21 18:19:48 +02:00
client_windows_test.go Update integration test to support windows 2017-07-21 18:19:51 +02:00
code-of-conduct.md Add code of conduct 2017-04-04 09:41:38 -07:00
container.go Add root mounts to task info 2017-07-25 15:24:06 -07:00
container_linux_test.go client: rename rootfs to snapshot in "With" functions 2017-07-25 15:24:06 -07:00
container_test.go client: rename rootfs to snapshot in "With" functions 2017-07-25 15:24:06 -07:00
container_unix.go containerd: remove GRPC service export 2017-07-12 16:57:47 -07:00
containerd.service Add containerd unit file 2017-06-16 14:05:16 -07:00
containerstore.go containerd: remove GRPC service export 2017-07-12 16:57:47 -07:00
grpc.go Add default namespace to client 2017-06-12 15:47:58 -07:00
helpers_unix_test.go client: rename rootfs to snapshot in "With" functions 2017-07-25 15:24:06 -07:00
helpers_windows_test.go client: rename rootfs to snapshot in "With" functions 2017-07-25 15:24:06 -07:00
image.go Update the content interface to return info from update 2017-07-12 16:22:13 -07:00
io.go Update ctr so it works again on windows 2017-07-21 18:19:48 +02:00
io_unix.go Update ctr so it works again on windows 2017-07-21 18:19:48 +02:00
io_windows.go Update ctr so it works again on windows 2017-07-21 18:19:48 +02:00
process.go events: refactor event distribution 2017-07-25 15:08:09 -07:00
spec.go Don't require rootfs if not set on container 2017-05-25 11:17:36 -07:00
spec_unix.go containerd: remove GRPC service export 2017-07-12 16:57:47 -07:00
spec_unix_test.go containerd: Add WithNamespace to replace namespace 2017-06-19 11:22:26 -07:00
spec_windows.go Update ctr so it works again on windows 2017-07-21 18:19:48 +02:00
task.go Merge pull request #1246 from stevvooe/events-refactor 2017-07-26 08:31:12 -04:00
vendor.conf Revendor hcsshim and go-winio 2017-07-25 12:03:44 -07:00

README.md

banner

GoDoc Build Status FOSSA Status Go Report Card

containerd is an industry-standard container runtime with an emphasis on simplicity, robustness and portability. It is available as a daemon for Linux and Windows, which can manage the complete container lifecycle of its host system: image transfer and storage, container execution and supervision, low-level storage and network attachments, etc.

containerd is designed to be embedded into a larger system, rather than being used directly by developers or end-users.

Features

Client

containerd offers a full client package to help you integrate containerd into your platform.


import "github.com/containerd/containerd"

func main() {
	client, err := containerd.New("/run/containerd/containerd.sock")
	defer client.Close()
}

Namespaces

Namespaces allow multiple consumers to use the same containerd without conflicting with each other. It has the benefit of sharing content but still having separation with containers and images.

To set a namespace for requests to the API:

context    = context.Background()
// create a context for docker
docker = namespaces.WithNamespace(context, "docker")

containerd, err := client.NewContainer(docker, "id")

To set a default namespace on the client:

client, err := containerd.New(address, containerd.WithDefaultNamespace("docker"))

Distribution

// pull an image
image, err := client.Pull(context, "docker.io/library/redis:latest")

// push an image
err := client.Push(context, "docker.io/library/redis:latest", image.Target())

OCI Runtime Specification

containerd fully supports the OCI runtime specification for running containers. We have built in functions to help you generate runtime specifications based on images as well as custom parameters.

spec, err := containerd.GenerateSpec(containerd.WithImageConfig(context, image))

Containers

In containerd, a container is a metadata object. Resources such as an OCI runtime specification, image, root filesystem, and other metadata can be attached to a container.

redis, err := client.NewContainer(context, "redis-master",
	containerd.WithSpec(spec),
)
defer redis.Delete(context)

Root Filesystems

containerd allows you to use overlay or snapshot filesystems with your containers. It comes with builtin support for overlayfs and btrfs.

// pull an image and unpack it into the configured snapshotter
image, err := client.Pull(context, "docker.io/library/redis:latest", containerd.WithPullUnpack)

// allocate a new RW root filesystem for a container based on the image
redis, err := client.NewContainer(context, "redis-master",
	containerd.WithSpec(spec),
	containerd.WithNewSnapshot("redis-rootfs", image),
)

// use a readonly filesystem with multiple containers
for i := 0; i < 10; i++ {
	id := fmt.Sprintf("id-%s", i)
	container, err := client.NewContainer(ctx, id,
		containerd.WithSpec(spec),
		containerd.WithNewSnapshotView(id, image),
	)
}

Tasks

Taking a container object and turning it into a runnable process on a system is done by creating a new Task from the container. A task represents the runnable object within containerd.

// create a new task
task, err := redis.NewTask(context, containerd.Stdio)
defer task.Delete(context)

// the task is now running and has a pid that can be use to setup networking
// or other runtime settings outside of containerd
pid := task.Pid()

// start the redis-server process inside the container
err := task.Start(context)

// wait for the task to exit and get the exit status
status, err := task.Wait(context)

Checkpoint and Restore

If you have criu installed on your machine you can checkpoint and restore containers and their tasks. This allow you to clone and/or live migrate containers to other machines.

// checkpoint the task then push it to a registry
checkpoint, err := task.Checkpoint(context, containerd.WithExit)

err := client.Push(context, "myregistry/checkpoints/redis:master", checkpoint)

// on a new machine pull the checkpoint and restore the redis container
image, err := client.Pull(context, "myregistry/checkpoints/redis:master")

checkpoint := image.Target()

redis, err = client.NewContainer(context, "redis-master", containerd.WithCheckpoint(checkpoint, "redis-rootfs"))
defer container.Delete(context)

task, err = redis.NewTask(context, containerd.Stdio, containerd.WithTaskCheckpoint(checkpoint))
defer task.Delete(context)

err := task.Start(context)

Developer Quick-Start

To build the daemon and ctr simple test client, the following build system dependencies are required:

  • Go 1.8.x or above (requires 1.8 due to use of golang plugin(s))
  • Protoc 3.x compiler and headers (download at the Google protobuf releases page)
  • Btrfs headers and libraries for your distribution. Note that building the btrfs driver can be disabled via build tag removing this dependency.

For proper results, install the protoc release into /usr/local on your build system. For example, the following commands will download and install the 3.1.0 release for a 64-bit Linux host:

$ wget -c https://github.com/google/protobuf/releases/download/v3.1.0/protoc-3.1.0-linux-x86_64.zip
$ sudo unzip protoc-3.1.0-linux-x86_64.zip -d /usr/local

With the required dependencies installed, the Makefile target named binaries will compile the ctr and containerd binaries and place them in the bin/ directory. Using sudo make install will place the binaries in /usr/local/bin. When making any changes to the gRPC API, make generate will use the installed protoc compiler to regenerate the API generated code packages.

Note: A build tag is currently available to disable building the btrfs snapshot driver. Adding BUILDTAGS=no_btrfs to your environment before calling the binaries Makefile target will disable the btrfs driver within the containerd Go build.

Vendoring of external imports uses the vndr tool which uses a simple config file, vendor.conf, to provide the URL and version or hash details for each vendored import. After modifying vendor.conf run the vndr tool to update the vendor/ directory contents. Combining the vendor.conf update with the changeset in vendor/ after running vndr should become a single commit for a PR which relies on vendored updates.

Please refer to RUNC.md for the currently supported version of runc that is used by containerd.

Releases

containerd will be released with a 1.0 when feature complete and this version will be supported for 1 year with security and bug fixes applied and released.

The upgrade path for containerd is that the 0.0.x patch releases are always backward compatible with its major and minor version. Minor (0.x.0) version will always be compatible with the previous minor release. i.e. 1.2.0 is backwards compatible with 1.1.0 and 1.1.0 is compatible with 1.0.0. There is no compatibility guarantees with upgrades from two minor releases. i.e. 1.0.0 to 1.2.0.

There are not backwards compatibility guarantees with upgrades to major versions. i.e 1.0.0 to 2.0.0. Each major version will be supported for 1 year with bug fixes and security patches.

Development reports.

Weekly summary on the progress and what is being worked on. https://github.com/containerd/containerd/tree/master/reports

Communication

For async communication and long running discussions please use issues and pull requests on the github repo. This will be the best place to discuss design and implementation.

For sync communication we have a community slack with a #containerd channel that everyone is welcome to join and chat about development.

Slack: https://dockr.ly/community

Copyright ©2016-2017 Docker, Inc. All rights reserved, except as follows. Code is released under the Apache 2.0 license. The README.md file, and files in the "docs" folder are licensed under the Creative Commons Attribution 4.0 International License under the terms and conditions set forth in the file "LICENSE.docs". You may obtain a duplicate copy of the same license, titled CC-BY-SA-4.0, at http://creativecommons.org/licenses/by/4.0/.