Using Overlay file system with Docker on Ubuntu

09Mar15

Last week Jérôme Petazzoni did an excellent (abbreviated) version of his ‘Deep dive into Docker storage drivers‘ at the London Docker Meetup. If I wasn’t convinced enough by that, Jessie Frazelle hammered home the same point in her QCon Presentation – AUFS is where it used to be at, and the new king is Overlay. I set about trying it out for myself during Jessie’s presentation, and as I couldn’t find a simple guide I’m writing one here.

Update 24 Dec 2015 If you’re using Ubuntu after the switch to systemd (14.10+) then you need these instructions.

3.18 Kernel

OverlayFS has been in Ubuntu kernels for some time, but that’s not what we want. Overlay (without the FS) is a different kernel module, so you’ll need to install the 3.18 (or later) kernel:

cd /tmp/
wget http://kernel.ubuntu.com/~kernel-ppa/mainline/v3.18-vivid/linux-headers-3.18.0-031800-generic_3.18.0-031800.201412071935_amd64.deb
wget http://kernel.ubuntu.com/~kernel-ppa/mainline/v3.18-vivid/linux-headers-3.18.0-031800_3.18.0-031800.201412071935_all.deb
wget http://kernel.ubuntu.com/~kernel-ppa/mainline/v3.18-vivid/linux-image-3.18.0-031800-generic_3.18.0-031800.201412071935_amd64.deb
sudo dpkg -i linux-headers-3.18.0-*.deb linux-image-3.18.0-*.deb

I’ve tested this myself on Ubuntu 14.04 and 12.04.

3.19 Kernel

Thanks to Manbeard for pointing out that the release of 15.04 makes the kernel upgrade much easier:

sudo apt-get install -y –install-recommends linux-generic-lts-vivid

Docker bits

You’ll need Docker 1.4 or later (I tested on 1.5), which can be installed using the usual Ubuntu instructions if you don’t already have it.

After rebooting to get the new kernel it’s now necessary to set ‘-s overlay’ in the DOCKER_OPTS within /etc/default/docker:

# Use DOCKER_OPTS to modify the daemon startup options.
DOCKER_OPTS="-s overlay"

Restart the Docker service, and if all is well you should get the following output from ‘docker info’

$ sudo docker info
Containers: 0
Images: 0
Storage Driver: overlay
 Backing Filesystem: extfs
Execution Driver: native-0.2
Kernel Version: 3.18.0-031800-generic
Operating System: Ubuntu 14.04.1 LTS
etc...

I seem to recall needing ‘modprobe overlay’ on 12.04 to get things working. I’d also note the bad news that Docker falls back to DeviceMapper (rather than AUFS) if it can’t make Overlay work.

Update

[1] Justin Cormack pointed me at this article ‘Another union filesystem approach



16 Responses to “Using Overlay file system with Docker on Ubuntu”

  1. Why is overlay the “king” now?

    • Faster, more reliable, and it seems to be what the Docker core team are running on their own setups, so it’s likely the one that’s getting the most testing.

    • 3 smerrill

      Probably the biggest plus for overlay is that it is in the Linux kernel proper as of 3.18. AUFS, on the other hand, was an out-of-tree kernel patchset, so each distro would have to evaluate if they would maintain it and put it into their kernel builds.

  2. We have translated your article to chinese:http://dockerone.com/article/237

  3. Please note that previous containers running with aufs will not be available to overlay. Plan accordingly.

    • Good point. I started using overlay on a new VM, but if you have existing containers then they will need to be exported and imported.

  4. Couldn’t you just use the LTS kernel enablement to upgrade?

    https://wiki.ubuntu.com/Kernel/LTSEnablementStack

    “sudo apt-get install –install-recommends linux-generic-lts-vivid”

    • Thanks – that wasn’t an option when I first wrote this, but now that 15.04 is out it’s a much easier way to go.

  5. Thanks! Updated for Ubuntu 15.04 and systemd here: https://gist.github.com/rosskevin/6e693047e79f9c9d0702


  1. 1 Nifty Things for Week Ending 27 March » Ramblings
  2. 2 I quadrupled the speed of our container test rig in a day | Weave Blog
  3. 3 Docker 101 | ITJUMPSTART
  4. 4 Upgrading Docker Redux | Chris Swan's Weblog
  5. 5 I Quadrupled the Speed of Our Container Test Rig in a Day | Weaveworks blog
  6. 6 Using Overlay file system with Docker on systemd Ubuntu (15.04+) | Chris Swan's Weblog
  7. 7 Using Overlay file system with Docker on systemd Ubuntu (14.10+) | Chris Swan's Weblog

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s


Follow

Get every new post delivered to your Inbox.

Join 122 other followers

%d bloggers like this: