Scott Johnston

Docker Hub: A new stack plus ecosystem partners automate developer workflows

docker-hub-getting-startedThe Docker Hub team has been busy over the summer and today we’re ready to share some exciting updates. More and more developers are using Docker Hub to automate their workflows, and Docker Hub’s re-architected stack and new UI, together with partner plugins for source code management and continuous integration, will help them, and you, build, ship, and run apps even faster.


 

Workflow Automation for Development Teams

While Docker Hub offers a public registry service for storing and sharing Docker images – over 200,000 at last count – it also has many additional services to help development teams automate their workflows. Specifically, teams use Docker Hub’s private repos, automated builds, and webhooks to assemble tailored toolchains across their source code, and throughout their integrated build, test, registry, and deployment environment. And with built-in organizational collaboration tools, including fine-grained access control, teams can more easily use Docker Hub to share images and coordinate their work. And while of course your mileage may vary, it is not unusual for teams to be able to deploy 7x more frequently as a result of Docker and Docker Hub-based continuous integration.

What does a typical Docker and Docker Hub-based continuous integration workflow look like?

docker-hub-diagram

 

While Docker Hub’s services are flexible enough to allow teams to create many different custom workflows to suit their specific needs, here’s one high-level example of how you can set things up:

1) Create an organization on Docker Hub and invite colleagues.
2) Create a Dockerfile for your app. Many users start with one of the Official Repos on Docker Hub as their base image.
3) Connect your team’s source code repo with your team’s Docker Hub repo and automated build service.
4) Set-up webhooks to kick-off testing using a CI service after the image is pushed into the team’s Docker Hub repo and return the result of the test.

With a set-up like this, any code changes committed to the team’s source code repo will automatically trigger a build on Docker Hub and push the new image into the team’s Docker Hub repo. Webhooks will then automatically trigger the CI service to pull the newly-built image, test it, and return a status, e.g., “success” or “fail”. The newly-built and -tested image is now ready for use by other team members, as well as for deployment to any environment.

For specific examples, see how companies like Bleacher Report, Bunchball, Business Insider, and Gilt Groupe all use Docker Hub as an integral part of their continuous integration pipeline.


 

Integrate Your Favorite Tools

A major reason why Docker Hub is finding rapid adoption is its flexibility in creating pipelines that integrate Docker Hub’s services with other tools. Specifically, today, Docker Hub users can plug in continuous integration services like Circle CI, Travis, Cloudbees Jenkins, and Shippable as well as source code management services like GitHub, Atlassian Bitbucket, and GitLab. To integrate with other services for deployments, notifications, and other workflow steps teams use Docker Hub’s build triggers and webhooks.

As Paul Biggar, CEO of Circle CI explains: “The combination of Circle CI continuous integration and deployment and Docker Hub creates dramatic developer efficiencies for our many joint customers. For instance, an engineering lead from Sony Japan says that while older projects in the organization required a checklist of instructions and took days to deploy fully to their app servers, their team now uses Circle CI and Docker Hub to go from a GitHub push to a completed deployment in minutes.”


 

Under The Covers

Since the launch of Docker Hub at DockerCon SF in June 2014, the number of users has grown by 5x, the number of repos by 6x, and the volume of image downloads by more than 280x, to 860 million downloads. This has consumed more than 200 TB of image storage and over 400 TB of network bandwidth.

Seeing this growth in the first year and estimating future growth, the Docker Hub team stepped back and completely re-thought the product from top-to-bottom. Thanks to significant engineering investment in infrastructure providers, a new application architecture, and a completely new front-end technology stack, Hub users are seeing 2.5x faster downloads and 1.9x faster UI response times.


 

Now Available with Commercial Support

As teams automate their development workflows, they soon start to think about how to deploy and manage Docker-based apps in production. Many are looking for additional help with these production deployments, and for them we’re pleased to offer commercial support and maintenance, with plans starting at $150/month. We offer different plans for different user needs, with committed service levels aligned to the application SLAs you provide your own customers.


 

We hope you’re as excited about these updates to Docker Hub as we are! The Docker Hub community has been very supportive throughout our iterations of the product, giving us lots of feedback along the way. Please keep it coming!

Thanks – we can’t wait to see the apps you’ll build with Docker and Docker Hub!

– The Docker Hub Team

 

Additional Resources

 


 

 Learn More about Docker

,

Scott Johnston

Docker Hub: A new stack plus ecosystem partners automate developer workflows


Leave a Reply

Get the Latest Docker News by Email

Docker Weekly is a newsletter with the latest content on Docker and the agenda for the upcoming weeks.