There are a large number of technologies and concepts that can dramatically improve software quality, while simultaneously reducing its development time, cost, and effort. The question, though, is which combination is the right one for both your organization and your project?<\/p>\n
Like so many topics, the answer to this one is, \u201cIt depends.\u201d So today, I\u2019m going to help whittle that list down somewhat by looking at several of the main advantages that continuous integration (CI) in the cloud can bring. However, before I do that, let\u2019s quickly recap what CI and the cloud are, starting with the cloud.<\/p>\n
The cloud is often seen as a very amorphous, even nebulous, concept, one often applied to anything<\/em> to do with computing infrastructure that you can\u2019t either directly or physically touch and control. As a result, it\u2019s become a somewhat derided term that marketing departments seem to use with increasing abandon. This derision is rather unfortunate as, when well understood, the cloud is a potent tool, one which can be very enabling and transformative.<\/p>\n So let\u2019s suitably define what it is. Of all the cloud descriptions I\u2019ve heard, the best one is this one from an interview with Scott Hanselman<\/a>:<\/p>\n The cloud is hosting generalized and made elastic<\/strong>. It\u2019s hosting with an API wrapped around it. It\u2019s choice. It\u2019s an API. It\u2019s flexible billing\u2026The cloud is about gaining control of your business. It\u2019s about gaining knowledge. It\u2019s not a loss of control.<\/p><\/blockquote>\n You can listen to the longer version of his description, which starts from about 14 minutes into the interview.<\/p>\n For myself, the cloud is computer infrastructure that scales dynamically with you, whether up or down. It\u2019s infrastructure that has the flexibility to adapt to your changing needs \u2014 and budgets \u2014 continuously.<\/p>\n Given the benefits that this brings, over recent years, a whole range of vendors have appeared, offering a variety of services designed to support a broad range of infrastructure needs. These include hosted database and logging providers such as ElephantSQL<\/em> and Loggly<\/em>, email providers such as Zoho<\/em>, and more generalized computing infrastructure such as Amazon Web Services<\/em>, Google Cloud Platform<\/em>, and Microsoft Azure<\/em>.<\/p>\n Next, what is continuous integration (CI)? According to Codeship\u2019s CI Essentials guide<\/a>, continuous integration is:<\/p>\n \u2026a development practice where developers integrate code into a shared repository frequently<\/strong>, preferably several times a day. Each integration can then be verified by an automated build and automated tests<\/strong>. While automated testing is not strictly part of CI, it is typically implied. One of the key benefits of regularly integrating code is that you can detect errors quickly and locate them more easily<\/strong>. As each change introduced is typically small, pinpointing the specific change that introduced a defect can be done quickly.<\/p><\/blockquote>\n Continuous integration needn\u2019t be complicated nor sophisticated. At its simplest, it could consist of just a few things:<\/p>\n In reality, however, CI pipelines often have much more sophisticated requirements, such as database<\/em>, queueing<\/em>, caching<\/em>, and web servers<\/em>, which are often required for acceptance and integration tests.<\/p>\n This complexity can be driven by a range of factors, such as the industry that the software serves, regulatory requirements and constraints, budgetary constraints, and the project\u2019s technical requirements.<\/p>\n Now that we\u2019ve recapped what these terms mean, why should you put your CI pipeline in the cloud instead of hosting it yourself? What benefits will you accrue by doing so that could outweigh a homegrown solution? To answer these two questions, let\u2019s consider four key advantages of CI in the cloud.<\/p>\n The first benefit of CI in the cloud that we should consider is lower cost. This might sound counterintuitive when you\u2019re using an external service, as you\u2019ll likely be paying for the service at some point. But calculating cost, as I\u2019ve argued previously<\/a>, is usually neither a quick nor easy process. Let\u2019s step through an example so that you see what I mean.<\/p>\n Codeship Basic<\/a> offers three paid plans: starter<\/em>, essential<\/em>, and power<\/em>. There\u2019s also a free plan (not just a free trial), a good option if you\u2019re just getting started or you\u2019re building a project that\u2019s either for a hobby or an open-source project. You can get started for free, then as your budget grows, you can scale up to get more functionality and power.<\/p>\n Assuming that you went with one of those plans, after signing up, you\u2019d just need to do a bit of light-touch account configuration, and you\u2019re ready to build your first CI pipeline. Contrast this with building a solution that either you or your team created, or one based on an open-source tool such as Jenkins<\/a>. If you take that path, you\u2019ll have to:<\/p>\n Depending on just how advanced and sophisticated your solution needs to be, your costs, amortized over a decade or more, could be quite substantial. Given that, which approach costs less, not only in a monetary sense but also in respect to time and overhead?<\/p>\n One thing that can\u2019t be removed by hosting a CI solution in the cloud is the need for configuration. However, it can be significantly<\/em> reduced. By using a hosted solution, the configuration requirements are reduced just to those required for your CI pipeline(s). On top of that, a range of default settings is typically available to suit the nature of the software being developed.<\/p>\n All you have to do is choose the one that best fits your software and make supplementary changes. As an example, Codeship provides basic commands for such languages and frameworks as Go<\/em>, Java<\/em>, PHP<\/em>, Python<\/em>, Node.js<\/em>, Vue.js<\/em>, Symfony<\/em>, Laravel<\/em>, Ruby on Rails<\/em>, and Sinatra<\/em>. In addition, a default pipeline will be created to match the default build commands.<\/p>\n Despite this level of support and assistance, no cloud provider will ever be able to create a solution that exactly suits the needs of every software project. So you may find that the default commands and build pipelines aren\u2019t always suitable. In these situations, you should expect to be able to provide custom build scripts and configurations, as well as to customize and extend the default options as you need to, on a project-by-project basis, as and when the need arises.<\/p>\n So either way, whether the defaults, extending the defaults, or a custom script set is the path you take, you would still have far less to configure than in a solution you created yourself.<\/p>\n Perhaps the greatest advantage of using the cloud is its elastic nature, one that can scale both up and down as the needs arise. If you\u2019re a small development organization, perhaps consisting of only two developers on the way to deploying your first release, you can get started with only the features and computing power that you absolutely<\/em> need.<\/p>\n This lets you keep your costs to a minimum and avoid over-investing in hardware that you don\u2019t yet need. However, as your application\u2019s complexity or user base grows, you can dynamically scale up the available resources to meet demand.<\/p>\n This flexibility is also available if you have intermittent periods of load, periods that may only last for a few days \u2014 or hours \u2014 at most. It lets you dynamically scale to handle unpredictable traffic spikes or seasonal holidays.<\/p>\n But concerning CI, hosting providers can also provide elasticity around testing by offering a configurable number of parallel test pipelines. Parallel test pipelines allow you to split builds into multiple pipelines, which in turn reduce the test suite\u2019s execution time.<\/p>\n Next, let\u2019s consider flexibility. Consider that you designed a homegrown solution when your organization or software was quite young. It started out needing a rather simple software stack, perhaps composed of Apache<\/em> or NGINX<\/em>, PHP<\/em>, and PostgreSQL<\/em>.<\/p>\n However, you\u2019ve rapidly gained a strong following and consequently, have added an increasing number of technologies into the mix, such as Redis<\/em>, Memcached<\/em>, and ELK<\/em>. What\u2019s more, because of the demand, you\u2019re now considering transitioning to a Go-based microservice architecture.<\/p>\n What will it take and what will it cost you to refactor and maintain your internal CI solution? Can you find the staff with sufficient experience in the technologies required to both adapt \u2014\u00a0or to recreate \u2014 and maintain it?<\/p>\n Contrast this with a Cloud solution which works with projects almost regardless of their technology mix, one which comes with a host of infrastructure ready to go, including a range of database<\/em>, queuing<\/em>, cache<\/em>, and search servers<\/em>.<\/p>\n What\u2019s more, in certain cases, multiple versions of these servers are simultaneously available. As a result, you have the flexibility of testing your application in a wide array of combinations and permutations. All you may need to do is to provide the appropriate environment settings to your application, and it can alternate between the different versions as necessary.<\/p>\n And that\u2019s been a look at four benefits of using cloud-based continuous integration over an in-house, homegrown solution. Can you think of any more? Do you feel that any of the four mentioned either aren\u2019t applicable or could be extended? If so, I\u2019d love to hear your thoughts in the comments.<\/p>\n If you\u2019ve been on the fence for some time about the cloud, whether what it is or whether it\u2019s worth including in your software stack, I hope that these benefits have helped resolve any lingering doubt that you may have. I also hope that you now see that regardless of your organization\u2019s size or your application\u2019s maturity and sophistication, a cloud-based CI solution may be the more viable choice.<\/p>\nWhat Is Continuous Integration?<\/h2>\n
\n
Benefits of CI in the Cloud<\/h2>\n
Reduced cost<\/h3>\n
\n
Minimal configuration<\/h3>\n
Dynamic scalability<\/h3>\n
Flexibility<\/h3>\n
In Conclusion<\/h2>\n
Links<\/h2>\n
\n