On each Pull Request opened in GitHub we run Travis CI and Appveyor to provide prompt feedback about the status of PR. Our main CI pipeline runs on GitLab CI. GitLab repository automatically mirrors our GitHub repository and runs pipeline on `master` branch. It tests more environments and different configurations. It publish variety of artifacts.

- `test-rel-lin` - `r-release` on Linux, most comprehensive test environment, `-O3 -flto -fno-common -Wunused-result`, extra check for no compilation warnings, includes testing [_with other packages_](./../inst/tests/other.Rraw)

- `test-rel-cran-lin` - `--as-cran` on Linux, `-g0`, extra check for final status of `R CMD check` where we allow one NOTE (_size of tarball_).

- `test-dev-cran-lin` - `r-devel` and `--as-cran` on Linux, `--with-recommended-packages --enable-strict-barrier --disable-long-double`, tests for compilation warnings in pkg install and new NOTEs/Warnings in pkg check, and because it is R-devel it is marked as allow_failure

- `test-rel-vanilla-lin` - `r-release` on Linux, no suggested deps, no OpenMP, `-O0`, tracks memory usage during tests

- `test-310-cran-lin` - R 3.1.0 on Linux

- `test-344-cran-lin` - R 3.4.4 on Linux

- `test-350-cran-lin` - R 3.5.0 on Linux, no `r-recommended`

- `test-rel-win` - `r-release` on Windows

- `test-dev-win` - `r-devel` on Windows

- `test-old-win` - `r-oldrel` on Windows

- `test-rel-osx` - MacOSX build not yet deployed, see [#3326](https://github.com/Rdatatable/data.table/issues/3326) for status

- R packages repository for `data.table` and all _Suggests_ dependencies, url: `https://Rdatatable.gitlab.io/data.table`

- [CRAN-like checks results](https://rdatatable.gitlab.io/data.table/web/checks/check_results_data.table.html) - note that all artifacts, including check results page, are being published only when all test jobs successfully pass, thus one will not see an _ERROR_ status there (unless error happened on a job marked as `allow_failure`).

- [docker images](https://gitlab.com/Rdatatable/data.table/container_registry) - copy/paste-able `docker pull` commands can be found at the bottom of our [CRAN-like homepage](https://rdatatable.gitlab.io/data.table/web/packages/data.table/index.html)

Test jobs:

- `r-release` on Linux, includes code coverage check

- _(might be disabled)_ `r-release` on OSX

Artifacts:

- R packages repository having `data.table` sources only, url: `https://Rdatatable.github.io/data.table`

- code coverage stats pushed to [codecov.io/gh/Rdatatable/data.table](https://codecov.io/gh/Rdatatable/data.table)

Test jobs:

- Windows `r-release`

- _(might be disabled)_ Windows `r-devel`

Artifacts:

- Windows `r-release` binaries accessed only via web UI

Base R implemented helper script, [originally proposed to R](https://svn.r-project.org/R/branches/tools4pkgs/src/library/tools/R/packages.R), that ease the process of extracting dependency information from description files, also to mirror packages and their recursive dependencies from CRAN to local CRAN-like directory. It is widely used in our [GitLab CI pipeline](./../.gitlab-ci.yml).

Base R implemented helper script to orchestrate generation of most artifacts. It is being used only in [_integration_ stage in GitLab CI pipeline](./../.gitlab-ci.yml).

Template file to produce `Dockerfile` for, as of now, three docker images. Docker images are being built and published in [_deploy_ stage in GitLab CI pipeline](./../.gitlab-ci.yml).

- `r-base-dev` using `r-release`: publish docker image of `data.table` on R-release

- `r-builder` using `r-release`: publish on R-release and OS dependencies for building Rmarkdown vignettes

- `r-devel`: publish docker image of `data.table` on R-devel built with `--with-recommended-packages --enable-strict-barrier --disable-long-double`

Script used on Travis CI to publish CRAN-like repository of `data.table` sources. It publishes to `gh-pages` branch in GitHub repository. It depends on a token, which is provided based on `secure` environment variable in [.travis.yml](./../.travis.yml). It has been generated by @jangorecki.

if (as.logical(Sys.getenv("GITLAB_CI","false")) && identical(Sys.getenv("CI_PROJECT_NAME"), "data.table")) {

options("repos" = if (.Platform$OS.type == "windows") file.path("file://",getwd(),"bus/mirror-packages/cran") else file.path("file:", normalizePath("bus/mirror-packages/cran", mustWork=FALSE)))

}

r_devel_ver = Sys.getenv("R_DEVEL_VERSION")

r_oldrel_ver = Sys.getenv("R_OLDREL_VERSION")

stopifnot(nzchar(r_rel_ver), nzchar(r_devel_ver), nzchar(r_oldrel_ver))

sprintf("<tr><td> Windows binaries: </td><td> %s </td></tr>", format.bins(ver=c("r-devel","r-release","r-oldrel"), bin_ver=c(r_devel_ver, r_rel_ver, r_oldrel_ver), cran.home=cran.home, os.type="windows", pkg=pkg, version=version, repodir=repodir)),

sprintf("<tr><td> macOS binaries: </td><td> %s </td></tr>", format.bins(ver=c("r-release","r-oldrel"), bin_ver=c(r_rel_ver, r_oldrel_ver), cran.home=cran.home, os.type="macosx", pkg=pkg, version=version, repodir=repodir))

if (pkg=="data.table") { ## docker images

registry = Sys.getenv("CI_REGISTRY", "registry.gitlab.com")

namespace = Sys.getenv("CI_PROJECT_NAMESPACE", "Rdatatable")

project = Sys.getenv("CI_PROJECT_NAME", "data.table")

images = c("r-release","r-devel","r-release-builder")

images.title = c("Base R release", "Base R development", "R release package builder")

tags = rep("latest", 3)

docker.dl = sprintf("<tr><td> %s: </td><td> <pre><code>docker pull %s/%s/%s/%s:%s</code></pre> </td></tr>", images.title, tolower(registry), tolower(namespace), tolower(project), tolower(images), tags)

}

if (pkg=="data.table")

c("<h4>Docker images:</h4>",

sprintf("<table summary=\"Package %s docker images\">", pkg),

docker.dl,

"</table>"),

lib.dirs<-intersect(c("html","doc"), all.lib.dirs<-list.dirs(pkg.from, full.names=FALSE))

if (length(tmp) < 2L) stop("test job names must be test-[r.version]-...")

v = tmp[2L]

if (grepl("\\D", v)) stop("second word in test job name must be rel/dev/old or numbers of R version")

dcf = read.dcf(file.path("bus", job, paste(pkg, "Rcheck", sep="."), pkg, "DESCRIPTION"))

dcf = read.dcf(file.path("bus", job, paste(pkg, "Rcheck", sep="."), pkg, "DESCRIPTION"))

cc = file.path("bus", job, paste(pkg, "Rcheck", sep="."), pkg, "cc") ## data.table style cc file

th = "<th>Flavor</th><th>Version</th><th>Revision</th><th>Install</th><th>Status</th><th>Flags</th><th>Rout.fail</th><th>Memtest</th>"

"<tr><td><a href=\"check_flavors.html\">%s</a></td><td>%s</td><td>%s</td><td><a href=\"%s/%s/00install.out\">out</a></td><td><a href=\"%s/%s/00check.log\">%s</a></td><td>%s</td><td>%s</td><td>%s</td></tr>",

sub("test-", "", jobs, fixed=TRUE),

sapply(jobs, pkg.version, pkg),

sapply(jobs, pkg.revision, pkg),

pkg, jobs, ## install

pkg, jobs, sapply(sapply(jobs, check.test, pkg="data.table"), status), ## check

sapply(jobs, pkg.flags, pkg),

mapply(test.files, jobs, routs, trim.exts=2L), # 1st fail, 2nd Rout, keep just: tests_x64/main

mapply(test.files, jobs, memouts, trim.name=TRUE)

move.bin <- function(job, bin.version, os.type, file="DESCRIPTION", silent=FALSE) {