We’re running an open source build system (caffe 2 and pytorch) and looking at switching from Jenkins to another CI, as we’re having too many issues with Jenkins.
Each GitHub PR triggers a large number of builds, e.g. one for each python version, one for each each cuda version, one for each nvidia driver version, one for Linux, MacOS & Windows, etc. So the total number of combinations is huge. On top of that we run performance regression tests, and each time a PR is merged, we trigger new builds for all pending PRs.
We have configured EC2 auto-scaling groups for the different workers types (GPU & CPU), so we can handle peak load builds in a reasonable time.
This functionality we’d like to retain, but not have to deal with all Jenkins issues Does this sound like a good fit for Concourse?
And how does Concourse deal with MacOS & Windows builds?