In this article, we present JUWELS Booster, a recently commissioned high-performance computing system at the Jülich Supercomputing Center. With its architecture, most importantly large number of powerful Graphics Processing Units (GPUs) and fast interconnect via InfiniBand, it is an ideal machine for large-scale Artificial Intelligence (AI) research applications. We detail parallel, distributed...