Using Computing Containers and Continuous Integration to Improve Numerical Research Reproducibility
Keywords:
linux containers, docker, cloud computing, continuous integration, research reproducibility.Abstract
Cloud computing has opened new options of collaboration between research teams in the field of high performance computing and numerical research. Running computational workloads in virtual machines became common in recent years. However, the use of computing containers provides many additional advantages besides just proving new possible runtime choice. One of the most important (and often underappreciated) is an option to improve the reproducibility of research results based on complex mathematical modeling. This paper provides an overview of architecture based on computing containers and continuous integration tools we used to achieve reproducible numerical results
References
. U. Markwardt. “Running Virtual Machines in a Slurm Batch System”, presented at Slurm User Group Meeting, Washington DC, USA, 2015. [On-line]. Available: http://slurm.schedmd.com/SLUG15/SlurmVM.pdf [June 01, 2018].
. W. Felter, A. Ferreira, R. Rajamony, J. Rubio. "IBM Research Report. Performance Comparison of Virtual Machines and Linux Containers." [On-line]. Available: http://domino.research.ibm.com/library/cyberdig.nsf/papers/0929052195DD819C85257D2300681E7B/$File/rc25482.pdf [June 01, 2018].
. C. Kniep. "Containerization of High Performance Compute Workloads using Docker." [On-line]. Available: http://doc.qnib.org/2014-11-05_Whitepaper_Docker-MPI-workload.pdf [June 01, 2018].
J. Cito, V. Ferme, H.C. Gall. "Using Docker Containers to Improve Reproducibility in Software and Web Engineering Research." in Web Engineering. ICWE 2016. Lecture Notes in Computer Science, vol. 9671. A. Bozzon, P. Cudre-Maroux, C. Pautasso (eds). Springer, 2016.
L.H. Hung, D. Kristiyanto, S.B. Lee, K.Y. Yeung. "GUIdock: Using Docker containers with a common graphics user interface to address the reproducibility of research." PLoS One, 11(4):e0152686, 2016.
A. Ermakov, A. Vasyukov “Testing Docker Performance for HPC Applications” IOSR Journal of Computer Engineering, vol. 20, pp. 36-43, 2018.
Downloads
Published
How to Cite
Issue
Section
License
Authors who submit papers with this journal agree to the following terms.