Using Computing Containers and Continuous Integration to Improve Numerical Research Reproducibility

  • Alexey Vasyukov Moscow Institute of Physics and Technology, Institutsky lane 9, Dolgoprudny, 141701, Russia
  • Igor Petrov Moscow Institute of Physics and Technology, Institutsky lane 9, Dolgoprudny, 141701, Russia
Keywords: linux containers, docker, cloud computing, continuous integration, research reproducibility.

Abstract

Cloud computing has opened new options of collaboration between research teams in the field of high performance computing and numerical research. Running computational workloads in virtual machines became common in recent years. However, the use of computing containers provides many additional advantages besides just proving new possible runtime choice. One of the most important (and often underappreciated) is an option to improve the reproducibility of research results based on complex mathematical modeling. This paper provides an overview of architecture based on computing containers and continuous integration tools we used to achieve reproducible numerical results

References

. U. Markwardt. “Running Virtual Machines in a Slurm Batch System”, presented at Slurm User Group Meeting, Washington DC, USA, 2015. [On-line]. Available: http://slurm.schedmd.com/SLUG15/SlurmVM.pdf [June 01, 2018].

. W. Felter, A. Ferreira, R. Rajamony, J. Rubio. "IBM Research Report. Performance Comparison of Virtual Machines and Linux Containers." [On-line]. Available: http://domino.research.ibm.com/library/cyberdig.nsf/papers/0929052195DD819C85257D2300681E7B/$File/rc25482.pdf [June 01, 2018].

. C. Kniep. "Containerization of High Performance Compute Workloads using Docker." [On-line]. Available: http://doc.qnib.org/2014-11-05_Whitepaper_Docker-MPI-workload.pdf [June 01, 2018].

J. Cito, V. Ferme, H.C. Gall. "Using Docker Containers to Improve Reproducibility in Software and Web Engineering Research." in Web Engineering. ICWE 2016. Lecture Notes in Computer Science, vol. 9671. A. Bozzon, P. Cudre-Maroux, C. Pautasso (eds). Springer, 2016.

L.H. Hung, D. Kristiyanto, S.B. Lee, K.Y. Yeung. "GUIdock: Using Docker containers with a common graphics user interface to address the reproducibility of research." PLoS One, 11(4):e0152686, 2016.

A. Ermakov, A. Vasyukov “Testing Docker Performance for HPC Applications” IOSR Journal of Computer Engineering, vol. 20, pp. 36-43, 2018.

Published
2018-07-01
How to Cite
Vasyukov, A., & Petrov, I. (2018). Using Computing Containers and Continuous Integration to Improve Numerical Research Reproducibility. International Journal of Computer (IJC), 30(1), 27-33. Retrieved from https://ijcjournal.org/index.php/InternationalJournalOfComputer/article/view/1249
Section
Articles