Enabling Automated Deployment for Cluster Computing in Distributed PC Classrooms

Authors: Shuen-Tai Wang, Ying-Chuan Chen, Hsi-Ya Chang

Abstract:

The rapid improvement of the microprocessor and network has made it possible for the PC cluster to compete with conventional supercomputers. Lots of high throughput type of applications can be satisfied by using the current desktop PCs, especially for those in PC classrooms, and leave the supercomputers for the demands from large scale high performance parallel computations. This paper presents our development on enabling an automated deployment mechanism for cluster computing to utilize the computing power of PCs such as reside in PC classroom. After well deployment, these PCs can be transformed into a pre-configured cluster computing resource immediately without touching the existing education/training environment installed on these PCs. Thus, the training activities will not be affected by this additional activity to harvest idle computing cycles. The time and manpower required to build and manage a computing platform in geographically distributed PC classrooms also can be reduced by this development.

Keywords: PC cluster, automated deployment, cluster computing, PC classroom.

Digital Object Identifier (DOI): doi.org/10.5281/zenodo.1055725

References:

[1] R. Buyya (ed.), "High Performance Cluster Computing: Systems and Architectures," Prentice Hall, 1999.
[2] C. Reschke, T. Sterling, D. Ridge, D. Savarse, D. Becker, P. Merkey, "A Design Study of Alternative Network Topologies for the Beowulf Parallel Workstation," Proceedings of the Fifth IEEE International Symposium on High Performance Distributed Computing, (1996).
[3] T. Sterling, D. Becker, and D. Savarese,"Beowulf: A Parallel Workstation for Scientific Computation," Proceedings of the Fourth 1995 International Conference on Parallel Processing (ICPP), Vol. 1, pp.111-14 (1995).
[4] A. Apon, R. Buyya, H. Jin, and J. Mache, "Cluster Computing in the Classroom: Topics, Guidelines, and Experiences"
[5] Message Passing Interface Forum, "MPI: A message-passing interface standard," International Journal of Supercomputer Applications 8 (3/4) (1994) 165-414
[6] P. M. Papadopoulous, M. J. Katz, and G. Bruno, "NPACI Rocks: Tools and techniques for easily deploying manageable Linux clusters," In IEEE Cluster 2001, October 2001.
[7] P. Uthayopas, T. Angsakul, and J. Maneesilp. "System management framework and tools for beowulf cluster," In Proceedings of HPCAsia2000, Beijing, May 2000.
[8] Open Cluster Group, "OSCAR: A packaged cluster software stack for high performance computing," http://www.openclustergroup.org.
[9] C. Y. Tu, W. C. Kuo, Y. T. Wang, Steven Shiau, "E2CC: Building energy efficient ClassCloud using DRBL," in Grid '09: Proceedings of the 10th annual international conferenceon Grid Computing. Banff, AB, Canada: IEEE Computer Society, 2009, pp. 189-195.
[10] P. Barham, B. Dragovic, K. Fraser, S. Hand, T. Harris, A. Ho, R. Neugebauer, I. Pratt, and A. Warfield, "Xen and the Art of Virtualization," In Proc. 19th SOSP, Lake George, NY, Oct 2003.
[11] PXELINUX, http://syslinux.zytor.com/wiki/index.php/PXELINUX.
[12] NCHC, National Center for High-performance Computing, http://www.nchc.org.tw
[13] Wake-on-LAN, http://en.wikipedia.org/wiki/Wake-on-LAN
[14] TORQUE Resource Manager, http://www.clusterresources.com/products/torque-resource-manager.ph.
[15] I. Foster, C. Kesselman, S. Tuecke, "The Anatomy of the Grid: Enabling Scalable Virtual Organisations'," International Journal of High Performance Computing Applications, 15 (3). p. 200-222. 2001
[16] P. Armstrong, “Building a Scheduler Adapter for the GridWay Metascheduler,” Faculty of Engineering Summer 2006 Work Term Report
[17] I. Foster and C. Kesselman, “Globus: A Metacomputing Infrastructure Toolkit,” International Journal of Supercomputer Applications 11 2 (1997), pp. 115-128.
[18] The Globus Project: the GridFTP protocol, http://www.globus.org/datagrid/gridftp.html.
[19] A. Petitet, R. C. Whaley, J. J. Dongarra, and A. Cleary. “HPL - A Portable Implementation of the High-performance Linpack Benchmark for Distributed Memory Computers,” Available: http://www.netlib.org/benchmark/hpl/
[20] Siraya Cluster, Available: http://siraya.sro.nchc.org.tw/