Some Issues with Extension of an HPC Cluster
Authors: Pil Seong Park
Homemade HPC clusters are widely used in many small labs, because they are easy to build and cost-effective. Even though incremental growth is an advantage of clusters, it results in heterogeneous systems anyhow. Instead of adding new nodes to the cluster, we can extend clusters to include some other Internet servers working independently on the same LAN, so that we can make use of their idle times, especially during the night. However extension across a firewall raises some security problems with NFS. In this paper, we propose a method to solve such a problem using SSH tunneling, and suggest a modified structure of the cluster that implements it.
Digital Object Identifier (DOI): doi.org/10.5281/zenodo.1092958Procedia APA BibTeX Chicago EndNote Harvard JSON MLA RIS XML ISO 690 PDF Downloads 1477
 M. Baker and R. Buyya, "Cluster Computing: the commodity supercomputer”, Software-Practice and Experience, vol.29(6), 1999, pp.551-576.
 M. Dusi, F. Gringoli, and L. Salgarelli, "A Preliminary Look at the Privacy of SSH Tunnels”, in Proc. 17th International Conference on Computer Communications and Networks(ICCCN '08), 2008.
 M. Eggen, N. Franklin, and R. Eggen, "Load Balancing on a Non-dedicated Heterogeneous Network of Workstations.” in International Conference on Parallel and Distributed Processing Techniques and Applications (PDPTA 2002), June 2002.
 J. Faik, L. G. Gervasio, J. E. Flaherty, J. Chang, J. D. Teresco, E.G. Boman, and K. D. Devine, "A model for resource-aware load balancing on heterogeneous clusters”, Tech. Rep. CS-03-03, Williams College Dept. of Computer Science, http://www.cs.williams.edu/drum/, 2003.
 I. Galindo, F. Almeida, and J. M. Badia-Contelles, "Dynamic Load Balancing on Dedicated Heterogeneous Systems”, Recent Advances in Parallel Virtual Machine and Message Passing Interface, Lecture Notes in Computer Science, vol.5205, 2008, pp 64-74
 G. A. Geist, A. Beguelin, J. J. Dongarra, W. Jiang, R. Manchek, and V. S. Sunderam, PVM: Parallel Virtual Machine: A Users’ Guide and Tutorial for Networked Parallel Computing. MIT Press, Cambridge, MA, USA 1994.
 O. Honda, H. Ohsaki, M. Imase, M. Ishizuka, and J. Murayama, "Understanding TCP over TCP: Effects of TCP tunneling on end-to-end throughput and latency," in Proc. 2005 OpticsEast/ITCom, Oct. 2005.
 L. V. Kale, M. Bhandarkar, and R. Brunner, "Run-time Support for Adaptive Load Balancing”, in Lecture Notes in Computer Science, Proc. 4th Workshop on Runtime Systems for Parallel Programming (RTSPP) Cancun – Mexico, Vol. 1800, 2000, pp.1152-1159.
 K. Lu, R. Subrata, and A. Y. Zomaya, "On the performance-driven load distribution for heterogeneous computational grids”, J. of Computer and System Sciences vol.73, 2007, pp.1191-1206.
 A. I. Margaris, "Local Area Multicomputer (LAM-MPI)”, J. Computer and Information Science, Vol.6(2), 2013, pp.1-8.
 M. Snir, S. Otto, S. Huss-Lederman, D. Walker, and J. J. Dongarra, MPI: The Complete Reference. MIT Press, Cambridge, MA, USA, 1996.
 M. Zaki, W. Li, and S. Parthasarathy, "Customized Dynamic Load Balancing in a Heterogeneous Network of Workstations”, in 1996 Proc. 5th IEEE Int. Symposium on High Performance Distributed Computing.
 Berkeley NOW Project, http://now.cs.berkeley.edu/
 Clustered file system, http://en.wikipedia.org/wiki/Clustered_file_system
 LAM/MPI Parallel Computing, http://www.lam-mpi.org/
 Linux NFS-HOWTO, http://nfs.sourceforge.net/nfs-howto/
 Linux NFS Overview, FAQ and HOWTO, http://nfs.sourceforge.net/
 Open MPI, http://www.open-mpi.org
 Port Forwarding Using SSH Tunnel, http://www.fclose.com/b/linux/818/port-forwarding-using-ssh-tunnel/
 ssh-keygen: password-less SSH login http://rcsg-gsir.imsb-dsgi.nrc-cnrc.gc.ca/documents/internet/node31.html
 http://www.linuxquestions.org/questions/linux -security-4/firewall-blocking-nfs-even-though-ports-are-open-294069/