Architecture of Large-Scale Systems

Authors: Arne Koschel, Irina Astrova, Elena Deutschkämer, Jacob Ester, Johannes Feldmann

Abstract:

In this paper various techniques in relation to large-scale systems are presented. At first, explanation of large-scale systems and differences from traditional systems are given. Next, possible specifications and requirements on hardware and software are listed. Finally, examples of large-scale systems are presented.

Keywords: Distributed file systems, cashing, large scale systems, MapReduce algorithm, NoSQL databases.

Digital Object Identifier (DOI): doi.org/10.5281/zenodo.1089020

References:

[1] D. Masak, "SOA?: Serviceorientierung in Business und Software” Springer, 2007.
[2] S. Edlich, A. Friedland, J. Hampe, B. Brauer, „NoSQL - Einstieg in die Welt nichtrelationaler Web 2.0 Datenbanken 2010", Hanser, 2007.
[3] F. Chang, J. Dean, S. Ghemawat, W. Hsieh, D. Wallach, M. Burrows, T. Chandra, A. Fike, R. Gruber, "Bigtable: A Distributed Storage System for Structured Data”, Goole Inc., 2006.
[4] http://www.oser.org/~hp/bsyII/node6.html, "Skalierbarkeit”, 2007.
[5] http://blog.namics.com/2009/05/skalierbare-dat.htm, „Skalierbare Datenbanksysteme: ACID versus BASE", 2009.
[6] http://nosql-database.org/, "NoSQL - Your Ultimate Guide to the Non - Relational Universe!”, 2011.
[7] http://www.heise.de/open/artikel/NoSQL-im-Ueberblick-1012483.html, „NoSQL im Überblick", 2010.
[8] http://www.gi.de/service/informatiklexikon/informatiklexikon-detailansicht/meldung/spaltenorientierte-datenbanken-267.html, „Spaltenorientierte Datenbanken", 2010.
[9] http://eliteinformatiker.de/2011/05/18/nosql-document-store-couchdb-mongodb/, „NoSQL: Dokumentenorientierte Datenbanken (CouchDB, MongoDB)”, 2011.
[10] Cloud Computing: Web-basierte dynamische IT-Services (Informatik im Fokus) , 2. Auflage, Springer ,ISBN 978-3-642-18435-2.
[11] "Scaling memcached at Facebook”, Paul Saab, December 2008, Facebook Engineering, http://www.facebook.com/ note.php?note_id=39391378919.
[12] Oliver Fischer, "MapReduce: Programmiermodell und Framework”, April 2010, http://www.heise.de/developer/artikel/Programmiermodell-und-Framework-964823.html.
[13] "Playfish's Social Gaming Architecture - 50 Million Monthly Users And Growing”, http://highscalability.com/blog/2010/9/21/playfishs-social-gaming-architecture-50-million-monthly-user.html, 2010.
[14] Richard P. Gabriel, "Can’t Be Built” IBM Research, 2007.
[15] Eeles2008, Peter Eeles, Presentaion on "Architecting Large-Scale Systems, IBM, 2008.
[16] Paul Saab, "Scaling memcached at Facebook”, 2008, via Facebook.com
[17] Brad Fitzpatrick , "Distributed Caching with Memcached”, 2004, on http://www.linuxjournal.com/article/7451?page=0,1.
[18] Realtime Hadoop usage at Facebook: The Complete Story, Dhruba Borthakur, http://hadoopblog.blogspot.com/search/label/ hadoop%20and%20facebook.
[19] Sanjay Ghemawat, Howard Gobioff, and Shun-Tak Leung,” The Google File System”, Google Coorp., 2003.
[20] Facebook: Science and the social Graph, Aditya Agarwal, May 2009, http://www.infoq.com/presentations/Facebook-Software-Stack.
[21] AmazonStatistics; Jeff Barr, "Amazon S3 Blog” July 2011 http://aws.typepad.com/aws/2011/07/amazon-s3-more-than-449-billion-objects.html.