Big Brain: A Single Database System for a Federated Data Warehouse Architecture

Authors: X. Gumara Rigol, I. Martínez de Apellaniz Anzuola, A. Garcia Serrano, A. Franzi Cros, O. Vidal Calbet, A. Al Maruf

Abstract:

Traditional federated architectures for data warehousing work well when corporations have existing regional data warehouses and there is a need to aggregate data at a global level. Schibsted Media Group has been maturing from a decentralised organisation into a more globalised one and needed to build both some of the regional data warehouses for some brands at the same time as the global one. In this paper, we present the architectural alternatives studied and why a custom federated approach was the notable recommendation to go further with the implementation. Although the data warehouses are logically federated, the implementation uses a single database system which presented many advantages like: cost reduction and improved data access to global users allowing consumers of the data to have a common data model for detailed analysis across different geographies and a flexible layer for local specific needs in the same place.

Keywords: Data integration, data warehousing, federated architecture, online analytical processing.

Digital Object Identifier (DOI): doi.org/10.5281/zenodo.1474733

References:

[1] T. H. Davenport, D. Cohen, A. Jacobson. Competing on Analytics. BABSON Executive Education (May 2005) http://www.babsonknowledge.org/analytics.pdf.
[2] M. Schneider. Integrated Vision of Federated Data Warehouses. Data Integration and the Semantic Web (Luxembourg, June 2006).
[3] R. Jindal, A. Acharya. Federated Data Warehouse Architecture. WIPRO (accessed September 2017) http://hosteddocs.ittoolbox.com/Federated%20data%20Warehouse%20Architecture.pdf.
[4] S. Berger, M. Schrefl. From Federated Databases to a Federated Data Warehouse System. Proceedings of the 41st Hawaii International Conference on System Sciences (2008).
[5] W. H. Inmon. Building the Data Warehouse. Wiley Publishing Inc. (1996).
[6] Tableau Software http://www.tableausoftware.com.