Distributed Computing to Blockc Rajiv Pandey

This book represents the combined peer-reviewed proceedings of the Fifth International Symposium on Intelligent Distributed Computing – IDC 2011 and of the Third International Workshop on Multi-Agent Systems Technology and Semantics – MASTS 2011. Both events were held in Delft, The Netherlands during October 5-7, 2011.

This timely text/reference describes the development and implementation of large-scale distributed processing systems using open source tools and technologies. Comprehensive in scope, the book presents state-of-the-art material on building high performance distributed computing systems, providing practical guidance and best practices as well as describing theoretical software frameworks. Features: describes the fundamentals of building scalable software systems for large-scale data processing in the new paradigm of high performance distributed computing; presents an overview of the Hadoop ecosystem, followed by step-by-step instruction on its installation, programming and execution; Reviews the basics of Spark, including resilient distributed datasets, and examines Hadoop streaming and working with Scalding; Provides detailed case studies on approaches to clustering, data classification and regression analysis; Explains the process of creating a working recommender system using Scalding and Spark.