Learning storm : create real-time stream processing applications with apache storm /: create real-time stream processing applications with apache storm. (2014)

• Record Type: Book
• Further Information: Note: Ankit Jain, Anand Nalya ; cover image by Pratyush Mohanta.
• Authors: Jain, Ankit; Nalya, Anand
• Other Names: Mohanta, Pratyush cover designer.
• Contents: Cover; Copyright; Credits; About the Authors; About the Reviewers; www.PacktPub.com; Table of Contents; Preface; Chapter 1: Setting Up Storm on a Single Machine; Features of Storm; Storm components; Nimbus; Supervisor nodes; The ZooKeeper cluster; The Storm data model; Definition of a Storm topology; Operation modes; Setting up your development environment; Installing Java SDK 6; Installing Maven; Installing Git -- distributed version control; Installing the STS IDE; Developing a sample topology; Setting up ZooKeeper; Setting up Storm on a single development machine. Deploying the sample topology on a single-node clusterSummary; Chapter 2: Setting Up a Storm Cluster; Setting up a ZooKeeper cluster; Setting up a distributed Storm cluster; Deploying a topology on a remote Storm cluster; Deploying the sample topology on the remote cluster; Configuring the parallelism of a topology; The worker process; The executor; Tasks; Configuring parallelism at the code level; Distributing worker processes, executors, and tasks in the sample topology; Rebalancing the parallelism of a topology; Rebalancing the parallelism of the sample topology; Stream grouping. Shuffle groupingFields grouping; All grouping; Global grouping; Direct grouping; Local or shuffle grouping; Custom grouping; Guaranteed message processing; Summary; Chapter 3: Monitoring the Storm Cluster; Starting to use the Storm UI; Monitoring a topology using the Storm UI; Cluster statistics using the Nimbus thrift client; Fetching information with the Nimbus thrift client; Summary; Chapter 4: Storm and Kafka Integration; The Kafka architecture; The producer; Replication; Consumers; Brokers; Data retention; Setting up Kafka; Setting up a single-node Kafka cluster. Setting up a three-node Kafka clusterRunning multiple Kafka brokers on a single node; A sample Kafka producer; Integrating Kafka with Storm; Summary; Chapter 5: Exploring High-level Abstraction in Storm with Trident; Introducing Trident; Understanding Trident''s data model; Writing Trident functions, filters, and projections; Trident functions; Trident filters; Trident projections; Trident repartitioning operations; The shuffle operation; The partitionBy operation; The global operation; The broadcast operation; The batchGlobal operation; The partition operation; Trident aggregators. The partition aggregateThe aggregate; The ReducerAggregator interface; The Aggregator interface; The CombinerAggregator interface; The persistent aggregate; Aggregator chaining; Utilizing the groupBy operation; A non-transactional topology; A sample Trident topology; Maintaining the topology state with Trident; A transactional topology; The opaque transactional topology; Distributed RPC; When to use Trident; Summary; Chapter 6: Integration of Storm with Batch Processing Tools; Exploring Apache Hadoop; Understanding HDFS; Understanding YARN; Installing Apache Hadoop.
• Publisher Details: Birmingham, England : Packt Publishing Ltd
• Publication Date: 2014
• Copyright Date: 2014
• Extent: 1 online resource (252 pages), illustrations
• Subjects: 005.7136; COMPUTERS -- Web -- Web Programming; Telecommunication -- Message processing; Application software -- Programming; Fault-tolerant computing; Electronic data processing; COMPUTERS -- Web -- Web Services & APIs; COMPUTERS -- Data Processing; Electronic books
• Languages: English
• ISBNs: 9781783981335; 1783981334; 1783981326; 9781783981328
• Related ISBNs: 9781783981328
• Notes: Note: Online resource; title from PDF title page (ebrary, viewed September 4, 2014).
• Access Rights: Legal Deposit; Only available on premises controlled by the deposit library and to one user at any one time; The Legal Deposit Libraries (Non-Print Works) Regulations (UK).
• Access Usage: Restricted: Printing from this resource is governed by The Legal Deposit Libraries (Non-Print Works) Regulations (UK) and UK copyright law currently in force.