课件大数据-学习gate.pptxVIP

Real time Analytics with Apache Kafka and SparkOctober 2014 MeetupOrganized by Big Data Hyderabad. ;About Me;Quick Questionnaire;What we are going to learn/see today ? ;Apache Zookeeper TM;What is Zookeeper;Zookeeper Use cases;Zookeeper Data Model;Let’s recall basic concepts ofMessaging System;Point to Point Messaging (Queue);Publish-Subscribe Messaging (Topic);Apache Kafka;Overview;How it works;Real time transfer;Performance Numbers;About Apache Spark;So Why Spark ?;Spark Stack;Execution Flow;Terminology;Terminology (contd.);Resilient Distributed Dataset (RDD);Cluster Deployment;Monitoring;;Let’s start getting hands dirty;Kafka Installation;Start Servers;Create/List Topics;Producer;Consumer;Multi-Broker Cluster;Start with New Nodes;Let’s move to Apache Spark;Spark Shell;scala textFile.count() // Number of items in this RDD ees0: Long = 126 scala textFile.first() // First item in this RDD res1: String = # Apache Spark ;Map - Reduce;With Caching…;With HDFS…;Standalone (Scala);Standalone (Java);Job Submission;Configuration;Let’s discuss Real-time Clickstream Analytics;Analytics High Level Flow;Spark Streaming;Support Multiple Input/Outputs;Streaming Flow;Spark Streaming Terminology;Spark Context;Reading from Kafka Stream;Processing of Stream;Thanks!@rahuldausa on twitter and slideshare