Real-Time Streaming with Apache Kafka, Spark, and Storm
eBook - ePub

Real-Time Streaming with Apache Kafka, Spark, and Storm

Create Platforms That Can Quickly Crunch Data and Deliver Real-Time Analytics to Users

  1. English
  2. ePUB (mobile friendly)
  3. Available on iOS & Android
eBook - ePub

Real-Time Streaming with Apache Kafka, Spark, and Storm

Create Platforms That Can Quickly Crunch Data and Deliver Real-Time Analytics to Users

Book details
Table of contents
Citations

About This Book

Build a platform using Apache Kafka, Spark, and Storm to generate real-time data insights and view them through Dashboards.

Key Features
? Extensive practical demonstration of Apache Kafka concepts, including producer and consumer examples.
? Includes graphical examples and explanations of implementing Kafka Producer and Kafka Consumer commands and methods.
? Covers integration and implementation of Spark-Kafka and Kafka-Storm architectures.

Description
Real-Time Streaming with Apache Kafka, Spark, and Storm is a book that provides an overview of the real-time streaming concepts and architectures of Apache Kafka, Storm, and Spark. The readers will learn how to build systems that can process data streams in real time using these technologies. They will be able to process a large amount of real-time data and perform analytics or generate insights as a result of this.The architecture of Kafka and its various components are described in detail. A Kafka Cluster installation and configuration will be demonstrated. The Kafka publisher-subscriber system will be implemented in the Eclipse IDE using the Command Line and Java. The book discusses the architecture of Apache Storm, the concepts of Spout and Bolt, as well as their applications in a Transaction Alert System. It also describes Spark's core concepts, applications, and the use of Spark to implement a microservice. To learn about the process of integrating Kafka and Storm, two approaches to Spark and Kafka integration will be discussed.This book will assist a software engineer to transition to a Big Data engineer and Big Data architect by providing knowledge of big data processing and the architectures of Kafka, Storm, and Spark Streaming.

What you will learn
? Creation of Kafka producers, consumers, and brokers using command line.
? End-to-end implementation of Kafka messaging system with Java in Eclipse.
? Perform installation and creation of a Storm Cluster and execute Storm Management commands.
? Implement Spouts, Bolts and a Topology in Storm for Transaction alert application system.

Who this book is for
This book is intended for Software Developers, Data Scientists, and Big Data Architects who want to build software systems to process data streams in real time. To understand the concepts in this book, knowledge of any programming language such as Java, Python, etc. is needed.

Table of Contents
1. Introduction to Kafka
2. Installing Kafka
3. Kafka Messaging
4. Kafka Producers
5. Kafka Consumers
6. Introduction to Storm
7. Installation and Configuration
8. Spouts and Bolts
9. Introduction to Spark
10. Spark Streaming
11. Kafka Integration with Storm
12. Kafka Integration with Spark

About the Authors
Brindha Priyadarshini Jeyaraman has more than 12+ years of work experience in Software Development and building Data analytics systems. She has completed her M.Tech in Knowledge Engineering with a gold medal from the National University of Singapore. She is an expert in understanding business problems, designing, and implementing solutions using Machine Learning. She has a strong software development background with extensive experience in implementing data analytics systems. She has worked on several Data Science projects in Transportation, E-commerce, Healthcare, Insurance, Banking and Finance Domains. She has completed her SCJP and SCWCD certifications. LinkedIn Profile: https://www.linkedin.com/in/brindha-jeyaraman-75347922/

Frequently asked questions

Simply head over to the account section in settings and click on “Cancel Subscription” - it’s as simple as that. After you cancel, your membership will stay active for the remainder of the time you’ve paid for. Learn more here.
At the moment all of our mobile-responsive ePub books are available to download via the app. Most of our PDFs are also available to download and we're working on making the final remaining ones downloadable now. Learn more here.
Both plans give you full access to the library and all of Perlego’s features. The only differences are the price and subscription period: With the annual plan you’ll save around 30% compared to 12 months on the monthly plan.
We are an online textbook subscription service, where you can get access to an entire online library for less than the price of a single book per month. With over 1 million books across 1000+ topics, we’ve got you covered! Learn more here.
Look out for the read-aloud symbol on your next book to see if you can listen to it. The read-aloud tool reads text aloud for you, highlighting the text as it is being read. You can pause it, speed it up and slow it down. Learn more here.
Yes, you can access Real-Time Streaming with Apache Kafka, Spark, and Storm by Brindha Priyadarshini Jeyaraman in PDF and/or ePUB format, as well as other popular books in Computer Science & Data Processing. We have over one million books available in our catalogue for you to explore.

Information

Publisher
BPB Publications
Year
2021
ISBN
9789390684595
Topic
Computer Science
Subtopic
Data Processing
Index
Computer Science

Table of contents

  1. Cover Page
  2. Title Page
  3. Copyright Page
  4. Dedication Page
  5. About the Author
  6. About the Reviewer
  7. Acknowledgement
  8. Preface
  9. Errata
  10. Table of Contents
  11. 1. Introduction to Kafka
  12. 2. Installing Kafka
  13. 3. Kafka Messaging
  14. 4. Kafka Producers
  15. 5. Kafka Consumers
  16. 6. Introduction to Storm
  17. 7. Installation and Configuration of Storm
  18. 8. Spouts and Bolts
  19. 9. Introduction to Spark
  20. 10. Spark Streaming
  21. 11. Kafka Integration with Spark
  22. 12. Kafka Integration with Storm
  23. Index