Скачать или смотреть Spark Streaming Course Intro

This is the first video of our upcoming spark streaming series. Here we have discussed the topic that we will be covering in the upcoming videos.

List of topics.

1. What is Real-time Processing?

2. Importance of Real-time Processing with one Example.

3. Batch Processing vs Real-time Stream Processing

4. What is Spark Streaming?

5. DStream, RDD, Messages/Records

6. What is the batch duration?

7. Different types of Producer in Streaming.

8. Difference b/w all these producers.

9. Understanding Spark Streaming by a simple program

10. Stateless vs Stateful transformation

11. Different transformations to demonstrate the
difference between stateless & stateful transformation.

12. ReduceByKey vs updateStateByKey

13. Window time and Sliding Interval

14. E.g to understand the Sliding Interval concept

15. ReduceByKeyAndWindow & reduceByWindow

16. CountByWindow

17. Join in Streaming

18. Stream-Stream Join

19. Stream-dataset join

20. Output operation in Streaming

21. Spark Streaming and Kafka Intergation.

22. One End to End project with Spark Streaming, MongoDB, Kafka

#apachespark #streaming #bigdata