The Internals of Spark Structured Streaming (Apache Spark 2.4.0)
Welcome to The Internals of Spark Structured Streaming gitbook! I’m very excited to have you here and hope you will enjoy exploring the internals of Spark Structured Streaming as much as I have.
I write to discover what I know.
I’m Jacek Laskowski, an independent consultant, software developer and technical instructor specializing in Apache Spark, Apache Kafka and Kafka Streams (with Scala, sbt, Kubernetes, DC/OS, Apache Mesos, and Hadoop YARN).
|I’m also writing Mastering Apache Spark 2, Mastering Spark SQL, Mastering Kafka Streams, and Apache Kafka Notebook gitbooks.|
Expect text and code snippets from a variety of public sources. Attribution follows.
Now, let me introduce you to Spark Structured Streaming.