The Internals of Spark Structured Streaming (Apache Spark 2.4.1)

Welcome to The Internals of Spark Structured Streaming gitbook! I’m very excited to have you here and hope you will enjoy exploring the internals of Spark Structured Streaming as much as I have.

I write to discover what I know.
— Flannery O'Connor

I’m Jacek Laskowski, a freelance IT consultant, software engineer and technical instructor specializing in Apache Spark, Apache Kafka and Kafka Streams (with Scala and sbt).

I offer software development and consultancy services with hands-on in-depth workshops and mentoring. Reach out to me at or @jaceklaskowski to discuss opportunities.

Consider joining me at Warsaw Scala Enthusiasts and Warsaw Spark meetups in Warsaw, Poland.

Expect text and code snippets from a variety of public sources. Attribution follows.

Now, let me introduce you to Spark Structured Streaming.

results matching ""

    No results matching ""