The Internals of Spark SQL (Apache Spark 2.4.1)

Welcome to The Internals of Spark SQL gitbook! I’m very excited to have you here and hope you will enjoy exploring the internals of Spark SQL as much as I have.

I write to discover what I know.
— Flannery O'Connor

I’m Jacek Laskowski, an independent consultant, software developer and technical instructor specializing in Apache Spark, Apache Kafka and Kafka Streams (with Scala, sbt, Kubernetes, DC/OS, Apache Mesos, and Hadoop YARN).

I offer software development and consultancy services with very hands-on in-depth workshops and mentoring. Reach out to me at or @jaceklaskowski to discuss opportunities.

Consider joining me at Warsaw Scala Enthusiasts and Warsaw Spark meetups in Warsaw, Poland.

Expect text and code snippets from a variety of public sources. Attribution follows.

Now, let me introduce you to Spark SQL.

results matching ""

    No results matching ""