BasicWriteJobStatsTracker is a concrete WriteJobStatsTracker.

BasicWriteJobStatsTracker is created when DataWritingCommand and Spark Structured Streaming’s FileStreamSink are requested for one.

When requested for a new WriteTaskStatsTracker, BasicWriteJobStatsTracker creates a new BasicWriteTaskStatsTracker.

Creating BasicWriteJobStatsTracker Instance

BasicWriteJobStatsTracker takes the following when created:

  • Serializable Hadoop Configuration

  • Metrics (Map[String, SQLMetric])

results matching ""

    No results matching ""