SinkFileStatus

SinkFileStatus represents the status of files of FileStreamSink (and the type of the metadata of FileStreamSinkLog):

  • Path

  • Size

  • isDir flag

  • Modification time

  • Block replication

  • Block size

  • Action (either add or delete)

toFileStatus Method

toFileStatus: FileStatus

toFileStatus simply creates a new Hadoop FileStatus.

Note
 toFileStatus is used exclusively when MetadataLogFileIndex is created.

Creating SinkFileStatus Instance — apply Object Method

apply(f: FileStatus): SinkFileStatus

apply simply creates a new SinkFileStatus (with add action).

Note
 apply is used exclusively when ManifestFileCommitProtocol is requested to commitTask.

results matching ""

    No results matching ""