FileSystemBasedCheckpointFileManager — CheckpointFileManager on Hadoop’s FileSystem API

FileSystemBasedCheckpointFileManager is a CheckpointFileManager that uses Hadoop’s FileSystem API for managing checkpoint files:

FileSystemBasedCheckpointFileManager is created exclusively when CheckpointFileManager helper object is requested for a CheckpointFileManager (for HDFSMetadataLog, StreamMetadata and HDFSBackedStateStoreProvider).

FileSystemBasedCheckpointFileManager is a RenameHelperMethods for atomicity by "write-to-temp-file-and-rename".

Creating FileSystemBasedCheckpointFileManager Instance

FileSystemBasedCheckpointFileManager takes the following to be created:

FileSystemBasedCheckpointFileManager initializes the internal properties.

Internal Properties

Name Description

fs

Hadoop’s FileSystem of the checkpoint directory

results matching ""

    No results matching ""