Package org.apache.hadoop.fs.s3a.commit

Class CommitterStatisticNames

java.lang.Object
org.apache.hadoop.fs.s3a.commit.CommitterStatisticNames
@Public @Unstable public final class CommitterStatisticNames extends Object
Statistic names for committers. Please keep in sync with org.apache.hadoop.fs.s3a.Statistic so that S3A and manifest committers are in sync.

  • Field Details

    • COMMITTER_BYTES_COMMITTED_COUNT

      public static final String COMMITTER_BYTES_COMMITTED_COUNT
      Amount of data committed: "committer_bytes_committed".
      See Also:

    • COMMITTER_COMMIT_JOB

      public static final String COMMITTER_COMMIT_JOB
      Duration Tracking of time to commit an entire job: "committer_commit_job".
      See Also:

    • COMMITTER_FILES_COMMITTED_COUNT

      public static final String COMMITTER_FILES_COMMITTED_COUNT
      Number of files committed: "committer_files_committed".
      See Also:

    • COMMITTER_TASKS_COMPLETED_COUNT

      public static final String COMMITTER_TASKS_COMPLETED_COUNT
      "Count of successful tasks:: "committer_tasks_completed".
      See Also:

    • COMMITTER_TASKS_FAILED_COUNT

      public static final String COMMITTER_TASKS_FAILED_COUNT
      Count of failed tasks: "committer_tasks_failed".
      See Also:

    • COMMITTER_COMMITS_ABORTED_COUNT

      public static final String COMMITTER_COMMITS_ABORTED_COUNT
      Count of commits aborted: "committer_commits_aborted".
      See Also:

    • COMMITTER_COMMITS_REVERTED_COUNT

      public static final String COMMITTER_COMMITS_REVERTED_COUNT
      Count of commits reverted: "committer_commits_reverted".
      See Also:

    • COMMITTER_COMMITS_FAILED

      public static final String COMMITTER_COMMITS_FAILED
      Count of commits failed: "committer_commits.failures".
      See Also:

    • COMMITTER_FILE_COUNT_MEAN

      public static final String COMMITTER_FILE_COUNT_MEAN
      The number of files in a task. This will be a MeanStatistic.
      See Also:

    • COMMITTER_FILE_SIZE_MEAN

      public static final String COMMITTER_FILE_SIZE_MEAN
      File Size.
      See Also:

    • COMMITTER_TASK_DIRECTORY_COUNT_MEAN

      public static final String COMMITTER_TASK_DIRECTORY_COUNT_MEAN
      What is a task attempt's directory count.
      See Also:

    • COMMITTER_TASK_DIRECTORY_DEPTH_MEAN

      public static final String COMMITTER_TASK_DIRECTORY_DEPTH_MEAN
      What is the depth of a task attempt's directory tree.
      See Also:

    • COMMITTER_TASK_FILE_COUNT_MEAN

      public static final String COMMITTER_TASK_FILE_COUNT_MEAN
      The number of files in a task. This will be a MeanStatistic.
      See Also:

    • COMMITTER_TASK_FILE_SIZE_MEAN

      public static final String COMMITTER_TASK_FILE_SIZE_MEAN
      The number of files in a task. This will be a MeanStatistic.
      See Also:

    • OP_CREATE_DIRECTORIES

      public static final String OP_CREATE_DIRECTORIES
      Directory creation "op_create_directories".
      See Also:

    • OP_CREATE_ONE_DIRECTORY

      public static final String OP_CREATE_ONE_DIRECTORY
      Creating a single directory "op_create_one_directory".
      See Also:

    • OP_DIRECTORY_SCAN

      public static final String OP_DIRECTORY_SCAN
      Directory scan "op_directory_scan".
      See Also:

    • OP_STAGE_JOB_COMMIT

      public static final String OP_STAGE_JOB_COMMIT
      Overall job commit "committer_commit_job".
      See Also:

    • OP_LOAD_ALL_MANIFESTS

      public static final String OP_LOAD_ALL_MANIFESTS
      "op_load_all_manifests".
      See Also:

    • OP_LOAD_MANIFEST

      public static final String OP_LOAD_MANIFEST
      Load a task manifest: "op_load_manifest".
      See Also:

    • OP_RENAME_FILE

      public static final String OP_RENAME_FILE
      Rename a file: "op_rename".
      See Also:

    • OP_SAVE_TASK_MANIFEST

      public static final String OP_SAVE_TASK_MANIFEST
      Save a task manifest: "op_task_stage_save_task_manifest".
      See Also:

    • OP_STAGE_TASK_ABORT_TASK

      public static final String OP_STAGE_TASK_ABORT_TASK
      Task abort: "op_task_stage_abort_task".
      See Also:

    • OP_STAGE_JOB_ABORT

      public static final String OP_STAGE_JOB_ABORT
      Job abort: "op_job_stage_abort".
      See Also:

    • OP_STAGE_JOB_CLEANUP

      public static final String OP_STAGE_JOB_CLEANUP
      Job cleanup: "op_job_stage_cleanup".
      See Also:

    • OP_STAGE_JOB_CREATE_TARGET_DIRS

      public static final String OP_STAGE_JOB_CREATE_TARGET_DIRS
      Prepare Directories Stage: "op_job_stage_create_target_dirs".
      See Also:

    • OP_STAGE_JOB_LOAD_MANIFESTS

      public static final String OP_STAGE_JOB_LOAD_MANIFESTS
      Load Manifest Stage: "op_job_stage_load_manifests".
      See Also:

    • OP_STAGE_JOB_RENAME_FILES

      public static final String OP_STAGE_JOB_RENAME_FILES
      Rename files stage duration: "op_job_stage_rename_files".
      See Also:

    • OP_STAGE_JOB_SETUP

      public static final String OP_STAGE_JOB_SETUP
      Job Setup Stage: "op_job_stage_setup".
      See Also:

    • OP_STAGE_JOB_SAVE_SUCCESS

      public static final String OP_STAGE_JOB_SAVE_SUCCESS
      Job saving _SUCCESS marker Stage: "op_job_stage_save_success_marker".
      See Also:

    • OP_STAGE_JOB_VALIDATE_OUTPUT

      public static final String OP_STAGE_JOB_VALIDATE_OUTPUT
      Output Validation (within job commit) Stage: "op_job_stage_optional_validate_output".
      See Also:

    • OP_STAGE_TASK_SAVE_MANIFEST

      public static final String OP_STAGE_TASK_SAVE_MANIFEST
      Task saving manifest file Stage: "op_task_stage_save_manifest".
      See Also:

    • OP_STAGE_TASK_SETUP

      public static final String OP_STAGE_TASK_SETUP
      Task Setup Stage: "op_task_stage_setup".
      See Also:

    • OP_STAGE_TASK_COMMIT

      public static final String OP_STAGE_TASK_COMMIT
      Task Commit Stage: "op_stage_task_commit".
      See Also:

    • OP_STAGE_TASK_SCAN_DIRECTORY

      public static final String OP_STAGE_TASK_SCAN_DIRECTORY
      Task Scan directory Stage: "op_stage_task_scan_directory".
      See Also: