Apache Hadoop Changelog

Release 3.1.0 - 2018-04-06

INCOMPATIBLE CHANGES:

JIRA Summary Priority Component Reporter Contributor
HADOOP-15008 Metrics sinks may emit too frequently if multiple sink periods are configured Minor metrics Erik Krogen Erik Krogen
HDFS-12825 Fsck report shows config key name for min replication issues Minor hdfs Harshakiran Reddy Gabor Bota
HDFS-12883 RBF: Document Router and State Store metrics Major documentation Yiqun Lin Yiqun Lin
HDFS-12895 RBF: Add ACL support for mount table Major . Yiqun Lin Yiqun Lin
YARN-7190 Ensure only NM classpath in 2.x gets TSv2 related hbase jars, not the user classpath Major timelineclient, timelinereader, timelineserver Vrushali C Varun Saxena
HADOOP-13282 S3 blob etags to be made visible in S3A status/getFileChecksum() calls Minor fs/s3 Steve Loughran Steve Loughran
HDFS-13099 RBF: Use the ZooKeeper as the default State Store Minor documentation Yiqun Lin Yiqun Lin
YARN-7677 Docker image cannot set HADOOP_CONF_DIR Major . Eric Badger Jim Brennan

IMPORTANT ISSUES:

JIRA Summary Priority Component Reporter Contributor
HDFS-13083 RBF: Fix doc error setting up client Major federation tartarus tartarus

NEW FEATURES:

JIRA Summary Priority Component Reporter Contributor
HADOOP-15005 Support meta tag element in Hadoop XML configurations Major . Ajay Kumar Ajay Kumar
YARN-3926 [Umbrella] Extend the YARN resource model for easier resource-type management and profiles Major nodemanager, resourcemanager Varun Vasudev Varun Vasudev
HDFS-7877 [Umbrella] Support maintenance state for datanodes Major datanode, namenode Ming Ma Ming Ma
HADOOP-13055 Implement linkMergeSlash and linkFallback for ViewFileSystem Major fs, viewfs Zhe Zhang Manoj Govindassamy
YARN-6871 Add additional deSelects params in RMWebServices#getAppReport Major resourcemanager, router Giovanni Matteo Fumarola Tanuj Nayak
HADOOP-14840 Tool to estimate resource requirements of an application pipeline based on prior executions Major tools Subru Krishnan Rui Li
HDFS-206 Support for head in FSShell Minor . Olga Natkovich Gabor Bota
YARN-5079 [Umbrella] Native YARN framework layer for services and beyond Major . Vinod Kumar Vavilapalli
YARN-4757 [Umbrella] Simplified discovery of services via DNS mechanisms Major . Vinod Kumar Vavilapalli
HADOOP-13786 Add S3A committers for zero-rename commits to S3 endpoints Major fs/s3 Steve Loughran Steve Loughran
HDFS-9806 Allow HDFS block replicas to be provided by an external storage system Major . Chris Douglas
YARN-6592 [Umbrella] Rich placement constraints in YARN Major . Konstantinos Karanasos
HDFS-12998 SnapshotDiff - Provide an iterator-based listing API for calculating snapshotDiff Major snapshots Shashikant Banerjee Shashikant Banerjee
YARN-5764 NUMA awareness support for launching containers Major nodemanager, yarn Olasoji Devaraj K
YARN-5983 [Umbrella] Support for FPGA as a Resource in YARN Major yarn Zhankun Tang Zhankun Tang
YARN-6223 [Umbrella] Natively support GPU configuration/discovery/scheduling/isolation on YARN Major . Wangda Tan Wangda Tan
HADOOP-14898 Create official Docker images for development and testing features Major . Elek, Marton Elek, Marton
HDFS-13553 RBF: Support global quota Major . Íñigo Goiri Yiqun Lin

IMPROVEMENTS:

JIRA Summary Priority Component Reporter Contributor
YARN-7022 Improve click interaction in queue topology in new YARN UI Major yarn-ui-v2 Abdullah Yousufi Abdullah Yousufi
YARN-7033 Add support for NM Recovery of assigned resources (e.g. GPU’s, NUMA, FPGA’s) to container Major nodemanager Devaraj K Devaraj K
HADOOP-14850 Read HttpServer2 resources directly from the source tree (if exists) Major . Elek, Marton Elek, Marton
HADOOP-14849 some wrong spelling words update Trivial . Chen Hongfei Chen Hongfei
HADOOP-14844 Remove requirement to specify TenantGuid for MSI Token Provider Major fs/adl Atul Sikaria Atul Sikaria
YARN-7057 FSAppAttempt#getResourceUsage doesn’t need to consider resources queued for preemption Major fairscheduler Karthik Kambatla Karthik Kambatla
HADOOP-14804 correct wrong parameters format order in core-default.xml Trivial . Chen Hongfei Chen Hongfei
HADOOP-14864 FSDataInputStream#unbuffer UOE should include stream class name Minor fs John Zhuge Bharat Viswanadham
HDFS-12441 Suppress UnresolvedPathException in namenode log Minor . Kihwal Lee Kihwal Lee
HADOOP-13714 Tighten up our compatibility guidelines for Hadoop 3 Blocker documentation Karthik Kambatla Daniel Templeton
HADOOP-7308 Remove unused TaskLogAppender configurations from log4j.properties Major conf Todd Lipcon Todd Lipcon
YARN-7045 Remove FSLeafQueue#addAppSchedulable Major fairscheduler Yufei Gu Sen Zhao
HDFS-12486 GetConf to get journalnodeslist Major journal-node, shell Bharat Viswanadham Bharat Viswanadham
HDFS-12320 Add quantiles for transactions batched in Journal sync Major metrics, namenode Hanisha Koneru Hanisha Koneru
HDFS-12516 Suppress the fsnamesystem lock warning on nn startup Major . Ajay Kumar Ajay Kumar
HDFS-12304 Remove unused parameter from FsDatasetImpl#addVolume Minor . Chen Liang Chen Liang
YARN-65 Reduce RM app memory footprint once app has completed Major resourcemanager Jason Lowe Manikandan R
HDFS-5040 Audit log for admin commands/ logging output of all DFS admin commands Major namenode Raghu C Doppalapudi Kuhu Shukla
HDFS-12560 Remove the extra word “it” in HdfsUserGuide.md Trivial . fang zhenyi fang zhenyi
YARN-6333 Improve doc for minSharePreemptionTimeout, fairSharePreemptionTimeout and fairSharePreemptionThreshold Major fairscheduler Yufei Gu Chetna Chaudhari
HDFS-12552 Use slf4j instead of log4j in FSNamesystem Major . Ajay Kumar Ajay Kumar
HADOOP-14908 CrossOriginFilter should trigger regex on more input Major common, security Allen Wittenauer Johannes Alberti
HDFS-12455 WebHDFS - Adding “snapshot enabled” status to ListStatus query result. Major snapshots, webhdfs Ajay Kumar Ajay Kumar
HDFS-12420 Add an option to disallow ‘namenode format -force’ Major . Ajay Kumar Ajay Kumar
YARN-2162 add ability in Fair Scheduler to optionally configure maxResources in terms of percentage Major fairscheduler, scheduler Ashwin Shankar Yufei Gu
YARN-7207 Cache the RM proxy server address Major RM Yufei Gu Yufei Gu
HADOOP-14920 KMSClientProvider won’t work with KMS delegation token retrieved from non-Java client. Major kms Xiaoyu Yao Xiaoyu Yao
HADOOP-14184 Remove service loader config entry for ftp fs Minor fs John Zhuge Sen Zhao
HDFS-12542 Update javadoc and documentation for listStatus Major documentation Ajay Kumar Ajay Kumar
YARN-7359 TestAppManager.testQueueSubmitWithNoPermission() should be scheduler agnostic Minor . Haibo Chen Haibo Chen
YARN-7261 Add debug message for better download latency monitoring Major nodemanager Yufei Gu Yufei Gu
HDFS-12650 Use slf4j instead of log4j in LeaseManager Major . Ajay Kumar Ajay Kumar
YARN-7357 Several methods in TestZKRMStateStore.TestZKRMStateStoreTester.TestZKRMStateStoreInternal should have @Override annotations Trivial resourcemanager Daniel Templeton Sen Zhao
YARN-4163 Audit getQueueInfo and getApplications calls Major . Chang Li Chang Li
HADOOP-9657 NetUtils.wrapException to have special handling for 0.0.0.0 addresses and :0 ports Minor net Steve Loughran Varun Saxena
YARN-7397 Reduce lock contention in FairScheduler#getAppWeight() Major fairscheduler Daniel Templeton Daniel Templeton
HDFS-7878 API - expose a unique file identifier Major . Sergey Shelukhin Chris Douglas
YARN-6413 FileSystem based Yarn Registry implementation Major amrmproxy, api, resourcemanager Ellen Hui Ellen Hui
HDFS-12771 Add genstamp and block size to metasave Corrupt blocks list Minor . Kuhu Shukla Kuhu Shukla
HDFS-10528 Add logging to successful standby checkpointing Major namenode Xiaoyu Yao Xiaoyu Yao
YARN-7401 Reduce lock contention in ClusterNodeTracker#getClusterCapacity() Major resourcemanager Daniel Templeton Daniel Templeton
HDFS-7060 Avoid taking locks when sending heartbeats from the DataNode Major . Haohui Mai Jiandan Yang
HADOOP-14872 CryptoInputStream should implement unbuffer Major fs, security John Zhuge John Zhuge
YARN-7413 Support resource type in SLS Major scheduler-load-simulator Yufei Gu Yufei Gu
HADOOP-14876 Create downstream developer docs from the compatibility guidelines Critical documentation Daniel Templeton Daniel Templeton
YARN-7414 FairScheduler#getAppWeight() should be moved into FSAppAttempt#getWeight() Minor fairscheduler Daniel Templeton Soumabrata Chakraborty
HDFS-12814 Add blockId when warning slow mirror/disk in BlockReceiver Trivial hdfs Jiandan Yang Jiandan Yang
HADOOP-13514 Upgrade maven surefire plugin to 2.20.1 Major build Ewan Higgs Akira Ajisaka
YARN-7524 Remove unused FairSchedulerEventLog Major fairscheduler Wilfred Spiegelenburg Wilfred Spiegelenburg
YARN-6851 Capacity Scheduler: document configs for controlling # containers allowed to be allocated per node heartbeat Minor . Wei Yan Wei Yan
YARN-7495 Improve robustness of the AggregatedLogDeletionService Major log-aggregation Jonathan Eagles Jonathan Eagles
HDFS-12594 snapshotDiff fails if the report exceeds the RPC response limit Major hdfs Shashikant Banerjee Shashikant Banerjee
HDFS-12877 Add open(PathHandle) with default buffersize Trivial . Chris Douglas Chris Douglas
HADOOP-14976 Set HADOOP_SHELL_EXECNAME explicitly in scripts Major . Arpit Agarwal Arpit Agarwal
HADOOP-15039 Move SemaphoredDelegatingExecutor to hadoop-common Minor fs, fs/oss, fs/s3 Genmao Yu Genmao Yu
YARN-6483 Add nodes transitioning to DECOMMISSIONING state to the list of updated nodes returned to the AM Major resourcemanager Juan Rodríguez Hortalá Juan Rodríguez Hortalá
HADOOP-15056 Fix TestUnbuffer#testUnbufferException failure Minor test Jack Bearden Jack Bearden
HADOOP-15012 Add readahead, dropbehind, and unbuffer to StreamCapabilities Major fs John Zhuge John Zhuge
HADOOP-15104 AliyunOSS: change the default value of max error retry Major fs/oss wujinhu wujinhu
YARN-7274 Ability to disable elasticity at leaf queue level Major capacityscheduler Scott Brokaw Zian Chen
HDFS-12882 Support full open(PathHandle) contract in HDFS Major hdfs-client Chris Douglas Chris Douglas
YARN-7625 Expose NM node/containers resource utilization in JVM metrics Major nodemanager Weiwei Yang Weiwei Yang
HADOOP-14914 Change to a safely casting long to int. Major . Yufei Gu Ajay Kumar
HDFS-12910 Secure Datanode Starter should log the port when it fails to bind Minor datanode Stephen O’Donnell Stephen O’Donnell
YARN-7642 Add test case to verify context update after container promotion or demotion with or without auto update Minor nodemanager Weiwei Yang Weiwei Yang
YARN-5418 When partial log aggregation is enabled, display the list of aggregated files on the container log page Major . Siddharth Seth Xuan Gong
HADOOP-15106 FileSystem::open(PathHandle) should throw a specific exception on validation failure Minor . Chris Douglas Chris Douglas
HDFS-12818 Support multiple storages in DataNodeCluster / SimulatedFSDataset Minor datanode, test Erik Krogen Erik Krogen
HDFS-12932 Fix confusing LOG message for block replication Minor hdfs Chao Sun Chao Sun
HDFS-9023 When NN is not able to identify DN for replication, reason behind it can be logged Critical hdfs-client, namenode Surendra Singh Lilhore Xiao Chen
YARN-7580 ContainersMonitorImpl logged message lacks detail when exceeding memory limits Major nodemanager Wilfred Spiegelenburg Wilfred Spiegelenburg
HDFS-12351 Explicitly describe the minimal number of DataNodes required to support an EC policy in EC document. Minor documentation, erasure-coding Lei (Eddy) Xu Hanisha Koneru
HDFS-12629 NameNode UI should report total blocks count by type - replicated and erasure coded Major hdfs Manoj Govindassamy Manoj Govindassamy
YARN-7687 ContainerLogAppender Improvements Trivial . BELUGA BEHR
YARN-7688 Miscellaneous Improvements To ProcfsBasedProcessTree Minor nodemanager BELUGA BEHR
HDFS-11847 Enhance dfsadmin listOpenFiles command to list files blocking datanode decommissioning Major hdfs Manoj Govindassamy Manoj Govindassamy
YARN-7678 Ability to enable logging of container memory stats Major nodemanager Jim Brennan Jim Brennan
HDFS-11848 Enhance dfsadmin listOpenFiles command to list files under a given path Major . Manoj Govindassamy Yiqun Lin
HDFS-12945 Switch to ClientProtocol instead of NamenodeProtocols in NamenodeWebHdfsMethods Minor . Wei Yan Wei Yan
HDFS-12808 Add LOG.isDebugEnabled() guard for LOG.debug(“…”) Minor . Mehran Hassani Bharat Viswanadham
YARN-7722 Rename variables in MockNM, MockRM for better clarity Trivial . lovekesh bansal lovekesh bansal
YARN-7622 Allow fair-scheduler configuration on HDFS Minor fairscheduler, resourcemanager Greg Phillips Greg Phillips
HADOOP-15033 Use java.util.zip.CRC32C for Java 9 and above Major performance, util Dmitry Chuyko Dmitry Chuyko
YARN-7590 Improve container-executor validation check Major security, yarn Eric Yang Eric Yang
HADOOP-15157 Zookeeper authentication related properties to support CredentialProviders Minor security Gergo Repas Gergo Repas
MAPREDUCE-7029 FileOutputCommitter is slow on filesystems lacking recursive delete Minor . Karthik Palaniappan Karthik Palaniappan
HADOOP-15114 Add closeStreams(…) to IOUtils Major . Ajay Kumar Ajay Kumar
MAPREDUCE-6984 MR AM to clean up temporary files from previous attempt in case of no recovery Major applicationmaster Gergo Repas Gergo Repas
HDFS-13036 Reusing the volume storage ID obtained by replicaInfo Major datanode liaoyuxiangqin liaoyuxiangqin
YARN-7755 Clean up deprecation messages for allocation increments in FS config Minor fairscheduler Wilfred Spiegelenburg Wilfred Spiegelenburg
MAPREDUCE-7022 Fast fail rogue jobs based on task scratch dir size Major task Johan Gustavsson Johan Gustavsson
YARN-2185 Use pipes when localizing archives Major nodemanager Jason Lowe Miklos Szegedi
HDFS-13092 Reduce verbosity for ThrottledAsyncChecker.java:schedule Minor datanode Mukul Kumar Singh Mukul Kumar Singh
HDFS-13062 Provide support for JN to use separate journal disk per namespace Major federation, journal-node Bharat Viswanadham Bharat Viswanadham
HADOOP-15170 Add symlink support to FileUtil#unTarUsingJava Minor util Jason Lowe Ajay Kumar
HADOOP-15168 Add kdiag tool to hadoop command Minor . Bharat Viswanadham Bharat Viswanadham
HDFS-13073 Cleanup code in InterQJournalProtocol.proto Minor journal-node Bharat Viswanadham Bharat Viswanadham
HADOOP-15212 Add independent secret manager method for logging expired tokens Major security Daryn Sharp Daryn Sharp
YARN-7841 Cleanup AllocationFileLoaderService’s reloadAllocations method Minor yarn Szilard Nemeth Szilard Nemeth
HDFS-12947 Limit the number of Snapshots allowed to be created for a Snapshottable Directory Major snapshots Shashikant Banerjee Shashikant Banerjee
HDFS-12933 Improve logging when DFSStripedOutputStream failed to write some blocks Minor erasure-coding Xiao Chen chencan
YARN-7728 Expose container preemptions related information in Capacity Scheduler queue metrics Major . Eric Payne Eric Payne
YARN-7655 Avoid AM preemption caused by RRs for specific nodes or racks Major fairscheduler Steven Rand Steven Rand
HADOOP-15187 Remove ADL mock test dependency on REST call invoked from Java SDK Major fs/adl Vishwajeet Dusane Vishwajeet Dusane
MAPREDUCE-7048 Uber AM can crash due to unknown task in statusUpdate Major mr-am Peter Bacsko Peter Bacsko
HADOOP-15195 With SELinux enabled, directories mounted with start-build-env.sh may not be accessible. Major build Grigori Rybkine Grigori Rybkine
HADOOP-14531 [Umbrella] Improve S3A error handling & reporting Blocker fs/s3 Steve Loughran Steve Loughran
HADOOP-15204 Add Configuration API for parsing storage sizes Minor conf Anu Engineer Anu Engineer
HDFS-13142 Define and Implement a DiifList Interface to store and manage SnapshotDiffs Major snapshots Shashikant Banerjee Shashikant Banerjee
HADOOP-13972 ADLS to support per-store configuration Major fs/adl John Zhuge Sharad Sonker
HDFS-13153 Enable HDFS diskbalancer by default Major diskbalancer Ajay Kumar Ajay Kumar
HADOOP-14875 Create end user documentation from the compatibility guidelines Critical documentation Daniel Templeton Daniel Templeton
HADOOP-15070 add test to verify FileSystem and paths differentiate on user info Minor fs, test Steve Loughran Steve Loughran
YARN-7813 Capacity Scheduler Intra-queue Preemption should be configurable for each queue Major capacity scheduler, scheduler preemption Eric Payne Eric Payne
HDFS-13168 XmlImageVisitor - Prefer Array over LinkedList Minor hdfs BELUGA BEHR BELUGA BEHR
HDFS-13167 DatanodeAdminManager Improvements Trivial hdfs BELUGA BEHR BELUGA BEHR
HADOOP-15235 Authentication Tokens should use HMAC instead of MAC Major security Robert Kanter Robert Kanter
HADOOP-12897 KerberosAuthenticator.authenticate to include URL on IO failures Minor security Steve Loughran Ajay Kumar
HDFS-13175 Add more information for checking argument in DiskBalancerVolume Minor diskbalancer Lei (Eddy) Xu Lei (Eddy) Xu
HDFS-11187 Optimize disk access for last partial chunk checksum of Finalized replica Major datanode Wei-Chiu Chuang Gabor Bota
HADOOP-15255 Upper/Lower case conversion support for group names in LdapGroupsMapping Major . Nanda kumar Nanda kumar
HADOOP-13374 Add the L&N verification script Major . Xiao Chen Allen Wittenauer
HADOOP-15178 Generalize NetUtils#wrapException to handle other subclasses with String Constructor Major . Ajay Kumar Ajay Kumar
HDFS-13193 Various Improvements for BlockTokenSecretManager Trivial hdfs BELUGA BEHR BELUGA BEHR
HADOOP-14959 DelegationTokenAuthenticator.authenticate() to wrap network exceptions Minor net, security Steve Loughran Ajay Kumar
MAPREDUCE-7010 Make Job History File Permissions configurable Major . Andras Bokor Gergely Novák
HDFS-13192 Change the code order in getFileEncryptionInfo to avoid unnecessary call of assignment Minor encryption LiXin Ge LiXin Ge
MAPREDUCE-7061 SingleCluster setup document needs to be updated Major . Bharat Viswanadham Bharat Viswanadham
HADOOP-15263 hadoop cloud-storage module to mark hadoop-common as provided; add azure-datalake Minor build Steve Loughran Steve Loughran
HADOOP-15007 Stabilize and document Configuration <tag> element Blocker conf Steve Loughran Ajay Kumar
HDFS-13102 Implement SnapshotSkipList class to store Multi level DirectoryDiffs Major snapshots Shashikant Banerjee Shashikant Banerjee
HDFS-13202 Fix the outdated javadocs in HAUtil Trivial . Chao Sun Chao Sun
YARN-5028 RMStateStore should trim down app state for completed applications Major resourcemanager Karthik Kambatla Gergo Repas
HADOOP-15279 increase maven heap size recommendations Minor build, documentation, test Allen Wittenauer Allen Wittenauer
HDFS-13171 Handle Deletion of nodes in SnasphotSkipList Major snapshots Shashikant Banerjee Shashikant Banerjee
HADOOP-15252 Checkstyle version is not compatible with IDEA’s checkstyle plugin Major . Andras Bokor Andras Bokor
HDFS-13173 Replace ArrayList with DirectoryDiffList(SnapshotSkipList) to store DirectoryDiffs Major snapshots Shashikant Banerjee Shashikant Banerjee
HADOOP-15282 HADOOP-15235 broke TestHttpFSServerWebServer Major test Robert Kanter Robert Kanter
HDFS-13170 Port webhdfs unmaskedpermission parameter to HTTPFS Major . Stephen O’Donnell Stephen O’Donnell
HDFS-13223 Reduce DiffListBySkipList memory usage Major snapshots Tsz Wo Nicholas Sze Shashikant Banerjee
HDFS-13227 Add a method to calculate cumulative diff over multiple snapshots in DirectoryDiffList Minor snapshots Shashikant Banerjee Shashikant Banerjee
HDFS-13222 Update getBlocks method to take minBlockSize in RPC calls Major balancer & mover Bharat Viswanadham Bharat Viswanadham
HDFS-13225 StripeReader#checkMissingBlocks() ’s IOException info is incomplete Major erasure-coding, hdfs-client lufei lufei
HDFS-11394 Support for getting erasure coding policy through WebHDFS#FileStatus Major erasure-coding, namenode Kai Sasaki Kai Sasaki
HDFS-13252 Code refactoring: Remove Diff.ListType Major snapshots Tsz Wo Nicholas Sze Tsz Wo Nicholas Sze
HDFS-12780 Fix spelling mistake in DistCpUtils.java Trivial . Jianfei Jiang Jianfei Jiang
HADOOP-15311 HttpServer2 needs a way to configure the acceptor/selector count Major common Erik Krogen Erik Krogen
HDFS-13235 DiskBalancer: Update Documentation to add newly added options Major diskbalancer, documentation Bharat Viswanadham Bharat Viswanadham
HDFS-336 dfsadmin -report should report number of blocks from datanode Minor . Lohit Vijayarenu Bharat Viswanadham
HDFS-11600 Refactor TestDFSStripedOutputStreamWithFailure test classes Minor erasure-coding, test Andrew Wang Sammi Chen
HDFS-13257 Code cleanup: INode never throws QuotaExceededException Major namenode Tsz Wo Nicholas Sze Tsz Wo Nicholas Sze
HDFS-13275 Adding log for BlockPoolManager#refreshNamenodes failures Minor datanode Xiaoyu Yao Ajay Kumar
HDFS-13246 FileInputStream redundant closes in readReplicasFromCache Minor datanode liaoyuxiangqin liaoyuxiangqin
HADOOP-15209 DistCp to eliminate needless deletion of files under already-deleted directories Major tools/distcp Steve Loughran Steve Loughran
MAPREDUCE-7047 Make HAR tool support IndexedLogAggregtionController Major . Xuan Gong Xuan Gong
HDFS-12884 BlockUnderConstructionFeature.truncateBlock should be of type BlockInfo Major namenode Konstantin Shvachko chencan
YARN-7064 Use cgroup to get container resource utilization Major nodemanager Miklos Szegedi Miklos Szegedi
HADOOP-15334 Upgrade Maven surefire plugin Major build Arpit Agarwal Arpit Agarwal
HADOOP-14825 Über-JIRA: S3Guard Phase II: Hadoop 3.1 features Major fs/s3 Steve Loughran Steve Loughran
HADOOP-15312 Undocumented KeyProvider configuration keys Major . Wei-Chiu Chuang LiXin Ge
YARN-7623 Fix the CapacityScheduler Queue configuration documentation Major . Arun Suresh Jonathan Hung
HDFS-13314 NameNode should optionally exit if it detects FsImage corruption Major namenode Arpit Agarwal Arpit Agarwal
YARN-8076 Support to specify application tags in distributed shell Major distributed-shell Weiwei Yang Weiwei Yang
HADOOP-14831 Über-jira: S3a phase IV: Hadoop 3.1 features Blocker fs/s3 Steve Loughran Steve Loughran
YARN-5881 [Umbrella] Enable configuration of queue capacity in terms of absolute resources Major . Sean Po Sunil Govindan
HADOOP-14841 Kms client should disconnect if unable to get output stream from connection. Major kms Xiao Chen Rushabh S Shah
HDFS-13493 Reduce the HttpServer2 thread count on DataNodes Major datanode Erik Krogen Erik Krogen

BUG FIXES:

JIRA Summary Priority Component Reporter Contributor
YARN-7023 Incorrect ReservationId.compareTo() implementation Minor reservation system Oleg Danilov Oleg Danilov
YARN-7152 [ATSv2] Registering timeline client before AMRMClient service init throw exception. Major timelineclient Rohith Sharma K S Rohith Sharma K S
YARN-6992 Kill application button is visible even if the application is FINISHED in RM UI Major . Sumana Sathish Suma Shivaprasad
YARN-7140 CollectorInfo should have Public visibility Minor . Varun Saxena Varun Saxena
YARN-7130 ATSv2 documentation changes post merge Major timelineserver Varun Saxena Varun Saxena
HDFS-12406 dfsadmin command prints “Exception encountered” even if there is no exception, when debug is enabled Minor hdfs-client Nanda kumar Nanda kumar
YARN-4727 Unable to override the $HADOOP_CONF_DIR env variable for container Major nodemanager Terence Yim Jason Lowe
YARN-7163 RMContext need not to be injected to webapp and other Always Running services. Blocker resourcemanager Rohith Sharma K S Rohith Sharma K S
HDFS-12424 Datatable sorting on the Datanode Information page in the Namenode UI is broken Major . Shawna Martell Shawna Martell
HDFS-12323 NameNode terminates after full GC thinking QJM unresponsive if full GC is much longer than timeout Major namenode, qjm Erik Krogen Erik Krogen
YARN-7149 Cross-queue preemption sometimes starves an underserved queue Major capacity scheduler Eric Payne Eric Payne
YARN-7172 ResourceCalculator.fitsIn() should not take a cluster resource parameter Major scheduler Daniel Templeton Sen Zhao
YARN-7199 Fix TestAMRMClientContainerRequest.testOpportunisticAndGuaranteedRequests Blocker . Botong Huang Botong Huang
MAPREDUCE-6960 Shuffle Handler prints disk error stack traces for every read failure. Major . Kuhu Shukla Kuhu Shukla
HDFS-12480 TestNameNodeMetrics#testTransactionAndCheckpointMetrics Fails in trunk Blocker test Brahma Reddy Battula Hanisha Koneru
HDFS-11799 Introduce a config to allow setting up write pipeline with fewer nodes than replication factor Major . Yongjun Zhang Brahma Reddy Battula
YARN-7196 Fix finicky TestContainerManager tests Major . Arun Suresh Arun Suresh
YARN-6771 Use classloader inside configuration class to make new classes Major . Jongyoul Lee Jongyoul Lee
HDFS-12526 FSDirectory should use Time.monotonicNow for durations Minor . Chetna Chaudhari Bharat Viswanadham
HDFS-12371 “BlockVerificationFailures” and “BlocksVerified” show up as 0 in Datanode JMX Major metrics Sai Nukavarapu Hanisha Koneru
YARN-7034 DefaultLinuxContainerRuntime and DockerLinuxContainerRuntime sends client environment variables to container-executor Blocker nodemanager Miklos Szegedi Miklos Szegedi
HDFS-12507 StripedBlockUtil.java:694: warning - Tag @link: reference not found: StripingCell Minor documentation Tsz Wo Nicholas Sze Mukul Kumar Singh
MAPREDUCE-6966 DistSum should use Time.monotonicNow for measuring durations Minor . Chetna Chaudhari Chetna Chaudhari
YARN-6878 TestCapacityScheduler.testDefaultNodeLabelExpressionQueueConfig() has the args to assertEqual() in the wrong order Trivial capacity scheduler, test Daniel Templeton Sen Zhao
HDFS-12064 Reuse object mapper in HDFS Minor . Mingliang Liu Hanisha Koneru
HDFS-12535 Change the Scope of the Class DFSUtilClient to Private Major . Bharat Viswanadham Bharat Viswanadham
HDFS-12536 Add documentation for getconf command with -journalnodes option Major . Bharat Viswanadham Bharat Viswanadham
HADOOP-14905 Fix javadocs issues in Hadoop HDFS-NFS Major nfs Mukul Kumar Singh Mukul Kumar Singh
HADOOP-14904 Fix javadocs issues in Hadoop HDFS Minor . Mukul Kumar Singh Mukul Kumar Singh
HDFS-12339 NFS Gateway on Shutdown Gives Unregistration Failure. Does Not Unregister with rpcbind Portmapper Major nfs Sailesh Patel Mukul Kumar Singh
HDFS-12375 Fail to start/stop journalnodes using start-dfs.sh/stop-dfs.sh. Major federation, journal-node, scripts Wenxin He Bharat Viswanadham
YARN-7153 Remove duplicated code in AMRMClientAsyncImpl.java Minor client Sen Zhao Sen Zhao
HADOOP-14897 Loosen compatibility guidelines for native dependencies Blocker documentation, native Chris Douglas Daniel Templeton
HDFS-12529 Get source for config tags from file name Major . Ajay Kumar Ajay Kumar
YARN-7118 AHS REST API can return NullPointerException Major . Prabhu Joseph Billie Rinaldi
HDFS-12495 TestPendingInvalidateBlock#testPendingDeleteUnknownBlocks fails intermittently Major . Eric Badger Eric Badger
HADOOP-14822 hadoop-project/pom.xml is executable Minor . Akira Ajisaka Ajay Kumar
YARN-7157 Add admin configuration to filter per-user’s apps in secure cluster Major webapp Sunil Govindan Sunil Govindan
YARN-7257 AggregatedLogsBlock reports a bad ‘end’ value as a bad ‘start’ value Major log-aggregation Jason Lowe Jason Lowe
YARN-7084 TestSchedulingMonitor#testRMStarts fails sporadically Major . Jason Lowe Jason Lowe
HDFS-12271 Incorrect statement in Downgrade section of HDFS Rolling Upgrade document Minor documentation Nanda kumar Nanda kumar
HDFS-12576 JournalNodes are getting started, even though dfs.namenode.shared.edits.dir is not configured Major journal-node Bharat Viswanadham Bharat Viswanadham
HDFS-11968 ViewFS: StoragePolicies commands fail with HDFS federation Major hdfs Mukul Kumar Singh Mukul Kumar Singh
YARN-6943 Update Yarn to YARN in documentation Minor documentation Miklos Szegedi Chetna Chaudhari
YARN-7211 AMSimulator in SLS does’t work due to refactor of responseId Blocker scheduler-load-simulator Yufei Gu Botong Huang
HADOOP-14459 SerializationFactory shouldn’t throw a NullPointerException if the serializations list is not defined Minor . Nandor Kollar Nandor Kollar
YARN-7279 Fix typo in helper message of ContainerLauncher Trivial . Elek, Marton Elek, Marton
YARN-7258 Add Node and Rack Hints to Opportunistic Scheduler Major . Arun Suresh kartheek muthyala
YARN-7285 ContainerExecutor always launches with priorities due to yarn-default property Minor nodemanager Jason Lowe Jason Lowe
HDFS-12494 libhdfs SIGSEGV in setTLSExceptionStrings Major libhdfs John Zhuge John Zhuge
YARN-7245 Max AM Resource column in Active Users Info section of Capacity Scheduler UI page should be updated per-user Major capacity scheduler, yarn Eric Payne Eric Payne
HDFS-11575 Supporting HDFS NFS gateway with Federated HDFS Major nfs Mukul Kumar Singh Mukul Kumar Singh
HADOOP-14910 Upgrade netty-all jar to latest 4.0.x.Final Critical . Vinayakumar B Vinayakumar B
MAPREDUCE-6951 Improve exception message when mapreduce.jobhistory.webapp.address is in wrong format Major applicationmaster Prabhu Joseph Prabhu Joseph
HDFS-12627 Fix typo in DFSAdmin command output Trivial . Ajay Kumar Ajay Kumar
HADOOP-13102 Update GroupsMapping documentation to reflect the new changes Major documentation Anu Engineer Esther Kundin
YARN-7270 Fix unsafe casting from long to int for class Resource and its sub-classes Major resourcemanager Yufei Gu Yufei Gu
YARN-7124 LogAggregationTFileController deletes/renames while file is open Critical nodemanager Daryn Sharp Jason Lowe
YARN-7341 TestRouterWebServiceUtil#testMergeMetrics is flakey Major federation Robert Kanter Robert Kanter
HADOOP-14958 CLONE - Fix source-level compatibility after HADOOP-11252 Blocker . Junping Du Junping Du
YARN-7294 TestSignalContainer#testSignalRequestDeliveryToNM fails intermittently with Fair scheduler Major . Miklos Szegedi Miklos Szegedi
YARN-7355 TestDistributedShell should be scheduler agnostic Major . Haibo Chen Haibo Chen
HDFS-12683 DFSZKFailOverController re-order logic for logging Exception Major . Bharat Viswanadham Bharat Viswanadham
HADOOP-14966 Handle JDK-8071638 for hadoop-common Blocker . Bibin A Chundatt Bibin A Chundatt
HDFS-12695 Add a link to HDFS router federation document in site.xml Minor documentation Yiqun Lin Yiqun Lin
YARN-7385 TestFairScheduler#testUpdateDemand and TestFSLeafQueue#testUpdateDemand are failing with NPE Major test Robert Kanter Yufei Gu
HADOOP-14977 Xenial dockerfile needs ant in main build for findbugs Trivial build, test Allen Wittenauer Akira Ajisaka
HDFS-12579 JournalNodeSyncer should use fromUrl field of EditLogManifestResponse to construct servlet Url Major . Hanisha Koneru Hanisha Koneru
YARN-7375 Possible NPE in RMWebapp when HA is enabled and the active RM fails Major . Chandni Singh Chandni Singh
YARN-6747 TestFSAppStarvation.testPreemptionEnable fails intermittently Major . Sunil Govindan Miklos Szegedi
YARN-7336 Unsafe cast from long to int Resource.hashCode() method Critical resourcemanager Daniel Templeton Miklos Szegedi
HADOOP-14990 Clean up jdiff xml files added for 2.8.2 release Blocker . Subru Krishnan Junping Du
HADOOP-14980 [JDK9] Upgrade maven-javadoc-plugin to 3.0.0-M1 Minor build ligongyi ligongyi
HDFS-12714 Hadoop 3 missing fix for HDFS-5169 Major native Joe McDonnell Joe McDonnell
YARN-7146 Many RM unit tests failing with FairScheduler Major test Robert Kanter Robert Kanter
YARN-7396 NPE when accessing container logs due to null dirsHandler Major . Jonathan Hung Jonathan Hung
YARN-7370 Preemption properties should be refreshable Major capacity scheduler, scheduler preemption Eric Payne Gergely Novák
YARN-7400 incorrect log preview displayed in jobhistory server ui Major yarn Santhosh B Gowda Xuan Gong
HADOOP-15013 Fix ResourceEstimator findbugs issues Blocker . Allen Wittenauer Arun Suresh
YARN-7432 Fix DominantResourceFairnessPolicy serializable findbugs issues Blocker . Allen Wittenauer Daniel Templeton
YARN-7434 Router getApps REST invocation fails with multiple RMs Critical . Subru Krishnan Íñigo Goiri
HADOOP-15015 TestConfigurationFieldsBase to use SLF4J for logging Trivial conf, test Steve Loughran Steve Loughran
YARN-7428 Add containerId to Localizer failed logs Minor nodemanager Prabhu Joseph Prabhu Joseph
YARN-4793 [Umbrella] Simplified API layer for services and beyond Major . Vinod Kumar Vavilapalli
HADOOP-15018 Update JAVA_HOME in create-release for Xenial Dockerfile Blocker build Andrew Wang Andrew Wang
HDFS-12788 Reset the upload button when file upload fails Critical ui, webhdfs Brahma Reddy Battula Brahma Reddy Battula
YARN-7453 Fix issue where RM fails to switch to active after first successful start Blocker resourcemanager Rohith Sharma K S Rohith Sharma K S
YARN-7458 TestContainerManagerSecurity is still flakey Major test Robert Kanter Robert Kanter
YARN-7454 RMAppAttemptMetrics#getAggregateResourceUsage can NPE due to double lookup Minor resourcemanager Jason Lowe Jason Lowe
YARN-7465 start-yarn.sh fails to start ResourceManager unless running as root Blocker . Sean Mackrory
HDFS-12791 NameNode Fsck http Connection can timeout for directories with multiple levels Major tools Mukul Kumar Singh Mukul Kumar Singh
HDFS-12797 Add Test for NFS mount of not supported filesystems like (file:///) Minor nfs Mukul Kumar Singh Mukul Kumar Singh
HADOOP-14929 Cleanup usage of decodecomponent and use QueryStringDecoder from netty Major . Bharat Viswanadham Bharat Viswanadham
HDFS-12498 Journal Syncer is not started in Federated + HA cluster Major federation, journal-node Bharat Viswanadham Bharat Viswanadham
YARN-7452 Decommissioning node default value to be zero in new YARN UI Trivial yarn-ui-v2 Vasudevan Skm Vasudevan Skm
YARN-7445 Render Applications and Services page with filters in new YARN UI Major yarn-ui-v2 Vasudevan Skm Vasudevan Skm
HADOOP-15031 Fix javadoc issues in Hadoop Common Minor common Mukul Kumar Singh Mukul Kumar Singh
HDFS-12705 WebHdfsFileSystem exceptions should retain the caused by exception Major hdfs Daryn Sharp Hanisha Koneru
YARN-7462 Render outstanding resource requests on application page of new YARN UI Major yarn-ui-v2 Vasudevan Skm Vasudevan Skm
YARN-7464 Introduce filters in Nodes page of new YARN UI Major yarn-ui-v2 Vasudevan Skm Vasudevan Skm
YARN-7361 Improve the docker container runtime documentation Major . Shane Kumpf Shane Kumpf
YARN-7492 Set up SASS for new YARN UI styling Major yarn-ui-v2 Vasudevan Skm Vasudevan Skm
YARN-7469 Capacity Scheduler Intra-queue preemption: User can starve if newest app is exactly at user limit Major capacity scheduler, yarn Eric Payne Eric Payne
HADOOP-14982 Clients using FailoverOnNetworkExceptionRetry can go into a loop if they’re used without authenticating with kerberos in HA env Major common Peter Bacsko Peter Bacsko
YARN-7489 ConcurrentModificationException in RMAppImpl#getRMAppMetrics Major capacityscheduler Tao Yang Tao Yang
YARN-7525 Incorrect query parameters in cluster nodes REST API document Minor documentation Tao Yang Tao Yang
HDFS-12813 RequestHedgingProxyProvider can hide Exception thrown from the Namenode for proxy size of 1 Major ha Mukul Kumar Singh Mukul Kumar Singh
HADOOP-15046 Document Apache Hadoop does not support Java 9 in BUILDING.txt Major documentation Akira Ajisaka Hanisha Koneru
YARN-7513 Remove scheduler lock in FSAppAttempt.getWeight() Minor fairscheduler Wilfred Spiegelenburg Wilfred Spiegelenburg
YARN-7390 All reservation related test cases failed when TestYarnClient runs against Fair Scheduler. Major fairscheduler, reservation system Yufei Gu Yufei Gu
YARN-7290 Method canContainerBePreempted can return true when it shouldn’t Major fairscheduler Steven Rand Steven Rand
MAPREDUCE-7014 Fix java doc errors in jdk1.8 Major . Rohith Sharma K S Steve Loughran
YARN-7363 ContainerLocalizer doesn’t have a valid log4j config when using LinuxContainerExecutor Major nodemanager Yufei Gu Yufei Gu
HDFS-12754 Lease renewal can hit a deadlock Major . Kuhu Shukla Kuhu Shukla
YARN-7499 Layout changes to Application details page in new YARN UI Major yarn-ui-v2 Vasudevan Skm Vasudevan Skm
HDFS-12857 StoragePolicyAdmin should support schema based path Major namenode Surendra Singh Lilhore Surendra Singh Lilhore
HDFS-12832 INode.getFullPathName may throw ArrayIndexOutOfBoundsException lead to NameNode exit Critical namenode DENG FEI Konstantin Shvachko
HADOOP-15054 upgrade hadoop dependency on commons-codec to 1.11 Major . PJ Fanning Bharat Viswanadham
HDFS-11754 Make FsServerDefaults cache configurable. Minor . Rushabh S Shah Mikhail Erofeev
HADOOP-15042 Azure PageBlobInputStream.skip() can return negative value when numberOfPagesRemaining is 0 Minor fs/azure Rajesh Balamohan Rajesh Balamohan
YARN-7509 AsyncScheduleThread and ResourceCommitterService are still running after RM is transitioned to standby Critical . Tao Yang Tao Yang
HDFS-12681 Make HdfsLocatedFileStatus a subtype of LocatedFileStatus Major . Chris Douglas Chris Douglas
YARN-7558 “yarn logs” command fails to get logs for running containers if UI authentication is enabled. Critical . Namit Maheshwari Xuan Gong
HDFS-12638 Delete copy-on-truncate block along with the original block, when deleting a file being truncated Blocker hdfs Jiandan Yang Konstantin Shvachko
YARN-7546 Layout changes in Queue UI to show queue details on right pane Major yarn-ui-v2 Vasudevan Skm Vasudevan Skm
HDFS-12836 startTxId could be greater than endTxId when tailing in-progress edit log Major hdfs Chao Sun Chao Sun
YARN-4813 TestRMWebServicesDelegationTokenAuthentication.testDoAs fails intermittently Major resourcemanager Daniel Templeton Gergo Repas
MAPREDUCE-5124 AM lacks flow control for task events Major mr-am Jason Lowe Peter Bacsko
YARN-7589 TestPBImplRecords fails with NullPointerException Major . Jason Lowe Daniel Templeton
YARN-7455 quote_and_append_arg can overflow buffer Major nodemanager Jason Lowe Jim Brennan
HADOOP-14600 LocatedFileStatus constructor forces RawLocalFS to exec a process to get the permissions Major fs Steve Loughran Ping Liu
YARN-7594 TestNMWebServices#testGetNMResourceInfo fails on trunk Major nodemanager, webapp Gergely Novák Gergely Novák
YARN-5594 Handle old RMDelegationToken format when recovering RM Major resourcemanager Tatyana But Robert Kanter
HADOOP-15058 create-release site build outputs dummy shaded jars due to skipShade Blocker . Andrew Wang Andrew Wang
HADOOP-14985 Remove subversion related code from VersionInfoMojo.java Minor build Akira Ajisaka Ajay Kumar
YARN-7586 Application Placement should be done before ACL checks in ResourceManager Blocker . Suma Shivaprasad Suma Shivaprasad
HDFS-11751 DFSZKFailoverController daemon exits with wrong status code Major auto-failover Doris Gu Bharat Viswanadham
HADOOP-15080 Aliyun OSS: update oss sdk from 2.8.1 to 2.8.3 to remove its dependency on Cat-x “json-lib” Blocker fs/oss Chris Douglas Sammi Chen
HADOOP-15098 TestClusterTopology#testChooseRandom fails intermittently Major test Zsolt Venczel Zsolt Venczel
YARN-7608 Incorrect sTarget column causing DataTable warning on RM application and scheduler web page Major resourcemanager, webapp Weiwei Yang Gergely Novák
HDFS-12891 Do not invalidate blocks if toInvalidate is empty Major . Zsolt Venczel Zsolt Venczel
YARN-7635 TestRMWebServicesSchedulerActivities fails in trunk Major test Sunil Govindan Sunil Govindan
HDFS-12833 Distcp : Update the usage of delete option for dependency with update and overwrite option Minor distcp, hdfs Harshakiran Reddy usharani
YARN-7647 NM print inappropriate error log when node-labels is enabled Minor . Yang Wang Yang Wang
YARN-7536 em-table improvement for better filtering in new YARN UI Minor yarn-ui-v2 Vasudevan Skm Vasudevan Skm
HDFS-12907 Allow read-only access to reserved raw for non-superusers Major namenode Daryn Sharp Rushabh S Shah
HDFS-12881 Output streams closed with IOUtils suppressing write errors Major . Jason Lowe Ajay Kumar
YARN-7595 Container launching code suppresses close exceptions after writes Major nodemanager Jason Lowe Jim Brennan
HADOOP-15085 Output streams closed with IOUtils suppressing write errors Major . Jason Lowe Jim Brennan
YARN-7629 TestContainerLaunch# fails after YARN-7381 Major . Jason Lowe Jason Lowe
YARN-7664 Several javadoc errors Blocker . Sean Mackrory Sean Mackrory
HADOOP-15123 KDiag tries to load krb5.conf from KRB5CCNAME instead of KRB5_CONFIG Minor security Vipin Rathor Vipin Rathor
HADOOP-15109 TestDFSIO -read -random doesn’t work on file sized 4GB Minor fs, test zhoutai.zt Ajay Kumar
YARN-7661 NodeManager metrics return wrong value after update node resource Major . Yang Wang Yang Wang
HDFS-12930 Remove the extra space in HdfsImageViewer.md Trivial documentation Yiqun Lin Rahul Pathak
YARN-7662 [Atsv2] Define new set of configurations for reader and collectors to bind. Major . Rohith Sharma K S Rohith Sharma K S
YARN-7466 ResourceRequest has a different default for allocationRequestId than Container Major . Chandni Singh Chandni Singh
YARN-7674 Update Timeline Reader web app address in UI2 Major . Rohith Sharma K S Sunil Govindan
YARN-7577 Unit Fail: TestAMRestart#testPreemptedAMRestartOnRMRestart Major . Miklos Szegedi Miklos Szegedi
HDFS-12949 Fix findbugs warning in ImageWriter.java Major . Akira Ajisaka Akira Ajisaka
HDFS-12938 TestErasureCodigCLI testAll failing consistently. Major erasure-coding, hdfs Rushabh S Shah Ajay Kumar
HDFS-12951 Incorrect javadoc in SaslDataTransferServer.java#receive Major encryption Mukul Kumar Singh Mukul Kumar Singh
HDFS-12959 Fix TestOpenFilesWithSnapshot redundant configurations Minor hdfs Manoj Govindassamy Manoj Govindassamy
YARN-7542 Fix issue that causes some Running Opportunistic Containers to be recovered as PAUSED Major . Arun Suresh Sampada Dehankar
HDFS-12915 Fix findbugs warning in INodeFile$HeaderFormat.getBlockLayoutRedundancy Major namenode Wei-Chiu Chuang Chris Douglas
YARN-7555 Support multiple resource types in YARN native services Critical yarn-native-services Wangda Tan Wangda Tan
HADOOP-15122 Lock down version of doxia-module-markdown plugin Blocker . Elek, Marton Elek, Marton
HADOOP-15143 NPE due to Invalid KerberosTicket in UGI Major . Jitendra Nath Pandey Mukul Kumar Singh
HADOOP-15152 Typo in javadoc of ReconfigurableBase#reconfigurePropertyImpl Trivial common Nanda kumar Nanda kumar
HADOOP-15155 Error in javadoc of ReconfigurableBase#reconfigureProperty Minor . Ajay Kumar Ajay Kumar
YARN-7585 NodeManager should go unhealthy when state store throws DBException Major nodemanager Wilfred Spiegelenburg Wilfred Spiegelenburg
YARN-6894 RM Apps API returns only active apps when query parameter queue used Minor resourcemanager, restapi Grant Sohn Gergely Novák
YARN-7692 Skip validating priority acls while recovering applications Blocker resourcemanager Charan Hebri Sunil Govindan
MAPREDUCE-7028 Concurrent task progress updates causing NPE in Application Master Blocker mr-am Gergo Repas Gergo Repas
YARN-7602 NM should reference the singleton JvmMetrics instance Major nodemanager Haibo Chen Haibo Chen
HADOOP-15093 Deprecation of yarn.resourcemanager.zk-address is undocumented Major documentation Namit Maheshwari Ajay Kumar
HDFS-12931 Handle InvalidEncryptionKeyException during DistributedFileSystem#getFileChecksum Major encryption Mukul Kumar Singh Mukul Kumar Singh
HDFS-12948 DiskBalancer report command top option should only take positive numeric values Minor diskbalancer Namit Maheshwari Shashikant Banerjee
HDFS-12913 TestDNFencingWithReplication.testFencingStress fix mini cluster not yet active issue Major . Zsolt Venczel Zsolt Venczel
HDFS-12987 Document - Disabling the Lazy persist file scrubber. Trivial documentation, hdfs Karthik Palanisamy Karthik Palanisamy
HDFS-12860 StripedBlockUtil#getRangesInternalBlocks throws exception for the block group size larger than 2GB Major erasure-coding Lei (Eddy) Xu Lei (Eddy) Xu
YARN-7619 Max AM Resource value in Capacity Scheduler UI has to be refreshed for every user Major capacity scheduler, yarn Eric Payne Eric Payne
YARN-7645 TestContainerResourceUsage#testUsageAfterAMRestartWithMultipleContainers is flakey with FairScheduler Major test Robert Kanter Robert Kanter
YARN-7699 queueUsagePercentage is coming as INF for getApp REST api call Major webapp Sunil Govindan Sunil Govindan
HDFS-12985 NameNode crashes during restart after an OpenForWrite file present in the Snapshot got deleted Major hdfs Manoj Govindassamy Manoj Govindassamy
YARN-4227 Ignore expired containers from removed nodes in FairScheduler Critical fairscheduler Wilfred Spiegelenburg Wilfred Spiegelenburg
YARN-7718 DistributedShell failed to specify resource other than memory/vcores from container_resources Critical . Wangda Tan Wangda Tan
YARN-7508 NPE in FiCaSchedulerApp when debug log enabled in async-scheduling mode Major capacityscheduler Tao Yang Tao Yang
YARN-7663 RMAppImpl:Invalid event: START at KILLED Major resourcemanager lujie lujie
YARN-6948 Invalid event: ATTEMPT_ADDED at FINAL_SAVING Major yarn lujie lujie
HDFS-12994 TestReconstructStripedFile.testNNSendsErasureCodingTasks fails due to socket timeout Major erasure-coding Lei (Eddy) Xu Lei (Eddy) Xu
YARN-7665 Allow FS scheduler state dump to be turned on/off separately from FS debug log Major . Wilfred Spiegelenburg Wilfred Spiegelenburg
YARN-7689 TestRMContainerAllocator fails after YARN-6124 Major scheduler Wilfred Spiegelenburg Wilfred Spiegelenburg
HADOOP-15163 Fix S3ACommitter documentation Minor documentation, fs/s3 Alessandro Andrioni Alessandro Andrioni
HADOOP-15060 TestShellBasedUnixGroupsMapping.testFiniteGroupResolutionTime flaky Major . Miklos Szegedi Miklos Szegedi
YARN-7735 Fix typo in YARN documentation Minor documentation Takanobu Asanuma Takanobu Asanuma
YARN-7727 Incorrect log levels in few logs with QueuePriorityContainerCandidateSelector Minor yarn Prabhu Joseph Prabhu Joseph
HDFS-12984 BlockPoolSlice can leak in a mini dfs cluster Major . Robert Joseph Evans Ajay Kumar
HDFS-11915 Sync rbw dir on the first hsync() to avoid file lost on power failure Critical . Kanaka Kumar Avvaru Vinayakumar B
YARN-7731 RegistryDNS should handle upstream DNS returning CNAME Major . Billie Rinaldi Eric Yang
YARN-7671 Improve Diagonstic message for stop yarn native service Major . Yesha Vora Chandni Singh
YARN-7705 Create the container log directory with correct sticky bit in C code Major nodemanager Yufei Gu Yufei Gu
HDFS-13016 globStatus javadoc refers to glob pattern as “regular expression” Trivial documentation, hdfs Ryanne Dolan Mukul Kumar Singh
HADOOP-15172 Fix the javadoc warning in WriteOperationHelper.java Minor documentation, fs/s3 Mukul Kumar Singh Mukul Kumar Singh
YARN-7479 TestContainerManagerSecurity.testContainerManager[Simple] flaky in trunk Major test Botong Huang Akira Ajisaka
HDFS-13004 TestLeaseRecoveryStriped#testLeaseRecovery is failing when safeLength is 0MB or larger than the test file Major hdfs Zsolt Venczel Zsolt Venczel
HDFS-9049 Make Datanode Netty reverse proxy port to be configurable Major datanode Vinayakumar B Vinayakumar B
YARN-7758 Add an additional check to the validity of container and application ids passed to container-executor Major nodemanager Miklos Szegedi Yufei Gu
YARN-7717 Add configuration consistency for module.enabled and docker.privileged-containers.enabled Major . Yesha Vora Eric Badger
HADOOP-15150 in FsShell, UGI params should be overidden through env vars(-D arg) Major . Brahma Reddy Battula Brahma Reddy Battula
YARN-7750 [UI2] Render time related fields in all pages to the browser timezone Major yarn-ui-v2 Vasudevan Skm Vasudevan Skm
YARN-7740 Fix logging for destroy yarn service cli when app does not exist and some minor bugs Major yarn-native-services Yesha Vora Jian He
YARN-7139 FairScheduler: finished applications are always restored to default queue Major fairscheduler Wilfred Spiegelenburg Wilfred Spiegelenburg
YARN-7753 [UI2] Meta information about Application logs has to be pulled from ATS 1.5 instead of ATS2 Major yarn-ui-v2 Sunil Govindan Sunil Govindan
HADOOP-14788 Credentials readTokenStorageFile to stop wrapping IOEs in IOEs Minor security Steve Loughran Ajay Kumar
HDFS-13039 StripedBlockReader#createBlockReader leaks socket on IOException Critical datanode, erasure-coding Lei (Eddy) Xu Lei (Eddy) Xu
HADOOP-15181 Typo in SecureMode.md Trivial documentation Masahiro Tanaka Masahiro Tanaka
YARN-7738 CapacityScheduler: Support refresh maximum allocation for multiple resource types Blocker . Sumana Sathish Wangda Tan
YARN-7766 Introduce a new config property for YARN Service dependency tarball location Major applications, client, yarn-native-services Gour Saha Gour Saha
HDFS-12963 Error log level in ShortCircuitRegistry#removeShm Minor . hu xiaodong hu xiaodong
YARN-7796 Container-executor fails with segfault on certain OS configurations Major nodemanager Gergo Repas Gergo Repas
YARN-7749 [UI2] GPU information tab in left hand side disappears when we click other tabs below Major . Sumana Sathish Vasudevan Skm
YARN-7806 Distributed Shell should use timeline async api’s Major distributed-shell Sumana Sathish Rohith Sharma K S
HDFS-13023 Journal Sync does not work on a secure cluster Major journal-node Namit Maheshwari Bharat Viswanadham
HADOOP-15121 Encounter NullPointerException when using DecayRpcScheduler Major . Tao Jie Tao Jie
MAPREDUCE-7015 Possible race condition in JHS if the job is not loaded Major jobhistoryserver Peter Bacsko Peter Bacsko
YARN-7737 prelaunch.err file not found exception on container failure Major . Jonathan Hung Keqiu Hu
YARN-7777 Fix user name format in YARN Registry DNS name Major . Jian He Jian He
YARN-7628 [Documentation] Documenting the ability to disable elasticity at leaf queue Major capacity scheduler Zian Chen Zian Chen
HDFS-13063 Fix the incorrect spelling in HDFSHighAvailabilityWithQJM.md Trivial documentation Jianfei Jiang Jianfei Jiang
YARN-7102 NM heartbeat stuck when responseId overflows MAX_INT Critical . Botong Huang Botong Huang
MAPREDUCE-7041 MR should not try to clean up at first job attempt Major . Takanobu Asanuma Gergo Repas
YARN-7742 [UI2] Duplicated containers are rendered per attempt Major . Rohith Sharma K S Vasudevan Skm
YARN-7760 [UI2] Clicking ‘Master Node’ or link next to ‘AM Node Web UI’ under application’s appAttempt page goes to OLD RM UI Major . Sumana Sathish Vasudevan Skm
MAPREDUCE-7020 Task timeout in uber mode can crash AM Major mr-am Akira Ajisaka Peter Bacsko
YARN-7765 [Atsv2] GSSException: No valid credentials provided - Failed to find any Kerberos tgt thrown by Timelinev2Client & HBaseClient in NM Blocker . Sumana Sathish Rohith Sharma K S
HDFS-13065 TestErasureCodingMultipleRacks#testSkewedRack3 is failing Major hdfs Gabor Bota Gabor Bota
HDFS-12974 Exception message is not printed when creating an encryption zone fails with AuthorizationException Minor encryption fang zhenyi fang zhenyi
YARN-7698 A misleading variable’s name in ApplicationAttemptEventDispatcher Minor resourcemanager Jinjiang Ling Jinjiang Ling
YARN-7790 Improve Capacity Scheduler Async Scheduling to better handle node failures Critical . Sumana Sathish Wangda Tan
HDFS-12528 Add an option to not disable short-circuit reads on failures Major hdfs-client, performance Andre Araujo Xiao Chen
YARN-7861 [UI2] Logs page shows duplicated containers with ATS Major yarn-ui-v2 Sunil Govindan Sunil Govindan
YARN-7828 Clicking on yarn service should take to component tab Major yarn-ui-v2 Yesha Vora Sunil Govindan
HDFS-13061 SaslDataTransferClient#checkTrustAndSend should not trust a partially trusted channel Major . Xiaoyu Yao Ajay Kumar
HDFS-13060 Adding a BlacklistBasedTrustedChannelResolver for TrustedChannelResolver Major datanode, security Xiaoyu Yao Ajay Kumar
HDFS-12897 getErasureCodingPolicy should handle .snapshot dir better Major erasure-coding, hdfs, snapshots Harshakiran Reddy LiXin Ge
MAPREDUCE-7033 Map outputs implicitly rely on permissive umask for shuffle Critical mrv2 Jason Lowe Jason Lowe
HDFS-13048 LowRedundancyReplicatedBlocks metric can be negative Major metrics Akira Ajisaka Akira Ajisaka
HADOOP-15198 Correct the spelling in CopyFilter.java Major tools/distcp Mukul Kumar Singh Mukul Kumar Singh
YARN-7831 YARN Service CLI should use hadoop.http.authentication.type to determine authentication method Major . Eric Yang Eric Yang
YARN-7879 NM user is unable to access the application filecache due to permissions Critical . Shane Kumpf Jason Lowe
HDFS-13100 Handle IllegalArgumentException when GETSERVERDEFAULTS is not implemented in webhdfs. Critical hdfs, webhdfs Yongjun Zhang Yongjun Zhang
YARN-7876 Localized jars that are expanded after localization are not fully copied Blocker . Miklos Szegedi Miklos Szegedi
YARN-7849 TestMiniYarnClusterNodeUtilization#testUpdateNodeUtilization fails due to heartbeat sync error Major test Jason Lowe Botong Huang
YARN-7801 AmFilterInitializer should addFilter after fill all parameters Critical . Sumana Sathish Wangda Tan
YARN-7889 Missing kerberos token when check for RM REST API availability Major yarn-native-services Eric Yang Eric Yang
YARN-7850 [UI2] Log Aggregation status to be displayed in Application Page Major yarn-ui-v2 Yesha Vora Gergely Novák
YARN-7866 [UI2] Error to be displayed correctly while accessing kerberized cluster without kinit Major yarn-ui-v2 Sumana Sathish Sunil Govindan
YARN-7890 NPE during container relaunch Major . Billie Rinaldi Jason Lowe
HDFS-11701 NPE from Unresolved Host causes permanent DFSInputStream failures Major hdfs-client James Moore Lokesh Jain
HDFS-13115 In getNumUnderConstructionBlocks(), ignore the inodeIds for which the inodes have been deleted Major . Yongjun Zhang Yongjun Zhang
HDFS-12935 Get ambiguous result for DFSAdmin command in HA mode when only one namenode is up Major tools Jianfei Jiang Jianfei Jiang
YARN-7827 Stop and Delete Yarn Service from RM UI fails with HTTP ERROR 404 Critical yarn-ui-v2 Yesha Vora Sunil Govindan
HDFS-13120 Snapshot diff could be corrupted after concat Major namenode, snapshots Xiaoyu Yao Xiaoyu Yao
YARN-7909 YARN service REST API returns charset=null when kerberos enabled Major yarn-native-services Eric Yang Eric Yang
HDFS-13130 Log object instance get incorrectly in SlowDiskTracker Minor . Jianfei Jiang Jianfei Jiang
YARN-7906 Fix mvn site fails with error: Multiple sources of package comments found for package “o.a.h.y.client.api.impl” Blocker build, documentation Akira Ajisaka Akira Ajisaka
YARN-5848 Remove unnecessary public/crossdomain.xml from YARN UIv2 sub project Blocker yarn-ui-v2 Allen Wittenauer Sunil Govindan
YARN-7697 NM goes down with OOM due to leak in log-aggregation Blocker . Santhosh B Gowda Xuan Gong
YARN-7739 DefaultAMSProcessor should properly check customized resource types against minimum/maximum allocation Blocker . Wangda Tan Wangda Tan
HDFS-10453 ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster. Major namenode He Xiaoqiao He Xiaoqiao
HDFS-8693 refreshNamenodes does not support adding a new standby to a running DN Critical datanode, ha Jian Fang Ajith S
MAPREDUCE-7052 TestFixedLengthInputFormat#testFormatCompressedIn is flaky Major client, test Peter Bacsko Peter Bacsko
HDFS-13112 Token expiration edits may cause log corruption or deadlock Critical namenode Daryn Sharp Daryn Sharp
HDFS-13151 Fix the javadoc error in ReplicaInfo Minor . Bharat Viswanadham Bharat Viswanadham
MAPREDUCE-7053 Timed out tasks can fail to produce thread dump Major . Jason Lowe Jason Lowe
HDFS-13058 Fix dfs.namenode.shared.edits.dir in TestJournalNode Major journal-node, test Bharat Viswanadham Bharat Viswanadham
HADOOP-15206 BZip2 drops and duplicates records when input split size is small Major . Aki Tanaka Aki Tanaka
YARN-7937 Fix http method name in Cluster Application Timeout Update API example request Minor docs, documentation Charan Hebri Charan Hebri
HADOOP-15223 Replace Collections.EMPTY* with empty* when available Minor . Akira Ajisaka fang zhenyi
HDFS-13159 TestTruncateQuotaUpdate fails in trunk Major test Arpit Agarwal Nanda kumar
YARN-7947 Capacity Scheduler intra-queue preemption can NPE for non-schedulable apps Major capacity scheduler, scheduler preemption Eric Payne Eric Payne
HADOOP-10571 Use Log.*(Object, Throwable) overload to log exceptions Major . Arpit Agarwal Andras Bokor
HADOOP-6852 apparent bug in concatenated-bzip2 support (decoding) Major io Greg Roelofs Zsolt Venczel
YARN-7942 Yarn ServiceClient does not not delete znode from secure ZooKeeper Blocker yarn-native-services Eric Yang Billie Rinaldi
HADOOP-15236 Fix typo in RequestHedgingProxyProvider and RequestHedgingRMFailoverProxyProvider Trivial documentation Akira Ajisaka Gabor Bota
YARN-7675 [UI2] Support loading pre-2.8 version /scheduler REST response for queue page Major yarn-ui-v2 Gergely Novák Gergely Novák
YARN-7949 [UI2] ArtifactsId should not be a compulsory field for new service Major yarn-ui-v2 Yesha Vora Yesha Vora
YARN-5714 ContainerExecutor does not order environment map Trivial nodemanager Remi Catherinot Remi Catherinot
MAPREDUCE-7027 HadoopArchiveLogs shouldn’t delete the original logs if the HAR creation fails Critical mrv2 Gergely Novák Gergely Novák
HDFS-12865 RequestHedgingProxyProvider should handle case when none of the proxies are available Major ha Mukul Kumar Singh Mukul Kumar Singh
HADOOP-15254 Correct the wrong word spelling ‘intialize’ Minor . fang zhenyi fang zhenyi
HDFS-12781 After Datanode down, In Namenode UI Datanode tab is throwing warning message. Major datanode Harshakiran Reddy Brahma Reddy Battula
HDFS-12070 Failed block recovery leaves files open indefinitely and at risk for data loss Major . Daryn Sharp Kihwal Lee
HADOOP-15265 Exclude json-smart explicitly in hadoop-auth avoid being pulled in transitively Major . Nishant Bangarwa Nishant Bangarwa
YARN-7963 TestServiceAM and TestServiceMonitor test cases are hanging Major yarn-native-services Eric Yang Chandni Singh
HDFS-13145 SBN crash when transition to ANN with in-progress edit tailing enabled Major ha, namenode Chao Sun Chao Sun
HDFS-13181 DiskBalancer: Add an configuration for valid plan hours Major diskbalancer Bharat Viswanadham Bharat Viswanadham
HDFS-13143 SnapshotDiff - snapshotDiffReport might be inconsistent if the snapshotDiff calculation happens between a snapshot and the current tree Major snapshots Shashikant Banerjee Shashikant Banerjee
HDFS-13194 CachePool permissions incorrectly checked Major . Yiqun Lin Jianfei Jiang
HDFS-13114 CryptoAdmin#ReencryptZoneCommand should resolve Namespace info from path Major encryption, hdfs Hanisha Koneru Hanisha Koneru
HDFS-13081 Datanode#checkSecureConfig should allow SASL and privileged HTTP Major datanode, security Xiaoyu Yao Ajay Kumar
YARN-7985 Service name is validated twice in ServiceClient when a service is created Trivial yarn-native-services Chandni Singh Chandni Singh
MAPREDUCE-7059 Downward Compatibility issue: MR job fails because of unknown setErasureCodingPolicy method from 3.x client to HDFS 2.x cluster Critical job submission Jiandan Yang Jiandan Yang
YARN-7835 [Atsv2] Race condition in NM while publishing events if second attempt is launched on the same node Critical . Rohith Sharma K S Rohith Sharma K S
HADOOP-15275 Incorrect javadoc for return type of RetryPolicy#shouldRetry Minor documentation Nanda kumar Nanda kumar
YARN-7958 ServiceMaster should only wait for recovery of containers with id that match the current application id Critical yarn Chandni Singh Chandni Singh
HDFS-13211 Fix a bug in DirectoryDiffList.getMinListForRange Major snapshots Shashikant Banerjee Shashikant Banerjee
HDFS-13210 Fix the typo in MiniDFSCluster class Trivial test Yiqun Lin fang zhenyi
YARN-7511 NPE in ContainerLocalizer when localization failed for running container Major nodemanager Tao Yang Tao Yang
HADOOP-15261 Upgrade commons-io from 2.4 to 2.5 Major minikdc PandaMonkey PandaMonkey
MAPREDUCE-7023 TestHadoopArchiveLogs.testCheckFilesAndSeedApps fails on rerun Minor test Gergely Novák Gergely Novák
HDFS-13178 Disk Balancer: Add skipDateCheck option to DiskBalancer Execute command Major diskbalancer Bharat Viswanadham Bharat Viswanadham
HADOOP-15286 Remove unused imports from TestKMSWithZK.java Minor test Akira Ajisaka Ajay Kumar
YARN-7995 Remove unnecessary boxings and unboxings from PlacementConstraintParser.java Minor . Akira Ajisaka Sen Zhao
HDFS-13040 Kerberized inotify client fails despite kinit properly Major namenode Wei-Chiu Chuang Xiao Chen
HADOOP-15288 TestSwiftFileSystemBlockLocation doesn’t compile Critical build, fs/swift Steve Loughran Steve Loughran
YARN-7736 Fix itemization in YARN federation document Minor documentation Akira Ajisaka Sen Zhao
HDFS-13164 File not closed if streamer fail with DSQuotaExceededException Major hdfs-client Xiao Chen Xiao Chen
HADOOP-15289 FileStatus.readFields() assertion incorrect Critical . Steve Loughran Steve Loughran
HDFS-13188 Disk Balancer: Support multiple block pools during block move Major diskbalancer Bharat Viswanadham Bharat Viswanadham
HDFS-13109 Support fully qualified hdfs path in EZ commands Major hdfs Hanisha Koneru Hanisha Koneru
HADOOP-15296 Fix a wrong link for RBF in the top page Minor documentation Takanobu Asanuma Takanobu Asanuma
YARN-8011 TestOpportunisticContainerAllocatorAMService#testContainerPromoteAndDemoteBeforeContainerStart fails sometimes in trunk Minor . Tao Yang Tao Yang
HADOOP-15292 Distcp’s use of pread is slowing it down. Minor tools/distcp Virajith Jalaparti Virajith Jalaparti
HADOOP-15273 distcp can’t handle remote stores with different checksum algorithms Critical tools/distcp Steve Loughran Steve Loughran
HADOOP-15280 TestKMS.testWebHDFSProxyUserKerb and TestKMS.testWebHDFSProxyUserSimple fail in trunk Major . Ray Chiang Bharat Viswanadham
YARN-7944 [UI2] Remove master node link from headers of application pages Major yarn-ui-v2 Yesha Vora Yesha Vora
MAPREDUCE-6930 mapreduce.map.cpu.vcores and mapreduce.reduce.cpu.vcores are both present twice in mapred-default.xml Major mrv2 Daniel Templeton Sen Zhao
YARN-8000 Yarn Service: component instance name shows up as component name in container record Major . Chandni Singh Chandni Singh
HDFS-13190 Document WebHDFS support for snapshot diff Major documentation, webhdfs Xiaoyu Yao Lokesh Jain
HDFS-13244 Add stack, conf, metrics links to utilities dropdown in NN webUI Major . Bharat Viswanadham Bharat Viswanadham
HDFS-10618 TestPendingReconstruction#testPendingAndInvalidate is flaky due to race condition Major . Eric Badger Eric Badger
YARN-8024 LOG in class MaxRunningAppsEnforcer is initialized with a faulty class FairScheduler Major fairscheduler Yufei Gu Sen Zhao
HDFS-10803 TestBalancerWithMultipleNameNodes#testBalancing2OutOf3Blockpools fails intermittently due to no free space available Major . Yiqun Lin Yiqun Lin
HDFS-12156 TestFSImage fails without -Pnative Major test Akira Ajisaka Akira Ajisaka
HDFS-13271 WebHDFS: Add constructor in SnapshottableDirectoryStatus with HdfsFileStatus as argument Major webhdfs Lokesh Jain Lokesh Jain
HDFS-13239 Fix non-empty dir warning message when setting default EC policy Minor . Hanisha Koneru Bharat Viswanadham
YARN-8022 ResourceManager UI cluster/app/<app-id> page fails to render Blocker webapp Tarun Parimi Tarun Parimi
HDFS-13249 Document webhdfs support for getting snapshottable directory list Major documentation, webhdfs Lokesh Jain Lokesh Jain
MAPREDUCE-7064 Flaky test TestTaskAttempt#testReducerCustomResourceTypes Major client, test Peter Bacsko Peter Bacsko
HDFS-13261 Fix incorrect null value check Minor hdfs Jianfei Jiang Jianfei Jiang
HADOOP-15305 Replace FileUtils.writeStringToFile(File, String) with (File, String, Charset) to fix deprecation warnings Minor . Akira Ajisaka fang zhenyi
HDFS-12723 TestReadStripedFileWithMissingBlocks#testReadFileWithMissingBlocks failing consistently. Major . Rushabh S Shah Ajay Kumar
HDFS-13251 Avoid using hard coded datanode data dirs in unit tests Major test Xiaoyu Yao Ajay Kumar
HDFS-13280 WebHDFS: Fix NPE in get snasphottable directory list call Major webhdfs Lokesh Jain Lokesh Jain
YARN-7952 RM should be able to recover log aggregation status after restart/fail-over Major . Xuan Gong Xuan Gong
HADOOP-15234 Throw meaningful message on null when initializing KMSWebApp Major kms Xiao Chen fang zhenyi
YARN-7636 Re-reservation count may overflow when cluster resource exhausted for a long time Major capacityscheduler Tao Yang Tao Yang
HDFS-12886 Ignore minReplication for block recovery Major hdfs, namenode Lukas Majercak Lukas Majercak
YARN-8039 Clean up log dir configuration in TestLinuxContainerExecutorWithMocks.testStartLocalizer Minor . Miklos Szegedi Miklos Szegedi
HDFS-13296 GenericTestUtils generates paths with drive letter in Windows and fail webhdfs related test cases Major . Xiao Liang Xiao Liang
HDFS-13268 TestWebHdfsFileContextMainOperations fails on Windows Major . Íñigo Goiri Xiao Liang
YARN-8054 Improve robustness of the LocalDirsHandlerService MonitoringTimerTask thread Major . Jonathan Eagles Jonathan Eagles
YARN-7873 Revert YARN-6078 Blocker . Billie Rinaldi Billie Rinaldi
HDFS-13195 DataNode conf page cannot display the current value after reconfig Minor datanode maobaolong maobaolong
HADOOP-14067 VersionInfo should load version-info.properties from its own classloader Major common Thejas M Nair Thejas M Nair
YARN-8063 DistributedShellTimelinePlugin wrongly check for entityId instead of entityType Major . Rohith Sharma K S Rohith Sharma K S
YARN-8062 yarn rmadmin -getGroups returns group from which the user has been removed Critical . Sumana Sathish Sunil Govindan
YARN-8068 Application Priority field causes NPE in app timeline publish when Hadoop 2.7 based clients to 2.8+ Blocker yarn Sunil Govindan Sunil Govindan
YARN-8075 DShell does not fail when we ask more GPUs than available even though AM throws ‘InvalidResourceRequestException’ Major . Sumana Sathish Wangda Tan
HADOOP-15320 Remove customized getFileBlockLocations for hadoop-azure and hadoop-azure-datalake Major fs/adl, fs/azure shanyu zhao shanyu zhao
YARN-8085 ResourceProfilesManager should be set in RMActiveServiceContext Blocker capacityscheduler Tao Yang Tao Yang
YARN-8086 ManagedParentQueue with no leaf queues cause JS error in new UI Blocker . Suma Shivaprasad Suma Shivaprasad
YARN-6629 NPE occurred when container allocation proposal is applied but its resource requests are removed before Critical . Tao Yang Tao Yang
MAPREDUCE-7036 ASF License warning in hadoop-mapreduce-client Minor test Takanobu Asanuma Takanobu Asanuma
YARN-7527 Over-allocate node resource in async-scheduling mode of CapacityScheduler Major capacityscheduler Tao Yang Tao Yang
YARN-7598 Document how to use classpath isolation for aux-services in YARN Major . Xuan Gong Xuan Gong
HDFS-13136 Avoid taking FSN lock while doing group member lookup for FSD permission check Major namenode Xiaoyu Yao Xiaoyu Yao
HADOOP-15450 Avoid fsync storm triggered by DiskChecker and handle disk full situation Blocker . Kihwal Lee Arpit Agarwal
YARN-8346 Upgrading to 3.1 kills running containers with error “Opportunistic container queue is full” Blocker . Rohith Sharma K S Jason Lowe
HADOOP-9747 Reduce unnecessary UGI synchronization Critical security Daryn Sharp Daryn Sharp

TESTS:

JIRA Summary Priority Component Reporter Contributor
MAPREDUCE-6953 Skip the testcase testJobWithChangePriority if FairScheduler is used Major client Peter Bacsko Peter Bacsko
HDFS-12730 Verify open files captured in the snapshots across config disable and enable Major hdfs Manoj Govindassamy Manoj Govindassamy
HADOOP-15117 open(PathHandle) contract test should be exhaustive for default options Major . Chris Douglas Chris Douglas
HDFS-13106 Need to exercise all HDFS APIs for EC Major hdfs Haibo Yan Haibo Yan
HDFS-13107 Add Mover Cli Unit Tests for Federated cluster Major balancer & mover, test Bharat Viswanadham Bharat Viswanadham
HDFS-13550 TestDebugAdmin#testComputeMetaCommand fails on Windows Minor . Anbang Hu Anbang Hu

SUB-TASKS:

JIRA Summary Priority Component Reporter Contributor
YARN-4081 Add support for multiple resource types in the Resource class Major resourcemanager Varun Vasudev Varun Vasudev
YARN-4172 Extend DominantResourceCalculator to account for all resources Major resourcemanager Varun Vasudev Varun Vasudev
YARN-4715 Add support to read resource types from a config file Major nodemanager, resourcemanager Varun Vasudev Varun Vasudev
YARN-4829 Add support for binary units Major nodemanager, resourcemanager Varun Vasudev Varun Vasudev
YARN-4830 Add support for resource types in the nodemanager Major nodemanager Varun Vasudev Varun Vasudev
YARN-5242 Update DominantResourceCalculator to consider all resource types in calculations Major resourcemanager Varun Vasudev Varun Vasudev
YARN-5586 Update the Resources class to consider all resource types Major nodemanager, resourcemanager Varun Vasudev Varun Vasudev
YARN-5707 Add manager class for resource profiles Major resourcemanager Varun Vasudev Varun Vasudev
YARN-5708 Implement APIs to get resource profiles from the RM Major client Varun Vasudev Varun Vasudev
YARN-5587 Add support for resource profiles Major nodemanager, resourcemanager Varun Vasudev Varun Vasudev
YARN-5951 Changes to allow CapacityScheduler to use configuration store Major . Jonathan Hung Jonathan Hung
YARN-5946 Create YarnConfigurationStore interface and InMemoryConfigurationStore class Major . Jonathan Hung Jonathan Hung
YARN-5588 Add support for resource profiles in distributed shell Major nodemanager, resourcemanager Varun Vasudev Varun Vasudev
YARN-6232 Update resource usage and preempted resource calculations to take into account all resource types Major resourcemanager Varun Vasudev Varun Vasudev
YARN-5948 Implement MutableConfigurationManager for handling storage into configuration store Major . Jonathan Hung Jonathan Hung
YARN-5952 Create REST API for changing YARN scheduler configurations Major . Jonathan Hung Jonathan Hung
HDFS-10706 [READ] Add tool generating FSImage from external store Major namenode, tools Chris Douglas Chris Douglas
YARN-6445 [YARN-3926] Performance improvements in resource profile branch with respect to SLS Major nodemanager, resourcemanager Varun Vasudev Varun Vasudev
HDFS-11653 [READ] ProvidedReplica should return an InputStream that is bounded by its length Major . Virajith Jalaparti Virajith Jalaparti
HDFS-11663 [READ] Fix NullPointerException in ProvidedBlocksBuilder Major . Virajith Jalaparti Virajith Jalaparti
HDFS-11703 [READ] Tests for ProvidedStorageMap Major . Virajith Jalaparti Virajith Jalaparti
YARN-5949 Add pluggable configuration ACL policy interface and implementation Major . Jonathan Hung Jonathan Hung
HDFS-11791 [READ] Test for increasing replication of provided files. Major . Virajith Jalaparti Virajith Jalaparti
HDFS-11792 [READ] Test cases for ProvidedVolumeDF and ProviderBlockIteratorImpl Major . Virajith Jalaparti Virajith Jalaparti
HDFS-11673 [READ] Handle failures of Datanode with PROVIDED storage Major . Virajith Jalaparti Virajith Jalaparti
YARN-6575 Support global configuration mutation in MutableConfProvider Major . Jonathan Hung Jonathan Hung
YARN-5953 Create CLI for changing YARN configurations Major . Jonathan Hung Jonathan Hung
YARN-6761 Fix build for YARN-3926 branch Major nodemanager, resourcemanager Varun Vasudev Varun Vasudev
YARN-6786 ResourcePBImpl imports cleanup Trivial resourcemanager Daniel Templeton Yeliang Cang
YARN-5947 Create LeveldbConfigurationStore class using Leveldb as backing store Major . Jonathan Hung Jonathan Hung
YARN-6322 Disable queue refresh when configuration mutation is enabled Major . Jonathan Hung Jonathan Hung
YARN-6593 [API] Introduce Placement Constraint object Major . Konstantinos Karanasos Konstantinos Karanasos
YARN-6788 Improve performance of resource profile branch Blocker nodemanager, resourcemanager Sunil Govindan Sunil Govindan
HDFS-12091 [READ] Check that the replicas served from a {{ProvidedVolumeImpl}} belong to the correct external storage Major . Virajith Jalaparti Virajith Jalaparti
HDFS-12093 [READ] Share remoteFS between ProvidedReplica instances. Major . Ewan Higgs Virajith Jalaparti
YARN-6471 Support to add min/max resource configuration for a queue Major capacity scheduler Sunil Govindan Sunil Govindan
YARN-6935 ResourceProfilesManagerImpl.parseResource() has no need of the key parameter Major resourcemanager Daniel Templeton Manikandan R
HDFS-12289 [READ] HDFS-12091 breaks the tests for provided block reads Major . Virajith Jalaparti Virajith Jalaparti
YARN-6994 Remove last uses of Long from resource types code Minor resourcemanager Daniel Templeton Daniel Templeton
YARN-6892 Improve API implementation in Resources and DominantResourceCalculator class Major nodemanager, resourcemanager Sunil Govindan Sunil Govindan
YARN-6908 ResourceProfilesManagerImpl is missing @Overrides on methods Minor resourcemanager Daniel Templeton Sunil Govindan
YARN-6610 DominantResourceCalculator#getResourceAsValue dominant param is updated to handle multiple resources Critical resourcemanager Daniel Templeton Daniel Templeton
YARN-7030 Performance optimizations in Resource and ResourceUtils class Critical nodemanager, resourcemanager Wangda Tan Wangda Tan
YARN-7042 Clean up unit tests after YARN-6610 Major test Daniel Templeton Daniel Templeton
YARN-6789 Add Client API to get all supported resource types from RM Major nodemanager, resourcemanager Sunil Govindan Sunil Govindan
YARN-6781 ResourceUtils#initializeResourcesMap takes an unnecessary Map parameter Minor resourcemanager Daniel Templeton Yu-Tang Lin
YARN-7043 Cleanup ResourceProfileManager Critical . Wangda Tan Wangda Tan
YARN-7067 Optimize ResourceType information display in UI Critical nodemanager, resourcemanager Wangda Tan Wangda Tan
YARN-7039 Fix javac and javadoc errors in YARN-3926 branch Major nodemanager, resourcemanager Sunil Govindan Sunil Govindan
YARN-7024 Fix issues on recovery in LevelDB store Major . Jonathan Hung Jonathan Hung
YARN-7093 Improve log message in ResourceUtils Trivial nodemanager, resourcemanager Sunil Govindan Sunil Govindan
YARN-7075 Better styling for donut charts in new YARN UI Major . Da Ding Da Ding
HADOOP-14103 Sort out hadoop-aws contract-test-options.xml Minor fs/s3, test Steve Loughran John Zhuge
YARN-6933 ResourceUtils.DISALLOWED_NAMES check is duplicated Major resourcemanager Daniel Templeton Manikandan R
YARN-5328 Plan/ResourceAllocation data structure enhancements required to support recurring reservations in ReservationSystem Major resourcemanager Subru Krishnan Subru Krishnan
YARN-7056 Document Resource Profiles feature Major nodemanager, resourcemanager Sunil Govindan Sunil Govindan
YARN-7144 Log Aggregation controller should not swallow the exceptions when it calls closeWriter and closeReader. Major . Xuan Gong Xuan Gong
YARN-7104 Improve Nodes Heatmap in new YARN UI with better color coding Major . Da Ding Da Ding
YARN-6600 Introduce default and max lifetime of application at LeafQueue level Major capacity scheduler Rohith Sharma K S Rohith Sharma K S
YARN-5330 SharingPolicy enhancements required to support recurring reservations in ReservationSystem Major resourcemanager Subru Krishnan Carlo Curino
YARN-7072 Add a new log aggregation file format controller Major . Xuan Gong Xuan Gong
YARN-7136 Additional Performance Improvement for Resource Profile Feature Critical nodemanager, resourcemanager Wangda Tan Wangda Tan
YARN-7137 Move newly added APIs to unstable in YARN-3926 branch Blocker nodemanager, resourcemanager Wangda Tan Wangda Tan
YARN-7194 Log aggregation status is always Failed with the newly added log aggregation IndexedFileFormat Major . Xuan Gong Xuan Gong
YARN-6612 Update fair scheduler policies to be aware of resource types Major fairscheduler Daniel Templeton Daniel Templeton
YARN-7174 Add retry logic in LogsCLI when fetch running application logs Major . Xuan Gong Xuan Gong
YARN-6840 Implement zookeeper based store for scheduler configuration updates Major . Wangda Tan Jonathan Hung
HDFS-12473 Change hosts JSON file format Major . Ming Ma Ming Ma
HDFS-11035 Better documentation for maintenace mode and upgrade domain Major datanode, documentation Wei-Chiu Chuang Ming Ma
YARN-7046 Add closing logic to configuration store Major . Jonathan Hung Jonathan Hung
MAPREDUCE-6947 Moving logging APIs over to slf4j in hadoop-mapreduce-examples Major . Gergely Novák Gergely Novák
HADOOP-14894 ReflectionUtils should use Time.monotonicNow to mesaure duration Minor . Bharat Viswanadham Bharat Viswanadham
HADOOP-14892 MetricsSystemImpl should use Time.monotonicNow for measuring durations Minor . Chetna Chaudhari Chetna Chaudhari
YARN-7238 Documentation for API based scheduler configuration management Major . Jonathan Hung Jonathan Hung
HADOOP-14893 WritableRpcEngine should use Time.monotonicNow Minor . Chetna Chaudhari Chetna Chaudhari
HDFS-12386 Add fsserver defaults call to WebhdfsFileSystem. Minor webhdfs Rushabh S Shah Rushabh S Shah
YARN-7252 Removing queue then failing over results in exception Critical . Jonathan Hung Jonathan Hung
YARN-7251 Misc changes to YARN-5734 Major . Jonathan Hung Jonathan Hung
YARN-6962 Add support for updateContainers when allocating using FederationInterceptor Minor . Botong Huang Botong Huang
YARN-7259 Add size-based rolling policy to LogAggregationIndexedFileController Major . Xuan Gong Xuan Gong
MAPREDUCE-6971 Moving logging APIs over to slf4j in hadoop-mapreduce-client-app Major . Jinjiang Ling Jinjiang Ling
YARN-6916 Moving logging APIs over to slf4j in hadoop-yarn-server-common Major . Akira Ajisaka Akira Ajisaka
HDFS-12584 [READ] Fix errors in image generation tool from latest rebase Major . Virajith Jalaparti Virajith Jalaparti
YARN-6975 Moving logging APIs over to slf4j in hadoop-yarn-server-tests, hadoop-yarn-server-web-proxy and hadoop-yarn-server-router Major . Yeliang Cang Yeliang Cang
YARN-2037 Add work preserving restart support for Unmanaged AMs Major resourcemanager Karthik Kambatla Botong Huang
YARN-5329 Placement Agent enhancements required to support recurring reservations in ReservationSystem Blocker resourcemanager Subru Krishnan Carlo Curino
YARN-6182 Fix alignment issues and missing information in new YARN UI’s Queue page Major yarn-ui-v2 Akhil PB Akhil PB
HADOOP-14845 Azure wasb: getFileStatus not making any auth checks Major fs/azure, security Sivaguru Sankaridurg Sivaguru Sankaridurg
HADOOP-14899 Restrict Access to setPermission operation when authorization is enabled in WASB Major fs/azure Kannapiran Srinivasan Kannapiran Srinivasan
YARN-7237 Cleanup usages of ResourceProfiles Critical nodemanager, resourcemanager Wangda Tan Wangda Tan
YARN-7296 convertToProtoFormat(Resource r) is not setting for all resource types Major . lovekesh bansal lovekesh bansal
HADOOP-14913 Sticky bit implementation for rename() operation in Azure WASB Major fs, fs/azure Varada Hemeswari Varada Hemeswari
YARN-6620 Add support in NodeManager to isolate GPU devices by using CGroups Major . Wangda Tan Wangda Tan
YARN-7205 Log improvements for the ResourceUtils Major nodemanager, resourcemanager Jian He Sunil Govindan
YARN-7180 Remove class ResourceType Major resourcemanager, scheduler Yufei Gu Sunil Govindan
HADOOP-14935 Azure: POSIX permissions are taking effect in access() method even when authorization is enabled Major fs/azure Santhosh G Nayak Santhosh G Nayak
YARN-7254 UI and metrics changes related to absolute resource configuration Major capacity scheduler Sunil Govindan Sunil Govindan
YARN-7311 Fix TestRMWebServicesReservation parametrization for fair scheduler Blocker fairscheduler, reservation system Yufei Gu Yufei Gu
HDFS-12605 [READ] TestNameNodeProvidedImplementation#testProvidedDatanodeFailures fails after rebase Major . Virajith Jalaparti Virajith Jalaparti
YARN-7345 GPU Isolation: Incorrect minor device numbers written to devices.deny file Major . Jonathan Hung Jonathan Hung
YARN-7338 Support same origin policy for cross site scripting prevention. Major yarn-ui-v2 Vrushali C Sunil Govindan
YARN-4090 Make Collections.sort() more efficient by caching resource usage Major fairscheduler Xianyin Xin Yufei Gu
YARN-6984 DominantResourceCalculator.isAnyMajorResourceZero() should test all resources Major scheduler Daniel Templeton Sunil Govindan
YARN-4827 Document configuration of ReservationSystem for FairScheduler Blocker capacity scheduler Subru Krishnan Yufei Gu
YARN-5516 Add REST API for supporting recurring reservations Major resourcemanager Sangeetha Abdu Jyothi Sean Po
MAPREDUCE-6977 Moving logging APIs over to slf4j in hadoop-mapreduce-client-common Major client Jinjiang Ling Jinjiang Ling
YARN-6505 Define the strings used in SLS JSON input file format Major scheduler-load-simulator Yufei Gu Gergely Novák
YARN-7332 Compute effectiveCapacity per each resource vector Major capacity scheduler Sunil Govindan Sunil Govindan
YARN-7224 Support GPU isolation for docker container Major . Wangda Tan Wangda Tan
YARN-7374 Improve performance of DRF comparisons for resource types in fair scheduler Critical fairscheduler Daniel Templeton Daniel Templeton
YARN-6927 Add support for individual resource types requests in MapReduce Major resourcemanager Daniel Templeton Gergo Repas
YARN-6594 [API] Introduce SchedulingRequest object Major . Konstantinos Karanasos Konstantinos Karanasos
HADOOP-14997 Add hadoop-aliyun as dependency of hadoop-cloud-storage Minor fs/oss Genmao Yu Genmao Yu
YARN-7289 Application lifetime does not work with FairScheduler Major resourcemanager Miklos Szegedi Miklos Szegedi
YARN-7392 Render cluster information on new YARN web ui Major webapp Vasudevan Skm Vasudevan Skm
HDFS-11902 [READ] Merge BlockFormatProvider and FileRegionProvider. Major . Virajith Jalaparti Virajith Jalaparti
YARN-7307 Allow client/AM update supported resource types via YARN APIs Blocker nodemanager, resourcemanager Wangda Tan Sunil Govindan
HDFS-12607 [READ] Even one dead datanode with PROVIDED storage results in ProvidedStorageInfo being marked as FAILED Major . Virajith Jalaparti Virajith Jalaparti
YARN-7394 Merge code paths for Reservation/Plan queues and Auto Created queues Major capacity scheduler Suma Shivaprasad Suma Shivaprasad
HDFS-12671 [READ] Test NameNode restarts when PROVIDED is configured Major . Virajith Jalaparti Virajith Jalaparti
HDFS-12789 [READ] Image generation tool does not close an opened stream Major . Virajith Jalaparti Virajith Jalaparti
YARN-7166 Container REST endpoints should report resource types Major resourcemanager Daniel Templeton Daniel Templeton
YARN-7143 FileNotFound handling in ResourceUtils is inconsistent Major resourcemanager Daniel Templeton Daniel Templeton
HDFS-12776 [READ] Increasing replication for PROVIDED files should create local replicas Major . Virajith Jalaparti Virajith Jalaparti
HDFS-12779 [READ] Allow cluster id to be specified to the Image generation tool Trivial . Virajith Jalaparti Virajith Jalaparti
HDFS-12777 [READ] Reduce memory and CPU footprint for PROVIDED volumes. Major . Virajith Jalaparti Virajith Jalaparti
YARN-7406 Moving logging APIs over to slf4j in hadoop-yarn-api Major . Yeliang Cang Yeliang Cang
YARN-7442 [YARN-7069] Limit format of resource type name Blocker nodemanager, resourcemanager Wangda Tan Wangda Tan
YARN-7369 Improve the resource types docs Major docs Daniel Templeton Daniel Templeton
YARN-6595 [API] Add Placement Constraints at the application level Major . Konstantinos Karanasos Arun Suresh
YARN-7411 Inter-Queue preemption’s computeFixpointAllocation need to handle absolute resources while computing normalizedGuarantee Major resourcemanager Sunil Govindan Sunil Govindan
YARN-7488 Make ServiceClient.getAppId method public to return ApplicationId for a service name Major . Gour Saha Gour Saha
HADOOP-14993 AliyunOSS: Override listFiles and listLocatedStatus Major fs/oss Genmao Yu Genmao Yu
YARN-6953 Clean up ResourceUtils.setMinimumAllocationForMandatoryResources() and setMaximumAllocationForMandatoryResources() Minor resourcemanager Daniel Templeton Manikandan R
HDFS-12775 [READ] Fix reporting of Provided volumes Major . Virajith Jalaparti Virajith Jalaparti
YARN-7482 Max applications calculation per queue has to be retrospected with absolute resource support Major capacity scheduler Sunil Govindan Sunil Govindan
YARN-7486 Race condition in service AM that can cause NPE Major . Jian He Jian He
YARN-7503 Configurable heap size / JVM opts in service AM Major . Jonathan Hung Jonathan Hung
YARN-7419 CapacityScheduler: Allow auto leaf queue creation after queue mapping Major capacity scheduler Suma Shivaprasad Suma Shivaprasad
YARN-7483 CapacityScheduler test cases cleanup post YARN-5881 Major test Sunil Govindan Sunil Govindan
HDFS-12801 RBF: Set MountTableResolver as default file resolver Minor . Íñigo Goiri Íñigo Goiri
YARN-7430 Enable user re-mapping for Docker containers by default Blocker security, yarn Eric Yang Eric Yang
YARN-7218 ApiServer REST API naming convention /ws/v1 is already used in Hadoop v2 Major api, applications Eric Yang Eric Yang
YARN-7448 [API] Add SchedulingRequest to the AllocateRequest Major . Arun Suresh Panagiotis Garefalakis
YARN-7529 TestYarnNativeServices#testRecoverComponentsAfterRMRestart() fails intermittently Major . Chandni Singh Chandni Singh
YARN-6128 Add support for AMRMProxy HA Major amrmproxy, nodemanager Subru Krishnan Botong Huang
HADOOP-15024 AliyunOSS: support user agent configuration and include that & Hadoop version information to oss server Major fs, fs/oss Sammi Chen Sammi Chen
HDFS-12778 [READ] Report multiple locations for PROVIDED blocks Major . Virajith Jalaparti Virajith Jalaparti
YARN-5534 Allow user provided Docker volume mount list Major yarn luhuichun Shane Kumpf
YARN-7330 Add support to show GPU in UI including metrics Blocker . Wangda Tan Wangda Tan
YARN-7538 Fix performance regression introduced by Capacity Scheduler absolute min/max resource refactoring Major capacity scheduler Sunil Govindan Sunil Govindan
YARN-7544 Use queue-path.capacity/maximum-capacity to specify CapacityScheduler absolute min/max resources Major capacity scheduler Sunil Govindan Sunil Govindan
YARN-6168 Restarted RM may not inform AM about all existing containers Major . Billie Rinaldi Chandni Singh
HDFS-12809 [READ] Fix the randomized selection of locations in {{ProvidedBlocksBuilder}}. Major . Virajith Jalaparti Virajith Jalaparti
HDFS-12858 RBF: Add router admin commands usage in HDFS commands reference doc Minor documentation Yiqun Lin Yiqun Lin
YARN-7564 Cleanup to fix checkstyle issues of YARN-5881 branch Minor . Sunil Govindan Sunil Govindan
YARN-7480 Render tooltips on columns where text is clipped in new YARN UI Major yarn-ui-v2 Vasudevan Skm Vasudevan Skm
YARN-7575 NPE in scheduler UI when max-capacity is not configured Major capacity scheduler Eric Payne Sunil Govindan
YARN-7533 Documentation for absolute resource support in Capacity Scheduler Major capacity scheduler Sunil Govindan Sunil Govindan
HDFS-12835 RBF: Fix Javadoc parameter errors Minor . Wei Yan Wei Yan
YARN-7541 Node updates don’t update the maximum cluster capability for resources other than CPU and memory Critical resourcemanager Daniel Templeton Daniel Templeton
YARN-7573 Gpu Information page could be empty for nodes without GPU Major webapp, yarn-ui-v2 Sunil Govindan Sunil Govindan
HDFS-12685 [READ] FsVolumeImpl exception when scanning Provided storage volume Major . Ewan Higgs Virajith Jalaparti
HDFS-12665 [AliasMap] Create a version of the AliasMap that runs in memory in the Namenode (leveldb) Major . Ewan Higgs Ewan Higgs
YARN-7487 Ensure volume to include GPU base libraries after created by plugin Major . Wangda Tan Wangda Tan
YARN-6507 Add support in NodeManager to isolate FPGA devices with CGroups Major yarn Zhankun Tang Zhankun Tang
MAPREDUCE-6994 Uploader tool for Distributed Cache Deploy code changes Major . Miklos Szegedi Miklos Szegedi
HDFS-12591 [READ] Implement LevelDBFileRegionFormat Minor hdfs Ewan Higgs Ewan Higgs
YARN-6907 Node information page in the old web UI should report resource types Major resourcemanager Daniel Templeton Gergely Novák
YARN-7587 Skip dispatching opportunistic containers to nodes whose queue is already full Major . Weiwei Yang Weiwei Yang
HDFS-12396 Webhdfs file system should get delegation token from kms provider. Major encryption, kms, webhdfs Rushabh S Shah Rushabh S Shah
YARN-7092 Render application specific log under application tab in new YARN UI Major yarn-ui-v2 Akhil PB Akhil PB
HADOOP-15071 s3a troubleshooting docs to add a couple more failure modes Minor documentation, fs/s3 Steve Loughran Steve Loughran
YARN-7438 Additional changes to make SchedulingPlacementSet agnostic to ResourceRequest / placement algorithm Major . Wangda Tan Wangda Tan
HDFS-12885 Add visibility/stability annotations Trivial . Chris Douglas Chris Douglas
HADOOP-14475 Metrics of S3A don’t print out when enable it in Hadoop metrics property file Major fs/s3 Yonger Yonger
HDFS-12713 [READ] Refactor FileRegion and BlockAliasMap to separate out HDFS metadata and PROVIDED storage metadata Major . Virajith Jalaparti Ewan Higgs
HDFS-12894 [READ] Skip setting block count of ProvidedDatanodeStorageInfo on DN registration update Major . Virajith Jalaparti Virajith Jalaparti
YARN-7610 Extend Distributed Shell to support launching job with opportunistic containers Major applications/distributed-shell Weiwei Yang Weiwei Yang
HDFS-11640 [READ] Datanodes should use a unique identifier when reading from external stores Major . Virajith Jalaparti Virajith Jalaparti
HDFS-12887 [READ] Allow Datanodes with Provided volumes to start when blocks with the same id exist locally Major . Virajith Jalaparti Virajith Jalaparti
MAPREDUCE-6998 Moving logging APIs over to slf4j in hadoop-mapreduce-client-jobclient Major . Akira Ajisaka Gergely Novák
MAPREDUCE-7000 Moving logging APIs over to slf4j in hadoop-mapreduce-client-nativetask Minor . Jinjiang Ling Jinjiang Ling
HDFS-12874 [READ] Documentation for provided storage Major . Chris Douglas Virajith Jalaparti
YARN-7522 Introduce AllocationTagsManager to associate allocation tags to nodes Major . Wangda Tan Wangda Tan
HDFS-12905 [READ] Handle decommissioning and under-maintenance Datanodes with Provided storage. Major . Virajith Jalaparti Virajith Jalaparti
HDFS-12893 [READ] Support replication of Provided blocks with non-default topologies. Major . Virajith Jalaparti Virajith Jalaparti
YARN-7443 Add native FPGA module support to do isolation with cgroups Major yarn Zhankun Tang Zhankun Tang
YARN-7473 Implement Framework and policy for capacity management of auto created queues Major capacity scheduler Suma Shivaprasad Suma Shivaprasad
YARN-7420 YARN UI changes to depict auto created queues Major capacity scheduler Suma Shivaprasad Suma Shivaprasad
YARN-7520 Queue Ordering policy changes for ordering auto created leaf queues within Managed parent Queues Major capacity scheduler Suma Shivaprasad Suma Shivaprasad
YARN-6704 Add support for work preserving NM restart when FederationInterceptor is enabled in AMRMProxyService Major . Botong Huang Botong Huang
YARN-7632 Effective min and max resource need to be set for auto created leaf queues upon creation and capacity management Major capacity scheduler Suma Shivaprasad Suma Shivaprasad
MAPREDUCE-7018 Apply erasure coding properly to framework tarball and support plain tar Major . Miklos Szegedi Miklos Szegedi
HDFS-12875 RBF: Complete logic for -readonly option of dfsrouteradmin add command Major . Yiqun Lin Íñigo Goiri
YARN-7634 Queue ACL validations should validate parent queue ACLs before auto-creating leaf queues Major capacity scheduler Suma Shivaprasad Suma Shivaprasad
YARN-7641 Allow searchable filter for Application page log viewer in new YARN UI Major yarn-ui-v2 Vasudevan Skm Vasudevan Skm
YARN-7383 Node resource is not parsed correctly for resource names containing dot Major nodemanager, resourcemanager Jonathan Hung Gergely Novák
YARN-7643 Handle recovery of applications in case of auto-created leaf queue mapping Major capacity scheduler Suma Shivaprasad Suma Shivaprasad
HDFS-12912 [READ] Fix configuration and implementation of LevelDB-based alias maps Major . Virajith Jalaparti Virajith Jalaparti
YARN-7119 Support multiple resource types in rmadmin updateNodeResource command Major nodemanager, resourcemanager Daniel Templeton Manikandan R
YARN-7630 Fix AMRMToken rollover handling in AMRMProxy Minor . Botong Huang Botong Huang
YARN-7565 Yarn service pre-maturely releases the container after AM restart Major . Chandni Singh Chandni Singh
YARN-7638 Unit tests related to preemption for auto created leaf queues feature Major capacity scheduler Suma Shivaprasad Suma Shivaprasad
YARN-7633 Documentation for auto queue creation feature and related configurations Major capacity scheduler Suma Shivaprasad Suma Shivaprasad
HDFS-12712 [9806] Code style cleanup Minor . Íñigo Goiri Virajith Jalaparti
HDFS-12903 [READ] Fix closing streams in ImageWriter Major . Íñigo Goiri Virajith Jalaparti
YARN-7617 Add a flag in distributed shell to automatically PROMOTE opportunistic containers to guaranteed once they are started Minor applications/distributed-shell Weiwei Yang Weiwei Yang
HDFS-12937 RBF: Add more unit tests for router admin commands Major test Yiqun Lin Yiqun Lin
YARN-7620 Allow node partition filters on Queues page of new YARN UI Major yarn-ui-v2 Vasudevan Skm Vasudevan Skm
YARN-7670 Modifications to the ResourceScheduler to support SchedulingRequests Major . Arun Suresh Arun Suresh
YARN-7032 [ATSv2] NPE while starting hbase co-processor when HBase authorization is enabled. Critical . Rohith Sharma K S Rohith Sharma K S
HADOOP-14965 s3a input stream “normal” fadvise mode to be adaptive Major fs/s3 Steve Loughran Steve Loughran
HADOOP-15133 [JDK9] Ignore com.sun.javadoc.* and com.sun.tools.* in animal-sniffer-maven-plugin to compile with Java 9 Major . Akira Ajisaka Akira Ajisaka
YARN-7669 API and interface modifications for placement constraint processor Major . Arun Suresh Arun Suresh
HADOOP-15113 NPE in S3A getFileStatus: null instrumentation on using closed instance Major fs/s3 Steve Loughran Steve Loughran
HADOOP-15086 NativeAzureFileSystem file rename is not atomic Major fs/azure Shixiong Zhu Thomas Marquardt
YARN-7653 Rack cardinality support for AllocationTagsManager Major . Panagiotis Garefalakis Panagiotis Garefalakis
YARN-6596 Introduce Placement Constraint Manager module Major . Konstantinos Karanasos Konstantinos Karanasos
YARN-7612 Add Processor Framework for Rich Placement Constraints Major . Arun Suresh Arun Suresh
YARN-7613 Implement Basic algorithm for constraint based placement Major . Arun Suresh Panagiotis Garefalakis
YARN-7682 Expose canSatisfyConstraints utility function to validate a placement against a constraint Major . Arun Suresh Panagiotis Garefalakis
HDFS-12988 RBF: Mount table entries not properly updated in the local cache Major . Íñigo Goiri Íñigo Goiri
YARN-7557 It should be possible to specify resource types in the fair scheduler increment value Critical fairscheduler Daniel Templeton Gergo Repas
YARN-7666 Introduce scheduler specific environment variable support in ApplicationSubmissionContext for better scheduling placement configurations Major . Sunil Govindan Sunil Govindan
YARN-7242 Support to specify values of different resource types in DistributedShell for easier testing Critical nodemanager, resourcemanager Wangda Tan Gergely Novák
YARN-7704 Document improvement for registry dns Major . Jian He Jian He
HADOOP-15161 s3a: Stream and common statistics missing from metrics Major . Sean Mackrory Sean Mackrory
HDFS-12802 RBF: Control MountTableResolver cache size Major . Íñigo Goiri Íñigo Goiri
HDFS-12934 RBF: Federation supports global quota Major . Yiqun Lin Yiqun Lin
YARN-7681 Double-check placement constraints in scheduling phase before actual allocation is made Major RM, scheduler Weiwei Yang Weiwei Yang
YARN-5366 Improve handling of the Docker container life cycle Major yarn Shane Kumpf Shane Kumpf
MAPREDUCE-7030 Uploader tool should ignore symlinks to the same directory Minor . Miklos Szegedi Miklos Szegedi
YARN-7724 yarn application status should support application name Major yarn-native-services Yesha Vora Jian He
YARN-7696 Add container tags to ContainerTokenIdentifier, api.Container and NMContainerStatus to handle all recovery cases Major . Arun Suresh Arun Suresh
HDFS-12972 RBF: Display mount table quota info in Web UI and admin command Major . Yiqun Lin Yiqun Lin
MAPREDUCE-7034 Moving logging APIs over to slf4j the rest of all in hadoop-mapreduce Major . Takanobu Asanuma Takanobu Asanuma
HADOOP-15079 ITestS3AFileOperationCost#testFakeDirectoryDeletion failing after OutputCommitter patch Critical . Sean Mackrory Steve Loughran
HDFS-12919 RBF: Support erasure coding methods in RouterRpcServer Critical . Íñigo Goiri Íñigo Goiri
YARN-6736 Consider writing to both ats v1 & v2 from RM for smoother upgrades Major timelineserver Vrushali C Aaron Gresch
MAPREDUCE-7032 Add the ability to specify a delayed replication count Major . Miklos Szegedi Miklos Szegedi
HADOOP-15141 Support IAM Assumed roles in S3A Major fs/s3 Steve Loughran Steve Loughran
HADOOP-15027 AliyunOSS: Support multi-thread pre-read to improve sequential read from Hadoop to Aliyun OSS performance Major fs/oss wujinhu wujinhu
YARN-6619 AMRMClient Changes to use the PlacementConstraint and SchcedulingRequest objects Major . Arun Suresh Arun Suresh
YARN-7709 Remove SELF from TargetExpression type Blocker . Wangda Tan Konstantinos Karanasos
YARN-6599 Support anti-affinity constraint via AppPlacementAllocator Major . Wangda Tan Wangda Tan
YARN-7745 Allow DistributedShell to take a placement specification for containers it wants to launch Major . Arun Suresh Arun Suresh
HDFS-12973 RBF: Document global quota supporting in federation Major . Yiqun Lin Yiqun Lin
HDFS-13028 RBF: Fix spurious TestRouterRpc#testProxyGetStats Minor . Íñigo Goiri Íñigo Goiri
YARN-5094 some YARN container events have timestamp of -1 Critical . Sangjin Lee Haibo Chen
MAPREDUCE-6995 Uploader tool for Distributed Cache Deploy documentation Major . Miklos Szegedi Miklos Szegedi
YARN-7774 Miscellaneous fixes to the PlacementProcessor Blocker . Arun Suresh Arun Suresh
YARN-7763 Allow Constraints specified in the SchedulingRequest to override application level constraints Blocker . Wangda Tan Weiwei Yang
YARN-7729 Add support for setting the PID namespace mode Major nodemanager Shane Kumpf Billie Rinaldi
YARN-7788 Factor out management of temp tags from AllocationTagsManager Major . Arun Suresh Arun Suresh
YARN-7779 Display allocation tags in RM web UI and expose same through REST API Major RM Weiwei Yang Weiwei Yang
YARN-7782 Enable user re-mapping for Docker containers in yarn-default.xml Blocker security, yarn Eric Yang Eric Yang
YARN-7605 Implement doAs for Api Service REST API Major . Eric Yang Eric Yang
YARN-7540 Convert yarn app cli to call yarn api services Major . Eric Yang Eric Yang
HDFS-12772 RBF: Federation Router State State Store internal API Major . Íñigo Goiri Íñigo Goiri
YARN-7783 Add validation step to ensure constraints are not violated due to order in which a request is processed Blocker . Arun Suresh Arun Suresh
YARN-7807 Assume intra-app anti-affinity as default for scheduling request inside AppPlacementAllocator Blocker . Wangda Tan Wangda Tan
YARN-7795 Fix jenkins issues of YARN-6592 branch Blocker . Sunil Govindan Sunil Govindan
HDFS-13042 RBF: Heartbeat Router State Major . Íñigo Goiri Íñigo Goiri
YARN-7798 Refactor SLS Reservation Creation Minor . Young Chen Young Chen
HDFS-13049 RBF: Inconsistent Router OPTS config in branch-2 and branch-3 Minor . Wei Yan Wei Yan
YARN-7814 Remove automatic mounting of the cgroups root directory into Docker containers Major . Shane Kumpf Shane Kumpf
YARN-7784 Fix Cluster metrics when placement processor is enabled Major metrics, RM Weiwei Yang Arun Suresh
YARN-6597 Add RMContainer recovery test to verify tag population in the AllocationTagsManager Major . Konstantinos Karanasos Panagiotis Garefalakis
YARN-7817 Add Resource reference to RM’s NodeInfo object so REST API can get non memory/vcore resource usages. Major . Sumana Sathish Sunil Govindan
YARN-7797 Docker host network can not obtain IP address for RegistryDNS Major nodemanager Eric Yang Eric Yang
HDFS-12574 Add CryptoInputStream to WebHdfsFileSystem read call. Major encryption, kms, webhdfs Rushabh S Shah Rushabh S Shah
YARN-5148 [UI2] Add page to new YARN UI to view server side configurations/logs/JVM-metrics Major webapp, yarn-ui-v2 Wangda Tan Kai Sasaki
YARN-7723 Avoid using docker volume –format option to run against older docker releases Major . Wangda Tan Wangda Tan
YARN-7780 Documentation for Placement Constraints Major . Arun Suresh Konstantinos Karanasos
YARN-7811 Service AM should use configured default docker network Major yarn-native-services Billie Rinaldi Billie Rinaldi
YARN-7822 Constraint satisfaction checker support for composite OR and AND constraints Major . Arun Suresh Weiwei Yang
HDFS-13044 RBF: Add a safe mode for the Router Major . Íñigo Goiri Íñigo Goiri
YARN-7816 YARN Service - Two different users are unable to launch a service of the same name Major applications Gour Saha Gour Saha
HDFS-13043 RBF: Expose the state of the Routers in the federation Major . Íñigo Goiri Íñigo Goiri
HDFS-12997 Move logging to slf4j in BlockPoolSliceStorage and Storage Major . Ajay Kumar Ajay Kumar
HDFS-13068 RBF: Add router admin option to manage safe mode Major . Íñigo Goiri Yiqun Lin
YARN-7839 Modify PlacementAlgorithm to Check node capacity before placing request on node Major . Arun Suresh Panagiotis Garefalakis
YARN-7868 Provide improved error message when YARN service is disabled Major yarn-native-services Eric Yang Eric Yang
YARN-7778 Merging of placement constraints defined at different levels Major . Konstantinos Karanasos Weiwei Yang
YARN-7860 Fix UT failure TestRMWebServiceAppsNodelabel#testAppsRunning Major . Weiwei Yang Sunil Govindan
YARN-7516 Security check for trusted docker image Major . Eric Yang Eric Yang
YARN-7815 Make the YARN mounts added to Docker containers more restrictive Major . Shane Kumpf Shane Kumpf
HADOOP-15214 Make Hadoop compatible with Guava 21.0 Minor . Igor Dvorzhak Igor Dvorzhak
YARN-5428 Allow for specifying the docker client configuration directory Major yarn Shane Kumpf Shane Kumpf
YARN-7838 Support AND/OR constraints in Distributed Shell Critical distributed-shell Weiwei Yang Weiwei Yang
HADOOP-13974 S3Guard CLI to support list/purge of pending multipart commits Major fs/s3 Steve Loughran Aaron Fabbri
YARN-7917 Fix failing test TestDockerContainerRuntime#testLaunchContainerWithDockerTokens Minor nodemanager Shane Kumpf Shane Kumpf
YARN-7914 Fix exit code handling for short lived Docker containers Critical . Shane Kumpf Shane Kumpf
HADOOP-15040 Upgrade AWS SDK to 1.11.271: NPE bug spams logs w/ Yarn Log Aggregation Blocker fs/s3 Aaron Fabbri Aaron Fabbri
YARN-7789 Should fail RM if 3rd resource type is configured but RM uses DefaultResourceCalculator Critical . Sumana Sathish Zian Chen
HADOOP-15076 Enhance S3A troubleshooting documents and add a performance document Blocker documentation, fs/s3 Steve Loughran Steve Loughran
HADOOP-15176 Enhance IAM Assumed Role support in S3A client Blocker fs/s3, test Steve Loughran Steve Loughran
YARN-7920 Simplify configuration for PlacementConstraints Blocker . Wangda Tan Wangda Tan
YARN-7292 Retrospect Resource Profile Behavior for overriding capability Blocker nodemanager, resourcemanager Wangda Tan Wangda Tan
HADOOP-14507 extend per-bucket secret key config with explicit getPassword() on fs.s3a.$bucket.secret.key Critical fs/s3 Steve Loughran Steve Loughran
YARN-7328 ResourceUtils allows yarn.nodemanager.resource-types.memory-mb and .vcores to override yarn.nodemanager.resource.memory-mb and .cpu-vcores Critical nodemanager Daniel Templeton lovekesh bansal
HDFS-13119 RBF: Manage unavailable clusters Major . Íñigo Goiri Yiqun Lin
YARN-7940 Service AM gets NoAuth with secure ZK Blocker yarn-native-services Billie Rinaldi Billie Rinaldi
YARN-7223 Document GPU isolation feature Blocker . Wangda Tan Wangda Tan
HADOOP-15247 Move commons-net up to 3.6 Minor fs Steve Loughran Steve Loughran
YARN-7916 Remove call to docker logs on failure in container-executor Major . Shane Kumpf Shane Kumpf
YARN-7836 YARN Service component update PUT API should not use component name from JSON body Major api, yarn-native-services Gour Saha Gour Saha
YARN-7934 [GQ] Refactor preemption calculators to allow overriding for Federation Global Algos Major . Carlo Curino Carlo Curino
YARN-7921 Transform a PlacementConstraint to a string expression Major . Weiwei Yang Weiwei Yang
HDFS-13187 RBF: Fix Routers information shown in the web UI Minor . Wei Yan Wei Yan
HDFS-13184 RBF: Improve the unit test TestRouterRPCClientRetries Minor test Yiqun Lin Yiqun Lin
YARN-7893 Document the FPGA isolation feature Blocker . Zhankun Tang Zhankun Tang
YARN-7959 Add .vm extension to PlacementConstraints.md to ensure proper filtering Critical documentation Weiwei Yang Weiwei Yang
HDFS-13199 RBF: Fix the hdfs router page missing label icon issue Major federation, hdfs maobaolong maobaolong
YARN-7929 Support to set container execution type in SLS Major scheduler-load-simulator Jiandan Yang Jiandan Yang
HADOOP-15264 AWS “shaded” SDK 1.11.271 is pulling in netty 4.1.17 Blocker fs/s3 Steve Loughran Steve Loughran
YARN-7446 Docker container privileged mode and –user flag contradict each other Major . Eric Yang Eric Yang
YARN-7954 Component status stays “Ready” when yarn service is stopped Major . Yesha Vora Gour Saha
YARN-7955 Calling stop on an already stopped service says “Successfully stopped service” Major . Gour Saha Gour Saha
YARN-7637 GPU volume creation command fails when work preserving is disabled at NM Critical nodemanager Sunil Govindan Zian Chen
HADOOP-15274 Move hadoop-openstack to slf4j Minor fs/swift Steve Loughran fang zhenyi
HADOOP-14652 Update metrics-core version to 3.2.4 Major . Ray Chiang Ray Chiang
HDFS-1686 Federation: Add more Balancer tests with federation setting Minor balancer & mover, test Tsz Wo Nicholas Sze Bharat Viswanadham
HADOOP-13761 S3Guard: implement retries for DDB failures and throttling; translate exceptions Blocker fs/s3 Aaron Fabbri Aaron Fabbri
YARN-7915 Trusted image log message repeated multiple times Major . Eric Badger Shane Kumpf
HADOOP-15090 Add ADL troubleshooting doc Major documentation, fs/adl Steve Loughran Steve Loughran
YARN-7972 Support inter-app placement constraints for allocation tags by application ID Major . Weiwei Yang Weiwei Yang
HADOOP-15271 Remove unicode multibyte characters from JavaDoc Major documentation Akira Ajisaka Takanobu Asanuma
HADOOP-15287 JDK9 JavaDoc build fails due to one-character underscore identifiers in hadoop-yarn-common Major documentation Takanobu Asanuma Takanobu Asanuma
HADOOP-15291 TestMiniKdc fails on Java 9 Major test Akira Ajisaka Takanobu Asanuma
YARN-7346 Add a profile to allow optional compilation for ATSv2 with HBase-2.0 Major . Ted Yu Haibo Chen
YARN-7919 Refactor timelineservice-hbase module into submodules Major timelineservice Haibo Chen Haibo Chen
HDFS-13214 RBF: Complete document of Router configuration Major . Tao Jie Yiqun Lin
HADOOP-15267 S3A multipart upload fails when SSE-C encryption is enabled Critical fs/s3 Anis Elleuch Anis Elleuch
YARN-7891 LogAggregationIndexedFileController should support read from HAR file Major . Xuan Gong Xuan Gong
YARN-7626 Allow regular expression matching in container-executor.cfg for devices and named docker volumes mount Major . Zian Chen Zian Chen
HDFS-13230 RBF: ConnectionManager’s cleanup task will compare each pool’s own active conns with its total conns Minor . Wei Yan Chao Sun
HDFS-13233 RBF: MountTableResolver doesn’t return the correct mount point of the given path Major hdfs wangzhiyuan wangzhiyuan
HADOOP-15277 remove .FluentPropertyBeanIntrospector from CLI operation log output Minor conf Steve Loughran Steve Loughran
HADOOP-15293 TestLogLevel fails on Java 9 Major test Akira Ajisaka Takanobu Asanuma
HDFS-13212 RBF: Fix router location cache issue Major federation, hdfs Weiwei Wu Weiwei Wu
HDFS-13232 RBF: ConnectionPool should return first usable connection Minor . Wei Yan Ekanth Sethuramalingam
HDFS-13240 RBF: Update some inaccurate document descriptions Minor . Yiqun Lin Yiqun Lin
YARN-7523 Introduce description and version field in Service record Critical . Gour Saha Chandni Singh
HADOOP-15297 Make S3A etag => checksum feature optional Blocker fs/s3 Steve Loughran Steve Loughran
HDFS-11399 Many tests fails in Windows due to injecting disk failures Major . Yiqun Lin Yiqun Lin
HDFS-12677 Extend TestReconstructStripedFile with a random EC policy Major erasure-coding, test Takanobu Asanuma Takanobu Asanuma
HDFS-13241 RBF: TestRouterSafemode failed if the port 8888 is in use Major hdfs, test maobaolong maobaolong
HDFS-13253 RBF: Quota management incorrect parent-child relationship judgement Major . Yiqun Lin Yiqun Lin
HDFS-13226 RBF: Throw the exception if mount table entry validated failed Major hdfs maobaolong maobaolong
HDFS-12505 Extend TestFileStatusWithECPolicy with a random EC policy Major erasure-coding, test Takanobu Asanuma Takanobu Asanuma
HDFS-12587 Use Parameterized tests in TestBlockInfoStriped and TestLowRedundancyBlockQueues to test all EC policies Major erasure-coding, test Takanobu Asanuma Takanobu Asanuma
YARN-5015 Support sliding window retry capability for container restart Major nodemanager Varun Vasudev Chandni Singh
YARN-7657 Queue Mapping could provide options to provide ‘user’ specific auto-created queues under a specified group parent queue Major capacity scheduler Suma Shivaprasad Suma Shivaprasad
HADOOP-15308 TestConfiguration fails on Windows because of paths Major test Íñigo Goiri Xiao Liang
HDFS-12773 RBF: Improve State Store FS implementation Major . Íñigo Goiri Íñigo Goiri
HADOOP-15294 TestUGILoginFromKeytab fails on Java9 Major security Takanobu Asanuma Takanobu Asanuma
YARN-7999 Docker launch fails when user private filecache directory is missing Major . Eric Yang Jason Lowe
HDFS-13198 RBF: RouterHeartbeatService throws out CachedStateStore related exceptions when starting router Minor . Wei Yan Wei Yan
HADOOP-15278 log s3a at info Major fs/s3 Steve Loughran Steve Loughran
HDFS-13224 RBF: Resolvers to support mount points across multiple subclusters Major . Íñigo Goiri Íñigo Goiri
HDFS-13215 RBF: Move Router to its own module Major . Íñigo Goiri Wei Yan
YARN-8053 Add hadoop-distcp in exclusion in hbase-server dependencies for timelineservice-hbase packages. Major . Rohith Sharma K S Rohith Sharma K S
HDFS-13250 RBF: Router to manage requests across multiple subclusters Major . Íñigo Goiri Íñigo Goiri
HDFS-11190 [READ] Namenode support for data stored in external stores. Major . Virajith Jalaparti Virajith Jalaparti
HDFS-10675 [READ] Datanode support to read from external stores. Major . Virajith Jalaparti Virajith Jalaparti
HDFS-13318 RBF: Fix FindBugs in hadoop-hdfs-rbf Minor . Íñigo Goiri Ekanth Sethuramalingam
HDFS-12792 RBF: Test Router-based federation using HDFSContract Major . Íñigo Goiri Íñigo Goiri
YARN-7581 HBase filters are not constructed correctly in ATSv2 Major ATSv2 Haibo Chen Haibo Chen
YARN-7986 ATSv2 REST API queries do not return results for uppercase application tags Critical . Charan Hebri Charan Hebri
HDFS-12512 RBF: Add WebHDFS Major fs Íñigo Goiri Wei Yan
YARN-8070 Yarn Service API site doc broken due to unwanted character in YarnServiceAPI.md Blocker site Gour Saha Gour Saha
HDFS-13291 RBF: Implement available space based OrderResolver Major . Yiqun Lin Yiqun Lin
HDFS-13204 RBF: Optimize name service safe mode icon Minor . liuhongtong liuhongtong
HDFS-13352 RBF: Add xsl stylesheet for hdfs-rbf-default.xml Major documentation Takanobu Asanuma Takanobu Asanuma
YARN-8010 Add config in FederationRMFailoverProxy to not bypass facade cache when failing over Minor . Botong Huang Botong Huang
HDFS-13347 RBF: Cache datanode reports Minor . Íñigo Goiri Íñigo Goiri
YARN-8069 Clean up example hostnames Major . Billie Rinaldi Billie Rinaldi
HDFS-13364 RBF: Support NamenodeProtocol in the Router Major . Íñigo Goiri Íñigo Goiri
HADOOP-14651 Update okhttp version to 2.7.5 Major fs/adl Ray Chiang Ray Chiang
YARN-8027 Setting hostname of docker container breaks for –net=host in docker 1.13 Major yarn Jim Brennan Jim Brennan
YARN-7810 TestDockerContainerRuntime test failures due to UID lookup of a non-existent user Major . Shane Kumpf Shane Kumpf
HADOOP-15497 TestTrash should use proper test path to avoid failing on Windows Minor . Anbang Hu Anbang Hu

OTHER:

JIRA Summary Priority Component Reporter Contributor
HDFS-12376 Enable JournalNode Sync by default Major hdfs Hanisha Koneru Hanisha Koneru
YARN-6499 Remove the doc about Schedulable#redistributeShare() Trivial fairscheduler Yufei Gu Chetna Chaudhari
YARN-7343 Add a junit test for ContainerScheduler recovery Minor . kartheek muthyala Sampada Dehankar
YARN-6124 Make SchedulingEditPolicy can be enabled / disabled / updated with RMAdmin -refreshQueues Major . Wangda Tan Zian Chen
HADOOP-15149 CryptoOutputStream should implement StreamCapabilities Major fs Mike Drob Xiao Chen
YARN-7691 Add Unit Tests for ContainersLauncher Major . Sampada Dehankar Sampada Dehankar
YARN-7468 Provide means for container network policy control Major nodemanager Clay B. Xuan Gong
YARN-6486 FairScheduler: Deprecate continuous scheduling Major fairscheduler Wilfred Spiegelenburg Wilfred Spiegelenburg
HADOOP-15177 Update the release year to 2018 Blocker build Akira Ajisaka Bharat Viswanadham
HADOOP-15197 Remove tomcat from the Hadoop-auth test bundle Major . Xiao Chen Xiao Chen
HADOOP-14325 [Umbrella] Stabilise S3A Server Side Encryption Major documentation, fs/s3, test Steve Loughran
YARN-7918 Fix TestAMRMClientPlacementConstraints Critical . Botong Huang Gergely Novák
HDFS-13052 WebHDFS: Add support for snasphot diff Major . Lokesh Jain Lokesh Jain
HADOOP-14742 Document multi-URI replication Inode for ViewFS Major documentation, viewfs Chris Douglas Gera Shegalov
HDFS-13141 WebHDFS: Add support for getting snasphottable directory list Major webhdfs Lokesh Jain Lokesh Jain
YARN-8072 RM log is getting flooded with MemoryPlacementConstraintManager info logs Critical . Zian Chen Zian Chen