Apache Hadoop Changelog

Release 3.0.0-alpha1 - 2016-09-03

INCOMPATIBLE CHANGES:

JIRA Summary Priority Component Reporter Contributor
HADOOP-8124 Remove the deprecated Syncable.sync() method Major fs Tsz Wo Nicholas Sze Tsz Wo Nicholas Sze
HDFS-3034 Remove the deprecated Syncable.sync() method Major hdfs-client Tsz Wo Nicholas Sze Tsz Wo Nicholas Sze
HDFS-5079 Cleaning up NNHAStatusHeartbeat.State DatanodeProtocolProtos. Major datanode, namenode Konstantin Shvachko Tao Luo
HDFS-5570 Deprecate hftp / hsftp and replace them with webhdfs / swebhdfs Major . Haohui Mai Haohui Mai
HADOOP-10485 Remove dead classes in hadoop-streaming Major tools Haohui Mai Haohui Mai
HDFS-6246 Remove ‘dfs.support.append’ flag from trunk code Minor . Uma Maheswara Rao G Uma Maheswara Rao G
HADOOP-10474 Move o.a.h.record to hadoop-streaming Major . Haohui Mai Haohui Mai
HADOOP-9902 Shell script rewrite Major scripts Allen Wittenauer Allen Wittenauer
HADOOP-11041 VersionInfo output specifies subversion Minor build Guo Ruijing Tsuyoshi Ozawa
MAPREDUCE-5972 Fix typo ‘programatically’ in job.xml (and a few other places) Trivial . Akira Ajisaka Akira Ajisaka
HADOOP-11356 Removed deprecated o.a.h.fs.permission.AccessControlException Major . Haohui Mai Li Lu
HADOOP-10950 rework heap management vars Major scripts Allen Wittenauer John Smith
MAPREDUCE-5785 Derive heap size or mapreduce.*.memory.mb automatically Major mr-am, task Gera Shegalov Gera Shegalov
YARN-2428 LCE default banned user list should have yarn Trivial nodemanager Allen Wittenauer Varun Saxena
MAPREDUCE-5653 DistCp does not honour config-overrides for mapreduce.[map,reduce].memory.mb Major distcp Mithun Radhakrishnan Ratandeep Ratti
HADOOP-11657 Align the output of `hadoop fs -du` to be more Unix-like Minor . Nick Dimiduk Akira Ajisaka
HDFS-7302 namenode -rollingUpgrade downgrade may finalize a rolling upgrade Major namenode Tsz Wo Nicholas Sze Kai Sasaki
HADOOP-6857 FsShell should report raw disk usage including replication factor Major fs Alex Kozlov Byron Wong
HADOOP-10115 Exclude duplicate jars in hadoop package under different component’s lib Major build Vinayakumar B Vinayakumar B
YARN-3154 Should not upload partial logs for MR jobs or other "short-running’ applications Blocker nodemanager, resourcemanager Xuan Gong Xuan Gong
MAPREDUCE-4424 ‘mapred job -list’ command should show the job name as well Minor mrv2 Harsh J Avinash Kujur
YARN-3241 FairScheduler handles “invalid” queue names inconsistently Major fairscheduler zhihai xu zhihai xu
HDFS-7985 WebHDFS should be always enabled Major . Haohui Mai Li Lu
HDFS-6353 Check and make checkpoint before stopping the NameNode Major namenode Suresh Srinivas Jing Zhao
HADOOP-11553 Formalize the shell API Blocker documentation, scripts Allen Wittenauer Allen Wittenauer
HADOOP-11731 Rework the changelog and releasenotes Major documentation Allen Wittenauer Allen Wittenauer
HADOOP-11746 rewrite test-patch.sh Major build, test Allen Wittenauer Allen Wittenauer
HADOOP-11627 Remove io.native.lib.available Major native Akira Ajisaka Brahma Reddy Battula
HDFS-7281 Missing block is marked as corrupted block Major namenode Ming Ma Ming Ma
HDFS-8226 Non-HA rollback compatibility broken Blocker . J.Andreina J.Andreina
MAPREDUCE-2632 Avoid calling the partitioner when the numReduceTasks is 1. Major . Ravi Teja Ch N V Sunil Govindan
HDFS-8241 Remove unused NameNode startup option -finalize Minor namenode Brahma Reddy Battula Brahma Reddy Battula
HDFS-8332 DFS client API calls should check filesystem closed Major . Rakesh R Rakesh R
HADOOP-11698 Remove DistCpV1 and Logalyzer Major tools/distcp Allen Wittenauer Brahma Reddy Battula
HADOOP-11772 RPC Invoker relies on static ClientCache which has synchronized(this) blocks Major ipc, performance Gopal V Haohui Mai
YARN-2336 Fair scheduler REST api returns a missing ‘[’ bracket JSON for deep queue tree Major fairscheduler Kenji Kikushima Akira Ajisaka
HDFS-8135 Remove the deprecated FSConstants class Major . Haohui Mai Li Lu
MAPREDUCE-6336 Enable v2 FileOutputCommitter by default Major mrv2 Gera Shegalov Siqi Li
YARN-2355 MAX_APP_ATTEMPTS_ENV may no longer be a useful env var for a container Major . Zhijie Shen Darrell Taylor
YARN-41 The RM should handle the graceful shutdown of the NM. Major nodemanager, resourcemanager Ravi Teja Ch N V Devaraj K
HADOOP-11347 RawLocalFileSystem#mkdir and create should honor umask Major fs Chris Nauroth Varun Saxena
HDFS-8591 Remove support for deprecated configuration key dfs.namenode.decommission.nodes.per.interval Minor namenode Andrew Wang Andrew Wang
HDFS-6564 Use slf4j instead of common-logging in hdfs-client Major build Haohui Mai Rakesh R
HDFS-6440 Support more than 2 NameNodes Major auto-failover, ha, namenode Jesse Yates Jesse Yates
MAPREDUCE-6427 Fix typo in JobHistoryEventHandler Minor . Brahma Reddy Battula Ray Chiang
HADOOP-12209 Comparable type should be in FileStatus Minor fs Yong Zhang Yong Zhang
HADOOP-12269 Update aws-sdk dependency to 1.10.6; move to aws-sdk-s3 Major fs/s3 Thomas Demoor Thomas Demoor
HDFS-8895 Remove deprecated BlockStorageLocation APIs Major . Andrew Wang Andrew Wang
HDFS-8900 Compact XAttrs to optimize memory footprint. Major namenode Yi Liu Yi Liu
HDFS-8981 Adding revision to data node jmx getVersion() method Minor . Siqi Li Siqi Li
YARN-4087 Followup fixes after YARN-2019 regarding RM behavior when state-store error occurs Major . Jian He Jian He
YARN-4126 RM should not issue delegation tokens in unsecure mode Major . Jian He Bibin A Chundatt
HADOOP-12416 Trash messages should be handled by Logger instead of being delivered on System.out Major trash Ashutosh Chauhan Mingliang Liu
HDFS-9063 Correctly handle snapshot path for getContentSummary Major namenode Jing Zhao Jing Zhao
HDFS-9085 Show renewer information in DelegationTokenIdentifier#toString Trivial security zhihai xu zhihai xu
HADOOP-12495 Fix posix_spawn error on OS X Major util Allen Wittenauer Allen Wittenauer
HDFS-9070 Allow fsck display pending replica location information for being-written blocks Major . Rui Gao Rui Gao
HDFS-9278 Fix preferredBlockSize typo in OIV XML output Trivial tools Nicole Pazmany Nicole Pazmany
HADOOP-12436 GlobPattern regex library has performance issues with wildcard characters Major fs Matthew Paduano Matthew Paduano
HADOOP-10787 Rename/remove non-HADOOP_*, etc from the shell scripts Blocker scripts Allen Wittenauer Allen Wittenauer
HADOOP-12294 Throw an Exception when fs.permissions.umask-mode is misconfigured Major conf Chang Li Chang Li
HADOOP-10465 Fix use of generics within SortedMapWritable Minor . Bertrand Dechoux Bertrand Dechoux
HDFS-9433 DFS getEZForPath API on a non-existent file should throw FileNotFoundException Major encryption Rakesh R Rakesh R
HDFS-5165 Remove the TotalFiles metrics Minor . Akira Ajisaka Akira Ajisaka
HADOOP-11252 RPC client does not time out by default Critical ipc Wilfred Spiegelenburg Masatake Iwasaki
HDFS-9047 Retire libwebhdfs Major webhdfs Allen Wittenauer Haohui Mai
HADOOP-12651 Replace dev-support with wrappers to Yetus Major scripts Allen Wittenauer Allen Wittenauer
MAPREDUCE-6613 Change mapreduce.jobhistory.jhist.format default from json to binary Minor . Ray Chiang Ray Chiang
HDFS-9395 Make HDFS audit logging consistant Major . Kihwal Lee Kuhu Shukla
HADOOP-12552 Fix undeclared/unused dependency to httpclient Minor build Masatake Iwasaki Masatake Iwasaki
HADOOP-12850 pull shell code out of hadoop-dist Major build Allen Wittenauer Allen Wittenauer
HADOOP-11792 Remove all of the CHANGES.txt files Major build Allen Wittenauer Andrew Wang
HADOOP-12857 Rework hadoop-tools Major build Allen Wittenauer Allen Wittenauer
HADOOP-12967 Remove FileUtil#copyMerge Major . Brahma Reddy Battula Brahma Reddy Battula
HADOOP-12811 Change kms server port number which conflicts with HMaster port number Critical kms Yufeng Jiang Xiao Chen
YARN-4784 Fairscheduler: defaultQueueSchedulingPolicy should not accept FIFO Major fairscheduler Yufei Gu Yufei Gu
HDFS-9427 HDFS should not default to ephemeral ports Critical datanode, hdfs-client, namenode Arpit Agarwal Xiaobing Zhou
HADOOP-12563 Updated utility to create/modify token files Major . Allen Wittenauer Matthew Paduano
HADOOP-13045 hadoop_add_classpath is not working in .hadooprc Major . Akira Ajisaka Allen Wittenauer
MAPREDUCE-6526 Remove usage of metrics v1 from hadoop-mapreduce Blocker . Akira Ajisaka Akira Ajisaka
HADOOP-12504 Remove metrics v1 Blocker metrics Akira Ajisaka Akira Ajisaka
HDFS-10337 OfflineEditsViewer stats option should print 0 instead of null for the count of operations Minor . Akira Ajisaka Yiqun Lin
HADOOP-11858 [JDK8] Set minimum version of Hadoop 3 to JDK 8 Blocker build Robert Kanter Robert Kanter
YARN-5035 FairScheduler: Adjust maxAssign dynamically when assignMultiple is turned on Major fairscheduler Karthik Kambatla Karthik Kambatla
HADOOP-13175 Remove hadoop-ant from hadoop-tools Major . Chris Douglas Chris Douglas
HADOOP-12892 fix/rewrite create-release Blocker build Allen Wittenauer Allen Wittenauer
HADOOP-9613 [JDK8] Update jersey version to latest 1.x release Major build Timothy St. Clair Tsuyoshi Ozawa
HADOOP-13209 replace slaves with workers Major scripts John Smith John Smith
HDFS-6434 Default permission for creating file should be 644 for WebHdfs/HttpFS Minor webhdfs Juan Yu Wellington Chevreuil
HADOOP-12864 Remove bin/rcc script Blocker tools Allen Wittenauer Allen Wittenauer
HADOOP-12709 Cut s3:// from trunk Major fs/s3 Steve Loughran Mingliang Liu
HADOOP-12064 [JDK8] Update guice version to 4.0 Blocker . Tsuyoshi Ozawa Tsuyoshi Ozawa
HDFS-10548 Remove the long deprecated BlockReaderRemote Major hdfs Kai Zheng Kai Zheng
HADOOP-13301 Millisecond timestamp for FsShell console log and MapReduce jobsummary log Minor . John Zhuge John Zhuge
HADOOP-13382 remove unneeded commons-httpclient dependencies from POM files in Hadoop and sub-projects Major build Matt Foley Matt Foley
HDFS-10650 DFSClient#mkdirs and DFSClient#primitiveMkdir should use default directory permission Minor . John Zhuge John Zhuge
HDFS-10689 Hdfs dfs chmod should reset sticky bit permission when the bit is omitted in the octal mode Minor fs Manoj Govindassamy Manoj Govindassamy
HDFS-10725 Caller context should always be constructed by a builder Minor ipc Mingliang Liu Mingliang Liu
HDFS-7933 fsck should also report decommissioning replicas. Major namenode Jitendra Nath Pandey Xiaoyu Yao
HADOOP-12726 Unsupported FS operations should throw UnsupportedOperationException Major fs Daniel Templeton Daniel Templeton
HADOOP-13534 Remove unused TrashPolicy#getInstance and initialize code Minor . Zhe Zhang Yiqun Lin
YARN-5567 Fix script exit code checking in NodeHealthScriptRunner#reportHealthStatus Major nodemanager Yufei Gu Yufei Gu
HDFS-2538 option to disable fsck dots Minor namenode Allen Wittenauer Mohammad Kamrul Islam
YARN-5049 Extend NMStateStore to save queued container information Major nodemanager, resourcemanager Konstantinos Karanasos Arun Suresh

IMPORTANT ISSUES:

JIRA Summary Priority Component Reporter Contributor
YARN-4785 inconsistent value type of the “type” field for LeafQueueInfo in response of RM REST API - cluster/scheduler Major webapp Jayesh Varun Vasudev
HADOOP-11393 Revert HADOOP_PREFIX, go back to HADOOP_HOME Major scripts, tracing Allen Wittenauer Allen Wittenauer
HADOOP-12930 [Umbrella] Dynamic subcommands for hadoop shell scripts Critical scripts Allen Wittenauer Allen Wittenauer

NEW FEATURES:

JIRA Summary Priority Component Reporter Contributor
MAPREDUCE-4887 Rehashing partitioner for better distribution Major . Radim Kolar Radim Kolar
HADOOP-11013 CLASSPATH handling should be consolidated, debuggable Major . Allen Wittenauer Allen Wittenauer
HADOOP-6590 Add a username check for hadoop sub-commands Minor scripts Scott Chen John Smith
HADOOP-11353 Add support for .hadooprc Major scripts Allen Wittenauer Allen Wittenauer
HADOOP-9044 add FindClass main class to provide classpath checking of installations Minor util Steve Loughran Steve Loughran
HADOOP-11485 Pluggable shell integration Major scripts Allen Wittenauer Allen Wittenauer
HADOOP-8934 Shell command ls should include sort options Minor fs Jonathan Allen Jonathan Allen
HADOOP-11554 Expose HadoopKerberosName as a hadoop subcommand Major scripts Allen Wittenauer Allen Wittenauer
HADOOP-11565 Add –slaves shell option Major scripts Allen Wittenauer Allen Wittenauer
HADOOP-9477 Add posixGroups support for LDAP groups mapping service Major . Kai Zheng Dapeng Sun
HDFS-8009 Signal congestion on the DataNode Major datanode Haohui Mai Haohui Mai
YARN-2901 Add errors and warning metrics page to RM, NM web UI Major nodemanager, resourcemanager Varun Vasudev Varun Vasudev
HADOOP-9642 Configuration to resolve environment variables via ${env.VARIABLE} references Minor conf, scripts Steve Loughran Kengo Seki
HDFS-7891 A block placement policy with best rack failure tolerance Minor namenode Walter Su Walter Su
HADOOP-11843 Make setting up the build environment easier Major build Niels Basjes Niels Basjes
MAPREDUCE-6284 Add Task Attempt State API to MapReduce Application Master REST API Minor . Ryu Kobayashi Ryu Kobayashi
HADOOP-10971 Add -C flag to make `hadoop fs -ls` print filenames only Major fs Ryan Williams Kengo Seki
MAPREDUCE-6364 Add a “Kill” link to Task Attempts page Minor applicationmaster Ryu Kobayashi Ryu Kobayashi
HADOOP-7947 Validate XMLs if a relevant tool is available, when using scripts Major scripts Harsh J Kengo Seki
HDFS-8487 Generalize BlockInfo in preparation of merging HDFS-7285 into trunk and branch-2 Major namenode Zhe Zhang Zhe Zhang
HDFS-8608 Merge HDFS-7912 to trunk and branch-2 (track BlockInfo instead of Block in UnderReplicatedBlocks and PendingReplicationBlocks) Major . Zhe Zhang Zhe Zhang
HADOOP-5732 Add SFTP FileSystem Minor fs Íñigo Goiri ramtin
HDFS-8622 Implement GETCONTENTSUMMARY operation for WebImageViewer Major . Jagadesh Kiran N Jagadesh Kiran N
HDFS-8155 Support OAuth2 in WebHDFS Major webhdfs Jakob Homan Jakob Homan
MAPREDUCE-6415 Create a tool to combine aggregated logs into HAR files Major . Robert Kanter Robert Kanter
HADOOP-12360 Create StatsD metrics2 sink Minor metrics Dave Marion Dave Marion
HDFS-7285 Erasure Coding Support inside HDFS Major . Weihua Jiang Zhe Zhang
HADOOP-10949 metrics2 sink plugin for Apache Kafka Major metrics Babak Behzad Babak Behzad
YARN-261 Ability to fail AM attempts Major api Jason Lowe Rohith Sharma K S
HDFS-9184 Logging HDFS operation’s caller context into audit logs Major . Mingliang Liu Mingliang Liu
HDFS-9057 allow/disallow snapshots via webhdfs Major webhdfs Allen Wittenauer Brahma Reddy Battula
YARN-4349 Support CallerContext in YARN Major . Wangda Tan Wangda Tan
HADOOP-12366 expose calculated paths Major . Allen Wittenauer Allen Wittenauer
HADOOP-12321 Make JvmPauseMonitor an AbstractService Major . Steve Loughran Sunil Govindan
YARN-3623 We should have a config to indicate the Timeline Service version Major timelineserver Zhijie Shen Xuan Gong
HADOOP-12657 Add a option to skip newline on empty files with getMerge -nl Minor . Jan Filipiak Kanaka Kumar Avvaru
YARN-3458 CPU resource monitoring in Windows Minor nodemanager Íñigo Goiri Íñigo Goiri
HADOOP-12691 Add CSRF Filter for REST APIs to Hadoop Common Major security Larry McCay Larry McCay
HADOOP-12635 Adding Append API support for WASB Major fs/azure Dushyanth Dushyanth
HDFS-9525 hadoop utilities need to support provided delegation tokens Blocker security Allen Wittenauer Heesoo Kim
HADOOP-12702 Add an HDFS metrics sink Major metrics Daniel Templeton Daniel Templeton
HADOOP-12426 Add Entry point for Kerberos health check Minor security Steve Loughran Steve Loughran
HDFS-9244 Support nested encryption zones Major encryption Xiaoyu Yao Zhe Zhang
HADOOP-12548 Read s3a creds from a Credential Provider Major fs/s3 Allen Wittenauer Larry McCay
HDFS-9711 Integrate CSRF prevention filter in WebHDFS. Major datanode, namenode, webhdfs Chris Nauroth Chris Nauroth
HDFS-9835 OIV: add ReverseXML processor which reconstructs an fsimage from an XML file Major tools Colin P. McCabe Colin P. McCabe
HDFS-9239 DataNode Lifeline Protocol: an alternative protocol for reporting DataNode liveness Major datanode, namenode Chris Nauroth Chris Nauroth
HADOOP-12909 Change ipc.Client to support asynchronous calls Major ipc Tsz Wo Nicholas Sze Xiaobing Zhou
HDFS-9945 Datanode command for evicting writers Major datanode Kihwal Lee Kihwal Lee
HADOOP-13008 Add XFS Filter for UIs to Hadoop Common Major security Larry McCay Larry McCay
HADOOP-13065 Add a new interface for retrieving FS and FC Statistics Major fs Ram Venkatesh Mingliang Liu
HADOOP-12723 S3A: Add ability to plug in any AWSCredentialsProvider Major fs/s3 Steven K. Wong Steven K. Wong
HADOOP-12847 hadoop daemonlog should support https and SPNEGO for Kerberized cluster Major security Wei-Chiu Chuang Wei-Chiu Chuang
HADOOP-13226 Support async call retry and failover Major io, ipc Xiaobing Zhou Tsz Wo Nicholas Sze
HADOOP-12537 S3A to support Amazon STS temporary credentials Minor fs/s3 Sean Mackrory Sean Mackrory
HADOOP-12666 Support Microsoft Azure Data Lake - as a file system in Hadoop Major fs/adl, tools Vishwajeet Dusane Vishwajeet Dusane
HDFS-1312 Re-balance disks within a Datanode Major datanode Travis Crawford Anu Engineer
YARN-2928 YARN Timeline Service v.2: alpha 1 Critical timelineserver Sangjin Lee Sangjin Lee
MAPREDUCE-6331 [Umbrella] Make MapReduce work with Timeline Service Nextgen (YARN-2928) Major . Vinod Kumar Vavilapalli Sangjin Lee
HADOOP-12747 support wildcard in libjars argument Major util Sangjin Lee Sangjin Lee
HDFS-9804 Allow long-running Balancer to login with keytab Major balancer & mover, security Xiao Chen Xiao Chen
MAPREDUCE-6690 Limit the number of resources a single map reduce job can submit for localization Major . Chris Trezzo Chris Trezzo
MAPREDUCE-6578 Add support for HDFS heterogeneous storage testing to TestDFSIO Major . Wei Zhou Wei Zhou
HADOOP-13396 Allow pluggable audit loggers in KMS Major kms Xiao Chen Xiao Chen
HDFS-10584 Allow long-running Mover tool to login with keytab Major balancer & mover, security Rakesh R Rakesh R
MAPREDUCE-6304 Specifying node labels when submitting MR jobs Major job submission Jian Fang Naganarasimha G R
YARN-1963 Support priorities across applications within the same queue Major api, resourcemanager Arun C Murthy Sunil Govindan

IMPROVEMENTS:

JIRA Summary Priority Component Reporter Contributor
MAPREDUCE-2944 Improve checking of input for Api displayTasks() Trivial client XieXianshan XieXianshan
HADOOP-8017 Configure hadoop-main pom to get rid of M2E plugin execution not covered Major build Eric Charles Eric Charles
HADOOP-8078 Add capability to turn on security in unit tests. Major test Jitendra Nath Pandey Jaimin Jetly
MAPREDUCE-3956 Remove the use of the deprecated Syncable.sync() method Minor examples Tsz Wo Nicholas Sze Tsz Wo Nicholas Sze
HADOOP-8147 test-patch should run tests with -fn to avoid masking test failures Major test Robert Joseph Evans Robert Joseph Evans
HADOOP-8290 Remove two remaining references to “hadoop.native.lib” oldprop Trivial test Harsh J Harsh J
HDFS-2743 Streamline usage of bookkeeper journal manager Major ha Ivan Kelly Ivan Kelly
HADOOP-8312 testpatch.sh should provide a simpler way to see which warnings changed Major scripts Robert Joseph Evans Robert Joseph Evans
HDFS-3293 Implement equals for journainfo class. Minor namenode Hari Mankude Hari Mankude
HADOOP-8375 test-patch should stop immediately once it has found compilation errors Major build Tsz Wo Nicholas Sze Robert Joseph Evans
HADOOP-8297 Writable javadocs don’t carry default constructor Trivial documentation Harsh J Harsh J
HADOOP-7659 fs -getmerge isn’t guaranteed to work well over non-HDFS filesystems Minor fs Harsh J Harsh J
MAPREDUCE-3302 Remove the last dependency call from org.apache.hadoop.record package in MR. Minor client Harsh J Harsh J
MAPREDUCE-2384 The job submitter should make sure to validate jobs before creation of necessary files Major job submission, test Denny Ye Harsh J
HDFS-3476 Correct the default used in TestDFSClientRetries.busyTest() after HDFS-3462 Minor test Harsh J Harsh J
HDFS-3478 Test quotas with Long.Max_Value Minor namenode Sujay Rau Sujay Rau
MAPREDUCE-4371 Check for cyclic dependencies in Jobcontrol job DAG Major mrv1 madhukara phatak madhukara phatak
HADOOP-8523 test-patch.sh doesn’t validate patches before building Minor build Jack Dintruff Jack Dintruff
HADOOP-8521 Port StreamInputFormat to new Map Reduce API Major streaming madhukara phatak madhukara phatak
HADOOP-8593 add the missed @Override to methods in Metric/Metric2 package Minor metrics Brandon Li Brandon Li
HDFS-3768 Exception in TestJettyHelper is incorrect Minor test Jakob Homan Eli Reisman
HDFS-3834 Unused Command.java fields NAME, DESCRIPTION and USAGE Minor shell Jing Zhao Jing Zhao
HDFS-2580 NameNode#main(…) can make use of GenericOptionsParser. Minor namenode Harsh J Harsh J
HADOOP-8588 SerializationFactory shouldn’t throw a NullPointerException if the serializations list is empty Minor io Harsh J Sho Shimauchi
HADOOP-8838 Colorize the test-patch output sent to JIRA Trivial build Harsh J Harsh J
MAPREDUCE-4686 hadoop-mapreduce-client-core fails compilation in Eclipse due to missing Avro-generated classes Major build Chris Nauroth Chris Nauroth
HADOOP-8864 Addendum to HADOOP-8840: Add a coloring case for +0 results too. Trivial precommit Harsh J Harsh J
HDFS-3995 Use DFSTestUtil.createFile() for file creation and writing in test cases Minor test Jing Zhao Jing Zhao
HADOOP-8920 Add more javadoc to metrics2 related classes Minor metrics Suresh Srinivas Suresh Srinivas
HADOOP-8776 Provide an option in test-patch that can enable / disable compiling native code Minor build Hemanth Yamijala Chris Nauroth
MAPREDUCE-4735 Make arguments in TestDFSIO case insensitive Trivial test Robert Kanter Brandon Li
HADOOP-6616 Improve documentation for rack awareness Major documentation Jeff Hammerbacher Adam Faris
HADOOP-9075 FileContext#FSLinkResolver should be made static Minor . Suresh Srinivas Arpit Agarwal
HDFS-3358 Specify explicitly that the NN UI status total is talking of persistent objects on heap. Trivial namenode Harsh J Harsh J
HADOOP-9277 Improve javadoc for FileContext Minor . Andrew Wang Andrew Wang
HADOOP-9394 Port findHangingTest.sh from HBase to Hadoop Minor . Andrew Wang Andrew Wang
HDFS-4665 Move TestNetworkTopologyWithNodeGroup to Common Minor test Luke Lu Junping Du
MAPREDUCE-5232 log classpath and other key properties on child JVM start Major mrv1, mrv2 Sangjin Lee Sangjin Lee
HDFS-5041 Add the time of last heartbeat to dead server Web UI Minor . Ted Yu Ted Yu
HADOOP-10044 Improve the javadoc of rpc code Minor . Sanjay Radia Sanjay Radia
MAPREDUCE-5197 Checkpoint Service: a library component to facilitate checkpoint of task state Major mrv2 Carlo Curino Carlo Curino
MAPREDUCE-5196 CheckpointAMPreemptionPolicy implements preemption in MR AM via checkpointing Major mr-am, mrv2 Carlo Curino Carlo Curino
HDFS-6228 comments typo fix for FsDatasetImpl.java Trivial . yunjiong zhao yunjiong zhao
HADOOP-8719 Workaround for kerberos-related log errors upon running any hadoop command on OSX Trivial scripts Jianbin Wei Jianbin Wei
HADOOP-10834 Typo in CredentialShell usage Minor security Benoy Antony Benoy Antony
MAPREDUCE-6013 mapred version is missing Major scripts Allen Wittenauer Akira Ajisaka
MAPREDUCE-2841 Task level native optimization Major task Binglin Chang Sean Zhong
YARN-2438 yarn-env.sh cleanup Major scripts Allen Wittenauer Allen Wittenauer
HADOOP-11092 hadoop shell commands should print usage if not given a class Major scripts Bruno Mahé Allen Wittenauer
HDFS-7278 Add a command that allows sysadmins to manually trigger full block reports from a DN Major datanode Colin P. McCabe Colin P. McCabe
HADOOP-11025 hadoop-daemons.sh should just call hdfs directly Major scripts Allen Wittenauer Masatake Iwasaki
HADOOP-11150 hadoop command should show the reason on failure by invalid COMMAND or CLASSNAME Minor scripts Masatake Iwasaki Masatake Iwasaki
HADOOP-11208 Replace “daemon” with better name in script subcommands Major scripts Yongjun Zhang Allen Wittenauer
HADOOP-10926 Improve smart-apply-patch.sh to apply binary diffs Major . Andrew Wang Colin P. McCabe
HADOOP-11081 Document hadoop properties expected to be set by the shell code in *-env.sh Major documentation, scripts Allen Wittenauer Allen Wittenauer
YARN-2472 yarn-daemons.sh should just call yarn directly Major scripts Allen Wittenauer Masatake Iwasaki
YARN-2301 Improve yarn container command Major . Jian He Naganarasimha G R
HADOOP-11352 Clean up test-patch.sh to disable “+1 contrib tests” Major build Akira Ajisaka Akira Ajisaka
YARN-2437 start-yarn.sh/stop-yarn should give info Major scripts Allen Wittenauer Varun Saxena
HDFS-7531 Improve the concurrent access on FsVolumeList Major datanode Lei (Eddy) Xu Lei (Eddy) Xu
HADOOP-11058 Missing HADOOP_CONF_DIR generates strange results Major scripts Allen Wittenauer Masatake Iwasaki
HDFS-7579 Improve log reporting during block report rpc failure Minor datanode Charles Lamb Charles Lamb
HDFS-7446 HDFS inotify should have the ability to determine what txid it has read up to Major hdfs-client Colin P. McCabe Colin P. McCabe
HDFS-7182 JMX metrics aren’t accessible when NN is busy Major . Ming Ma Ming Ma
HADOOP-11466 FastByteComparisons: do not use UNSAFE_COMPARER on the SPARC architecture because it is slower there Minor io, performance, util Suman Somasundar Suman Somasundar
HADOOP-11460 Deprecate shell vars Major scripts Allen Wittenauer John Smith
HADOOP-11346 Rewrite sls/rumen to use new shell framework Major scripts, tools Allen Wittenauer John Smith
HADOOP-7713 dfs -count -q should label output column Trivial . Nigel Daley Jonathan Allen
HADOOP-6964 Allow compact property description in xml Major conf Owen O’Malley Kengo Seki
HADOOP-11506 Configuration variable expansion regex expensive for long values Major conf Dmitriy V. Ryaboy Gera Shegalov
HDFS-7546 Document, and set an accepting default for dfs.namenode.kerberos.principal.pattern Minor security Harsh J Harsh J
HDFS-7694 FSDataInputStream should support “unbuffer” Major . Colin P. McCabe Colin P. McCabe
HDFS-7322 deprecate sbin/hadoop-daemon.sh Major scripts Allen Wittenauer Allen Wittenauer
YARN-2796 deprecate sbin/yarn-daemon.sh Major scripts Allen Wittenauer Allen Wittenauer
MAPREDUCE-6250 deprecate sbin/mr-jobhistory-daemon.sh Major scripts Allen Wittenauer Allen Wittenauer
MAPREDUCE-6260 Convert site documentation to markdown Major documentation Allen Wittenauer Masatake Iwasaki
HADOOP-11575 Daemon log documentation is misleading Major documentation Jagadesh Kiran N Naganarasimha G R
HADOOP-11596 Allow smart-apply-patch.sh to add new files in binary git patches Major . Ravi Prakash Ravi Prakash
HADOOP-11593 Convert site documentation from apt to markdown (stragglers) Major documentation Allen Wittenauer Masatake Iwasaki
YARN-3230 Clarify application states on the web UI Major . Jian He Jian He
HDFS-7460 Rewrite httpfs to use new shell framework Major scripts Allen Wittenauer John Smith
YARN-3168 Convert site documentation from apt to markdown Major documentation Allen Wittenauer Gururaj Shetty
YARN-3199 Fair Scheduler documentation improvements Minor fairscheduler Rohit Agarwal Rohit Agarwal
MAPREDUCE-6267 Refactor JobSubmitter#copyAndConfigureFiles into it’s own class Minor . Chris Trezzo Chris Trezzo
YARN-3249 Add a “kill application” button to Resource Manager’s Web UI Minor resourcemanager Ryu Kobayashi Ryu Kobayashi
HADOOP-11673 Use org.junit.Assume to skip tests instead of return Minor test Akira Ajisaka Brahma Reddy Battula
HADOOP-11692 Improve authentication failure WARN message to avoid user confusion Major ipc Yongjun Zhang Yongjun Zhang
HADOOP-11226 Add a configuration to set ipc.Client’s traffic class with IPTOS_LOWDELAY|IPTOS_RELIABILITY Major ipc Gopal V Gopal V
YARN-2280 Resource manager web service fields are not accessible Trivial resourcemanager Krisztian Horvath Krisztian Horvath
HADOOP-11711 Provide a default value for AES/CTR/NoPadding CryptoCodec classes Minor . Andrew Wang Andrew Wang
MAPREDUCE-4414 Add main methods to JobConf and YarnConfiguration, for debug purposes Major client Harsh J Plamen Jeliazkov
MAPREDUCE-6105 Inconsistent configuration in property mapreduce.reduce.shuffle.merge.percent Trivial . Dongwook Kwon Ray Chiang
HDFS-2360 Ugly stacktrace when quota exceeds Minor hdfs-client Rajit Saha Harsh J
MAPREDUCE-6100 replace “mapreduce.job.credentials.binary” with MRJobConfig.MAPREDUCE_JOB_CREDENTIALS_BINARY for better readability. Trivial mrv2 zhihai xu zhihai xu
MAPREDUCE-5755 MapTask.MapOutputBuffer#compare/swap should have @Override annotation Trivial . Tsuyoshi Ozawa Tsuyoshi Ozawa
MAPREDUCE-4653 TestRandomAlgorithm has an unused “import” statement Trivial contrib/gridmix Amir Sanjar Amir Sanjar
HADOOP-11659 o.a.h.fs.FileSystem.Cache#remove should use a single hash map lookup Minor fs Gera Shegalov Brahma Reddy Battula
HADOOP-11709 Time.NANOSECONDS_PER_MILLISECOND - use class-level final constant instead of method variable Trivial . Ajith S Ajith S
HDFS-7835 make initial sleeptime in locateFollowingBlock configurable for DFSClient. Major hdfs-client zhihai xu zhihai xu
HDFS-7829 Code clean up for LocatedBlock Minor . Jing Zhao Takanobu Asanuma
MAPREDUCE-6282 Reuse historyFileAbsolute.getFileSystem in CompletedJob#loadFullHistoryData for code optimization. Trivial jobhistoryserver zhihai xu zhihai xu
HADOOP-11447 Add a more meaningful toString method to SampleStat and MutableStat Minor metrics Karthik Kambatla Karthik Kambatla
YARN-3350 YARN RackResolver spams logs with messages at info level Major . Wilfred Spiegelenburg Wilfred Spiegelenburg
MAPREDUCE-6239 Consolidate TestJobConf classes in hadoop-mapreduce-client-jobclient and hadoop-mapreduce-client-core Minor client Varun Saxena Varun Saxena
MAPREDUCE-5190 Unnecessary condition test in RandomSampler Minor mrv2 Jingguo Yao Jingguo Yao
MAPREDUCE-6287 Deprecated methods in org.apache.hadoop.examples.Sort Minor examples Chao Zhang Chao Zhang
HADOOP-11737 mockito’s version in hadoop-nfs’ pom.xml shouldn’t be specified Minor nfs Kengo Seki Kengo Seki
YARN-2868 FairScheduler: Metric for latency to allocate first container for an application Major . Ray Chiang Ray Chiang
HDFS-7875 Improve log message when wrong value configured for dfs.datanode.failed.volumes.tolerated Trivial datanode nijel nijel
HDFS-7793 Refactor DFSOutputStream separating DataStreamer out Major hdfs-client Kai Zheng Li Bo
HADOOP-11741 Add LOG.isDebugEnabled() guard for some LOG.debug() Major . Walter Su Walter Su
MAPREDUCE-579 Streaming “slowmatch” documentation Trivial contrib/streaming Bo Adler Harsh J
HDFS-7928 Scanning blocks from disk during rolling upgrade startup takes a lot of time if disks are busy Major datanode Rushabh S Shah Rushabh S Shah
HADOOP-11524 hadoop_do_classpath_subcommand throws a shellcheck warning Minor scripts Allen Wittenauer Chris Nauroth
HADOOP-11719 [Fsshell] Remove bin/hadoop reference from GenericOptionsParser default help text Minor scripts Brahma Reddy Battula Brahma Reddy Battula
HDFS-8004 Use KeyProviderCryptoExtension#warmUpEncryptedKeys when creating an encryption zone Trivial encryption Andrew Wang Andrew Wang
HDFS-7890 Improve information on Top users for metrics in RollingWindowsManager and lower log level Major . J.Andreina J.Andreina
HDFS-4396 Add START_MSG/SHUTDOWN_MSG for ZKFC Major auto-failover, ha, tools Liang Xie Liang Xie
HADOOP-11660 Add support for hardware crc of HDFS checksums on ARM aarch64 architecture Minor native Edward Nevill Edward Nevill
HDFS-7645 Rolling upgrade is restoring blocks from trash multiple times Major datanode Nathan Roberts Keisuke Ogiwara
HDFS-3918 EditLogTailer shouldn’t log WARN when other node is in standby mode Major ha Todd Lipcon Todd Lipcon
HDFS-7944 Minor cleanup of BlockPoolManager#getAllNamenodeThreads Minor . Arpit Agarwal Arpit Agarwal
YARN-3258 FairScheduler: Need to add more logging to investigate allocations Minor fairscheduler Anubhav Dhoot Anubhav Dhoot
HDFS-7671 hdfs user guide should point to the common rack awareness doc Major documentation Allen Wittenauer Kai Sasaki
YARN-3412 RM tests should use MockRM where possible Major resourcemanager, test Karthik Kambatla Karthik Kambatla
YARN-3428 Debug log resources to be localized for a container Trivial nodemanager Karthik Kambatla Karthik Kambatla
YARN-3424 Change logs for ContainerMonitorImpl’s resourse monitoring from info to debug Major nodemanager Anubhav Dhoot Anubhav Dhoot
YARN-3248 Display count of nodes blacklisted by apps in the web UI Major capacityscheduler, resourcemanager Varun Vasudev Varun Vasudev
HDFS-7978 Add LOG.isDebugEnabled() guard for some LOG.debug(..) Major . Walter Su Walter Su
HDFS-8008 Support client-side back off when the datanodes are congested Major hdfs-client Haohui Mai Haohui Mai
HDFS-7888 Change DataStreamer/DFSOutputStream/DFSPacket for convenience of subclassing Minor hdfs-client Li Bo Li Bo
HDFS-8035 Move checkBlocksProperlyReplicated() in FSNamesystem to BlockManager Minor namenode Haohui Mai Haohui Mai
HADOOP-9805 Refactor RawLocalFileSystem#rename for improved testability. Minor fs, test Chris Nauroth Jean-Pierre Matsumoto
HADOOP-11785 Reduce number of listStatus operation in distcp buildListing() Minor tools/distcp Zoran Dimitrijevic Zoran Dimitrijevic
HADOOP-11717 Add Redirecting WebSSO behavior with JWT Token in Hadoop Auth Major security Larry McCay Larry McCay
YARN-3294 Allow dumping of Capacity Scheduler debug logs via web UI for a fixed time period Major capacityscheduler Varun Vasudev Varun Vasudev
HDFS-8073 Split BlockPlacementPolicyDefault.chooseTarget(..) so it can be easily overrided. Trivial namenode Walter Su Walter Su
HDFS-8076 Code cleanup for DFSInputStream: use offset instead of LocatedBlock when possible Major . Zhe Zhang Zhe Zhang
HDFS-7979 Initialize block report IDs with a random number Minor datanode Andrew Wang Andrew Wang
HDFS-8101 DFSClient use of non-constant DFSConfigKeys pulls in WebHDFS classes at runtime Minor hdfs-client Sean Busbey Sean Busbey
YARN-3293 Track and display capacity scheduler health metrics in web UI Major capacityscheduler Varun Vasudev Varun Vasudev
MAPREDUCE-6291 Correct mapred queue usage command Minor client Brahma Reddy Battula Brahma Reddy Battula
MAPREDUCE-6307 Remove property mapreduce.tasktracker.taskmemorymanager.monitoringinterval Minor . Akira Ajisaka J.Andreina
YARN-3348 Add a ‘yarn top’ tool to help understand cluster usage Major resourcemanager Varun Vasudev Varun Vasudev
YARN-3469 ZKRMStateStore: Avoid setting watches that are not required Minor . Jun Gong Jun Gong
HDFS-8117 More accurate verification in SimulatedFSDataset: replace DEFAULT_DATABYTE with patterned data Major . Zhe Zhang Zhe Zhang
HDFS-8144 Split TestLazyPersistFiles into multiple tests Major test Arpit Agarwal Arpit Agarwal
YARN-3404 View the queue name to YARN Application page Minor . Ryu Kobayashi Ryu Kobayashi
YARN-3451 Add start time and Elapsed in ApplicationAttemptReport and display the same in RMAttemptBlock WebUI Major api, webapp Rohith Sharma K S Rohith Sharma K S
HDFS-7863 Missing description of some methods and parameters in javadoc of FSDirDeleteOp Minor . Yongjun Zhang Brahma Reddy Battula
HDFS-8152 Refactoring of lazy persist storage cases Major test Arpit Agarwal Arpit Agarwal
HDFS-8133 Improve readability of deleted block check Major namenode Daryn Sharp Daryn Sharp
HADOOP-11812 Implement listLocatedStatus for ViewFileSystem to speed up split calculation Blocker fs Gera Shegalov Gera Shegalov
MAPREDUCE-6297 Task Id of the failed task in diagnostics should link to the task page Minor jobhistoryserver Siqi Li Siqi Li
HADOOP-11827 Speed-up distcp buildListing() using threadpool Major tools/distcp Zoran Dimitrijevic Zoran Dimitrijevic
YARN-3494 Expose AM resource limit and usage in QueueMetrics Major . Jian He Rohith Sharma K S
YARN-3503 Expose disk utilization percentage and bad local and log dir counts on NM via JMX Major nodemanager Varun Vasudev Varun Vasudev
YARN-3410 YARN admin should be able to remove individual application records from RMStateStore Critical resourcemanager, yarn Wangda Tan Rohith Sharma K S
HDFS-8215 Refactor NamenodeFsck#check method Minor namenode Takanobu Asanuma Takanobu Asanuma
YARN-3511 Add errors and warnings page to ATS Major timelineserver Varun Vasudev Varun Vasudev
HDFS-8176 Record from/to snapshots in audit log for snapshot diff report Minor snapshots J.Andreina J.Andreina
YARN-3406 Display count of running containers in the RM’s Web UI Minor . Ryu Kobayashi Ryu Kobayashi
HADOOP-11357 Print information of the build enviornment in test-patch.sh Minor scripts Haohui Mai Allen Wittenauer
HADOOP-11857 Fix CommandFormat#commandFormat java doc annotation Trivial . Xiaoyu Yao J.Andreina
MAPREDUCE-6057 Remove obsolete entries from mapred-default.xml Minor . Ray Chiang Ray Chiang
HDFS-8204 Mover/Balancer should not schedule two replicas to the same DN Minor balancer & mover Walter Su Walter Su
HDFS-8280 Code Cleanup in DFSInputStream Minor . Jing Zhao Jing Zhao
HDFS-8283 DataStreamer cleanup and some minor improvement Minor hdfs-client Tsz Wo Nicholas Sze Tsz Wo Nicholas Sze
HDFS-5574 Remove buffer copy in BlockReader.skip Trivial . Binglin Chang Binglin Chang
HDFS-7770 Need document for storage type label of data node storage locations under dfs.datanode.data.dir Major documentation Xiaoyu Yao Xiaoyu Yao
HDFS-8200 Refactor FSDirStatAndListingOp Major . Haohui Mai Haohui Mai
YARN-3363 add localization and container launch time to ContainerMetrics at NM to show these timing information for each active container. Major nodemanager zhihai xu zhihai xu
HDFS-7397 Add more detail to the documentation for the conf key “dfs.client.read.shortcircuit.streams.cache.size” Minor hdfs-client Tsz Wo Nicholas Sze Brahma Reddy Battula
YARN-2980 Move health check script related functionality to hadoop-common Blocker . Ming Ma Varun Saxena
HADOOP-11911 test-patch should allow configuration of default branch Minor . Sean Busbey Sean Busbey
HDFS-7758 Retire FsDatasetSpi#getVolumes() and use FsDatasetSpi#getVolumeRefs() instead Major datanode Lei (Eddy) Xu Lei (Eddy) Xu
MAPREDUCE-6192 Create unit test to automatically compare MR related classes and mapred-default.xml Minor . Ray Chiang Ray Chiang
HADOOP-11813 releasedocmaker.py should use today’s date instead of unreleased Minor build Allen Wittenauer Darrell Taylor
YARN-3491 PublicLocalizer#addResource is too slow. Critical nodemanager zhihai xu zhihai xu
MAPREDUCE-6279 AM should explicity exit JVM after all services have stopped Major . Jason Lowe Eric Payne
HDFS-8108 Fsck should provide the info on mandatory option to be used along with “-blocks , -locations and -racks” Trivial documentation J.Andreina J.Andreina
HDFS-8207 Improper log message when blockreport interval compared with initial delay Minor . Brahma Reddy Battula Brahma Reddy Battula
MAPREDUCE-6079 Rename JobImpl#username to reporterUserName Major . Tsuyoshi Ozawa Tsuyoshi Ozawa
HDFS-8209 Support different number of datanode directories in MiniDFSCluster. Minor test Surendra Singh Lilhore Surendra Singh Lilhore
YARN-3169 Drop YARN’s overview document Major documentation Allen Wittenauer Brahma Reddy Battula
YARN-2784 Make POM project names consistent Minor build Rohith Sharma K S Rohith Sharma K S
MAPREDUCE-5981 Log levels of certain MR logs can be changed to DEBUG Major . Varun Saxena Varun Saxena
HADOOP-6842 “hadoop fs -text” does not give a useful text representation of MapWritable objects Major io Steven K. Wong Akira Ajisaka
YARN-20 More information for “yarn.resourcemanager.webapp.address” in yarn-default.xml Trivial documentation, resourcemanager Nemon Lou Bartosz Ługowski
HDFS-5640 Add snapshot methods to FileContext. Major hdfs-client, snapshots Chris Nauroth Rakesh R
HDFS-8284 Update documentation about how to use HTrace with HDFS Major documentation Masatake Iwasaki Masatake Iwasaki
HDFS-7433 Optimize performance of DatanodeManager’s node map Critical namenode Daryn Sharp Daryn Sharp
HADOOP-11590 Update sbin commands and documentation to use new –slaves option Blocker documentation, scripts Allen Wittenauer Allen Wittenauer
MAPREDUCE-5248 Let NNBenchWithoutMR specify the replication factor for its test Minor client, test Erik Paulson Erik Paulson
HADOOP-9737 JarFinder#getJar should delete the jar file upon destruction of the JVM Major util Esteban Gutierrez Jean-Baptiste Onofré
YARN-1050 Document the Fair Scheduler REST API Major documentation, fairscheduler Sandy Ryza Kenji Kikushima
YARN-3271 FairScheduler: Move tests related to max-runnable-apps from TestFairScheduler to TestAppRunnability Major . Karthik Kambatla nijel
YARN-2206 Update document for applications REST API response examples Minor documentation Kenji Kikushima Brahma Reddy Battula
HDFS-6757 Simplify lease manager with INodeID Major . Haohui Mai Haohui Mai
HDFS-8327 Simplify quota calculations for snapshots and truncate Major . Haohui Mai Haohui Mai
YARN-1287 Consolidate MockClocks Major . Sandy Ryza Sebastian Wong
HDFS-8357 Consolidate parameters of INode.CleanSubtree() into a parameter objects. Major . Haohui Mai Li Lu
HADOOP-11950 Add cli option to test-patch to set the project-under-test Minor . Sean Busbey Sean Busbey
HADOOP-11948 test-patch’s issue matching regex should be configurable. Major . Sean Busbey Sean Busbey
MAPREDUCE-5465 Tasks are often killed before they exit on their own Major mr-am, mrv2 Radim Kolar Ming Ma
YARN-3513 Remove unused variables in ContainersMonitorImpl and add debug log for overall resource usage by all containers Trivial nodemanager Naganarasimha G R Naganarasimha G R
HDFS-8255 Rename getBlockReplication to getPreferredBlockReplication Major . Zhe Zhang Zhe Zhang
YARN-3613 TestContainerManagerSecurity should init and start Yarn cluster in setup instead of individual methods Minor test Karthik Kambatla nijel
HDFS-6184 Capture NN’s thread dump when it fails over Major namenode Ming Ma Ming Ma
YARN-3539 Compatibility doc to state that ATS v1 is a stable REST API Major documentation Steve Loughran Steve Loughran
HADOOP-9723 Improve error message when hadoop archive output path already exists Trivial . Stephen Chu Yongjun Zhang
HADOOP-10993 Dump java command line to *.out file Minor . Allen Wittenauer Kengo Seki
HADOOP-11713 ViewFileSystem should support snapshot methods. Major fs Chris Nauroth Rakesh R
HDFS-8350 Remove old webhdfs.xml and other outdated documentation stuff Major documentation Akira Ajisaka Brahma Reddy Battula
HADOOP-11960 Enable Azure-Storage Client Side logging. Major tools Dushyanth Dushyanth
HDFS-6888 Allow selectively audit logging ops Major . Kihwal Lee Chen He
HDFS-8397 Refactor the error handling code in DataStreamer Minor hdfs-client Tsz Wo Nicholas Sze Tsz Wo Nicholas Sze
HDFS-8394 Move getAdditionalBlock() and related functionalities into a separate class Major . Haohui Mai Haohui Mai
HADOOP-11939 Deprecate DistCpV1 and Logalyzer Major . Brahma Reddy Battula Brahma Reddy Battula
HDFS-4185 Add a metric for number of active leases Major namenode Kihwal Lee Rakesh R
HADOOP-1540 Support file exclusion list in distcp Minor util Senthil Subramanian Steven Rand
HADOOP-11103 Clean up RemoteException Trivial ipc Sean Busbey Sean Busbey
HDFS-8131 Implement a space balanced block placement policy Minor namenode Liu Shaohui Liu Shaohui
HADOOP-11970 Replace uses of ThreadLocal<Random> with JDK7 ThreadLocalRandom Major . Sean Busbey Sean Busbey
HADOOP-11995 Make jetty version configurable from the maven command line Trivial build, ld sriharsha devineni sriharsha devineni
HDFS-4383 Document the lease limits Minor . Eli Collins Mohammad Arshad
HADOOP-10366 Add whitespaces between the classes for values in core-default.xml to fit better in browser Minor documentation Chengwei Yang Kanaka Kumar Avvaru
HADOOP-11594 Improve the readability of site index of documentation Minor documentation Masatake Iwasaki Masatake Iwasaki
YARN-160 nodemanagers should obtain cpu/memory values from underlying OS Major nodemanager Alejandro Abdelnur Varun Vasudev
HADOOP-11242 Record the time of calling in tracing span of IPC server Minor ipc Masatake Iwasaki Masatake Iwasaki
HDFS-5033 Bad error message for fs -put/copyFromLocal if user doesn’t have permissions to read the source Minor . Karthik Kambatla Darrell Taylor
YARN-3722 Merge multiple TestWebAppUtils into o.a.h.yarn.webapp.util.TestWebAppUtils Minor test Masatake Iwasaki Masatake Iwasaki
HADOOP-11142 Remove hdfs dfs reference from file system shell documentation Minor documentation Jonathan Allen Kengo Seki
HADOOP-11894 Bump the version of Apache HTrace to 3.2.0-incubating Major . Masatake Iwasaki Masatake Iwasaki
YARN-3489 RMServerUtils.validateResourceRequests should only obtain queue info once Major resourcemanager Jason Lowe Varun Saxena
HDFS-8443 Document dfs.namenode.service.handler.count in hdfs-site.xml Major documentation Akira Ajisaka J.Andreina
YARN-3547 FairScheduler: Apps that have no resource demand should not participate scheduling Major fairscheduler Xianyin Xin Xianyin Xin
YARN-3713 Remove duplicate function call storeContainerDiagnostics in ContainerDiagnosticsUpdateTransition Minor nodemanager zhihai xu zhihai xu
HADOOP-12043 Display warning if defaultFs is not set when running fs commands. Minor fs Lei (Eddy) Xu Lei (Eddy) Xu
YARN-3467 Expose allocatedMB, allocatedVCores, and runningContainers metrics on running Applications in RM Web UI Minor webapp, yarn Anthony Rojas Anubhav Dhoot
HDFS-8490 Typo in trace enabled log in ExceptionHandler of WebHDFS Trivial webhdfs Jakob Homan Archana T
HDFS-8521 Add @VisibleForTesting annotation to {{BlockPoolSlice#selectReplicaToDelete}} Trivial . Colin P. McCabe Colin P. McCabe
MAPREDUCE-6174 Combine common stream code into parent class for InMemoryMapOutput and OnDiskMapOutput. Major mrv2 Eric Payne Eric Payne
HDFS-8532 Make the visibility of DFSOutputStream#streamer member variable to private Trivial . Rakesh R Rakesh R
HDFS-8535 Clarify that dfs usage in dfsadmin -report output includes all block replicas. Minor documentation Lei (Eddy) Xu Lei (Eddy) Xu
MAPREDUCE-6383 Pi job (QuasiMonteCarlo) should not try to read the results file if its job fails Major examples Harsh J Harsh J
YARN-3259 FairScheduler: Trigger fairShare updates on node events Major fairscheduler Anubhav Dhoot Anubhav Dhoot
HADOOP-12059 S3Credentials should support use of CredentialProvider Major fs/s3 Sean Busbey Sean Busbey
MAPREDUCE-6354 ShuffleHandler should be able to log shuffle connections Major . Chang Li Chang Li
HADOOP-12055 Deprecate usage of NativeIO#link Major native Andrew Wang Andrew Wang
HDFS-8432 Introduce a minimum compatible layout version to allow downgrade in more rolling upgrade use cases. Major namenode, rolling upgrades Chris Nauroth Chris Nauroth
HDFS-8116 Cleanup uncessary if LOG.isDebugEnabled() from RollingWindowManager Trivial namenode Xiaoyu Yao Brahma Reddy Battula
YARN-2716 Refactor ZKRMStateStore retry code with Apache Curator Major . Jian He Karthik Kambatla
HDFS-8553 Document hdfs class path options Major documentation Xiaoyu Yao Brahma Reddy Battula
YARN-3786 Document yarn class path options Major documentation Brahma Reddy Battula Brahma Reddy Battula
MAPREDUCE-6392 Document mapred class path options Major documentation Brahma Reddy Battula Brahma Reddy Battula
HDFS-8549 Abort the balancer if an upgrade is in progress Major balancer & mover Andrew Wang Andrew Wang
HDFS-8573 Move creation of restartMeta file logic from BlockReceiver to ReplicaInPipeline Major datanode Lei (Eddy) Xu Lei (Eddy) Xu
HADOOP-11971 Move test utilities for tracing from hadoop-hdfs to hadoop-common Minor tracing Masatake Iwasaki Masatake Iwasaki
HDFS-8361 Choose SSD over DISK in block placement Major namenode Tsz Wo Nicholas Sze Tsz Wo Nicholas Sze
YARN-3789 Improve logs for LeafQueue#activateApplications() Minor resourcemanager Bibin A Chundatt Bibin A Chundatt
HDFS-8606 Cleanup DFSOutputStream by removing unwanted changes Minor hdfs-client Rakesh R Rakesh R
YARN-3148 Allow CORS related headers to passthrough in WebAppProxyServlet Major . Prakash Ramachandran Varun Saxena
HDFS-8589 Fix unused imports in BPServiceActor and BlockReportLeaseManager Trivial . Colin P. McCabe Colin P. McCabe
HADOOP-7139 Allow appending to existing SequenceFiles Major io Stephen Rose Kanaka Kumar Avvaru
HDFS-8605 Merge Refactor of DFSOutputStream from HDFS-7285 branch Major . Vinayakumar B Vinayakumar B
MAPREDUCE-6395 Improve the commit failure messages in MRAppMaster recovery Major applicationmaster Gera Shegalov Brahma Reddy Battula
HDFS-8582 Support getting a list of reconfigurable config properties and do not generate spurious reconfig warnings Minor datanode, hdfs-client Lei (Eddy) Xu Lei (Eddy) Xu
MAPREDUCE-6316 Task Attempt List entries should link to the task overview Major . Siqi Li Siqi Li
MAPREDUCE-6305 AM/Task log page should be able to link back to the job Major . Siqi Li Siqi Li
YARN-3834 Scrub debug logging of tokens during resource localization. Major nodemanager Chris Nauroth Chris Nauroth
MAPREDUCE-6408 Queue name and user name should be printed on the job page Major applicationmaster Siqi Li Siqi Li
HDFS-8639 Option for HTTP port of NameNode by MiniDFSClusterManager Minor test Kai Sasaki Kai Sasaki
YARN-3360 Add JMX metrics to TimelineDataManager Major timelineserver Jason Lowe Jason Lowe
HADOOP-12049 Control http authentication cookie persistence via configuration Major security Benoy Antony H Lu
HDFS-8462 Implement GETXATTRS and LISTXATTRS operations for WebImageViewer Major . Akira Ajisaka Jagadesh Kiran N
HDFS-8640 Make reserved RBW space visible through JMX Major . Kanaka Kumar Avvaru Kanaka Kumar Avvaru
HDFS-8546 Use try with resources in DataStorage and Storage Minor datanode Andrew Wang Andrew Wang
HADOOP-11203 Allow ditscp to accept bandwitdh in fraction MegaBytes Major tools/distcp Raju Bairishetti Raju Bairishetti
HADOOP-11807 add a lint mode to releasedocmaker Minor build, documentation, yetus Allen Wittenauer ramtin
HDFS-8653 Code cleanup for DatanodeManager, DatanodeDescriptor and DatanodeStorageInfo Major . Zhe Zhang Zhe Zhang
HDFS-8659 Block scanner INFO message is spamming logs Major datanode Yongjun Zhang Yongjun Zhang
HADOOP-12149 copy all of test-patch BINDIR prior to re-exec Blocker yetus Allen Wittenauer Allen Wittenauer
MAPREDUCE-6384 Add the last reporting reducer info for too many fetch failure diagnostics Major . Chang Li Chang Li
HADOOP-12158 Improve error message in TestCryptoStreamsWithOpensslAesCtrCryptoCodec when OpenSSL is not installed Trivial test Andrew Wang Andrew Wang
HADOOP-12172 FsShell mkdir -p makes an unnecessary check for the existence of the parent. Minor fs Chris Nauroth Chris Nauroth
HDFS-8703 Merge refactor of DFSInputStream from ErasureCoding branch Major . Vinayakumar B Vinayakumar B
HDFS-8709 Clarify automatic sync in FSEditLog#logEdit Minor . Andrew Wang Andrew Wang
HADOOP-12045 Enable LocalFileSystem#setTimes to change atime Minor fs Kazuho Fujii Kazuho Fujii
HADOOP-12185 NetworkTopology is not efficient adding/getting/removing nodes Major . Íñigo Goiri Íñigo Goiri
HADOOP-12135 cleanup releasedocmaker Major yetus Allen Wittenauer Allen Wittenauer
HADOOP-12195 Add annotation to package-info.java file to workaround MCOMPILER-205 Trivial . Andrew Wang Andrew Wang
HADOOP-12193 Rename Touchz.java to Touch.java Trivial . Andrew Wang Andrew Wang
HDFS-8711 setSpaceQuota command should print the available storage type when input storage type is wrong Major hdfs-client Surendra Singh Lilhore Surendra Singh Lilhore
HDFS-8712 Remove “public” and “abstract” modifiers in FsVolumeSpi and FsDatasetSpi Trivial . Lei (Eddy) Xu Lei (Eddy) Xu
HADOOP-12194 Support for incremental generation in the protoc plugin Major . Andrew Wang Andrew Wang
HADOOP-12180 Move ResourceCalculatorPlugin from YARN to Common Major util Chris Douglas Chris Douglas
HADOOP-12210 Collect network usage on the node Major . Robert Grandl Robert Grandl
YARN-3069 Document missing properties in yarn-default.xml Major documentation Ray Chiang Ray Chiang
YARN-3381 Fix typo InvalidStateTransitonException Minor api Xiaoshuang LU Brahma Reddy Battula
HADOOP-12211 Collect disks usages on the node Major . Robert Grandl Robert Grandl
HDFS-8722 Optimize datanode writes for small writes and flushes Critical . Kihwal Lee Kihwal Lee
HADOOP-12232 Upgrade Tomcat dependency to 6.0.44. Major build Chris Nauroth Chris Nauroth
YARN-3170 YARN architecture document needs updating Major documentation Allen Wittenauer Brahma Reddy Battula
YARN-3174 Consolidate the NodeManager and NodeManagerRestart documentation into one Major documentation Allen Wittenauer Masatake Iwasaki
HDFS-7314 When the DFSClient lease cannot be renewed, abort open-for-write files rather than the entire DFSClient Major . Ming Ma Ming Ma
HADOOP-10979 Auto-entries in hadoop_usage Minor scripts Allen Wittenauer Allen Wittenauer
HADOOP-11893 Mark org.apache.hadoop.security.token.Token as @InterfaceAudience.Public Major security Steve Loughran Brahma Reddy Battula
HADOOP-12081 Fix UserGroupInformation.java to support 64-bit zLinux Major security Adam Roberts Akira Ajisaka
HADOOP-12214 Parse ‘HadoopArchive’ commandline using cli Options. Minor . Vinayakumar B Vinayakumar B
YARN-3261 rewrite resourcemanager restart doc to remove roadmap bits Major documentation Allen Wittenauer Gururaj Shetty
YARN-2921 Fix MockRM/MockAM#waitForState sleep too long Major test Karthik Kambatla Tsuyoshi Ozawa
HADOOP-12161 Add getStoragePolicy API to the FileSystem interface Major fs Arpit Agarwal Brahma Reddy Battula
HADOOP-12189 Improve CallQueueManager#swapQueue to make queue elements drop nearly impossible. Major ipc, test zhihai xu zhihai xu
HADOOP-12009 Clarify FileSystem.listStatus() sorting order & fix FileSystemContractBaseTest:testListStatus Minor documentation, fs, test Jakob Homan J.Andreina
HADOOP-12259 Utility to Dynamic port allocation Major test, util Brahma Reddy Battula Brahma Reddy Battula
HDFS-8735 Inotify : All events classes should implement toString() API. Major hdfs-client Surendra Singh Lilhore Surendra Singh Lilhore
HDFS-7858 Improve HA Namenode Failover detection on the client Major hdfs-client Arun Suresh Arun Suresh
HDFS-8180 AbstractFileSystem Implementation for WebHdfs Major webhdfs Santhosh G Nayak Santhosh G Nayak
HDFS-8811 Move BlockStoragePolicy name’s constants from HdfsServerConstants.java to HdfsConstants.java Major . Vinayakumar B Vinayakumar B
HDFS-8822 Add SSD storagepolicy tests in TestBlockStoragePolicy#testDefaultPolicies Major . Vinayakumar B Vinayakumar B
YARN-3950 Add unique YARN_SHELL_ID environment variable to DistributedShell Major applications/distributed-shell Robert Kanter Robert Kanter
YARN-2768 Avoid cloning Resource in FSAppAttempt#updateDemand Minor fairscheduler Hong Zhiguo Hong Zhiguo
HDFS-8816 Improve visualization for the Datanode tab in the NN UI Major . Haohui Mai Haohui Mai
HDFS-8821 Explain message “Operation category X is not supported in state standby” Minor . Gautam Gopalakrishnan Gautam Gopalakrishnan
HADOOP-12271 Hadoop Jar Error Should Be More Explanatory Minor . Jesse Anderson Josh Elser
HADOOP-12249 pull argument parsing into a function Major scripts Allen Wittenauer Allen Wittenauer
HADOOP-12183 Annotate the HTrace span created by FsShell with the command-line arguments passed by the user Minor tracing Masatake Iwasaki Masatake Iwasaki
YARN-3978 Configurably turn off the saving of container info in Generic AHS Major timelineserver, yarn Eric Payne Eric Payne
YARN-3965 Add startup timestamp to nodemanager UI Minor nodemanager Hong Zhiguo Hong Zhiguo
HADOOP-12280 Skip unit tests based on maven profile rather than NativeCodeLoader.isNativeCodeLoaded Minor test Masatake Iwasaki Masatake Iwasaki
HDFS-8815 DFS getStoragePolicy implementation using single RPC call Major hdfs-client Arpit Agarwal Surendra Singh Lilhore
YARN-3961 Expose pending, running and reserved containers of a queue in REST api and yarn top Major capacityscheduler, fairscheduler, webapp Anubhav Dhoot Anubhav Dhoot
YARN-4019 Add JvmPauseMonitor to ResourceManager and NodeManager Major nodemanager, resourcemanager Robert Kanter Robert Kanter
MAPREDUCE-6443 Add JvmPauseMonitor to Job History Server Major jobhistoryserver Robert Kanter Robert Kanter
HDFS-8887 Expose storage type and storage ID in BlockLocation Major . Andrew Wang Andrew Wang
HADOOP-12318 Expose underlying LDAP exceptions in SaslPlainServer Minor security Mike Yoder Mike Yoder
HADOOP-12295 Improve NetworkTopology#InnerNode#remove logic Major . Yi Liu Yi Liu
HDFS-7649 Multihoming docs should emphasize using hostnames in configurations Major documentation Arpit Agarwal Brahma Reddy Battula
YARN-4055 Report node resource utilization in heartbeat Major nodemanager Íñigo Goiri Íñigo Goiri
HDFS-8713 Convert DatanodeDescriptor to use SLF4J logging Trivial . Andrew Wang Andrew Wang
HDFS-8883 NameNode Metrics : Add FSNameSystem lock Queue Length Major namenode Anu Engineer Anu Engineer
HDFS-6407 Add sorting and pagination in the datanode tab of the NN Web UI Critical namenode Nathan Roberts Haohui Mai
HDFS-8880 NameNode metrics logging Major namenode Arpit Agarwal Arpit Agarwal
YARN-4057 If ContainersMonitor is not enabled, only print related log info one time Minor nodemanager Jun Gong Jun Gong
HADOOP-12050 Enable MaxInactiveInterval for hadoop http auth token Major security Benoy Antony H Lu
HDFS-8435 Support CreateFlag in WebHdfs Major webhdfs Vinoth Sathappan Jakob Homan
HDFS-8911 NameNode Metric : Add Editlog counters as a JMX metric Major namenode Anu Engineer Anu Engineer
HDFS-8917 Cleanup BlockInfoUnderConstruction from comments and tests Minor namenode Zhe Zhang Zhe Zhang
HDFS-8884 Fail-fast check in BlockPlacementPolicyDefault#chooseTarget Major . Yi Liu Yi Liu
HDFS-8828 Utilize Snapshot diff report to build diff copy list in distcp Major distcp, snapshots Yufei Gu Yufei Gu
HDFS-8924 Add pluggable interface for reading replicas in DFSClient Major hdfs-client Colin P. McCabe Colin P. McCabe
HDFS-8928 Improvements for BlockUnderConstructionFeature: ReplicaUnderConstruction as a separate class and replicas as an array Minor namenode Zhe Zhang Jing Zhao
HDFS-2390 dfsadmin -setBalancerBandwidth doesnot validate -ve value Minor balancer & mover Rajit Saha Gautam Gopalakrishnan
HDFS-8983 NameNode support for protected directories Major namenode Arpit Agarwal Arpit Agarwal
HDFS-8946 Improve choosing datanode storage for block placement Major namenode Yi Liu Yi Liu
HDFS-8965 Harden edit log reading code against out of memory errors Major . Colin P. McCabe Colin P. McCabe
HADOOP-12368 Mark ViewFileSystemBaseTest and ViewFsBaseTest as abstract Trivial . Andrew Wang Andrew Wang
HADOOP-12367 Move TestFileUtil’s test resources to resources folder Minor . Andrew Wang Andrew Wang
HADOOP-12369 Point hadoop-project/pom.xml java.security.krb5.conf within target folder Minor . Andrew Wang Andrew Wang
HDFS-328 Improve fs -setrep error message for invalid replication factors Major namenode Tsz Wo Nicholas Sze Daniel Templeton
HADOOP-5323 Trash documentation should describe its directory structure and configurations Minor documentation Suman Sehgal Weiwei Yang
HDFS-9021 Use a yellow elephant rather than a blue one in diagram Minor . Andrew Wang Andrew Wang
HADOOP-12358 Add -safely flag to rm to prompt when deleting many files Major fs Xiaoyu Yao Xiaoyu Yao
YARN-4024 YARN RM should avoid unnecessary resolving IP when NMs doing heartbeat Major resourcemanager Wangda Tan Hong Zhiguo
HADOOP-12384 Add “-direct” flag option for fs copy so that user can choose not to create “._COPYING_” file Major fs Chen He J.Andreina
HDFS-9019 Adding informative message to sticky bit permission denied exception Minor security Thejas M Nair Xiaoyu Yao
HDFS-8384 Allow NN to startup if there are files having a lease but are not under construction Minor namenode Tsz Wo Nicholas Sze Jing Zhao
HDFS-8929 Add a metric to expose the timestamp of the last journal Major journal-node Akira Ajisaka Surendra Singh Lilhore
HDFS-7116 Add a command to get the balancer bandwidth Major balancer & mover Akira Ajisaka Rakesh R
YARN-4086 Allow Aggregated Log readers to handle HAR files Major . Robert Kanter Robert Kanter
HDFS-8974 Convert docs in xdoc format to markdown Minor documentation Masatake Iwasaki Masatake Iwasaki
YARN-4145 Make RMHATestBase abstract so its not run when running all tests under that namespace Minor . Anubhav Dhoot Anubhav Dhoot
HADOOP-12324 Better exception reporting in SaslPlainServer Minor security Mike Yoder Mike Yoder
YARN-2005 Blacklisting support for scheduling AMs Major resourcemanager Jason Lowe Anubhav Dhoot
HDFS-8829 Make SO_RCVBUF and SO_SNDBUF size configurable for DataTransferProtocol sockets and allow configuring auto-tuning Major datanode He Tianyi He Tianyi
HDFS-9065 Include commas on # of files, blocks, total filesystem objects in NN Web UI Minor namenode Daniel Templeton Daniel Templeton
HADOOP-12413 AccessControlList should avoid calling getGroupNames in isUserInList with empty groups. Major security zhihai xu zhihai xu
HDFS-8953 DataNode Metrics logging Major . Kanaka Kumar Avvaru Kanaka Kumar Avvaru
YARN-4158 Remove duplicate close for LogWriter in AppLogAggregatorImpl#uploadLogsForContainers Minor nodemanager zhihai xu zhihai xu
YARN-4149 yarn logs -am should provide an option to fetch all the log files Major client, nodemanager Varun Vasudev Varun Vasudev
HDFS-9082 Change the log level in WebHdfsFileSystem.initialize() from INFO to DEBUG Minor webhdfs Santhosh G Nayak Santhosh G Nayak
YARN-4135 Improve the assertion message in MockRM while failing after waiting for the state. Trivial . nijel nijel
MAPREDUCE-6478 Add an option to skip cleanupJob stage or ignore cleanup failure during commitJob(). Major . Junping Du Junping Du
HADOOP-12404 Disable caching for JarURLConnection to avoid sharing JarFile with other users when loading resource from URL in Configuration class. Minor conf zhihai xu zhihai xu
HADOOP-12428 Fix inconsistency between log-level guards and statements Minor . Jackie Chang Jagadesh Kiran N
YARN-4095 Avoid sharing AllocatorPerContext object in LocalDirAllocator between ShuffleHandler and LocalDirsHandlerService. Major nodemanager zhihai xu zhihai xu
HDFS-5795 RemoteBlockReader2#checkSuccess() shoud print error status Trivial . Brandon Li Xiao Chen
HDFS-9112 Improve error message for Haadmin when multiple name service IDs are configured Major tools Anu Engineer Anu Engineer
HDFS-9132 Pass genstamp to ReplicaAccessorBuilder Major hdfs-client Colin P. McCabe Colin P. McCabe
HADOOP-12442 Display help if the command option to "hdfs dfs " is not valid Minor . nijel nijel
HADOOP-11984 Enable parallel JUnit tests in pre-commit. Major build, scripts, test Chris Nauroth Chris Nauroth
MAPREDUCE-6471 Document distcp incremental copy Major distcp Arpit Agarwal Neelesh Srinivas Salian
HDFS-9148 Incorrect assert message in TestWriteToReplica#testWriteToTemporary Trivial test Tony Wu Tony Wu
HDFS-8859 Improve DataNode ReplicaMap memory footprint to save about 45% Major datanode Yi Liu Yi Liu
HDFS-8696 Make the lower and higher watermark in the DN Netty server configurable Major webhdfs Xiaobing Zhou Xiaobing Zhou
YARN-3727 For better error recovery, check if the directory exists before using it for localization. Major nodemanager zhihai xu zhihai xu
HDFS-9175 Change scope of ‘AccessTokenProvider.getAccessToken()’ and ‘CredentialBasedAccessTokenProvider.getCredential()’ abstract methods to public Major webhdfs Santhosh G Nayak Santhosh G Nayak
HADOOP-12458 Retries is typoed to spell Retires in parts of hadoop-yarn and hadoop-common Minor documentation Neelesh Srinivas Salian Neelesh Srinivas Salian
HDFS-9151 Mover should print the exit status/reason on console like balancer tool. Minor balancer & mover Archana T Surendra Singh Lilhore
HADOOP-12350 WASB Logging: Improve WASB Logging around deletes, reads and writes Major tools Dushyanth Dushyanth
HADOOP-12284 UserGroupInformation doAs can throw misleading exception Trivial security Aaron Dossett Aaron Dossett
YARN-4228 FileSystemRMStateStore use IOUtils#close instead of fs#close Minor . Bibin A Chundatt Bibin A Chundatt
YARN-3943 Use separate threshold configurations for disk-full detection and disk-not-full detection. Critical nodemanager zhihai xu zhihai xu
MAPREDUCE-6479 Add missing mapred job command options in mapreduce document Major documentation nijel nijel
HADOOP-11104 org.apache.hadoop.metrics2.lib.MetricsRegistry needs numerical parameter checking Minor . Ray Chiang Ray Chiang
HDFS-9181 Better handling of exceptions thrown during upgrade shutdown Minor . Wei-Chiu Chuang Wei-Chiu Chuang
HDFS-9110 Use Files.walkFileTree in NNUpgradeUtil#doPreUpgrade for better efficiency Minor . Charlie Helin Charlie Helin
HDFS-9221 HdfsServerConstants#ReplicaState#getState should avoid calling values() since it creates a temporary array Major performance Staffan Friberg Staffan Friberg
HDFS-8988 Use LightWeightHashSet instead of LightWeightLinkedSet in BlockManager#excessReplicateMap Major . Yi Liu Yi Liu
HDFS-9139 Enable parallel JUnit tests for HDFS Pre-commit Major test Vinayakumar B Vinayakumar B
HDFS-9145 Tracking methods that hold FSNamesytemLock for too long Major namenode Jing Zhao Mingliang Liu
HADOOP-10775 Shell operations to fail with meaningful errors on windows if winutils.exe not found Minor util Steve Loughran Steve Loughran
YARN-4253 Standardize on using PrivilegedOperationExecutor for all invocations of container-executor in LinuxContainerExecutor Major . Sidharta Seethana Sidharta Seethana
YARN-4252 Log container-executor invocation details when exit code is non-zero Minor nodemanager Sidharta Seethana Sidharta Seethana
HDFS-9238 Update TestFileCreation#testLeaseExpireHardLimit() to avoid using DataNodeTestUtils#getFile() Trivial test Tony Wu Tony Wu
HDFS-9188 Make block corruption related tests FsDataset-agnostic. Major test Lei (Eddy) Xu Lei (Eddy) Xu
HDFS-9205 Do not schedule corrupt blocks for replication Minor namenode Tsz Wo Nicholas Sze Tsz Wo Nicholas Sze
HADOOP-12481 JWTRedirectAuthenticationHandler doesn’t Retain Original Query String Major security Larry McCay Larry McCay
HDFS-9257 improve error message for “Absolute path required” in INode.java to contain the rejected path Trivial namenode Marcell Szabo Marcell Szabo
HDFS-9253 Refactor tests of libhdfs into a directory Major . Haohui Mai Haohui Mai
HADOOP-12450 UserGroupInformation should not log at WARN level if no groups are found Minor security Elliott Clark Elliott Clark
HADOOP-12460 Add overwrite option for ‘get’ shell command Major . Keegan Witt Jagadesh Kiran N
HDFS-9250 Add Precondition check to LocatedBlock#addCachedLoc Major namenode Xiao Chen Xiao Chen
HDFS-9251 Refactor TestWriteToReplica and TestFsDatasetImpl to avoid explicitly creating Files in tests code. Major test Lei (Eddy) Xu Lei (Eddy) Xu
MAPREDUCE-6489 Fail fast rogue tasks that write too much to local disk Major task Maysam Yabandeh Maysam Yabandeh
HDFS-8647 Abstract BlockManager’s rack policy into BlockPlacementPolicy Major . Ming Ma Brahma Reddy Battula
HDFS-7087 Ability to list /.reserved Major . Andrew Wang Xiao Chen
HDFS-9280 Document NFS gateway export point parameter Trivial documentation Zhe Zhang Xiao Chen
HADOOP-12334 Change Mode Of Copy Operation of HBase WAL Archiving to bypass Azure Storage Throttling after retries Major tools Gaurav Kanade Gaurav Kanade
HADOOP-7266 Deprecate metrics v1 Blocker metrics Luke Lu Akira Ajisaka
YARN-2913 Fair scheduler should have ability to set MaxResourceDefault for each queue Major . Siqi Li Siqi Li
HDFS-9264 Minor cleanup of operations on FsVolumeList#volumes Minor . Walter Su Walter Su
HDFS-8808 dfs.image.transfer.bandwidthPerSec should not apply to -bootstrapStandby Major . Gautam Gopalakrishnan Zhe Zhang
HDFS-9297 Update TestBlockMissingException to use corruptBlockOnDataNodesByDeletingBlockFile() Trivial test Tony Wu Tony Wu
HDFS-4015 Safemode should count and report orphaned blocks Major namenode Todd Lipcon Anu Engineer
YARN-3528 Tests with 12345 as hard-coded port break jenkins Blocker . Steve Loughran Brahma Reddy Battula
YARN-4285 Display resource usage as percentage of queue and cluster in the RM UI Major resourcemanager Varun Vasudev Varun Vasudev
HDFS-7284 Add more debug info to BlockInfoUnderConstruction#setGenerationStampAndVerifyReplicas Major namenode Hu Liu, Wei-Chiu Chuang
HADOOP-12472 Make GenericTestUtils.assertExceptionContains robust Minor test Steve Loughran Steve Loughran
HDFS-9291 Fix TestInterDatanodeProtocol to be FsDataset-agnostic. Minor test Lei (Eddy) Xu Lei (Eddy) Xu
HDFS-8945 Update the description about replica placement in HDFS Architecture documentation Minor documentation Masatake Iwasaki Masatake Iwasaki
HDFS-9292 Make TestFileConcorruption independent to underlying FsDataset Implementation. Minor . Lei (Eddy) Xu Lei (Eddy) Xu
HDFS-9259 Make SO_SNDBUF size configurable at DFSClient side for hdfs write scenario Major . Ming Ma Mingliang Liu
HDFS-9299 Give ReplicationMonitor a readable thread name Trivial namenode Staffan Friberg Staffan Friberg
HDFS-9307 fuseConnect should be private to fuse_connect.c Trivial fuse-dfs Colin P. McCabe Mingliang Liu
HADOOP-12520 Use XInclude in hadoop-azure test configuration to isolate Azure Storage account keys for service integration tests. Major fs/azure, test Chris Nauroth Chris Nauroth
HDFS-9311 Support optional offload of NameNode HA service health checks to a separate RPC server. Major ha, namenode Chris Nauroth Chris Nauroth
HADOOP-12385 include nested stack trace in SaslRpcClient.getServerToken() Minor security Steve Loughran Steve Loughran
HDFS-9255 Consolidate block recovery related implementation into a single class Minor datanode Walter Su Walter Su
YARN-2573 Integrate ReservationSystem with the RM failover mechanism Major capacityscheduler, fairscheduler, resourcemanager Subru Krishnan Subru Krishnan
HDFS-6200 Create a separate jar for hdfs-client Major build Haohui Mai Haohui Mai
HDFS-8545 Refactor FS#getUsed() to use ContentSummary and add an API to fetch the total file length from a specific path Minor . J.Andreina J.Andreina
HDFS-9229 Expose size of NameNode directory as a metric Minor namenode Zhe Zhang Surendra Singh Lilhore
YARN-4310 FairScheduler: Log skipping reservation messages at DEBUG level Minor fairscheduler Arun Suresh Arun Suresh
HDFS-9323 Randomize the DFSStripedOutputStreamWithFailure tests Minor test Tsz Wo Nicholas Sze Tsz Wo Nicholas Sze
HADOOP-12133 Add schemas to Maven Assembly XMLs Minor . Gabor Liptak Gabor Liptak
HDFS-9312 Fix TestReplication to be FsDataset-agnostic. Minor . Lei (Eddy) Xu Lei (Eddy) Xu
HDFS-9308 Add truncateMeta() and deleteMeta() to MiniDFSCluster Minor test Tony Wu Tony Wu
HADOOP-12541 make re2j dependency consistent Major build Allen Wittenauer Matthew Paduano
HDFS-9331 Modify TestNameNodeMXBean#testNameNodeMXBeanInfo() to account for filesystem entirely allocated for DFS use Trivial test Tony Wu Tony Wu
HDFS-9363 Add fetchReplica() to FsDatasetTestUtils to return FsDataset-agnostic Replica. Minor test Tony Wu Tony Wu
HDFS-9282 Make data directory count and storage raw capacity related tests FsDataset-agnostic Minor test Tony Wu Tony Wu
HADOOP-12344 Improve validateSocketPathSecurity0 error message Trivial net Casey Brotherton Casey Brotherton
HDFS-9398 Make ByteArraryManager log message in one-line format Minor hdfs-client Mingliang Liu Mingliang Liu
HDFS-9234 WebHdfs : getContentSummary() should give quota for storage types Major webhdfs Surendra Singh Lilhore Surendra Singh Lilhore
HDFS-9369 Use ctest to run tests for hadoop-hdfs-native-client Minor . Haohui Mai Haohui Mai
HADOOP-12562 Make hadoop dockerfile usable by Yetus Major build Allen Wittenauer Allen Wittenauer
YARN-4287 Capacity Scheduler: Rack Locality improvement Major capacityscheduler Nathan Roberts Nathan Roberts
MAPREDUCE-5485 Allow repeating job commit by extending OutputCommitter API Critical . Nemon Lou Junping Du
MAPREDUCE-6499 Add elapsed time for retired job in JobHistoryServer WebUI Major webapps Yiqun Lin Yiqun Lin
HDFS-9252 Change TestFileTruncate to use FsDatasetTestUtils to get block file size and genstamp. Major . Lei (Eddy) Xu Lei (Eddy) Xu
HADOOP-12568 Update core-default.xml to describe posixGroups support Minor documentation Wei-Chiu Chuang Wei-Chiu Chuang
YARN-4279 Mark ApplicationId and ApplicationAttemptId static methods as @Public, @Unstable Minor client Steve Loughran Steve Loughran
HADOOP-12575 Add build instruction for docker toolbox instead of boot2docker Trivial documentation Kai Sasaki Kai Sasaki
HDFS-8056 Decommissioned dead nodes should continue to be counted as dead after NN restart Major . Ming Ma Ming Ma
HADOOP-11901 BytesWritable fails to support 2G chunks due to integer overflow Major . Reynold Xin Reynold Xin
HDFS-9439 Include status of closeAck into exception message in DataNode#run Trivial . Xiao Chen Xiao Chen
HDFS-9402 Switch DataNode.LOG to use slf4j Minor . Walter Su Walter Su
HDFS-3302 Review and improve HDFS trash documentation Major documentation Harsh J Madhu Kiran
HADOOP-10035 Cleanup TestFilterFileSystem Major . Suresh Srinivas Suresh Srinivas
HADOOP-10555 Add offset support to MurmurHash Trivial . Sergey Shelukhin Sergey Shelukhin
HADOOP-10068 Improve log4j regex in testFindContainingJar Trivial . Robert Rati Robert Rati
HDFS-9024 Deprecate the TotalFiles metric Major . Akira Ajisaka Akira Ajisaka
HDFS-7988 Replace usage of ExactSizeInputStream with LimitInputStream. Minor . Chris Nauroth Walter Su
HDFS-9314 Improve BlockPlacementPolicyDefault’s picking of excess replicas Major . Ming Ma Xiao Chen
MAPREDUCE-5870 Support for passing Job priority through Application Submission Context in Mapreduce Side Major client Sunil Govindan Sunil Govindan
HDFS-9434 Recommission a datanode with 500k blocks may pause NN for 30 seconds Major namenode Tsz Wo Nicholas Sze Tsz Wo Nicholas Sze
YARN-4132 Separate configs for nodemanager to resourcemanager connection timeout and retries Major nodemanager Chang Li Chang Li
HDFS-8512 WebHDFS : GETFILESTATUS should return LocatedBlock with storage type info Major webhdfs Sumana Sathish Xiaoyu Yao
HADOOP-12600 FileContext and AbstractFileSystem should be annotated as a Stable interface. Blocker fs Chris Nauroth Chris Nauroth
HDFS-9269 Update the documentation and wrapper for fuse-dfs Minor fuse-dfs Wei-Chiu Chuang Wei-Chiu Chuang
HDFS-9485 Make BlockManager#removeFromExcessReplicateMap accept BlockInfo instead of Block Minor namenode Mingliang Liu Mingliang Liu
HDFS-9490 MiniDFSCluster should change block generation stamp via FsDatasetTestUtils Minor test Tony Wu Tony Wu
HDFS-8831 Trash Support for deletion in HDFS encryption zone Major encryption Xiaoyu Yao Xiaoyu Yao
HDFS-9267 TestDiskError should get stored replicas through FsDatasetTestUtils. Minor test Lei (Eddy) Xu Lei (Eddy) Xu
HDFS-9474 TestPipelinesFailover should not fail when printing debug message Major . Yongjun Zhang John Zhuge
HDFS-9491 Tests should get the number of pending async delets via FsDatasetTestUtils Minor test Tony Wu Tony Wu
YARN-3456 Improve handling of incomplete TimelineEntities Minor timelineserver Steve Loughran Varun Saxena
HADOOP-12625 Add a config to disable the /logs endpoints Major security Robert Kanter Robert Kanter
HDFS-9527 The return type of FSNamesystem.getBlockCollection should be changed to INodeFile Minor namenode Tsz Wo Nicholas Sze Tsz Wo Nicholas Sze
HDFS-9472 concat() API does not give proper exception messages on ./reserved relative path Major namenode Rakesh R Rakesh R
YARN-4341 add doc about timeline performance tool usage Major . Chang Li Chang Li
HDFS-9532 Detailed exception info is lost in reportTo method of ErrorReportAction and ReportBadBlockAction Trivial datanode Yongjun Zhang Yongjun Zhang
HDFS-9528 Cleanup namenode audit/log/exception messages Minor namenode Tsz Wo Nicholas Sze Tsz Wo Nicholas Sze
HDFS-9281 Change TestDeleteBlockPool to not explicitly use File to check block pool existence. Minor test Lei (Eddy) Xu Lei (Eddy) Xu
HDFS-8860 Remove unused Replica copyOnWrite code Major . Lei (Eddy) Xu Lei (Eddy) Xu
MAPREDUCE-6436 JobHistory cache issue Blocker . Ryu Kobayashi Kai Sasaki
HADOOP-12639 Imrpove JavaDoc for getTrimmedStrings Trivial util BELUGA BEHR BELUGA BEHR
HDFS-9557 Reduce object allocation in PB conversion Major hdfs-client Daryn Sharp Daryn Sharp
YARN-4207 Add a non-judgemental YARN app completion status Major . Sergey Shelukhin Rich Haase
HDFS-9198 Coalesce IBR processing in the NN Major namenode Daryn Sharp Daryn Sharp
HDFS-9552 Document types of permission checks performed for HDFS operations. Major documentation Chris Nauroth Chris Nauroth
HDFS-8477 describe dfs.ha.zkfc.port in hdfs-default.xml Minor . Kanaka Kumar Avvaru Kanaka Kumar Avvaru
HDFS-9350 Avoid creating temprorary strings in Block.toString() and getBlockName() Minor performance Staffan Friberg Staffan Friberg
HADOOP-12570 HDFS Secure Mode Documentation updates Major documentation Arpit Agarwal Arpit Agarwal
YARN-4480 Clean up some inappropriate imports Major . Kai Zheng Kai Zheng
HDFS-9582 TestLeaseRecoveryStriped file missing Apache License header and not well formatted Minor . Uma Maheswara Rao G Uma Maheswara Rao G
YARN-4290 Add -showDetails option to YARN Nodes CLI to print all nodes reports information Major client Wangda Tan Sunil Govindan
YARN-4400 AsyncDispatcher.waitForDrained should be final Trivial yarn Daniel Templeton Daniel Templeton
HADOOP-12566 Add NullGroupMapping Major . Daniel Templeton Daniel Templeton
YARN-2934 Improve handling of container’s stderr Critical . Gera Shegalov Naganarasimha G R
MAPREDUCE-6584 Remove trailing whitespaces from mapred-default.xml Major documentation Akira Ajisaka Akira Ajisaka
HADOOP-12686 Update FileSystemShell documentation to mention the meaning of each columns of fs -du Minor documentation, fs Daisuke Kobayashi Daisuke Kobayashi
HADOOP-12663 Remove Hard-Coded Values From FileSystem.java Trivial fs BELUGA BEHR BELUGA BEHR
YARN-4544 All the log messages about rolling monitoring interval are shown with WARN level Minor log-aggregation, nodemanager Takashi Ohnishi Takashi Ohnishi
YARN-4438 Implement RM leader election with curator Major . Jian He Jian He
HDFS-9630 DistCp minor refactoring and clean up Minor distcp Kai Zheng Kai Zheng
YARN-4582 Label-related invalid resource request exception should be able to properly handled by application Major scheduler Bibin A Chundatt Bibin A Chundatt
HDFS-9569 Log the name of the fsimage being loaded for better supportability Trivial namenode Yongjun Zhang Yongjun Zhang
MAPREDUCE-6473 Job submission can take a long time during Cluster initialization Major performance Kuhu Shukla Kuhu Shukla
HADOOP-12683 Add number of samples in last interval in snapshot of MutableStat Minor metrics Vikram Srivastava Vikram Srivastava
HADOOP-8887 Use a Maven plugin to build the native code using CMake Minor build Colin P. McCabe Colin P. McCabe
HDFS-9415 Document dfs.cluster.administrators and dfs.permissions.superusergroup Major documentation Arpit Agarwal Xiaobing Zhou
HADOOP-12713 Disable spurious checkstyle checks Major . Andrew Wang Andrew Wang
HADOOP-12662 The build should fail if a -Dbundle option fails Minor . Kai Zheng Kai Zheng
HDFS-6054 MiniQJMHACluster should not use static port to avoid binding failure in unit test Major test Brandon Li Yongjun Zhang
HDFS-9576 HTrace: collect position/length information on read operations Major hdfs-client, tracing Zhe Zhang Zhe Zhang
YARN-4603 FairScheduler should mention user requested queuename in error message when failed in queue ACL check Trivial fairscheduler Tao Jie Tao Jie
YARN-4492 Add documentation for preemption supported in Capacity scheduler Minor capacity scheduler Naganarasimha G R Naganarasimha G R
HDFS-9674 The HTrace span for OpWriteBlock should record the maxWriteToDisk time Major datanode, tracing Colin P. McCabe Colin P. McCabe
YARN-4371 “yarn application -kill” should take multiple application ids Major . Tsuyoshi Ozawa Sunil Govindan
YARN-4496 Improve HA ResourceManager Failover detection on the client Major client, resourcemanager Arun Suresh Jian He
HDFS-9653 Expose the number of blocks pending deletion through dfsadmin report command Major hdfs-client, tools Weiwei Yang Weiwei Yang
HADOOP-12731 Remove useless boxing/unboxing code Minor performance Kousuke Saruta Kousuke Saruta
YARN-3542 Re-factor support for CPU as a resource using the new ResourceHandler mechanism Critical nodemanager Sidharta Seethana Varun Vasudev
HDFS-9541 Add hdfsStreamBuilder API to libhdfs to support defaultBlockSizes greater than 2 GB Major libhdfs Colin P. McCabe Colin P. McCabe
YARN-4462 FairScheduler: Disallow preemption from a queue Major fairscheduler Tao Jie Tao Jie
HDFS-9677 Rename generationStampV1/generationStampV2 to legacyGenerationStamp/generationStamp Minor namenode Jing Zhao Mingliang Liu
MAPREDUCE-6431 JobClient should be an AutoClosable Major . André Kelpe Haibo Chen
HDFS-9654 Code refactoring for HDFS-8578 Minor datanode Tsz Wo Nicholas Sze Tsz Wo Nicholas Sze
HDFS-7764 DirectoryScanner shouldn’t abort the scan if one directory had an error Major datanode Rakesh R Rakesh R
HDFS-9706 Log more details in debug logs in BlockReceiver’s constructor Minor . Xiao Chen Xiao Chen
YARN-4647 Make RegisterNodeManagerRequestPBImpl thread-safe Major nodemanager Karthik Kambatla Karthik Kambatla
HDFS-9638 Improve DistCp Help and documentation Minor distcp Wei-Chiu Chuang Wei-Chiu Chuang
HDFS-9566 Remove expensive ‘BlocksMap#getStorages(Block b, final DatanodeStorage.State state)’ method Major namenode Daryn Sharp Daryn Sharp
YARN-4649 Add additional logging to some NM state store operations Minor . Sidharta Seethana Sidharta Seethana
HDFS-9721 Allow Delimited PB OIV tool to run upon fsimage that contains INodeReference Major . Xiao Chen Xiao Chen
HDFS-9669 TcpPeerServer should respect ipc.server.listen.queue.size Major . Elliott Clark Elliott Clark
HDFS-9260 Improve the performance and GC friendliness of NameNode startup and full block reports Major datanode, namenode, performance Staffan Friberg Staffan Friberg
HDFS-9715 Check storage ID uniqueness on datanode startup Major datanode Lei (Eddy) Xu Lei (Eddy) Xu
YARN-4662 Document some newly added metrics Major . Jian He Jian He
HDFS-9629 Update the footer of Web UI to show year 2016 Major . Xiao Chen Xiao Chen
MAPREDUCE-6566 Add retry support to mapreduce CLI tool Major . Varun Vasudev Varun Vasudev
HDFS-9726 Refactor IBR code to a new class Minor datanode Tsz Wo Nicholas Sze Tsz Wo Nicholas Sze
HADOOP-12772 NetworkTopologyWithNodeGroup.getNodeGroup() can loop infinitely for invalid ‘loc’ values Minor . Kuhu Shukla Kuhu Shukla
HADOOP-12758 Extend CSRF Filter with UserAgent Checks Major security Larry McCay Larry McCay
HDFS-9686 Remove useless boxing/unboxing code Minor performance Kousuke Saruta Kousuke Saruta
HADOOP-12759 RollingFileSystemSink should eagerly rotate directories Critical . Daniel Templeton Daniel Templeton
MAPREDUCE-6626 Reuse ObjectMapper instance in MapReduce Minor performance Yiqun Lin Yiqun Lin
HADOOP-12788 OpensslAesCtrCryptoCodec should log which random number generator is used. Minor . Wei-Chiu Chuang Wei-Chiu Chuang
YARN-4628 Display application priority in yarn top Minor . Bibin A Chundatt Bibin A Chundatt
YARN-4655 Log uncaught exceptions/errors in various thread pools in YARN Major . Sidharta Seethana Sidharta Seethana
HADOOP-12764 Increase default value of KMS maxHttpHeaderSize and make it configurable Minor . Zhe Zhang Zhe Zhang
HDFS-9637 Tests for RollingFileSystemSink Major test Daniel Templeton Daniel Templeton
HDFS-9795 OIV Delimited should show which files are ACL-enabled. Trivial tools Lei (Eddy) Xu Lei (Eddy) Xu
HADOOP-12776 Remove getaclstatus call for non-acl commands in getfacl. Major . Brahma Reddy Battula Brahma Reddy Battula
HDFS-9768 Reuse objectMapper instance in HDFS to improve the performance Major performance Yiqun Lin Yiqun Lin
HDFS-9644 Update encryption documentation to reflect nested EZs Major documentation, encryption Zhe Zhang Zhe Zhang
HDFS-9700 DFSClient and DFSOutputStream should set TCP_NODELAY on sockets for DataTransferProtocol Major hdfs-client Gary Helmling Gary Helmling
HDFS-9797 Log Standby exceptions thrown by RequestHedgingProxyProvider at DEBUG Level Minor hdfs-client Íñigo Goiri Íñigo Goiri
YARN-4682 AMRM client to log when AMRM token updated Major client Steve Loughran Prabhu Joseph
HADOOP-12805 Annotate CanUnbuffer with @InterfaceAudience.Public Major . Ted Yu Ted Yu
YARN-4569 Remove incorrect part of maxResources in FairScheduler documentation Major documentation Ray Chiang Ray Chiang
YARN-4690 Skip object allocation in FSAppAttempt#getResourceUsage when possible Major . Ming Ma Ming Ma
MAPREDUCE-6634 Log uncaught exceptions/errors in various thread pools in mapreduce Major . Sidharta Seethana Sidharta Seethana
HADOOP-12817 Enable TLS v1.1 and 1.2 Major security Robert Kanter Robert Kanter
HADOOP-10865 Add a Crc32 chunked verification benchmark for both directly and non-directly buffer cases Minor util Tsz Wo Nicholas Sze Tsz Wo Nicholas Sze
HDFS-4946 Allow preferLocalNode in BlockPlacementPolicyDefault to be configurable Major namenode James Kinley Nathan Roberts
HADOOP-11031 Design Document for Credential Provider API Major site Larry McCay Larry McCay
MAPREDUCE-6627 Add machine-readable output to mapred job -history command Major client Robert Kanter Robert Kanter
HADOOP-12828 Print user when services are started Trivial . Brandon Li Wei-Chiu Chuang
HADOOP-12794 Support additional compression levels for GzipCodec Major io Ravi Mutyala Ravi Mutyala
YARN-4708 Missing default mapper type in TimelineServer performance test tool usage Minor timelineserver Kai Sasaki Kai Sasaki
HDFS-9425 Expose number of blocks per volume as a metric Major . Brahma Reddy Battula Brahma Reddy Battula
HADOOP-12668 Support excluding weak Ciphers in HttpServer2 through ssl-server.xml Critical security Vijay Singh Vijay Singh
HADOOP-12555 WASB to read credentials from a credential provider Minor fs/azure Chris Nauroth Larry McCay
HDFS-8578 On upgrade, Datanode should process all storage/data dirs in parallel Critical datanode Raju Bairishetti Vinayakumar B
HADOOP-12829 StatisticsDataReferenceCleaner swallows interrupt exceptions Minor fs Gregory Chanan Gregory Chanan
MAPREDUCE-6640 mapred job -history command should be able to take Job ID Major client Robert Kanter Robert Kanter
HADOOP-12535 Run FileSystem contract tests with hadoop-azure. Major fs/azure, test Chris Nauroth madhumita chakraborty
HDFS-9854 Log cipher suite negotiation more verbosely Major encryption Wei-Chiu Chuang Wei-Chiu Chuang
YARN-4697 NM aggregation thread pool is not bound by limits Critical nodemanager Haibo Chen Haibo Chen
HDFS-9843 Document distcp options required for copying between encrypted locations Major distcp, documentation, encryption Xiaoyu Yao Xiaoyu Yao
HDFS-9838 Refactor the excessReplicateMap to a class Major namenode Tsz Wo Nicholas Sze Tsz Wo Nicholas Sze
HDFS-9734 Refactoring of checksum failure report related codes Major . Kai Zheng Kai Zheng
HADOOP-12824 Collect network and disk usage on the node running Windows Major . Íñigo Goiri Íñigo Goiri
YARN-4579 Allow DefaultContainerExecutor container log directory permissions to be configurable Major yarn Ray Chiang Ray Chiang
YARN-4720 Skip unnecessary NN operations in log aggregation Major . Ming Ma Jun Gong
HADOOP-12841 Update s3-related properties in core-default.xml Minor fs/s3 Wei-Chiu Chuang Wei-Chiu Chuang
HDFS-9831 Document webhdfs retry configuration keys introduced by HDFS-5219/HDFS-5122 Major documentation, webhdfs Xiaoyu Yao Xiaobing Zhou
HDFS-9710 Change DN to send block receipt IBRs in batches Major datanode Tsz Wo Nicholas Sze Tsz Wo Nicholas Sze
MAPREDUCE-6622 Add capability to set JHS job cache to a task-based limit Critical jobhistoryserver Ray Chiang Ray Chiang
YARN-4718 Rename variables in SchedulerNode to reduce ambiguity post YARN-1011 Major scheduler Karthik Kambatla Íñigo Goiri
HDFS-9733 Refactor DFSClient#getFileChecksum and DataXceiver#blockChecksum Major . Kai Zheng Kai Zheng
YARN-4671 There is no need to acquire CS lock when completing a container Major . MENG DING MENG DING
HADOOP-12853 Change WASB documentation regarding page blob support Minor fs/azure madhumita chakraborty madhumita chakraborty
HDFS-9887 WebHdfs socket timeouts should be configurable Major fs, webhdfs Austin Donnelly Austin Donnelly
HADOOP-12859 Disable hiding field style checks in class setters Major . Kai Zheng Kai Zheng
HDFS-9534 Add CLI command to clear storage policy from a path. Major tools Chris Nauroth Xiaobing Zhou
HADOOP-12793 Write a new group mapping service guide Major documentation Wei-Chiu Chuang Wei-Chiu Chuang
HADOOP-12470 In-page TOC of documentation should be automatically generated by doxia macro Major documentation Masatake Iwasaki Masatake Iwasaki
HDFS-9889 Update balancer/mover document about HDFS-6133 feature Minor . Yongjun Zhang Yongjun Zhang
MAPREDUCE-6648 Add yarn.app.mapreduce.am.log.level to mapred-default.xml Trivial documentation Harsh J Harsh J
HDFS-9521 TransferFsImage.receiveFile should account and log separate times for image download and fsync to disk Minor . Wellington Chevreuil Wellington Chevreuil
HDFS-9906 Remove spammy log spew when a datanode is restarted Major namenode Elliott Clark Brahma Reddy Battula
HADOOP-12901 Add warning log when KMSClientProvider cannot create a connection to the KMS server Minor . Xiao Chen Xiao Chen
HADOOP-12789 log classpath of ApplicationClassLoader at INFO level Minor util Sangjin Lee Sangjin Lee
HDFS-9882 Add heartbeatsTotal in Datanode metrics Minor datanode Hua Liu Hua Liu
HADOOP-12860 Expand section “Data Encryption on HTTP” in SecureMode documentation Minor . Wei-Chiu Chuang Wei-Chiu Chuang
YARN-4465 SchedulerUtils#validateRequest for Label check should happen only when nodelabel enabled Minor . Bibin A Chundatt Bibin A Chundatt
HADOOP-12904 Update Yetus to 0.2.0 Blocker build Allen Wittenauer Allen Wittenauer
HADOOP-12798 Update changelog and release notes (2016-03-04) Major documentation Allen Wittenauer Allen Wittenauer
HADOOP-12905 Clean up CHANGES.txt RAT exclusions from pom.xml files. Trivial build Chris Nauroth Chris Nauroth
HDFS-9927 Document the new OIV ReverseXML processor Minor documentation Wei-Chiu Chuang Wei-Chiu Chuang
HADOOP-11404 Clarify the “expected client Kerberos principal is null” authorization message Minor security Stephen Chu Stephen Chu
HDFS-9942 Add an HTrace span when refreshing the groups for a username Major . Colin P. McCabe Colin P. McCabe
HDFS-9941 Do not log StandbyException on NN, other minor logging fixes Major namenode Arpit Agarwal Arpit Agarwal
YARN-4719 Add a helper library to maintain node state and allows common queries Major scheduler Karthik Kambatla Karthik Kambatla
HADOOP-12923 Move the test code in ipc.Client to test Minor ipc Tsz Wo Nicholas Sze Tsz Wo Nicholas Sze
HDFS-9928 Make HDFS commands guide up to date Major documentation Wei-Chiu Chuang Wei-Chiu Chuang
YARN-4560 Make scheduler error checking message more user friendly Trivial yarn Ray Chiang Ray Chiang
HDFS-9579 Provide bytes-read-by-network-distance metrics at FileSystem.Statistics level Major . Ming Ma Ming Ma
YARN-4732 *ProcessTree classes have too many whitespace issues Trivial . Karthik Kambatla Gabor Liptak
HDFS-9405 Warmup NameNode EDEK caches in background thread Major encryption, namenode Zhe Zhang Xiao Chen
HDFS-9951 Use string constants for XML tags in OfflineImageReconstructor Minor . Yiqun Lin Yiqun Lin
HADOOP-12952 /BUILDING example of zero-docs dist should skip javadocs Trivial build, documentation Steve Loughran Steve Loughran
HADOOP-12947 Update documentation Hadoop Groups Mapping to add static group mapping, negative cache Minor documentation, security Wei-Chiu Chuang Wei-Chiu Chuang
YARN-4117 End to end unit test with mini YARN cluster for AMRMProxy Service Major nodemanager, resourcemanager Kishore Chaliparambil Giovanni Matteo Fumarola
HADOOP-10965 Print fully qualified path in CommandWithDestination error messages Minor . André Kelpe John Zhuge
YARN-4436 DistShell ApplicationMaster.ExecBatScripStringtPath is misspelled Trivial applications/distributed-shell Daniel Templeton Matt LaMantia
MAPREDUCE-6663 [NNBench] Refactor nnbench as a Tool implementation. Major . Brahma Reddy Battula Brahma Reddy Battula
HADOOP-12886 Exclude weak ciphers in SSLFactory through ssl-server.xml Major . Wei-Chiu Chuang Wei-Chiu Chuang
YARN-4884 Fix missing documentation about rmadmin command regarding node labels Minor . Kai Sasaki Kai Sasaki
HADOOP-12916 Allow RPC scheduler/callqueue backoff using response times Major ipc Xiaoyu Yao Xiaoyu Yao
HADOOP-12950 ShutdownHookManager should have a timeout for each of the Registered shutdown hook Major . Xiaoyu Yao Xiaoyu Yao
YARN-4639 Remove dead code in TestDelegationTokenRenewer added in YARN-3055 Trivial resourcemanager Daniel Templeton Daniel Templeton
HADOOP-11661 Deprecate FileUtil#copyMerge Major util Brahma Reddy Battula Brahma Reddy Battula
HADOOP-11687 Ignore x-* and response headers when copying an Amazon S3 object Major fs/s3 Denis Jannot Harsh J
YARN-4607 Pagination support for AppAttempt page TotalOutstandingResource Requests table Minor . Bibin A Chundatt Bibin A Chundatt
HADOOP-11212 NetUtils.wrapException to handle SocketException explicitly Major util Steve Loughran Steve Loughran
HADOOP-12672 RPC timeout should not override IPC ping interval Major ipc Masatake Iwasaki Masatake Iwasaki
HDFS-10235 [NN UI] Last contact for Live Nodes should be relative time Major . Brahma Reddy Battula Brahma Reddy Battula
YARN-4769 Add support for CSRF header in the dump capacity scheduler logs and kill app buttons in RM web UI Major . Varun Vasudev Varun Vasudev
HADOOP-12984 Add GenericTestUtils.getTestDir method and use it for temporary directory in tests Major build, test Steve Loughran Steve Loughran
HADOOP-8813 RPC Server and Client classes need InterfaceAudience and InterfaceStability annotations Trivial ipc Brandon Li Brandon Li
YARN-4756 Unnecessary wait in Node Status Updater during reboot Major . Eric Badger Eric Badger
HDFS-10266 Remove unused properties dfs.client.file-block-storage-locations.num-threads and dfs.client.file-block-storage-locations.timeout.millis Minor . Ray Chiang Ray Chiang
HADOOP-12951 Improve documentation on KMS ACLs and delegation tokens Major . Xiao Chen Xiao Chen
HADOOP-12994 Specify PositionedReadable, add contract tests, fix problems Major fs Steve Loughran Steve Loughran
YARN-4630 Remove useless boxing/unboxing code Minor yarn Kousuke Saruta Kousuke Saruta
HDFS-10279 Improve validation of the configured number of tolerated failed volumes Major . Yiqun Lin Yiqun Lin
YARN-4541 Change log message in LocalizedResource#handle() to DEBUG Minor . Ray Chiang Ray Chiang
HADOOP-12822 Change “Metrics intern cache overflow” log level from WARN to INFO Minor metrics Akira Ajisaka Andras Bokor
HADOOP-12969 Mark IPC.Client and IPC.Server as @Public, @Evolving Minor ipc Xiaobing Zhou Xiaobing Zhou
HADOOP-12963 Allow using path style addressing for accessing the s3 endpoint Minor fs/s3 Andrew Baptist Stephen Montgomery
HDFS-10280 Document new dfsadmin command -evictWriters Minor documentation Wei-Chiu Chuang Wei-Chiu Chuang
HDFS-10292 Add block id when client got Unable to close file exception Minor . Brahma Reddy Battula Brahma Reddy Battula
HDFS-9412 getBlocks occupies FSLock and takes too long to complete Major balancer & mover, namenode He Tianyi He Tianyi
HDFS-10302 BlockPlacementPolicyDefault should use default replication considerload value Trivial . Yiqun Lin Yiqun Lin
HDFS-10264 Logging improvements in FSImageFormatProtobuf.Saver Major namenode Konstantin Shvachko Xiaobing Zhou
HADOOP-12985 Support MetricsSource interface for DecayRpcScheduler Metrics Major . Xiaoyu Yao Xiaoyu Yao
HDFS-9894 Add unsetStoragePolicy API to FileContext/AbstractFileSystem and derivatives Major . Xiaobing Zhou Xiaobing Zhou
HADOOP-12891 S3AFileSystem should configure Multipart Copy threshold and chunk size Major fs/s3 Andrew Olson Andrew Olson
HADOOP-13033 Add missing Javadoc enries to Interns.java Minor metrics Andras Bokor Andras Bokor
HDFS-10298 Document the usage of distcp -diff option Major distcp, documentation Akira Ajisaka Takashi Ohnishi
YARN-1297 FairScheduler: Move some logs to debug and check if debug logging is enabled Major fairscheduler Sandy Ryza Yufei Gu
HADOOP-13039 Add documentation for configuration property ipc.maximum.data.length for controlling maximum RPC message size. Major documentation Chris Nauroth Mingliang Liu
HDFS-10330 Add Corrupt Blocks Information in Metasave Output Major . Kuhu Shukla Kuhu Shukla
HADOOP-5470 RunJar.unJar() should write the last modified time found in the jar entry to the uncompressed file Minor util Colin Evans Andras Bokor
HDFS-3702 Add an option for NOT writing the blocks locally if there is a datanode on the same box as the client Minor hdfs-client Nicolas Liochon Lei (Eddy) Xu
HDFS-10297 Increase default balance bandwidth and concurrent moves Minor balancer & mover John Zhuge John Zhuge
HADOOP-12957 Limit the number of outstanding async calls Major ipc Xiaobing Zhou Xiaobing Zhou
YARN-5003 Add container resource to RM audit log Major resourcemanager, scheduler Nathan Roberts Nathan Roberts
HDFS-9902 Support different values of dfs.datanode.du.reserved per storage type Major datanode Pan Yuxuan Brahma Reddy Battula
HADOOP-13068 Clean up RunJar and related test class Trivial util Andras Bokor Andras Bokor
HADOOP-13103 Group resolution from LDAP may fail on javax.naming.ServiceUnavailableException Minor security Tsz Wo Nicholas Sze Tsz Wo Nicholas Sze
HADOOP-12866 add a subcommand for gridmix Major tools Allen Wittenauer Kai Sasaki
MAPREDUCE-6678 Allow ShuffleHandler readahead without drop-behind Major nodemanager Nathan Roberts Nathan Roberts
HADOOP-12982 Document missing S3A and S3 properties Minor documentation, fs/s3, tools Wei-Chiu Chuang Wei-Chiu Chuang
HDFS-10172 hdfs erasurecode command should remove the redundant -usage option Minor erasure-coding Wei-Chiu Chuang Yuanbo Liu
YARN-4995 FairScheduler: Display per-queue demand on the scheduler page Minor . xupeng xupeng
YARN-4577 Enable aux services to have their own custom classpath/jar file Major . Xuan Gong Xuan Gong
YARN-5053 More informative diagnostics when applications killed by a user Major resourcemanager Jason Lowe Eric Badger
HADOOP-13142 Change project version from 3.0.0 to 3.0.0-alpha1 Blocker . Andrew Wang Andrew Wang
HADOOP-12868 Fix hadoop-openstack undeclared and unused dependencies Major tools Allen Wittenauer Masatake Iwasaki
HADOOP-12971 FileSystemShell doc should explain relative path Critical documentation John Zhuge John Zhuge
HADOOP-13148 TestDistCpViewFs to include IOExceptions in test error reports Minor tools/distcp Steve Loughran Steve Loughran
HADOOP-13146 Refactor RetryInvocationHandler Minor io Tsz Wo Nicholas Sze Tsz Wo Nicholas Sze
HADOOP-13161 remove JDK7 from Dockerfile Major build Allen Wittenauer Allen Wittenauer
HDFS-9732 Improve DelegationTokenIdentifier.toString() for better logging Major . Steve Loughran Yongjun Zhang
HDFS-10383 Safely close resources in DFSTestUtil Major test Mingliang Liu Mingliang Liu
MAPREDUCE-6686 Add a way to download the job config from the mapred CLI Major client Robert Kanter Robert Kanter
HADOOP-12782 Faster LDAP group name resolution with ActiveDirectory Major security Wei-Chiu Chuang Wei-Chiu Chuang
YARN-4002 make ResourceTrackerService.nodeHeartbeat more concurrent Critical . Hong Zhiguo Hong Zhiguo
HDFS-10417 Improve error message from checkBlockLocalPathAccess Minor datanode Tianyin Xu Tianyin Xu
HADOOP-13168 Support Future.get with timeout in ipc async calls Major ipc Tsz Wo Nicholas Sze Tsz Wo Nicholas Sze
MAPREDUCE-6696 Add a configuration to limit the number of map tasks allowed per job. Major job submission zhihai xu zhihai xu
HADOOP-13145 In DistCp, prevent unnecessary getFileStatus call when not preserving metadata. Major tools/distcp Chris Nauroth Chris Nauroth
HADOOP-13112 Change CredentialShell to use CommandShell base class Minor . Matthew Paduano Matthew Paduano
YARN-4878 Expose scheduling policy and max running apps over JMX for Yarn queues Major yarn Yufei Gu Yufei Gu
HDFS-9782 RollingFileSystemSink should have configurable roll interval Major . Daniel Templeton Daniel Templeton
HADOOP-13198 Add support for OWASP’s dependency-check Minor build, security Mike Yoder Mike Yoder
HDFS-10217 show ‘blockScheduled’ tooltip in datanodes table. Major . Brahma Reddy Battula Brahma Reddy Battula
HADOOP-13160 Suppress checkstyle JavadocPackage check for test source Minor . John Zhuge John Zhuge
YARN-4766 NM should not aggregate logs older than the retention policy Major log-aggregation, nodemanager Haibo Chen Haibo Chen
HADOOP-12911 Upgrade Hadoop MiniKDC with Kerby Major test Jiajia Li Jiajia Li
HADOOP-13199 Add doc for distcp -filters Trivial documentation John Zhuge John Zhuge
HADOOP-13193 Upgrade to Apache Yetus 0.3.0 Major build, documentation, test Allen Wittenauer Kengo Seki
HADOOP-13197 Add non-decayed call metrics for DecayRpcScheduler Major ipc, metrics Xiaoyu Yao Xiaoyu Yao
HDFS-10341 Add a metric to expose the timeout number of pending replication blocks Major . Akira Ajisaka Akira Ajisaka
HADOOP-13109 Add ability to edit existing token file via dtutil -alias flag Minor security Matthew Paduano Matthew Paduano
HADOOP-13105 Support timeouts in LDAP queries in LdapGroupsMapping. Major security Chris Nauroth Mingliang Liu
HADOOP-12807 S3AFileSystem should read AWS credentials from environment variables Minor fs/s3 Tobin Baker Tobin Baker
MAPREDUCE-5044 Have AM trigger jstack on task attempts that timeout before killing them Major mr-am Jason Lowe Eric Payne
HADOOP-10048 LocalDirAllocator should avoid holding locks while accessing the filesystem Major . Jason Lowe Jason Lowe
HADOOP-13220 Follow on fixups after upgraded mini-kdc using Kerby Major test Jiajia Li Jiajia Li
MAPREDUCE-6714 Refactor UncompressedSplitLineReader.fillBuffer() Major . Daniel Templeton Daniel Templeton
HADOOP-12291 Add support for nested groups in LdapGroupsMapping Major security Gautam Gopalakrishnan Esther Kundin
HDFS-7541 Upgrade Domains in HDFS Major . Ming Ma Ming Ma
HDFS-10256 Use GenericTestUtils.getTestDir method in tests for temporary directories Major build, test Vinayakumar B Vinayakumar B
YARN-5083 YARN CLI for AM logs does not give any error message if entered invalid am value Major yarn Sumana Sathish Jian He
HADOOP-12943 Add -w -r options in dfs -test command Major fs, scripts, tools Weiwei Yang Weiwei Yang
HDFS-10493 Add links to datanode web UI in namenode datanodes page Major namenode, ui Weiwei Yang Weiwei Yang
YARN-5082 Limit ContainerId increase in fair scheduler if the num of node app reserved reached the limit Major . sandflee sandflee
YARN-4958 The file localization process should allow for wildcards to reduce the application footprint in the state store Critical nodemanager Daniel Templeton Daniel Templeton
HADOOP-13296 Cleanup javadoc for Path Minor documentation Daniel Templeton Daniel Templeton
MAPREDUCE-6719 The list of -libjars archives should be replaced with a wildcard in the distributed cache to reduce the application footprint in the state store Critical distributed-cache Daniel Templeton Daniel Templeton
HDFS-7597 DelegationTokenIdentifier should cache the TokenIdentifier to UGI mapping Critical webhdfs Daryn Sharp Daryn Sharp
MAPREDUCE-6721 mapreduce.reduce.shuffle.memory.limit.percent=0.0 should be legal to enforce shuffle to disk Major mrv2, task Gera Shegalov Gera Shegalov
YARN-5278 Remove unused argument in TestRMWebServicesForCSWithPartitions#setupQueueConfiguration Minor test Akira Ajisaka Tao Jie
HADOOP-13307 add rsync to Dockerfile so that precommit archive works Trivial build Allen Wittenauer Allen Wittenauer
HADOOP-13067 cleanup the dockerfile Major . Allen Wittenauer Allen Wittenauer
HADOOP-13227 AsyncCallHandler should use an event driven architecture to handle async calls Major io, ipc Tsz Wo Nicholas Sze Tsz Wo Nicholas Sze
HADOOP-13263 Reload cached groups in background after expiry Major . Stephen O’Donnell Stephen O’Donnell
HDFS-10440 Improve DataNode web UI Major datanode, ui Weiwei Yang Weiwei Yang
HADOOP-13034 Log message about input options in distcp lacks some items Minor tools/distcp Takashi Ohnishi Takashi Ohnishi
HADOOP-13235 Use Date and Time API in KafkaSink Minor . Akira Ajisaka Akira Ajisaka
HDFS-10568 Reuse ObjectMapper instance in CombinedHostsFileReader and CombinedHostsFileWriter Major hdfs-client Yiqun Lin Yiqun Lin
HADOOP-13337 Update maven-enforcer-plugin version to 1.4.1 Major build Tsuyoshi Ozawa Tsuyoshi Ozawa
YARN-4568 Fix message when NodeManager runs into errors initializing the recovery directory Major yarn Ray Chiang Ray Chiang
HDFS-9805 TCP_NODELAY not set before SASL handshake in data transfer pipeline Major datanode Gary Helmling Gary Helmling
HDFS-10582 Change deprecated configuration fs.checkpoint.dir to dfs.namenode.checkpoint.dir in HDFS Commands Doc Minor documentation Pan Yuxuan Pan Yuxuan
HDFS-10488 Update WebHDFS documentation regarding CREATE and MKDIR default permissions Minor documentation, webhdfs Wellington Chevreuil Wellington Chevreuil
MAPREDUCE-6717 Remove deprecated StringUtils.getFormattedTimeWithDiff Minor . Akira Ajisaka Shen Yinjie
HDFS-10300 TestDistCpSystem should share MiniDFSCluster Trivial test John Zhuge John Zhuge
HDFS-10387 DataTransferProtocol#writeBlock missing some javadocs Minor datanode, hdfs Yongjun Zhang John Zhuge
YARN-5339 passing file to -out for YARN log CLI doesnt give warning or error code Major . Sumana Sathish Xuan Gong
HADOOP-13290 Appropriate use of generics in FairCallQueue Major ipc Konstantin Shvachko Jonathan Hung
YARN-5303 Clean up ContainerExecutor JavaDoc Minor nodemanager Daniel Templeton Daniel Templeton
HADOOP-13289 Remove unused variables in TestFairCallQueue Minor test Konstantin Shvachko Ye Zhou
YARN-5380 NMTimelinePublisher should use getMemorySize instead of getMemory Major timelineserver Karthik Kambatla Vrushali C
HDFS-10628 Log HDFS Balancer exit message to its own log Minor balancer & mover Jiayi Zhou Jiayi Zhou
MAPREDUCE-6652 Add configuration property to prevent JHS from loading jobs with a task count greater than X Major jobhistoryserver Haibo Chen Haibo Chen
YARN-5181 ClusterNodeTracker: add method to get list of nodes matching a specific resourceName Major scheduler Karthik Kambatla Karthik Kambatla
HADOOP-13298 Fix the leftover L&N files in hadoop-build-tools/src/main/resources/META-INF/ Minor . Xiao Chen Tsuyoshi Ozawa
YARN-4996 Make TestNMReconnect.testCompareRMNodeAfterReconnect() scheduler agnostic, or better yet parameterized Minor resourcemanager, test Daniel Templeton Kai Sasaki
HDFS-10647 Add a link to HDFS disk balancer document in site.xml Major documentation Akira Ajisaka Yiqun Lin
MAPREDUCE-6365 Refactor JobResourceUploader#uploadFilesInternal Minor . Chris Trezzo Chris Trezzo
HDFS-10425 Clean up NNStorage and TestSaveNamespace Minor . Andras Bokor Andras Bokor
YARN-4883 Make consistent operation name in AdminService Minor resourcemanager Kai Sasaki Kai Sasaki
HADOOP-13383 Update release notes for 3.0.0-alpha1 Blocker documentation Andrew Wang Andrew Wang
YARN-1126 Add validation of users input nodes-states options to nodes CLI Major . Wei Yan Wei Yan
HDFS-10287 MiniDFSCluster should implement AutoCloseable Minor test John Zhuge Andras Bokor
HDFS-10225 DataNode hot swap drives should disallow storage type changes. Major datanode Lei (Eddy) Xu Lei (Eddy) Xu
HDFS-10660 Expose storage policy apis via HDFSAdmin interface Major . Rakesh R Rakesh R
HADOOP-13272 ViewFileSystem should support storage policy related API Major fs, viewfs Peter Shi Peter Shi
HDFS-9937 Update dfsadmin command line help and HdfsQuotaAdminGuide Minor . Wei-Chiu Chuang Kai Sasaki
HDFS-10667 Report more accurate info about data corruption location Major datanode, hdfs Yongjun Zhang Yuanbo Liu
HADOOP-13354 Update WASB driver to use the latest version (4.2.0) of SDK for Microsoft Azure Storage Clients Major fs/azure Sivaguru Sankaridurg Sivaguru Sankaridurg
HDFS-10519 Add a configuration option to enable in-progress edit log tailing Minor ha Jiayi Zhou Jiayi Zhou
HDFS-10676 Add namenode metric to measure time spent in generating EDEKs Major namenode Hanisha Koneru Hanisha Koneru
MAPREDUCE-6746 Replace org.apache.commons.io.Charsets with java.nio.charset.StandardCharsets Minor . Vincent Poon Vincent Poon
HDFS-10703 HA NameNode Web UI should show last checkpoint time Minor ui John Zhuge John Zhuge
MAPREDUCE-6729 Accurately compute the test execute time in DFSIO Minor benchmarks, performance, test zhangminglei zhangminglei
HADOOP-13444 Replace org.apache.commons.io.Charsets with java.nio.charset.StandardCharsets Minor . Vincent Poon Vincent Poon
YARN-5456 container-executor support for FreeBSD, NetBSD, and others if conf path is absolute Major nodemanager, security Allen Wittenauer Allen Wittenauer
YARN-5460 Change container runtime type logging in DelegatingLinuxContainerRuntime to debug Trivial yarn Shane Kumpf Shane Kumpf
HADOOP-13458 LoadBalancingKMSClientProvider#doOp should log IOException stacktrace Trivial kms Wei-Chiu Chuang Chen Liang
MAPREDUCE-6730 Use StandardCharsets instead of String overload in TextOutputFormat Minor . Sahil Kang Sahil Kang
HDFS-10707 Replace org.apache.commons.io.Charsets with java.nio.charset.StandardCharsets Minor . Vincent Poon Vincent Poon
HADOOP-13442 Optimize UGI group lookups Major . Daryn Sharp Daryn Sharp
HADOOP-13466 Add an AutoCloseableLock class Major . Chen Liang Chen Liang
MAPREDUCE-6748 Enhance logging for Cluster.java around InetSocketAddress Minor . sarun singla Vrushali C
YARN-4910 Fix incomplete log info in ResourceLocalizationService Trivial . Jun Gong Jun Gong
HADOOP-13380 TestBasicDiskValidator should not write data to /tmp Minor . Lei (Eddy) Xu Yufei Gu
YARN-5483 Optimize RMAppAttempt#pullJustFinishedContainers Major . sandflee sandflee
HADOOP-13190 Mention LoadBalancingKMSClientProvider in KMS HA documentation Major documentation, kms Wei-Chiu Chuang Wei-Chiu Chuang
HDFS-10677 Über-jira: Enhancements to NNThroughputBenchmark tool Major benchmarks, tools Mingliang Liu Mingliang Liu
HDFS-10342 BlockManager#createLocatedBlocks should not check corrupt replicas if none are corrupt Major hdfs Daryn Sharp Kuhu Shukla
MAPREDUCE-6751 Add debug log message when splitting is not possible due to unsplittable compression Minor client, mrv1, mrv2 Peter Vary Peter Vary
YARN-5455 Update Javadocs for LinuxContainerExecutor Major nodemanager Daniel Templeton Daniel Templeton
HDFS-10682 Replace FsDatasetImpl object lock with a separate lock object Major datanode Chen Liang Chen Liang
YARN-4702 FairScheduler: Allow setting maxResources for ad hoc queues Major fairscheduler Karthik Kambatla Daniel Templeton
HADOOP-13503 Improve SaslRpcClient failure logging Major security Xiaobing Zhou Xiaobing Zhou
HADOOP-13527 Add Spark to CallerContext LimitedPrivate scope Minor ipc Weiqing Yang Weiqing Yang
HDFS-10645 Make block report size as a metric and add this metric to datanode web ui Major datanode, ui Yuanbo Liu Yuanbo Liu
MAPREDUCE-6587 Remove unused params in connection-related methods of Fetcher Minor . Yiqun Lin Yiqun Lin
YARN-4491 yarn list command to support filtering by tags Minor client Steve Loughran Varun Saxena
HADOOP-13538 Deprecate getInstance and initialize methods with Path in TrashPolicy Minor . Yiqun Lin Yiqun Lin
HDFS-8986 Add option to -du to calculate directory space usage excluding snapshots Major snapshots Gautam Gopalakrishnan Xiao Chen
HDFS-10795 Fix an error in ReaderStrategy#ByteBufferStrategy Major . Sammi Chen Sammi Chen
HDFS-10798 Make the threshold of reporting FSNamesystem lock contention configurable Major logging, namenode Zhe Zhang Erik Krogen
YARN-5550 TestYarnCLI#testGetContainers should format according to CONTAINER_PATTERN Minor client, test Jonathan Hung Jonathan Hung
MAPREDUCE-6741 add MR support to redact job conf properties Major mrv2 Haibo Chen Haibo Chen
HADOOP-12325 RPC Metrics : Add the ability track and log slow RPCs Major ipc, metrics Anu Engineer Anu Engineer
HADOOP-7930 Kerberos relogin interval in UserGroupInformation should be configurable Major security Alejandro Abdelnur Robert Kanter
HDFS-8873 Allow the directoryScanner to be rate-limited Major datanode Nathan Roberts Daniel Templeton
HADOOP-12825 Log slow name resolutions Major . Sidharta Seethana Sidharta Seethana
HDFS-8865 Improve quota initialization performance Major . Kihwal Lee Kihwal Lee

BUG FIXES:

JIRA Summary Priority Component Reporter Contributor
HDFS-2299 TestOfflineEditsViewer is failing on trunk Major test Aaron T. Myers Uma Maheswara Rao G
HDFS-2310 TestBackupNode fails since HADOOP-7524 went in. Major test Ivan Kelly Ivan Kelly
HDFS-2313 Rat excludes has a typo for excluding editsStored files Major test Aaron T. Myers Aaron T. Myers
MAPREDUCE-2978 hudson findbugs not reporting properly Major mrv2 Thomas Graves Tom White
HDFS-46 The namespace quota of root directory should not be Integer.MAX_VALUE Major namenode Tsz Wo Nicholas Sze Uma Maheswara Rao G
HDFS-2373 Commands using webhdfs and hftp print unnecessary debug information on the console with security enabled Major webhdfs Arpit Gupta Arpit Gupta
HADOOP-6220 HttpServer wraps InterruptedExceptions by IOExceptions if interrupted in startup Minor util Steve Loughran Steve Loughran
MAPREDUCE-3149 add a test to verify that buildDTAuthority works for cases with no authority. Major test John George John George
HADOOP-7769 TestJMXJsonServlet is failing Major test Tom White Tom White
HADOOP-8177 MBeans shouldn’t try to register when it fails to create MBeanName Minor metrics Devaraj K Devaraj K
HDFS-3116 Typo in fetchdt error message Trivial hdfs-client Aaron T. Myers AOE Takashi
HADOOP-7757 Test file reference count is at least 3x actual value Major build Jonathan Eagles Jonathan Eagles
HDFS-3265 PowerPc Build error. Major build Kumar Ravi Kumar Ravi
HADOOP-8339 jenkins complaining about 16 javadoc warnings Major build Thomas Graves Robert Joseph Evans
HADOOP-8354 test-patch findbugs may fail if a dependent module is changed Major build Tom White Robert Joseph Evans
HADOOP-8395 Text shell command unnecessarily demands that a SequenceFile’s key class be WritableComparable Trivial util Harsh J Harsh J
HDFS-2312 FSNamesystem header comment says it’s for the DN Trivial namenode Aaron T. Myers Harsh J
HDFS-3197 Incorrect class comments in a few tests Trivial test Aaron T. Myers Andy Isaacson
HADOOP-8360 empty-configuration.xml fails xml validation Minor test Radim Kolar Radim Kolar
HADOOP-8413 test-patch.sh gives out the wrong links for newPatchFindbugsWarnings Minor precommit Colin P. McCabe Colin P. McCabe
HADOOP-6871 When the value of a configuration key is set to its unresolved form, it causes the IllegalStateException in Configuration.get() stating that substitution depth is too large. Major conf Arvind Prabhakar Arvind Prabhakar
MAPREDUCE-3990 MRBench allows Long-sized input-lines value but parses CLI argument as an Integer Trivial benchmarks Harsh J Harsh J
HDFS-3462 TestDFSClientRetries.busyTest() should restore default xceiver count in the config. Major test Konstantin Shvachko madhukara phatak
HDFS-3550 raid added javadoc warnings Minor build Thomas Graves Jason Lowe
HDFS-3549 dist tar build fails in hadoop-hdfs-raid project Critical build Jason Lowe Jason Lowe
HADOOP-8548 test-patch.sh shows an incorrect link in Jekins builds Major build Kihwal Lee Kihwal Lee
HDFS-3614 Revert unused MiniDFSCluster constructor from HDFS-3049 Blocker . Arun C Murthy Arun C Murthy
HADOOP-8584 test-patch.sh should not immediately exit when no tests are added or modified Major . Colin P. McCabe Colin P. McCabe
HADOOP-8818 Should use equals() rather than == to compare String or Text in MD5MD5CRC32FileChecksum and TFileDumper Minor fs, io Brandon Li Brandon Li
HADOOP-8821 Findbugs warning Configuration.dumpDeprecatedKeys() concatenates strings using + in a loop Trivial conf Suresh Srinivas Suresh Srinivas
HADOOP-7256 Resource leak during failure scenario of closing of resources. Minor util ramkrishna.s.vasudevan ramkrishna.s.vasudevan
HADOOP-8436 NPE In getLocalPathForWrite ( path, conf ) when the required context item is not configured Major fs Brahma Reddy Battula Brahma Reddy Battula
HADOOP-8840 Fix the test-patch colorizer to cover all sorts of +1 lines. Major build Harsh J Harsh J
MAPREDUCE-4685 DBCount should not use ACCESS Major examples Viji Viji
MAPREDUCE-3223 Remove MR1 configs from mapred-default.xml Major documentation, mrv2 Todd Lipcon Todd Lipcon
HADOOP-8839 test-patch’s -1 on @author tag presence doesn’t cause a -1 to the overall result Trivial build Harsh J Harsh J
MAPREDUCE-4695 Fix LocalRunner on trunk after MAPREDUCE-3223 broke it Blocker test Harsh J Harsh J
HDFS-3735 NameNode WebUI should allow sorting live datanode list by fields Block Pool Used, Block Pool Used(%) and Failed Volumes. Major namenode Brahma Reddy Battula Brahma Reddy Battula
HDFS-4003 test-patch should build the common native libs before running hdfs tests Major build Eli Collins Colin P. McCabe
MAPREDUCE-4574 Fix TotalOrderParitioner to work with non-WritableComparable key types Trivial client Harsh J Harsh J
HADOOP-8918 dev-support/test-patch.sh is parsing modified files wrong Major build Raja Aluri Raja Aluri
HADOOP-8910 Add examples to GlobExpander#expand method Minor fs Suresh Srinivas Suresh Srinivas
HDFS-2434 TestNameNodeMetrics.testCorruptBlock fails intermittently Major test Uma Maheswara Rao G Jing Zhao
HDFS-4067 TestUnderReplicatedBlocks may fail due to ReplicaAlreadyExistsException Major test Eli Collins Jing Zhao
HDFS-4115 TestHDFSCLI.testAll fails one test due to number format Minor test Trevor Robinson Trevor Robinson
HADOOP-8974 TestDFVariations fails on Windows Major fs Chris Nauroth Chris Nauroth
HADOOP-9037 Bug in test-patch.sh and precommit build process Critical build Kihwal Lee Kihwal Lee
HADOOP-9121 InodeTree.java has redundant check for vName while throwing exception Major fs Arup Malakar Arup Malakar
HDFS-4310 fix test org.apache.hadoop.hdfs.server.datanode.TestStartSecureDataNode Major . Ivan A. Veselovsky Ivan A. Veselovsky
HDFS-4275 MiniDFSCluster-based tests fail on Windows due to failure to delete test namenode directory Major test Chris Nauroth Chris Nauroth
HDFS-4338 TestNameNodeMetrics#testCorruptBlock is flaky Major namenode Andrew Wang Andrew Wang
HADOOP-9139 improve script hadoop-common-project/hadoop-common/src/test/resources/kdc/killKdc.sh Minor . Ivan A. Veselovsky Ivan A. Veselovsky
HADOOP-9202 test-patch.sh fails during mvn eclipse:eclipse if patch adds a new module to the build Major build Chris Nauroth Chris Nauroth
HADOOP-9242 Duplicate surefire plugin config in hadoop-common Major test Andrey Klochkov Andrey Klochkov
HADOOP-9249 hadoop-maven-plugins version-info goal causes build failure when running with Clover Major build Chris Nauroth Chris Nauroth
MAPREDUCE-5012 Typo in javadoc for IdentityMapper class Trivial documentation Adam Monsen Adam Monsen
HADOOP-8419 GzipCodec NPE upon reset with IBM JDK Major io Luke Lu Yu Li
HDFS-4391 TestDataTransferKeepalive fails when tests are executed in a certain order. Major test Konstantin Shvachko Andrew Wang
HADOOP-9393 TestRPC fails with JDK7 Major . Andrew Wang Andrew Wang
HADOOP-9431 TestSecurityUtil#testLocalHostNameForNullOrWild on systems where hostname contains capital letters Trivial security, test Chris Nauroth Chris Nauroth
HADOOP-9261 S3n filesystem can move a directory under itself -and so lose data Major fs/s3 Steve Loughran Steve Loughran
HADOOP-9265 S3 blockstore filesystem breaks part of the Filesystem contract Major fs/s3 Steve Loughran Steve Loughran
HADOOP-9433 TestLocalFileSystem#testHasFileDescriptor leaks file handle Major fs, test Chris Nauroth Chris Nauroth
YARN-524 TestYarnVersionInfo failing if generated properties doesn’t include an SVN URL Minor api Steve Loughran Steve Loughran
HDFS-4757 Update FSDirectory#inodeMap when replacing an INodeDirectory while setting quota Minor namenode Jing Zhao Jing Zhao
HDFS-4761 Refresh INodeMap in FSDirectory#reset() Minor namenode Jing Zhao Jing Zhao
HDFS-4904 Remove JournalService Major namenode Suresh Srinivas Arpit Agarwal
HADOOP-9186 test-patch.sh should report build failure to JIRA Major . Binglin Chang Binglin Chang
HDFS-4366 Block Replication Policy Implementation May Skip Higher-Priority Blocks for Lower-Priority Blocks Major . Derek Dagit Derek Dagit
HADOOP-9583 test-patch gives +1 despite build failure when running tests Critical . Jason Lowe Jason Lowe
YARN-1471 The SLS simulator is not running the preemption policy for CapacityScheduler Minor . Carlo Curino Carlo Curino
HDFS-5794 Fix the inconsistency of layout version number of ADD_DATANODE_AND_STORAGE_UUIDS between trunk and branch-2 Minor namenode Jing Zhao Jing Zhao
MAPREDUCE-5717 Task pings are interpreted as task progress Major . Jason Lowe Jason Lowe
HADOOP-10325 improve jenkins javadoc warnings from test-patch.sh Major . Colin P. McCabe Colin P. McCabe
MAPREDUCE-5912 Task.calculateOutputSize does not handle Windows files after MAPREDUCE-5196 Major client Remus Rusanu Remus Rusanu
HADOOP-10831 UserProvider is not thread safe Major security Benoy Antony Benoy Antony
YARN-2436 yarn application help doesn’t work Major scripts Allen Wittenauer Allen Wittenauer
HADOOP-11002 shell escapes are incompatible with previous releases Major scripts Allen Wittenauer Allen Wittenauer
HADOOP-10996 Stop violence in the *_HOME Major scripts Allen Wittenauer Allen Wittenauer
HADOOP-11033 shell scripts ignore JAVA_HOME on OS X Major scripts Lei (Eddy) Xu Allen Wittenauer
HADOOP-11052 hadoop_verify_secure_prereq’s results aren’t checked in bin/hdfs Critical scripts Allen Wittenauer Allen Wittenauer
HDFS-6893 crypto subcommand is not sorted properly in hdfs’s hadoop_usage Trivial scripts Allen Wittenauer David Luo
YARN-2525 yarn logs command gives error on trunk Minor scripts Prakash Ramachandran Akira Ajisaka
HADOOP-11055 non-daemon pid files are missing Blocker scripts Allen Wittenauer Allen Wittenauer
HADOOP-11022 User replaced functions get lost 2-3 levels deep (e.g., sbin) Critical scripts Allen Wittenauer Allen Wittenauer
MAPREDUCE-5875 Make Counter limits consistent across JobClient, MRAppMaster, and YarnChild Major applicationmaster, client, task Gera Shegalov Gera Shegalov
HDFS-7204 balancer doesn’t run as a daemon Blocker scripts Allen Wittenauer Allen Wittenauer
HADOOP-11240 Jenkins build seems to be broken by changes in test-patch.sh Blocker . Zhijie Shen Steve Loughran
HDFS-7213 processIncrementalBlockReport performance degradation Critical namenode Daryn Sharp Eric Payne
HDFS-7235 DataNode#transferBlock should report blocks that don’t exist using reportBadBlock Major datanode, namenode Yongjun Zhang Yongjun Zhang
HDFS-7263 Snapshot read can reveal future bytes for appended files. Major hdfs-client Konstantin Shvachko Tao Luo
HDFS-7319 Remove dead link to HFTP documentation from index.xml Minor documentation Masatake Iwasaki Masatake Iwasaki
HADOOP-11267 TestSecurityUtil fails when run with JDK8 because of empty principal names Minor security, test Stephen Chu Stephen Chu
HADOOP-10786 Fix UGI#reloginFromKeytab on Java 8 Major security Tobi Vollebregt Stephen Chu
HADOOP-11284 Fix variable name mismatches in hadoop-functions.sh Minor scripts Masatake Iwasaki Masatake Iwasaki
HADOOP-11298 slaves.sh and stop-all.sh are missing slashes Trivial scripts Allen Wittenauer Allen Wittenauer
YARN-2856 Application recovery throw InvalidStateTransitonException: Invalid event: ATTEMPT_KILLED at ACCEPTED Critical resourcemanager Rohith Sharma K S Rohith Sharma K S
MAPREDUCE-6161 mapred hsadmin command missing from trunk Major scripts Jason Lowe Allen Wittenauer
YARN-2816 NM fail to start with NPE during container recovery Major nodemanager zhihai xu zhihai xu
YARN-2414 RM web UI: app page will crash if app is failed before any attempt has been created Major webapp Zhijie Shen Wangda Tan
HDFS-7225 Remove stale block invalidation work when DN re-registers with different UUID Major namenode Zhe Zhang Zhe Zhang
HDFS-7407 Minor typo in privileged pid/out/log names Minor . Allen Wittenauer Allen Wittenauer
YARN-2865 Application recovery continuously fails with “Application with id already present. Cannot duplicate” Critical resourcemanager Rohith Sharma K S Rohith Sharma K S
HDFS-7425 NameNode block deletion logging uses incorrect appender. Minor namenode Chris Nauroth Chris Nauroth
HDFS-4882 Prevent the Namenode’s LeaseManager from looping forever in checkLeases Critical hdfs-client, namenode Zesheng Wu Ravi Prakash
YARN-2906 CapacitySchedulerPage shows HTML tags for a queue’s Active Users Major capacityscheduler Jason Lowe Jason Lowe
HADOOP-11333 Fix deadlock in DomainSocketWatcher when the notification pipe is full Major . yunjiong zhao yunjiong zhao
YARN-2905 AggregatedLogsBlock page can infinitely loop if the aggregated log file is corrupted Blocker . Jason Lowe Varun Saxena
YARN-2894 When ACL’s are enabled, if RM switches then application can not be viewed from web. Major resourcemanager Rohith Sharma K S Rohith Sharma K S
HADOOP-11296 hadoop-daemons.sh throws ‘host1: bash: host3: command not found…’ Major scripts Vinayakumar B Vinayakumar B
YARN-2874 Dead lock in “DelegationTokenRenewer” which blocks RM to execute any further apps Blocker resourcemanager Naganarasimha G R Naganarasimha G R
HADOOP-11343 Overflow is not properly handled in caclulating final iv for AES CTR Blocker security Haifeng Chen Haifeng Chen
HADOOP-10134 [JDK8] Fix Javadoc errors caused by incorrect or illegal tags in doc comments Minor . Andrew Purtell Andrew Purtell
HADOOP-11368 Fix SSLFactory truststore reloader thread leak in KMSClientProvider Major kms Arun Suresh Arun Suresh
HDFS-7489 Incorrect locking in FsVolumeList#checkDirs can hang datanodes Critical datanode Noah Lorang Noah Lorang
YARN-2910 FSLeafQueue can throw ConcurrentModificationException Major fairscheduler Wilfred Spiegelenburg Wilfred Spiegelenburg
HDFS-7503 Namenode restart after large deletions can cause slow processReport (due to logging) Major namenode Arpit Agarwal Arpit Agarwal
YARN-2917 Potential deadlock in AsyncDispatcher when system.exit called in AsyncDispatcher#dispatch and AsyscDispatcher#serviceStop from shutdown hook Critical resourcemanager Rohith Sharma K S Rohith Sharma K S
HADOOP-11238 Update the NameNode’s Group Cache in the background when possible Minor . Chris Li Chris Li
HADOOP-11380 Restore Rack Awareness documentation Major . Allen Wittenauer Allen Wittenauer
MAPREDUCE-6166 Reducers do not validate checksum of map outputs when fetching directly to disk Major mrv2 Eric Payne Eric Payne
HADOOP-11397 Can’t override HADOOP_IDENT_STRING Trivial . Allen Wittenauer Kengo Seki
YARN-2964 RM prematurely cancels tokens for jobs that submit jobs (oozie) Blocker resourcemanager Daryn Sharp Jian He
HDFS-7552 change FsVolumeList toString() to fix TestDataNodeVolumeFailureToleration Major datanode, test Liang Xie Liang Xie
HDFS-7443 Datanode upgrade to BLOCKID_BASED_LAYOUT fails if duplicate block files are present in the same volume Blocker . Kihwal Lee Colin P. McCabe
YARN-2952 Incorrect version check in RMStateStore Major . Jian He Rohith Sharma K S
YARN-2975 FSLeafQueue app lists are accessed without required locks Blocker . Karthik Kambatla Karthik Kambatla
YARN-2340 NPE thrown when RM restart after queue is STOPPED. There after RM can not recovery application’s and remain in standby Critical resourcemanager, scheduler Nishan Shetty Rohith Sharma K S
YARN-2992 ZKRMStateStore crashes due to session expiry Blocker resourcemanager Karthik Kambatla Karthik Kambatla
YARN-2922 ConcurrentModificationException in CapacityScheduler’s LeafQueue Major capacityscheduler, resourcemanager, scheduler Jason Tufo Rohith Sharma K S
HADOOP-10908 Common needs updates for shell rewrite Major documentation Allen Wittenauer Allen Wittenauer
YARN-2978 ResourceManager crashes with NPE while getting queue info Critical . Jason Tufo Varun Saxena
YARN-2997 NM keeps sending already-sent completed containers to RM until containers are removed from context Major nodemanager Chengbing Liu Chengbing Liu
YARN-3002 YARN documentation needs updating post-shell rewrite Major documentation Allen Wittenauer Allen Wittenauer
HDFS-7596 NameNode should prune dead storages from storageMap Major namenode Arpit Agarwal Arpit Agarwal
HDFS-7533 Datanode sometimes does not shutdown on receiving upgrade shutdown command Major . Kihwal Lee Eric Payne
HADOOP-11473 test-patch says “-1 overall” even when all checks are +1 Major build Jason Lowe Jason Lowe
HDFS-7470 SecondaryNameNode need twice memory when calling reloadFromImageFile Major namenode yunjiong zhao yunjiong zhao
YARN-2637 maximum-am-resource-percent could be respected for both LeafQueue/User when trying to activate applications. Critical resourcemanager Wangda Tan Craig Welch
HDFS-7581 HDFS documentation needs updating post-shell rewrite Major documentation Allen Wittenauer Allen Wittenauer
HADOOP-11350 The size of header buffer of HttpServer is too small when HTTPS is enabled Major security Benoy Antony Benoy Antony
HDFS-7610 Fix removal of dynamically added DN volumes Major datanode Lei (Eddy) Xu Lei (Eddy) Xu
HADOOP-11484 hadoop-mapreduce-client-nativetask fails to build on ARM AARCH64 due to x86 asm statements Minor native Edward Nevill Edward Nevill
HDFS-3443 Fix NPE when namenode transition to active during startup by adding checkNNStartup() in NameNodeRpcServer Major auto-failover, ha suja s Vinayakumar B
HDFS-7575 Upgrade should generate a unique storage ID for each volume Critical . Lars Francke Arpit Agarwal
HADOOP-11482 Use correct UGI when KMSClientProvider is called by a proxy user Major . Arun Suresh Arun Suresh
HDFS-7667 Various typos and improvements to HDFS Federation doc Minor documentation Charles Lamb Charles Lamb
HDFS-3750 API docs don’t include HDFS Critical documentation Eli Collins Jolly Chen
HDFS-7320 The appearance of hadoop-hdfs-httpfs site docs is inconsistent Minor documentation Masatake Iwasaki Masatake Iwasaki
YARN-3024 LocalizerRunner should give DIE action when all resources are localized Major nodemanager Chengbing Liu Chengbing Liu
HADOOP-11316 “mvn package -Pdist,docs -DskipTests -Dtar” fails because of non-ascii characters Blocker . Tsuyoshi Ozawa Tsuyoshi Ozawa
YARN-3103 AMRMClientImpl does not update AMRM token properly Blocker client Jason Lowe Jason Lowe
MAPREDUCE-6230 MR AM does not survive RM restart if RM activated a new AMRM secret key Blocker mr-am Jason Lowe Jason Lowe
HDFS-7707 Edit log corruption due to delayed block removal again Major namenode Yongjun Zhang Yongjun Zhang
HDFS-7733 NFS: readdir/readdirplus return null directory attribute on failure Major nfs Arpit Agarwal Arpit Agarwal
MAPREDUCE-6237 Multiple mappers with DBInputFormat don’t work because of reusing conections Major mrv2 Kannan Rajah Kannan Rajah
HDFS-7670 HDFS Quota guide has typos, incomplete command lines Major documentation Allen Wittenauer Brahma Reddy Battula
HDFS-7669 HDFS Design Doc references commands that no longer exist. Major documentation Allen Wittenauer Brahma Reddy Battula
HDFS-7755 httpfs shell code has hardcoded path to bash Major scripts Dmitry Sivachenko Dmitry Sivachenko
YARN-3094 reset timer for liveness monitors after RM recovery Major resourcemanager Jun Gong Jun Gong
MAPREDUCE-4413 MR lib dir contains jdiff (which is gpl) Critical build Eli Collins Nemon Lou
HDFS-7714 Simultaneous restart of HA NameNodes and DataNode can cause DataNode to register successfully with only one NameNode. Major datanode Chris Nauroth Vinayakumar B
YARN-2246 Job History Link in RM UI is redirecting to the URL which contains Job Id twice Major webapp Devaraj K Devaraj K
HADOOP-11559 Add links to RackAwareness and InterfaceClassification to site index Minor documentation Masatake Iwasaki Masatake Iwasaki
HADOOP-11581 Fix Multithreaded correctness Warnings #org.apache.hadoop.fs.shell.Ls Major . Brahma Reddy Battula Brahma Reddy Battula
HADOOP-11580 Remove SingleNodeSetup.md from trunk Major documentation Allen Wittenauer Akira Ajisaka
HADOOP-11583 Fix syntax error in SecureMode.md Trivial documentation Masatake Iwasaki Masatake Iwasaki
HADOOP-11437 Remove the version and author information from distcp’s README file Major documentation Allen Wittenauer Brahma Reddy Battula
HADOOP-11585 Fix formatting in Tracing.md Trivial documentation Masatake Iwasaki Masatake Iwasaki
HDFS-7711 Fix various typos in ClusterSetup.md Major documentation Brahma Reddy Battula Brahma Reddy Battula
HDFS-7791 dfs count -v should be added to quota documentation Major documentation Allen Wittenauer Akira Ajisaka
HDFS-7803 Wrong command mentioned in HDFSHighAvailabilityWithQJM documentation Minor documentation Mohammad Arshad Mohammad Arshad
MAPREDUCE-6234 TestHighRamJob fails due to the change in MAPREDUCE-5785 Major contrib/gridmix, mrv2 Masatake Iwasaki Masatake Iwasaki
HADOOP-11295 RPC Server Reader thread can’t shutdown if RPCCallQueue is full Major . Ming Ma Ming Ma
HDFS-7788 Post-2.6 namenode may not start up with an image containing inodes created with an old release. Blocker . Kihwal Lee Rushabh S Shah
YARN-3194 RM should handle NMContainerStatuses sent by NM while registering if NM is Reconnected node Blocker resourcemanager Rohith Sharma K S Rohith Sharma K S
HADOOP-11604 Prevent ConcurrentModificationException while closing domain sockets during shutdown of DomainSocketWatcher thread. Critical net Liang Xie Chris Nauroth
YARN-3238 Connection timeouts to nodemanagers are retried at multiple levels Blocker . Jason Lowe Jason Lowe
YARN-3207 secondary filter matches entites which do not have the key being filtered for. Major timelineserver Prakash Ramachandran Zhijie Shen
HDFS-7009 Active NN and standby NN have different live nodes Major datanode Ming Ma Ming Ma
HADOOP-11625 Minor fixes to command manual & SLA doc Major documentation Allen Wittenauer Allen Wittenauer
HDFS-7763 fix zkfc hung issue due to not catching exception in a corner case Major ha Liang Xie Liang Xie
YARN-3239 WebAppProxy does not support a final tracking url which has query fragments and params Major . Hitesh Shah Jian He
HADOOP-11637 bash location hard-coded in shell scripts Major scripts Allen Wittenauer Allen Wittenauer
MAPREDUCE-6223 TestJobConf#testNegativeValueForTaskVmem failures Major test Gera Shegalov Varun Saxena
HADOOP-10774 Update KerberosTestUtils for hadoop-auth tests when using IBM Java Major security sangamesh sangamesh
HDFS-4681 TestBlocksWithNotEnoughRacks#testCorruptBlockRereplicatedAcrossRacks fails using IBM java Major test Tian Hong Wang Ayappan
HDFS-7871 NameNodeEditLogRoller can keep printing “Swallowing exception” message Critical . Jing Zhao Jing Zhao
YARN-3222 RMNodeImpl#ReconnectNodeTransition should send scheduler events in sequential order Critical resourcemanager Rohith Sharma K S Rohith Sharma K S
YARN-3231 FairScheduler: Changing queueMaxRunningApps interferes with pending jobs Critical . Siqi Li Siqi Li
YARN-3242 Asynchrony in ZK-close can lead to ZKRMStateStore watcher receiving events for old client Critical resourcemanager zhihai xu zhihai xu
HADOOP-11674 oneByteBuf in CryptoInputStream and CryptoOutputStream should be non static Critical io Sean Busbey Sean Busbey
HDFS-7885 Datanode should not trust the generation stamp provided by client Critical datanode vitthal (Suhas) Gogate Tsz Wo Nicholas Sze
YARN-3227 Timeline renew delegation token fails when RM user’s TGT is expired Critical . Jonathan Eagles Zhijie Shen
HADOOP-11653 shellprofiles should require .sh extension Major scripts Allen Wittenauer Brahma Reddy Battula
YARN-3287 TimelineClient kerberos authentication failure uses wrong login context. Major . Jonathan Eagles Daryn Sharp
HADOOP-11668 hadoop-daemons.sh bw compat broke with –slaves change Major scripts Vinayakumar B Vinayakumar B
HDFS-7830 DataNode does not release the volume lock when adding a volume fails. Major datanode Lei (Eddy) Xu Lei (Eddy) Xu
HADOOP-11703 git should ignore .DS_Store files on Mac OS X Major . Abin Shahab Abin Shahab
HADOOP-10027 *Compressor_deflateBytesDirect passes instance instead of jclass to GetStaticObjectField Minor native Eric Abbott Hui Zheng
YARN-3267 Timelineserver applies the ACL rules after applying the limit on the number of records Major . Prakash Ramachandran Chang Li
HDFS-7915 The DataNode can sometimes allocate a ShortCircuitShm slot and fail to tell the DFSClient about it because of a network error Major . Colin P. McCabe Colin P. McCabe
HDFS-5356 MiniDFSCluster shoud close all open FileSystems when shutdown() Critical test haosdent Rakesh R
YARN-3197 Confusing log generated by CapacityScheduler Minor capacityscheduler Hitesh Shah Varun Saxena
YARN-3243 CapacityScheduler should pass headroom from parent to children to make sure ParentQueue obey its capacity limits. Major capacityscheduler, resourcemanager Wangda Tan Wangda Tan
YARN-3305 AM-Used Resource for leafqueue is wrongly populated if AM ResourceRequest is less than minimumAllocation Major scheduler Rohith Sharma K S Rohith Sharma K S
YARN-3205 FileSystemRMStateStore should disable FileSystem Cache to avoid get a Filesystem with an old configuration. Major resourcemanager zhihai xu zhihai xu
MAPREDUCE-5807 Print usage for TeraSort job. Trivial examples Rohith Sharma K S Rohith Sharma K S
YARN-3351 AppMaster tracking URL is broken in HA Major webapp Anubhav Dhoot Anubhav Dhoot
HDFS-7929 inotify unable fetch pre-upgrade edit log segments once upgrade starts Major . Zhe Zhang Zhe Zhang
HDFS-7587 Edit log corruption can happen if append fails with a quota violation Blocker namenode Kihwal Lee Jing Zhao
HDFS-7867 Update action param from “start” to “prepare” in rolling upgrade javadoc Trivial . J.Andreina J.Andreina
MAPREDUCE-6281 Fix javadoc in Terasort Trivial . Albert Chu Albert Chu
HDFS-7930 commitBlockSynchronization() does not remove locations Blocker namenode Konstantin Shvachko Yi Liu
YARN-3369 Missing NullPointer check in AppSchedulingInfo causes RM to die Blocker resourcemanager Giovanni Matteo Fumarola Brahma Reddy Battula
YARN-3269 Yarn.nodemanager.remote-app-log-dir could not be configured to fully qualified path Major . Xuan Gong Xuan Gong
MAPREDUCE-6213 NullPointerException caused by job history server addr not resolvable Minor applicationmaster Peng Zhang Peng Zhang
MAPREDUCE-5448 MapFileOutputFormat#getReaders bug with invisible files/folders Minor mrv2 Maysam Yabandeh Maysam Yabandeh
MAPREDUCE-6242 Progress report log is incredibly excessive in application master Major applicationmaster Jian Fang Varun Saxena
YARN-3393 Getting application(s) goes wrong when app finishes before starting the attempt Critical timelineserver Zhijie Shen Zhijie Shen
HDFS-7884 NullPointerException in BlockSender Blocker datanode Tsz Wo Nicholas Sze Brahma Reddy Battula
HDFS-7960 The full block report should prune zombie storages even if they’re not empty Critical . Lei (Eddy) Xu Colin P. McCabe
HDFS-3325 When configuring “dfs.namenode.safemode.threshold-pct” to a value greater or equal to 1 there is mismatch in the UI report Minor . J.Andreina J.Andreina
YARN-3383 AdminService should use “warn” instead of “info” to log exception when operation fails Major resourcemanager Wangda Tan Li Lu
YARN-3397 yarn rmadmin should skip -failover Minor resourcemanager J.Andreina J.Andreina
HADOOP-11724 DistCp throws NPE when the target directory is root. Minor . Lei (Eddy) Xu Lei (Eddy) Xu
YARN-3400 [JDK 8] Build Failure due to unreported exceptions in RPCUtil Major . Robert Kanter Robert Kanter
HDFS-7804 haadmin command usage #HDFSHighAvailabilityWithQJM.html Major documentation Brahma Reddy Battula Brahma Reddy Battula
HDFS-7990 IBR delete ack should not be delayed Major namenode Daryn Sharp Daryn Sharp
HADOOP-11760 Fix typo of javadoc in DistCp Trivial . Chen He Brahma Reddy Battula
MAPREDUCE-6294 Remove an extra parameter described in Javadoc of TockenCache Trivial . Chen He Brahma Reddy Battula
HDFS-7501 TransactionsSinceLastCheckpoint can be negative on SBNs Major namenode Harsh J Gautam Gopalakrishnan
HDFS-7742 favoring decommissioning node for replication can cause a block to stay underreplicated for long periods Major namenode Nathan Roberts Nathan Roberts
HDFS-8002 Website refers to /trash directory Major documentation Mike Drob Brahma Reddy Battula
HDFS-7261 storageMap is accessed without synchronization in DatanodeDescriptor#updateHeartbeatState() Major . Ted Yu Brahma Reddy Battula
HDFS-7997 The first non-existing xattr should also throw IOException Minor . zhouyingchao zhouyingchao
HDFS-6945 BlockManager should remove a block from excessReplicateMap and decrement ExcessBlocks metric when the block is removed Critical namenode Akira Ajisaka Akira Ajisaka
YARN-3425 NPE from RMNodeLabelsManager.serviceStop when NodeLabelsManager.serviceInit failed Minor resourcemanager Bibin A Chundatt Bibin A Chundatt
HDFS-7922 ShortCircuitCache#close is not releasing ScheduledThreadPoolExecutors Major . Rakesh R Rakesh R
HDFS-8026 Trace FSOutputSummer#writeChecksumChunks rather than DFSOutputStream#writeChunk Minor . Colin P. McCabe Colin P. McCabe
MAPREDUCE-6303 Read timeout when retrying a fetch error can be fatal to a reducer Blocker . Jason Lowe Jason Lowe
YARN-3415 Non-AM containers can be counted towards amResourceUsage of a Fair Scheduler queue Critical fairscheduler Rohit Agarwal zhihai xu
HADOOP-11797 releasedocmaker.py needs to put ASF headers on output Major build Allen Wittenauer Allen Wittenauer
HADOOP-11800 Clean up some test methods in TestCodec.java Major test Akira Ajisaka Brahma Reddy Battula
MAPREDUCE-4844 Counters / AbstractCounters have constant references not declared final Major . Gera Shegalov Brahma Reddy Battula
YARN-3435 AM container to be allocated Appattempt AM container shown as null Trivial resourcemanager Bibin A Chundatt Bibin A Chundatt
HDFS-7999 FsDatasetImpl#createTemporary sometimes holds the FSDatasetImpl lock for a very long time Major . zhouyingchao zhouyingchao
YARN-3429 TestAMRMTokens.testTokenExpiry fails Intermittently with error message:Invalid AMRMToken Major test zhihai xu zhihai xu
HDFS-5215 dfs.datanode.du.reserved is not considered while computing available space Major datanode Brahma Reddy Battula Brahma Reddy Battula
YARN-3457 NPE when NodeManager.serviceInit fails and stopRecoveryStore called Minor nodemanager Bibin A Chundatt Bibin A Chundatt
YARN-3459 Fix failiure of TestLog4jWarningErrorMetricsAppender Blocker . Li Lu Varun Vasudev
HDFS-8072 Reserved RBW space is not released if client terminates while writing block Major datanode Arpit Agarwal Arpit Agarwal
HDFS-8046 Allow better control of getContentSummary Major . Kihwal Lee Kihwal Lee
YARN-2890 MiniYarnCluster should turn on timeline service if configured to do so Major . Mit Desai Mit Desai
HDFS-7725 Incorrect “nodes in service” metrics caused all writes to fail Major . Ming Ma Ming Ma
HDFS-8096 DatanodeMetrics#blocksReplicated will get incremented early and even for failed transfers Major datanode Vinayakumar B Vinayakumar B
YARN-3465 Use LinkedHashMap to preserve order of resource requests Major nodemanager zhihai xu zhihai xu
HDFS-8099 Change “DFSInputStream has been closed already” message to debug log level Minor hdfs-client Charles Lamb Charles Lamb
YARN-3055 The token is not renewed properly if it’s shared by jobs (oozie) in DelegationTokenRenewer Blocker security Yi Liu Daryn Sharp
HDFS-8091 ACLStatus and XAttributes not properly presented to INodeAttributesProvider before returning to client Major namenode Arun Suresh Arun Suresh
MAPREDUCE-6266 Job#getTrackingURL should consistently return a proper URL Minor . Ray Chiang Ray Chiang
HDFS-8081 Split getAdditionalBlock() into two methods. Major . Konstantin Shvachko Konstantin Shvachko
HDFS-7939 Two fsimage_rollback_* files are created which are not deleted after rollback. Critical . J.Andreina J.Andreina
MAPREDUCE-6314 TestPipeApplication fails on trunk Major test Varun Vasudev Varun Vasudev
YARN-3466 Fix RM nodes web page to sort by node HTTP-address, #containers and node-label column Major resourcemanager, webapp Jason Lowe Jason Lowe
HDFS-7931 DistributedFIleSystem should not look for keyProvider in cache if Encryption is disabled Minor hdfs-client Arun Suresh Arun Suresh
HDFS-8111 NPE thrown when invalid FSImage filename given for “hdfs oiv_legacy” cmd Minor tools Archana T Surendra Singh Lilhore
HADOOP-11811 Fix typos in hadoop-project/pom.xml and TestAccessControlList Minor . Chen He Brahma Reddy Battula
YARN-3382 Some of UserMetricsInfo metrics are incorrectly set to root queue metrics Major webapp Rohit Agarwal Rohit Agarwal
YARN-3472 Possible leak in DelegationTokenRenewer#allTokens Major . Jian He Rohith Sharma K S
YARN-3394 WebApplication proxy documentation is incomplete Minor resourcemanager Bibin A Chundatt Naganarasimha G R
HADOOP-11819 HttpServerFunctionalTest#prepareTestWebapp should create web app directory if it does not exist. Minor . Rohith Sharma K S Rohith Sharma K S
HDFS-6666 Abort NameNode and DataNode startup if security is enabled but block access token is not enabled. Minor datanode, namenode, security Chris Nauroth Vijay Bhat
HDFS-8055 NullPointerException when topology script is missing. Major namenode Anu Engineer Anu Engineer
YARN-3266 RMContext inactiveNodes should have NodeId as map key Major resourcemanager Chengbing Liu Chengbing Liu
YARN-3436 Fix URIs in documention of YARN web service REST APIs Minor documentation, resourcemanager Bibin A Chundatt Bibin A Chundatt
HDFS-8127 NameNode Failover during HA upgrade can cause DataNode to finalize upgrade Blocker ha Jing Zhao Jing Zhao
HDFS-8151 Always use snapshot path as source when invalid snapshot names are used for diff based distcp Minor distcp Sushmitha Sreenivasan Jing Zhao
HDFS-7934 Update RollingUpgrade rollback documentation: should use bootstrapstandby for standby NN Critical documentation J.Andreina J.Andreina
HDFS-8149 The footer of the Web UI “Hadoop, 2014” is old Major . Akira Ajisaka Brahma Reddy Battula
HDFS-8142 DistributedFileSystem encryption zone commands should resolve relative paths Major . Rakesh R Rakesh R
MAPREDUCE-6300 Task list sort by task id broken Minor . Siqi Li Siqi Li
YARN-3021 YARN’s delegation-token handling disallows certain trust setups to operate properly over DistCp Major security Harsh J Yongjun Zhang
HDFS-8153 Error Message points to wrong parent directory in case of path component name length error Major namenode Anu Engineer Anu Engineer
YARN-3493 RM fails to come up with error “Failed to load/recover state” when mem settings are changed Critical yarn Sumana Sathish Jian He
HDFS-8043 NPE in MiniDFSCluster teardown Major test Steve Loughran Brahma Reddy Battula
HDFS-8173 NPE thrown at DataNode shutdown when HTTP server was not able to create Minor datanode Archana T Surendra Singh Lilhore
YARN-3497 ContainerManagementProtocolProxy modifies IPC timeout conf without making a copy Major client Jason Lowe Jason Lowe
MAPREDUCE-6238 MR2 can’t run local jobs with -libjars command options which is a regression from MR1 Critical mrv2 zhihai xu zhihai xu
HDFS-8179 DFSClient#getServerDefaults returns null within 1 hour of system start Blocker . Xiaoyu Yao Xiaoyu Yao
HDFS-7993 Provide each Replica details in fsck Major . Ming Ma J.Andreina
HDFS-8163 Using monotonicNow for block report scheduling causes test failures on recently restarted systems Blocker datanode Arpit Agarwal Arpit Agarwal
HADOOP-11704 DelegationTokenAuthenticationFilter must pass ipaddress instead of hostname to ProxyUsers#authorize() Major . Anubhav Dhoot Anubhav Dhoot
YARN-3495 Confusing log generated by FairScheduler Major . Brahma Reddy Battula Brahma Reddy Battula
MAPREDUCE-6293 Set job classloader on uber-job’s LocalContainerLauncher event thread Major mr-am Sangjin Lee Sangjin Lee
HADOOP-11846 TestCertificateUtil.testCorruptPEM failing on Jenkins JDK8 Major build, security Steve Loughran Larry McCay
HADOOP-11859 PseudoAuthenticationHandler fails with httpcomponents v4.4 Major . Eugene Koifman Eugene Koifman
MAPREDUCE-6330 Fix typo in Task Attempt API’s URL in documentations Minor documentation Ryu Kobayashi Ryu Kobayashi
HADOOP-11848 Incorrect arguments to sizeof in DomainSocket.c Major native Malcolm Kavalsky Malcolm Kavalsky
HADOOP-11868 Invalid user logins trigger large backtraces in server log Major . Chang Li Chang Li
HADOOP-11861 test-patch.sh rewrite addendum patch Major build Anu Engineer Allen Wittenauer
HADOOP-11864 JWTRedirectAuthenticationHandler breaks java8 javadocs Major build Steve Loughran Larry McCay
HDFS-4448 Allow HA NN to start in secure mode with wildcard address configured Major ha, namenode, security Aaron T. Myers Aaron T. Myers
YARN-3522 DistributedShell uses the wrong user to put timeline data Blocker timelineserver Zhijie Shen Zhijie Shen
HDFS-8147 Mover should not schedule two replicas to the same DN storage Major balancer & mover Surendra Singh Lilhore Surendra Singh Lilhore
HADOOP-11730 Regression: s3n read failure recovery broken Major fs/s3 Takenori Sato Takenori Sato
YARN-3516 killing ContainerLocalizer action doesn’t take effect when private localizer receives FETCH_FAILURE status. Minor nodemanager zhihai xu zhihai xu
HADOOP-11802 DomainSocketWatcher thread terminates sometimes after there is an I/O error during requestShortCircuitShm Major . Eric Payne Colin P. McCabe
HDFS-8070 Pre-HDFS-7915 DFSClient cannot use short circuit on post-HDFS-7915 DataNode Blocker caching Gopal V Colin P. McCabe
HDFS-8217 During block recovery for truncate Log new Block Id in case of copy-on-truncate is true. Major datanode Vinayakumar B Vinayakumar B
HDFS-8231 StackTrace displayed at client while QuotaByStorageType exceeds Major hdfs-client J.Andreina J.Andreina
HDFS-8110 Remove unsupported ‘hdfs namenode -rollingUpgrade downgrade’ from document Minor documentation J.Andreina J.Andreina
HDFS-8191 Fix byte to integer casting in SimulatedFSDataset#simulatedByte Minor . Zhe Zhang Zhe Zhang
YARN-3387 Previous AM’s container complete message couldn’t pass to current am if am restarted and rm changed Critical resourcemanager sandflee sandflee
HADOOP-11876 Refactor code to make it more readable, minor maybePrintStats bug Trivial tools/distcp Zoran Dimitrijevic Zoran Dimitrijevic
YARN-3444 Fix typo capabililty Trivial applications/distributed-shell Gabor Liptak Gabor Liptak
YARN-3537 NPE when NodeManager.serviceInit fails and stopRecoveryStore invoked Major nodemanager Brahma Reddy Battula Brahma Reddy Battula
HDFS-8211 DataNode UUID is always null in the JMX counter Major datanode Anu Engineer Anu Engineer
MAPREDUCE-6333 TestEvents,TestAMWebServicesTasks,TestAppController are broken due to MAPREDUCE-6297 Major . Siqi Li Siqi Li
HDFS-7673 synthetic load generator docs give incorrect/incomplete commands Major documentation Allen Wittenauer Brahma Reddy Battula
HDFS-8206 Fix the typos in hadoop-hdfs-httpfs Major . Brahma Reddy Battula Brahma Reddy Battula
YARN-3464 Race condition in LocalizerRunner kills localizer before localizing all resources Critical nodemanager zhihai xu zhihai xu
HADOOP-11865 Incorrect path mentioned in document for accessing script files Major documentation J.Andreina J.Andreina
MAPREDUCE-6252 JobHistoryServer should not fail when encountering a missing directory Major jobhistoryserver Craig Welch Craig Welch
YARN-3530 ATS throws exception on trying to filter results without otherinfo. Critical timelineserver Sreenath Somarajapuram Zhijie Shen
HDFS-8205 CommandFormat#parse() should not parse option as value of option Blocker . Peter Shi Peter Shi
HADOOP-11870 [JDK8] AuthenticationFilter, CertificateUtil, SignerSecretProviders, KeyAuthorizationKeyProvider Javadoc issues Major build Robert Kanter Robert Kanter
MAPREDUCE-6324 Uber jobs fail to update AMRM token when it rolls over Blocker mr-am Jason Lowe Jason Lowe
HDFS-8232 Missing datanode counters when using Metrics2 sink interface Major datanode Anu Engineer Anu Engineer
MAPREDUCE-6334 Fetcher#copyMapOutput is leaking usedMemory upon IOException during InMemoryMapOutput shuffle handler Blocker . Eric Payne Eric Payne
MAPREDUCE-6343 JobConf.parseMaximumHeapSizeMB() fails to parse value greater than 2GB expressed in bytes Major . Hao Xia Hao Xia
HDFS-8273 FSNamesystem#Delete() should not call logSync() when holding the lock Blocker namenode Jing Zhao Haohui Mai
YARN-3485 FairScheduler headroom calculation doesn’t consider maxResources for Fifo and FairShare policies Critical fairscheduler Karthik Kambatla Karthik Kambatla
HDFS-8269 getBlockLocations() does not resolve the .reserved path and generates incorrect edit logs when updating the atime Blocker . Yesha Vora Haohui Mai
YARN-3517 RM web ui for dumping scheduler logs should be for admins only Blocker resourcemanager, security Varun Vasudev Varun Vasudev
HDFS-8214 Secondary NN Web UI shows wrong date for Last Checkpoint Major namenode Charles Lamb Charles Lamb
YARN-3533 Test: Fix launchAM in MockRM to wait for attempt to be scheduled Major yarn Anubhav Dhoot Anubhav Dhoot
MAPREDUCE-6339 Job history file is not flushed correctly because isTimerActive flag is not set true when flushTimerTask is scheduled. Critical mrv2 zhihai xu zhihai xu
HADOOP-11821 Fix findbugs warnings in hadoop-sls Major tools Akira Ajisaka Brahma Reddy Battula
YARN-3564 Fix TestContainerAllocation.testAMContainerAllocationWhenDNSUnavailable fails randomly Major . Jian He Jian He
HADOOP-11891 OsSecureRandom should lazily fill its reservoir Major security Arun Suresh Arun Suresh
HADOOP-11866 increase readability and reliability of checkstyle, shellcheck, and whitespace reports Minor . Naganarasimha G R Allen Wittenauer
HDFS-8292 Move conditional in fmt_time from dfs-dust.js to status.html Minor namenode Charles Lamb Charles Lamb
HDFS-8300 Fix unit test failures and findbugs warning caused by HDFS-8283 Major . Jing Zhao Jing Zhao
HDFS-8276 LazyPersistFileScrubber should be disabled if scrubber interval configured zero Major namenode Surendra Singh Lilhore Surendra Singh Lilhore
HADOOP-11889 Make checkstyle runnable from root project Major build, test Gera Shegalov Gera Shegalov
HDFS-8213 DFSClient should use hdfs.client.htrace HTrace configuration prefix rather than hadoop.htrace Critical . Billie Rinaldi Colin P. McCabe
HDFS-8229 LAZY_PERSIST file gets deleted after NameNode restart. Major namenode Surendra Singh Lilhore Surendra Singh Lilhore
YARN-2893 AMLaucher: sporadic job failures due to EOFException in readTokenStorageStream Major resourcemanager Gera Shegalov zhihai xu
HADOOP-11491 HarFs incorrectly declared as requiring an authority Critical fs Gera Shegalov Brahma Reddy Battula
HADOOP-11900 Add failIfNoTests=false to hadoop-build-tools pom Major test Gera Shegalov Gera Shegalov
MAPREDUCE-6345 Documentation fix for when CRLA is enabled for MRAppMaster logs Trivial documentation Rohit Agarwal Rohit Agarwal
YARN-2454 Fix compareTo of variable UNBOUNDED in o.a.h.y.util.resource.Resources. Major . Xu Yang Xu Yang
YARN-1993 Cross-site scripting vulnerability in TextView.java Major webapp Ted Yu Kenji Kikushima
MAPREDUCE-5905 CountersStrings.toEscapedCompactStrings outputs unnecessary “null” strings Minor . Akira Ajisaka Akira Ajisaka
MAPREDUCE-6349 Fix typo in property org.apache.hadoop.mapreduce.lib.chain.Chain.REDUCER_INPUT_VALUE_CLASS Minor . Ray Chiang Ray Chiang
HADOOP-9658 SnappyCodec#checkNativeCodeLoaded may unexpectedly fail when native code is not loaded Major . Zhijie Shen Zhijie Shen
YARN-3097 Logging of resource recovery on NM restart has redundancies Minor nodemanager Jason Lowe Eric Payne
HDFS-8290 WebHDFS calls before namesystem initialization can cause NullPointerException. Minor webhdfs Chris Nauroth Chris Nauroth
MAPREDUCE-5649 Reduce cannot use more than 2G memory for the final merge Major mrv2 stanley shi Gera Shegalov
MAPREDUCE-6259 IllegalArgumentException due to missing job submit time Major jobhistoryserver zhihai xu zhihai xu
YARN-3375 NodeHealthScriptRunner.shouldRun() check is performing 3 times for starting NodeHealthScriptRunner Minor nodemanager Devaraj K Devaraj K
YARN-2725 Adding test cases of retrying requests about ZKRMStateStore Major . Tsuyoshi Ozawa Tsuyoshi Ozawa
MAPREDUCE-6165 [JDK8] TestCombineFileInputFormat failed on JDK8 Minor . Wei Yan Akira Ajisaka
HADOOP-11328 ZKFailoverController does not log Exception when doRun raises errors Major ha Tianyin Xu Tianyin Xu
HADOOP-11916 TestStringUtils#testLowerAndUpperStrings failed on MAC due to a JVM bug Minor . Ming Ma Ming Ma
YARN-3552 RM Web UI shows -1 running containers for completed apps Trivial webapp Rohith Sharma K S Rohith Sharma K S
HADOOP-11120 hadoop fs -rmr gives wrong advice Major . Allen Wittenauer Juliet Hougland
YARN-3396 Handle URISyntaxException in ResourceLocalizationService Major nodemanager Chengbing Liu Brahma Reddy Battula
YARN-2123 Progress bars in Web UI always at 100% due to non-US locale Major webapp Johannes Simon Akira Ajisaka
HDFS-8305 HDFS INotify: the destination field of RenameOp should always end with the file name Major . Colin P. McCabe Colin P. McCabe
HADOOP-11917 test-patch.sh should work with ${BASEDIR}/patchprocess setups Blocker . Allen Wittenauer Allen Wittenauer
HDFS-7847 Modify NNThroughputBenchmark to be able to operate on a remote NameNode Major . Colin P. McCabe Charles Lamb
HDFS-8219 setStoragePolicy with folder behavior is different after cluster restart Major . Peter Shi Surendra Singh Lilhore
HADOOP-11926 test-patch.sh mv does wrong math Major . Allen Wittenauer Allen Wittenauer
HADOOP-11912 Extra configuration key used in TraceUtils should respect prefix Minor . Masatake Iwasaki Masatake Iwasaki
YARN-3582 NPE in WebAppProxyServlet Major . Jian He Jian He
HDFS-2484 checkLease should throw FileNotFoundException when file does not exist Major namenode Konstantin Shvachko Rakesh R
YARN-3385 Race condition: KeeperException$NoNodeException will cause RM shutdown during ZK node deletion. Critical resourcemanager zhihai xu zhihai xu
HDFS-7833 DataNode reconfiguration does not recalculate valid volumes required, based on configured failed volumes tolerated. Major datanode Chris Nauroth Lei (Eddy) Xu
YARN-3577 Misspelling of threshold in log4j.properties for tests Minor test Brahma Reddy Battula Brahma Reddy Battula
HDFS-8325 Misspelling of threshold in log4j.properties for tests Minor test Brahma Reddy Battula Brahma Reddy Battula
HADOOP-10387 Misspelling of threshold in log4j.properties for tests in hadoop-common-project Minor conf, test Kenji Kikushima Brahma Reddy Battula
MAPREDUCE-6356 Misspelling of threshold in log4j.properties for tests Minor test Brahma Reddy Battula Brahma Reddy Battula
YARN-3523 Cleanup ResourceManagerAdministrationProtocol interface audience Major client, resourcemanager Wangda Tan Naganarasimha G R
HDFS-7980 Incremental BlockReport will dramatically slow down the startup of a namenode Major . Hui Zheng Walter Su
HADOOP-11936 Dockerfile references a removed image Major . Allen Wittenauer Allen Wittenauer
YARN-3584 [Log mesage correction] : MIssing space in Diagnostics message Trivial . nijel nijel
HDFS-8321 CacheDirectives and CachePool operations should throw RetriableException in safemode Major . Haohui Mai Haohui Mai
HDFS-8037 CheckAccess in WebHDFS silently accepts malformed FsActions parameters Minor webhdfs Jake Low Walter Su
YARN-1832 Fix wrong MockLocalizerStatus#equals implementation Minor nodemanager Hong Zhiguo Hong Zhiguo
YARN-3572 Correct typos in WritingYarnApplications.md Minor documentation Sandeep Khurana Gabor Liptak
HADOOP-11922 Misspelling of threshold in log4j.properties for tests in hadoop-tools Minor . Brahma Reddy Battula Gabor Liptak
HDFS-8257 Namenode rollingUpgrade option is incorrect in document Major documentation J.Andreina J.Andreina
HDFS-8067 haadmin prints out stale help messages Minor hdfs-client Ajith S Ajith S
YARN-3592 Fix typos in RMNodeLabelsManager Trivial resourcemanager Junping Du Sunil Govindan
HDFS-8174 Update replication count to live rep count in fsck report Minor . J.Andreina J.Andreina
HDFS-6291 FSImage may be left unclosed in BootstrapStandby#doRun() Minor ha Ted Yu Sanghyun Yun
YARN-3358 Audit log not present while refreshing Service ACLs Minor resourcemanager Varun Saxena Varun Saxena
HDFS-8349 Remove .xml and documentation references to dfs.webhdfs.enabled Minor . Ray Chiang Ray Chiang
YARN-3589 RM and AH web UI display DOCTYPE wrongly Major webapp Rohith Sharma K S Rohith Sharma K S
HDFS-7998 HDFS Federation : Command mentioned to add a NN to existing federated cluster is wrong Minor documentation Ajith S Ajith S
HDFS-8222 Remove usage of "dfsadmin -upgradeProgress " from document which is no longer supported Major documentation J.Andreina J.Andreina
HDFS-8187 Remove usage of “-setStoragePolicy” and “-getStoragePolicy” using dfsadmin cmd (as it is not been supported) Major documentation J.Andreina J.Andreina
HDFS-8175 Provide information on snapshotDiff for supporting the comparison between snapshot and current status Major documentation J.Andreina J.Andreina
MAPREDUCE-6342 Make POM project names consistent Minor build Rohith Sharma K S Rohith Sharma K S
HDFS-6576 Datanode log is generating at root directory in security mode Minor datanode, scripts Surendra Singh Lilhore Surendra Singh Lilhore
HADOOP-11877 SnappyDecompressor’s Logger class name is wrong Major conf Surendra Singh Lilhore Surendra Singh Lilhore
HDFS-3384 DataStreamer thread should be closed immediatly when failed to setup a PipelineForAppendOrRecovery Major hdfs-client Brahma Reddy Battula Uma Maheswara Rao G
YARN-3554 Default value for maximum nodemanager connect wait time is too high Major . Jason Lowe Naganarasimha G R
HDFS-7894 Rolling upgrade readiness is not updated in jmx until query command is issued. Critical . Kihwal Lee Brahma Reddy Battula
YARN-3600 AM container link is broken (on a killed application, at least) Major . Sergey Shelukhin Naganarasimha G R
HDFS-8346 libwebhdfs build fails during link due to unresolved external symbols. Major native Chris Nauroth Chris Nauroth
HDFS-8274 NFS configuration nfs.dump.dir not working Major nfs Ajith S Ajith S
HDFS-8340 Fix NFS documentation of nfs.wtmax Minor documentation, nfs Ajith S Ajith S
HADOOP-10356 Corrections in winutils/chmod.c Trivial bin René Nyffenegger René Nyffenegger
HADOOP-7165 listLocatedStatus(path, filter) is not redefined in FilterFs Major fs Hairong Kuang Hairong Kuang
MAPREDUCE-3383 Duplicate job.getOutputValueGroupingComparator() in ReduceTask Major . Binglin Chang Binglin Chang
HDFS-8311 DataStreamer.transfer() should timeout the socket InputStream. Major hdfs-client Esteban Gutierrez Esteban Gutierrez
HDFS-8113 Add check for null BlockCollection pointers in BlockInfoContiguous structures Major namenode Chengbing Liu Chengbing Liu
HADOOP-9729 The example code of org.apache.hadoop.util.Tool is incorrect Major util hellojinjie hellojinjie
MAPREDUCE-2094 LineRecordReader should not seek into non-splittable, compressed streams. Major task Niels Basjes Niels Basjes
HADOOP-11942 Add links to SLGUserGuide to site index Minor documentation Masatake Iwasaki Masatake Iwasaki
HDFS-8245 Standby namenode doesn’t process DELETED_BLOCK if the add block request is in edit log. Major . Rushabh S Shah Rushabh S Shah
YARN-3018 Unify the default value for yarn.scheduler.capacity.node-locality-delay in code and default xml file Trivial capacityscheduler nijel nijel
HDFS-8326 Documentation about when checkpoints are run is out of date Major documentation Misty Linville Misty Linville
YARN-3604 removeApplication in ZKRMStateStore should also disable watch. Minor resourcemanager zhihai xu zhihai xu
YARN-3476 Nodemanager can fail to delete local logs if log aggregation fails Major log-aggregation, nodemanager Jason Lowe Rohith Sharma K S
YARN-3473 Fix RM Web UI configuration for some properties Minor resourcemanager Ray Chiang Ray Chiang
HDFS-8097 TestFileTruncate is failing intermittently Major test Rakesh R Rakesh R
HADOOP-11775 Fix Javadoc typos in hadoop-openstack module Trivial documentation Chen He Yanjun Wang
YARN-1912 ResourceLocalizer started without any jvm memory control Major nodemanager stanley shi Masatake Iwasaki
MAPREDUCE-6359 RM HA setup, “Cluster” tab links populated with AM hostname instead of RM Minor . Aroop Maliakkal yunjiong zhao
MAPREDUCE-6353 Divide by zero error in MR AM when calculating available containers Major mr-am Anubhav Dhoot Anubhav Dhoot
YARN-3395 FairScheduler: Trim whitespaces when using username for queuename Major fairscheduler zhihai xu zhihai xu
HDFS-8351 Remove namenode -finalize option from document Major documentation Akira Ajisaka Akira Ajisaka
YARN-3587 Fix the javadoc of DelegationTokenSecretManager in projects of yarn, etc. Minor documentation Akira Ajisaka Gabor Liptak
HADOOP-11663 Remove description about Java 6 from docs Minor documentation Masatake Iwasaki Masatake Iwasaki
HADOOP-11928 Test-patch check for @author tags incorrectly flags removal of @author tags Major . Sean Busbey Kengo Seki
HADOOP-11951 test-patch should give better info about failures to handle dev-support updates without resetrepo option Minor . Sean Busbey Sean Busbey
HADOOP-11947 test-patch should return early from determine-issue when run in jenkins mode. Minor . Sean Busbey Sean Busbey
HDFS-7916 ‘reportBadBlocks’ from datanodes to standby Node BPServiceActor goes for infinite loop Critical datanode Vinayakumar B Rushabh S Shah
YARN-3434 Interaction between reservations and userlimit can result in significant ULF violation Major capacityscheduler Thomas Graves Thomas Graves
HDFS-8362 Java Compilation Error in TestHdfsConfigFields.java Major . Mohammad Arshad Mohammad Arshad
MAPREDUCE-6360 TestMapreduceConfigFields is placed in wrong dir, introducing compile error Major . Vinayakumar B Mohammad Arshad
MAPREDUCE-6361 NPE issue in shuffle caused by concurrent issue between copySucceeded() in one thread and copyFailed() in another thread on the same host Critical . Junping Du Junping Du
YARN-3629 NodeID is always printed as “null” in node manager initialization log. Major . nijel nijel
MAPREDUCE-6251 JobClient needs additional retries at a higher level to address not-immediately-consistent dfs corner cases Major jobhistoryserver, mrv2 Craig Welch Craig Welch
MAPREDUCE-6366 mapreduce.terasort.final.sync configuration in TeraSort doesn’t work Trivial examples Takuya Fukudome Takuya Fukudome
HDFS-6300 Prevent multiple balancers from running simultaneously Critical balancer & mover Rakesh R Rakesh R
HDFS-8358 TestTraceAdmin fails Major . Kihwal Lee Masatake Iwasaki
HADOOP-11966 Variable cygwin is undefined in hadoop-config.sh when executed through hadoop-daemon.sh. Critical scripts Chris Nauroth Chris Nauroth
HDFS-8380 Always call addStoredBlock on blocks which have been shifted from one storage to another Major . Colin P. McCabe Colin P. McCabe
HADOOP-8174 Remove confusing comment in Path#isAbsolute() Trivial fs Suresh Srinivas Suresh Srinivas
HDFS-8150 Make getFileChecksum fail for blocks under construction Critical . Kihwal Lee J.Andreina
MAPREDUCE-5708 Duplicate String.format in YarnOutputFiles.getSpillFileForWrite Minor . Konstantin Weitz Konstantin Weitz
YARN-1519 check if sysconf is implemented before using it Major nodemanager Radim Kolar Radim Kolar
HDFS-8371 Fix test failure in TestHdfsConfigFields for spanreceiver properties Major . Ray Chiang Ray Chiang
MAPREDUCE-6273 HistoryFileManager should check whether summaryFile exists to avoid FileNotFoundException causing HistoryFileInfo into MOVE_FAILED state Minor jobhistoryserver zhihai xu zhihai xu
YARN-2421 RM still allocates containers to an app in the FINISHING state Major scheduler Thomas Graves Chang Li
YARN-3526 ApplicationMaster tracking URL is incorrectly redirected on a QJM cluster Major resourcemanager, webapp Weiwei Yang Weiwei Yang
HADOOP-11988 Fix typo in the document for hadoop fs -find Trivial documentation Akira Ajisaka Kengo Seki
HADOOP-10582 Fix the test case for copying to non-existent dir in TestFsShellCopy Minor fs Kousuke Saruta Kousuke Saruta
HDFS-8412 Fix the test failures in HTTPFS: In some tests setReplication called after fs close. Major fs Uma Maheswara Rao G Uma Maheswara Rao G
HDFS-8345 Storage policy APIs must be exposed via the FileSystem interface Major hdfs-client Arpit Agarwal Arpit Agarwal
HDFS-8405 Fix a typo in NamenodeFsck Minor namenode Tsz Wo Nicholas Sze Takanobu Asanuma
HDFS-6348 SecondaryNameNode not terminating properly on runtime exceptions Major namenode Rakesh R Rakesh R
YARN-3601 Fix UT TestRMFailover.testRMWebAppRedirect Critical resourcemanager, webapp Weiwei Yang Weiwei Yang
HDFS-8404 Pending block replication can get stuck using older genstamp Major namenode Nathan Roberts Nathan Roberts
HADOOP-11973 Ensure ZkDelegationTokenSecretManager namespace znodes get created with ACLs Major security Gregory Chanan Gregory Chanan
HADOOP-11963 Metrics documentation for FSNamesystem misspells PendingDataNodeMessageCount. Trivial documentation Chris Nauroth Anu Engineer
YARN-2821 Distributed shell app master becomes unresponsive sometimes Major applications/distributed-shell Varun Vasudev Varun Vasudev
YARN-3677 Fix findbugs warnings in yarn-server-resourcemanager Minor resourcemanager Akira Ajisaka Vinod Kumar Vavilapalli
YARN-3681 yarn cmd says “could not find main class ‘queue’” in windows Blocker yarn Sumana Sathish Varun Saxena
YARN-3654 ContainerLogsPage web UI should not have meta-refresh Major yarn Xuan Gong Xuan Gong
YARN-3694 Fix dead link for TimelineServer REST API Minor documentation Akira Ajisaka Jagadesh Kiran N
YARN-3646 Applications are getting stuck some times in case of retry policy forever Major client Raju Bairishetti Raju Bairishetti
HDFS-8421 Move startFile() and related operations into FSDirWriteFileOp Major . Haohui Mai Haohui Mai
HDFS-8451 DFSClient probe for encryption testing interprets empty URI property for “enabled” Blocker encryption Steve Loughran Steve Loughran
YARN-3675 FairScheduler: RM quits when node removal races with continousscheduling on the same node Critical fairscheduler Anubhav Dhoot Anubhav Dhoot
HADOOP-12016 Typo in FileSystem:: listStatusIterator Trivial fs Jakob Homan Arthur Vigil
HADOOP-12014 hadoop-config.cmd displays a wrong error message Minor scripts Kengo Seki Kengo Seki
HADOOP-11955 Fix a typo in the cluster setup doc Trivial . Kihwal Lee Yanjun Wang
HDFS-8268 Port conflict log for data node server is not sufficient Minor datanode Mohammad Shahid Khan Mohammad Shahid Khan
YARN-3594 WintuilsProcessStubExecutor.startStreamReader leaks streams Trivial nodemanager Steve Loughran Lars Francke
HADOOP-11743 maven doesn’t clean all the site files Minor documentation Allen Wittenauer ramtin
HADOOP-11927 Fix “undefined reference to dlopen” error when compiling libhadooppipes Major build, native, tools Xianyin Xin Xianyin Xin
YARN-3701 Isolating the error of generating a single app report when getting all apps from generic history service Blocker timelineserver Zhijie Shen Zhijie Shen
YARN-3707 RM Web UI queue filter doesn’t work Blocker . Wangda Tan Wangda Tan
YARN-2238 filtering on UI sticks even if I move away from the page Major webapp Sangjin Lee Jian He
HADOOP-8751 NPE in Token.toString() when Token is constructed using null identifier Minor security Vlad Rozov Kanaka Kumar Avvaru
HADOOP-11969 ThreadLocal initialization in several classes is not thread safe Critical io Sean Busbey Sean Busbey
YARN-3626 On Windows localized resources are not moved to the front of the classpath when they should be Major yarn Craig Welch Craig Welch
HADOOP-9891 CLIMiniCluster instructions fail with MiniYarnCluster ClassNotFoundException Minor documentation Steve Loughran Darrell Taylor
HDFS-8431 hdfs crypto class not found in Windows Critical scripts Sumana Sathish Anu Engineer
HADOOP-12004 test-patch breaks with reexec in certain situations Critical . Allen Wittenauer Sean Busbey
YARN-3723 Need to clearly document primaryFilter and otherInfo value type Critical timelineserver Zhijie Shen Zhijie Shen
HADOOP-11406 xargs -P is not portable Critical scripts Allen Wittenauer Kengo Seki
HADOOP-11983 HADOOP_USER_CLASSPATH_FIRST works the opposite of what it is supposed to do Major scripts Sangjin Lee Sangjin Lee
HDFS-8407 libhdfs hdfsListDirectory must set errno to 0 on success Major native Juan Yu Masatake Iwasaki
HDFS-8429 Avoid stuck threads if there is an error in DomainSocketWatcher that stops the thread Major . zhouyingchao zhouyingchao
HADOOP-11959 WASB should configure client side socket timeout in storage client blob request options Major tools Ivan Mitic Ivan Mitic
HADOOP-11934 Use of JavaKeyStoreProvider in LdapGroupsMapping causes infinite loop Blocker security Mike Yoder Larry McCay
HDFS-7401 Add block info to DFSInputStream’ WARN message when it adds node to deadNodes Minor . Ming Ma Mohammad Arshad
HADOOP-12042 Users may see TrashPolicy if hdfs dfs -rm is run Major . Allen Wittenauer J.Andreina
HDFS-7609 Avoid retry cache collision when Standby NameNode loading edits Critical namenode Carrey Zhan Ming Ma
HADOOP-11885 hadoop-dist dist-layout-stitching.sh does not work with dash Major build Andrew Wang Andrew Wang
YARN-3725 App submission via REST API is broken in secure mode due to Timeline DT service address is empty Blocker resourcemanager, timelineserver Zhijie Shen Zhijie Shen
HADOOP-9905 remove dependency of zookeeper for hadoop-client Major . Vinayakumar B Vinayakumar B
HADOOP-12037 Fix wrong classname in example configuration of hadoop-auth documentation Trivial documentation Masatake Iwasaki Masatake Iwasaki
HDFS-8256 fsck "-storagepolicies , -blockId ,-replicaDetails " options are missed out in usage and from documentation Major documentation J.Andreina J.Andreina
HDFS-8486 DN startup may cause severe data loss Blocker datanode Daryn Sharp Daryn Sharp
HDFS-8386 Improve synchronization of ‘streamer’ reference in DFSOutputStream Major hdfs-client Rakesh R Rakesh R
HDFS-8513 Rename BlockPlacementPolicyRackFaultTolarent to BlockPlacementPolicyRackFaultTolerant Minor namenode Andrew Wang Andrew Wang
HADOOP-11991 test-patch.sh isn’t re-executed even if smart-apply-patch.sh is modified Major test Kengo Seki Kengo Seki
HDFS-8270 create() always retried with hardcoded timeout when file already exists with open lease Major hdfs-client Andrey Stepachev J.Andreina
HDFS-8470 fsimage loading progress should update inode, delegation token and cache pool count. Minor namenode tongshiquan Surendra Singh Lilhore
HDFS-8523 Remove usage information on unsupported operation “fsck -showprogress” from branch-2 Major documentation J.Andreina J.Andreina
HDFS-3716 Purger should remove stale fsimage ckpt files Minor namenode suja s J.Andreina
YARN-3751 TestAHSWebServices fails after YARN-3467 Major . Zhijie Shen Sunil Govindan
YARN-3585 NodeManager cannot exit on SHUTDOWN event triggered and NM recovery is enabled Critical . Peng Zhang Rohith Sharma K S
MAPREDUCE-6374 Distributed Cache File visibility should check permission of full path Major . Chang Li Chang Li
YARN-3762 FairScheduler: CME on FSParentQueue#getQueueUserAclInfo Critical fairscheduler Karthik Kambatla Karthik Kambatla
YARN-3749 We should make a copy of configuration when init MiniYARNCluster with multiple RMs Major . Chun Chen Chun Chen
MAPREDUCE-5965 Hadoop streaming throws error if list of input files is high. Error is: “error=7, Argument list too long at if number of input file is high” Major . Arup Malakar Wilfred Spiegelenburg
HADOOP-12018 smart-apply-patch.sh fails if the patch edits CR+LF files and is created by ‘git diff –no-prefix’ Minor build Akira Ajisaka Kengo Seki
HADOOP-12019 update BUILDING.txt to include python for ‘mvn site’ in windows Major . Vinayakumar B Vinayakumar B
MAPREDUCE-6382 Don’t escape HTML links in Diagnostics in JHS job overview Major . Siqi Li Siqi Li
HADOOP-12058 Fix dead links to DistCp and Hadoop Archives pages. Minor documentation, site Kazuho Fujii Kazuho Fujii
HDFS-8463 Calling DFSInputStream.seekToNewSource just after stream creation causes NullPointerException Minor . Masatake Iwasaki Masatake Iwasaki
YARN-3764 CapacityScheduler should forbid moving LeafQueue from one parent to another Blocker . Wangda Tan Wangda Tan
HADOOP-11994 smart-apply-patch wrongly assumes that git is infallible Major test Allen Wittenauer Kengo Seki
HADOOP-11924 Tolerate JDK-8047340-related exceptions in Shell#isSetSidAvailable preventing class init Major . Gera Shegalov Tsuyoshi Ozawa
YARN-3733 Fix DominantRC#compare() does not work as expected if cluster resource is empty Blocker resourcemanager Bibin A Chundatt Rohith Sharma K S
MAPREDUCE-6377 JHS sorting on state column not working in webUi Minor jobhistoryserver Bibin A Chundatt zhihai xu
MAPREDUCE-6387 Serialize the recently added Task#encryptedSpillKey field at the end Minor . Arun Suresh Arun Suresh
HADOOP-12056 Use DirectoryStream in DiskChecker#checkDirs to detect errors when listing a directory Major util zhihai xu zhihai xu
HDFS-8522 Change heavily recorded NN logs from INFO to DEBUG level Major namenode Xiaoyu Yao Xiaoyu Yao
YARN-3655 FairScheduler: potential livelock due to maxAMShare limitation and container reservation Critical fairscheduler zhihai xu zhihai xu
HDFS-8539 Hdfs doesnt have class ‘debug’ in windows Major scripts Sumana Sathish Anu Engineer
YARN-3780 Should use equals when compare Resource in RMNodeImpl#ReconnectNodeTransition Minor resourcemanager zhihai xu zhihai xu
YARN-3747 TestLocalDirsHandlerService should delete the created test directory logDir2 Minor test David Moore David Moore
HDFS-8554 TestDatanodeLayoutUpgrade fails on Windows. Major test Chris Nauroth Chris Nauroth
YARN-3778 Fix Yarn resourcemanger CLI usage Major . Brahma Reddy Battula Brahma Reddy Battula
HADOOP-12054 RPC client should not retry for InvalidToken exceptions Critical ipc Daryn Sharp Varun Saxena
HDFS-8552 Fix hdfs CLI usage message for namenode and zkfc Major . Xiaoyu Yao Brahma Reddy Battula
HADOOP-12073 Azure FileSystem PageBlobInputStream does not return -1 on EOF Major tools Ivan Mitic Ivan Mitic
HDFS-8568 TestClusterId#testFormatWithEmptyClusterIdOption is failing Major . Rakesh R Rakesh R
HADOOP-7817 RawLocalFileSystem.append() should give FSDataOutputStream with accurate .getPos() Major fs Kristofer Tomasette Kanaka Kumar Avvaru
MAPREDUCE-6350 JobHistory doesn’t support fully-functional search Critical jobhistoryserver Siqi Li Siqi Li
MAPREDUCE-6389 Fix BaileyBorweinPlouffe CLI usage message Trivial . Brahma Reddy Battula Brahma Reddy Battula
HADOOP-12052 IPC client downgrades all exception types to IOE, breaks callers trying to use them Critical . Steve Loughran Brahma Reddy Battula
YARN-3785 Support for Resource as an argument during submitApp call in MockRM test class Minor resourcemanager Sunil Govindan Sunil Govindan
HADOOP-12074 in Shell.java#runCommand() rethrow InterruptedException as InterruptedIOException Minor . Lavkesh Lahngir Lavkesh Lahngir
HDFS-8566 HDFS documentation about debug commands wrongly identifies them as “hdfs dfs” commands Major documentation Surendra Singh Lilhore Surendra Singh Lilhore
HDFS-8583 Document that NFS gateway does not work with rpcbind on SLES 11 Major documentation Arpit Agarwal Arpit Agarwal
HDFS-8572 DN always uses HTTP/localhost@REALM principals in SPNEGO Blocker . Haohui Mai Haohui Mai
YARN-3794 TestRMEmbeddedElector fails because of ambiguous LOG reference Major test Chengbing Liu Chengbing Liu
HDFS-8593 Calculation of effective layout version mishandles comparison to current layout version in storage. Major namenode Chris Nauroth Chris Nauroth
HDFS-8596 TestDistributedFileSystem et al tests are broken in branch-2 due to incorrect setting of “datanode” attribute Blocker datanode Yongjun Zhang Yongjun Zhang
HDFS-8595 TestCommitBlockSynchronization fails in branch-2.7 Major test Arpit Agarwal Arpit Agarwal
HDFS-8607 TestFileCorruption doesn’t work as expected Major test Walter Su Walter Su
HADOOP-12001 Limiting LDAP search conflicts with posixGroup addition Blocker security Patrick White Patrick White
HADOOP-12078 The default retry policy does not handle RetriableException correctly Critical ipc Arpit Agarwal Arpit Agarwal
MAPREDUCE-6396 TestPipeApplication fails by NullPointerException Major test Akira Ajisaka Brahma Reddy Battula
HDFS-8576 Lease recovery should return true if the lease can be released and the file can be closed Major namenode J.Andreina J.Andreina
HDFS-8592 SafeModeException never get unwrapped Major . Haohui Mai Haohui Mai
HADOOP-12095 org.apache.hadoop.fs.shell.TestCount fails Major test Brahma Reddy Battula Brahma Reddy Battula
HDFS-4660 Block corruption can happen during pipeline recovery Blocker datanode Peng Zhang Kihwal Lee
HDFS-8548 Minicluster throws NPE on shutdown Major . Mike Drob Surendra Singh Lilhore
YARN-3714 AM proxy filter can not get RM webapp address from yarn.resourcemanager.hostname.rm-id Minor . Masatake Iwasaki Masatake Iwasaki
HDFS-8551 Fix hdfs datanode CLI usage message Major . Xiaoyu Yao Brahma Reddy Battula
HADOOP-12076 Incomplete Cache Mechanism in CredentialProvider API Major security Larry McCay Larry McCay
YARN-3617 Fix WindowsResourceCalculatorPlugin.getCpuFrequency() returning always -1 Minor . Georg Berendt J.Andreina
YARN-3804 Both RM are on standBy state when kerberos user not in yarn.admin.acl Critical resourcemanager Bibin A Chundatt Varun Saxena
HDFS-8446 Separate safemode related operations in GetBlockLocations() Minor . Haohui Mai Haohui Mai
HDFS-8615 Correct HTTP method in WebHDFS document Major documentation Akira Ajisaka Brahma Reddy Battula
MAPREDUCE-6373 The logger reports total input paths but it is referring to input files Trivial . Andi Chirita Amdocs Bibin A Chundatt
YARN-3824 Fix two minor nits in member variable properties of YarnConfiguration Trivial yarn Ray Chiang Ray Chiang
HADOOP-12100 ImmutableFsPermission should not override applyUmask since that method doesn’t modify the FsPermission Major . Robert Kanter Bibin A Chundatt
YARN-3802 Two RMNodes for the same NodeId are used in RM sometimes after NM is reconnected. Major resourcemanager zhihai xu zhihai xu
HDFS-8633 Fix setting of dfs.datanode.readahead.bytes in hdfs-default.xml to match DFSConfigKeys Minor datanode Ray Chiang Ray Chiang
HDFS-8626 Reserved RBW space is not released if creation of RBW File fails Blocker . Kanaka Kumar Avvaru Kanaka Kumar Avvaru
MAPREDUCE-6405 NullPointerException in App Attempts page Major . Siqi Li Siqi Li
HADOOP-12103 Small refactoring of DelegationTokenAuthenticationFilter to allow code sharing Minor security Yongjun Zhang Yongjun Zhang
HDFS-8337 Accessing httpfs via webhdfs doesn’t work from a jar with kerberos Major security, webhdfs Yongjun Zhang Yongjun Zhang
MAPREDUCE-6403 Fix typo in the usage of NNBench Trivial documentation Akira Ajisaka Jagadesh Kiran N
HDFS-8480 Fix performance and timeout issues in HDFS-7929 by using hard-links to preserve old edit logs instead of copying them Critical . Zhe Zhang Zhe Zhang
MAPREDUCE-5948 org.apache.hadoop.mapred.LineRecordReader does not handle multibyte record delimiters well Critical . Kris Geusebroek Akira Ajisaka
HDFS-8542 WebHDFS getHomeDirectory behavior does not match specification Major webhdfs Jakob Homan Kanaka Kumar Avvaru
YARN-3842 NMProxy should retry on NMNotYetReadyException Critical . Karthik Kambatla Robert Kanter
YARN-3835 hadoop-yarn-server-resourcemanager test package bundles core-site.xml, yarn-site.xml Minor resourcemanager Vamsee Yarlagadda Vamsee Yarlagadda
MAPREDUCE-6406 Update FileOutputCommitter.FILEOUTPUTCOMMITTER_ALGORITHM_VERSION_DEFAULT to match mapred-default.xml Minor mrv2 Ray Chiang Ray Chiang
MAPREDUCE-6410 Aggregated Logs Deletion doesnt work after refreshing Log Retention Settings in secure cluster Critical . Zhang Wei Varun Saxena
MAPREDUCE-6400 Multiple shuffle transfer fails because input is closed too early Blocker task Akira Ajisaka Brahma Reddy Battula
YARN-3809 Failed to launch new attempts because ApplicationMasterLauncher’s threads all hang Major resourcemanager Jun Gong Jun Gong
YARN-3832 Resource Localization fails on a cluster due to existing cache directories Critical nodemanager Ranga Swamy Brahma Reddy Battula
YARN-3790 usedResource from rootQueue metrics may get stale data for FS scheduler after recovering the container Major fairscheduler, test Rohith Sharma K S zhihai xu
HADOOP-11958 MetricsSystemImpl fails to show backtrace when an error occurs Major . Jason Lowe Jason Lowe
HDFS-8646 Prune cached replicas from DatanodeDescriptor state on replica invalidation Major caching Andrew Wang Andrew Wang
YARN-3826 Race condition in ResourceTrackerService leads to wrong diagnostics messages Major resourcemanager Chengbing Liu Chengbing Liu
YARN-3745 SerializedException should also try to instantiate internal exception with the default constructor Major . Lavkesh Lahngir Lavkesh Lahngir
MAPREDUCE-6413 TestLocalJobSubmission is failing with unknown host Major test Jason Lowe zhihai xu
HDFS-8665 Fix replication check in DFSTestUtils#waitForReplication Trivial test Andrew Wang Andrew Wang
HADOOP-8151 Error handling in snappy decompressor throws invalid exceptions Major io, native Todd Lipcon Matt Foley
YARN-3850 NM fails to read files from full disks which can lead to container logs being lost and other issues Blocker log-aggregation, nodemanager Varun Saxena Varun Saxena
HDFS-8656 Preserve compatibility of ClientProtocol#rollingUpgrade after finalization Critical rolling upgrades Andrew Wang Andrew Wang
YARN-3859 LeafQueue doesn’t print user properly for application add Minor capacityscheduler Devaraj K Varun Saxena
HDFS-8681 BlockScanner is incorrectly disabled by default Blocker datanode Andrew Wang Arpit Agarwal
YARN-3860 rmadmin -transitionToActive should check the state of non-target node Major resourcemanager Masatake Iwasaki Masatake Iwasaki
HDFS-8586 Dead Datanode is allocated for write when client is from deadnode Critical . Brahma Reddy Battula Brahma Reddy Battula
HADOOP-12119 hadoop fs -expunge does not work for federated namespace Major . Vrushali C J.Andreina
HDFS-8628 Update missing command option for fetchdt Major documentation J.Andreina J.Andreina
YARN-3695 ServerProxy (NMProxy, etc.) shouldn’t retry forever for non network exception. Major . Junping Du Raju Bairishetti
HADOOP-12089 StorageException complaining " no lease ID" when updating FolderLastModifiedTime in WASB Major tools Duo Xu Duo Xu
YARN-3770 SerializedException should also handle java.lang.Error Major . Lavkesh Lahngir Lavkesh Lahngir
HDFS-8687 Remove the duplicate usage message from Dfsck.java Major . Brahma Reddy Battula Brahma Reddy Battula
HADOOP-12107 long running apps may have a huge number of StatisticsData instances under FileSystem Critical fs Sangjin Lee Sangjin Lee
HDFS-8579 Update HDFS usage with missing options Minor . J.Andreina J.Andreina
HADOOP-12154 FileSystem#getUsed() returns the file length only from root ‘/’ Major . tongshiquan J.Andreina
HDFS-8627 NPE thrown if unable to fetch token from Namenode Major . J.Andreina J.Andreina
YARN-3768 ArrayIndexOutOfBoundsException with empty environment variables Major yarn Joe Ferner zhihai xu
HADOOP-10798 globStatus() should always return a sorted list of files Minor . Felix Borchers Colin P. McCabe
HADOOP-12124 Add HTrace support for FsShell Major . Colin P. McCabe Colin P. McCabe
HADOOP-12159 Move DistCpUtils#compareFs() to org.apache.hadoop.fs.FileUtil and fix for HA namespaces Major . Ray Chiang Ray Chiang
MAPREDUCE-6121 JobResourceUpdater#compareFs() doesn’t handle HA namespaces Major mrv2 Thomas Graves Ray Chiang
HADOOP-12116 Fix unrecommended syntax usages in hadoop/hdfs/yarn script for cygwin in branch-2 Major scripts Li Lu Li Lu
HADOOP-12164 Fix TestMove and TestFsShellReturnCode failed to get command name using reflection. Minor . Lei (Eddy) Xu Lei (Eddy) Xu
YARN-3823 Fix mismatch in default values for yarn.scheduler.maximum-allocation-vcores property Minor . Ray Chiang Ray Chiang
YARN-3830 AbstractYarnScheduler.createReleaseCache may try to clean a null attempt Major scheduler nijel nijel
HDFS-8706 Fix typo in datanode startup options in HDFSCommands.html Major . Brahma Reddy Battula Brahma Reddy Battula
MAPREDUCE-6420 Interrupted Exception in LocalContainerLauncher should be logged in warn/info level Major . Chang Li Chang Li
MAPREDUCE-6418 MRApp should not shutdown LogManager during shutdown Major test Chang Li Chang Li
YARN-3793 Several NPEs when deleting local files on NM recovery Major nodemanager Karthik Kambatla Varun Saxena
HDFS-8666 speedup TestMover Major test Walter Su Walter Su
HADOOP-12171 Shorten overly-long htrace span names for server Major tracing Colin P. McCabe Colin P. McCabe
YARN-3875 FSSchedulerNode#reserveResource() doesn’t print Application Id properly in log Minor . Bibin A Chundatt Bibin A Chundatt
YARN-3508 Prevent processing preemption events on the main RM dispatcher Major resourcemanager, scheduler Jason Lowe Varun Saxena
HADOOP-12173 NetworkTopology#add calls NetworkTopology#toString always Major . Íñigo Goiri Íñigo Goiri
HDFS-8577 Avoid retrying to recover lease on a file which does not exist Major . J.Andreina J.Andreina
YARN-3882 AggregatedLogFormat should close aclScanner and ownerScanner after create them. Minor nodemanager zhihai xu zhihai xu
MAPREDUCE-6425 ShuffleHandler passes wrong “base” parameter to getMapOutputInfo if mapId is not in the cache. Major mrv2, nodemanager zhihai xu zhihai xu
HADOOP-12186 ActiveStandbyElector shouldn’t call monitorLockNodeAsync multiple times Major ha zhihai xu zhihai xu
HDFS-8686 WebHdfsFileSystem#getXAttr(Path p, final String name) doesn’t work if namespace is in capitals Major webhdfs Jagadesh Kiran N Kanaka Kumar Avvaru
YARN-3837 javadocs of TimelineAuthenticationFilterInitializer give wrong prefix for auth options Minor timelineserver Steve Loughran Bibin A Chundatt
HADOOP-12117 Potential NPE from Configuration#loadProperty with allowNullValueProperties set. Minor conf zhihai xu zhihai xu
MAPREDUCE-6038 A boolean may be set error in the Word Count v2.0 in MapReduce Tutorial Minor . Pei Ma Tsuyoshi Ozawa
YARN-3892 NPE on RMStateStore#serviceStop when CapacityScheduler#serviceInit fails Minor . Bibin A Chundatt Bibin A Chundatt
YARN-3690 [JDK8] ‘mvn site’ fails Major api, site Akira Ajisaka Brahma Reddy Battula
HADOOP-12202 releasedocmaker drops missing component and assignee entries Blocker yetus Allen Wittenauer Allen Wittenauer
HDFS-8642 Make TestFileTruncate more reliable Minor . Rakesh R Rakesh R
HADOOP-11878 FileContext.java # fixRelativePart should check for not null for a more informative exception Major . Brahma Reddy Battula Brahma Reddy Battula
HADOOP-12201 Add tracing to FileSystem#createFileSystem and Globber#glob Major . Colin P. McCabe Colin P. McCabe
HADOOP-12200 TestCryptoStreamsWithOpensslAesCtrCryptoCodec should be skipped in non-native profile Minor test Masatake Iwasaki Masatake Iwasaki
MAPREDUCE-6426 TestShuffleHandler#testGetMapOutputInfo is failing Major test Devaraj K zhihai xu
HDFS-8729 Fix testTruncateWithDataNodesRestartImmediately occasionally failed Minor . Walter Su Walter Su
YARN-3888 ApplicationMaster link is broken in RM WebUI when appstate is NEW Minor resourcemanager Bibin A Chundatt Bibin A Chundatt
HDFS-8749 Fix findbugs warning in BlockManager.java Minor . Akira Ajisaka Brahma Reddy Battula
HDFS-2956 calling fetchdt without a –renewer argument throws NPE Major security Todd Lipcon Vinayakumar B
HDFS-8751 Remove setBlocks API from INodeFile and misc code cleanup Major namenode Zhe Zhang Zhe Zhang
YARN-3849 Too much of preemption activity causing continuos killing of containers across queues Critical capacityscheduler Sunil Govindan Sunil Govindan
YARN-3917 getResourceCalculatorPlugin for the default should intercept all exceptions Major . Gera Shegalov Gera Shegalov
YARN-3894 RM startup should fail for wrong CS xml NodeLabel capacity configuration Critical capacityscheduler Bibin A Chundatt Bibin A Chundatt
MAPREDUCE-6421 Fix findbugs warning in RMContainerAllocator.reduceNodeLabelExpression Major . Ray Chiang Brahma Reddy Battula
HADOOP-12191 Bzip2Factory is not thread safe Major io Jason Lowe Brahma Reddy Battula
HDFS-7608 hdfs dfsclient newConnectedPeer has no write timeout Major fuse-dfs, hdfs-client zhangshilong Xiaoyu Yao
HADOOP-12153 ByteBufferReadable doesn’t declare @InterfaceAudience and @InterfaceStability Minor fs Steve Loughran Brahma Reddy Battula
HDFS-8778 TestBlockReportRateLimiting#testLeaseExpiration can deadlock Major test Arpit Agarwal Arpit Agarwal
HADOOP-10615 FileInputStream in JenkinsHash#main() is never closed Minor . Ted Yu Chen He
HADOOP-12240 Fix tests requiring native library to be skipped in non-native profile Minor test Masatake Iwasaki Masatake Iwasaki
YARN-3805 Update the documentation of Disk Checker based on YARN-90 Minor documentation Masatake Iwasaki Masatake Iwasaki
HDFS-8767 RawLocalFileSystem.listStatus() returns null for UNIX pipefile Critical . Haohui Mai Kanaka Kumar Avvaru
YARN-3885 ProportionalCapacityPreemptionPolicy doesn’t preempt if queue is more than 2 level Blocker yarn Ajith S Ajith S
YARN-3453 Fair Scheduler: Parts of preemption logic uses DefaultResourceCalculator even in DRF mode causing thrashing Major fairscheduler Ashwin Shankar Arun Suresh
YARN-3535 Scheduler must re-request container resources when RMContainer transitions from ALLOCATED to KILLED Critical capacityscheduler, fairscheduler, resourcemanager Peng Zhang Peng Zhang
YARN-3905 Application History Server UI NPEs when accessing apps run after RM restart Major timelineserver Eric Payne Eric Payne
HADOOP-12235 hadoop-openstack junit & mockito dependencies should be “provided” Minor build, fs/swift Steve Loughran Ted Yu
HADOOP-12088 KMSClientProvider uses equalsIgnoreCase(“application/json”) Major kms Steve Loughran Brahma Reddy Battula
HADOOP-12051 ProtobufRpcEngine.invoke() should use Exception.toString() over getMessage in logging/span events Minor ipc Steve Loughran Varun Saxena
HADOOP-12237 releasedocmaker.py doesn’t work behind a proxy Major yetus Tsuyoshi Ozawa Tsuyoshi Ozawa
HDFS-8657 Update docs for mSNN Minor . Jesse Yates Jesse Yates
HDFS-7582 Enforce maximum number of ACL entries separately per access and default. Major namenode Vinayakumar B Vinayakumar B
HDFS-8800 hdfs –daemon stop namenode corrupts logs Major scripts John Smith John Smith
YARN-3915 scmadmin help message correction Minor yarn Bibin A Chundatt Bibin A Chundatt
MAPREDUCE-5801 Uber mode’s log message is missing a vcore reason Minor . Steven K. Wong Steven K. Wong
HADOOP-11762 Enable swift distcp to secure HDFS Major fs/swift Chen He Chen He
HDFS-8773 Few FSNamesystem metrics are not documented in the Metrics page Major documentation Rakesh R Rakesh R
YARN-3878 AsyncDispatcher can hang while stopping if it is configured for draining events on stop Critical . Varun Saxena Varun Saxena
HDFS-7728 Avoid updating quota usage while loading edits Major . Jing Zhao Jing Zhao
HADOOP-11962 Sasl message with MD5 challenge text shouldn’t be LOG out even in debug level. Critical ipc, security Junping Du Junping Du
HADOOP-12017 Hadoop archives command should use configurable replication factor when closing Major . Zhe Zhang Bibin A Chundatt
HADOOP-12239 StorageException complaining " no lease ID" when updating FolderLastModifiedTime in WASB Major fs/azure, tools Duo Xu Duo Xu
YARN-3932 SchedulerApplicationAttempt#getResourceUsageReport and UserInfo should based on total-used-resources Major resourcemanager Bibin A Chundatt Bibin A Chundatt
YARN-3954 TestYarnConfigurationFields#testCompareConfigurationClassAgainstXml fails in trunk Major . Varun Saxena Varun Saxena
YARN-2019 Retrospect on decision of making RM crashed if any exception throw in ZKRMStateStore Critical . Junping Du Jian He
HDFS-8797 WebHdfsFileSystem creates too many connections for pread Major webhdfs Jing Zhao Jing Zhao
YARN-3941 Proportional Preemption policy should try to avoid sending duplicate PREEMPT_CONTAINER event to scheduler Major capacityscheduler Sunil Govindan Sunil Govindan
YARN-3900 Protobuf layout of yarn_security_token causes errors in other protos that include it Major . Anubhav Dhoot Anubhav Dhoot
YARN-3845 Scheduler page does not render RGBA color combinations in IE11 Minor . Jagadesh Kiran N Mohammad Shahid Khan
HDFS-8806 Inconsistent metrics: number of missing blocks with replication factor 1 not properly cleared Major . Zhe Zhang Zhe Zhang
YARN-3967 Fetch the application report from the AHS if the RM does not know about it Major . Mit Desai Mit Desai
YARN-3957 FairScheduler NPE In FairSchedulerQueueInfo causing scheduler page to return 500 Major fairscheduler Anubhav Dhoot Anubhav Dhoot
YARN-3925 ContainerLogsUtils#getContainerLogFile fails to read container log files from full disks. Critical nodemanager zhihai xu zhihai xu
YARN-3973 Recent changes to application priority management break reservation system from YARN-1051 Major resourcemanager Carlo Curino Carlo Curino
YARN-3958 TestYarnConfigurationFields should be moved to hadoop-yarn-api module Major . Varun Saxena Varun Saxena
HDFS-8810 Correct assertions in TestDFSInotifyEventInputStream class. Minor test Surendra Singh Lilhore Surendra Singh Lilhore
HDFS-8785 TestDistributedFileSystem is failing in trunk Major test Arpit Agarwal Xiaoyu Yao
YARN-2194 Cgroups cease to work in RHEL7 Critical nodemanager Wei Yan Wei Yan
YARN-3846 RM Web UI queue filter is not working Major yarn Mohammad Shahid Khan Mohammad Shahid Khan
HADOOP-12245 References to misspelled REMAINING_QUATA in FileSystemShell.md Minor documentation Gera Shegalov Gabor Liptak
YARN-3982 container-executor parsing of container-executor.cfg broken in trunk and branch-2 Blocker nodemanager Varun Vasudev Varun Vasudev
HADOOP-12175 FsShell must load SpanReceiverHost to support tracing Major tracing Masatake Iwasaki Masatake Iwasaki
HDFS-8670 Better to exclude decommissioned nodes for namenode NodeUsage JMX Major . Ming Ma J.Andreina
HADOOP-10945 4-digit octal umask permissions throws a parse error Major fs Jason Lowe Chang Li
YARN-3919 NPEs’ while stopping service after exception during CommonNodeLabelsManager#start Trivial resourcemanager Varun Saxena Varun Saxena
YARN-3963 AddNodeLabel on duplicate label addition shows success Minor . Bibin A Chundatt Bibin A Chundatt
YARN-3990 AsyncDispatcher may overloaded with RMAppNodeUpdateEvent when Node is connected/disconnected Critical resourcemanager Rohith Sharma K S Bibin A Chundatt
HDFS-6860 BlockStateChange logs are too noisy Major namenode Arpit Agarwal Chang Li
HADOOP-12268 AbstractContractAppendTest#testRenameFileBeingAppended misses rename operation. Major test zhihai xu zhihai xu
HDFS-8847 change TestHDFSContractAppend to not override testRenameFileBeingAppended method. Major test zhihai xu zhihai xu
HDFS-8850 VolumeScanner thread exits with exception if there is no block pool to be scanned but there are suspicious blocks Major datanode Colin P. McCabe Colin P. McCabe
HDFS-8844 TestHDFSCLI does not cleanup the test directory Minor test Akira Ajisaka Masatake Iwasaki
HADOOP-12274 Remove direct download link from BUILDING.txt Minor documentation Caleb Severn Caleb Severn
HADOOP-12302 Fix native compilation on Windows after HADOOP-7824 Blocker . Vinayakumar B Vinayakumar B
YARN-3983 Make CapacityScheduler to easier extend application allocation logic Major . Wangda Tan Wangda Tan
HADOOP-12304 Applications using FileContext fail with the default file system configured to be wasb/s3/etc. Blocker fs Chris Nauroth Chris Nauroth
HADOOP-11932 MetricsSinkAdapter hangs when being stopped Critical . Jian He Brahma Reddy Battula
MAPREDUCE-6257 Document encrypted spills Major security Allen Wittenauer Bibin A Chundatt
HDFS-8856 Make LeaseManager#countPath O(1) Major namenode Arpit Agarwal Arpit Agarwal
HDFS-8772 Fix TestStandbyIsHot#testDatanodeRestarts which occasionally fails Major . Walter Su Walter Su
YARN-3966 Fix excessive loggings in CapacityScheduler Major . Jian He Jian He
HDFS-8866 Typo in docs: Rumtime -> Runtime Trivial documentation, webhdfs Jakob Homan Gabor Liptak
YARN-3999 RM hangs on draining events Major . Jian He Jian He
YARN-4026 FiCaSchedulerApp: ContainerAllocator should be able to choose how to order pending resource requests Major . Wangda Tan Wangda Tan
HDFS-8879 Quota by storage type usage incorrectly initialized upon namenode restart Major namenode Kihwal Lee Xiaoyu Yao
HADOOP-12258 Need translate java.nio.file.NoSuchFileException to FileNotFoundException to avoid regression Critical fs zhihai xu zhihai xu
YARN-4005 Completed container whose app is finished is not removed from NMStateStore Major . Jun Gong Jun Gong
YARN-4047 ClientRMService getApplications has high scheduler lock contention Major resourcemanager Jason Lowe Jason Lowe
YARN-3987 am container complete msg ack to NM once RM receive it Major resourcemanager sandflee sandflee
HADOOP-12322 typos in rpcmetrics.java Trivial ipc Anu Engineer Anu Engineer
HDFS-8565 Typo in dfshealth.html - “Decomissioning” Trivial . nijel nijel
MAPREDUCE-5817 Mappers get rescheduled on node transition even after all reducers are completed Major applicationmaster Sangjin Lee Sangjin Lee
HDFS-8891 HDFS concat should keep srcs order Blocker . Yong Zhang Yong Zhang
MAPREDUCE-6439 AM may fail instead of retrying if RM shuts down during the allocate call Critical . Anubhav Dhoot Anubhav Dhoot
HDFS-8845 DiskChecker should not traverse the entire tree Major . Chang Li Chang Li
HDFS-8852 HDFS architecture documentation of version 2.x is outdated about append write support Major documentation Hong Dai Thanh Ajith S
YARN-3857 Memory leak in ResourceManager with SIMPLE mode Critical resourcemanager mujunchao mujunchao
YARN-4028 AppBlock page key update and diagnostics value null on recovery Minor . Bibin A Chundatt Bibin A Chundatt
HDFS-8908 TestAppendSnapshotTruncate may fail with IOException: Failed to replace a bad datanode Minor test Tsz Wo Nicholas Sze Tsz Wo Nicholas Sze
HDFS-8867 Enable optimized block reports Major . Rushabh S Shah Daryn Sharp
HADOOP-12317 Applications fail on NM restart on some linux distro because NM container recovery declares AM container as LOST Critical . Anubhav Dhoot Anubhav Dhoot
HDFS-8863 The remaining space check in BlockPlacementPolicyDefault is flawed Critical . Kihwal Lee Kihwal Lee
HDFS-8922 Link the native_mini_dfs test library with libdl, since IBM Java requires it Major build Ayappan Ayappan
HDFS-8809 HDFS fsck reports under construction blocks as “CORRUPT” Major tools Sudhir Prakash Jing Zhao
MAPREDUCE-6357 MultipleOutputs.write() API should document that output committing is not utilized when input path is absolute Major documentation Ivan Mitic Dustin Cote
YARN-3986 getTransferredContainers in AbstractYarnScheduler should be present in YarnScheduler interface instead Major scheduler Varun Saxena Varun Saxena
HADOOP-12347 Fix mismatch parameter name in javadocs of AuthToken#setMaxInactives Trivial . Xiaoyu Yao Xiaoyu Yao
HDFS-8942 Update hyperlink to rack awareness page in HDFS Architecture documentation Trivial documentation Masatake Iwasaki Masatake Iwasaki
YARN-3896 RMNode transitioned from RUNNING to REBOOTED because its response id had not been reset synchronously Major resourcemanager Jun Gong Jun Gong
HDFS-8930 Block report lease may leak if the 2nd full block report comes when NN is still in safemode Minor . Jing Zhao Jing Zhao
HDFS-8932 NPE thrown in NameNode when try to get “TotalSyncCount” metric before editLogStream initialization Major . Surendra Singh Lilhore Surendra Singh Lilhore
HADOOP-12352 Delay in checkpointing Trash can leave trash for 2 intervals before deleting Trivial trash Casey Brotherton Casey Brotherton
HDFS-8846 Add a unit test for INotify functionality across a layout version upgrade Major namenode Zhe Zhang Zhe Zhang
HDFS-8896 DataNode object isn’t GCed when shutdown, because it has GC root in ShutdownHookManager Minor test Walter Su Walter Su
HDFS-8961 Surpress findbug warnings of o.a.h.hdfs.shortcircuit.DfsClientShmManager.EndpointShmManager in hdfs-client Major . Haohui Mai Mingliang Liu
HADOOP-12362 Set hadoop.tmp.dir and hadoop.log.dir in pom Major . Charlie Helin Charlie Helin
HDFS-8969 Clean up findbugs warnings for HDFS-8823 and HDFS-8932 Major namenode Anu Engineer Anu Engineer
HDFS-8963 Fix incorrect sign extension of xattr length in HDFS-8900 Critical . Haohui Mai Colin P. McCabe
YARN-1556 NPE getting application report with a null appId Minor client Steve Loughran Weiwei Yang
MAPREDUCE-6452 NPE when intermediate encrypt enabled for LocalRunner Major . Bibin A Chundatt zhihai xu
HDFS-8950 NameNode refresh doesn’t remove DataNodes that are no longer in the allowed list Major datanode, namenode Daniel Templeton Daniel Templeton
HADOOP-12346 Increase some default timeouts / retries for S3a connector Major fs/s3 Sean Mackrory Sean Mackrory
HADOOP-12359 hadoop fs -getmerge doc is wrong Major documentation Daniel Templeton Jagadesh Kiran N
HADOOP-10365 BufferedOutputStream in FileUtil#unpackEntries() should be closed in finally block Minor util Ted Yu Kiran Kumar M R
HDFS-8995 Flaw in registration bookeeping can make DN die on reconnect Critical . Kihwal Lee Kihwal Lee
HDFS-8388 Time and Date format need to be in sync in NameNode UI page Minor . Archana T Surendra Singh Lilhore
YARN-4073 Unused ApplicationACLsManager in ContainerManagerImpl Trivial . Naganarasimha G R Naganarasimha G R
HDFS-9003 ForkJoin thread pool leaks Major . Kihwal Lee Kihwal Lee
HDFS-8885 ByteRangeInputStream used in webhdfs does not override available() Minor webhdfs Shradha Revankar Shradha Revankar
HADOOP-10318 Incorrect reference to nodeFile in RumenToSLSConverter error message Minor . Ted Yu Wei Yan
HADOOP-12213 Interrupted exception can occur when Client#stop is called Minor . Oleg Zhurakousky Kuhu Shukla
HDFS-9009 Send metrics logs to NullAppender by default Major logging Arpit Agarwal Arpit Agarwal
HDFS-8964 When validating the edit log, do not read at or beyond the file offset that is being written Major journal-node, namenode Zhe Zhang Zhe Zhang
HDFS-8939 Test(S)WebHdfsFileContextMainOperations failing on branch-2 Major webhdfs Jakob Homan Chris Nauroth
YARN-4103 RM WebServices missing scheme for appattempts logLinks Major . Jonathan Eagles Jonathan Eagles
YARN-4105 Capacity Scheduler headroom for DRF is wrong Major capacityscheduler Chang Li Chang Li
MAPREDUCE-6442 Stack trace is missing when error occurs in client protocol provider’s constructor Major client Chang Li Chang Li
YARN-3591 Resource localization on a bad disk causes subsequent containers failure Major . Lavkesh Lahngir Lavkesh Lahngir
YARN-4121 Typos in capacity scheduler documentation. Trivial documentation Kai Sasaki Kai Sasaki
YARN-4096 App local logs are leaked if log aggregation fails to initialize for the app Major log-aggregation, nodemanager Jason Lowe Jason Lowe
HADOOP-12388 Fix components’ version information in the web page ‘About the Cluster’ Minor util Jun Gong Jun Gong
HDFS-9033 dfsadmin -metasave prints “NaN” for cache used% Major . Archana T Brahma Reddy Battula
HDFS-8716 introduce a new config specifically for safe mode block count Major . Chang Li Chang Li
HDFS-8581 ContentSummary on / skips further counts on yielding lock Minor namenode tongshiquan J.Andreina
HDFS-6763 Initialize file system-wide quota once on transitioning to active Major ha, namenode Daryn Sharp Kihwal Lee
MAPREDUCE-6474 ShuffleHandler can possibly exhaust nodemanager file descriptors Major mrv2, nodemanager Nathan Roberts Kuhu Shukla
YARN-4106 NodeLabels for NM in distributed mode is not updated even after clusterNodelabel addition in RM Major . Bibin A Chundatt Bibin A Chundatt
YARN-4115 Reduce loglevel of ContainerManagementProtocolProxy to Debug Minor . Anubhav Dhoot Anubhav Dhoot
HADOOP-12348 MetricsSystemImpl creates MetricsSourceAdapter with wrong time unit parameter. Major metrics zhihai xu zhihai xu
HDFS-9042 Update document for the Storage policy name Minor documentation J.Andreina J.Andreina
HDFS-9036 In BlockPlacementPolicyWithNodeGroup#chooseLocalStorage , random node is selected eventhough fallbackToLocalRack is true. Major . J.Andreina J.Andreina
HADOOP-12407 Test failing: hadoop.ipc.TestSaslRPC Critical security, test Steve Loughran Steve Loughran
HADOOP-12087 [JDK8] Fix javadoc errors caused by incorrect or illegal tags Major documentation Akira Ajisaka Akira Ajisaka
HDFS-9069 TestNameNodeMetricsLogger failing -port in use Critical test Steve Loughran Steve Loughran
HDFS-8996 Consolidate validateLog and scanLog in FJM#EditLogFile Major journal-node, namenode Zhe Zhang Zhe Zhang
YARN-4151 Fix findbugs errors in hadoop-yarn-server-common module Major . MENG DING MENG DING
HDFS-9067 o.a.h.hdfs.server.datanode.fsdataset.impl.TestLazyWriter is failing in trunk Critical . Haohui Mai Surendra Singh Lilhore
MAPREDUCE-6472 MapReduce AM should have java.io.tmpdir=./tmp to be consistent with tasks Major mr-am Jason Lowe Naganarasimha G R
HADOOP-12374 Description of hdfs expunge command is confusing Major documentation, trash Weiwei Yang Weiwei Yang
YARN-4078 getPendingResourceRequestForAttempt is present in AbstractYarnScheduler should be present in YarnScheduler interface instead Minor resourcemanager Naganarasimha G R Naganarasimha G R
HDFS-9072 Fix random failures in TestJMXGet Critical test J.Andreina J.Andreina
HDFS-9073 Fix failures in TestLazyPersistLockedMemory#testReleaseOnEviction Critical test J.Andreina J.Andreina
YARN-3433 Jersey tests failing with Port in Use -again Critical build, test Steve Loughran Brahma Reddy Battula
HADOOP-12417 TestWebDelegationToken failing with port in use Major test Steve Loughran Mingliang Liu
MAPREDUCE-6481 LineRecordReader may give incomplete record and wrong position/key information for uncompressed input sometimes. Critical mrv2 zhihai xu zhihai xu
MAPREDUCE-5002 AM could potentially allocate a reduce container to a map attempt Major mr-am Jason Lowe Chang Li
MAPREDUCE-5982 Task attempts that fail from the ASSIGNED state can disappear Major mr-am Jason Lowe Chang Li
HADOOP-12386 RetryPolicies.RETRY_FOREVER should be able to specify a retry interval Major . Wangda Tan Sunil Govindan
YARN-3697 FairScheduler: ContinuousSchedulingThread can fail to shutdown Critical fairscheduler zhihai xu zhihai xu
HDFS-6955 DN should reserve disk space for a full block when creating tmp files Major datanode Arpit Agarwal Kanaka Kumar Avvaru
HDFS-5802 NameNode does not check for inode type before traversing down a path Trivial namenode Harsh J Xiao Chen
MAPREDUCE-6460 TestRMContainerAllocator.testAttemptNotFoundCausesRMCommunicatorException fails Major test zhihai xu zhihai xu
YARN-4167 NPE on RMActiveServices#serviceStop when store is null Minor . Bibin A Chundatt Bibin A Chundatt
YARN-4113 RM should respect retry-interval when uses RetryPolicies.RETRY_FOREVER Critical . Wangda Tan Sunil Govindan
YARN-4188 MoveApplicationAcrossQueuesResponse should be an abstract class Minor resourcemanager Giovanni Matteo Fumarola Giovanni Matteo Fumarola
HDFS-9043 Doc updation for commands in HDFS Federation Minor documentation J.Andreina J.Andreina
HDFS-9013 Deprecate NameNodeMXBean#getNNStarted in branch2 and remove from trunk Major namenode Surendra Singh Lilhore Surendra Singh Lilhore
YARN-3975 WebAppProxyServlet should not redirect to RM page if AHS is enabled Major . Mit Desai Mit Desai
HADOOP-12438 Reset RawLocalFileSystem.useDeprecatedFileStatus in TestLocalFileSystem Trivial test Chris Nauroth Chris Nauroth
HDFS-9128 TestWebHdfsFileContextMainOperations and TestSWebHdfsFileContextMainOperations fail due to invalid HDFS path on Windows. Trivial test Chris Nauroth Chris Nauroth
YARN-4152 NM crash with NPE when LogAggregationService#stopContainer called for absent container Critical log-aggregation, nodemanager Bibin A Chundatt Bibin A Chundatt
YARN-4044 Running applications information changes such as movequeue is not published to TimeLine server Critical resourcemanager, timelineserver Sunil Govindan Sunil Govindan
HDFS-9076 Log full path instead of inodeId in DFSClient#closeAllFilesBeingWritten() Major hdfs-client Surendra Singh Lilhore Surendra Singh Lilhore
MAPREDUCE-6484 Yarn Client uses local address instead of RM address as token renewer in a secure cluster when RM HA is enabled. Major client, security zhihai xu zhihai xu
HADOOP-12437 Allow SecurityUtil to lookup alternate hostnames Major net, security Arpit Agarwal Arpit Agarwal
HADOOP-12252 LocalDirAllocator should not throw NPE with empty string configuration. Minor fs zhihai xu zhihai xu
YARN-3624 ApplicationHistoryServer reverses the order of the filters it gets Major timelineserver Mit Desai Mit Desai
HDFS-9123 Copying from the root to a subdirectory should be forbidden Minor fs Wei-Chiu Chuang Wei-Chiu Chuang
MAPREDUCE-6480 archive-logs tool may miss applications Major . Robert Kanter Robert Kanter
HDFS-9107 Prevent NN’s unrecoverable death spiral after full GC Critical namenode Daryn Sharp Daryn Sharp
HDFS-9133 ExternalBlockReader and ReplicaAccessor need to return -1 on read when at EOF Major hdfs-client Colin P. McCabe Colin P. McCabe
HDFS-9080 update htrace version to 4.0.1 Major tracing Colin P. McCabe Colin P. McCabe
YARN-4204 ConcurrentModificationException in FairSchedulerQueueInfo Major . Anubhav Dhoot Anubhav Dhoot
HDFS-9106 Transfer failure during pipeline recovery causes permanent write failures Critical . Kihwal Lee Kihwal Lee
HDFS-9147 Fix the setting of visibleLength in ExternalBlockReader Major hdfs-client Colin P. McCabe Colin P. McCabe
MAPREDUCE-6492 AsyncDispatcher exit with NPE on TaskAttemptImpl#sendJHStartEventForAssignedFailTask Critical . Bibin A Chundatt Bibin A Chundatt
HADOOP-12440 TestRPC#testRPCServerShutdown did not produce the desired thread states before shutting down Minor . Xiao Chen Xiao Chen
HDFS-9092 Nfs silently drops overlapping write requests and causes data copying to fail Major nfs Yongjun Zhang Yongjun Zhang
YARN-4180 AMLauncher does not retry on failures when talking to NM Critical resourcemanager Anubhav Dhoot Anubhav Dhoot
HDFS-9141 Thread leak in Datanode#refreshVolumes Major datanode Uma Maheswara Rao G Uma Maheswara Rao G
YARN-4066 Large number of queues choke fair scheduler Major fairscheduler Johan Gustavsson Johan Gustavsson
HADOOP-12447 Clean up some htrace integration issues Major tracing Colin P. McCabe Colin P. McCabe
HDFS-9174 Fix findbugs warnings in FSOutputSummer.tracer and DirectoryScanner$ReportCompiler.currentThread Critical . Yi Liu Yi Liu
HDFS-9001 DFSUtil.getNsServiceRpcUris() can return too many entries in a non-HA, non-federated cluster Major . Daniel Templeton Daniel Templeton
HADOOP-12448 TestTextCommand: use mkdirs rather than mkdir to create test directory Major test Colin P. McCabe Colin P. McCabe
MAPREDUCE-6494 Permission issue when running archive-logs tool as different users Major . Robert Kanter Robert Kanter
MAPREDUCE-6497 Fix wrong value of JOB_FINISHED event in JobHistoryEventHandler Major . Shinichi Yamashita Shinichi Yamashita
HADOOP-10296 Incorrect null check in SwiftRestClient#buildException() Minor . Ted Yu Kanaka Kumar Avvaru
HADOOP-8437 getLocalPathForWrite should throw IOException for invalid paths Major fs Brahma Reddy Battula Brahma Reddy Battula
MAPREDUCE-6485 MR job hanged forever because all resources are taken up by reducers and the last map attempt never get resource to run Critical applicationmaster Bob.zhao Xianyin Xin
HDFS-9185 Fix null tracer in ErasureCodingWorker Critical erasure-coding Rakesh R Rakesh R
HDFS-9191 Typo in Hdfs.java. NoSuchElementException is misspelled Trivial documentation Catherine Palmer Catherine Palmer
HDFS-9100 HDFS Balancer does not respect dfs.client.use.datanode.hostname Major balancer & mover Yongjun Zhang Casey Brotherton
YARN-3619 ContainerMetrics unregisters during getMetrics and leads to ConcurrentModificationException Major nodemanager Jason Lowe zhihai xu
HDFS-9193 Fix incorrect references the usages of the DN in dfshealth.js Minor . Chang Li Chang Li
HADOOP-11098 [JDK8] Max Non Heap Memory default changed between JDK7 and 8 Major . Travis Thompson Tsuyoshi Ozawa
HADOOP-12441 Fix kill command behavior under some Linux distributions. Critical . Wangda Tan Wangda Tan
HADOOP-12452 Fix tracing documention reflecting the update to htrace-4 Major documentation Masatake Iwasaki Masatake Iwasaki
YARN-4176 Resync NM nodelabels with RM periodically for distributed nodelabels Major . Bibin A Chundatt Bibin A Chundatt
HDFS-7899 Improve EOF error message Minor hdfs-client Harsh J Jagadesh Kiran N
MAPREDUCE-6503 archive-logs tool should use HADOOP_PREFIX instead of HADOOP_HOME Major . Robert Kanter Robert Kanter
YARN-4209 RMStateStore FENCED state doesn’t work due to updateFencedState called by stateMachine.doTransition Critical resourcemanager zhihai xu zhihai xu
HDFS-9196 Fix TestWebHdfsContentLength Major . Tsuyoshi Ozawa Masatake Iwasaki
HDFS-9178 Slow datanode I/O can cause a wrong node to be marked bad Critical . Kihwal Lee Kihwal Lee
HDFS-9182 Cleanup the findbugs and other issues after HDFS EC merged to trunk. Critical erasure-coding Yi Liu Uma Maheswara Rao G
HADOOP-12465 Incorrect javadoc in WritableUtils.java Minor documentation Martin Petricek Jagadesh Kiran N
HDFS-9176 TestDirectoryScanner#testThrottling often fails. Minor test Yi Liu Daniel Templeton
HDFS-9137 DeadLock between DataNode#refreshVolumes and BPOfferService#registrationSucceeded Major datanode Uma Maheswara Rao G Uma Maheswara Rao G
HDFS-8164 cTime is 0 in VERSION file for newly formatted NameNode. Minor namenode Chris Nauroth Xiao Chen
HDFS-9204 DatanodeDescriptor#PendingReplicationWithoutTargets is wrongly calculated Major . Jing Zhao Mingliang Liu
HDFS-9217 Fix broken findbugsExcludeFile.xml for hadoop-hdfs-client module Critical build Mingliang Liu Mingliang Liu
YARN-4235 FairScheduler PrimaryGroup does not handle empty groups returned for a user Major fairscheduler Anubhav Dhoot Anubhav Dhoot
MAPREDUCE-6302 Preempt reducers after a configurable timeout irrespective of headroom Critical . mai shurong Karthik Kambatla
HDFS-9142 Separating Configuration object for namenode(s) in MiniDFSCluster Major . Siqi Li Siqi Li
HDFS-8941 DistributedFileSystem listCorruptFileBlocks API should resolve relative path Major hdfs-client Rakesh R Rakesh R
HDFS-9222 Add hadoop-hdfs-client as a dependency of hadoop-hdfs-native-client Major . Haohui Mai Mingliang Liu
YARN-4201 AMBlacklist does not work for minicluster Major resourcemanager Jun Gong Jun Gong
HDFS-9215 Suppress the RAT warnings in hdfs-native-client module Minor . Haohui Mai Haohui Mai
HDFS-9224 TestFileTruncate fails intermittently with BindException Major test Brahma Reddy Battula Brahma Reddy Battula
YARN-4017 container-executor overuses PATH_MAX Major nodemanager Allen Wittenauer Sidharta Seethana
HDFS-8676 Delayed rolling upgrade finalization can cause heartbeat expiration and write failures Critical . Kihwal Lee Walter Su
HADOOP-12474 MiniKMS should use random ports for Jetty server by default Major . Mingliang Liu Mingliang Liu
HADOOP-12449 TestDNS and TestNetUtils failing if no network Minor test Steve Loughran Steve Loughran
HADOOP-11515 Upgrade jsch lib to jsch-0.1.51 to avoid problems running on java7 Major build Johannes Zillmann Tsuyoshi Ozawa
HDFS-9235 hdfs-native-client build getting errors when built with cmake 2.6 Minor hdfs-client Eric Payne Eric Payne
HDFS-8779 WebUI fails to display block IDs that are larger than 2^53 - 1 Minor webhdfs Walter Su Haohui Mai
HDFS-9187 Fix null pointer error in Globber when FS was not constructed via FileSystem#createFileSystem Major tracing stack Colin P. McCabe
HDFS-1172 Blocks in newly completed files are considered under-replicated too quickly Major namenode Todd Lipcon Masatake Iwasaki
YARN-4250 NPE in AppSchedulingInfo#isRequestLabelChanged Major resourcemanager, scheduler Brahma Reddy Battula Brahma Reddy Battula
HADOOP-12364 Deleting pid file after stop is causing the daemons to keep restarting Minor . Siqi Li Siqi Li
HADOOP-12478 Shell.getWinUtilsPath() has been renamed Shell.getWinutilsPath() Critical util Steve Loughran Steve Loughran
HDFS-9220 Reading small file (< 512 bytes) that is open for append fails due to incorrect checksum Blocker . Bogdan Raducanu Jing Zhao
HADOOP-12479 ProtocMojo does not log the reason for a protoc compilation failure. Minor build Chris Nauroth Chris Nauroth
HADOOP-11628 SPNEGO auth does not work with CNAMEs in JDK8 Blocker security Daryn Sharp Daryn Sharp
YARN-2597 MiniYARNCluster should propagate reason for AHS not starting Major test Steve Loughran Steve Loughran
YARN-4155 TestLogAggregationService.testLogAggregationServiceWithInterval failing Critical test Steve Loughran Bibin A Chundatt
HADOOP-10941 Proxy user verification NPEs if remote host is unresolvable Critical ipc, security Daryn Sharp Benoy Antony
HADOOP-12483 Maintain wrapped SASL ordering for postponed IPC responses Critical ipc Daryn Sharp Daryn Sharp
HDFS-9237 NPE at TestDataNodeVolumeFailureToleration#tearDown Major test Brahma Reddy Battula Brahma Reddy Battula
HADOOP-12464 Interrupted client may try to fail-over and retry Major ipc Kihwal Lee Kihwal Lee
HADOOP-12493 bash unit tests are failing Major . Allen Wittenauer Allen Wittenauer
YARN-4270 Limit application resource reservation on nodes for non-node/rack specific requests Major fairscheduler Arun Suresh Arun Suresh
HDFS-9208 Disabling atime may fail clients like distCp Major . Kihwal Lee Kihwal Lee
HDFS-9270 TestShortCircuitLocalRead should not leave socket after unit test Minor test Masatake Iwasaki Masatake Iwasaki
HADOOP-12418 TestRPC.testRPCInterruptedSimple fails intermittently Major test Steve Loughran Kihwal Lee
MAPREDUCE-6495 Docs for archive-logs tool Major documentation Robert Kanter Robert Kanter
HDFS-3059 ssl-server.xml causes NullPointer Minor datanode, security Evert Lammerts Xiao Chen
HDFS-9274 Default value of dfs.datanode.directoryscan.throttle.limit.ms.per.sec should be consistent Trivial datanode Yi Liu Yi Liu
MAPREDUCE-6518 Set SO_KEEPALIVE on shuffle connections Major mrv2, nodemanager Nathan Roberts Chang Li
HDFS-9225 Fix intermittent test failure of TestBlockManager.testBlocksAreNotUnderreplicatedInSingleRack Minor test Masatake Iwasaki Masatake Iwasaki
HDFS-9273 ACLs on root directory may be lost after NN restart Critical namenode Xiao Chen Xiao Chen
YARN-4000 RM crashes with NPE if leaf queue becomes parent queue during restart Major capacityscheduler, resourcemanager Jason Lowe Varun Saxena
HADOOP-9692 Improving log message when SequenceFile reader throws EOFException on zero-length file Major . Chu Tong Zhe Zhang
YARN-4256 YARN fair scheduler vcores with decimal values Minor fairscheduler Prabhu Joseph Jun Gong
HADOOP-12484 Single File Rename Throws Incorrectly In Potential Race Condition Scenarios Major tools Gaurav Kanade Gaurav Kanade
HDFS-9286 HttpFs does not parse ACL syntax correctly for operation REMOVEACLENTRIES Major fs Wei-Chiu Chuang Wei-Chiu Chuang
YARN-4009 CORS support for ResourceManager REST API Major . Prakash Ramachandran Varun Vasudev
YARN-4041 Slow delegation token renewal can severely prolong RM recovery Major resourcemanager Jason Lowe Sunil Govindan
HDFS-9290 DFSClient#callAppend() is not backward compatible for slightly older NameNodes Blocker . Tony Wu Tony Wu
HDFS-9301 HDFS clients can’t construct HdfsConfiguration instances Major . Steve Loughran Mingliang Liu
YARN-4294 [JDK8] Fix javadoc errors caused by wrong reference and illegal tag Blocker build, documentation Akira Ajisaka Akira Ajisaka
YARN-4289 TestDistributedShell failing with bind exception Major test Brahma Reddy Battula Brahma Reddy Battula
YARN-4296 DistributedShell Log.info is not friendly Major applications/distributed-shell Xiaowei Wang Xiaowei Wang
YARN-4246 NPE while listing app attempt Major . Varun Saxena nijel
YARN-4223 Findbugs warnings in hadoop-yarn-server-nodemanager project Minor nodemanager Varun Saxena Varun Saxena
HADOOP-12513 Dockerfile lacks initial ‘apt-get update’ Trivial build Akihiro Suda Akihiro Suda
YARN-4284 condition for AM blacklisting is too narrow Major resourcemanager Sangjin Lee Sangjin Lee
HDFS-9268 fuse_dfs chown crashes when uid is passed as -1 Minor . Wei-Chiu Chuang Colin P. McCabe
HDFS-9284 fsck command should not print exception trace when file not found Major . Jagadesh Kiran N Jagadesh Kiran N
HDFS-9305 Delayed heartbeat processing causes storm of subsequent heartbeats Major datanode Chris Nauroth Arpit Agarwal
YARN-4169 Fix racing condition of TestNodeStatusUpdaterForLabels Critical test Steve Loughran Naganarasimha G R
YARN-4300 [JDK8] Fix javadoc errors caused by wrong tags Blocker build, documentation Akira Ajisaka Akira Ajisaka
HADOOP-12515 Mockito dependency is missing in hadoop-kafka module Major test Kai Zheng Kai Zheng
YARN-4302 SLS not able start due to NPE in SchedulerApplicationAttempt#getResourceUsageReport Major . Bibin A Chundatt Bibin A Chundatt
HADOOP-12178 NPE during handling of SASL setup if problem with SASL resolver class Minor ipc Steve Loughran Steve Loughran
HADOOP-12494 fetchdt stores the token based on token kind instead of token service Major . Heesoo Kim Heesoo Kim
HADOOP-11685 StorageException complaining " no lease ID" during HBase distributed log splitting Major tools Duo Xu Duo Xu
HDFS-9231 fsck doesn’t list correct file path when Bad Replicas/Blocks are in a snapshot Major snapshots Xiao Chen Xiao Chen
HDFS-9302 WebHDFS truncate throws NullPointerException if newLength is not provided Minor webhdfs Karthik Palaniappan Jagadesh Kiran N
YARN-4251 TestAMRMClientOnRMRestart#testAMRMClientOnAMRMTokenRollOverOnRMRestart is failing Major test Brahma Reddy Battula Brahma Reddy Battula
HADOOP-12519 hadoop-azure tests should avoid creating a metrics configuration file in the module root directory. Minor fs/azure, test Chris Nauroth Chris Nauroth
HDFS-9279 Decomissioned capacity should not be considered for configured/used capacity Major . Kuhu Shukla Kuhu Shukla
HDFS-9044 Give Priority to FavouredNodes , before selecting nodes from FavouredNode’s Node Group Major . J.Andreina J.Andreina
YARN-4130 Duplicate declaration of ApplicationId in RMAppManager#submitApplication method Trivial resourcemanager Kai Sasaki Kai Sasaki
YARN-4288 NodeManager restart should keep retrying to register to RM while connection exception happens during RM failed over. Critical nodemanager Junping Du Junping Du
MAPREDUCE-6515 Update Application priority in AM side from AM-RM heartbeat Major applicationmaster Sunil Govindan Sunil Govindan
HDFS-9332 Fix Precondition failures from NameNodeEditLogRoller while saving namespace Major . Andrew Wang Andrew Wang
YARN-4313 Race condition in MiniMRYarnCluster when getting history server address Major . Jian He Jian He
YARN-4320 TestJobHistoryEventHandler fails as AHS in MiniYarnCluster no longer binds to default port 8188 Major . Varun Saxena Varun Saxena
MAPREDUCE-6528 Memory leak for HistoryFileManager.getJobSummary() Critical jobhistoryserver Junping Du Junping Du
MAPREDUCE-6451 DistCp has incorrect chunkFilePath for multiple jobs when strategy is dynamic Major distcp Kuhu Shukla Kuhu Shukla
MAPREDUCE-6525 Fix test failure of TestMiniMRClientCluster.testRestart Minor test Masatake Iwasaki Masatake Iwasaki
HADOOP-12533 Introduce FileNotFoundException in WASB for read and seek API Major tools Dushyanth Dushyanth
HADOOP-12508 delete fails with exception when lease is held on blob Blocker fs/azure Gaurav Kanade Gaurav Kanade
HDFS-9329 TestBootstrapStandby#testRateThrottling is flaky because fsimage size is smaller than IO buffer size Minor test Zhe Zhang Zhe Zhang
HDFS-9313 Possible NullPointerException in BlockManager if no excess replica can be chosen Major . Ming Ma Ming Ma
HADOOP-12542 TestDNS fails on Windows after HADOOP-12437. Major net Chris Nauroth Chris Nauroth
YARN-4326 Fix TestDistributedShell timeout as AHS in MiniYarnCluster no longer binds to default port 8188 Major . MENG DING MENG DING
HDFS-9289 Make DataStreamer#block thread safe and verify genStamp in commitBlock Critical . Chang Li Chang Li
YARN-4127 RM fail with noAuth error if switched from failover mode to non-failover mode Major resourcemanager Jian He Varun Saxena
HDFS-9351 checkNNStartup() need to be called when fsck calls FSNamesystem.getSnapshottableDirs() Major namenode Yongjun Zhang Xiao Chen
HADOOP-12296 when setnetgrent returns 0 in linux, exception should be thrown Major . Chang Li Chang Li
HDFS-9357 NN UI renders icons of decommissioned DN incorrectly Critical . Archana T Surendra Singh Lilhore
HADOOP-12540 TestAzureFileSystemInstrumentation#testClientErrorMetrics fails intermittently due to assumption that a lease error will be thrown. Major fs/azure, test Chris Nauroth Gaurav Kanade
HDFS-9360 Storage type usage isn’t updated properly after file deletion Major . Ming Ma Ming Ma
HDFS-9378 hadoop-hdfs-client tests do not write logs. Minor test Chris Nauroth Chris Nauroth
HDFS-4937 ReplicationMonitor can infinite-loop in BlockPlacementPolicyDefault#chooseRandom() Major namenode Kihwal Lee Kihwal Lee
HDFS-9372 Remove dead code in DataStorage.recoverTransitionRead Major datanode Duo Zhang Duo Zhang
MAPREDUCE-3914 Mismatched free() / delete / delete [] in HadoopPipes Major pipes Charles Earl Joe Mudd
MAPREDUCE-1125 SerialUtils.cc: deserializeFloat is out of sync with SerialUtils.hh Major pipes Simone Leo Simone Leo
HDFS-9384 TestWebHdfsContentLength intermittently hangs and fails due to TCP conversation mismatch between client and server. Minor test Chris Nauroth Chris Nauroth
HDFS-6481 DatanodeManager#getDatanodeStorageInfos() should check the length of storageIDs Minor namenode Ted Yu Tsz Wo Nicholas Sze
HDFS-9318 considerLoad factor can be improved Major . Kuhu Shukla Kuhu Shukla
HDFS-9236 Missing sanity check for block size during block recovery Major datanode Tony Wu Tony Wu
HDFS-9394 branch-2 hadoop-hdfs-client fails during FileSystem ServiceLoader initialization, because HftpFileSystem is missing. Critical hdfs-client Chris Nauroth Mingliang Liu
HADOOP-12553 [JDK8] Fix javadoc error caused by illegal tag Blocker build, documentation Akira Ajisaka Akira Ajisaka
MAPREDUCE-5763 Warn message about httpshuffle in NM logs Major . Sandy Ryza Akira Ajisaka
HDFS-9383 TestByteArrayManager#testByteArrayManager fails Major . Kihwal Lee Tsz Wo Nicholas Sze
HDFS-9249 NPE is thrown if an IOException is thrown in NameNode constructor Minor namenode Wei-Chiu Chuang Wei-Chiu Chuang
HDFS-2261 AOP unit tests are not getting compiled or run Minor test Giridharan Kesavan Haohui Mai
HDFS-9401 Fix findbugs warnings in BlockRecoveryWorker Major . Brahma Reddy Battula Brahma Reddy Battula
HADOOP-12482 Race condition in JMX cache update Major . Tony Wu Tony Wu
HDFS-9364 Unnecessary DNS resolution attempts when creating NameNodeProxies Major ha, performance Xiao Chen Xiao Chen
HADOOP-12560 Fix sprintf warnings in {{DomainSocket.c}} introduced by HADOOP-12344 Major native Colin P. McCabe Mingliang Liu
HDFS-9245 Fix findbugs warnings in hdfs-nfs/WriteCtx Major nfs Mingliang Liu Mingliang Liu
YARN-4241 Fix typo of property name in yarn-default.xml Major documentation Anthony Rojas Anthony Rojas
MAPREDUCE-6533 testDetermineCacheVisibilities of TestClientDistributedCacheManager is broken Major . Chang Li Chang Li
HDFS-9396 Total files and directories on jmx and web UI on standby is uninitialized Blocker . Kihwal Lee Kihwal Lee
MAPREDUCE-6540 TestMRTimelineEventHandling fails Major test Sangjin Lee Sangjin Lee
YARN-4347 Resource manager fails with Null pointer exception Major yarn Yesha Vora Jian He
HADOOP-12545 Hadoop javadoc has broken links for AccessControlList, ImpersonationProvider, DefaultImpersonationProvider, and DistCp Major documentation Mohammad Arshad Mohammad Arshad
YARN-4354 Public resource localization fails with NPE Blocker nodemanager Jason Lowe Jason Lowe
HDFS-9413 getContentSummary() on standby should throw StandbyException Critical . Brahma Reddy Battula Brahma Reddy Battula
HDFS-9358 TestNodeCount#testNodeCount timed out Major test Wei-Chiu Chuang Masatake Iwasaki
HDFS-9397 Fix typo for readChecksum() LOG.warn in BlockSender.java Trivial . Enrique Flores Enrique Flores
HDFS-9400 TestRollingUpgradeRollback fails on branch-2. Blocker . Chris Nauroth Brahma Reddy Battula
HDFS-9431 DistributedFileSystem#concat fails if the target path is relative. Major hdfs-client Kazuho Fujii Kazuho Fujii
YARN-2859 ApplicationHistoryServer binds to default port 8188 in MiniYARNCluster Critical timelineserver Hitesh Shah Vinod Kumar Vavilapalli
YARN-4374 RM capacity scheduler UI rounds user limit factor Major capacityscheduler Chang Li Chang Li
YARN-3769 Consider user limit when calculating total pending resource for preemption policy in Capacity Scheduler Major capacityscheduler Eric Payne Eric Payne
HDFS-9443 Disabling HDFS client socket cache causes logging message printed to console for CLI commands. Trivial hdfs-client Chris Nauroth Chris Nauroth
HADOOP-11218 Add TLSv1.1,TLSv1.2 to KMS, HttpFS, SSLFactory Critical kms Robert Kanter Vijay Singh
HADOOP-12467 Respect user-defined JAVA_LIBRARY_PATH in Windows Hadoop scripts Minor scripts Radhey Shah Radhey Shah
HADOOP-12181 Fix intermittent test failure of TestZKSignerSecretProvider Minor . Masatake Iwasaki Masatake Iwasaki
HDFS-6885 Fix wrong use of BytesWritable in FSEditLogOp#RenameOp Minor namenode Yi Liu Yi Liu
HADOOP-12098 Remove redundant test dependencies in Hadoop Archives Minor . Varun Saxena Varun Saxena
HDFS-7897 Shutdown metrics when stopping JournalNode Major . zhouyingchao zhouyingchao
HADOOP-11149 Increase the timeout of TestZKFailoverController Major test Rajat Jain Steve Loughran
HADOOP-11677 Add cookie flags for logs and static contexts Major . nijel nijel
HDFS-9356 Decommissioning node does not have Last Contact value in the UI Major . Archana T Surendra Singh Lilhore
HADOOP-12313 NPE in JvmPauseMonitor when calling stop() before start() Critical . Rohith Sharma K S Gabor Liptak
HDFS-9428 Fix intermittent failure of TestDNFencing.testQueueingWithAppend Minor test Masatake Iwasaki Masatake Iwasaki
HDFS-9435 TestBlockRecovery#testRBWReplicas is failing intermittently Major . Rakesh R Rakesh R
HADOOP-12577 Bump up commons-collections version to 3.2.2 to address a security flaw Blocker build, security Wei-Chiu Chuang Wei-Chiu Chuang
YARN-4344 NMs reconnecting with changed capabilities can lead to wrong cluster resource calculations Critical resourcemanager Varun Vasudev Varun Vasudev
HADOOP-9822 create constant MAX_CAPACITY in RetryCache rather than hard-coding 16 in RetryCache constructor Minor . Tsuyoshi Ozawa Tsuyoshi Ozawa
HDFS-9423 Fix intermittent failure of TestEditLogTailer Minor test Masatake Iwasaki Masatake Iwasaki
YARN-4298 Fix findbugs warnings in hadoop-yarn-common Minor . Varun Saxena Sunil Govindan
YARN-4387 Fix typo in FairScheduler log message Minor fairscheduler Xin Wang Xin Wang
HDFS-6101 TestReplaceDatanodeOnFailure fails occasionally Major test Arpit Agarwal Wei-Chiu Chuang
HDFS-8855 Webhdfs client leaks active NameNode connections Major webhdfs Bob Hansen Xiaobing Zhou
HDFS-8335 FSNamesystem should construct FSPermissionChecker only if permission is enabled Major . David Bryson Gabor Liptak
MAPREDUCE-5883 “Total megabyte-seconds” in job counters is slightly misleading Minor . Nathan Roberts Nathan Roberts
YARN-4365 FileSystemNodeLabelStore should check for root dir existence on startup Major resourcemanager Jason Lowe Kuhu Shukla
HDFS-8807 dfs.datanode.data.dir does not handle spaces between storageType and URI correctly Major datanode Anu Engineer Anu Engineer
HADOOP-12415 hdfs and nfs builds broken on -missing compile-time dependency on netty Major nfs Konstantin Boudnik Tom Zeng
MAPREDUCE-6553 Replace ‘\u2b05’ with ‘<-’ in rendering job configuration Minor jobhistoryserver Akira Ajisaka Gabor Liptak
MAPREDUCE-6555 TestMRAppMaster fails on trunk Major . Varun Saxena Junping Du
HADOOP-12598 add XML namespace declarations for some hadoop/tools modules Minor build, tools Xin Wang Xin Wang
YARN-4380 TestResourceLocalizationService.testDownloadingResourcesOnContainerKill fails intermittently Major test Tsuyoshi Ozawa Varun Saxena
MAPREDUCE-6557 Some tests in mapreduce-client-app are writing outside of target Blocker build Allen Wittenauer Akira Ajisaka
HDFS-9459 hadoop-hdfs-native-client fails test build on Windows after transition to ctest. Blocker build, test Chris Nauroth Chris Nauroth
HDFS-9451 Clean up depreated umasks and related unit tests Major . Wei-Chiu Chuang Wei-Chiu Chuang
HDFS-9407 TestFileTruncate fails with BindException Major test Brahma Reddy Battula Brahma Reddy Battula
HDFS-9467 Fix data race accessing writeLockHeldTimeStamp in FSNamesystem Major namenode Mingliang Liu Mingliang Liu
MAPREDUCE-6549 multibyte delimiters with LineRecordReader cause duplicate records Major mrv1, mrv2 Dustin Cote Wilfred Spiegelenburg
MAPREDUCE-6550 archive-logs tool changes log ownership to the Yarn user when using DefaultContainerExecutor Major . Robert Kanter Robert Kanter
HADOOP-12468 Partial group resolution failure should not result in user lockout Minor security Wei-Chiu Chuang Wei-Chiu Chuang
HDFS-9426 Rollingupgrade finalization is not backward compatible Blocker . Kihwal Lee Kihwal Lee
HADOOP-10406 TestIPC.testIpcWithReaderQueuing may fail Major ipc Tsz Wo Nicholas Sze Xiao Chen
HDFS-9470 Encryption zone on root not loaded from fsimage after NN restart Critical . Xiao Chen Xiao Chen
HDFS-9336 deleteSnapshot throws NPE when snapshotname is null Major . Brahma Reddy Battula Brahma Reddy Battula
HADOOP-12609 Fix intermittent failure of TestDecayRpcScheduler Minor ipc, test Masatake Iwasaki Masatake Iwasaki
HDFS-6533 TestBPOfferService#testBasicFunctionalitytest fails intermittently Major datanode, hdfs-client Yongjun Zhang Wei-Chiu Chuang
YARN-4398 Yarn recover functionality causes the cluster running slowly and the cluster usage rate is far below 100 Major resourcemanager NING DING NING DING
HDFS-9294 DFSClient deadlock when close file and failed to renew lease Blocker hdfs-client DENG FEI Brahma Reddy Battula
HADOOP-12565 Replace DSA with RSA for SSH key type in SingleCluster.md Minor documentation Alexander Veit Mingliang Liu
YARN-4408 NodeManager still reports negative running containers Major nodemanager Robert Kanter Robert Kanter
HDFS-9430 Remove waitForLoadingFSImage since checkNNStartup has ensured image loaded and namenode started. Major . Brahma Reddy Battula Brahma Reddy Battula
YARN-4392 ApplicationCreatedEvent event time resets after RM restart/failover Critical . Xuan Gong Naganarasimha G R
YARN-4422 Generic AHS sometimes doesn’t show started, node, or logs on App page Major . Eric Payne Eric Payne
YARN-4424 Fix deadlock in RMAppImpl Blocker . Yesha Vora Jian He
HADOOP-12617 SPNEGO authentication request to non-default realm gets default realm name inserted in target server principal Major security Matt Foley Matt Foley
YARN-4431 Not necessary to do unRegisterNM() if NM get stop due to failed to connect to RM Major nodemanager Junping Du Junping Du
YARN-4421 Remove dead code in RmAppImpl.RMAppRecoveredTransition Trivial resourcemanager Daniel Templeton Daniel Templeton
HADOOP-12618 NPE in TestSequenceFile Major test Brahma Reddy Battula Brahma Reddy Battula
YARN-4434 NodeManager Disk Checker parameter documentation is not correct Minor documentation, nodemanager Takashi Ohnishi Weiwei Yang
HADOOP-12602 TestMetricsSystemImpl#testQSize occasionally fail Major test Wei-Chiu Chuang Masatake Iwasaki
HDFS-9519 Some coding improvement in SecondaryNameNode#main Major namenode Yongjun Zhang Xiao Chen
HDFS-9514 TestDistributedFileSystem.testDFSClientPeerWriteTimeout failing; exception being swallowed Major hdfs-client, test Steve Loughran Wei-Chiu Chuang
HDFS-9535 Newly completed blocks in IBR should not be considered under-replicated too quickly Major namenode Jing Zhao Mingliang Liu
YARN-4418 AM Resource Limit per partition can be updated to ResourceUsage as well Major resourcemanager Sunil Govindan Sunil Govindan
HADOOP-12638 UnsatisfiedLinkError while checking ISA-L in checknative command. Minor native Kai Sasaki Kai Sasaki
YARN-4403 (AM/NM/Container)LivelinessMonitor should use monotonic time when calculating period Critical . Junping Du Junping Du
YARN-4402 TestNodeManagerShutdown And TestNodeManagerResync fails with bind exception Major test Brahma Reddy Battula Brahma Reddy Battula
YARN-4439 Clarify NMContainerStatus#toString method. Major . Jian He Jian He
YARN-4440 FSAppAttempt#getAllowedLocalityLevelByTime should init the lastScheduler time Major fairscheduler Yiqun Lin Yiqun Lin
HDFS-9516 truncate file fails with data dirs on multiple disks Major datanode Bogdan Raducanu Plamen Jeliazkov
HDFS-8894 Set SO_KEEPALIVE on DN server sockets Major datanode Nathan Roberts Kanaka Kumar Avvaru
HADOOP-12192 update releasedocmaker commands Blocker . Allen Wittenauer Allen Wittenauer
YARN-4461 Redundant nodeLocalityDelay log in LeafQueue Trivial capacityscheduler Jason Lowe Eric Payne
YARN-4452 NPE when submit Unmanaged application Critical . Naganarasimha G R Naganarasimha G R
HDFS-9570 Minor typos, grammar, and case sensitivity cleanup in HdfsPermissionsGuide.md’s Trivial documentation Travis Campbell Travis Campbell
HDFS-9565 TestDistributedFileSystem.testLocatedFileStatusStorageIdsTypes is flaky due to race condition Minor fs, test Wei-Chiu Chuang Wei-Chiu Chuang
YARN-4225 Add preemption status to yarn queue -status for capacity scheduler Minor capacity scheduler, yarn Eric Payne Eric Payne
HADOOP-12615 Fix NPE in MiniKMS.start() Minor kms, test Wei-Chiu Chuang Wei-Chiu Chuang
HDFS-9515 NPE when MiniDFSCluster#shutdown is invoked on uninitialized reference Minor . Wei-Chiu Chuang Wei-Chiu Chuang
HDFS-9572 Prevent DataNode log spam if a client connects on the data transfer port but sends no data. Major datanode Chris Nauroth Chris Nauroth
HDFS-9533 seen_txid in the shared edits directory is modified during bootstrapping Major ha, namenode Kihwal Lee Kihwal Lee
HDFS-9571 Fix ASF Licence warnings in Jenkins reports Major test Brahma Reddy Battula Brahma Reddy Battula
HDFS-9393 After choosing favored nodes, choosing nodes for remaining replicas should go through BlockPlacementPolicy Major . J.Andreina J.Andreina
HADOOP-12647 Add /usr/lib default for ISAL library and fix missing .c file in CMakeLists Major . Kai Zheng Kai Zheng
HDFS-9347 Invariant assumption in TestQuorumJournalManager.shutdown() is wrong Major test Wei-Chiu Chuang Wei-Chiu Chuang
HADOOP-12656 MiniKdc throws “address in use” BindException Major . Wei-Chiu Chuang Wei-Chiu Chuang
HADOOP-12636 Prevent ServiceLoader failure init for unused FileSystems Major fs Íñigo Goiri Íñigo Goiri
MAPREDUCE-6583 Clarify confusing sentence in MapReduce tutorial document Minor documentation chris snow Kai Sasaki
HDFS-9505 HDFS Architecture documentation needs to be refreshed. Major documentation Chris Nauroth Masatake Iwasaki
YARN-4454 NM to nodelabel mapping going wrong after RM restart Critical . Bibin A Chundatt Bibin A Chundatt
HDFS-9580 TestComputeInvalidateWork#testDatanodeReRegistration failed due to unexpected number of invalidate blocks. Major datanode, namenode, test Wei-Chiu Chuang Wei-Chiu Chuang
YARN-4477 FairScheduler: Handle condition which can result in an infinite loop in attemptScheduling. Major fairscheduler Tao Jie Tao Jie
HDFS-9589 Block files which have been hardlinked should be duplicated before the DataNode appends to the them Major datanode Colin P. McCabe Colin P. McCabe
HDFS-9458 TestBackupNode always binds to port 50070, which can cause bind failures. Major test Chris Nauroth Xiao Chen
YARN-4109 Exception on RM scheduler page loading with labels Minor . Bibin A Chundatt Mohammad Shahid Khan
YARN-4156 TestAMRestart#testAMBlacklistPreventsRestartOnSameNode assumes CapacityScheduler Major . Anubhav Dhoot Anubhav Dhoot
MAPREDUCE-6419 JobHistoryServer doesn’t sort properly based on Job ID when Job id’s exceed 9999 Major webapps Devaraj K Mohammad Shahid Khan
HDFS-9597 BaseReplicationPolicyTest should update data node stats after adding a data node Minor datanode, test Wei-Chiu Chuang Wei-Chiu Chuang
HDFS-7163 WebHdfsFileSystem should retry reads according to the configured retry policy. Major webhdfs Eric Payne Eric Payne
HADOOP-12559 KMS connection failures should trigger TGT renewal Major security Zhe Zhang Zhe Zhang
MAPREDUCE-6574 MR AM should print host of failed tasks. Major . Wangda Tan Mohammad Shahid Khan
YARN-4417 Make RM and Timeline-server REST APIs more consistent Major . Wangda Tan Wangda Tan
MAPREDUCE-6589 TestTaskLog outputs a log under directory other than target/test-dir Major test Akira Ajisaka Akira Ajisaka
YARN-4315 NaN in Queue percentage for cluster apps page Minor . Bibin A Chundatt Bibin A Chundatt
HDFS-9376 TestSeveralNameNodes fails occasionally Major test Kihwal Lee Masatake Iwasaki
YARN-1382 Remove unusableRMNodesConcurrentSet (never used) in NodeListManager to get rid of memory leak Major resourcemanager Alejandro Abdelnur Rohith Sharma K S
HADOOP-12682 Fix TestKMS#testKMSRestart* failure Major . Wei-Chiu Chuang Wei-Chiu Chuang
HADOOP-12608 Fix exception message in WASB when connecting with anonymous credential Major tools Dushyanth Dushyanth
YARN-4524 Cleanup AppSchedulingInfo Major scheduler Karthik Kambatla Karthik Kambatla
YARN-4522 Queue acl can be checked at app submission Major . Jian He Jian He
YARN-4510 Fix SLS startup failure caused by NPE Critical . Bibin A Chundatt Bibin A Chundatt
YARN-4530 LocalizedResource trigger a NPE Cause the NodeManager exit Major . tangshangwen tangshangwen
MAPREDUCE-6593 TestJobHistoryEventHandler.testTimelineEventHandling fails on trunk because of NPE Major . Tsuyoshi Ozawa Naganarasimha G R
HDFS-9445 Datanode may deadlock while handling a bad volume Blocker . Kihwal Lee Walter Su
HADOOP-12658 Clear javadoc and check style issues around DomainSocket Trivial . Kai Zheng Kai Zheng
HADOOP-12604 Exception may be swallowed in KMSClientProvider Major kms Yongjun Zhang Yongjun Zhang
HDFS-9605 Add links to failed volumes to explorer.html in HDFS Web UI Minor . Archana T Archana T
MAPREDUCE-6577 MR AM unable to load native library without MR_AM_ADMIN_USER_ENV set Critical mr-am Sangjin Lee Sangjin Lee
HADOOP-12689 S3 filesystem operations stopped working correctly Major tools Matthew Paduano Matthew Paduano
YARN-4546 ResourceManager crash due to scheduling opportunity overflow Critical resourcemanager Jason Lowe Jason Lowe
HDFS-9615 Fix variable name typo in DFSConfigKeys Trivial . Ray Chiang Ray Chiang
HADOOP-12634 Change Lazy Rename Pending Operation Completion of WASB to address case of potential data loss due to partial copy Critical . Gaurav Kanade Gaurav Kanade
HDFS-9600 do not check replication if the block is under construction Critical . Phil Yang Phil Yang
HDFS-9619 SimulatedFSDataset sometimes can not find blockpool for the correct namenode Major datanode, test Wei-Chiu Chuang Wei-Chiu Chuang
HADOOP-12675 Fix description about retention period in usage of expunge command Minor documentation Masatake Iwasaki Masatake Iwasaki
HADOOP-12655 TestHttpServer.testBindAddress bind port range is wider than expected Major . Wei-Chiu Chuang Wei-Chiu Chuang
HADOOP-12613 TestFind.processArguments occasionally fails Major test Wei-Chiu Chuang Wei-Chiu Chuang
HADOOP-12573 TestRPC.testClientBackOff failing Major test Steve Loughran Xiao Chen
MAPREDUCE-6508 TestNetworkedJob fails consistently due to delegation token changes on RM. Major test Rohith Sharma K S Akira Ajisaka
HDFS-9574 Reduce client failures during datanode restart Major . Kihwal Lee Kihwal Lee
HDFS-9493 Test o.a.h.hdfs.server.namenode.TestMetaSave fails in trunk Major test Mingliang Liu Tony Wu
HADOOP-12678 Handle empty rename pending metadata file during atomic rename in redo path Critical fs/azure madhumita chakraborty madhumita chakraborty
HADOOP-12590 TestCompressorDecompressor failing without stack traces Critical test Steve Loughran John Zhuge
HADOOP-12587 Hadoop AuthToken refuses to work without a maxinactive attribute in issued token Blocker security Steve Loughran Benoy Antony
HADOOP-12551 Introduce FileNotFoundException for WASB FileSystem API Major tools Dushyanth Dushyanth
MAPREDUCE-6068 Illegal progress value warnings in map tasks Major mrv2, task Todd Lipcon Binglin Chang
HDFS-9639 Inconsistent Logging in BootstrapStandby Minor ha BELUGA BEHR Xiaobing Zhou
HDFS-9584 NPE in distcp when ssl configuration file does not exist in class path. Major distcp Surendra Singh Lilhore Surendra Singh Lilhore
HADOOP-12584 Disable browsing the static directory in HttpServer2 Major security Robert Kanter Robert Kanter
YARN-4567 javadoc failing on java 8 Blocker build Steve Loughran Steve Loughran
YARN-4414 Nodemanager connection errors are retried at multiple levels Major nodemanager Jason Lowe Chang Li
HADOOP-12653 Use SO_REUSEADDR to avoid getting “Address already in use” when using kerberos and attempting to bind to any port on the local IP address Major net Colin P. McCabe Colin P. McCabe
HADOOP-12603 TestSymlinkLocalFSFileContext#testSetTimesSymlinkToDir occasionally fail Major test Wei-Chiu Chuang Wei-Chiu Chuang
YARN-4571 Make app id/name available to the yarn authorizer provider for better auditing Major . Jian He Jian He
YARN-4551 Address the duplication between StatusUpdateWhenHealthy and StatusUpdateWhenUnhealthy transitions Minor nodemanager Karthik Kambatla Sunil Govindan
HDFS-9517 Fix missing @Test annotation on TestDistCpUtils.testUnpackAttributes Trivial distcp Wei-Chiu Chuang Wei-Chiu Chuang
YARN-4534 Remove the redundant symbol in yarn rmadmin help msg Trivial . Yiqun Lin Yiqun Lin
HADOOP-12700 Remove unused import in TestCompressorDecompressor.java Minor . John Zhuge John Zhuge
MAPREDUCE-6601 Fix typo in Job#setUseNewAPI Trivial . Kai Sasaki Kai Sasaki
YARN-3446 FairScheduler headroom calculation should exclude nodes in the blacklist Major fairscheduler zhihai xu zhihai xu
HDFS-9648 TestStartup.testImageChecksum is broken by HDFS-9569’s message change Trivial namenode Wei-Chiu Chuang Wei-Chiu Chuang
HADOOP-12706 TestLocalFsFCStatistics#testStatisticsThreadLocalDataCleanUp times out occasionally Major test Jason Lowe Sangjin Lee
YARN-4581 AHS writer thread leak makes RM crash while RM is recovering Major resourcemanager sandflee sandflee
MAPREDUCE-6554 MRAppMaster servicestart failing with NPE in MRAppMaster#parsePreviousJobHistory Critical . Bibin A Chundatt Bibin A Chundatt
YARN-4389 “yarn.am.blacklisting.enabled” and “yarn.am.blacklisting.disable-failure-threshold” should be app specific rather than a setting for whole YARN cluster Critical applications Junping Du Sunil Govindan
HDFS-9612 DistCp worker threads are not terminated after jobs are done. Major distcp Wei-Chiu Chuang Wei-Chiu Chuang
HDFS-9624 DataNode start slowly due to the initial DU command operations Major . Yiqun Lin Yiqun Lin
HADOOP-12712 Fix some cmake plugin and native build warnings Minor native Colin P. McCabe Colin P. McCabe
HADOOP-12714 Fix hadoop-mapreduce-client-nativetask unit test which fails because it is not able to open the “glibc bug spill” file. Major native Colin P. McCabe Colin P. McCabe
YARN-4538 QueueMetrics pending cores and memory metrics wrong Major . Bibin A Chundatt Bibin A Chundatt
YARN-4596 SystemMetricPublisher should not swallow error messages from TimelineClient#putEntities Major timelineserver Li Lu Li Lu
YARN-4502 Fix two AM containers get allocated when AM restart Critical . Yesha Vora Vinod Kumar Vavilapalli
HDFS-9623 Update example configuration of block state change log in log4j.properties Minor logging Masatake Iwasaki Masatake Iwasaki
YARN-4565 When sizeBasedWeight enabled for FairOrderingPolicy in CapacityScheduler, Sometimes lead to situation where all queue resources consumed by AMs only Major capacity scheduler, capacityscheduler Karam Singh Wangda Tan
HADOOP-12356 Fix computing CPU usage statistics on Windows Major util Yunqi Zhang Íñigo Goiri
HDFS-9661 Deadlock in DN.FsDatasetImpl between moveBlockAcrossStorage and createRbw Major datanode ade ade
HDFS-9655 NN should start JVM pause monitor before loading fsimage Critical . John Zhuge John Zhuge
YARN-4559 Make leader elector and zk store share the same curator client Major . Jian He Jian He
YARN-4611 Fix scheduler load simulator to support multi-layer network location Major . Ming Ma Ming Ma
HADOOP-12605 Fix intermittent failure of TestIPC.testIpcWithReaderQueuing Minor test Masatake Iwasaki Masatake Iwasaki
HDFS-9625 set replication for empty file failed when set storage policy Major namenode DENG FEI DENG FEI
HADOOP-12423 Handle failure of registering shutdownhook by ShutdownHookManager in static block Minor fs Abhishek Agarwal Abhishek Agarwal
HDFS-9634 webhdfs client side exceptions don’t provide enough details Major webhdfs Eric Payne Eric Payne
YARN-4608 Redundant code statement in WritingYarnApplications Minor documentation Kai Sasaki Kai Sasaki
HADOOP-7161 Remove unnecessary oro package from dependency management section Minor build Todd Lipcon Sean Busbey
YARN-4610 Reservations continue looking for one app causes other apps to starve Blocker capacityscheduler Jason Lowe Jason Lowe
HADOOP-12659 Incorrect usage of config parameters in token manager of KMS Major security Tianyin Xu Mingliang Liu
YARN-4584 RM startup failure when AM attempts greater than max-attempts Critical . Bibin A Chundatt Bibin A Chundatt
HDFS-9618 Fix mismatch between log level and guard in BlockManager#computeRecoveryWorkForBlocks Minor namenode Masatake Iwasaki Masatake Iwasaki
MAPREDUCE-6605 Fix typos mapreduce.map.skip.proc.count.autoincr and mapreduce.reduce.skip.proc.count.autoincr in mapred-default.xml Major documentation Dong Zhen Kai Sasaki
YARN-4605 Spelling mistake in the help message of “yarn applicationattempt” command Trivial client Manjunath Ballur Weiwei Yang
HDFS-9682 Fix a typo “aplication” in HttpFS document Trivial documentation Weiwei Yang Weiwei Yang
HADOOP-12730 Hadoop streaming -mapper and -reducer options are wrongly documented as required Major documentation DeepakVohra Kengo Seki
YARN-4497 RM might fail to restart when recovering apps whose attempts are missing Critical . Jun Gong Jun Gong
HDFS-8898 Create API and command-line argument to get quota and quota usage without detailed content summary Major fs Joep Rottinghuis Ming Ma
YARN-4598 Invalid event: RESOURCE_FAILED at CONTAINER_CLEANEDUP_AFTER_KILL Major nodemanager tangshangwen tangshangwen
YARN-4592 Remove unused GetContainerStatus proto Minor . Chang Li Chang Li
YARN-4520 FinishAppEvent is leaked in leveldb if no app’s container running on this node Major nodemanager sandflee sandflee
MAPREDUCE-6610 JobHistoryEventHandler should not swallow timeline response Trivial . Li Lu Li Lu
HDFS-9690 ClientProtocol.addBlock is not idempotent after HDFS-8071 Major namenode Tsz Wo Nicholas Sze Tsz Wo Nicholas Sze
HADOOP-12743 Fix git environment check during test-patch Major . Ray Chiang Allen Wittenauer
YARN-4612 Fix rumen and scheduler load simulator handle killed tasks properly Major . Ming Ma Ming Ma
HADOOP-12492 maven install triggers bats test Major build Allen Wittenauer Allen Wittenauer
HADOOP-12735 core-default.xml misspells hadoop.workaround.non.threadsafe.getpwuid Minor . Ray Chiang Ray Chiang
HDFS-8999 Allow a file to be closed with COMMITTED but not yet COMPLETE blocks. Major namenode Jitendra Nath Pandey Tsz Wo Nicholas Sze
MAPREDUCE-6595 Fix findbugs warnings in OutputCommitter and FileOutputCommitter Major . Akira Ajisaka Akira Ajisaka
MAPREDUCE-6563 Streaming documentation contains a stray ‘%’ character. Trivial documentation Chris Nauroth Chris Nauroth
YARN-4519 potential deadlock of CapacityScheduler between decrease container and assign containers Major capacityscheduler sandflee MENG DING
MAPREDUCE-6616 Fail to create jobhistory file if there are some multibyte characters in the job name Major jobhistoryserver Akira Ajisaka Kousuke Saruta
YARN-4411 RMAppAttemptImpl#createApplicationAttemptReport throws IllegalArgumentException Major resourcemanager yarntime Bibin A Chundatt
YARN-4617 LeafQueue#pendingOrderingPolicy should always use fixed ordering policy instead of using same as active applications ordering policy Major capacity scheduler Rohith Sharma K S Rohith Sharma K S
YARN-4428 Redirect RM page to AHS page when AHS turned on and RM page is not available Major . Chang Li Chang Li
HDFS-9659 EditLogTailerThread to Active Namenode RPC should timeout Critical ha, namenode Surendra Singh Lilhore Surendra Singh Lilhore
MAPREDUCE-6618 YarnClientProtocolProvider leaking the YarnClient thread. Major . Xuan Gong Xuan Gong
HDFS-9210 Fix some misuse of %n in VolumeScanner#printStats Minor datanode Xiaoyu Yao Xiaoyu Yao
HDFS-9701 DN may deadlock when hot-swapping under load Major . Xiao Chen Xiao Chen
YARN-3102 Decommisioned Nodes not listed in Web UI Minor resourcemanager Bibin A Chundatt Kuhu Shukla
HDFS-9406 FSImage may get corrupted after deleting snapshot Major namenode Stanislav Antic Yongjun Zhang
HDFS-9718 HAUtil#getConfForOtherNodes should unset independent generic keys before initialize Major namenode DENG FEI DENG FEI
HDFS-9708 FSNamesystem.initAuditLoggers() doesn’t trim classnames Minor fs Steve Loughran Mingliang Liu
HADOOP-12757 Findbug compilation fails for ‘Kafka Library support’ Major . Rohith Sharma K S Akira Ajisaka
MAPREDUCE-6621 Memory Leak in JobClient#submitJobInternal() Major . Xuan Gong Xuan Gong
HADOOP-12755 Fix typo in defaultFS warning message Trivial . Andrew Wang Andrew Wang
MAPREDUCE-6620 Jobs that did not start are shown as starting in 1969 in the JHS web UI Major jobhistoryserver Daniel Templeton Haibo Chen
HDFS-9739 DatanodeStorage.isValidStorageId() is broken Critical hdfs-client Kihwal Lee Mingliang Liu
HDFS-9740 Use a reasonable limit in DFSTestUtil.waitForMetric() Major test Kihwal Lee Chang Li
YARN-4625 Make ApplicationSubmissionContext and ApplicationSubmissionContextInfo more consistent Major . Xuan Gong Xuan Gong
HADOOP-12761 incremental maven build is not really incremental Minor build Sangjin Lee Sangjin Lee
YARN-4594 container-executor fails to remove directory tree when chmod required Major nodemanager Colin P. McCabe Colin P. McCabe
HDFS-9748 When addExpectedReplicasToPending is called twice, pendingReplications should avoid duplication Minor . Walter Su Walter Su
YARN-4669 Fix logging statements in resource manager’s Application class Trivial . Sidharta Seethana Sidharta Seethana
HDFS-9730 Storage ID update does not happen when there is a layout change Major datanode Kihwal Lee Tsz Wo Nicholas Sze
HDFS-9724 Degraded performance in WebHDFS listing as it does not reuse ObjectMapper Critical performance Akira Ajisaka Akira Ajisaka
HADOOP-12766 The default value of “hadoop.workaround.non.threadsafe.getpwuid” is different between core-default.xml and NativeIO.java Minor . Akira Ajisaka Akira Ajisaka
HDFS-9761 Rebalancer sleeps too long between iterations Blocker balancer & mover Adrian Bridgett Mingliang Liu
HDFS-9713 DataXceiver#copyBlock should return if block is pinned Major datanode Uma Maheswara Rao G Uma Maheswara Rao G
HADOOP-12773 HBase classes fail to load with client/job classloader enabled Major util Sangjin Lee Sangjin Lee
HDFS-9777 Fix typos in DFSAdmin command line and documentation Trivial hdfs-client Wei-Chiu Chuang Wei-Chiu Chuang
HDFS-9784 Example usage is not correct in Transparent Encryption document Major documentation Takashi Ohnishi Takashi Ohnishi
HDFS-9752 Permanent write failures may happen to slow writers during datanode rolling upgrades Critical . Kihwal Lee Walter Su
HDFS-9760 WebHDFS AuthFilter cannot be configured with custom AltKerberos auth handler Major webhdfs Ryan Sasson Ryan Sasson
HDFS-9779 TestReplicationPolicyWithNodeGroup NODE variable picks wrong rack value Minor test Kuhu Shukla Kuhu Shukla
YARN-4629 Distributed shell breaks under strong security Major applications/distributed-shell, security Daniel Templeton Daniel Templeton
HADOOP-12792 TestUserGroupInformation#testGetServerSideGroups fails in chroot Minor security, test Eric Badger Eric Badger
HDFS-9788 Incompatible tag renumbering in HeartbeatResponseProto Blocker rolling upgrades Andrew Wang Andrew Wang
HADOOP-12795 KMS does not log detailed stack trace for unexpected errors. Major kms Chris Nauroth Chris Nauroth
HADOOP-12699 TestKMS#testKMSProvider intermittently fails during ‘test rollover draining’ Major . Xiao Chen Xiao Chen
HDFS-9790 HDFS Balancer should exit with a proper message if upgrade is not finalized Major . Xiaobing Zhou Xiaobing Zhou
HDFS-9801 ReconfigurableBase should update the cached configuration Major datanode Arpit Agarwal Arpit Agarwal
HADOOP-12780 During WASB atomic rename handle crash when one directory has been renamed but not file under it. Critical fs/azure madhumita chakraborty madhumita chakraborty
HADOOP-12589 Fix intermittent test failure of TestCopyPreserveFlag Major test Tsuyoshi Ozawa Masatake Iwasaki
HADOOP-12786 “hadoop key” command usage is not documented Major documentation Akira Ajisaka Xiao Chen
HDFS-9765 TestBlockScanner#testVolumeIteratorWithCaching fails intermittently Major test Mingliang Liu Akira Ajisaka
HDFS-9456 BlockPlacementPolicyWithNodeGroup should override verifyBlockPlacement Major . Junping Du Xiaobing Zhou
HADOOP-12810 FileSystem#listLocatedStatus causes unnecessary RPC calls Major fs, fs/s3 Ryan Blue Ryan Blue
HDFS-9787 SNNs stop uploading FSImage to ANN once isPrimaryCheckPointer changed to false. Major ha Guocui Mi Guocui Mi
MAPREDUCE-6341 Fix typo in mapreduce tutorial Trivial . John Michael Luy John Michael Luy
HADOOP-12787 KMS SPNEGO sequence does not work with WEBHDFS Major kms, security Xiaoyu Yao Xiaoyu Yao
HDFS-9815 Move o.a.h.fs.Hdfs to hadoop-hdfs-client Blocker . Haohui Mai Vinayakumar B
HDFS-9608 Disk IO imbalance in HDFS with heterogeneous storages Major . Wei Zhou Wei Zhou
HDFS-9799 Reimplement getCurrentTrashDir to remove incompatibility Blocker . Zhe Zhang Zhe Zhang
YARN-4689 FairScheduler: Cleanup preemptContainer to be more readable Trivial fairscheduler Karthik Kambatla Kai Sasaki
YARN-4654 Yarn node label CLI should parse “=” correctly when trying to remove all labels on a node Major . Wangda Tan Naganarasimha G R
HDFS-6832 Fix the usage of ‘hdfs namenode’ command Minor . Akira Ajisaka Manjunath Ballur
HDFS-8923 Add -source flag to balancer usage message Trivial balancer & mover, documentation Chris Trezzo Chris Trezzo
HDFS-9764 DistCp doesn’t print value for several arguments including -numListstatusThreads Minor distcp Yongjun Zhang Wei-Chiu Chuang
MAPREDUCE-6637 Testcase Failure : TestFileInputFormat.testSplitLocationInfo Major test Brahma Reddy Battula Brahma Reddy Battula
HDFS-9839 Reduce verbosity of processReport logging Major namenode Arpit Agarwal Arpit Agarwal
HDFS-7452 skip StandbyException log for getCorruptFiles() Minor . Brahma Reddy Battula Brahma Reddy Battula
YARN-4707 Remove the extra char (>) from SecureContainer.md Major documentation Brahma Reddy Battula Brahma Reddy Battula
YARN-4386 refreshNodesGracefully() should send recommission event to active RMNodes only Minor graceful Kuhu Shukla Kuhu Shukla
HDFS-9842 dfs.datanode.balance.bandwidthPerSec should accept friendly size units Minor balancer & mover Yiqun Lin Yiqun Lin
YARN-4709 NMWebServices produces incorrect JSON for containers Critical . Varun Saxena Varun Saxena
MAPREDUCE-6635 Unsafe long to int conversion in UncompressedSplitLineReader and IndexOutOfBoundsException Critical . Sergey Shelukhin Junping Du
YARN-4651 movetoqueue option does not documented in ‘YARN Commands’ Major documentation Takashi Ohnishi Takashi Ohnishi
YARN-4648 Move preemption related tests from TestFairScheduler to TestFairSchedulerPreemption Major fairscheduler Karthik Kambatla Kai Sasaki
HDFS-9549 TestCacheDirectives#testExceedsCapacity is flaky Major . Wei-Chiu Chuang Xiao Chen
YARN-2046 Out of band heartbeats are sent only on container kill and possibly too early Major nodemanager Jason Lowe Ming Ma
HDFS-9844 Correct path creation in getTrashRoot to handle root dir Blocker encryption Zhe Zhang Zhe Zhang
YARN-4722 AsyncDispatcher logs redundant event queue sizes Major . Jason Lowe Jason Lowe
HADOOP-12070 Some of the bin/hadoop subcommands are not available on Windows Major scripts Kengo Seki Kengo Seki
HADOOP-12716 KerberosAuthenticator#doSpnegoSequence use incorrect class to determine isKeyTab in JDK8 Major security Xiaoyu Yao Xiaoyu Yao
YARN-4729 SchedulerApplicationAttempt#getTotalRequiredResources can throw an NPE Major scheduler Karthik Kambatla Karthik Kambatla
YARN-4701 When task logs are not available, port 8041 is referenced instead of port 8042 Major yarn Haibo Chen Haibo Chen
HDFS-9858 RollingFileSystemSink can throw an NPE on non-secure clusters Major . Daniel Templeton Daniel Templeton
YARN-4723 NodesListManager$UnknownNodeId ClassCastException Critical resourcemanager Jason Lowe Kuhu Shukla
HADOOP-12849 TestSymlinkLocalFSFileSystem fails intermittently Major test Mingliang Liu Mingliang Liu
HADOOP-12831 LocalFS/FSOutputSummer NPEs in constructor if bytes per checksum set to 0 Minor fs Steve Loughran Mingliang Liu
HADOOP-12846 Credential Provider Recursive Dependencies Major . Larry McCay Larry McCay
HDFS-9864 Correct reference for RENEWDELEGATIONTOKEN and CANCELDELEGATIONTOKEN in webhdfs doc Major documentation Brahma Reddy Battula Brahma Reddy Battula
YARN-4731 container-executor should not follow symlinks in recursive_unlink_children Blocker . Bibin A Chundatt Colin P. McCabe
HADOOP-12622 RetryPolicies (other than FailoverOnNetworkExceptionRetry) should put on retry failed reason or the log from RMProxy’s retry could be very misleading. Critical auto-failover Junping Du Junping Du
YARN-4748 ApplicationHistoryManagerOnTimelineStore should not swallow exceptions on generateApplicationReport Major timelineserver Li Lu Li Lu
HADOOP-10321 TestCompositeService should cover all enumerations of adding a service to a parent service Major . Karthik Kambatla Ray Chiang
HADOOP-12851 S3AFileSystem Uptake of ProviderUtils.excludeIncompatibleCredentialProviders Major fs/s3 Larry McCay Larry McCay
HDFS-9870 Remove unused imports from DFSUtil Major . Brahma Reddy Battula Brahma Reddy Battula
HDFS-8791 block ID-based DN storage layout can be very slow for datanode on ext4 Blocker datanode Nathan Roberts Chris Trezzo
HDFS-9880 TestDatanodeRegistration fails occasionally Major test Kihwal Lee Kihwal Lee
HDFS-9881 DistributedFileSystem#getTrashRoot returns incorrect path for encryption zones Critical . Andrew Wang Andrew Wang
HDFS-9766 TestDataNodeMetrics#testDataNodeTimeSpend fails intermittently Major test Mingliang Liu Xiao Chen
HDFS-9851 Name node throws NPE when setPermission is called on a path that does not exist Critical namenode David Yan Brahma Reddy Battula
HDFS-9886 Configuration properties for hedged read is broken Blocker . Akira Ajisaka Akira Ajisaka
HADOOP-12870 Fix typo admininistration in CommandsManual.md Minor documentation Akira Ajisaka John Zhuge
HDFS-9048 DistCp documentation is out-of-dated Major . Haohui Mai Daisuke Kobayashi
HADOOP-12871 Fix dead link to NativeLibraries.html in CommandsManual.md Minor documentation Akira Ajisaka Brahma Reddy Battula
HADOOP-12872 Fix formatting in ServiceLevelAuth.md Trivial documentation Akira Ajisaka Brahma Reddy Battula
MAPREDUCE-4785 TestMRApp occasionally fails Major mrv2, test Jason Lowe Haibo Chen
HADOOP-12717 NPE when trying to rename a directory in Windows Azure Storage FileSystem Blocker . Robert Yokota Robert Yokota
YARN-4763 RMApps Page crashes with NPE Major webapp Bibin A Chundatt Bibin A Chundatt
YARN-4761 NMs reconnecting with changed capabilities can lead to wrong cluster resource calculations on fair scheduler Major fairscheduler Sangjin Lee Sangjin Lee
YARN-4737 Add CSRF filter support in YARN Major nodemanager, resourcemanager, webapp Jonathan Maron Jonathan Maron
YARN-4744 Too many signal to container failure in case of LCE Major . Bibin A Chundatt Sidharta Seethana
YARN-4760 proxy redirect to history server uses wrong URL Major webapp Jason Lowe Eric Badger
HDFS-9865 TestBlockReplacement fails intermittently in trunk Major test Yiqun Lin Yiqun Lin
YARN-4762 NMs failing on DelegatingLinuxContainerRuntime init with LCE on Blocker . Vinod Kumar Vavilapalli Sidharta Seethana
HDFS-9812 Streamer threads leak if failure happens when closing DFSOutputStream Major hdfs-client Yiqun Lin Yiqun Lin
HDFS-9919 TestStandbyCheckpoints#testNonPrimarySBNUploadFSImage waitForCheckpoint incorrectly Minor test Yiqun Lin Yiqun Lin
YARN-4764 Application submission fails when submitted queue is not available in scheduler xml Major . Bibin A Chundatt Bibin A Chundatt
HADOOP-12895 SSLFactory#createSSLSocketFactory exception message is wrong Trivial . Wei-Chiu Chuang Wei-Chiu Chuang
HADOOP-12688 Fix deadlinks in Compatibility.md Major documentation Akira Ajisaka Gabor Liptak
HADOOP-12903 IPC Server should allow suppressing exception logging by type, not log ‘server too busy’ messages Major ipc Arpit Agarwal Arpit Agarwal
HADOOP-12906 AuthenticatedURL should convert a 404/Not Found into an FileNotFoundException. Minor io, security Steve Loughran Steve Loughran
HDFS-9934 ReverseXML oiv processor should bail out if the XML file’s layoutVersion doesn’t match oiv’s Major tools Colin P. McCabe Colin P. McCabe
HDFS-9933 ReverseXML should be capitalized in oiv usage message Minor tools Colin P. McCabe Colin P. McCabe
HADOOP-12899 External distribution stitching scripts do not work correctly on Windows. Blocker build Chris Nauroth Chris Nauroth
HDFS-9953 Download File from UI broken after pagination Blocker namenode Brahma Reddy Battula Brahma Reddy Battula
HDFS-9947 Block#toString should not output information from derived classes Minor . Colin P. McCabe Colin P. McCabe
YARN-4816 SystemClock API broken in 2.9.0 Major . Siddharth Seth Siddharth Seth
HDFS-9904 testCheckpointCancellationDuringUpload occasionally fails Major test Kihwal Lee Yiqun Lin
MAPREDUCE-6579 JobStatus#getFailureInfo should not output diagnostic information when the job is running Blocker test Rohith Sharma K S Akira Ajisaka
HDFS-9780 RollingFileSystemSink doesn’t work on secure clusters Critical . Daniel Templeton Daniel Templeton
HADOOP-12888 Shell to disable bash and setsid support when running under JVM security manager Major security Costin Leau Costin Leau
YARN-4593 Deadlock in AbstractService.getConfig() Major yarn Steve Loughran Steve Loughran
HDFS-10173 Typo in DataXceiverServer Trivial datanode Michael Han Michael Han
MAPREDUCE-6645 TestWordStats outputs logs under directories other than target/test-dir Major test Akira Ajisaka Gabor Liptak
YARN-4812 TestFairScheduler#testContinuousScheduling fails intermittently Major fairscheduler Karthik Kambatla Karthik Kambatla
HDFS-9874 Long living DataXceiver threads cause volume shutdown to block. Critical datanode Rushabh S Shah Rushabh S Shah
HDFS-3677 dfs.namenode.edits.dir.required missing from hdfs-default.xml Major documentation, namenode Todd Lipcon Mark Yang
HADOOP-12626 Intel ISA-L libraries should be added to the Dockerfile Blocker io Allen Wittenauer Kai Zheng
HDFS-7166 SbNN Web UI shows #Under replicated blocks and #pending deletion blocks Major ha Juan Yu Wei-Chiu Chuang
YARN-4686 MiniYARNCluster.start() returns before cluster is completely started Major test Rohith Sharma K S Eric Badger
MAPREDUCE-6363 [NNBench] Lease mismatch error when running with multiple mappers Critical benchmarks Brahma Reddy Battula Bibin A Chundatt
MAPREDUCE-6110 JobHistoryServer CLI throws NullPointerException with job ids that do not exist Minor jobhistoryserver Li Lu Kai Sasaki
HDFS-10189 PacketResponder#toString should include the downstreams for PacketResponderType.HAS_DOWNSTREAM_IN_PIPELINE Minor datanode Joe Pallas Joe Pallas
MAPREDUCE-6580 Test failure : TestMRJobsWithProfiler Major . Rohith Sharma K S Eric Badger
MAPREDUCE-6656 [NNBench] OP_DELETE operation isn’t working after MAPREDUCE-6363 Blocker . J.Andreina J.Andreina
HDFS-10193 fuse_dfs segfaults if uid cannot be resolved to a username Major fuse-dfs John Thiltges John Thiltges
YARN-4820 ResourceManager web redirects in HA mode drops query parameters Major . Varun Vasudev Varun Vasudev
YARN-4850 test-fair-scheduler.xml isn’t valid xml Blocker fairscheduler, test Allen Wittenauer Yufei Gu
MAPREDUCE-6535 TaskID default constructor results in NPE on toString() Major mrv2 Daniel Templeton Daniel Templeton
HADOOP-12962 KMS key names are incorrectly encoded when creating key Major . Xiao Chen Xiao Chen
HADOOP-12958 PhantomReference for filesystem statistics can trigger OOM Major . Jason Lowe Sangjin Lee
HADOOP-12873 Remove MRv1 terms from HttpAuthentication.md Major documentation Akira Ajisaka Brahma Reddy Battula
HDFS-10182 Hedged read might overwrite user’s buf Major . zhouyingchao zhouyingchao
MAPREDUCE-6655 Fix a typo (STRICT_IE6) in Encrypted Shuffle Trivial documentation Wei-Chiu Chuang Wei-Chiu Chuang
HADOOP-12954 Add a way to change hadoop.security.token.service.use_ip Major security Robert Kanter Robert Kanter
YARN-4773 Log aggregation performs extraneous filesystem operations when rolling log aggregation is disabled Minor nodemanager Jason Lowe Jun Gong
MAPREDUCE-6662 Clear ASF Warnings on test data files Minor . Vinayakumar B Vinayakumar B
HDFS-9871 “Bytes Being Moved” -ve(-1 B) when cluster was already balanced. Major . Brahma Reddy Battula Brahma Reddy Battula
YARN-4863 AHS Security login should be in serviceInit() instead of serviceStart() Major timelineserver Junping Du Junping Du
HDFS-10197 TestFsDatasetCache failing intermittently due to timeout Major test Yiqun Lin Yiqun Lin
HDFS-9478 Reason for failing ipc.FairCallQueue contruction should be thrown Minor . Archana T Ajith S
HDFS-10228 TestHDFSCLI fails Major test Akira Ajisaka Akira Ajisaka
YARN-4865 Track Reserved resources in ResourceUsage and QueueCapacities Major resourcemanager Sunil Govindan Sunil Govindan
HADOOP-12972 Lz4Compressor#getLibraryName returns the wrong version number Trivial native John Zhuge Colin P. McCabe
HDFS-5177 blocksScheduled count should be decremented for abandoned blocks Major namenode Vinayakumar B Vinayakumar B
HDFS-10223 peerFromSocketAndKey performs SASL exchange before setting connection timeouts Major . Colin P. McCabe Colin P. McCabe
HDFS-10221 Add .json to the rat exclusions Blocker build Ming Ma Ming Ma
HADOOP-12902 JavaDocs for SignerSecretProvider are out-of-date in AuthenticationFilter Major documentation Robert Kanter Gabor Liptak
YARN-4183 Clarify the behavior of timeline service config properties Major . Mit Desai Naganarasimha G R
HADOOP-12955 Fix bugs in the initialization of the ISA-L library JNI bindings Major native Kai Zheng Kai Zheng
YARN-4657 Javadoc comment is broken for Resources.multiplyByAndAddTo() Trivial . Daniel Templeton Daniel Templeton
HDFS-10253 Fix TestRefreshCallQueue failure. Major . Brahma Reddy Battula Xiaoyu Yao
YARN-4746 yarn web services should convert parse failures of appId, appAttemptId and containerId to 400 Minor webapp Steve Loughran Bibin A Chundatt
HDFS-9599 TestDecommissioningStatus.testDecommissionStatus occasionally fails Major namenode Wei-Chiu Chuang Yiqun Lin
YARN-4706 UI Hosting Configuration in TimelineServer doc is broken Critical documentation Akira Ajisaka Akira Ajisaka
HDFS-10178 Permanent write failures can happen if pipeline recoveries occur for the first packet Critical . Kihwal Lee Kihwal Lee
HDFS-8496 Calling stopWriter() with FSDatasetImpl lock held may block other threads Major . zhouyingchao Colin P. McCabe
HDFS-9917 IBR accumulate more objects when SNN was down for sometime. Critical . Brahma Reddy Battula Brahma Reddy Battula
YARN-4880 Running TestZKRMStateStorePerf with real zookeeper cluster throws NPE Major . Rohith Sharma K S Sunil Govindan
YARN-4609 RM Nodes list page takes too much time to load Major webapp Bibin A Chundatt Bibin A Chundatt
HDFS-10239 Fsshell mv fails if port usage doesn’t match in src and destination paths Major . Kuhu Shukla Kuhu Shukla
YARN-4893 Fix some intermittent test failures in TestRMAdminService Blocker . Junping Du Brahma Reddy Battula
YARN-4916 TestNMProxy.tesNMProxyRPCRetry fails. Minor . Tibor Kiss Tibor Kiss
YARN-4915 Fix typo in YARN Secure Containers documentation Trivial documentation, yarn Takashi Ohnishi Takashi Ohnishi
YARN-4917 Fix typos in documentation of Capacity Scheduler. Minor documentation Takashi Ohnishi Takashi Ohnishi
HDFS-10261 TestBookKeeperHACheckpoints doesn’t handle ephemeral HTTP ports Major . Eric Badger Eric Badger
YARN-4699 Scheduler UI and REST o/p is not in sync when -replaceLabelsOnNode is used to change label of a node Critical capacity scheduler Sunil Govindan Sunil Govindan
YARN-4906 Capture container start/finish time in container metrics Major . Jian He Jian He
HADOOP-12022 fix site -Pdocs -Pdist in hadoop-project-dist; cleanout remaining forrest bits Blocker build Allen Wittenauer Allen Wittenauer
MAPREDUCE-6670 TestJobListCache#testEviction sometimes fails on Windows with timeout Minor test Gergely Novák Gergely Novák
HDFS-10192 Namenode safemode not coming out during failover Major namenode Brahma Reddy Battula Brahma Reddy Battula
HDFS-6520 hdfs fsck -move passes invalid length value when creating BlockReader Major . Shengjun Xin Xiao Chen
MAPREDUCE-6647 MR usage counters use the resources requested instead of the resources allocated Major . Haibo Chen Haibo Chen
HDFS-10267 Extra “synchronized” on FsDatasetImpl#recoverAppend and FsDatasetImpl#recoverClose Major datanode Colin P. McCabe Colin P. McCabe
HADOOP-13006 FileContextMainOperationsBaseTest.testListStatusThrowsExceptionForNonExistentFile() doesnt run Minor test Steve Loughran Kai Sasaki
YARN-4740 AM may not receive the container complete msg when it restarts Major . sandflee sandflee
MAPREDUCE-6633 AM should retry map attempts if the reduce task encounters commpression related errors. Major . Rushabh S Shah Rushabh S Shah
YARN-4927 TestRMHA#testTransitionedToActiveRefreshFail fails with FairScheduler Major test Karthik Kambatla Bibin A Chundatt
YARN-4938 MiniYarnCluster should not request transitionToActive to RM on non-HA environment Major test Akira Ajisaka Eric Badger
YARN-4562 YARN WebApp ignores the configuration passed to it for keystore settings Major . Sergey Shelukhin Sergey Shelukhin
HADOOP-12406 AbstractMapWritable.readFields throws ClassNotFoundException with custom writables Blocker io Nadeem Douba Nadeem Douba
HADOOP-12993 Change ShutdownHookManger complete shutdown log from INFO to DEBUG Minor . Xiaoyu Yao Xiaoyu Yao
YARN-4897 dataTables_wrapper change min height Minor . Bibin A Chundatt Bibin A Chundatt
HDFS-10277 PositionedReadable test testReadFullyZeroByteFile failing in HDFS Major test Steve Loughran Steve Loughran
HDFS-10271 Extra bytes are getting released from reservedSpace for append Critical . Brahma Reddy Battula Brahma Reddy Battula
HDFS-8356 Document missing properties in hdfs-default.xml Major documentation Ray Chiang Ray Chiang
YARN-4810 NM applicationpage cause internal error 500 Major . Bibin A Chundatt Bibin A Chundatt
HDFS-10273 Remove duplicate logSync() and log message in FSN#enterSafemode() Minor . Vinayakumar B Vinayakumar B
HADOOP-12964 Http server vulnerable to clickjacking Major . Haibo Chen Haibo Chen
YARN-4794 Deadlock in NMClientImpl Critical . Sumana Sathish Jian He
HDFS-9772 TestBlockReplacement#testThrottler doesn’t work as expected Minor test Yiqun Lin Yiqun Lin
HDFS-10270 TestJMXGet:testNameNode() fails Minor test Andras Bokor Gergely Novák
HDFS-10282 The VolumeScanner should warn about replica files which are misplaced Major datanode Colin P. McCabe Colin P. McCabe
HDFS-10216 distcp -diff relative path exception Major distcp John Zhuge Takashi Ohnishi
YARN-4924 NM recovery race can lead to container not cleaned up Major nodemanager Nathan Roberts sandflee
HADOOP-12989 Some tests in org.apache.hadoop.fs.shell.find occasionally time out Major test Akira Ajisaka Takashi Ohnishi
HADOOP-13026 Should not wrap IOExceptions into a AuthenticationException in KerberosAuthenticator Critical . Xuan Gong Xuan Gong
HDFS-10283 o.a.h.hdfs.server.namenode.TestFSImageWithSnapshot#testSaveLoadImageWithAppending fails intermittently Major test Mingliang Liu Mingliang Liu
YARN-4940 yarn node -list -all failed if RM start with decommissioned node Major . sandflee sandflee
YARN-4965 Distributed shell AM failed due to ClientHandlerException thrown by jersey Critical . Sumana Sathish Junping Du
YARN-4934 Reserved Resource for QueueMetrics needs to be handled correctly in few cases Major capacity scheduler Sunil Govindan Sunil Govindan
HDFS-10291 TestShortCircuitLocalRead failing Major test Steve Loughran Steve Loughran
HDFS-10275 TestDataNodeMetrics failing intermittently due to TotalWriteTime counted incorrectly Major test Yiqun Lin Yiqun Lin
MAPREDUCE-6649 getFailureInfo not returning any failure info Major . Eric Badger Eric Badger
HDFS-10265 OEV tool fails to read edit xml file if OP_UPDATE_BLOCKS has no BLOCK tag Minor tools Wan Chang Wan Chang
HDFS-10306 SafeModeMonitor should not leave safe mode if name system is starting active service Major namenode Mingliang Liu Mingliang Liu
HDFS-9744 TestDirectoryScanner#testThrottling occasionally time out after 300 seconds Minor datanode Wei-Chiu Chuang Yiqun Lin
HDFS-10308 TestRetryCacheWithHA#testRetryCacheOnStandbyNN failing Major test Rakesh R Rakesh R
HDFS-10312 Large block reports may fail to decode at NameNode due to 64 MB protobuf maximum length restriction. Major namenode Chris Nauroth Chris Nauroth
MAPREDUCE-6680 JHS UserLogDir scan algorithm sometime could skip directory with update in CloudFS (Azure FileSystem, S3, etc.) Major jobhistoryserver Junping Du Junping Du
YARN-4935 TestYarnClient#testSubmitIncorrectQueue fails with FairScheduler Major test Yufei Gu Yufei Gu
MAPREDUCE-2398 MRBench: setting the baseDir parameter has no effect Minor benchmarks Michael Noll Wilfred Spiegelenburg
YARN-4976 Missing NullPointer check in ContainerLaunchContextPBImpl causes RM to die Major resourcemanager Giovanni Matteo Fumarola Giovanni Matteo Fumarola
HDFS-9670 DistCp throws NPE when source is root Major distcp Yongjun Zhang John Zhuge
HADOOP-13042 Restore lost leveldbjni LICENSE and NOTICE changes Major . Andrew Wang Andrew Wang
HADOOP-13043 Add LICENSE.txt entries for bundled javascript dependencies Major . Andrew Wang Andrew Wang
HDFS-10319 Balancer should not try to pair storages with different types Minor balancer & mover Tsz Wo Nicholas Sze Tsz Wo Nicholas Sze
HDFS-10309 Balancer doesn’t honor dfs.blocksize value defined with suffix k(kilo), m(mega), g(giga) Minor balancer & mover Amit Anand Amit Anand
HDFS-9555 LazyPersistFileScrubber should still sleep if there are errors in the clear progress Major . Phil Yang Phil Yang
HADOOP-13052 ChecksumFileSystem mishandles crc file permissions Major fs Daryn Sharp Daryn Sharp
HDFS-9905 WebHdfsFileSystem#runWithRetry should display original stack trace on error Major test Kihwal Lee Wei-Chiu Chuang
HADOOP-11418 Property “io.compression.codec.lzo.class” does not work with other value besides default Major io fang fang chen Yuanbo Liu
HDFS-10318 TestJMXGet hides the real error in case of test failure Minor test Andras Bokor Andras Bokor
HDFS-10325 TestDFSShell#testMoveWithTargetPortEmpty fails Major test Takanobu Asanuma Takanobu Asanuma
YARN-4795 ContainerMetrics drops records Major resourcemanager Daniel Templeton Daniel Templeton
YARN-4556 TestFifoScheduler.testResourceOverCommit fails Major scheduler, test Akihiro Suda Akihiro Suda
HDFS-10329 Bad initialisation of StringBuffer in RequestHedgingProxyProvider.java Minor ha Max Schaefer Yiqun Lin
HDFS-10313 Distcp need to enforce the order of snapshot names passed to -diff Major distcp Yongjun Zhang Yiqun Lin
YARN-4983 JVM and UGI metrics disappear after RM is once transitioned to standby mode Major . Li Lu Li Lu
HADOOP-13030 Handle special characters in passwords in KMS startup script Major kms Xiao Chen Xiao Chen
YARN-4955 Add retry for SocketTimeoutException in TimelineClient Critical . Xuan Gong Xuan Gong
HDFS-9958 BlockManager#createLocatedBlocks can throw NPE for corruptBlocks on failed storages. Major . Kuhu Shukla Kuhu Shukla
YARN-5008 LeveldbRMStateStore database can grow substantially leading to long recovery times Major resourcemanager Jason Lowe Jason Lowe
YARN-5009 NMLeveldbStateStoreService database can grow substantially leading to longer recovery times Major nodemanager Jason Lowe Jason Lowe
HADOOP-12378 Fix findbugs warnings in hadoop-tools module Major tools Akira Ajisaka Akira Ajisaka
HDFS-10260 TestFsDatasetImpl#testCleanShutdownOfVolume often fails Major datanode, test Wei-Chiu Chuang Rushabh S Shah
HDFS-10335 Mover$Processor#chooseTarget() always chooses the first matching target storage group Critical balancer & mover Mingliang Liu Mingliang Liu
MAPREDUCE-6672 TestTeraSort fails on Windows Minor test Tibor Kiss Tibor Kiss
HDFS-10347 Namenode report bad block method doesn’t log the bad block or datanode. Minor namenode Rushabh S Shah Rushabh S Shah
HADOOP-13012 yetus-wrapper should fail sooner when download fails Minor yetus Steven K. Wong Steven K. Wong
HADOOP-13072 WindowsGetSpaceUsed constructor should be public Major . Vinayakumar B Vinayakumar B
MAPREDUCE-6537 Include hadoop-pipes examples in the release tarball Blocker pipes Allen Wittenauer Kai Sasaki
HDFS-10353 Fix hadoop-hdfs-native-client compilation on Windows Blocker build Brahma Reddy Battula Brahma Reddy Battula
HDFS-10344 DistributedFileSystem#getTrashRoots should skip encryption zone that does not have .Trash Major . Namit Maheshwari Xiaoyu Yao
HADOOP-13080 Refresh time in SysInfoWindows is in nanoseconds Major util Íñigo Goiri Íñigo Goiri
YARN-4834 ProcfsBasedProcessTree doesn’t track daemonized processes Major nodemanager Nathan Roberts Nathan Roberts
HADOOP-12469 distcp should not ignore the ignoreFailures option Critical tools/distcp Gera Shegalov Mingliang Liu
HDFS-10320 Rack failures may result in NN terminate Major . Xiao Chen Xiao Chen
MAPREDUCE-6677 LocalContainerAllocator doesn’t specify resource of the containers allocated. Major mr-am Haibo Chen Haibo Chen
MAPREDUCE-6675 TestJobImpl.testUnusableNode failed Major mrv2 Haibo Chen Haibo Chen
YARN-4311 Removing nodes from include and exclude lists will not remove them from decommissioned nodes list Major . Kuhu Shukla Kuhu Shukla
YARN-4984 LogAggregationService shouldn’t swallow exception in handling createAppDir() which cause thread leak. Critical log-aggregation Junping Du Junping Du
HADOOP-13077 Handle special characters in passwords in httpfs.sh Major . Xiao Chen Xiao Chen
HADOOP-13098 Dynamic LogLevel setting page should accept case-insensitive log level string Major . Junping Du Junping Du
HDFS-10324 Trash directory in an encryption zone should be pre-created with correct permissions Major encryption Wei-Chiu Chuang Wei-Chiu Chuang
MAPREDUCE-6514 Job hangs as ask is not updated after ramping down of all reducers Blocker applicationmaster Varun Saxena Varun Saxena
HDFS-2043 TestHFlush failing intermittently Major test Aaron T. Myers Yiqun Lin
YARN-5002 getApplicationReport call may raise NPE for removed queues Critical . Sumana Sathish Jian He
MAPREDUCE-6689 MapReduce job can infinitely increase number of reducer resource requests Blocker . Wangda Tan Wangda Tan
YARN-4747 AHS error 500 due to NPE when container start event is missing Major timelineserver Jason Lowe Varun Saxena
HDFS-9939 Increase DecompressorStream skip buffer size Major . Yongjun Zhang John Zhuge
HDFS-10374 typo in HDFSHighAvailabilityWithQJM doc. Minor documentation Takashi Ohnishi Takashi Ohnishi
YARN-5048 DelegationTokenRenewer#skipTokenRenewal may throw NPE Major . Jian He Jian He
YARN-4926 Change nodelabel rest API invalid reponse status to 400 Major . Bibin A Chundatt Bibin A Chundatt
HDFS-10372 Fix for failing TestFsDatasetImpl#testCleanShutdownOfVolume Major test Rushabh S Shah Rushabh S Shah
MAPREDUCE-6684 High contention on scanning of user directory under immediate_done in Job History Server Critical jobhistoryserver Haibo Chen Haibo Chen
HADOOP-13118 Fix IOUtils#cleanup and IOUtils#closeStream javadoc Trivial io Wei-Chiu Chuang Wei-Chiu Chuang
YARN-4768 getAvailablePhysicalMemorySize can be inaccurate on linux Major nodemanager Nathan Roberts Nathan Roberts
HADOOP-10694 Remove synchronized input streams from Writable deserialization Major io Gopal V Gopal V
HADOOP-13125 FS Contract tests don’t report FS initialization errors well Minor test Steve Loughran Steve Loughran
YARN-5029 RM needs to send update event with YarnApplicationState as Running to ATS/AHS Critical . Xuan Gong Xuan Gong
HADOOP-13116 Jets3tNativeS3FileSystemContractTest does not run. Minor test Chris Nauroth Chris Nauroth
MAPREDUCE-6639 Process hangs in LocatedFileStatusFetcher if FileSystem.get throws Major mrv2 Ryan Blue Ryan Blue
HADOOP-11180 Change log message “token.Token: Cannot find class for token kind kms-dt” to debug Major kms, security Yi Liu Yi Liu
MAPREDUCE-6558 multibyte delimiters with compressed input files generate duplicate records Major mrv1, mrv2 Wilfred Spiegelenburg Wilfred Spiegelenburg
HADOOP-13083 The number of javadocs warnings is limited to 100 Critical . Li Lu Gergely Novák
MAPREDUCE-6513 MR job got hanged forever when one NM unstable for some time Critical applicationmaster, resourcemanager Bob.zhao Varun Saxena
HDFS-10333 Intermittent org.apache.hadoop.hdfs.TestFileAppend failure in trunk Major hdfs Yongjun Zhang Yiqun Lin
HADOOP-12942 hadoop credential commands non-obviously use password of “none” Major security Mike Yoder Mike Yoder
YARN-4325 Nodemanager log handlers fail to send finished/failed events in some cases Critical . Junping Du Junping Du
HDFS-10410 RedundantEditLogInputStream#LOG is set to wrong class Minor . John Zhuge John Zhuge
HDFS-10208 Addendum for HDFS-9579: to handle the case when client machine can’t resolve network path Major . Ming Ma Ming Ma
HDFS-10242 Cannot create space quota of zero Major fs Takashi Ohnishi Takashi Ohnishi
MAPREDUCE-6693 ArrayIndexOutOfBoundsException occurs when the length of the job name is equal to mapreduce.jobhistory.jobname.limit Critical . Bibin A Chundatt Ajith S
HADOOP-13163 Reuse pre-computed filestatus in Distcp-CopyMapper Minor tools/distcp Rajesh Balamohan Rajesh Balamohan
HDFS-10303 DataStreamer#ResponseProcessor calculates packet ack latency incorrectly. Major hdfs-client Surendra Singh Lilhore Surendra Singh Lilhore
MAPREDUCE-6701 application master log can not be available when clicking jobhistory’s am logs link Critical jobhistoryserver chenyukang Haibo Chen
MAPREDUCE-6698 Increase timeout on TestUnnecessaryBlockingOnHistoryFileInfo.testTwoThreadsQueryingDifferentJobOfSameUser Major jobhistoryserver Haibo Chen Haibo Chen
HDFS-10404 Fix formatting of CacheAdmin command usage help text Major caching Yiqun Lin Yiqun Lin
MAPREDUCE-6657 job history server can fail on startup when NameNode is in start phase Major jobhistoryserver Haibo Chen Haibo Chen
HADOOP-13159 Fix potential NPE in Metrics2 source for DecayRpcScheduler Major ipc Xiaoyu Yao Xiaoyu Yao
HDFS-10397 Distcp should ignore -delete option if -diff option is provided instead of exiting Major distcp Mingliang Liu Mingliang Liu
HDFS-10381 DataStreamer DataNode exclusion log message should be warning Minor hdfs-client John Zhuge John Zhuge
HDFS-10360 DataNode may format directory and lose blocks if current/VERSION is missing Major datanode Wei-Chiu Chuang Wei-Chiu Chuang
HDFS-9226 MiniDFSCluster leaks dependency Mockito via DataNodeTestUtils Major test Josh Elser Josh Elser
HADOOP-13138 Unable to append to a SequenceFile with Compression.NONE. Critical . Gervais Mickaël Vinayakumar B
HADOOP-13157 Follow-on improvements to hadoop credential commands Major security Mike Yoder Mike Yoder
YARN-3840 Resource Manager web ui issue when sorting application by id (with application having id > 9999) Major resourcemanager LINTE Varun Saxena
YARN-5107 TestContainerMetrics fails Major test Akira Ajisaka Akira Ajisaka
HADOOP-13177 Native tests fail on OS X, because DYLD_LIBRARY_PATH is not defined to include libhadoop.dylib. Minor build Chris Nauroth Chris Nauroth
HADOOP-12767 update apache httpclient version to 4.5.2; httpcore to 4.4.4 Major build Artem Aliev Artem Aliev
YARN-5100 The YarnApplicationState is always running in ATS no matter the application is running or finishes. Blocker . Xuan Gong Xuan Gong
YARN-5076 YARN web interfaces lack XFS protection Major nodemanager, resourcemanager, timelineserver Jonathan Maron Jonathan Maron
HADOOP-13183 S3A proxy tests fail after httpclient/httpcore upgrade. Major fs/s3 Chris Nauroth Steve Loughran
YARN-5020 Fix Documentation for Yarn Capacity Scheduler on Resource Calculator Minor . Jo Desmet Takashi Ohnishi
HDFS-10424 DatanodeLifelineProtocol not able to use under security cluster Blocker . gu-chi Chris Nauroth
HDFS-10438 When NameNode HA is configured to use the lifeline RPC server, it should log the address of that server. Minor ha, namenode KWON BYUNGCHANG Chris Nauroth
HDFS-10439 Update setOwner doc in HdfsPermissionsGuide Minor documentation John Zhuge John Zhuge
MAPREDUCE-6607 Enable regex pattern matching when mapreduce.task.files.preserve.filepattern is set Minor applicationmaster Maysam Yabandeh Kai Sasaki
YARN-5112 Excessive log warnings for directory permission issue on NM recovery. Major . Jian He Jian He
YARN-5103 With NM recovery enabled, restarting NM multiple times results in AM restart Critical yarn Sumana Sathish Junping Du
YARN-5055 max apps per user can be larger than max per queue Minor capacityscheduler, resourcemanager Jason Lowe Eric Badger
YARN-4979 FSAppAttempt demand calculation considers demands at multiple locality levels different Major fairscheduler zhihai xu zhihai xu
YARN-3971 Skip RMNodeLabelsManager#checkRemoveFromClusterNodeLabelsOfQueue on nodelabel recovery Critical resourcemanager Bibin A Chundatt Bibin A Chundatt
HDFS-9365 Balancer does not work with the HDFS-6376 HA setup Major balancer & mover Tsz Wo Nicholas Sze Tsz Wo Nicholas Sze
MAPREDUCE-6703 Add flag to allow MapReduce AM to request for OPPORTUNISTIC containers Major . Arun Suresh Arun Suresh
YARN-5131 Distributed shell AM fails when extra container arrives during finishing Major . Sumana Sathish Wangda Tan
YARN-3344 Fix warning - procfs stat file is not in the expected format Major . Jon Bringhurst Ravindra Kumar Naik
YARN-4459 container-executor should only kill process groups Major nodemanager Jun Gong Jun Gong
YARN-4866 FairScheduler: AMs can consume all vcores leading to a livelock when using FAIR policy Major fairscheduler Karthik Kambatla Yufei Gu
HDFS-10463 TestRollingFileSystemSinkWithHdfs needs some cleanup Critical . Daniel Templeton Daniel Templeton
YARN-5166 javadoc:javadoc goal fails on hadoop-yarn-client Major . Andras Bokor Andras Bokor
HDFS-10276 HDFS should not expose path info that user has no permission to see. Major fs, security Kevin Cox Yuanbo Liu
YARN-5132 Exclude generated protobuf sources from YARN Javadoc build Critical . Subru Krishnan Subru Krishnan
HADOOP-13132 Handle ClassCastException on AuthenticationException in LoadBalancingKMSClientProvider Major kms Miklos Szurap Wei-Chiu Chuang
HDFS-10415 TestDistributedFileSystem#MyDistributedFileSystem attempts to set up statistics before initialize() is called Major test Sangjin Lee Mingliang Liu
HADOOP-13137 TraceAdmin should support Kerberized cluster Major tracing Wei-Chiu Chuang Wei-Chiu Chuang
HDFS-9476 TestDFSUpgradeFromImage#testUpgradeFromRel1BBWImage occasionally fail Major . Wei-Chiu Chuang Masatake Iwasaki
HDFS-10367 TestDFSShell.testMoveWithTargetPortEmpty fails with Address bind exception. Major test Brahma Reddy Battula Brahma Reddy Battula
HADOOP-13224 Grep job in Single Cluster document fails Major documentation Akira Ajisaka Akira Ajisaka
HDFS-10471 DFSAdmin#SetQuotaCommand’s help msg is not correct Minor documentation Yiqun Lin Yiqun Lin
YARN-5098 Yarn Application log Aggreagation fails due to NM can not get correct HDFS delegation token Major yarn Yesha Vora Jian He
HADOOP-13155 Implement TokenRenewer to renew and cancel delegation tokens in KMS Major kms, security Xiao Chen Xiao Chen
HDFS-10481 HTTPFS server should correctly impersonate as end user to open file Major httpfs Xiao Chen Xiao Chen
HDFS-10485 Fix findbugs warning in FSEditLog.java Major . Akira Ajisaka Akira Ajisaka
HDFS-10458 getFileEncryptionInfo should return quickly for non-encrypted cluster Major encryption, namenode Zhe Zhang Zhe Zhang
HDFS-10468 HDFS read ends up ignoring an interrupt Major . Siddharth Seth Jing Zhao
YARN-5206 RegistrySecurity includes id:pass in exception text if considered invalid Minor client, security Steve Loughran Steve Loughran
HDFS-10220 A large number of expired leases can make namenode unresponsive and cause failover Major namenode Nicolas Fraison Nicolas Fraison
MAPREDUCE-6240 Hadoop client displays confusing error message Major client Mohammad Kamrul Islam Gera Shegalov
YARN-4308 ContainersAggregated CPU resource utilization reports negative usage in first few heartbeats Major nodemanager Sunil Govindan Sunil Govindan
HDFS-10508 DFSInputStream should set thread’s interrupt status after catching InterruptException from sleep Major . Jing Zhao Jing Zhao
HADOOP-13249 RetryInvocationHandler need wrap InterruptedException in IOException when call Thread.sleep Major ipc zhihai xu zhihai xu
HADOOP-13213 Small Documentation bug with AuthenticatedURL in hadoop-auth Minor documentation Tom Ellis Tom Ellis
HADOOP-13243 TestRollingFileSystemSink.testSetInitialFlushTime() fails intermittently Minor test Daniel Templeton Daniel Templeton
HADOOP-13079 Add -q option to Ls to print ? instead of non-printable characters Major . John Zhuge John Zhuge
HDFS-10516 Fix bug when warming up EDEK cache of more than one encryption zone Major encryption, namenode Xiao Chen Xiao Chen
HADOOP-13270 BZip2CompressionInputStream finds the same compression marker twice in corner case, causing duplicate data blocks Critical . Haibo Chen Kai Sasaki
HADOOP-13179 GenericOptionsParser is not thread-safe because commons-cli OptionBuilder is not thread-safe Minor . hongbin ma hongbin ma
HADOOP-13244 o.a.h.ipc.Server#Server should honor handlerCount when queueSizePerHandler is specified in consturctor Minor ipc Xiaoyu Yao Kai Sasaki
HADOOP-13245 Fix up some misc create-release issues Blocker build Allen Wittenauer Allen Wittenauer
HDFS-10505 OIV’s ReverseXML processor should support ACLs Major tools Colin P. McCabe Surendra Singh Lilhore
HDFS-10525 Fix NPE in CacheReplicationMonitor#rescanCachedBlockMap Major caching Xiao Chen Xiao Chen
YARN-5237 Fix missing log files issue in rolling log aggregation. Major . Siddharth Seth Xuan Gong
HDFS-10532 Typo in RollingUpgrade docs Major documentation Arpit Agarwal Yiqun Lin
HADOOP-3733 “s3:” URLs break when Secret Key contains a slash, even if encoded Minor fs/s3 Stuart Sierra Steve Loughran
HDFS-9466 TestShortCircuitCache#testDataXceiverCleansUpSlotsOnFailure is flaky Major fs, hdfs-client Wei-Chiu Chuang Wei-Chiu Chuang
HADOOP-13255 KMSClientProvider should check and renew tgt when doing delegation token operations. Major kms Xiao Chen Xiao Chen
HADOOP-13242 Authenticate to Azure Data Lake using client ID and keys Major fs/adl Atul Sikaria Atul Sikaria
HADOOP-13285 DecayRpcScheduler MXBean should only report decayed CallVolumeSummary Major ipc Namit Maheshwari Xiaoyu Yao
HADOOP-13149 Windows distro build fails on dist-copynativelibs. Blocker build Chris Nauroth Chris Nauroth
YARN-5077 Fix FSLeafQueue#getFairShare() for queues with zero fairshare Major . Yufei Gu Yufei Gu
HDFS-10437 ReconfigurationProtocol not covered by HDFSPolicyProvider. Major namenode Chris Nauroth Arpit Agarwal
YARN-5246 NMWebAppFilter web redirects drop query parameters Major . Varun Vasudev Varun Vasudev
HADOOP-13192 org.apache.hadoop.util.LineReader cannot handle multibyte delimiters correctly Critical util binde binde
HDFS-10448 CacheManager#addInternal tracks bytesNeeded incorrectly when dealing with replication factors other than 1 Major caching Yiqun Lin Yiqun Lin
HADOOP-13287 TestS3ACredentials#testInstantiateFromURL fails if AWS secret key contains ‘+’. Minor fs/s3, test Chris Nauroth Chris Nauroth
MAPREDUCE-6197 Cache MapOutputLocations in ShuffleHandler Major . Siddharth Seth Junping Du
YARN-5266 Wrong exit code while trying to get app logs using regex via CLI Critical yarn Sumana Sathish Xuan Gong
HDFS-10561 test_native_mini_dfs fails by NoClassDefFoundError Major native, test Akira Ajisaka Akira Ajisaka
HDFS-10555 Unable to loadFSEdits due to a failure in readCachePoolInfo Critical caching, namenode Uma Maheswara Rao G Uma Maheswara Rao G
MAPREDUCE-6725 Javadoc for CLI#listEvents() contains no-existent param Minor client, documentation Shen Yinjie Shen Yinjie
HDFS-7959 WebHdfs logging is missing on Datanode Critical . Kihwal Lee Kihwal Lee
HDFS-10536 Standby NN can not trigger log roll after EditLogTailer thread failed 3 times in EditLogTailer.triggerActiveLogRoll method. Critical auto-failover XingFeng Shen XingFeng Shen
MAPREDUCE-6542 HistoryViewer uses SimpleDateFormat, but SimpleDateFormat is not threadsafe Major jobhistoryserver zhangyubiao zhangyubiao
HADOOP-13251 Authenticate with Kerberos credentials when renewing KMS delegation token Major kms Xiao Chen Xiao Chen
HADOOP-13316 Enforce Kerberos authentication for required ops in DelegationTokenAuthenticator Blocker kms, security Xiao Chen Xiao Chen
MAPREDUCE-5803 Counters page display all task neverthless of task type( Map or Reduce) Minor jobhistoryserver Rohith Sharma K S Kai Sasaki
HADOOP-9888 KerberosName static initialization gets default realm, which is unneeded in non-secure deployment. Major security Chris Nauroth Dmytro Kabakchei
HDFS-9852 hdfs dfs -setfacl error message is misleading Minor . Wei-Chiu Chuang Wei-Chiu Chuang
YARN-5262 Optimize sending RMNodeFinishedContainersPulledByAMEvent for every AM heartbeat Major resourcemanager Rohith Sharma K S Rohith Sharma K S
YARN-5182 MockNodes.newNodes creates one more node per rack than requested Major test Karthik Kambatla Karthik Kambatla
HADOOP-12345 Pad hostname correctly in CredentialsSys.java Critical nfs Pradeep Nayak Udupi Kadbet Pradeep Nayak Udupi Kadbet
YARN-5282 Fix typos in CapacityScheduler documentation Trivial documentation Ray Chiang Ray Chiang
HADOOP-13314 Remove ‘package-info.java’ from ‘test\java\org\apache\hadoop\fs\shell\’ to remove eclipse compile error Trivial . Vinayakumar B Vinayakumar B
HDFS-10572 Fix TestOfflineEditsViewer#testGenerated Blocker test Xiaoyu Yao Surendra Singh Lilhore
HDFS-10589 Javadoc for HAState#HAState and HAState#setStateInternal contains non-existent params Minor documentation, hdfs Shen Yinjie Shen Yinjie
YARN-5286 Add RPC port info in RM web service’s response when getting app status Major . Jun Gong Jun Gong
HADOOP-13342 ISAL download is breaking the Dockerfile Blocker build Allen Wittenauer Allen Wittenauer
YARN-5214 Pending on synchronized method DirectoryCollection#checkDirs can hang NM’s NodeStatusUpdater Critical nodemanager Junping Du Junping Du
YARN-5296 NMs going OutOfMemory because ContainerMetrics leak in ContainerMonitorImpl Major nodemanager Karam Singh Junping Du
YARN-5294 Pass remote ip address down to YarnAuthorizationProvider Major . Jian He Jian He
HADOOP-13350 Additional fix to LICENSE and NOTICE Blocker build Xiao Chen Xiao Chen
HDFS-10592 Fix intermittent test failure of TestNameNodeResourceChecker#testCheckThatNameNodeResourceMonitorIsRunning Major test Rakesh R Rakesh R
HADOOP-13349 HADOOP_CLASSPATH vs HADOOP_USER_CLASSPATH Blocker scripts Allen Wittenauer Allen Wittenauer
HADOOP-13320 Fix arguments check in documentation for WordCount v2.0 Minor documentation niccolo becchi niccolo becchi
YARN-5314 ConcurrentModificationException in ATS v1.5 EntityGroupFSTimelineStore Major timelineserver Karam Singh Li Lu
YARN-4939 the decommissioning Node should keep alive if NM restart Major . sandflee sandflee
HADOOP-12893 Verify LICENSE.txt and NOTICE.txt Blocker build Allen Wittenauer Xiao Chen
HADOOP-13352 Make X-FRAME-OPTIONS configurable in HttpServer2 Major net, security Anu Engineer Anu Engineer
HDFS-10336 TestBalancer failing intermittently because of not reseting UserGroupInformation completely Major test Yiqun Lin Yiqun Lin
HDFS-10512 VolumeScanner may terminate due to NPE in DataNode.reportBadBlocks Major datanode Wei-Chiu Chuang Yiqun Lin
YARN-5337 Fix OOM issue in DistributedShell. AM failed with “java.lang.OutOfMemoryError: GC overhead limit exceeded” Major . Sumana Sathish Jian He
HADOOP-13297 Add missing dependency in setting maven-remote-resource-plugin to fix builds Major build Akira Ajisaka Sean Busbey
YARN-5270 Solve miscellaneous issues caused by YARN-4844 Blocker . Wangda Tan Wangda Tan
YARN-5354 TestDistributedShell.checkTimelineV2() may fail for concurrent tests Major timelineserver Sangjin Lee Sangjin Lee
MAPREDUCE-6731 TestMRTimelineEventHandling.testMRNewTimelineServiceEventHandling() may fail for concurrent tests Major test Sangjin Lee Sangjin Lee
HDFS-10579 HDFS web interfaces lack configs for X-FRAME-OPTIONS protection Major datanode, namenode Anu Engineer Anu Engineer
YARN-4366 Fix Lint Warnings in YARN Common Major yarn Daniel Templeton Daniel Templeton
MAPREDUCE-6625 TestCLI#testGetJob fails occasionally Major test Jason Lowe Haibo Chen
HADOOP-13315 FileContext#umask is not initialized properly Minor . John Zhuge John Zhuge
YARN-5353 ResourceManager can leak delegation tokens when they are shared across apps Critical resourcemanager Jason Lowe Jason Lowe
HDFS-10590 Fix TestReconstructStripedBlocks.testCountLiveReplicas test failures Major . Rakesh R Rakesh R
HADOOP-11361 Fix a race condition in MetricsSourceAdapter.updateJmxCache Major . Brahma Reddy Battula Brahma Reddy Battula
YARN-5362 TestRMRestart#testFinishedAppRemovalAfterRMRestart can fail Major . Jason Lowe sandflee
YARN-5359 FileSystemTimelineReader/Writer uses unix-specific default storage path Minor . Sangjin Lee Sangjin Lee
YARN-5364 timelineservice modules have indirect dependencies on mapreduce artifacts Minor timelineserver Sangjin Lee Sangjin Lee
HDFS-10544 Balancer doesn’t work with IPFailoverProxyProvider Major balancer & mover, ha Zhe Zhang Zhe Zhang
HDFS-10617 PendingReconstructionBlocks.size() should be synchronized Major . Eric Badger Eric Badger
HADOOP-13351 TestDFSClientSocketSize buffer size tests are flaky Major . Aaron Fabbri Aaron Fabbri
YARN-5379 TestHBaseTimelineStorage. testWriteApplicationToHBase() fails intermittently Minor test, timelineserver Sangjin Lee Vrushali C
YARN-5383 Fix findbugs for nodemanager & checkstyle warnings in nodemanager.ContainerExecutor Major nodemanager Vrushali C Vrushali C
MAPREDUCE-6733 MapReduce JerseyTest tests failing with “java.net.BindException: Address already in use” Critical test Vinod Kumar Vavilapalli Vinod Kumar Vavilapalli
HADOOP-13254 Create framework for configurable disk checkers Major util Yufei Gu Yufei Gu
YARN-5272 Handle queue names consistently in FairScheduler Major fairscheduler Wilfred Spiegelenburg Wilfred Spiegelenburg
HDFS-10639 Fix typos in HDFSDiskbalancer.md Trivial documentation Akira Ajisaka Yiqun Lin
HADOOP-13073 RawLocalFileSystem does not react on changing umask Major fs Andras Bokor Andras Bokor
HADOOP-13202 Avoid possible overflow in org.apache.hadoop.util.bloom.BloomFilter#getNBytes Major util zhengbing li Kai Sasaki
YARN-5213 Fix a bug in LogCLIHelpers which cause TestLogsCLI#testFetchApplictionLogs fails intermittently Major test Rohith Sharma K S Xuan Gong
HDFS-10603 Fix flaky tests in org.apache.hadoop.hdfs.server.namenode.snapshot.TestOpenFilesWithSnapshot Major hdfs, namenode Yongjun Zhang Yiqun Lin
HADOOP-12991 Conflicting default ports in DelegateToFileSystem Major fs Kevin Hogeland Kai Sasaki
YARN-5309 Fix SSLFactory truststore reloader thread leak in TimelineClientImpl Blocker timelineserver, yarn Thomas Friedrich Weiwei Yang
YARN-5340 Race condition in RollingLevelDBTimelineStore#getAndSetStartTime() Critical timelineserver Sumana Sathish Li Lu
HDFS-8914 Document HA support in the HDFS HdfsDesign.md Major documentation Ravindra Babu Lars Francke
HADOOP-12588 Fix intermittent test failure of TestGangliaMetrics Major . Tsuyoshi Ozawa Masatake Iwasaki
HADOOP-13240 TestAclCommands.testSetfaclValidations fail Minor test linbao111 John Zhuge
HADOOP-13393 [Azure Data Lake] Correction needed in fs.defaultFS support in documentation Major fs/adl Vishwajeet Dusane Vishwajeet Dusane
HADOOP-13392 [Azure Data Lake] OAuth2 configuration should be default set to true when AdlFileSystem is configured. Major fs/adl Vishwajeet Dusane Vishwajeet Dusane
HADOOP-13389 TestS3ATemporaryCredentials.testSTS error when using IAM credentials Major fs/s3 Steven K. Wong Steven K. Wong
HADOOP-13406 S3AFileSystem: Consider reusing filestatus in delete() and mkdirs() Minor fs/s3 Rajesh Balamohan Rajesh Balamohan
MAPREDUCE-6744 Increase timeout on TestDFSIO tests Major . Eric Badger Eric Badger
HDFS-10688 BPServiceActor may run into a tight loop for sending block report when hitting IOException Major datanode Jing Zhao Chen Liang
HDFS-10671 Fix typo in HdfsRollingUpgrade.md Trivial documentation Yiqun Lin Yiqun Lin
HADOOP-13422 ZKDelegationTokenSecretManager JaasConfig does not work well with other ZK users in process Major . Sergey Shelukhin Sergey Shelukhin
HADOOP-9427 Use JUnit assumptions to skip platform-specific tests Major test Arpit Agarwal Gergely Novák
YARN-5441 Fixing minor Scheduler test case failures Major . Subru Krishnan Subru Krishnan
YARN-5431 TimeLineReader daemon start should allow to pass its own reader opts Major scripts, timelinereader Rohith Sharma K S Rohith Sharma K S
HDFS-10696 TestHDFSCLI fails Major test Akira Ajisaka Kai Sasaki
YARN-5432 Lock already held by another process while LevelDB cache store creation for dag Critical timelineserver Karam Singh Li Lu
YARN-5440 Use AHSClient in YarnClient when TimelineServer is running Major . Xuan Gong Xuan Gong
YARN-5438 TimelineClientImpl leaking FileSystem Instances causing Long running services like HiverServer2 daemon going OOM Major timelineserver Karam Singh Rohith Sharma K S
YARN-5203 Return ResourceRequest JAXB object in ResourceManager Cluster Applications REST API Major . Subru Krishnan Ellen Hui
HDFS-9276 Failed to Update HDFS Delegation Token for long running application in HA mode Major fs, ha, security Liangliang Gu Liangliang Gu
YARN-5436 Race in AsyncDispatcher can cause random test failures in Tez (probably YARN also) Major . Zhiyuan Yang Zhiyuan Yang
HADOOP-13381 KMS clients should use KMS Delegation Tokens from current UGI. Critical kms Xiao Chen Xiao Chen
HDFS-10691 FileDistribution fails in hdfs oiv command due to ArrayIndexOutOfBoundsException Major . Yiqun Lin Yiqun Lin
YARN-5121 fix some container-executor portability issues Blocker nodemanager, security Allen Wittenauer Allen Wittenauer
HADOOP-13440 FileContext does not react on changing umask via configuration Major . Yufei Gu Akira Ajisaka
YARN-5444 Fix failing unit tests in TestLinuxContainerExecutorWithMocks Major nodemanager Yufei Gu Yufei Gu
MAPREDUCE-6724 Single shuffle to memory must not exceed Integer#MAX_VALUE Major mrv2 Haibo Chen Haibo Chen
HDFS-5805 TestCheckpoint.testCheckpoint fails intermittently on branch2 Major . Mit Desai Eric Badger
HADOOP-13459 hadoop-azure runs several test cases repeatedly, causing unnecessarily long running time. Minor fs/azure, test Chris Nauroth Chris Nauroth
HDFS-742 A down DataNode makes Balancer to hang on repeatingly asking NameNode its partial block list Minor balancer & mover Hairong Kuang Mit Desai
YARN-4280 CapacityScheduler reservations may not prevent indefinite postponement on a busy cluster Major capacity scheduler Kuhu Shukla Kuhu Shukla
YARN-5462 TestNodeStatusUpdater.testNodeStatusUpdaterRetryAndNMShutdown fails intermittently Major . Eric Badger Eric Badger
HDFS-10710 In BlockManager#rescanPostponedMisreplicatedBlocks(), postponed misreplicated block counts should be retrieved with NN lock protection Major namenode Rui Gao Rui Gao
YARN-5469 Increase timeout of TestAmFilter.testFilter Minor . Eric Badger Eric Badger
HDFS-10569 A bug causes OutOfIndex error in BlockListAsLongs Minor . Weiwei Yang Weiwei Yang
HADOOP-13434 Add quoting to Shell class Major . Owen O’Malley Owen O’Malley
MAPREDUCE-6682 TestMRCJCFileOutputCommitter fails intermittently Major test Brahma Reddy Battula Akira Ajisaka
HADOOP-13443 KMS should check the type of underlying keyprovider of KeyProviderExtension before falling back to default Minor kms Anthony Young-Garner Anthony Young-Garner
HDFS-10716 In Balancer, the target task should be removed when its size < 0. Minor balancer & mover Yiqun Lin Yiqun Lin
HDFS-10722 Fix race condition in TestEditLog#testBatchedSyncWithClosedLogs Major hdfs Daryn Sharp Daryn Sharp
HADOOP-13467 Shell#getSignalKillCommand should use the bash builtin on Linux Major . Arpit Agarwal Arpit Agarwal
HDFS-10343 BlockManager#createLocatedBlocks may return blocks on failed storages Major hdfs Daryn Sharp Kuhu Shukla
HDFS-10715 NPE when applying AvailableSpaceBlockPlacementPolicy Major namenode Guangbin Zhu Guangbin Zhu
YARN-5333 Some recovered apps are put into default queue when RM HA Major . Jun Gong Jun Gong
HADOOP-13353 LdapGroupsMapping getPassward shouldn’t return null when IOException throws Major security Zhaohao Liang Wei-Chiu Chuang
YARN-4624 NPE in PartitionQueueCapacitiesInfo while accessing Schduler UI Major . Brahma Reddy Battula Brahma Reddy Battula
HADOOP-10823 TestReloadingX509TrustManager is flaky Major . Ratandeep Ratti Mingliang Liu
HADOOP-13403 AzureNativeFileSystem rename/delete performance improvements Major fs/azure Subramanyam Pattipaka Subramanyam Pattipaka
HADOOP-13457 Remove hardcoded absolute path for shell executable Major util Arpit Agarwal Chen Liang
HDFS-10457 DataNode should not auto-format block pool directory if VERSION is missing Major datanode Wei-Chiu Chuang Wei-Chiu Chuang
HDFS-4176 EditLogTailer should call rollEdits with a timeout Major ha, namenode Todd Lipcon Lei (Eddy) Xu
HADOOP-13439 Fix race between TestMetricsSystemImpl and TestGangliaMetrics Minor test Masatake Iwasaki Chen Liang
YARN-5474 Typo mistake in AMRMClient#getRegisteredTimeineClient API Trivial . Rohith Sharma K S Naganarasimha G R
MAPREDUCE-6750 TestHSAdminServer.testRefreshSuperUserGroups is failing Minor test Kihwal Lee Kihwal Lee
HADOOP-13473 Tracing in IPC Server is broken Major . Wei-Chiu Chuang Daryn Sharp
HDFS-10738 Fix TestRefreshUserMappings.testRefreshSuperUserGroupsConfiguration test failure Major test Rakesh R Rakesh R
HADOOP-13299 JMXJsonServlet is vulnerable to TRACE Minor . Haibo Chen Haibo Chen
HADOOP-13476 CredentialProviderFactory fails at class loading from libhdfs (JNI) Major fs/s3 Aaron Fabbri Aaron Fabbri
HDFS-8224 Schedule a block for scanning if its metadata file is corrupt Major datanode Rushabh S Shah Rushabh S Shah
YARN-5382 RM does not audit log kill request for active applications Major resourcemanager Jason Lowe Vrushali C
HDFS-10643 Namenode should use loginUser(hdfs) to generateEncryptedKey Major encryption, namenode Xiaoyu Yao Xiaoyu Yao
HADOOP-13461 NPE in KeyProvider.rollNewVersion Minor . Colm O hEigeartaigh Colm O hEigeartaigh
HDFS-10720 Fix intermittent test failure of TestDataNodeErasureCodingMetrics Major . Rakesh R Rakesh R
HDFS-8897 Balancer should handle fs.defaultFS trailing slash in HA Major balancer & mover LINTE John Zhuge
HADOOP-13441 Document LdapGroupsMapping keystore password properties Minor security Wei-Chiu Chuang Yuanbo Liu
HDFS-10731 FSDirectory#verifyMaxDirItems does not log path name Minor namenode Wei-Chiu Chuang Wei-Chiu Chuang
YARN-4833 For Queue AccessControlException client retries multiple times on both RM Major . Bibin A Chundatt Bibin A Chundatt
YARN-5476 Not existed application reported as ACCEPTED state by YarnClientImpl Critical yarn Yesha Vora Junping Du
YARN-5491 Random Failure TestCapacityScheduler#testCSQueueBlocked Major test Bibin A Chundatt Bibin A Chundatt
HDFS-9696 Garbage snapshot records lingering forever Critical . Kihwal Lee Kihwal Lee
YARN-5521 TestCapacityScheduler#testKillAllAppsInQueue fails randomly Major . Varun Saxena sandflee
HADOOP-13333 testConf.xml ls comparators in wrong order Trivial fs John Zhuge Vrushali C
HADOOP-13437 KMS should reload whitelist and default key ACLs when hot-reloading Major kms Xiao Chen Xiao Chen
YARN-5475 Test failed for TestAggregatedLogFormat on trunk Major . Junping Du Jun Gong
HADOOP-13470 GenericTestUtils$LogCapturer is flaky Major test, util Mingliang Liu Mingliang Liu
YARN-5523 Yarn running container log fetching causes OutOfMemoryError Major log-aggregation Prasanth Jayachandran Xuan Gong
HADOOP-13494 ReconfigurableBase can log sensitive information Major security Sean Mackrory Sean Mackrory
HDFS-9530 ReservedSpace is not cleared for abandoned Blocks Critical datanode Fei Hui Brahma Reddy Battula
HADOOP-11786 Fix Javadoc typos in org.apache.hadoop.fs.FileSystem Trivial documentation Chen He Andras Bokor
HDFS-10549 Correctly revoke file leases when closing files Major hdfs-client Yiqun Lin Yiqun Lin
HDFS-10773 BlockSender should not synchronize on the dataset object Major datanode Arpit Agarwal Chen Liang
HADOOP-13513 Java 1.7 support for org.apache.hadoop.fs.azure testcases Minor fs/azure Tibor Kiss Tibor Kiss
HADOOP-13512 ReloadingX509TrustManager should keep reloading in case of exception Critical security Mingliang Liu Mingliang Liu
HDFS-10763 Open files can leak permanently due to inconsistent lease update Critical . Kihwal Lee Kihwal Lee
YARN-4307 Display blacklisted nodes for AM container in the RM web UI Major resourcemanager, webapp Naganarasimha G R Naganarasimha G R
YARN-5533 JMX AM Used metrics for queue wrong when app submited to nodelabel partition Major . Bibin A Chundatt Bibin A Chundatt
MAPREDUCE-6763 Shuffle server listen queue is too small Major mrv2 Jason Lowe Jason Lowe
YARN-4837 User facing aspects of ‘AM blacklisting’ feature need fixing Critical . Vinod Kumar Vavilapalli Vinod Kumar Vavilapalli
MAPREDUCE-6310 Add jdiff support to MapReduce Blocker . Li Lu Li Lu
YARN-3388 Allocation in LeafQueue could get stuck because DRF calculator isn’t well supported when computing user-limit Major capacityscheduler Nathan Roberts Nathan Roberts
YARN-4685 Disable AM blacklisting by default to mitigate situations that application get hanged Critical resourcemanager Rohith Sharma K S Rohith Sharma K S
HADOOP-13428 Fix hadoop-common to generate jdiff Blocker . Wangda Tan Wangda Tan
HDFS-10764 Fix INodeFile#getBlocks to not return null Major namenode Arpit Agarwal Arpit Agarwal
MAPREDUCE-6762 ControlledJob#toString failed with NPE when job status is not successfully updated Major . Weiwei Yang Weiwei Yang
HDFS-10692 Point JDiff base version for HDFS from 2.6.0 to 2.7.2 Blocker . Wangda Tan Wangda Tan
HADOOP-13487 Hadoop KMS should load old delegation tokens from Zookeeper on startup Major kms Alex Ivanov Xiao Chen
HADOOP-13526 Add detailed logging in KMS for the authentication failure of proxy user Minor kms Suraj Acharya Suraj Acharya
HDFS-8312 Trash does not descent into child directories to check for permissions Critical fs, security Eric Yang Weiwei Yang
HDFS-10783 The option ‘-maxSize’ and ‘-step’ fail in OfflineImageViewer Major tools Yiqun Lin Yiqun Lin
HADOOP-13524 mvn eclipse:eclipse generates .gitignore’able files Major . Vinod Kumar Vavilapalli Vinod Kumar Vavilapalli
HADOOP-13497 fix wrong command in CredentialProviderAPI.md Trivial documentation Yuanbo Liu Yuanbo Liu
MAPREDUCE-6761 Regression when handling providers - invalid configuration ServiceConfiguration causes Cluster initialization failure Major mrv2 Peter Vary Peter Vary
MAPREDUCE-6767 TestSlive fails after a common change Major . Kihwal Lee Daniel Templeton
YARN-5537 Intermittent test failure of TestAMRMClient#testAMRMClientWithContainerResourceChange Major . Varun Saxena Bibin A Chundatt
HADOOP-13532 Fix typo in hadoop_connect_to_hosts error message Trivial scripts Albert Chu Albert Chu
HADOOP-13533 User cannot set empty HADOOP_SSH_OPTS environment variable option Minor scripts Albert Chu Albert Chu
HDFS-10748 TestFileTruncate#testTruncateWithDataNodesRestart runs sometimes timeout Major test Xiaoyu Yao Yiqun Lin
YARN-5430 Return container’s ip and host from NM ContainerStatus call Major . Jian He Jian He
HDFS-8915 TestFSNamesystem.testFSLockGetWaiterCount fails intermittently in jenkins Minor test Anu Engineer Masatake Iwasaki
YARN-5373 NPE listing wildcard directory in containerLaunch Blocker nodemanager Haibo Chen Daniel Templeton
HDFS-10793 Fix HdfsAuditLogger binary incompatibility introduced by HDFS-9184 Blocker . Andrew Wang Manoj Govindassamy
HDFS-10652 Add a unit test for HDFS-4660 Major datanode, hdfs Yongjun Zhang Vinayakumar B
HADOOP-13552 RetryInvocationHandler logs all remote exceptions Blocker ipc Jason Lowe Jason Lowe
HADOOP-12765 HttpServer2 should switch to using the non-blocking SslSelectChannelConnector to prevent performance degradation when handling SSL connections Major . Min Shen Min Shen
MAPREDUCE-6768 TestRecovery.testSpeculative failed with NPE Major mrv2 Haibo Chen Haibo Chen
HADOOP-13559 Remove close() within try-with-resources in ChecksumFileSystem/ChecksumFs classes Minor fs Aaron Fabbri Aaron Fabbri
HDFS-4210 Throw helpful exception when DNS entry for JournalNode cannot be resolved Trivial ha, journal-node, namenode Damien Hardy John Zhuge
YARN-5190 Registering/unregistering container metrics triggered by ContainerEvent and ContainersMonitorEvent are conflict which cause uncaught exception in ContainerMonitorImpl Blocker . Junping Du Junping Du
HADOOP-12597 In kms-site.xml configuration “hadoop.security.keystore.JavaKeyStoreProvider.password” should be updated with new name Minor security huangyitian Surendra Singh Lilhore
HDFS-10423 Increase default value of httpfs maxHttpHeaderSize Minor hdfs Nicolae Popa Nicolae Popa
HADOOP-13410 RunJar adds the content of the jar twice to the classpath Major util Sangjin Lee Yuanbo Liu
HDFS-10570 Remove classpath conflicts of netty-all jar in hadoop-hdfs-client Minor test Vinayakumar B Vinayakumar B
YARN-5234 ResourceManager REST API missing descriptions for what’s returned when using Fair Scheduler Minor documentation, fairscheduler, resourcemanager Grant Sohn
HDFS-10620 StringBuilder created and appended even if logging is disabled Major namenode Staffan Friberg Staffan Friberg
YARN-4925 ContainerRequest in AMRMClient, application should be able to specify nodes/racks together with nodeLabelExpression Major . Bibin A Chundatt Bibin A Chundatt
MAPREDUCE-6433 launchTime may be negative Major jobhistoryserver, mrv2 Allen Wittenauer zhihai xu
MAPREDUCE-6641 TestTaskAttempt fails in trunk Major test Tsuyoshi Ozawa Haibo Chen
YARN-5195 RM intermittently crashed with NPE while handling APP_ATTEMPT_REMOVED event when async-scheduling enabled in CapacityScheduler Major resourcemanager Karam Singh sandflee
HADOOP-12751 While using kerberos Hadoop incorrectly assumes names with ‘@’ to be non-simple Critical security Bolke de Bruin Bolke de Bruin

TESTS:

JIRA Summary Priority Component Reporter Contributor
MAPREDUCE-2669 Some new examples and test cases for them. Minor examples Plamen Jeliazkov Plamen Jeliazkov
HDFS-3121 hdfs tests for HADOOP-8014 Major test John George John George
HADOOP-8434 TestConfiguration currently has no tests for direct setter methods Major test Harsh J madhukara phatak
HDFS-2127 Add a test that ensure AccessControlExceptions contain a full path Major namenode Eli Collins Stephen Chu
HADOOP-8844 Add a plaintext fs -text test-case Major fs Harsh J Akira Ajisaka
HADOOP-11084 jenkins patchprocess links are broken Major scripts Colin P. McCabe Arpit Agarwal
MAPREDUCE-6191 TestJavaSerialization fails with getting incorrect MR job result Minor test sam liu sam liu
HADOOP-10668 TestZKFailoverControllerStress#testExpireBackAndForth occasionally fails Major test Ted Yu Ming Ma
YARN-3339 TestDockerContainerExecutor should pull a single image and not the entire centos repository Minor test Ravindra Kumar Naik Ravindra Kumar Naik
YARN-1880 Cleanup TestApplicationClientProtocolOnHA Trivial test Tsuyoshi Ozawa Tsuyoshi Ozawa
HDFS-6263 Remove DRFA.MaxBackupIndex config from log4j.properties Minor . Akira Ajisaka Abhiraj Butala
HDFS-6408 Remove redundant definitions in log4j.properties Minor test Abhiraj Butala Abhiraj Butala
YARN-2666 TestFairScheduler.testContinuousScheduling fails Intermittently Major scheduler Tsuyoshi Ozawa zhihai xu
HADOOP-11781 fix race conditions and add URL support to smart-apply-patch.sh Major test Allen Wittenauer Raymie Stata
HDFS-8247 TestDiskspaceQuotaUpdate#testAppendOverTypeQuota is failing Major test Anu Engineer Xiaoyu Yao
HADOOP-11881 test-patch.sh javac result is wildly wrong Major build, test Allen Wittenauer Kengo Seki
HADOOP-11904 test-patch.sh goes into an infinite loop on non-maven builds Critical test Allen Wittenauer Allen Wittenauer
YARN-3343 TestCapacitySchedulerNodeLabelUpdate.testNodeUpdate sometime fails in trunk Minor . Xuan Gong Rohith Sharma K S
YARN-3580 [JDK 8] TestClientRMService.testGetLabelsToNodes fails Major test Robert Kanter Robert Kanter
HDFS-7559 Create unit test to automatically compare HDFS related classes and hdfs-default.xml Minor . Ray Chiang Ray Chiang
HADOOP-11906 test-patch.sh should use ‘file’ command for patch determinism Major . Allen Wittenauer Sean Busbey
YARN-3602 TestResourceLocalizationService.testPublicResourceInitializesLocalDir fails Intermittently due to IOException from cleanup Minor test zhihai xu zhihai xu
HDFS-8243 Files written by TestHostsFiles and TestNameNodeMXBean are causing Release Audit Warnings. Minor test Ruth Wisniewski Ruth Wisniewski
HADOOP-11884 test-patch.sh should pull the real findbugs version Minor test Allen Wittenauer Kengo Seki
HADOOP-11944 add option to test-patch to avoid relocating patch process directory Minor . Sean Busbey Sean Busbey
HADOOP-11949 Add user-provided plugins to test-patch Major . Sean Busbey Sean Busbey
HADOOP-12000 cannot use –java-home in test-patch Major scripts Allen Wittenauer Allen Wittenauer
MAPREDUCE-6204 TestJobCounters should use new properties instead of JobConf.MAPRED_TASK_JAVA_OPTS Minor test sam liu sam liu
HADOOP-12035 shellcheck plugin displays a wrong version potentially Trivial build Kengo Seki Kengo Seki
HADOOP-12030 test-patch should only report on newly introduced findbugs warnings. Major . Sean Busbey Sean Busbey
HADOOP-11930 test-patch in offline mode should tell maven to be in offline mode Major . Sean Busbey Sean Busbey
HADOOP-11965 determine-flaky-tests needs a summary mode Minor . Allen Wittenauer Yufei Gu
YARN-2871 TestRMRestart#testRMRestartGetApplicationList sometime fails in trunk Minor . Ted Yu zhihai xu
YARN-3956 Fix TestNodeManagerHardwareUtils fails on Mac Minor nodemanager Varun Vasudev Varun Vasudev
HDFS-8834 TestReplication#testReplicationWhenBlockCorruption is not valid after HDFS-6482 Minor datanode Lei (Eddy) Xu Lei (Eddy) Xu
HADOOP-10854 unit tests for the shell scripts Major scripts Allen Wittenauer Allen Wittenauer
YARN-3992 TestApplicationPriority.testApplicationPriorityAllocation fails intermittently Major . Zhijie Shen Sunil Govindan
HDFS-2070 Add more unit tests for FsShell getmerge Major test XieXianshan Daniel Templeton
MAPREDUCE-5045 UtilTest#isCygwin method appears to be unused Trivial contrib/streaming, test Chris Nauroth Neelesh Srinivas Salian
YARN-3573 MiniMRYarnCluster constructor that starts the timeline server using a boolean should be marked deprecated Major timelineserver Mit Desai Brahma Reddy Battula
HDFS-9295 Add a thorough test of the full KMS code path Critical security, test Daniel Templeton Daniel Templeton
HDFS-9339 Extend full test of KMS ACLs Major test Daniel Templeton Daniel Templeton
HDFS-9354 Fix TestBalancer#testBalancerWithZeroThreadsForMove on Windows Major test Xiaoyu Yao Xiaoyu Yao
HDFS-9410 Some tests should always reset sysout and syserr Minor test Xiao Chen Xiao Chen
HADOOP-12564 Upgrade JUnit3 TestCase to JUnit 4 in org.apache.hadoop.io package Trivial test Dustin Cote Dustin Cote
HDFS-9153 Pretty-format the output for DFSIO Major . Kai Zheng Kai Zheng
HDFS-9429 Tests in TestDFSAdminWithHA intermittently fail with EOFException Major test Xiao Chen Xiao Chen
HADOOP-10729 Add tests for PB RPC in case version mismatch of client and server Major ipc Junping Du Junping Du
HDFS-9300 TestDirectoryScanner.testThrottle() is still a little flakey Major balancer & mover, test Daniel Templeton Daniel Templeton
HDFS-7553 fix the TestDFSUpgradeWithHA due to BindException Major test Liang Xie Xiao Chen
HDFS-9626 TestBlockReplacement#testBlockReplacement fails occasionally Minor test Xiao Chen Xiao Chen
HADOOP-12696 Add Tests for S3FileSystem Contract Major tools Matthew Paduano Matthew Paduano
HADOOP-12736 TestTimedOutTestsListener#testThreadDumpAndDeadlocks sometimes times out Major . Xiao Chen Xiao Chen
HADOOP-12715 TestValueQueue#testgetAtMostPolicyALL fails intermittently Major . Xiao Chen Xiao Chen
HDFS-9773 Remove dead code related to SimulatedFSDataset in tests Minor test Akira Ajisaka Brahma Reddy Battula
YARN-4704 TestResourceManager#testResourceAllocation() fails when using FairScheduler Major fairscheduler, test Ray Chiang Yufei Gu
HDFS-9888 Allow reseting KerberosName in unit tests Minor . Xiao Chen Xiao Chen
YARN-4717 TestResourceLocalizationService.testPublicResourceInitializesLocalDir fails Intermittently due to IllegalArgumentException from cleanup Minor nodemanager Daniel Templeton Daniel Templeton
HDFS-9949 Add a test case to ensure that the DataNode does not regenerate its UUID when a storage directory is cleared Minor . Harsh J Harsh J
HADOOP-12738 Create unit test to automatically compare Common related classes and core-default.xml Minor . Ray Chiang Ray Chiang
HADOOP-12101 Add automatic search of default Configuration variables to TestConfigurationFieldsBase Major test Ray Chiang Ray Chiang
HADOOP-13051 Add Glob unit test for special characters Minor fs Harsh J Harsh J
YARN-4947 Test timeout is happening for TestRMWebServicesNodes Major test Bibin A Chundatt Bibin A Chundatt
HADOOP-12701 Run checkstyle on test source files Minor . John Zhuge John Zhuge
YARN-5069 TestFifoScheduler.testResourceOverCommit race condition Major test Eric Badger Eric Badger
HADOOP-13178 TestShellBasedIdMapping.testStaticMapUpdate doesn’t work on OS X Major test Allen Wittenauer Kai Sasaki
YARN-5114 Add additional tests in TestRMWebServicesApps and rectify testInvalidAppAttempts failure in 2.8 Minor . Bibin A Chundatt Bibin A Chundatt
YARN-5024 TestContainerResourceUsage#testUsageAfterAMRestartWithMultipleContainers random failure Major test Bibin A Chundatt Bibin A Chundatt
YARN-5005 TestRMWebServices#testDumpingSchedulerLogs fails randomly Major . Bibin A Chundatt Bibin A Chundatt
YARN-5118 Tests fails with localizer port bind exception. Major test Brahma Reddy Battula Brahma Reddy Battula
HDFS-10375 Remove redundant TestMiniDFSCluster.testDualClusters Trivial test John Zhuge Jiayi Zhou
YARN-4989 TestWorkPreservingRMRestart#testCapacitySchedulerRecovery fails intermittently Major test Rohith Sharma K S Ajith S
YARN-5208 Run TestAMRMClient TestNMClient TestYarnClient TestClientRMTokens TestAMAuthorization tests with hadoop.security.token.service.use_ip enabled Blocker test Rohith Sharma K S Rohith Sharma K S
HADOOP-12875 [Azure Data Lake] Support for contract test and unit test cases Major fs/adl, test, tools Vishwajeet Dusane Vishwajeet Dusane
HADOOP-9321 fix coverage org.apache.hadoop.net Major . Aleksey Gorshkov Ivan A. Veselovsky
HADOOP-9330 Add custom JUnit4 test runner with configurable timeout Major test Steve Loughran Steve Loughran
YARN-5023 TestAMRestart#testShouldNotCountFailureToMaxAttemptRetry random failure Major . Bibin A Chundatt sandflee
YARN-5318 TestRMAdminService#testRefreshNodesResourceWithFileSystemBasedConfigurationProvider fails intermittently. Minor . sandflee Jun Gong
YARN-5037 TestRMRestart#testQueueMetricsOnRMRestart random failure Major . sandflee sandflee
YARN-5317 testAMRestartNotLostContainerCompleteMsg may fail Minor . sandflee sandflee
YARN-5159 Wrong Javadoc tag in MiniYarnCluster Major documentation Andras Bokor Andras Bokor
MAPREDUCE-6738 TestJobListCache.testAddExisting failed intermittently in slow VM testbed Minor . Junping Du Junping Du
YARN-5092 TestRMDelegationTokens fails intermittently Major test Rohith Sharma K S Jason Lowe
HADOOP-10980 TestActiveStandbyElector fails occasionally in trunk Minor . Ted Yu Eric Badger
HADOOP-13395 Enhance TestKMSAudit Minor kms Xiao Chen Xiao Chen
YARN-5343 TestContinuousScheduling#testSortedNodes fails intermittently Minor . sandflee Yufei Gu
YARN-2398 TestResourceTrackerOnHA crashes Major test Jason Lowe Ajith S
YARN-5492 TestSubmitApplicationWithRMHA is failing sporadically during precommit builds Major test Jason Lowe Vrushali C
YARN-5544 TestNodeBlacklistingOnAMFailures fails on trunk Major test Varun Saxena Sunil Govindan
HDFS-9745 TestSecureNNWithQJM#testSecureMode sometimes fails with timeouts Minor . Xiao Chen Xiao Chen
YARN-5389 TestYarnClient#testReservationDelete fails Major . Rohith Sharma K S Sean Po
YARN-5560 Clean up bad exception catching practices in TestYarnClient Major . Sean Po Sean Po
HADOOP-7363 TestRawLocalFileSystemContract is needed Major fs Matt Foley Andras Bokor

SUB-TASKS:

JIRA Summary Priority Component Reporter Contributor
HDFS-3178 Add states for journal synchronization in journal daemon Major ha, namenode Tsz Wo Nicholas Sze Tsz Wo Nicholas Sze
HDFS-3273 Refactor BackupImage and FSEditLog Major ha, namenode Tsz Wo Nicholas Sze Tsz Wo Nicholas Sze
HDFS-3292 Remove the deprecated DistributedFileSystem.DiskStatus and the related methods Major hdfs-client Tsz Wo Nicholas Sze Arpit Gupta
HADOOP-9258 Add stricter tests to FileSystemContractTestBase Major test Steve Loughran Steve Loughran
MAPREDUCE-5189 Basic AM changes to support preemption requests (per YARN-45) Major mr-am, mrv2 Carlo Curino Carlo Curino
MAPREDUCE-5867 Possible NPE in KillAMPreemptionPolicy related to ProportionalCapacityPreemptionPolicy Major resourcemanager Sunil Govindan Sunil Govindan
HDFS-6922 Add LazyPersist flag to INodeFile, save it in FsImage and edit logs Major datanode Arpit Agarwal Arpit Agarwal
HDFS-7071 Updated editsStored and editsStored.xml to bump layout version and add LazyPersist flag Major namenode Xiaoyu Yao Xiaoyu Yao
MAPREDUCE-6078 native-task: fix gtest build on macosx Trivial task Binglin Chang Binglin Chang
HDFS-7184 Allow data migration tool to run as a daemon Minor balancer & mover, scripts Benoy Antony Benoy Antony
HDFS-7035 Make adding a new data directory to the DataNode an atomic operation and improve error handling Major datanode Lei (Eddy) Xu Lei (Eddy) Xu
YARN-2766 ApplicationHistoryManager is expected to return a sorted list of apps/attempts/containers Major timelineserver Robert Kanter Robert Kanter
YARN-1984 LeveldbTimelineStore does not handle db exceptions properly Major . Jason Lowe Varun Saxena
YARN-2920 CapacityScheduler should be notified when labels on nodes changed Major . Wangda Tan Wangda Tan
YARN-3063 Bootstrap TimelineServer Next Gen Module Major timelineserver Zhijie Shen Zhijie Shen
YARN-3092 Create common ResourceUsage class to track labeled resource usages in Capacity Scheduler Major api, client, resourcemanager Wangda Tan Wangda Tan
YARN-3030 [Collector wireup] Set up timeline collector with basic request serving structure and lifecycle Major timelineserver Sangjin Lee Sangjin Lee
YARN-3011 NM dies because of the failure of resource localization Major nodemanager Wang Hao Varun Saxena
YARN-3099 Capacity Scheduler LeafQueue/ParentQueue should use ResourceUsage to track used-resources-by-label. Major api, client, resourcemanager Wangda Tan Wangda Tan
YARN-3098 Create common QueueCapacities class in Capacity Scheduler to track capacities-by-labels of queues Major capacityscheduler Wangda Tan Wangda Tan
YARN-2694 Ensure only single node labels specified in resource request / host, and node label expression only specified when resourceName=ANY Major capacityscheduler, resourcemanager Wangda Tan Wangda Tan
HDFS-7751 Fix TestHDFSCLI for quota with storage type Minor test Xiaoyu Yao Xiaoyu Yao
YARN-3124 Capacity Scheduler LeafQueue/ParentQueue should use QueueCapacities to track capacities-by-label Major api, client, resourcemanager Wangda Tan Wangda Tan
YARN-3041 [Data Model] create overall data objects of TS next gen Major timelineserver Sangjin Lee Zhijie Shen
YARN-3240 [Data Mode] Implement client API to put generic entities Major timelineserver Zhijie Shen Zhijie Shen
YARN-3087 [Collector implementation] the REST server (web server) for per-node collector does not work if it runs inside node manager Major timelineserver Sangjin Lee Li Lu
YARN-3125 [Event producers] Change distributed shell to use new timeline service Major timelineserver Zhijie Shen Junping Du
YARN-3210 [Source organization] Refactor timeline collector according to new code organization Major timelineserver Li Lu Li Lu
YARN-3264 [Storage implementation] Create backing storage write interface and a POC only file based storage implementation Major timelineserver Vrushali C Vrushali C
YARN-1809 Synchronize RM and Generic History Service Web-UIs Major . Zhijie Shen Xuan Gong
YARN-1884 ContainerReport should have nodeHttpAddress Major . Zhijie Shen Xuan Gong
HADOOP-11710 Make CryptoOutputStream behave like DFSOutputStream wrt synchronization Critical fs Sean Busbey Sean Busbey
YARN-3171 Sort by Application id, AppAttempt & ContainerID doesn’t work in ATS / RM web ui Minor timelineserver Jeff Zhang Naganarasimha G R
YARN-3039 [Collector wireup] Implement timeline app-level collector service discovery Major timelineserver Sangjin Lee Junping Du
YARN-3377 TestTimelineServiceClientIntegration fails Minor timelineserver Sangjin Lee Sangjin Lee
YARN-3356 Capacity Scheduler FiCaSchedulerApp should use ResourceUsage to track used-resources-by-label. Major capacityscheduler, resourcemanager Wangda Tan Wangda Tan
YARN-3345 Add non-exclusive node label API to RMAdmin protocol and NodeLabelsManager Major api, client, resourcemanager Wangda Tan Wangda Tan
HDFS-7854 Separate class DataStreamer out of DFSOutputStream Major hdfs-client Li Bo Li Bo
YARN-3034 [Collector wireup] Implement RM starting its timeline collector Major timelineserver Sangjin Lee Naganarasimha G R
HDFS-7713 Implement mkdirs in the HDFS Web UI Major ui Ravi Prakash Ravi Prakash
YARN-3040 [Data Model] Make putEntities operation be aware of the app’s context Major timelineserver Sangjin Lee Zhijie Shen
YARN-2495 Allow admin specify labels from each NM (Distributed configuration) Major resourcemanager Wangda Tan Naganarasimha G R
YARN-3374 Collector’s web server should randomly bind an available port Major timelineserver Zhijie Shen Zhijie Shen
HDFS-7893 Update the POM to create a separate hdfs-client jar Major build Haohui Mai Haohui Mai
YARN-3365 Add support for using the ‘tc’ tool via container-executor Major nodemanager Sidharta Seethana Sidharta Seethana
HDFS-8034 Fix TestDFSClientRetries#testDFSClientConfigurationLocateFollowingBlockInitialDelay for Windows Minor test Xiaoyu Yao Xiaoyu Yao
YARN-3334 [Event Producers] NM TimelineClient container metrics posting to new timeline service. Major nodemanager Junping Du Junping Du
YARN-3110 Few issues in ApplicationHistory web ui Minor applications, timelineserver Bibin A Chundatt Naganarasimha G R
HDFS-8049 Annotation client implementation as private Major hdfs-client Tsz Wo Nicholas Sze Takuya Fukudome
HDFS-8079 Separate the client retry conf from DFSConfigKeys Major hdfs-client Tsz Wo Nicholas Sze Tsz Wo Nicholas Sze
HDFS-8080 Separate JSON related routines used by WebHdfsFileSystem to a package local class Minor hdfs-client Haohui Mai Haohui Mai
HDFS-8085 Move CorruptFileBlockIterator to the hdfs.client.impl package Minor hdfs-client Tsz Wo Nicholas Sze Tsz Wo Nicholas Sze
HDFS-8089 Move o.a.h.hdfs.web.resources.* to the client jars Minor build Haohui Mai Haohui Mai
HDFS-8102 Separate webhdfs retry configuration keys from DFSConfigKeys Minor hdfs-client Haohui Mai Haohui Mai
YARN-3391 Clearly define flow ID/ flow run / flow version in API and storage Major timelineserver Zhijie Shen Zhijie Shen
YARN-1376 NM need to notify the log aggregation status to RM through Node heartbeat Major . Xuan Gong Xuan Gong
HDFS-8100 Refactor DFSClient.Conf to a standalone class Minor hdfs-client Tsz Wo Nicholas Sze Tsz Wo Nicholas Sze
HDFS-8103 Move BlockTokenSecretManager.AccessMode into BlockTokenIdentifier Minor security Haohui Mai Haohui Mai
HDFS-8084 Separate the client failover conf from DFSConfigKeys Major hdfs-client Tsz Wo Nicholas Sze Tsz Wo Nicholas Sze
HDFS-8083 Separate the client write conf from DFSConfigKeys Major hdfs-client Tsz Wo Nicholas Sze Tsz Wo Nicholas Sze
YARN-3347 Improve YARN log command to get AMContainer logs as well as running containers logs Major log-aggregation Xuan Gong Xuan Gong
YARN-3443 Create a ‘ResourceHandler’ subsystem to ease addition of support for new resource types on the NM Major nodemanager Sidharta Seethana Sidharta Seethana
HDFS-7701 Support reporting per storage type quota and usage with hadoop/hdfs shell Major datanode, namenode Xiaoyu Yao Peter Shi
YARN-3361 CapacityScheduler side changes to support non-exclusive node labels Major capacityscheduler Wangda Tan Wangda Tan
YARN-3318 Create Initial OrderingPolicy Framework and FifoOrderingPolicy Major scheduler Craig Welch Craig Welch
YARN-3326 Support RESTful API for getLabelsToNodes Minor resourcemanager Naganarasimha G R Naganarasimha G R
YARN-3354 Container should contains node-labels asked by original ResourceRequests Major api, capacityscheduler, nodemanager, resourcemanager Wangda Tan Wangda Tan
HDFS-8082 Separate the client read conf from DFSConfigKeys Major hdfs-client Tsz Wo Nicholas Sze Tsz Wo Nicholas Sze
HDFS-8165 Move GRANDFATHER_GENERATION_STAMP and GRANDFATER_INODE_ID to hdfs-client Major build Haohui Mai Haohui Mai
YARN-1402 Related Web UI, CLI changes on exposing client API to check log aggregation status Major . Xuan Gong Xuan Gong
YARN-2696 Queue sorting in CapacityScheduler should consider node label Major capacityscheduler, resourcemanager Wangda Tan Wangda Tan
YARN-3487 CapacityScheduler scheduler lock obtained unnecessarily when calling getQueue Critical capacityscheduler Jason Lowe Jason Lowe
YARN-3136 getTransferredContainers can be a bottleneck during AM registration Major scheduler Jason Lowe Sunil Govindan
HDFS-8169 Move LocatedBlocks and related classes to hdfs-client Major build, hdfs-client Haohui Mai Haohui Mai
YARN-3463 Integrate OrderingPolicy Framework with CapacityScheduler Major capacityscheduler Craig Welch Craig Welch
MAPREDUCE-6327 [Event producers] Implement MapReduce AM writing MR events/counters to v2 ATS Major . Sangjin Lee Junping Du
HDFS-8185 Separate client related routines in HAUtil into a new class Major build, hdfs-client Haohui Mai Haohui Mai
YARN-3225 New parameter or CLI for decommissioning node gracefully in RMAdmin CLI Major graceful Junping Du Devaraj K
HDFS-8218 Move classes that used by ClientProtocol into hdfs-client Major build Haohui Mai Haohui Mai
HADOOP-11850 Typos in hadoop-common java docs Minor . Surendra Singh Lilhore Surendra Singh Lilhore
YARN-3366 Outbound network bandwidth : classify/shape traffic originating from YARN containers Major . Sidharta Seethana Sidharta Seethana
YARN-2605 [RM HA] Rest api endpoints doing redirect incorrectly Major resourcemanager bc Wong Xuan Gong
YARN-3319 Implement a FairOrderingPolicy Major scheduler Craig Welch Craig Welch
YARN-3413 Node label attributes (like exclusivity) should settable via addToClusterNodeLabels but shouldn’t be changeable at runtime Major api, client, resourcemanager Wangda Tan Wangda Tan
HADOOP-11852 Disable symlinks in trunk Major . Andrew Wang Andrew Wang
YARN-3390 Reuse TimelineCollectorManager for RM Major timelineserver Zhijie Shen Zhijie Shen
YARN-2498 Respect labels in preemption policy of capacity scheduler for inter-queue preemption Major resourcemanager Wangda Tan Wangda Tan
YARN-3431 Sub resources of timeline entity needs to be passed to a separate endpoint. Major timelineserver Zhijie Shen Zhijie Shen
YARN-2740 Fix NodeLabelsManager to properly handle node label modifications when distributed node label configuration enabled Major resourcemanager Wangda Tan Naganarasimha G R
MAPREDUCE-6335 convert load test driver to timeline service v.2 Major . Sangjin Lee Sangjin Lee
YARN-3544 AM logs link missing in the RM UI for a completed app Blocker . Hitesh Shah Xuan Gong
YARN-2619 NodeManager: Add cgroups support for disk I/O isolation Major . Wei Yan Varun Vasudev
HDFS-8086 Move LeaseRenewer to the hdfs.client.impl package Minor hdfs-client Tsz Wo Nicholas Sze Takanobu Asanuma
YARN-3006 Improve the error message when attempting manual failover with auto-failover enabled Minor . Akira Ajisaka Akira Ajisaka
HDFS-8249 Separate HdfsConstants into the client and the server side class Major hdfs-client Haohui Mai Haohui Mai
HDFS-8309 Skip unit test using DataNodeTestUtils#injectDataDirFailure() on Windows Minor test Xiaoyu Yao Xiaoyu Yao
HDFS-8237 Move all protocol classes used by ClientProtocol to hdfs-client Major build Haohui Mai Haohui Mai
YARN-3551 Consolidate data model change according to the backend implementation Major timelineserver Zhijie Shen Zhijie Shen
HDFS-8314 Move HdfsServerConstants#IO_FILE_BUFFER_SIZE and SMALL_BUFFER_SIZE to the users Major . Haohui Mai Li Lu
HDFS-8310 Fix TestCLI.testAll ‘help: help for find’ on Windows Minor test Xiaoyu Yao Kiran Kumar M R
YARN-3301 Fix the format issue of the new RM web UI and AHS web UI after YARN-3272 / YARN-3262 Major resourcemanager Xuan Gong Xuan Gong
YARN-3562 unit tests failures and issues found from findbug from earlier ATS checkins Minor timelineserver Sangjin Lee Naganarasimha G R
YARN-3448 Add Rolling Time To Lives Level DB Plugin Capabilities Major timelineserver Jonathan Eagles Jonathan Eagles
YARN-2918 Don’t fail RM if queue’s configured labels are not existed in cluster-node-labels Major resourcemanager Rohith Sharma K S Wangda Tan
YARN-644 Basic null check is not performed on passed in arguments before using them in ContainerManagerImpl.startContainer Minor nodemanager Omkar Vinit Joshi Varun Saxena
YARN-3593 Add label-type and Improve “DEFAULT_PARTITION” in Node Labels Page Major webapp Naganarasimha G R Naganarasimha G R
YARN-2331 Distinguish shutdown during supervision vs. shutdown for rolling upgrade Major nodemanager Jason Lowe Jason Lowe
YARN-3134 [Storage implementation] Exploiting the option of using Phoenix to access HBase backend Major timelineserver Zhijie Shen Li Lu
YARN-3529 Add miniHBase cluster and Phoenix support to ATS v2 unit tests Major timelineserver Li Lu Li Lu
YARN-3634 TestMRTimelineEventHandling and TestApplication are broken Major timelineserver Sangjin Lee Sangjin Lee
YARN-3579 CommonNodeLabelsManager should support NodeLabel instead of string label name when getting node-to-label/label-to-label mappings Minor resourcemanager Sunil Govindan Sunil Govindan
MAPREDUCE-6337 add a mode to replay MR job history files to the timeline service Major . Sangjin Lee Sangjin Lee
YARN-3505 Node’s Log Aggregation Report with SUCCEED should not cached in RMApps Critical log-aggregation Junping Du Xuan Gong
HDFS-8403 Eliminate retries in TestFileCreation#testOverwriteOpenForWrite Major test Arpit Agarwal Arpit Agarwal
HDFS-8157 Writes to RAM DISK reserve locked memory for block files Major datanode Arpit Agarwal Arpit Agarwal
YARN-3541 Add version info on timeline service / generic history web UI and REST API Major timelineserver Zhijie Shen Zhijie Shen
YARN-3565 NodeHeartbeatRequest/RegisterNodeManagerRequest should use NodeLabel object instead of String Blocker api, client, resourcemanager Wangda Tan Naganarasimha G R
YARN-3583 Support of NodeLabel object instead of plain String in YarnClient side. Major client Sunil Govindan Sunil Govindan
YARN-3609 Move load labels from storage from serviceInit to serviceStart to make it works with RM HA case. Major resourcemanager Wangda Tan Wangda Tan
YARN-3684 Change ContainerExecutor’s primary lifecycle methods to use a more extensible mechanism for passing information. Major yarn Sidharta Seethana Sidharta Seethana
YARN-3411 [Storage implementation] explore & create the native HBase schema for writes Critical timelineserver Sangjin Lee Vrushali C
HDFS-8454 Remove unnecessary throttling in TestDatanodeDeath Major test Arpit Agarwal Arpit Agarwal
MAPREDUCE-6370 Timeline service v2 load generator needs to write event id Major . Li Lu Li Lu
YARN-3632 Ordering policy should be allowed to reorder an application when demand changes Major capacityscheduler Craig Welch Craig Welch
YARN-3686 CapacityScheduler should trim default_node_label_expression Critical api, client, resourcemanager Wangda Tan Sunil Govindan
YARN-3647 RMWebServices api’s should use updated api from CommonNodeLabelsManager to get NodeLabel object Major resourcemanager Sunil Govindan Sunil Govindan
YARN-3581 Deprecate -directlyAccessNodeLabelStore in RMAdminCLI Major api, client, resourcemanager Wangda Tan Naganarasimha G R
HDFS-8482 Rename BlockInfoContiguous to BlockInfo Major . Zhe Zhang Zhe Zhang
YARN-3700 ATS Web Performance issue at load time when large number of jobs Major resourcemanager, webapp, yarn Xuan Gong Xuan Gong
YARN-3726 Fix TestHBaseTimelineWriterImpl unit test failure by fixing it’s test data Major timelineserver Vrushali C Vrushali C
YARN-3721 build is broken on YARN-2928 branch due to possible dependency cycle Blocker timelineserver Sangjin Lee Li Lu
YARN-3716 Node-label-expression should be included by ResourceRequestPBImpl.toString Minor api Xianyin Xin Xianyin Xin
YARN-3740 Fixed the typo with the configuration name: APPLICATION_HISTORY_PREFIX_MAX_APPS Major resourcemanager, webapp, yarn Xuan Gong Xuan Gong
YARN-2900 Application (Attempt and Container) Not Found in AHS results in Internal Server Error (500) Major timelineserver Jonathan Eagles Mit Desai
HDFS-8489 Subclass BlockInfo to represent contiguous blocks Major namenode Zhe Zhang Zhe Zhang
YARN-3276 Refactor and fix null casting in some map cast for TimelineEntity (old and new) and fix findbug warnings Major timelineserver Junping Du Junping Du
YARN-2392 add more diags about app retry limits on AM failures Minor resourcemanager Steve Loughran Steve Loughran
YARN-3766 ATS Web UI breaks because of YARN-3467 Blocker resourcemanager, webapp, yarn Xuan Gong Xuan Gong
YARN-1462 AHS API and other AHS changes to handle tags for completed MR jobs Major . Karthik Kambatla Xuan Gong
YARN-1279 Expose a client API to allow clients to figure if log aggregation is complete Major . Arun C Murthy Xuan Gong
YARN-3787 loading applications by filtering appstartedTime period for ATS Web UI Major resourcemanager, webapp, yarn Xuan Gong Xuan Gong
HDFS-7923 The DataNodes should rate-limit their full block reports by asking the NN on heartbeat messages Major . Colin P. McCabe Colin P. McCabe
YARN-3044 [Event producers] Implement RM writing app lifecycle events to ATS Major timelineserver Sangjin Lee Naganarasimha G R
HDFS-8540 Mover should exit with NO_MOVE_BLOCK if no block can be moved Major balancer & mover Tsz Wo Nicholas Sze Surendra Singh Lilhore
YARN-3711 Documentation of ResourceManager HA should explain configurations about listen addresses Minor documentation Masatake Iwasaki Masatake Iwasaki
YARN-3801 [JDK-8][YARN-2928] Exclude jdk.tools from hbase-client and hbase-testing-util Major timelineserver Tsuyoshi Ozawa Tsuyoshi Ozawa
HDFS-8597 Fix TestFSImage#testZeroBlockSize on Windows Major datanode, test Xiaoyu Yao Xiaoyu Yao
HDFS-7164 Feature documentation for HDFS-6581 Major documentation Arpit Agarwal Arpit Agarwal
HDFS-8238 Move ClientProtocol to the hdfs-client Major build Haohui Mai Takanobu Asanuma
HDFS-6249 Output AclEntry in PBImageXmlWriter Minor tools Akira Ajisaka Surendra Singh Lilhore
YARN-3706 Generalize native HBase writer for additional tables Minor timelineserver Joep Rottinghuis Joep Rottinghuis
YARN-3521 Support return structured NodeLabel objects in REST API Major api, client, resourcemanager Wangda Tan Sunil Govindan
HDFS-8192 Eviction should key off used locked memory instead of ram disk free space Major datanode Arpit Agarwal Arpit Agarwal
YARN-3792 Test case failures in TestDistributedShell and some issue fixes related to ATSV2 Major timelineserver Naganarasimha G R Naganarasimha G R
HDFS-8651 Make hadoop-hdfs-project Native code -Wall-clean Major native Alan Burlison Alan Burlison
HADOOP-12036 Consolidate all of the cmake extensions in one directory Major . Allen Wittenauer Alan Burlison
HDFS-7390 Provide JMX metrics per storage type Major . Benoy Antony Benoy Antony
HADOOP-12104 Migrate Hadoop Pipes native build to new CMake framework Major build Alan Burlison Alan Burlison
HADOOP-12112 Make hadoop-common-project Native code -Wall-clean Major native Alan Burlison Alan Burlison
HDFS-8493 Consolidate truncate() related implementation in a single class Major . Haohui Mai Rakesh R
HDFS-8635 Migrate HDFS native build to new CMake framework Major build Alan Burlison Alan Burlison
MAPREDUCE-6407 Migrate MAPREDUCE nativetask build to new CMake framework Major build Alan Burlison Alan Burlison
YARN-3827 Migrate YARN native build to new CMake framework Major build Alan Burlison Alan Burlison
MAPREDUCE-6376 Add avro binary support for jhist files Major jobhistoryserver Ray Chiang Ray Chiang
YARN-3051 [Storage abstraction] Create backing storage read interface for ATS readers Major timelineserver Sangjin Lee Varun Saxena
HDFS-8620 Clean up the checkstyle warinings about ClientProtocol Major . Takanobu Asanuma Takanobu Asanuma
HDFS-8726 Move protobuf files that define the client-sever protocols to hdfs-client Major build Haohui Mai Haohui Mai
YARN-3047 [Data Serving] Set up ATS reader with basic request serving structure and lifecycle Major timelineserver Sangjin Lee Varun Saxena
YARN-1012 Report NM aggregated container resource utilization in heartbeat Major nodemanager Arun C Murthy Íñigo Goiri
YARN-3800 Reduce storage footprint for ReservationAllocation Major capacityscheduler, fairscheduler, resourcemanager Anubhav Dhoot Anubhav Dhoot
YARN-3836 add equals and hashCode to TimelineEntity and other classes in the data model Major timelineserver Sangjin Lee Li Lu
YARN-3445 Cache runningApps in RMNode for getting running apps on given NodeId Major nodemanager, resourcemanager Junping Du Junping Du
YARN-3116 [Collector wireup] We need an assured way to determine if a container is an AM container on NM Major nodemanager, timelineserver Zhijie Shen Giovanni Matteo Fumarola
HDFS-8541 Mover should exit with NO_MOVE_PROGRESS if there is no move progress Minor balancer & mover Tsz Wo Nicholas Sze Surendra Singh Lilhore
HDFS-8742 Inotify: Support event for OP_TRUNCATE Major namenode Surendra Singh Lilhore Surendra Singh Lilhore
YARN-1449 AM-NM protocol changes to support container resizing Major api Wangda Tan (No longer used) MENG DING
HADOOP-11974 Fix FIONREAD #include on Solaris Minor net Alan Burlison Alan Burlison
YARN-3930 FileSystemNodeLabelsStore should make sure edit log file closed when exception is thrown Major api, client, resourcemanager Dian Fu Dian Fu
YARN-3844 Make hadoop-yarn-project Native code -Wall-clean Major build Alan Burlison Alan Burlison
HDFS-8794 Improve CorruptReplicasMap#corruptReplicasMap Major . Yi Liu Yi Liu
HDFS-7483 Display information per tier on the Namenode UI Major . Benoy Antony Benoy Antony
YARN-2003 Support for Application priority : Changes in RM and Capacity Scheduler Major resourcemanager Sunil Govindan Sunil Govindan
HDFS-8721 Add a metric for number of encryption zones Major encryption Rakesh R Rakesh R
YARN-1645 ContainerManager implementation to support container resizing Major nodemanager Wangda Tan MENG DING
HDFS-8495 Consolidate append() related implementation into a single class Major namenode Rakesh R Rakesh R
HDFS-8795 Improve InvalidateBlocks#node2blocks Major . Yi Liu Yi Liu
HADOOP-12184 Remove unused Linux-specific constants in NativeIO Major native Martin Walsh Martin Walsh
HDFS-8730 Clean up the import statements in ClientProtocol Minor . Takanobu Asanuma Takanobu Asanuma
YARN-3969 Allow jobs to be submitted to reservation that is active but does not have any allocations Major capacityscheduler, fairscheduler, resourcemanager Subru Krishnan Subru Krishnan
HADOOP-12170 hadoop-common’s JNIFlags.cmake is redundant and can be removed Minor native Alan Burlison Alan Burlison
YARN-3656 LowCost: A Cost-Based Placement Agent for YARN Reservations Major capacityscheduler, resourcemanager Ishai Menache Jonathan Yaniv
YARN-3949 ensure timely flush of timeline writes Major timelineserver Sangjin Lee Sangjin Lee
YARN-3852 Add docker container support to container-executor Major yarn Sidharta Seethana Abin Shahab
YARN-3853 Add docker container runtime support to LinuxContainterExecutor Major yarn Sidharta Seethana Sidharta Seethana
YARN-3908 Bugs in HBaseTimelineWriterImpl Major timelineserver Zhijie Shen Vrushali C
YARN-3867 ContainerImpl changes to support container resizing Major nodemanager MENG DING MENG DING
HDFS-7192 DN should ignore lazyPersist hint if the writer is not local Major datanode Arpit Agarwal Arpit Agarwal
YARN-433 When RM is catching up with node updates then it should not expire acquired containers Major resourcemanager Bikas Saha Xuan Gong
MAPREDUCE-6394 Speed up Task processing loop in HsTasksBlock#render() Major jobhistoryserver Ray Chiang Ray Chiang
HADOOP-7824 NativeIO.java flags and identifiers must be set correctly for each platform, not hardcoded to their Linux values Major native Dmytro Shteflyuk Martin Walsh
YARN-3543 ApplicationReport should be able to tell whether the Application is AM managed or not. Major api Spandan Dutta Rohith Sharma K S
YARN-3993 Change to use the AM flag in ContainerContext determine AM container Major timelineserver Zhijie Shen Sunil Govindan
YARN-4004 container-executor should print output of docker logs if the docker container exits with non-0 exit status Major nodemanager Varun Vasudev Varun Vasudev
YARN-3736 Add RMStateStore apis to store and load accepted reservations for failover Major capacityscheduler, fairscheduler, resourcemanager Subru Krishnan Anubhav Dhoot
YARN-1643 Make ContainersMonitor can support change monitoring size of an allocated container in NM side Major nodemanager Wangda Tan MENG DING
YARN-3984 Rethink event column key issue Major timelineserver Zhijie Shen Vrushali C
YARN-3974 Refactor the reservation system test cases to use parameterized base test Major capacityscheduler, fairscheduler Subru Krishnan Subru Krishnan
YARN-3948 Display Application Priority in RM Web UI Major webapp Sunil Govindan Sunil Govindan
YARN-3049 [Storage Implementation] Implement storage reader interface to fetch raw data from HBase backend Major timelineserver Sangjin Lee Zhijie Shen
YARN-3873 pendingApplications in LeafQueue should also use OrderingPolicy Major capacityscheduler Sunil Govindan Sunil Govindan
YARN-3887 Support for changing Application priority during runtime Major capacityscheduler, resourcemanager Sunil Govindan Sunil Govindan
HDFS-8805 Archival Storage: getStoragePolicy should not need superuser privilege Major balancer & mover, namenode Hui Zheng Brahma Reddy Battula
HDFS-8052 Move WebHdfsFileSystem into hadoop-hdfs-client Major build Haohui Mai Haohui Mai
YARN-3906 split the application table from the entity table Major timelineserver Sangjin Lee Sangjin Lee
YARN-4023 Publish Application Priority to TimelineServer Major timelineserver Sunil Govindan Sunil Govindan
HDFS-8824 Do not use small blocks for balancing the cluster Major balancer & mover Tsz Wo Nicholas Sze Tsz Wo Nicholas Sze
YARN-3534 Collect memory/cpu usage on the node Major nodemanager, resourcemanager Íñigo Goiri Íñigo Goiri
HDFS-8801 Convert BlockInfoUnderConstruction as a feature Major namenode Zhe Zhang Jing Zhao
HDFS-8792 BlockManager#postponedMisreplicatedBlocks should use a LightWeightHashSet to save memory Major . Yi Liu Yi Liu
YARN-3904 Refactor timelineservice.storage to add support to online and offline aggregation writers Major timelineserver Li Lu Li Lu
HDFS-8862 BlockManager#excessReplicateMap should use a HashMap Major namenode Yi Liu Yi Liu
HDFS-8278 HDFS Balancer should consider remaining storage % when checking for under-utilized machines Major balancer & mover Gopal V Tsz Wo Nicholas Sze
YARN-3045 [Event producers] Implement NM writing container lifecycle events to ATS Major timelineserver Sangjin Lee Naganarasimha G R
HDFS-8826 Balancer may not move blocks efficiently in some cases Major balancer & mover Tsz Wo Nicholas Sze Tsz Wo Nicholas Sze
YARN-4025 Deal with byte representations of Longs in writer code Major timelineserver Vrushali C Sangjin Lee
HDFS-8803 Move DfsClientConf to hdfs-client Major build Haohui Mai Mingliang Liu
YARN-4064 build is broken at TestHBaseTimelineWriterImpl.java Blocker timelineserver Sangjin Lee Sangjin Lee
YARN-2923 Support configuration based NodeLabelsProvider Service in Distributed Node Label Configuration Setup Major nodemanager Naganarasimha G R Naganarasimha G R
YARN-1644 RM-NM protocol changes and NodeStatusUpdater implementation to support container resizing Major nodemanager Wangda Tan MENG DING
YARN-3868 ContainerManager recovery for container resizing Major nodemanager MENG DING MENG DING
YARN-3814 REST API implementation for getting raw entities in TimelineReader Major timelineserver Varun Saxena Varun Saxena
HDFS-8823 Move replication factor into individual blocks Major . Haohui Mai Haohui Mai
YARN-221 NM should provide a way for AM to tell it not to aggregate logs. Major log-aggregation, nodemanager Robert Joseph Evans Ming Ma
HDFS-8934 Move ShortCircuitShm to hdfs-client Major build Mingliang Liu Mingliang Liu
HDFS-8948 Use GenericTestUtils to set log levels in TestPread and TestReplaceDatanodeOnFailure Major build Mingliang Liu Mingliang Liu
YARN-4058 Miscellaneous issues in NodeManager project Minor timelineserver Naganarasimha G R Naganarasimha G R
YARN-4014 Support user cli interface in for Application Priority Major client, resourcemanager Rohith Sharma K S Rohith Sharma K S
HDFS-8951 Move the shortcircuit package to hdfs-client Major build Mingliang Liu Mingliang Liu
HDFS-8248 Store INodeId instead of the INodeFile object in BlockInfoContiguous Major . Haohui Mai Haohui Mai
HDFS-8962 Clean up checkstyle warnings in o.a.h.hdfs.DfsClientConf Major build Mingliang Liu Mingliang Liu
YARN-3250 Support admin cli interface in for Application Priority Major resourcemanager Sunil Govindan Rohith Sharma K S
HDFS-8925 Move BlockReaderLocal to hdfs-client Major build Mingliang Liu Mingliang Liu
HDFS-8980 Remove unnecessary block replacement in INodeFile Major namenode Jing Zhao Jing Zhao
HDFS-8990 Move RemoteBlockReader to hdfs-client module Major build Mingliang Liu Mingliang Liu
YARN-4092 RM HA UI redirection needs to be fixed when both RMs are in standby mode Major resourcemanager Xuan Gong Xuan Gong
YARN-4082 Container shouldn’t be killed when node’s label updated. Major capacity scheduler Wangda Tan Wangda Tan
YARN-2801 Add documentation for node labels feature Major documentation Gururaj Shetty Wangda Tan
YARN-3893 Both RM in active state when Admin#transitionToActive failure from refeshAll() Critical resourcemanager Bibin A Chundatt Bibin A Chundatt
HDFS-8890 Allow admin to specify which blockpools the balancer should run on Major balancer & mover Chris Trezzo Chris Trezzo
YARN-4101 RM should print alert messages if Zookeeper and Resourcemanager gets connection issue Critical yarn Yesha Vora Xuan Gong
YARN-3970 REST api support for Application Priority Major webapp Sunil Govindan Naganarasimha G R
HDFS-9002 Move o.a.h.hdfs.net/*Peer classes to hdfs-client Major build Mingliang Liu Mingliang Liu
HDFS-9012 Move o.a.h.hdfs.protocol.datatransfer.PipelineAck class to hadoop-hdfs-client module Major build Mingliang Liu Mingliang Liu
HDFS-8984 Move replication queues related methods in FSNamesystem to BlockManager Major . Haohui Mai Haohui Mai
YARN-2884 Proxying all AM-RM communications Major nodemanager, resourcemanager Carlo Curino Kishore Chaliparambil
YARN-4136 LinuxContainerExecutor loses info when forwarding ResourceHandlerException Trivial nodemanager Steve Loughran Bibin A Chundatt
YARN-4102 Add a “skip existing table” mode for timeline schema creator Major timelineserver Li Lu Li Lu
HDFS-9041 Move entries in META-INF/services/o.a.h.fs.FileSystem to hdfs-client Major build Haohui Mai Mingliang Liu
HDFS-9010 Replace NameNode.DEFAULT_PORT with HdfsClientConfigKeys.DFS_NAMENODE_RPC_PORT_DEFAULT config key Major build Mingliang Liu Mingliang Liu
YARN-1651 CapacityScheduler side changes to support increase/decrease container resource. Major resourcemanager, scheduler Wangda Tan Wangda Tan
YARN-313 Add Admin API for supporting node resource configuration in command line Critical client, graceful Junping Du Íñigo Goiri
HDFS-9008 Balancer#Parameters class could use a builder pattern Minor balancer & mover Chris Trezzo Chris Trezzo
YARN-3635 Get-queue-mapping should be a common interface of YarnScheduler Major scheduler Wangda Tan Tan, Wangda
YARN-3717 Expose app/am/queue’s node-label-expression to RM web UI / CLI / REST-API Major . Naganarasimha G R Naganarasimha G R
HDFS-7986 Allow files / directories to be deleted from the NameNode UI Major ui Ravi Prakash Ravi Prakash
HDFS-7995 Implement chmod in the HDFS Web UI Major ui Ravi Prakash Ravi Prakash
YARN-4034 Render cluster Max Priority in scheduler metrics in RM web UI Minor resourcemanager, webapp Rohith Sharma K S Rohith Sharma K S
YARN-3901 Populate flow run data in the flow_run & flow activity tables Major timelineserver Vrushali C Vrushali C
HDFS-9022 Move NameNode.getAddress() and NameNode.getUri() to hadoop-hdfs-client Major hdfs-client Mingliang Liu Mingliang Liu
YARN-4171 Resolve findbugs/javac warnings in YARN-1197 branch Major api, nodemanager, resourcemanager Wangda Tan Wangda Tan
YARN-3212 RMNode State Transition Update with DECOMMISSIONING state Major graceful, resourcemanager Junping Du Junping Du
HDFS-9101 Remove deprecated NameNode.getUri() static helper method Major . Mingliang Liu Mingliang Liu
HDFS-9004 Add upgrade domain to DatanodeInfo Major . Ming Ma Ming Ma
HDFS-9111 Move hdfs-client protobuf convert methods from PBHelper to PBHelperClient Major . Mingliang Liu Mingliang Liu
HDFS-9039 Separate client and server side methods of o.a.h.hdfs.NameNodeProxies Major . Mingliang Liu Mingliang Liu
HDFS-8733 Keep server related definition in hdfs.proto on server side Major . Yi Liu Mingliang Liu
HDFS-9131 Move config keys used by hdfs-client to HdfsClientConfigKeys Major . Mingliang Liu Mingliang Liu
HADOOP-12244 recover broken rebase during precommit Critical yetus Allen Wittenauer Allen Wittenauer
HDFS-7529 Consolidate encryption zone related implementation into a single class Major . Haohui Mai Rakesh R
HDFS-9134 Move LEASE_{SOFTLIMIT,HARDLIMIT}_PERIOD constants from HdfsServerConstants to HdfsConstants Major . Mingliang Liu Mingliang Liu
YARN-4075 [reader REST API] implement support for querying for flows and flow runs Major timelineserver Sangjin Lee Varun Saxena
HADOOP-11918 Listing an empty s3a root directory throws FileNotFound. Minor fs/s3 Lei (Eddy) Xu Lei (Eddy) Xu
HDFS-8053 Move DFSIn/OutputStream and related classes to hadoop-hdfs-client Major build Haohui Mai Mingliang Liu
HDFS-8740 Move DistributedFileSystem to hadoop-hdfs-client Major build Yi Liu Mingliang Liu
YARN-4141 Runtime Application Priority change should not throw exception for applications at finishing states Major resourcemanager Sunil Govindan Sunil Govindan
HDFS-9165 Move entries in META-INF/services/o.a.h.fs.FileSystem to hdfs-client Major build Haohui Mai Mingliang Liu
HDFS-8971 Remove guards when calling LOG.debug() and LOG.trace() in client package Major build Mingliang Liu Mingliang Liu
YARN-4203 Add request/response logging & timing for each REST endpoint call Minor timelineserver Vrushali C Varun Saxena
YARN-4210 HBase reader throws NPE if Get returns no rows Major timelineserver Varun Saxena Varun Saxena
HDFS-9015 Refactor TestReplicationPolicy to test different block placement policies Major . Ming Ma Ming Ma
YARN-1897 CLI and core support for signal container functionality Major api Ming Ma Ming Ma
HDFS-9158 [OEV-Doc] : Document does not mention about “-f” and “-r” options Major . nijel nijel
HDFS-9155 OEV should treat .XML files as XML even when the file name extension is uppercase Major . nijel nijel
YARN-3864 Implement support for querying single app and all apps for a flow run Blocker timelineserver Varun Saxena Varun Saxena
HDFS-9180 Update excluded DataNodes in DFSStripedOutputStream based on failures in data streamers Major erasure-coding Jing Zhao Jing Zhao
YARN-4215 RMNodeLabels Manager Need to verify and replace node labels for the only modified Node Label Mappings in the request Major resourcemanager Naganarasimha G R Naganarasimha G R
YARN-4178 [storage implementation] app id as string in row keys can cause incorrect ordering Major timelineserver Sangjin Lee Varun Saxena
HDFS-9206 Inconsistent default value of dfs.datanode.stripedread.buffer.size Minor erasure-coding Walter Su Walter Su
HDFS-9170 Move libhdfs / fuse-dfs / libwebhdfs to hdfs-client Major . Haohui Mai Haohui Mai
HDFS-9159 [OIV] : return value of the command is not correct if invalid value specified in “-p (processor)” option Major . nijel nijel
HDFS-9209 Erasure coding: Add apache license header in TestFileStatusWithECPolicy.java Major . Surendra Singh Lilhore Surendra Singh Lilhore
HDFS-8632 Add InterfaceAudience annotation to the erasure coding classes Major . Rakesh R Rakesh R
YARN-3964 Support NodeLabelsProvider at Resource Manager side Major . Dian Fu Dian Fu
YARN-4230 Increasing container resource while there is no headroom left will cause ResourceManager to crash Critical resourcemanager MENG DING MENG DING
HDFS-9006 Provide BlockPlacementPolicy that supports upgrade domain Major . Ming Ma Ming Ma
HDFS-9160 [OIV-Doc] : Missing details of “delimited” for processor options Major . nijel nijel
HDFS-8438 Erasure Coding: Allow concat striped files if they have the same ErasureCodingPolicy Major . Walter Su Walter Su
HDFS-9167 Update pom.xml in other modules to depend on hdfs-client instead of hdfs Major build Haohui Mai Mingliang Liu
YARN-4255 container-executor does not clean up docker operation command files. Minor . Sidharta Seethana Sidharta Seethana
HDFS-9223 Code cleanup for DatanodeDescriptor and HeartbeatManager Minor namenode Jing Zhao Jing Zhao
YARN-4258 Add support for controlling capabilities for docker containers Major yarn Sidharta Seethana Sidharta Seethana
HDFS-9157 [OEV and OIV] : Unnecessary parsing for mandatory arguements if “-h” option is specified as the only option Major . nijel nijel
YARN-4237 Support additional queries for ATSv2 Web UI Major . Varun Saxena Varun Saxena
HADOOP-12475 Replace guava Cache with ConcurrentHashMap for caching Connection in ipc Client Major conf, io, ipc Walter Su Walter Su
YARN-4162 CapacityScheduler: Add resource usage by partition and queue capacity by partition to REST API Major api, client, resourcemanager Naganarasimha G R Naganarasimha G R
YARN-4170 AM need to be notified with priority in AllocateResponse Major resourcemanager Sunil Govindan Sunil Govindan
YARN-2556 Tool to measure the performance of the timeline server Major timelineserver Jonathan Eagles Chang Li
YARN-4262 Allow whitelisted users to run privileged docker containers. Major yarn Sidharta Seethana Sidharta Seethana
YARN-4267 Add additional logging to container launch implementations in container-executor Major yarn Sidharta Seethana Sidharta Seethana
YARN-3985 Make ReservationSystem persist state using RMStateStore reservation APIs Major resourcemanager Anubhav Dhoot Anubhav Dhoot
YARN-2513 Host framework UIs in YARN for use with the ATS Major timelineserver Jonathan Eagles Jonathan Eagles
YARN-3739 Add reservation system recovery to RM recovery process Major capacityscheduler, fairscheduler, resourcemanager Subru Krishnan Subru Krishnan
YARN-4243 Add retry on establishing Zookeeper conenction in EmbeddedElectorService#serviceInit Major resourcemanager Xuan Gong Xuan Gong
YARN-4179 [reader implementation] support flow activity queries based on time Minor timelineserver Sangjin Lee Varun Saxena
YARN-4129 Refactor the SystemMetricPublisher in RM to better support newer events Major resourcemanager Naganarasimha G R Naganarasimha G R
YARN-4221 Store user in app to flow table Major timelineserver Varun Saxena Varun Saxena
YARN-3738 Add support for recovery of reserved apps running under dynamic queues Major capacityscheduler, resourcemanager Subru Krishnan Subru Krishnan
YARN-3724 Use POSIX nftw(3) instead of fts(3) Major . Malcolm Kavalsky Alan Burlison
YARN-2729 Support script based NodeLabelsProvider Interface in Distributed Node Label Configuration Setup Major nodemanager Naganarasimha G R Naganarasimha G R
HDFS-9304 Add HdfsClientConfigKeys class to TestHdfsConfigFields#configurationClasses Major build Mingliang Liu Mingliang Liu
YARN-3216 Max-AM-Resource-Percentage should respect node labels Critical resourcemanager Wangda Tan Sunil Govindan
HADOOP-12457 [JDK8] Fix a failure of compiling common by javadoc Major . Tsuyoshi Ozawa Akira Ajisaka
MAPREDUCE-6391 util/Timer.cc completely misunderstands _POSIX_CPUTIME Major build Alan Burlison Alan Burlison
MAPREDUCE-6412 Make hadoop-mapreduce-client Native code -Wall-clean Major build Alan Burlison Alan Burlison
MAPREDUCE-6416 Not all platforms have d_type in struct dirent Major build Alan Burlison Alan Burlison
MAPREDUCE-6435 MapReduce client assumes the world is x86 Major client Alan Burlison Alan Burlison
HADOOP-12040 Adjust inputs order for the decode API in raw erasure coder Major . Kai Zheng Kai Zheng
HDFS-9168 Move client side unit test to hadoop-hdfs-client Major build Haohui Mai Haohui Mai
HADOOP-12327 Initialize output buffers with ZERO bytes in erasure coder Major . Kai Zheng Kai Zheng
HDFS-9261 Erasure Coding: Skip encoding the data cells if all the parity data streamers are failed for the current block group Minor . Rakesh R Rakesh R
HDFS-9343 Empty caller context considered invalid Major . Mingliang Liu Mingliang Liu
HADOOP-12047 Indicate preference not to affect input buffers during coding in erasure coder Major . Kai Zheng Kai Zheng
HDFS-8777 Erasure Coding: add tests for taking snapshots on EC files Major erasure-coding Jing Zhao Rakesh R
HDFS-9275 Wait previous ErasureCodingWork to finish before schedule another one Major . Walter Su Walter Su
HDFS-9362 TestAuditLogger#testAuditLoggerWithCallContext assumes Unix line endings, fails on Windows. Minor test Chris Nauroth Chris Nauroth
HADOOP-12544 Erasure Coding: create dummy raw coder to isolate performance issues in testing Major . Rui Li Rui Li
HDFS-9007 Fix HDFS Balancer to honor upgrade domain policy Major . Ming Ma Ming Ma
HADOOP-11887 Introduce Intel ISA-L erasure coding library for native erasure encoding support Major io Kai Zheng Kai Zheng
HADOOP-11684 S3a to use thread pool that blocks clients Major fs/s3 Thomas Demoor Thomas Demoor
HDFS-9379 Make NNThroughputBenchmark$BlockReportStats support more than 10 datanodes Major test Mingliang Liu Mingliang Liu
YARN-1510 Make NMClient support change container resources Major nodemanager Wangda Tan (No longer used) MENG DING
YARN-4345 yarn rmadmin -updateNodeResource doesn’t work Critical graceful, resourcemanager Sushmitha Sreenivasan Junping Du
HDFS-8968 Erasure coding: a comprehensive I/O throughput benchmark tool Major erasure-coding, test Kai Zheng Rui Li
YARN-1509 Make AMRMClient support send increase container request and get increased/decreased containers Major resourcemanager Wangda Tan (No longer used) MENG DING
HDFS-9387 Fix namenodeUri parameter parsing in NNThroughputBenchmark Major test Mingliang Liu Mingliang Liu
HDFS-9421 NNThroughputBenchmark replication test NPE with -namenode option Major benchmarks Xiaoyu Yao Mingliang Liu
YARN-4184 Remove update reservation state api from state store as its not used by ReservationSystem Major capacityscheduler, fairscheduler, resourcemanager Anubhav Dhoot Sean Po
HADOOP-12582 Using BytesWritable’s getLength() and getBytes() instead of get() and getSize() Major . Tsuyoshi Ozawa Akira Ajisaka
YARN-4053 Change the way metric values are stored in HBase Storage Major timelineserver Varun Saxena Varun Saxena
YARN-3454 Add efficient merge operation to RLESparseResourceAllocation Major resourcemanager Carlo Curino Carlo Curino
HDFS-9348 Erasure Coding: DFS GetErasureCodingPolicy API on a non-existent file should be handled properly Minor erasure-coding Rakesh R Rakesh R
HDFS-7796 Include X-editable for slick contenteditable fields in the web UI Major ui Ravi Prakash Ravi Prakash
YARN-3980 Plumb resource-utilization info in node heartbeat through to the scheduler Major resourcemanager, scheduler Karthik Kambatla Íñigo Goiri
HADOOP-11954 Solaris does not support RLIMIT_MEMLOCK as in Linux Major . Malcolm Kavalsky Alan Burlison
YARN-4384 updateNodeResource CLI should not accept negative values for resource Major graceful, resourcemanager Sushmitha Sreenivasan Junping Du
HDFS-9438 TestPipelinesFailover assumes Linux ifconfig Minor test Alan Burlison John Zhuge
YARN-4297 TestJobHistoryEventHandler and TestRMContainerAllocator failing on YARN-2928 branch Major . Varun Saxena Varun Saxena
YARN-3862 Support for fetching specific configs and metrics based on prefixes Major timelineserver Varun Saxena Varun Saxena
YARN-4292 ResourceUtilization should be a part of NodeInfo REST API Major . Wangda Tan Sunil Govindan
HDFS-9436 Make NNThroughputBenchmark$BlockReportStats run with 10 datanodes by default Minor test Mingliang Liu Mingliang Liu
HDFS-9484 NNThroughputBenchmark$BlockReportStats should not send empty block reports Major test Mingliang Liu Mingliang Liu
YARN-4405 Support node label store in non-appendable file system Major api, client, resourcemanager Wangda Tan Wangda Tan
HDFS-9214 Support reconfiguring dfs.datanode.balance.max.concurrent.moves without DN restart Major datanode Xiaobing Zhou Xiaobing Zhou
HDFS-9129 Move the safemode block count into BlockManager Major namenode Haohui Mai Mingliang Liu
YARN-4248 REST API for submit/update/delete Reservations Major resourcemanager Carlo Curino Carlo Curino
HDFS-9414 Refactor reconfiguration of ClientDatanodeProtocol for reusability Major . Xiaobing Zhou Xiaobing Zhou
YARN-4356 ensure the timeline service v.2 is disabled cleanly and has no impact when it’s turned off Critical timelineserver Sangjin Lee Sangjin Lee
YARN-4358 Improve relationship between SharingPolicy and ReservationAgent Major capacityscheduler, fairscheduler, resourcemanager Carlo Curino Carlo Curino
YARN-4450 TestTimelineAuthenticationFilter and TestYarnConfigurationFields fail Major timelineserver Sangjin Lee Sangjin Lee
YARN-3946 Update exact reason as to why a submitted app is in ACCEPTED state to app’s diagnostic message Major capacity scheduler, resourcemanager Sumit Nigam Naganarasimha G R
YARN-4309 Add container launch related debug information to container logs when a container fails Major nodemanager Varun Vasudev Varun Vasudev
HDFS-9371 Code cleanup for DatanodeManager Major namenode Jing Zhao Jing Zhao
YARN-4460 [Bug fix] RM fails to start when SMP is enabled Major timelineserver Li Lu Li Lu
YARN-4445 Unify the term flowId and flowName in timeline v2 codebase Major timelineserver Li Lu Zhan Zhang
YARN-4293 ResourceUtilization should be a part of yarn node CLI Major . Wangda Tan Sunil Govindan
YARN-4416 Deadlock due to synchronised get Methods in AbstractCSQueue Minor capacity scheduler, resourcemanager Naganarasimha G R Naganarasimha G R
YARN-1856 cgroups based memory monitoring for containers Major nodemanager Karthik Kambatla Varun Vasudev
HDFS-9373 Erasure coding: friendly log information for write operations with some failed streamers Major erasure-coding Li Bo Li Bo
YARN-3226 UI changes for decommissioning node Major graceful Junping Du Sunil Govindan
YARN-4164 Retrospect update ApplicationPriority API return type Major resourcemanager Rohith Sharma K S Rohith Sharma K S
YARN-4350 TestDistributedShell fails for V2 scenarios Major timelineserver Sangjin Lee Naganarasimha G R
HDFS-9173 Erasure Coding: Lease recovery for striped file Major erasure-coding Walter Su Walter Su
HDFS-9575 Use byte array for internal block indices in a striped block Major erasure-coding Jing Zhao Jing Zhao
YARN-3586 RM only get back addresses of Collectors that NM needs to know. Critical resourcemanager, timelineserver Junping Du Junping Du
YARN-4234 New put APIs in TimelineClient for ats v1.5 Major timelineserver Xuan Gong Xuan Gong
YARN-2882 Add an OPPORTUNISTIC ExecutionType Major nodemanager Konstantinos Karanasos Konstantinos Karanasos
YARN-3480 Recovery may get very slow with lots of services with lots of app-attempts Major resourcemanager Jun Gong Jun Gong
YARN-4098 Document ApplicationPriority feature Major resourcemanager Rohith Sharma K S Rohith Sharma K S
HDFS-7779 Support changing ownership, group and replication in HDFS Web UI Major ui Ravi Prakash Ravi Prakash
HADOOP-12685 Input buffer position after encode/decode not consistent between different kinds of buffers Minor . Rui Li Rui Li
HDFS-9498 Move code that tracks blocks with future generation stamps to BlockManagerSafeMode Major namenode Mingliang Liu Mingliang Liu
YARN-2902 Killing a container that is localizing can orphan resources in the DOWNLOADING state Major nodemanager Jason Lowe Varun Saxena
YARN-4393 TestResourceLocalizationService#testFailedDirsResourceRelease fails intermittently Major test Varun Saxena Varun Saxena
YARN-4550 some tests in TestContainerLanch fails on non-english locale environment Minor nodemanager, test Takashi Ohnishi Takashi Ohnishi
YARN-4335 Allow ResourceRequests to specify ExecutionType of a request ask Major nodemanager, resourcemanager Konstantinos Karanasos Konstantinos Karanasos
YARN-4479 Retrospect app-priority in pendingOrderingPolicy during recovering applications Major api, resourcemanager Rohith Sharma K S Rohith Sharma K S
YARN-3995 Some of the NM events are not getting published due race condition when AM container finishes in NM Major nodemanager, timelineserver Naganarasimha G R Naganarasimha G R
HDFS-9621 getListing wrongly associates Erasure Coding policy to pre-existing replicated files under an EC directory Critical erasure-coding Sushmitha Sreenivasan Jing Zhao
YARN-4537 Pull out priority comparison from fifocomparator and use compound comparator for FifoOrdering policy Major capacity scheduler Rohith Sharma K S Rohith Sharma K S
HADOOP-11262 Enable YARN to use S3A Major fs/s3 Thomas Demoor Pieter Reuse
YARN-4553 Add cgroups support for docker containers Major yarn Sidharta Seethana Sidharta Seethana
YARN-4265 Provide new timeline plugin storage to support fine-grained entity caching Major timelineserver Li Lu Li Lu
YARN-4304 AM max resource configuration per partition to be displayed/updated correctly in UI and in various partition related metrics Major webapp Sunil Govindan Sunil Govindan
YARN-4526 Make SystemClock singleton so AppSchedulingInfo could use it Major scheduler Karthik Kambatla Karthik Kambatla
YARN-4557 Fix improper Queues sorting in PartitionedQueueComparator when accessible-node-labels=* Major resourcemanager Naganarasimha G R Naganarasimha G R
HADOOP-11828 Implement the Hitchhiker erasure coding algorithm Major . Zhe Zhang jack liuquan
HDFS-9542 Move BlockIdManager from FSNamesystem to BlockManager Major namenode Jing Zhao Jing Zhao
YARN-4622 TestDistributedShell fails for v2 test cases after modifications for 1.5 Major timelineserver Naganarasimha G R Naganarasimha G R
HDFS-9601 NNThroughputBenchmark.BlockReportStats should handle NotReplicatedYetException on adding block Major test Masatake Iwasaki Masatake Iwasaki
YARN-4578 Directories that are mounted in docker containers need to be more restrictive/container-specific Major yarn Sidharta Seethana Sidharta Seethana
YARN-4574 TestAMRMClientOnRMRestart fails on trunk Major client, test Takashi Ohnishi Takashi Ohnishi
HDFS-9646 ErasureCodingWorker may fail when recovering data blocks with length less than the first internal block Critical erasure-coding Takuya Fukudome Jing Zhao
YARN-4614 TestApplicationPriority#testApplicationPriorityAllocationWithChangeInPriority fails occasionally Major test Jason Lowe Sunil Govindan
YARN-4613 TestClientRMService#testGetClusterNodes fails occasionally Major test Jason Lowe Takashi Ohnishi
HDFS-9094 Add command line option to ask NameNode reload configuration. Major namenode Xiaobing Zhou Xiaobing Zhou
HDFS-9672 o.a.h.hdfs.TestLeaseRecovery2 fails intermittently Major test Mingliang Liu Mingliang Liu
YARN-4573 TestRMAppTransitions.testAppRunningKill and testAppKilledKilled fail on trunk Major resourcemanager, test Takashi Ohnishi Takashi Ohnishi
YARN-4238 correctly set createdTime and remove modifiedTime when publishing entities Major timelineserver Varun Saxena Varun Saxena
YARN-4224 Support fetching entities by UID and change the REST interface to conform to current REST APIs’ in YARN Major timelineserver Varun Saxena Varun Saxena
YARN-4644 TestRMRestart fails and findbugs issue in YARN-2928 branch Major timelineserver Varun Saxena Varun Saxena
YARN-4633 TestRMRestart.testRMRestartAfterPreemption fails intermittently in trunk Major test Rohith Sharma K S Bibin A Chundatt
YARN-4643 Container recovery is broken with delegating container runtime Critical yarn Sidharta Seethana Sidharta Seethana
YARN-4219 New levelDB cache storage for timeline v1.5 Major . Li Lu Li Lu
YARN-4543 TestNodeStatusUpdater.testStopReentrant fails + JUnit misusage Minor nodemanager Akihiro Suda Akihiro Suda
YARN-4615 TestAbstractYarnScheduler#testResourceRequestRecoveryToTheRightAppAttempt fails occasionally Major test Jason Lowe Sunil Govindan
HDFS-9494 Parallel optimization of DFSStripedOutputStream#flushAllInternals( ) Minor hdfs-client Rui Gao Rui Gao
YARN-4340 Add “list” API to reservation system Major capacityscheduler, fairscheduler, resourcemanager Carlo Curino Sean Po
YARN-4100 Add Documentation for Distributed and Delegated-Centralized Node Labels feature Major api, client, resourcemanager Naganarasimha G R Naganarasimha G R
HDFS-9731 Erasure Coding: Rename BlockECRecoveryCommand to BlockECReconstructionCommand Major erasure-coding Rakesh R Rakesh R
HDFS-9403 Erasure coding: some EC tests are missing timeout Minor erasure-coding, test Zhe Zhang Rui Gao
HDFS-9658 Erasure Coding: allow to use multiple EC policies in striping related tests Major . Rui Li Rui Li
HADOOP-12041 Implement another Reed-Solomon coder in pure Java Major . Kai Zheng Kai Zheng
HDFS-9503 Replace -namenode option with -fs for NNThroughputBenchmark Major test Konstantin Shvachko Mingliang Liu
YARN-4446 Refactor reader API for better extensibility Major timelineserver Varun Saxena Varun Saxena
HADOOP-12292 Make use of DeleteObjects optional Major fs/s3 Thomas Demoor Thomas Demoor
YARN-4667 RM Admin CLI for refreshNodesResources throws NPE when nothing is configured Critical client Naganarasimha G R Naganarasimha G R
HADOOP-12752 Improve diagnostics/use of envvar/sysprop credential propagation Minor security Steve Loughran Steve Loughran
YARN-4409 Fix javadoc and checkstyle issues in timelineservice code Major timelineserver Varun Saxena Varun Saxena
YARN-3367 Replace starting a separate thread for post entity with event loop in TimelineClient Major timelineserver Junping Du Naganarasimha G R
HDFS-9775 Erasure Coding : Rename BlockRecoveryWork to BlockReconstructionWork Major namenode Rakesh R Rakesh R
YARN-4138 Roll back container resource allocation after resource increase token expires Major api, nodemanager, resourcemanager MENG DING MENG DING
HDFS-9789 Correctly update DataNode’s scheduled block size when writing small EC file Major namenode Namit Maheshwari Jing Zhao
HDFS-9755 Erasure Coding: allow to use multiple EC policies in striping related tests [Part 2] Major erasure-coding, test Rui Li Rui Li
YARN-2575 Create separate ACLs for Reservation create/update/delete/list ops Major capacityscheduler, fairscheduler, resourcemanager Subru Krishnan Sean Po
YARN-4684 TestYarnCLI#testGetContainers failing in CN locale Major yarn Bibin A Chundatt Bibin A Chundatt
HDFS-9794 Streamer threads may leak if failure happens when closing the striped outputstream Critical hdfs-client Namit Maheshwari Jing Zhao
HDFS-9691 TestBlockManagerSafeMode#testCheckSafeMode fails intermittently Major test Mingliang Liu Mingliang Liu
HADOOP-12710 Remove dependency on commons-httpclient for TestHttpServerLogs Major . Wei-Chiu Chuang Wei-Chiu Chuang
HDFS-9830 Remove references to hftp in ViewFs documentation in trunk Minor documentation, fs Wei-Chiu Chuang Wei-Chiu Chuang
HDFS-9829 Erasure Coding: Improve few exception handling logic of ErasureCodingWorker Minor erasure-coding Rakesh R Rakesh R
HDFS-9818 Correctly handle EC reconstruction work caused by not enough racks Major datanode, namenode Takuya Fukudome Jing Zhao
HADOOP-11613 Remove commons-httpclient dependency from hadoop-azure Major . Akira Ajisaka Masatake Iwasaki
HDFS-9084 Pagination, sorting and filtering of files/directories in the HDFS Web UI Major ui Ravi Prakash Ravi Prakash
YARN-3223 Resource update during NM graceful decommission Major graceful, nodemanager, resourcemanager Junping Du Brook Zhou
HDFS-9816 Erasure Coding: allow to use multiple EC policies in striping related tests [Part 3] Major erasure-coding, test Rui Li Rui Li
YARN-4680 TimerTasks leak in ATS V1.5 Writer Major timelineserver Xuan Gong Xuan Gong
HADOOP-12808 Rename the RS coder from HDFS-RAID as legacy Major . Rui Li Rui Li
HDFS-9837 BlockManager#countNodes should be able to detect duplicated internal blocks Major . Jing Zhao Jing Zhao
HDFS-9866 BlockManager#chooseExcessReplicasStriped may weaken rack fault tolerance Major namenode Takuya Fukudome Jing Zhao
HDFS-9867 Missing block exception should carry locatedBlocks information Minor erasure-coding, hdfs-client Mingliang Liu Mingliang Liu
YARN-4566 TestMiniYarnClusterNodeUtilization sometimes fails on trunk Major test Takashi Ohnishi Takashi Ohnishi
HADOOP-12813 Migrate TestRPC and related codes to rebase on ProtobufRpcEngine Major . Kai Zheng Kai Zheng
HDFS-9876 shouldProcessOverReplicated should not count number of pending replicas Major erasure-coding, namenode Takuya Fukudome Jing Zhao
YARN-4700 ATS storage has one extra record each time the RM got restarted Major timelineserver Li Lu Naganarasimha G R
YARN-4749 Generalize config file handling in container-executor Major nodemanager Sidharta Seethana Sidharta Seethana
HDFS-8786 Erasure coding: use simple replication for internal blocks on decommissioning datanodes Major . Zhe Zhang Rakesh R
MAPREDUCE-6546 reconcile the two versions of the timeline service performance tests Minor . Sangjin Lee Sangjin Lee
HDFS-7866 Erasure coding: NameNode manages multiple erasure coding policies Major . Kai Zheng Rui Li
YARN-4696 Improving EntityGroupFSTimelineStore on exception handling, test setup, and concurrency Major timelineserver Steve Loughran Steve Loughran
HDFS-1477 Support reconfiguring dfs.heartbeat.interval and dfs.namenode.heartbeat.recheck-interval without NN restart Major namenode Patrick Kling Xiaobing Zhou
MAPREDUCE-6520 Migrate MR Client test cases part 1 Trivial test Dustin Cote Dustin Cote
HADOOP-11996 Improve and restructure native ISAL support Major io Kai Zheng Kai Zheng
YARN-4545 Allow YARN distributed shell to use ATS v1.5 APIs Major timelineserver Li Lu Li Lu
HADOOP-12826 Rename the new Java coder and make it default Major . Rui Li Rui Li
YARN-4817 Change Log Level to DEBUG for putDomain call in ATS 1.5 Trivial timelineserver Xuan Gong Xuan Gong
HDFS-9857 Erasure Coding: Rename replication-based names in BlockManager to more generic [part-1] Major erasure-coding Rakesh R Rakesh R
YARN-4108 CapacityScheduler: Improve preemption to only kill containers that would satisfy the incoming request Major capacity scheduler Wangda Tan Wangda Tan
YARN-4062 Add the flush and compaction functionality via coprocessors and scanners for flow run table Major timelineserver Vrushali C Vrushali C
YARN-4712 CPU Usage Metric is not captured properly in YARN-2928 Major timelineserver Naganarasimha G R Naganarasimha G R
HADOOP-12926 lz4.c does not detect 64-bit mode properly Major native Alan Burlison Alan Burlison
HADOOP-12819 Migrate TestSaslRPC and related codes to rebase on ProtobufRpcEngine Major . Kai Zheng Kai Zheng
YARN-4815 ATS 1.5 timelineclient impl try to create attempt directory for every event call Major timelineserver Xuan Gong Xuan Gong
YARN-4814 ATS 1.5 timelineclient impl call flush after every event write Major timelineserver Xuan Gong Xuan Gong
HDFS-9694 Make existing DFSClient#getFileChecksum() work for striped blocks Major . Kai Zheng Kai Zheng
YARN-4805 Don’t go through all schedulers in ParameterizedTestBase Major . Karthik Kambatla Karthik Kambatla
HDFS-9640 Remove hsftp from DistCp in trunk Major distcp Wei-Chiu Chuang Wei-Chiu Chuang
YARN-998 Keep NM resource updated through dynamic resource config for RM/NM restart Major graceful, nodemanager, scheduler Junping Du Junping Du
YARN-4711 NM is going down with NPE’s due to single thread processing of events by Timeline client Critical timelineserver Naganarasimha G R Naganarasimha G R
MAPREDUCE-6543 Migrate MR Client test cases part 2 Trivial test Dustin Cote Dustin Cote
HDFS-9349 Support reconfiguring fs.protected.directories without NN restart Major namenode Xiaobing Zhou Xiaobing Zhou
YARN-4822 Refactor existing Preemption Policy of CS for easier adding new approach to select preemption candidates Major . Wangda Tan Wangda Tan
YARN-4811 Generate histograms in ContainerMetrics for actual container resource usage Major . Varun Vasudev Varun Vasudev
YARN-4634 Scheduler UI/Metrics need to consider cases like non-queue label mappings Major . Sunil Govindan Sunil Govindan
HADOOP-12169 ListStatus on empty dir in S3A lists itself instead of returning an empty list Major fs/s3 Pieter Reuse Pieter Reuse
HADOOP-12959 Add additional github web site for ISA-L library Major . Li Bo Li Bo
HDFS-10186 DirectoryScanner: Improve logs by adding full path of both actual and expected block directories Minor datanode Rakesh R Rakesh R
HDFS-9719 Refactoring ErasureCodingWorker into smaller reusable constructs Major . Kai Zheng Kai Zheng
YARN-3461 Consolidate flow name/version/run defaults Major timelineserver Zhijie Shen Sangjin Lee
HADOOP-12753 S3A JUnit tests failing if using HTTP proxy Minor fs/s3 Zoran Rajic Zoran Rajic
YARN-4826 Document configuration of ReservationSystem for CapacityScheduler Minor capacity scheduler Subru Krishnan Subru Krishnan
HADOOP-12444 Support lazy seek in S3AInputStream Major fs/s3 Rajesh Balamohan Rajesh Balamohan
YARN-4928 Some yarn.server.timeline.* tests fail on Windows attempting to use a test root path containing a colon Minor test Gergely Novák Gergely Novák
YARN-4168 Test TestLogAggregationService.testLocalFileDeletionOnDiskFull failing Critical test Steve Loughran Takashi Ohnishi
YARN-3863 Support complex filters in TimelineReader Major . Varun Saxena Varun Saxena
HDFS-9918 Erasure Coding: Sort located striped blocks based on decommissioned states Major . Rakesh R Rakesh R
HADOOP-12973 make DU pluggable Major . Elliott Clark Elliott Clark
YARN-4886 Add HDFS caller context for EntityGroupFSTimelineStore Major timelineserver Li Lu Li Lu
HDFS-10209 Support enable caller context in HDFS namenode audit log without restart namenode Major . Xiaoyu Yao Xiaobing Zhou
HDFS-10286 Fix TestDFSAdmin#testNameNodeGetReconfigurableProperties Major . Xiaoyu Yao Xiaobing Zhou
HDFS-10281 o.a.h.hdfs.server.namenode.ha.TestPendingCorruptDnMessages fails intermittently Major test Mingliang Liu Mingliang Liu
HDFS-10293 StripedFileTestUtil#readAll flaky Major erasure-coding, test Mingliang Liu Mingliang Liu
YARN-4909 Fix intermittent failures of TestRMWebServices And TestRMWithCSRFFilter Blocker . Brahma Reddy Battula Bibin A Chundatt
YARN-4468 Document the general ReservationSystem functionality, and the REST API Major capacityscheduler, fairscheduler, resourcemanager Carlo Curino Carlo Curino
HADOOP-12924 Configure raw erasure coders for supported codecs Minor . Rui Li Rui Li
HDFS-10284 o.a.h.hdfs.server.blockmanagement.TestBlockManagerSafeMode.testCheckSafeMode fails intermittently Major test Mingliang Liu Mingliang Liu
YARN-2883 Queuing of container requests in the NM Major nodemanager, resourcemanager Konstantinos Karanasos Konstantinos Karanasos
YARN-4890 Unit test intermittent failure: TestNodeLabelContainerAllocation#testQueueUsedCapacitiesUpdate Major . Wangda Tan Sunil Govindan
HDFS-10207 Support enable Hadoop IPC backoff without namenode restart Major . Xiaoyu Yao Xiaobing Zhou
YARN-4968 A couple of AM retry unit tests need to wait SchedulerApplicationAttempt stopped. Major . Wangda Tan Wangda Tan
HADOOP-13011 Clearly Document the Password Details for Keystore-based Credential Providers Major documentation Larry McCay Larry McCay
YARN-3816 [Aggregation] App-level aggregation and accumulation for YARN system metrics Major timelineserver Junping Du Li Lu
YARN-4846 Random failures for TestCapacitySchedulerPreemption#testPreemptionPolicyShouldRespectAlreadyMarkedKillableContainers Major . Bibin A Chundatt Bibin A Chundatt
YARN-3215 Respect labels in CapacityScheduler when computing headroom Major capacityscheduler Wangda Tan Naganarasimha G R
YARN-2885 Create AMRMProxy request interceptor for distributed scheduling decisions for queueable containers Major nodemanager, resourcemanager Konstantinos Karanasos Arun Suresh
HADOOP-12935 API documentation for dynamic subcommands Major scripts Allen Wittenauer Allen Wittenauer
HDFS-9869 Erasure Coding: Rename replication-based names in BlockManager to more generic [part-2] Major erasure-coding Rakesh R Rakesh R
YARN-4991 Fix ContainerRequest Constructor to set nodelabelExpression correctly Major test Bibin A Chundatt Bibin A Chundatt
HDFS-10224 Implement asynchronous rename for DistributedFileSystem Major fs, hdfs-client Xiaobing Zhou Xiaobing Zhou
YARN-4966 Improve yarn logs to fetch container logs without specifying nodeId Major . Xuan Gong Xuan Gong
YARN-4807 MockAM#waitForState sleep duration is too long Major . Karthik Kambatla Yufei Gu
YARN-4956 findbug issue on LevelDBCacheTimelineStore Major timelineserver Xuan Gong Zhiyuan Yang
YARN-3998 Add support in the NodeManager to re-launch containers Major . Jun Gong Jun Gong
YARN-4986 Add a check in the coprocessor for table to operated on Major timelineserver Vrushali C Vrushali C
YARN-5014 Ensure non-metric values are returned as is for flow run table from the coprocessor Major timelineserver Vrushali C Vrushali C
YARN-3150 [Documentation] Documenting the timeline service v2 Major . Zhijie Shen Sangjin Lee
MAPREDUCE-6424 Store MR counters as timeline metrics instead of event Major . Junping Du Naganarasimha G R
YARN-4447 Provide a mechanism to represent complex filters and parse them at the REST layer Major timelineserver Varun Saxena Varun Saxena
YARN-4851 Metric improvements for ATS v1.5 storage components Major timelineserver Li Lu Li Lu
MAPREDUCE-6688 Store job configurations in Timeline Service v2 Major applicationmaster Junping Du Varun Saxena
HADOOP-12931 bin/hadoop work for dynamic subcommands Major scripts Allen Wittenauer Allen Wittenauer
HADOOP-12934 bin/mapred work for dynamic subcommands Major scripts Allen Wittenauer Allen Wittenauer
HADOOP-12933 bin/hdfs work for dynamic subcommands Major scripts Allen Wittenauer Allen Wittenauer
HADOOP-12932 bin/yarn work for dynamic subcommands Major scripts Allen Wittenauer Allen Wittenauer
HADOOP-12936 modify hadoop-tools to take advantage of dynamic subcommands Major scripts Allen Wittenauer Allen Wittenauer
YARN-4920 ATS/NM should support a link to dowload/get the logs in text format Major yarn Xuan Gong Xuan Gong
HADOOP-13086 enable daemonization of dynamic commands Major scripts Allen Wittenauer Allen Wittenauer
HADOOP-13089 hadoop distcp adds client opts twice when dynamic Major scripts Allen Wittenauer Allen Wittenauer
HADOOP-13087 env var doc update for dynamic commands Major scripts Allen Wittenauer Allen Wittenauer
HADOOP-13088 fix shellprofiles in hadoop-tools to allow replacement Major scripts Allen Wittenauer Allen Wittenauer
YARN-4905 Improve “yarn logs” command-line to optionally show log metadata also Major . Xuan Gong Xuan Gong
HADOOP-13094 hadoop-common unit tests for dynamic commands Major scripts, test Allen Wittenauer Allen Wittenauer
HADOOP-13095 hadoop-hdfs unit tests for dynamic commands Major scripts, test Allen Wittenauer Allen Wittenauer
YARN-4595 Add support for configurable read-only mounts when launching Docker containers Major yarn Billie Rinaldi Billie Rinaldi
HADOOP-13107 clean up how rumen is executed Major scripts, tools Allen Wittenauer Allen Wittenauer
HADOOP-13108 dynamic subcommands need a way to manipulate arguments Major scripts Allen Wittenauer Allen Wittenauer
HADOOP-13110 add a streaming subcommand to mapred Major . Allen Wittenauer Allen Wittenauer
YARN-5045 hbase unit tests fail due to dependency issues Blocker timelineserver Sangjin Lee Sangjin Lee
HADOOP-13111 convert hadoop gridmix to be dynamic Major scripts, tools Allen Wittenauer Allen Wittenauer
HADOOP-13115 dynamic subcommand docs should talk about exit vs. continue program flow Major documentation, scripts Allen Wittenauer Allen Wittenauer
HADOOP-13117 clarify daemonization and security vars for dynamic commands Major scripts Allen Wittenauer Allen Wittenauer
HADOOP-13121 rename sub-project shellprofiles to match the rest of Hadoop Major scripts Allen Wittenauer Allen Wittenauer
HADOOP-13120 add a –debug message when dynamic commands have been used Major scripts Allen Wittenauer Allen Wittenauer
YARN-4778 Support specifying resources for task containers in SLS Major . Wangda Tan Wangda Tan
YARN-4842 “yarn logs” command should not require the appOwner argument Major . Ram Venkatesh Xuan Gong
YARN-5073 Refactor startContainerInternal() in ContainerManager to remove unused parameter Minor nodemanager, resourcemanager Konstantinos Karanasos Konstantinos Karanasos
HADOOP-12749 Create a threadpoolexecutor that overrides afterExecute to log uncaught exceptions/errors Major . Sidharta Seethana Sidharta Seethana
HDFS-10346 Implement asynchronous setPermission/setOwner for DistributedFileSystem Major hdfs, hdfs-client Xiaobing Zhou Xiaobing Zhou
HADOOP-13122 Customize User-Agent header sent in HTTP requests by S3A. Minor fs/s3 Chris Nauroth Chris Nauroth
HADOOP-12844 Recover when S3A fails on IOException in read() Major fs/s3 Pieter Reuse Pieter Reuse
HADOOP-13028 add low level counter metrics for S3A; use in read performance tests Major fs/s3, metrics Steve Loughran Steve Loughran
HADOOP-12581 ShellBasedIdMapping needs suport for Solaris Major security Alan Burlison Alan Burlison
HDFS-9389 Add maintenance states to AdminStates Major . Ming Ma Ming Ma
HADOOP-13113 Enable parallel test execution for hadoop-aws. Minor test Chris Nauroth Chris Nauroth
YARN-2888 Corrective mechanisms for rebalancing NM container queues Major nodemanager, resourcemanager Konstantinos Karanasos Arun Suresh
HADOOP-13129 fix typo in dynamic subcommand docs Trivial scripts Sean Busbey Allen Wittenauer
HADOOP-13151 Underscores should be escaped in dynamic subcommands document Minor documentation Akira Ajisaka Allen Wittenauer
HADOOP-13153 fix typo in debug statement for dynamic subcommands Major scripts Allen Wittenauer Allen Wittenauer
YARN-4738 Notify the RM about the status of OPPORTUNISTIC containers Major nodemanager, resourcemanager Konstantinos Karanasos Konstantinos Karanasos
YARN-5075 Fix findbugs warning in hadoop-yarn-common module Major . Akira Ajisaka Arun Suresh
YARN-4412 Create ClusterMonitor to compute ordered list of preferred NMs for OPPORTUNITIC containers Major nodemanager, resourcemanager Arun Suresh Arun Suresh
HADOOP-13158 S3AFileSystem#toString might throw NullPointerException due to null cannedACL. Minor fs/s3 Chris Nauroth Chris Nauroth
YARN-5102 timeline service build fails with java 8 Blocker timelineserver Sangjin Lee Sangjin Lee
YARN-4832 NM side resource value should get updated if change applied in RM side Critical nodemanager, resourcemanager Junping Du Junping Du
YARN-5090 Add End-to-End test-cases for DistributedScheduling using MiniYarnCluster Major . Arun Suresh Arun Suresh
YARN-5096 timelinereader has a lot of logging that’s not useful Minor timelineserver Sangjin Lee Sangjin Lee
HADOOP-13140 FileSystem#initialize must not attempt to create StorageStatistics objects with null or empty schemes Major fs Brahma Reddy Battula Mingliang Liu
YARN-4913 Yarn logs should take a -out option to write to a directory Major . Xuan Gong Xuan Gong
HDFS-2173 saveNamespace should not throw IOE when only one storage directory fails to write VERSION file Major . Todd Lipcon Andras Bokor
YARN-5110 Fix OpportunisticContainerAllocator to insert complete HostAddress in issued ContainerTokenIds Major . Arun Suresh Konstantinos Karanasos
YARN-5050 Code cleanup for TestDistributedShell Major timelineserver Li Lu Li Lu
YARN-5016 Add support for a minimum retry interval for container retries Major . Varun Vasudev Jun Gong
HADOOP-13130 s3a failures can surface as RTEs, not IOEs Major fs/s3 Steve Loughran Steve Loughran
HDFS-7766 Add a flag to WebHDFS op=CREATE to not respond with a 307 redirect Major ui, webhdfs Ravi Prakash Ravi Prakash
YARN-5093 created time shows 0 in most REST output Critical timelineserver Sangjin Lee Varun Saxena
YARN-5018 Online aggregation logic should not run immediately after collectors got started Major timelineserver Li Lu Li Lu
YARN-3362 Add node label usage in RM CapacityScheduler web UI Major capacityscheduler, resourcemanager, webapp Wangda Tan Naganarasimha G R
HDFS-10390 Implement asynchronous setAcl/getAclStatus for DistributedFileSystem Major fs Xiaobing Zhou Xiaobing Zhou
YARN-5115 Avoid setting CONTENT-DISPOSITION header in the container-logs web-service Major . Xuan Gong Xuan Gong
YARN-857 Localization failures should be available in container diagnostics Critical . Hitesh Shah Vinod Kumar Vavilapalli
HDFS-8057 Move BlockReader implementation to the client implementation package Major hdfs-client Tsz Wo Nicholas Sze Takanobu Asanuma
HDFS-10434 Fix intermittent test failure of TestDataNodeErasureCodingMetrics Major . Rakesh R Rakesh R
HADOOP-12925 Checks for SPARC architecture need to include 64-bit SPARC Major conf Alan Burlison Alan Burlison
YARN-5097 NPE in Separator.joinEncoded() Critical timelineserver Sangjin Lee Vrushali C
YARN-5095 flow activities and flow runs are populated with wrong timestamp when RM restarts w/ recovery enabled Critical timelineserver Sangjin Lee Varun Saxena
YARN-4957 Add getNewReservation in ApplicationClientProtocol Major applications, client, resourcemanager Subru Krishnan Sean Po
HADOOP-13010 Refactor raw erasure coders Major . Kai Zheng Kai Zheng
HADOOP-12727 Minor cleanups needed for CMake 3.X Minor native Alan Burlison Alan Burlison
YARN-5138 fix “no findbugs output file” error for hadoop-yarn-server-timelineservice-hbase-tests Major timelineserver Vrushali C Vrushali C
HDFS-10431 Refactor and speedup TestAsyncDFSRename Minor test Xiaobing Zhou Xiaobing Zhou
HDFS-10236 Erasure Coding: Rename replication-based names in BlockManager to more generic [part-3] Major erasure-coding Rakesh R Rakesh R
YARN-5109 timestamps are stored unencoded causing parse errors Blocker timelineserver Sangjin Lee Varun Saxena
YARN-5089 Improve “yarn log” command-line “logFiles” option to support regex Major . Xuan Gong Xuan Gong
YARN-4987 Read cache concurrency issue between read and evict in EntityGroupFS timeline store Critical . Li Lu Li Lu
YARN-5127 Expose ExecutionType in Container api record Major . Arun Suresh Hitesh Sharma
HDFS-10430 Reuse FileSystem#access in TestAsyncDFS Major hdfs Xiaobing Zhou Xiaobing Zhou
YARN-5117 QueuingContainerManager does not start GUARANTEED Container even if Resources are available Major . Arun Suresh Konstantinos Karanasos
YARN-5111 YARN container system metrics are not aggregated to application Critical timelineserver Sangjin Lee Naganarasimha G R
YARN-4007 Add support for different network setups when launching the docker container Major nodemanager Varun Vasudev Sidharta Seethana
YARN-5141 Get Container logs for the Running application from Yarn Logs CommandLine Major . Xuan Gong Xuan Gong
YARN-5105 entire time series is returned for YARN container system metrics (CPU and memory) Major timelineserver Sangjin Lee Varun Saxena
HDFS-9833 Erasure coding: recomputing block checksum on the fly by reconstructing the missed/corrupt block data Major . Kai Zheng Rakesh R
HADOOP-13162 Consider reducing number of getFileStatus calls in S3AFileSystem.mkdirs Minor fs/s3 Rajesh Balamohan Rajesh Balamohan
YARN-5088 Improve “yarn log” command-line to read the last K bytes for the log files Major . Xuan Gong Xuan Gong
HADOOP-13131 Add tests to verify that S3A supports SSE-S3 encryption Minor fs/s3 Steve Loughran Steve Loughran
YARN-5162 Fix Exceptions thrown during registerAM call when Distributed Scheduling is Enabled Major . Arun Suresh Hitesh Sharma
HADOOP-13171 Add StorageStatistics to S3A; instrument some more operations Minor fs/s3 Steve Loughran Steve Loughran
YARN-1815 Work preserving recovery of Unmanged AMs Critical resourcemanager Karthik Kambatla Subru Krishnan
YARN-5165 Fix NoOvercommitPolicy to take advantage of RLE representation of plan Major capacityscheduler, fairscheduler, resourcemanager Carlo Curino Carlo Curino
YARN-5189 Make HBaseTimeline[Reader|Writer]Impl default and move FileSystemTimeline*Impl Major timelineserver Joep Rottinghuis Joep Rottinghuis
HDFS-9877 HDFS Namenode UI: Fix browsing directories that need to be encoded Major ui Ravi Prakash Ravi Prakash
HDFS-7767 Use the noredirect flag in WebHDFS to allow web browsers to upload files via the NN UI Major ui, webhdfs Ravi Prakash Ravi Prakash
YARN-5142 fix findbugs warnings/errors for hadoop-yarn-server-timelineservice-hbase-tests Major timelineserver Vrushali C Vrushali C
YARN-5167 Escaping occurences of encodedValues Critical timelineserver Joep Rottinghuis Sangjin Lee
YARN-5185 StageAllocaterGreedyRLE: Fix NPE in corner case Major capacityscheduler, fairscheduler, resourcemanager Carlo Curino Carlo Curino
YARN-4525 Fix bug in RLESparseResourceAllocation.getRangeOverlapping(…) Major . Ishai Menache Ishai Menache
YARN-5180 Allow ResourceRequest to specify an enforceExecutionType flag Major . Arun Suresh Arun Suresh
YARN-5176 More test cases for queuing of containers at the NM Major . Konstantinos Karanasos Konstantinos Karanasos
YARN-5204 Properly report status of killed/stopped queued containers Major . Konstantinos Karanasos Konstantinos Karanasos
HADOOP-13237 s3a initialization against public bucket fails if caller lacks any credentials Minor fs/s3 Steve Loughran Chris Nauroth
YARN-5210 NPE in Distributed Shell while publishing DS_CONTAINER_START event and other miscellaneous issues Major timelineserver Varun Saxena Varun Saxena
YARN-5199 Close LogReader in in AHSWebServices#getStreamingOutput and FileInputStream in NMWebServices#getLogs Major . Xuan Gong Xuan Gong
YARN-5191 Rename the “download=true” option for getLogs in NMWebServices and AHSWebServices Major . Xuan Gong Xuan Gong
YARN-5170 Eliminate singleton converters and static method access Major timelineserver Joep Rottinghuis Joep Rottinghuis
HDFS-7987 Allow files / directories to be moved Major ui Ravi Prakash Ravi Prakash
YARN-3426 Add jdiff support to YARN Blocker . Li Lu Li Lu
YARN-5052 [Documentation] Update timeline service v2 documentation to capture information about filters Major timelineserver Varun Saxena Varun Saxena
YARN-5124 Modify AMRMClient to set the ExecutionType in the ResourceRequest Major . Arun Suresh Arun Suresh
YARN-5212 Run existing ContainerManager tests using QueuingContainerManagerImpl Major . Konstantinos Karanasos Konstantinos Karanasos
YARN-4887 AM-RM protocol changes for identifying resource-requests explicitly Major applications, resourcemanager Subru Krishnan Subru Krishnan
YARN-1942 Deprecate toString/fromString methods from ConverterUtils and move them to records classes like ContainerId/ApplicationId, etc. Critical api Thomas Graves Wangda Tan
YARN-5223 Container line in yarn logs output for a live application should include the hostname for the container Major . Siddharth Seth Xuan Gong
YARN-5122 “yarn logs” for running containers should print an explicit footer saying that the log may be incomplete Major . Vinod Kumar Vavilapalli Jian He
YARN-5243 fix several rebase and other miscellaneous issues before merge Major timelineserver Sangjin Lee Sangjin Lee
YARN-5070 upgrade HBase version for first merge Critical timelineserver Sangjin Lee Vrushali C
HADOOP-13241 document s3a better Minor documentation, fs/s3 Steve Loughran Steve Loughran
HADOOP-12975 Add jitter to CachingGetSpaceUsed’s thread Major . Elliott Clark Elliott Clark
YARN-5251 Yarn CLI to obtain App logs for last ‘n’ bytes fails with ‘java.io.IOException’ and for ‘n’ bytes fails with NumberFormatException Blocker . Sumana Sathish Xuan Gong
HADOOP-13280 FileSystemStorageStatistics#getLong(“readOps“) should return readOps + largeReadOps Major fs Mingliang Liu Mingliang Liu
HADOOP-13288 Guard null stats key in FileSystemStorageStatistics Major fs Mingliang Liu Mingliang Liu
HADOOP-13291 Probing stats in DFSOpsCountStatistics/S3AStorageStatistics should be correctly implemented Major fs Mingliang Liu Mingliang Liu
HDFS-10538 Remove AsyncDistributedFileSystem API Major hdfs-client Xiaobing Zhou Xiaobing Zhou
HDFS-10328 Add per-cache-pool default replication num configuration Minor caching xupeng xupeng
HADOOP-13203 S3A: Support fadvise “random” mode for high performance readPositioned() reads Major fs/s3 Rajesh Balamohan Rajesh Balamohan
HDFS-10473 Allow only suitable storage policies to be set on striped files Major namenode Uma Maheswara Rao G Uma Maheswara Rao G
YARN-5171 Extend DistributedSchedulerProtocol to notify RM of containers allocated by the Node Major . Arun Suresh Íñigo Goiri
MAPREDUCE-6720 Inconsistent values of counters across tasks and job reported to timeline service. Major applicationmaster Varun Saxena Varun Saxena
HDFS-10460 Erasure Coding: Recompute block checksum for a particular range less than file size on the fly by reconstructing missed block Major datanode Rakesh R Rakesh R
HADOOP-13019 Implement ErasureCodec for HitchHiker XOR coding Major io Kai Sasaki Kai Sasaki
HADOOP-12229 Fix inconsistent subsection titles in filesystem.md Minor documentation Masatake Iwasaki Masatake Iwasaki
HADOOP-12242 Add in-page TOC to filesystem specification pages Minor documentation Masatake Iwasaki Masatake Iwasaki
HADOOP-13305 Define common statistics names across schemes Major fs Mingliang Liu Mingliang Liu
YARN-5174 [documentation] several updates/corrections to timeline service documentation Major timelineserver Sangjin Lee Sangjin Lee
YARN-5227 yarn logs command: no need to specify -applicationId when specifying containerId Major . Jian He Gergely Novák
YARN-5224 Logs for a completed container are not available in the yarn logs output for a live application Major . Siddharth Seth Xuan Gong
YARN-5316 fix hadoop-aws pom not to do the exclusion Major timelineserver Sangjin Lee Sangjin Lee
HADOOP-11993 maven enforcer plugin to ban java 8 incompatible dependencies Minor . Steve Loughran Tsuyoshi Ozawa
HADOOP-13283 Support reset operation for new global storage statistics and per FS storage stats Major fs Mingliang Liu Mingliang Liu
YARN-5233 Support for specifying a path for ATS plugin jars Major timelineserver Li Lu Li Lu
YARN-5080 Cannot obtain logs using YARN CLI -am for either KILLED or RUNNING AM Critical yarn Sumana Sathish Xuan Gong
YARN-5200 Improve yarn logs to get Container List Major . Xuan Gong Xuan Gong
HADOOP-13366 Fix dead link in o.a.h.fs.CommonConfigurationKeysPublic javadoc Minor documentation Rakesh R Rakesh R
YARN-5299 Log Docker run command when container fails Major yarn Varun Vasudev Varun Vasudev
YARN-4759 Fix signal handling for docker containers Major yarn Sidharta Seethana Shane Kumpf
YARN-5363 For AM containers, or for containers of running-apps, “yarn logs” incorrectly only (tries to) shows syslog file-type by default Major log-aggregation Vinod Kumar Vavilapalli Vinod Kumar Vavilapalli
HDFS-10600 PlanCommand#getThrsholdPercentage should not use throughput value. Major diskbalancer Lei (Eddy) Xu Yiqun Lin
YARN-5298 Mount usercache and NM filecache directories into Docker container Major yarn Varun Vasudev Sidharta Seethana
YARN-5361 Obtaining logs for completed container says ’file belongs to a running container ’ at the end Critical . Sumana Sathish Xuan Gong
YARN-5320 [YARN-3368] Add resource usage by applications and queues to cluster overview page. Major . Wangda Tan Wangda Tan
YARN-4484 Available Resource calculation for a queue is not correct when used with labels Major capacity scheduler Sunil Govindan Sunil Govindan
HADOOP-13368 DFSOpsCountStatistics$OpType#fromSymbol and s3a.Statistic#fromSymbol should be O(1) operation Major fs Mingliang Liu Mingliang Liu
YARN-5350 Distributed Scheduling: Ensure sort order of allocatable nodes returned by the RM is not lost Major . Arun Suresh Arun Suresh
HADOOP-13212 Provide an option to set the socket buffers in S3AFileSystem Minor fs/s3 Rajesh Balamohan Rajesh Balamohan
HDFS-10653 Optimize conversion from path string to components Major hdfs Daryn Sharp Daryn Sharp
HDFS-10565 Erasure Coding: Document about the current allowed storage policies for EC Striped mode files Major documentation Uma Maheswara Rao G Uma Maheswara Rao G
HADOOP-13207 Specify FileSystem listStatus, listFiles and RemoteIterator Major documentation, fs Steve Loughran Steve Loughran
HADOOP-13188 S3A file-create should throw error rather than overwrite directories Minor fs/s3 Raymie Stata Steve Loughran
YARN-5164 Use plan RLE to improve CapacityOverTimePolicy efficiency Major capacityscheduler, fairscheduler, resourcemanager Carlo Curino Carlo Curino
HADOOP-13041 Adding tests for coder utilities Major . Kai Sasaki Kai Sasaki
HDFS-10642 TestLazyPersistReplicaRecovery#testDnRestartWithSavedReplicas fails intermittently Major datanode, test Mingliang Liu Mingliang Liu
YARN-5392 Replace use of Priority in the Scheduling infrastructure with an opaque ShedulerRequestKey Major . Arun Suresh Arun Suresh
YARN-5351 ResourceRequest should take ExecutionType into account during comparison Major . Konstantinos Karanasos Konstantinos Karanasos
HDFS-10668 TestDataNodeMXBean#testDataNodeMXBeanBlockCount fails intermittently Major test Mingliang Liu Mingliang Liu
YARN-5434 Add -client|server argument for graceful decom Blocker graceful Robert Kanter Robert Kanter
YARN-5113 Refactoring and other clean-up for distributed scheduling Major . Arun Suresh Konstantinos Karanasos
HADOOP-11540 Raw Reed-Solomon coder using Intel ISA-L library Major . Zhe Zhang Kai Zheng
YARN-5458 Rename DockerStopCommandTest to TestDockerStopCommand Trivial . Shane Kumpf Shane Kumpf
YARN-5443 Add support for docker inspect command Major yarn Shane Kumpf Shane Kumpf
HADOOP-13429 Dispose of unnecessary SASL servers Major ipc Daryn Sharp Daryn Sharp
YARN-5226 remove AHS enable check from LogsCLI#fetchAMContainerLogs Major . Xuan Gong Xuan Gong
HADOOP-13426 More efficiently build IPC responses Major . Daryn Sharp Daryn Sharp
HDFS-10656 Optimize conversion of byte arrays back to path string Major hdfs Daryn Sharp Daryn Sharp
HDFS-10674 Optimize creating a full path from an inode Major hdfs Daryn Sharp Daryn Sharp
YARN-5342 Improve non-exclusive node partition resource allocation in Capacity Scheduler Major . Wangda Tan Sunil Govindan
HADOOP-13438 Optimize IPC server protobuf decoding Major . Daryn Sharp Daryn Sharp
YARN-5459 Add support for docker rm Minor yarn Shane Kumpf Shane Kumpf
HDFS-10588 False alarm in datanode log - ERROR - Disk Balancer is not enabled Major datanode, hdfs Weiwei Yang Weiwei Yang
YARN-5429 Fix @return related javadoc warnings in yarn-api Major . Vrushali C Vrushali C
YARN-4888 Changes in scheduler to identify resource-requests explicitly by allocation-id Major resourcemanager Subru Krishnan Subru Krishnan
HADOOP-13418 Fix javadoc warnings by JDK8 in hadoop-nfs package Major . Kai Sasaki Kai Sasaki
YARN-5470 Differentiate exactly match with regex in yarn log CLI Major . Xuan Gong Xuan Gong
YARN-5394 Remove bind-mount /etc/passwd for Docker containers Major yarn Zhankun Tang Zhankun Tang
HDFS-10681 DiskBalancer: query command should report Plan file path apart from PlanID Minor diskbalancer Manoj Govindassamy Manoj Govindassamy
YARN-5137 Make DiskChecker pluggable in NodeManager Major nodemanager Ray Chiang Yufei Gu
HADOOP-11588 Benchmark framework and test for erasure coders Major io Kai Zheng Rui Li
HDFS-8668 Erasure Coding: revisit buffer used for encoding and decoding. Major . Yi Liu Sammi Chen
HDFS-10724 Document the caller context config keys Minor ipc, namenode Mingliang Liu Mingliang Liu
HDFS-10678 Documenting NNThroughputBenchmark tool Major benchmarks, test Mingliang Liu Mingliang Liu
HDFS-10641 TestBlockManager#testBlockReportQueueing fails intermittently Major namenode, test Mingliang Liu Daryn Sharp
YARN-5514 Clarify DecommissionType.FORCEFUL comment Minor documentation Robert Kanter Vrushali C
HADOOP-13324 s3a tests don’t authenticate with S3 frankfurt (or other V4 auth only endpoints) Major fs/s3 Steve Loughran Steve Loughran
HADOOP-13208 S3A listFiles(recursive=true) to do a bulk listObjects instead of walking the pseudo-tree of directories Minor fs/s3 Steve Loughran Steve Loughran
HADOOP-13405 doc for “fs.s3a.acl.default” indicates incorrect values Minor fs/s3 Shen Yinjie Shen Yinjie
YARN-4676 Automatic and Asynchronous Decommissioning Nodes Status Tracking Major resourcemanager Daniel Zhi Daniel Zhi
HADOOP-13504 Refactor jni_common to conform to C89 restrictions imposed by Visual Studio 2010 Major io Sammi Chen Sammi Chen
HDFS-10711 Optimize FSPermissionChecker group membership check Major hdfs Daryn Sharp Daryn Sharp
HADOOP-13252 Tune S3A provider plugin mechanism Minor fs/s3 Steve Loughran Steve Loughran
HADOOP-13446 Support running isolated unit tests separate from AWS integration tests. Major fs/s3 Chris Nauroth Chris Nauroth
YARN-5457 Refactor DistributedScheduling framework to pull out common functionality Major resourcemanager Arun Suresh Arun Suresh
HDFS-10762 Pass IIP for file status related methods Major hdfs Daryn Sharp Daryn Sharp
HDFS-8905 Refactor DFSInputStream#ReaderStrategy Major erasure-coding Kai Zheng Sammi Chen
HDFS-10772 Reduce byte/string conversions for get listing Major hdfs Daryn Sharp Daryn Sharp
YARN-5042 Mount /sys/fs/cgroup into Docker containers as read only mount Major yarn Varun Vasudev luhuichun
YARN-5564 Fix typo in RM_SCHEDULER_RESERVATION_THRESHOLD_INCREMENT_MULTIPLE Trivial fairscheduler Ray Chiang Ray Chiang
YARN-3940 Application moveToQueue should check NodeLabel permission Major resourcemanager Bibin A Chundatt Bibin A Chundatt
YARN-5557 Add localize API to the ContainerManagementProtocol Major . Jian He Jian He
HDFS-10768 Optimize mkdir ops Major hdfs Daryn Sharp Daryn Sharp
HDFS-10598 DiskBalancer does not execute multi-steps plan. Critical diskbalancer Lei (Eddy) Xu Lei (Eddy) Xu
YARN-5327 API changes required to support recurring reservations in the YARN ReservationSystem Major resourcemanager Subru Krishnan Sangeetha Abdu Jyothi
YARN-4889 Changes in AMRMClient for identifying resource-requests explicitly Major resourcemanager Subru Krishnan Arun Suresh
HDFS-10655 Fix path related byte array conversion bugs Major hdfs Daryn Sharp Daryn Sharp
HDFS-10662 Optimize UTF8 string/byte conversions Major hdfs Daryn Sharp Daryn Sharp
HDFS-10673 Optimize FSPermissionChecker’s internal path usage Major hdfs Daryn Sharp Daryn Sharp
HDFS-10744 Internally optimize path component resolution Major hdfs Daryn Sharp Daryn Sharp
YARN-4091 Add REST API to retrieve scheduler activity Major capacity scheduler, resourcemanager Sunil Govindan Chen Ge
HDFS-10745 Directly resolve paths into INodesInPath Major hdfs Daryn Sharp Daryn Sharp
HADOOP-13419 Fix javadoc warnings by JDK8 in hadoop-common package Major . Kai Sasaki Kai Sasaki
HADOOP-10597 RPC Server signals backoff to clients when all request queues are full Major . Ming Ma Ming Ma
HADOOP-10300 Allowed deferred sending of call responses Major ipc Daryn Sharp Daryn Sharp
YARN-4390 Do surgical preemption based on reserved container in CapacityScheduler Major capacity scheduler Eric Payne Wangda Tan
YARN-4844 Add getMemorySize/getVirtualCoresSize to o.a.h.y.api.records.Resource Blocker api Wangda Tan Wangda Tan
YARN-3866 AM-RM protocol changes to support container resizing Blocker api MENG DING MENG DING
HDFS-7964 Add support for async edit logging Major namenode Daryn Sharp Daryn Sharp
HDFS-9005 Provide configuration support for upgrade domain Major . Ming Ma Ming Ma
HDFS-9016 Display upgrade domain information in fsck Major . Ming Ma Ming Ma
HDFS-9922 Upgrade Domain placement policy status marks a good block in violation when there are decommissioned nodes Minor . Chris Trezzo Chris Trezzo
HDFS-8818 Allow Balancer to run faster Major balancer & mover Tsz Wo Nicholas Sze Tsz Wo Nicholas Sze
YARN-4140 RM container allocation delayed incase of app submitted to Nodelabel partition Major scheduler Bibin A Chundatt Bibin A Chundatt
HDFS-9754 Avoid unnecessary getBlockCollection calls in BlockManager Major namenode Jing Zhao Jing Zhao

OTHER:

JIRA Summary Priority Component Reporter Contributor
HDFS-2776 Missing interface annotation on JournalSet Trivial namenode Todd Lipcon Brandon Li
HADOOP-8308 Support cross-project Jenkins builds Major build Tom White Tom White
YARN-3357 Move TestFifoScheduler to FIFO package Major scheduler, test Rohith Sharma K S Rohith Sharma K S
HADOOP-11814 Reformat hadoop-annotations, o.a.h.classification.tools Minor . Li Lu Li Lu
MAPREDUCE-6388 Remove deprecation warnings from JobHistoryServer classes Minor jobhistoryserver Ray Chiang Ray Chiang
YARN-3026 Move application-specific container allocation logic from LeafQueue to FiCaSchedulerApp Major capacityscheduler Wangda Tan Wangda Tan
HDFS-8938 Extract BlockToMarkCorrupt and ReplicationWork as standalone classes from BlockManager Major . Mingliang Liu Mingliang Liu
HDFS-9027 Refactor o.a.h.hdfs.DataStreamer#isLazyPersist() method Major . Mingliang Liu Mingliang Liu
MAPREDUCE-6477 Replace usage of deprecated NameNode.DEFAULT_PORT in TestFileSystem Major . Mingliang Liu Mingliang Liu
MAPREDUCE-6483 Replace deprecated method NameNode.getUri() with DFSUtilClient.getNNUri() in TestMRCredentials Major test Mingliang Liu Mingliang Liu
HDFS-9130 Use GenericTestUtils#setLogLevel to the logging level Major . Mingliang Liu Mingliang Liu
HADOOP-12446 Undeprecate createNonRecursive() Major . Ted Yu Ted Yu
HDFS-8979 Clean up checkstyle warnings in hadoop-hdfs-client module Major . Mingliang Liu Mingliang Liu
HADOOP-11791 Update src/site/markdown/releases to include old versions of Hadoop Major build, documentation Allen Wittenauer Allen Wittenauer
HADOOP-12514 Make static fields in GenericTestUtils for assertExceptionContains() package-private and final Minor test Mingliang Liu Mingliang Liu
HDFS-9377 Fix findbugs warnings in FSDirSnapshotOp Major namenode Mingliang Liu Mingliang Liu
HADOOP-12567 NPE in SaslRpcServer Major . Sergey Shelukhin Sergey Shelukhin
YARN-4535 Fix checkstyle error in CapacityScheduler.java Trivial . Rohith Sharma K S Naganarasimha G R
YARN-4653 Document YARN security model from the perspective of Application Developers Major site Steve Loughran Steve Loughran
HDFS-10200 Docs for WebHDFS still describe GETDELEGATIONTOKENS operation Trivial documentation Wellington Chevreuil Wellington Chevreuil
YARN-5297 Avoid printing a stack trace when recovering an app after the RM restarts Major . Siddharth Seth Junping Du
HDFS-10651 Clean up some configuration related codes about legacy block reader Minor . Kai Zheng Youwei Wang
HDFS-9353 Code and comment mismatch in JavaKeyStoreProvider Trivial . nijel Andras Bokor
HDFS-10718 Prefer direct ByteBuffer in native RS encoder and decoder Major . Sammi Chen Sammi Chen
YARN-5495 Remove import wildcard in CapacityScheduler Trivial capacityscheduler Ray Chiang Ray Chiang