Apache Hadoop Changelog

Release 2.8.0 - 2017-03-22

INCOMPATIBLE CHANGES:

JIRA	Summary	Priority	Component	Reporter	Contributor
YARN-3241	FairScheduler handles “invalid” queue names inconsistently	Major	fairscheduler	zhihai xu	zhihai xu
HADOOP-11731	Rework the changelog and releasenotes	Major	documentation	Allen Wittenauer	Allen Wittenauer
HADOOP-11746	rewrite test-patch.sh	Major	build, test	Allen Wittenauer	Allen Wittenauer
HDFS-8226	Non-HA rollback compatibility broken	Blocker	.	J.Andreina	J.Andreina
HADOOP-11772	RPC Invoker relies on static ClientCache which has synchronized(this) blocks	Major	ipc, performance	Gopal V	Haohui Mai
YARN-2336	Fair scheduler REST api returns a missing ‘[’ bracket JSON for deep queue tree	Major	fairscheduler	Kenji Kikushima	Akira Ajisaka
YARN-41	The RM should handle the graceful shutdown of the NM.	Major	nodemanager, resourcemanager	Ravi Teja Ch N V	Devaraj K
HDFS-6564	Use slf4j instead of common-logging in hdfs-client	Major	build	Haohui Mai	Rakesh R
MAPREDUCE-6427	Fix typo in JobHistoryEventHandler	Minor	.	Brahma Reddy Battula	Ray Chiang
HADOOP-12209	Comparable type should be in FileStatus	Minor	fs	Yong Zhang	Yong Zhang
HADOOP-12269	Update aws-sdk dependency to 1.10.6; move to aws-sdk-s3	Major	fs/s3	Thomas Demoor	Thomas Demoor
HDFS-8900	Compact XAttrs to optimize memory footprint.	Major	namenode	Yi Liu	Yi Liu
YARN-4087	Followup fixes after YARN-2019 regarding RM behavior when state-store error occurs	Major	.	Jian He	Jian He
HADOOP-12416	Trash messages should be handled by Logger instead of being delivered on System.out	Major	trash	Ashutosh Chauhan	Mingliang Liu
HDFS-9063	Correctly handle snapshot path for getContentSummary	Major	namenode	Jing Zhao	Jing Zhao
HDFS-9433	DFS getEZForPath API on a non-existent file should throw FileNotFoundException	Major	encryption	Rakesh R	Rakesh R
HADOOP-11252	RPC client does not time out by default	Critical	ipc	Wilfred Spiegelenburg	Masatake Iwasaki
HDFS-9047	Retire libwebhdfs	Major	webhdfs	Allen Wittenauer	Haohui Mai
HADOOP-12651	Replace dev-support with wrappers to Yetus	Major	scripts	Allen Wittenauer	Allen Wittenauer
HADOOP-12552	Fix undeclared/unused dependency to httpclient	Minor	build	Masatake Iwasaki	Masatake Iwasaki
HADOOP-11792	Remove all of the CHANGES.txt files	Major	build	Allen Wittenauer	Andrew Wang
YARN-5035	FairScheduler: Adjust maxAssign dynamically when assignMultiple is turned on	Major	fairscheduler	Karthik Kambatla	Karthik Kambatla
HADOOP-12892	fix/rewrite create-release	Blocker	build	Allen Wittenauer	Allen Wittenauer
HADOOP-13139	Branch-2: S3a to use thread pool that blocks clients	Major	fs/s3	Pieter Reuse	Pieter Reuse
HADOOP-13382	remove unneeded commons-httpclient dependencies from POM files in Hadoop and sub-projects	Major	build	Matt Foley	Matt Foley
HDFS-7933	fsck should also report decommissioning replicas.	Major	namenode	Jitendra Nath Pandey	Xiaoyu Yao
HADOOP-13560	S3ABlockOutputStream to support huge (many GB) file writes	Major	fs/s3	Steve Loughran	Steve Loughran
HDFS-11048	Audit Log should escape control characters	Major	.	Eric Badger	Eric Badger
HADOOP-13812	Upgrade Tomcat to 6.0.48	Blocker	kms	John Zhuge	John Zhuge
HADOOP-13929	ADLS connector should not check in contract-test-options.xml	Major	fs/adl, test	John Zhuge	John Zhuge
HADOOP-14138	Remove S3A ref from META-INF service discovery, rely on existing core-default entry	Critical	fs/s3	Steve Loughran	Steve Loughran

IMPORTANT ISSUES:

JIRA	Summary	Priority	Component	Reporter	Contributor
YARN-4785	inconsistent value type of the “type” field for LeafQueueInfo in response of RM REST API - cluster/scheduler	Major	webapp	Jayesh	Varun Vasudev
YARN-6959	RM may allocate wrong AM Container for new attempt	Major	capacity scheduler, fairscheduler, scheduler	Yuqi Wang	Yuqi Wang

NEW FEATURES:

JIRA	Summary	Priority	Component	Reporter	Contributor
HADOOP-8934	Shell command ls should include sort options	Minor	fs	Jonathan Allen	Jonathan Allen
HADOOP-9477	Add posixGroups support for LDAP groups mapping service	Major	.	Kai Zheng	Dapeng Sun
HDFS-8009	Signal congestion on the DataNode	Major	datanode	Haohui Mai	Haohui Mai
YARN-2901	Add errors and warning metrics page to RM, NM web UI	Major	nodemanager, resourcemanager	Varun Vasudev	Varun Vasudev
HDFS-7891	A block placement policy with best rack failure tolerance	Minor	namenode	Walter Su	Walter Su
HADOOP-11843	Make setting up the build environment easier	Major	build	Niels Basjes	Niels Basjes
MAPREDUCE-6284	Add Task Attempt State API to MapReduce Application Master REST API	Minor	.	Ryu Kobayashi	Ryu Kobayashi
HADOOP-10971	Add -C flag to make `hadoop fs -ls` print filenames only	Major	fs	Ryan Williams	Kengo Seki
MAPREDUCE-6364	Add a “Kill” link to Task Attempts page	Minor	applicationmaster	Ryu Kobayashi	Ryu Kobayashi
HDFS-8487	Generalize BlockInfo in preparation of merging HDFS-7285 into trunk and branch-2	Major	namenode	Zhe Zhang	Zhe Zhang
HDFS-8608	Merge HDFS-7912 to trunk and branch-2 (track BlockInfo instead of Block in UnderReplicatedBlocks and PendingReplicationBlocks)	Major	.	Zhe Zhang	Zhe Zhang
HADOOP-5732	Add SFTP FileSystem	Minor	fs	Íñigo Goiri	ramtin
HDFS-8622	Implement GETCONTENTSUMMARY operation for WebImageViewer	Major	.	Jagadesh Kiran N	Jagadesh Kiran N
HDFS-8155	Support OAuth2 in WebHDFS	Major	webhdfs	Jakob Homan	Jakob Homan
MAPREDUCE-6415	Create a tool to combine aggregated logs into HAR files	Major	.	Robert Kanter	Robert Kanter
HADOOP-12360	Create StatsD metrics2 sink	Minor	metrics	Dave Marion	Dave Marion
YARN-261	Ability to fail AM attempts	Major	api	Jason Lowe	Rohith Sharma K S
HDFS-9184	Logging HDFS operation’s caller context into audit logs	Major	.	Mingliang Liu	Mingliang Liu
HDFS-9057	allow/disallow snapshots via webhdfs	Major	webhdfs	Allen Wittenauer	Brahma Reddy Battula
YARN-4349	Support CallerContext in YARN	Major	.	Wangda Tan	Wangda Tan
YARN-3623	We should have a config to indicate the Timeline Service version	Major	timelineserver	Zhijie Shen	Xuan Gong
HADOOP-12657	Add a option to skip newline on empty files with getMerge -nl	Minor	.	Jan Filipiak	Kanaka Kumar Avvaru
YARN-3458	CPU resource monitoring in Windows	Minor	nodemanager	Íñigo Goiri	Íñigo Goiri
HADOOP-12691	Add CSRF Filter for REST APIs to Hadoop Common	Major	security	Larry McCay	Larry McCay
HADOOP-12635	Adding Append API support for WASB	Major	fs/azure	Dushyanth	Dushyanth
HADOOP-12426	Add Entry point for Kerberos health check	Minor	security	Steve Loughran	Steve Loughran
HDFS-9244	Support nested encryption zones	Major	encryption	Xiaoyu Yao	Zhe Zhang
HADOOP-12548	Read s3a creds from a Credential Provider	Major	fs/s3	Allen Wittenauer	Larry McCay
HDFS-9711	Integrate CSRF prevention filter in WebHDFS.	Major	datanode, namenode, webhdfs	Chris Nauroth	Chris Nauroth
HDFS-9835	OIV: add ReverseXML processor which reconstructs an fsimage from an XML file	Major	tools	Colin P. McCabe	Colin P. McCabe
HDFS-9239	DataNode Lifeline Protocol: an alternative protocol for reporting DataNode liveness	Major	datanode, namenode	Chris Nauroth	Chris Nauroth
HADOOP-12909	Change ipc.Client to support asynchronous calls	Major	ipc	Tsz Wo Nicholas Sze	Xiaobing Zhou
HDFS-9945	Datanode command for evicting writers	Major	datanode	Kihwal Lee	Kihwal Lee
HADOOP-13008	Add XFS Filter for UIs to Hadoop Common	Major	security	Larry McCay	Larry McCay
HADOOP-13065	Add a new interface for retrieving FS and FC Statistics	Major	fs	Ram Venkatesh	Mingliang Liu
HADOOP-12723	S3A: Add ability to plug in any AWSCredentialsProvider	Major	fs/s3	Steven K. Wong	Steven K. Wong
HADOOP-13226	Support async call retry and failover	Major	io, ipc	Xiaobing Zhou	Tsz Wo Nicholas Sze
HADOOP-12537	S3A to support Amazon STS temporary credentials	Minor	fs/s3	Sean Mackrory	Sean Mackrory
HDFS-9804	Allow long-running Balancer to login with keytab	Major	balancer & mover, security	Xiao Chen	Xiao Chen
HDFS-10918	Add a tool to get FileEncryptionInfo from CLI	Major	encryption	Xiao Chen	Xiao Chen
HADOOP-13716	Add LambdaTestUtils class for tests; fix eventual consistency problem in contract test setup	Major	test	Steve Loughran	Steve Loughran
HADOOP-14049	Honour AclBit flag associated to file/folder permission for Azure datalake account	Major	fs/adl	Vishwajeet Dusane	Vishwajeet Dusane
HADOOP-14048	REDO operation of WASB#AtomicRename should create placeholder blob for destination folder	Critical	fs/azure	NITIN VERMA	NITIN VERMA
MAPREDUCE-6304	Specifying node labels when submitting MR jobs	Major	job submission	Jian Fang	Naganarasimha G R
YARN-1963	Support priorities across applications within the same queue	Major	api, resourcemanager	Arun C Murthy	Sunil Govindan

IMPROVEMENTS:

JIRA	Summary	Priority	Component	Reporter	Contributor
HDFS-2580	NameNode#main(…) can make use of GenericOptionsParser.	Minor	namenode	Harsh J	Harsh J
MAPREDUCE-5232	log classpath and other key properties on child JVM start	Major	mrv1, mrv2	Sangjin Lee	Sangjin Lee
HADOOP-7713	dfs -count -q should label output column	Trivial	.	Nigel Daley	Jonathan Allen
HDFS-7546	Document, and set an accepting default for dfs.namenode.kerberos.principal.pattern	Minor	security	Harsh J	Harsh J
HADOOP-11692	Improve authentication failure WARN message to avoid user confusion	Major	ipc	Yongjun Zhang	Yongjun Zhang
HADOOP-11226	Add a configuration to set ipc.Client’s traffic class with IPTOS_LOWDELAY\|IPTOS_RELIABILITY	Major	ipc	Gopal V	Gopal V
HADOOP-11711	Provide a default value for AES/CTR/NoPadding CryptoCodec classes	Minor	.	Andrew Wang	Andrew Wang
MAPREDUCE-4414	Add main methods to JobConf and YarnConfiguration, for debug purposes	Major	client	Harsh J	Plamen Jeliazkov
MAPREDUCE-6105	Inconsistent configuration in property mapreduce.reduce.shuffle.merge.percent	Trivial	.	Dongwook Kwon	Ray Chiang
HDFS-2360	Ugly stacktrace when quota exceeds	Minor	hdfs-client	Rajit Saha	Harsh J
MAPREDUCE-6100	replace “mapreduce.job.credentials.binary” with MRJobConfig.MAPREDUCE_JOB_CREDENTIALS_BINARY for better readability.	Trivial	mrv2	zhihai xu	zhihai xu
MAPREDUCE-5755	MapTask.MapOutputBuffer#compare/swap should have @Override annotation	Trivial	.	Tsuyoshi Ozawa	Tsuyoshi Ozawa
MAPREDUCE-4653	TestRandomAlgorithm has an unused “import” statement	Trivial	contrib/gridmix	Amir Sanjar	Amir Sanjar
HADOOP-11659	o.a.h.fs.FileSystem.Cache#remove should use a single hash map lookup	Minor	fs	Gera Shegalov	Brahma Reddy Battula
HADOOP-11709	Time.NANOSECONDS_PER_MILLISECOND - use class-level final constant instead of method variable	Trivial	.	Ajith S	Ajith S
HDFS-7835	make initial sleeptime in locateFollowingBlock configurable for DFSClient.	Major	hdfs-client	zhihai xu	zhihai xu
HDFS-7829	Code clean up for LocatedBlock	Minor	.	Jing Zhao	Takanobu Asanuma
MAPREDUCE-6282	Reuse historyFileAbsolute.getFileSystem in CompletedJob#loadFullHistoryData for code optimization.	Trivial	jobhistoryserver	zhihai xu	zhihai xu
HADOOP-11447	Add a more meaningful toString method to SampleStat and MutableStat	Minor	metrics	Karthik Kambatla	Karthik Kambatla
YARN-3350	YARN RackResolver spams logs with messages at info level	Major	.	Wilfred Spiegelenburg	Wilfred Spiegelenburg
MAPREDUCE-6239	Consolidate TestJobConf classes in hadoop-mapreduce-client-jobclient and hadoop-mapreduce-client-core	Minor	client	Varun Saxena	Varun Saxena
MAPREDUCE-5190	Unnecessary condition test in RandomSampler	Minor	mrv2	Jingguo Yao	Jingguo Yao
MAPREDUCE-6287	Deprecated methods in org.apache.hadoop.examples.Sort	Minor	examples	Chao Zhang	Chao Zhang
HADOOP-11737	mockito’s version in hadoop-nfs’ pom.xml shouldn’t be specified	Minor	nfs	Kengo Seki	Kengo Seki
YARN-2868	FairScheduler: Metric for latency to allocate first container for an application	Major	.	Ray Chiang	Ray Chiang
HDFS-7875	Improve log message when wrong value configured for dfs.datanode.failed.volumes.tolerated	Trivial	datanode	nijel	nijel
HDFS-7793	Refactor DFSOutputStream separating DataStreamer out	Major	hdfs-client	Kai Zheng	Li Bo
HADOOP-11741	Add LOG.isDebugEnabled() guard for some LOG.debug()	Major	.	Walter Su	Walter Su
MAPREDUCE-579	Streaming “slowmatch” documentation	Trivial	contrib/streaming	Bo Adler	Harsh J
HDFS-7928	Scanning blocks from disk during rolling upgrade startup takes a lot of time if disks are busy	Major	datanode	Rushabh S Shah	Rushabh S Shah
HADOOP-11719	[Fsshell] Remove bin/hadoop reference from GenericOptionsParser default help text	Minor	scripts	Brahma Reddy Battula	Brahma Reddy Battula
HDFS-8004	Use KeyProviderCryptoExtension#warmUpEncryptedKeys when creating an encryption zone	Trivial	encryption	Andrew Wang	Andrew Wang
HDFS-7890	Improve information on Top users for metrics in RollingWindowsManager and lower log level	Major	.	J.Andreina	J.Andreina
HDFS-4396	Add START_MSG/SHUTDOWN_MSG for ZKFC	Major	auto-failover, ha, tools	Liang Xie	Liang Xie
HADOOP-11660	Add support for hardware crc of HDFS checksums on ARM aarch64 architecture	Minor	native	Edward Nevill	Edward Nevill
HDFS-7645	Rolling upgrade is restoring blocks from trash multiple times	Major	datanode	Nathan Roberts	Keisuke Ogiwara
HDFS-3918	EditLogTailer shouldn’t log WARN when other node is in standby mode	Major	ha	Todd Lipcon	Todd Lipcon
HDFS-7944	Minor cleanup of BlockPoolManager#getAllNamenodeThreads	Minor	.	Arpit Agarwal	Arpit Agarwal
YARN-3258	FairScheduler: Need to add more logging to investigate allocations	Minor	fairscheduler	Anubhav Dhoot	Anubhav Dhoot
HDFS-7671	hdfs user guide should point to the common rack awareness doc	Major	documentation	Allen Wittenauer	Kai Sasaki
YARN-3412	RM tests should use MockRM where possible	Major	resourcemanager, test	Karthik Kambatla	Karthik Kambatla
YARN-3428	Debug log resources to be localized for a container	Trivial	nodemanager	Karthik Kambatla	Karthik Kambatla
YARN-3424	Change logs for ContainerMonitorImpl’s resourse monitoring from info to debug	Major	nodemanager	Anubhav Dhoot	Anubhav Dhoot
YARN-3248	Display count of nodes blacklisted by apps in the web UI	Major	capacityscheduler, resourcemanager	Varun Vasudev	Varun Vasudev
HDFS-7978	Add LOG.isDebugEnabled() guard for some LOG.debug(..)	Major	.	Walter Su	Walter Su
HDFS-8008	Support client-side back off when the datanodes are congested	Major	hdfs-client	Haohui Mai	Haohui Mai
HDFS-7888	Change DataStreamer/DFSOutputStream/DFSPacket for convenience of subclassing	Minor	hdfs-client	Li Bo	Li Bo
HDFS-8035	Move checkBlocksProperlyReplicated() in FSNamesystem to BlockManager	Minor	namenode	Haohui Mai	Haohui Mai
HADOOP-9805	Refactor RawLocalFileSystem#rename for improved testability.	Minor	fs, test	Chris Nauroth	Jean-Pierre Matsumoto
HADOOP-11785	Reduce number of listStatus operation in distcp buildListing()	Minor	tools/distcp	Zoran Dimitrijevic	Zoran Dimitrijevic
HADOOP-11717	Add Redirecting WebSSO behavior with JWT Token in Hadoop Auth	Major	security	Larry McCay	Larry McCay
YARN-3294	Allow dumping of Capacity Scheduler debug logs via web UI for a fixed time period	Major	capacityscheduler	Varun Vasudev	Varun Vasudev
HDFS-8073	Split BlockPlacementPolicyDefault.chooseTarget(..) so it can be easily overrided.	Trivial	namenode	Walter Su	Walter Su
HDFS-8076	Code cleanup for DFSInputStream: use offset instead of LocatedBlock when possible	Major	.	Zhe Zhang	Zhe Zhang
HDFS-7979	Initialize block report IDs with a random number	Minor	datanode	Andrew Wang	Andrew Wang
HDFS-8101	DFSClient use of non-constant DFSConfigKeys pulls in WebHDFS classes at runtime	Minor	hdfs-client	Sean Busbey	Sean Busbey
YARN-3293	Track and display capacity scheduler health metrics in web UI	Major	capacityscheduler	Varun Vasudev	Varun Vasudev
MAPREDUCE-6291	Correct mapred queue usage command	Minor	client	Brahma Reddy Battula	Brahma Reddy Battula
MAPREDUCE-6307	Remove property mapreduce.tasktracker.taskmemorymanager.monitoringinterval	Minor	.	Akira Ajisaka	J.Andreina
YARN-3348	Add a ‘yarn top’ tool to help understand cluster usage	Major	resourcemanager	Varun Vasudev	Varun Vasudev
YARN-3469	ZKRMStateStore: Avoid setting watches that are not required	Minor	.	Jun Gong	Jun Gong
HDFS-8117	More accurate verification in SimulatedFSDataset: replace DEFAULT_DATABYTE with patterned data	Major	.	Zhe Zhang	Zhe Zhang
HDFS-8144	Split TestLazyPersistFiles into multiple tests	Major	test	Arpit Agarwal	Arpit Agarwal
YARN-3404	View the queue name to YARN Application page	Minor	.	Ryu Kobayashi	Ryu Kobayashi
YARN-3451	Add start time and Elapsed in ApplicationAttemptReport and display the same in RMAttemptBlock WebUI	Major	api, webapp	Rohith Sharma K S	Rohith Sharma K S
HDFS-7863	Missing description of some methods and parameters in javadoc of FSDirDeleteOp	Minor	.	Yongjun Zhang	Brahma Reddy Battula
HDFS-8152	Refactoring of lazy persist storage cases	Major	test	Arpit Agarwal	Arpit Agarwal
HDFS-8133	Improve readability of deleted block check	Major	namenode	Daryn Sharp	Daryn Sharp
HADOOP-11812	Implement listLocatedStatus for ViewFileSystem to speed up split calculation	Blocker	fs	Gera Shegalov	Gera Shegalov
MAPREDUCE-6297	Task Id of the failed task in diagnostics should link to the task page	Minor	jobhistoryserver	Siqi Li	Siqi Li
HADOOP-11827	Speed-up distcp buildListing() using threadpool	Major	tools/distcp	Zoran Dimitrijevic	Zoran Dimitrijevic
YARN-3494	Expose AM resource limit and usage in QueueMetrics	Major	.	Jian He	Rohith Sharma K S
YARN-3503	Expose disk utilization percentage and bad local and log dir counts on NM via JMX	Major	nodemanager	Varun Vasudev	Varun Vasudev
YARN-3410	YARN admin should be able to remove individual application records from RMStateStore	Critical	resourcemanager, yarn	Wangda Tan	Rohith Sharma K S
HDFS-8215	Refactor NamenodeFsck#check method	Minor	namenode	Takanobu Asanuma	Takanobu Asanuma
YARN-3511	Add errors and warnings page to ATS	Major	timelineserver	Varun Vasudev	Varun Vasudev
HDFS-8176	Record from/to snapshots in audit log for snapshot diff report	Minor	snapshots	J.Andreina	J.Andreina
YARN-3406	Display count of running containers in the RM’s Web UI	Minor	.	Ryu Kobayashi	Ryu Kobayashi
HADOOP-11357	Print information of the build enviornment in test-patch.sh	Minor	scripts	Haohui Mai	Allen Wittenauer
HDFS-8204	Mover/Balancer should not schedule two replicas to the same DN	Minor	balancer & mover	Walter Su	Walter Su
HDFS-8280	Code Cleanup in DFSInputStream	Minor	.	Jing Zhao	Jing Zhao
HDFS-8283	DataStreamer cleanup and some minor improvement	Minor	hdfs-client	Tsz Wo Nicholas Sze	Tsz Wo Nicholas Sze
HDFS-5574	Remove buffer copy in BlockReader.skip	Trivial	.	Binglin Chang	Binglin Chang
HDFS-7770	Need document for storage type label of data node storage locations under dfs.datanode.data.dir	Major	documentation	Xiaoyu Yao	Xiaoyu Yao
HDFS-8200	Refactor FSDirStatAndListingOp	Major	.	Haohui Mai	Haohui Mai
YARN-3363	add localization and container launch time to ContainerMetrics at NM to show these timing information for each active container.	Major	nodemanager	zhihai xu	zhihai xu
HDFS-7397	Add more detail to the documentation for the conf key “dfs.client.read.shortcircuit.streams.cache.size”	Minor	hdfs-client	Tsz Wo Nicholas Sze	Brahma Reddy Battula
YARN-2980	Move health check script related functionality to hadoop-common	Blocker	.	Ming Ma	Varun Saxena
HADOOP-11911	test-patch should allow configuration of default branch	Minor	.	Sean Busbey	Sean Busbey
HDFS-7758	Retire FsDatasetSpi#getVolumes() and use FsDatasetSpi#getVolumeRefs() instead	Major	datanode	Lei (Eddy) Xu	Lei (Eddy) Xu
HADOOP-11925	backport trunk’s smart-apply-patch.sh to branch-2	Major	scripts	Allen Wittenauer	Allen Wittenauer
MAPREDUCE-6192	Create unit test to automatically compare MR related classes and mapred-default.xml	Minor	.	Ray Chiang	Ray Chiang
HADOOP-11813	releasedocmaker.py should use today’s date instead of unreleased	Minor	build	Allen Wittenauer	Darrell Taylor
YARN-3491	PublicLocalizer#addResource is too slow.	Critical	nodemanager	zhihai xu	zhihai xu
MAPREDUCE-6279	AM should explicity exit JVM after all services have stopped	Major	.	Jason Lowe	Eric Payne
HDFS-8108	Fsck should provide the info on mandatory option to be used along with “-blocks , -locations and -racks”	Trivial	documentation	J.Andreina	J.Andreina
HDFS-8207	Improper log message when blockreport interval compared with initial delay	Minor	.	Brahma Reddy Battula	Brahma Reddy Battula
MAPREDUCE-6079	Rename JobImpl#username to reporterUserName	Major	.	Tsuyoshi Ozawa	Tsuyoshi Ozawa
HDFS-8209	Support different number of datanode directories in MiniDFSCluster.	Minor	test	Surendra Singh Lilhore	Surendra Singh Lilhore
YARN-3169	Drop YARN’s overview document	Major	documentation	Allen Wittenauer	Brahma Reddy Battula
YARN-2784	Make POM project names consistent	Minor	build	Rohith Sharma K S	Rohith Sharma K S
MAPREDUCE-5981	Log levels of certain MR logs can be changed to DEBUG	Major	.	Varun Saxena	Varun Saxena
HADOOP-6842	“hadoop fs -text” does not give a useful text representation of MapWritable objects	Major	io	Steven K. Wong	Akira Ajisaka
YARN-20	More information for “yarn.resourcemanager.webapp.address” in yarn-default.xml	Trivial	documentation, resourcemanager	Nemon Lou	Bartosz Ługowski
HDFS-5640	Add snapshot methods to FileContext.	Major	hdfs-client, snapshots	Chris Nauroth	Rakesh R
HDFS-8284	Update documentation about how to use HTrace with HDFS	Major	documentation	Masatake Iwasaki	Masatake Iwasaki
HDFS-7433	Optimize performance of DatanodeManager’s node map	Critical	namenode	Daryn Sharp	Daryn Sharp
MAPREDUCE-5248	Let NNBenchWithoutMR specify the replication factor for its test	Minor	client, test	Erik Paulson	Erik Paulson
HADOOP-9737	JarFinder#getJar should delete the jar file upon destruction of the JVM	Major	util	Esteban Gutierrez	Jean-Baptiste Onofré
YARN-1050	Document the Fair Scheduler REST API	Major	documentation, fairscheduler	Sandy Ryza	Kenji Kikushima
YARN-3271	FairScheduler: Move tests related to max-runnable-apps from TestFairScheduler to TestAppRunnability	Major	.	Karthik Kambatla	nijel
YARN-2206	Update document for applications REST API response examples	Minor	documentation	Kenji Kikushima	Brahma Reddy Battula
HDFS-6757	Simplify lease manager with INodeID	Major	.	Haohui Mai	Haohui Mai
HDFS-8327	Simplify quota calculations for snapshots and truncate	Major	.	Haohui Mai	Haohui Mai
YARN-1287	Consolidate MockClocks	Major	.	Sandy Ryza	Sebastian Wong
HDFS-8357	Consolidate parameters of INode.CleanSubtree() into a parameter objects.	Major	.	Haohui Mai	Li Lu
HADOOP-11950	Add cli option to test-patch to set the project-under-test	Minor	.	Sean Busbey	Sean Busbey
HADOOP-11948	test-patch’s issue matching regex should be configurable.	Major	.	Sean Busbey	Sean Busbey
MAPREDUCE-5465	Tasks are often killed before they exit on their own	Major	mr-am, mrv2	Radim Kolar	Ming Ma
YARN-3513	Remove unused variables in ContainersMonitorImpl and add debug log for overall resource usage by all containers	Trivial	nodemanager	Naganarasimha G R	Naganarasimha G R
HDFS-8255	Rename getBlockReplication to getPreferredBlockReplication	Major	.	Zhe Zhang	Zhe Zhang
YARN-3613	TestContainerManagerSecurity should init and start Yarn cluster in setup instead of individual methods	Minor	test	Karthik Kambatla	nijel
HDFS-6184	Capture NN’s thread dump when it fails over	Major	namenode	Ming Ma	Ming Ma
YARN-3539	Compatibility doc to state that ATS v1 is a stable REST API	Major	documentation	Steve Loughran	Steve Loughran
HADOOP-9723	Improve error message when hadoop archive output path already exists	Trivial	.	Stephen Chu	Yongjun Zhang
HADOOP-11713	ViewFileSystem should support snapshot methods.	Major	fs	Chris Nauroth	Rakesh R
HDFS-8350	Remove old webhdfs.xml and other outdated documentation stuff	Major	documentation	Akira Ajisaka	Brahma Reddy Battula
HADOOP-11960	Enable Azure-Storage Client Side logging.	Major	tools	Dushyanth	Dushyanth
HDFS-6888	Allow selectively audit logging ops	Major	.	Kihwal Lee	Chen He
HDFS-8397	Refactor the error handling code in DataStreamer	Minor	hdfs-client	Tsz Wo Nicholas Sze	Tsz Wo Nicholas Sze
HDFS-8394	Move getAdditionalBlock() and related functionalities into a separate class	Major	.	Haohui Mai	Haohui Mai
HADOOP-11939	Deprecate DistCpV1 and Logalyzer	Major	.	Brahma Reddy Battula	Brahma Reddy Battula
HDFS-4185	Add a metric for number of active leases	Major	namenode	Kihwal Lee	Rakesh R
HADOOP-1540	Support file exclusion list in distcp	Minor	util	Senthil Subramanian	Steven Rand
HADOOP-11103	Clean up RemoteException	Trivial	ipc	Sean Busbey	Sean Busbey
HDFS-8131	Implement a space balanced block placement policy	Minor	namenode	Liu Shaohui	Liu Shaohui
HADOOP-11970	Replace uses of ThreadLocal<Random> with JDK7 ThreadLocalRandom	Major	.	Sean Busbey	Sean Busbey
HADOOP-11995	Make jetty version configurable from the maven command line	Trivial	build, ld	sriharsha devineni	sriharsha devineni
HDFS-4383	Document the lease limits	Minor	.	Eli Collins	Mohammad Arshad
HADOOP-10366	Add whitespaces between the classes for values in core-default.xml to fit better in browser	Minor	documentation	Chengwei Yang	Kanaka Kumar Avvaru
HADOOP-11594	Improve the readability of site index of documentation	Minor	documentation	Masatake Iwasaki	Masatake Iwasaki
YARN-160	nodemanagers should obtain cpu/memory values from underlying OS	Major	nodemanager	Alejandro Abdelnur	Varun Vasudev
HADOOP-11242	Record the time of calling in tracing span of IPC server	Minor	ipc	Masatake Iwasaki	Masatake Iwasaki
YARN-3722	Merge multiple TestWebAppUtils into o.a.h.yarn.webapp.util.TestWebAppUtils	Minor	test	Masatake Iwasaki	Masatake Iwasaki
HADOOP-11894	Bump the version of Apache HTrace to 3.2.0-incubating	Major	.	Masatake Iwasaki	Masatake Iwasaki
YARN-3489	RMServerUtils.validateResourceRequests should only obtain queue info once	Major	resourcemanager	Jason Lowe	Varun Saxena
HDFS-8443	Document dfs.namenode.service.handler.count in hdfs-site.xml	Major	documentation	Akira Ajisaka	J.Andreina
YARN-3547	FairScheduler: Apps that have no resource demand should not participate scheduling	Major	fairscheduler	Xianyin Xin	Xianyin Xin
YARN-3713	Remove duplicate function call storeContainerDiagnostics in ContainerDiagnosticsUpdateTransition	Minor	nodemanager	zhihai xu	zhihai xu
HADOOP-12043	Display warning if defaultFs is not set when running fs commands.	Minor	fs	Lei (Eddy) Xu	Lei (Eddy) Xu
YARN-3467	Expose allocatedMB, allocatedVCores, and runningContainers metrics on running Applications in RM Web UI	Minor	webapp, yarn	Anthony Rojas	Anubhav Dhoot
HDFS-8490	Typo in trace enabled log in ExceptionHandler of WebHDFS	Trivial	webhdfs	Jakob Homan	Archana T
HDFS-8521	Add @VisibleForTesting annotation to {{BlockPoolSlice#selectReplicaToDelete}}	Trivial	.	Colin P. McCabe	Colin P. McCabe
MAPREDUCE-6174	Combine common stream code into parent class for InMemoryMapOutput and OnDiskMapOutput.	Major	mrv2	Eric Payne	Eric Payne
HDFS-8532	Make the visibility of DFSOutputStream#streamer member variable to private	Trivial	.	Rakesh R	Rakesh R
HDFS-8535	Clarify that dfs usage in dfsadmin -report output includes all block replicas.	Minor	documentation	Lei (Eddy) Xu	Lei (Eddy) Xu
MAPREDUCE-6383	Pi job (QuasiMonteCarlo) should not try to read the results file if its job fails	Major	examples	Harsh J	Harsh J
YARN-3259	FairScheduler: Trigger fairShare updates on node events	Major	fairscheduler	Anubhav Dhoot	Anubhav Dhoot
HADOOP-12059	S3Credentials should support use of CredentialProvider	Major	fs/s3	Sean Busbey	Sean Busbey
MAPREDUCE-6354	ShuffleHandler should be able to log shuffle connections	Major	.	Chang Li	Chang Li
HADOOP-12055	Deprecate usage of NativeIO#link	Major	native	Andrew Wang	Andrew Wang
HDFS-8432	Introduce a minimum compatible layout version to allow downgrade in more rolling upgrade use cases.	Major	namenode, rolling upgrades	Chris Nauroth	Chris Nauroth
HDFS-8116	Cleanup uncessary if LOG.isDebugEnabled() from RollingWindowManager	Trivial	namenode	Xiaoyu Yao	Brahma Reddy Battula
YARN-2716	Refactor ZKRMStateStore retry code with Apache Curator	Major	.	Jian He	Karthik Kambatla
HDFS-8553	Document hdfs class path options	Major	documentation	Xiaoyu Yao	Brahma Reddy Battula
YARN-3786	Document yarn class path options	Major	documentation	Brahma Reddy Battula	Brahma Reddy Battula
MAPREDUCE-6392	Document mapred class path options	Major	documentation	Brahma Reddy Battula	Brahma Reddy Battula
HDFS-8549	Abort the balancer if an upgrade is in progress	Major	balancer & mover	Andrew Wang	Andrew Wang
HDFS-8573	Move creation of restartMeta file logic from BlockReceiver to ReplicaInPipeline	Major	datanode	Lei (Eddy) Xu	Lei (Eddy) Xu
HADOOP-11971	Move test utilities for tracing from hadoop-hdfs to hadoop-common	Minor	tracing	Masatake Iwasaki	Masatake Iwasaki
HDFS-8361	Choose SSD over DISK in block placement	Major	namenode	Tsz Wo Nicholas Sze	Tsz Wo Nicholas Sze
YARN-3789	Improve logs for LeafQueue#activateApplications()	Minor	resourcemanager	Bibin A Chundatt	Bibin A Chundatt
HDFS-8606	Cleanup DFSOutputStream by removing unwanted changes	Minor	hdfs-client	Rakesh R	Rakesh R
YARN-3148	Allow CORS related headers to passthrough in WebAppProxyServlet	Major	.	Prakash Ramachandran	Varun Saxena
HDFS-8589	Fix unused imports in BPServiceActor and BlockReportLeaseManager	Trivial	.	Colin P. McCabe	Colin P. McCabe
HADOOP-7139	Allow appending to existing SequenceFiles	Major	io	Stephen Rose	Kanaka Kumar Avvaru
HDFS-8605	Merge Refactor of DFSOutputStream from HDFS-7285 branch	Major	.	Vinayakumar B	Vinayakumar B
MAPREDUCE-6395	Improve the commit failure messages in MRAppMaster recovery	Major	applicationmaster	Gera Shegalov	Brahma Reddy Battula
HDFS-8582	Support getting a list of reconfigurable config properties and do not generate spurious reconfig warnings	Minor	datanode, hdfs-client	Lei (Eddy) Xu	Lei (Eddy) Xu
MAPREDUCE-6316	Task Attempt List entries should link to the task overview	Major	.	Siqi Li	Siqi Li
MAPREDUCE-6305	AM/Task log page should be able to link back to the job	Major	.	Siqi Li	Siqi Li
YARN-3834	Scrub debug logging of tokens during resource localization.	Major	nodemanager	Chris Nauroth	Chris Nauroth
MAPREDUCE-6408	Queue name and user name should be printed on the job page	Major	applicationmaster	Siqi Li	Siqi Li
HDFS-8639	Option for HTTP port of NameNode by MiniDFSClusterManager	Minor	test	Kai Sasaki	Kai Sasaki
YARN-3360	Add JMX metrics to TimelineDataManager	Major	timelineserver	Jason Lowe	Jason Lowe
HADOOP-12049	Control http authentication cookie persistence via configuration	Major	security	Benoy Antony	H Lu
HDFS-8462	Implement GETXATTRS and LISTXATTRS operations for WebImageViewer	Major	.	Akira Ajisaka	Jagadesh Kiran N
HDFS-8640	Make reserved RBW space visible through JMX	Major	.	Kanaka Kumar Avvaru	Kanaka Kumar Avvaru
HDFS-8546	Use try with resources in DataStorage and Storage	Minor	datanode	Andrew Wang	Andrew Wang
HADOOP-11807	add a lint mode to releasedocmaker	Minor	build, documentation, yetus	Allen Wittenauer	ramtin
HDFS-8653	Code cleanup for DatanodeManager, DatanodeDescriptor and DatanodeStorageInfo	Major	.	Zhe Zhang	Zhe Zhang
HDFS-8659	Block scanner INFO message is spamming logs	Major	datanode	Yongjun Zhang	Yongjun Zhang
MAPREDUCE-6384	Add the last reporting reducer info for too many fetch failure diagnostics	Major	.	Chang Li	Chang Li
HADOOP-12158	Improve error message in TestCryptoStreamsWithOpensslAesCtrCryptoCodec when OpenSSL is not installed	Trivial	test	Andrew Wang	Andrew Wang
HADOOP-12172	FsShell mkdir -p makes an unnecessary check for the existence of the parent.	Minor	fs	Chris Nauroth	Chris Nauroth
HDFS-8703	Merge refactor of DFSInputStream from ErasureCoding branch	Major	.	Vinayakumar B	Vinayakumar B
HDFS-8709	Clarify automatic sync in FSEditLog#logEdit	Minor	.	Andrew Wang	Andrew Wang
HADOOP-12045	Enable LocalFileSystem#setTimes to change atime	Minor	fs	Kazuho Fujii	Kazuho Fujii
HADOOP-12185	NetworkTopology is not efficient adding/getting/removing nodes	Major	.	Íñigo Goiri	Íñigo Goiri
HADOOP-12135	cleanup releasedocmaker	Major	yetus	Allen Wittenauer	Allen Wittenauer
HADOOP-12195	Add annotation to package-info.java file to workaround MCOMPILER-205	Trivial	.	Andrew Wang	Andrew Wang
HADOOP-12193	Rename Touchz.java to Touch.java	Trivial	.	Andrew Wang	Andrew Wang
HDFS-8711	setSpaceQuota command should print the available storage type when input storage type is wrong	Major	hdfs-client	Surendra Singh Lilhore	Surendra Singh Lilhore
HDFS-8712	Remove “public” and “abstract” modifiers in FsVolumeSpi and FsDatasetSpi	Trivial	.	Lei (Eddy) Xu	Lei (Eddy) Xu
HADOOP-12194	Support for incremental generation in the protoc plugin	Major	.	Andrew Wang	Andrew Wang
HADOOP-12180	Move ResourceCalculatorPlugin from YARN to Common	Major	util	Chris Douglas	Chris Douglas
HADOOP-12210	Collect network usage on the node	Major	.	Robert Grandl	Robert Grandl
YARN-3069	Document missing properties in yarn-default.xml	Major	documentation	Ray Chiang	Ray Chiang
YARN-3381	Fix typo InvalidStateTransitonException	Minor	api	Xiaoshuang LU	Brahma Reddy Battula
HADOOP-12211	Collect disks usages on the node	Major	.	Robert Grandl	Robert Grandl
HDFS-8722	Optimize datanode writes for small writes and flushes	Critical	.	Kihwal Lee	Kihwal Lee
HADOOP-12232	Upgrade Tomcat dependency to 6.0.44.	Major	build	Chris Nauroth	Chris Nauroth
YARN-3170	YARN architecture document needs updating	Major	documentation	Allen Wittenauer	Brahma Reddy Battula
MAPREDUCE-5762	Port MAPREDUCE-3223 and MAPREDUCE-4695 (Remove MRv1 config from mapred-default.xml) to branch-2	Minor	documentation	Akira Ajisaka	Akira Ajisaka
YARN-3174	Consolidate the NodeManager and NodeManagerRestart documentation into one	Major	documentation	Allen Wittenauer	Masatake Iwasaki
HDFS-7314	When the DFSClient lease cannot be renewed, abort open-for-write files rather than the entire DFSClient	Major	.	Ming Ma	Ming Ma
HADOOP-11893	Mark org.apache.hadoop.security.token.Token as @InterfaceAudience.Public	Major	security	Steve Loughran	Brahma Reddy Battula
HADOOP-12081	Fix UserGroupInformation.java to support 64-bit zLinux	Major	security	Adam Roberts	Akira Ajisaka
HADOOP-12214	Parse ‘HadoopArchive’ commandline using cli Options.	Minor	.	Vinayakumar B	Vinayakumar B
YARN-2921	Fix MockRM/MockAM#waitForState sleep too long	Major	test	Karthik Kambatla	Tsuyoshi Ozawa
HADOOP-12161	Add getStoragePolicy API to the FileSystem interface	Major	fs	Arpit Agarwal	Brahma Reddy Battula
HADOOP-12189	Improve CallQueueManager#swapQueue to make queue elements drop nearly impossible.	Major	ipc, test	zhihai xu	zhihai xu
HADOOP-12009	Clarify FileSystem.listStatus() sorting order & fix FileSystemContractBaseTest:testListStatus	Minor	documentation, fs, test	Jakob Homan	J.Andreina
HADOOP-12259	Utility to Dynamic port allocation	Major	test, util	Brahma Reddy Battula	Brahma Reddy Battula
HDFS-8735	Inotify : All events classes should implement toString() API.	Major	hdfs-client	Surendra Singh Lilhore	Surendra Singh Lilhore
HDFS-7858	Improve HA Namenode Failover detection on the client	Major	hdfs-client	Arun Suresh	Arun Suresh
HDFS-8180	AbstractFileSystem Implementation for WebHdfs	Major	webhdfs	Santhosh G Nayak	Santhosh G Nayak
HDFS-8811	Move BlockStoragePolicy name’s constants from HdfsServerConstants.java to HdfsConstants.java	Major	.	Vinayakumar B	Vinayakumar B
HDFS-8822	Add SSD storagepolicy tests in TestBlockStoragePolicy#testDefaultPolicies	Major	.	Vinayakumar B	Vinayakumar B
YARN-3950	Add unique YARN_SHELL_ID environment variable to DistributedShell	Major	applications/distributed-shell	Robert Kanter	Robert Kanter
YARN-2768	Avoid cloning Resource in FSAppAttempt#updateDemand	Minor	fairscheduler	Hong Zhiguo	Hong Zhiguo
HDFS-8816	Improve visualization for the Datanode tab in the NN UI	Major	.	Haohui Mai	Haohui Mai
HDFS-8821	Explain message “Operation category X is not supported in state standby”	Minor	.	Gautam Gopalakrishnan	Gautam Gopalakrishnan
HADOOP-12271	Hadoop Jar Error Should Be More Explanatory	Minor	.	Jesse Anderson	Josh Elser
HADOOP-12183	Annotate the HTrace span created by FsShell with the command-line arguments passed by the user	Minor	tracing	Masatake Iwasaki	Masatake Iwasaki
YARN-3978	Configurably turn off the saving of container info in Generic AHS	Major	timelineserver, yarn	Eric Payne	Eric Payne
YARN-3965	Add startup timestamp to nodemanager UI	Minor	nodemanager	Hong Zhiguo	Hong Zhiguo
HADOOP-12280	Skip unit tests based on maven profile rather than NativeCodeLoader.isNativeCodeLoaded	Minor	test	Masatake Iwasaki	Masatake Iwasaki
HDFS-8815	DFS getStoragePolicy implementation using single RPC call	Major	hdfs-client	Arpit Agarwal	Surendra Singh Lilhore
YARN-3961	Expose pending, running and reserved containers of a queue in REST api and yarn top	Major	capacityscheduler, fairscheduler, webapp	Anubhav Dhoot	Anubhav Dhoot
YARN-4019	Add JvmPauseMonitor to ResourceManager and NodeManager	Major	nodemanager, resourcemanager	Robert Kanter	Robert Kanter
MAPREDUCE-6443	Add JvmPauseMonitor to Job History Server	Major	jobhistoryserver	Robert Kanter	Robert Kanter
HDFS-8887	Expose storage type and storage ID in BlockLocation	Major	.	Andrew Wang	Andrew Wang
HADOOP-12318	Expose underlying LDAP exceptions in SaslPlainServer	Minor	security	Mike Yoder	Mike Yoder
HADOOP-12295	Improve NetworkTopology#InnerNode#remove logic	Major	.	Yi Liu	Yi Liu
HDFS-7649	Multihoming docs should emphasize using hostnames in configurations	Major	documentation	Arpit Agarwal	Brahma Reddy Battula
YARN-4055	Report node resource utilization in heartbeat	Major	nodemanager	Íñigo Goiri	Íñigo Goiri
HDFS-8713	Convert DatanodeDescriptor to use SLF4J logging	Trivial	.	Andrew Wang	Andrew Wang
HDFS-8883	NameNode Metrics : Add FSNameSystem lock Queue Length	Major	namenode	Anu Engineer	Anu Engineer
HDFS-6407	Add sorting and pagination in the datanode tab of the NN Web UI	Critical	namenode	Nathan Roberts	Haohui Mai
HDFS-8880	NameNode metrics logging	Major	namenode	Arpit Agarwal	Arpit Agarwal
YARN-4057	If ContainersMonitor is not enabled, only print related log info one time	Minor	nodemanager	Jun Gong	Jun Gong
HADOOP-12050	Enable MaxInactiveInterval for hadoop http auth token	Major	security	Benoy Antony	H Lu
HDFS-8435	Support CreateFlag in WebHdfs	Major	webhdfs	Vinoth Sathappan	Jakob Homan
HDFS-8911	NameNode Metric : Add Editlog counters as a JMX metric	Major	namenode	Anu Engineer	Anu Engineer
HDFS-8917	Cleanup BlockInfoUnderConstruction from comments and tests	Minor	namenode	Zhe Zhang	Zhe Zhang
HDFS-8884	Fail-fast check in BlockPlacementPolicyDefault#chooseTarget	Major	.	Yi Liu	Yi Liu
HDFS-8828	Utilize Snapshot diff report to build diff copy list in distcp	Major	distcp, snapshots	Yufei Gu	Yufei Gu
HDFS-8924	Add pluggable interface for reading replicas in DFSClient	Major	hdfs-client	Colin P. McCabe	Colin P. McCabe
HDFS-8928	Improvements for BlockUnderConstructionFeature: ReplicaUnderConstruction as a separate class and replicas as an array	Minor	namenode	Zhe Zhang	Jing Zhao
HDFS-2390	dfsadmin -setBalancerBandwidth doesnot validate -ve value	Minor	balancer & mover	Rajit Saha	Gautam Gopalakrishnan
HDFS-8983	NameNode support for protected directories	Major	namenode	Arpit Agarwal	Arpit Agarwal
HDFS-8946	Improve choosing datanode storage for block placement	Major	namenode	Yi Liu	Yi Liu
HDFS-8965	Harden edit log reading code against out of memory errors	Major	.	Colin P. McCabe	Colin P. McCabe
HADOOP-12368	Mark ViewFileSystemBaseTest and ViewFsBaseTest as abstract	Trivial	.	Andrew Wang	Andrew Wang
HADOOP-12367	Move TestFileUtil’s test resources to resources folder	Minor	.	Andrew Wang	Andrew Wang
HADOOP-12369	Point hadoop-project/pom.xml java.security.krb5.conf within target folder	Minor	.	Andrew Wang	Andrew Wang
HDFS-328	Improve fs -setrep error message for invalid replication factors	Major	namenode	Tsz Wo Nicholas Sze	Daniel Templeton
HADOOP-5323	Trash documentation should describe its directory structure and configurations	Minor	documentation	Suman Sehgal	Weiwei Yang
HDFS-9021	Use a yellow elephant rather than a blue one in diagram	Minor	.	Andrew Wang	Andrew Wang
HADOOP-12358	Add -safely flag to rm to prompt when deleting many files	Major	fs	Xiaoyu Yao	Xiaoyu Yao
YARN-4024	YARN RM should avoid unnecessary resolving IP when NMs doing heartbeat	Major	resourcemanager	Wangda Tan	Hong Zhiguo
HADOOP-12384	Add “-direct” flag option for fs copy so that user can choose not to create “._COPYING_” file	Major	fs	Chen He	J.Andreina
HDFS-9019	Adding informative message to sticky bit permission denied exception	Minor	security	Thejas M Nair	Xiaoyu Yao
HDFS-8384	Allow NN to startup if there are files having a lease but are not under construction	Minor	namenode	Tsz Wo Nicholas Sze	Jing Zhao
HDFS-8929	Add a metric to expose the timestamp of the last journal	Major	journal-node	Akira Ajisaka	Surendra Singh Lilhore
HDFS-7116	Add a command to get the balancer bandwidth	Major	balancer & mover	Akira Ajisaka	Rakesh R
YARN-4086	Allow Aggregated Log readers to handle HAR files	Major	.	Robert Kanter	Robert Kanter
HDFS-8974	Convert docs in xdoc format to markdown	Minor	documentation	Masatake Iwasaki	Masatake Iwasaki
YARN-4145	Make RMHATestBase abstract so its not run when running all tests under that namespace	Minor	.	Anubhav Dhoot	Anubhav Dhoot
HADOOP-12324	Better exception reporting in SaslPlainServer	Minor	security	Mike Yoder	Mike Yoder
YARN-2005	Blacklisting support for scheduling AMs	Major	resourcemanager	Jason Lowe	Anubhav Dhoot
HDFS-8829	Make SO_RCVBUF and SO_SNDBUF size configurable for DataTransferProtocol sockets and allow configuring auto-tuning	Major	datanode	He Tianyi	He Tianyi
HDFS-9065	Include commas on # of files, blocks, total filesystem objects in NN Web UI	Minor	namenode	Daniel Templeton	Daniel Templeton
HADOOP-12413	AccessControlList should avoid calling getGroupNames in isUserInList with empty groups.	Major	security	zhihai xu	zhihai xu
HDFS-8953	DataNode Metrics logging	Major	.	Kanaka Kumar Avvaru	Kanaka Kumar Avvaru
YARN-4158	Remove duplicate close for LogWriter in AppLogAggregatorImpl#uploadLogsForContainers	Minor	nodemanager	zhihai xu	zhihai xu
YARN-4149	yarn logs -am should provide an option to fetch all the log files	Major	client, nodemanager	Varun Vasudev	Varun Vasudev
HDFS-9082	Change the log level in WebHdfsFileSystem.initialize() from INFO to DEBUG	Minor	webhdfs	Santhosh G Nayak	Santhosh G Nayak
YARN-4135	Improve the assertion message in MockRM while failing after waiting for the state.	Trivial	.	nijel	nijel
MAPREDUCE-6478	Add an option to skip cleanupJob stage or ignore cleanup failure during commitJob().	Major	.	Junping Du	Junping Du
HADOOP-12404	Disable caching for JarURLConnection to avoid sharing JarFile with other users when loading resource from URL in Configuration class.	Minor	conf	zhihai xu	zhihai xu
HADOOP-12428	Fix inconsistency between log-level guards and statements	Minor	.	Jackie Chang	Jagadesh Kiran N
YARN-4095	Avoid sharing AllocatorPerContext object in LocalDirAllocator between ShuffleHandler and LocalDirsHandlerService.	Major	nodemanager	zhihai xu	zhihai xu
HDFS-5795	RemoteBlockReader2#checkSuccess() shoud print error status	Trivial	.	Brandon Li	Xiao Chen
HDFS-9112	Improve error message for Haadmin when multiple name service IDs are configured	Major	tools	Anu Engineer	Anu Engineer
HDFS-9132	Pass genstamp to ReplicaAccessorBuilder	Major	hdfs-client	Colin P. McCabe	Colin P. McCabe
HADOOP-12442	Display help if the command option to "hdfs dfs " is not valid	Minor	.	nijel	nijel
HADOOP-11984	Enable parallel JUnit tests in pre-commit.	Major	build, scripts, test	Chris Nauroth	Chris Nauroth
MAPREDUCE-6471	Document distcp incremental copy	Major	distcp	Arpit Agarwal	Neelesh Srinivas Salian
HDFS-9148	Incorrect assert message in TestWriteToReplica#testWriteToTemporary	Trivial	test	Tony Wu	Tony Wu
HDFS-8859	Improve DataNode ReplicaMap memory footprint to save about 45%	Major	datanode	Yi Liu	Yi Liu
HDFS-8696	Make the lower and higher watermark in the DN Netty server configurable	Major	webhdfs	Xiaobing Zhou	Xiaobing Zhou
YARN-3727	For better error recovery, check if the directory exists before using it for localization.	Major	nodemanager	zhihai xu	zhihai xu
HDFS-9175	Change scope of ‘AccessTokenProvider.getAccessToken()’ and ‘CredentialBasedAccessTokenProvider.getCredential()’ abstract methods to public	Major	webhdfs	Santhosh G Nayak	Santhosh G Nayak
HADOOP-12458	Retries is typoed to spell Retires in parts of hadoop-yarn and hadoop-common	Minor	documentation	Neelesh Srinivas Salian	Neelesh Srinivas Salian
HDFS-9151	Mover should print the exit status/reason on console like balancer tool.	Minor	balancer & mover	Archana T	Surendra Singh Lilhore
HADOOP-12350	WASB Logging: Improve WASB Logging around deletes, reads and writes	Major	tools	Dushyanth	Dushyanth
HADOOP-12284	UserGroupInformation doAs can throw misleading exception	Trivial	security	Aaron Dossett	Aaron Dossett
YARN-4228	FileSystemRMStateStore use IOUtils#close instead of fs#close	Minor	.	Bibin A Chundatt	Bibin A Chundatt
YARN-3943	Use separate threshold configurations for disk-full detection and disk-not-full detection.	Critical	nodemanager	zhihai xu	zhihai xu
MAPREDUCE-6479	Add missing mapred job command options in mapreduce document	Major	documentation	nijel	nijel
HADOOP-11104	org.apache.hadoop.metrics2.lib.MetricsRegistry needs numerical parameter checking	Minor	.	Ray Chiang	Ray Chiang
HDFS-9181	Better handling of exceptions thrown during upgrade shutdown	Minor	.	Wei-Chiu Chuang	Wei-Chiu Chuang
HDFS-9110	Use Files.walkFileTree in NNUpgradeUtil#doPreUpgrade for better efficiency	Minor	.	Charlie Helin	Charlie Helin
HDFS-9221	HdfsServerConstants#ReplicaState#getState should avoid calling values() since it creates a temporary array	Major	performance	Staffan Friberg	Staffan Friberg
HDFS-8988	Use LightWeightHashSet instead of LightWeightLinkedSet in BlockManager#excessReplicateMap	Major	.	Yi Liu	Yi Liu
HDFS-9139	Enable parallel JUnit tests for HDFS Pre-commit	Major	test	Vinayakumar B	Vinayakumar B
HDFS-9145	Tracking methods that hold FSNamesytemLock for too long	Major	namenode	Jing Zhao	Mingliang Liu
HADOOP-10775	Shell operations to fail with meaningful errors on windows if winutils.exe not found	Minor	util	Steve Loughran	Steve Loughran
YARN-4253	Standardize on using PrivilegedOperationExecutor for all invocations of container-executor in LinuxContainerExecutor	Major	.	Sidharta Seethana	Sidharta Seethana
YARN-4252	Log container-executor invocation details when exit code is non-zero	Minor	nodemanager	Sidharta Seethana	Sidharta Seethana
HDFS-9238	Update TestFileCreation#testLeaseExpireHardLimit() to avoid using DataNodeTestUtils#getFile()	Trivial	test	Tony Wu	Tony Wu
HDFS-9188	Make block corruption related tests FsDataset-agnostic.	Major	test	Lei (Eddy) Xu	Lei (Eddy) Xu
HDFS-9205	Do not schedule corrupt blocks for replication	Minor	namenode	Tsz Wo Nicholas Sze	Tsz Wo Nicholas Sze
HADOOP-12481	JWTRedirectAuthenticationHandler doesn’t Retain Original Query String	Major	security	Larry McCay	Larry McCay
HDFS-9257	improve error message for “Absolute path required” in INode.java to contain the rejected path	Trivial	namenode	Marcell Szabo	Marcell Szabo
HDFS-9253	Refactor tests of libhdfs into a directory	Major	.	Haohui Mai	Haohui Mai
HADOOP-12450	UserGroupInformation should not log at WARN level if no groups are found	Minor	security	Elliott Clark	Elliott Clark
HADOOP-12460	Add overwrite option for ‘get’ shell command	Major	.	Keegan Witt	Jagadesh Kiran N
HDFS-9250	Add Precondition check to LocatedBlock#addCachedLoc	Major	namenode	Xiao Chen	Xiao Chen
HDFS-9251	Refactor TestWriteToReplica and TestFsDatasetImpl to avoid explicitly creating Files in tests code.	Major	test	Lei (Eddy) Xu	Lei (Eddy) Xu
MAPREDUCE-6489	Fail fast rogue tasks that write too much to local disk	Major	task	Maysam Yabandeh	Maysam Yabandeh
HDFS-8647	Abstract BlockManager’s rack policy into BlockPlacementPolicy	Major	.	Ming Ma	Brahma Reddy Battula
HDFS-7087	Ability to list /.reserved	Major	.	Andrew Wang	Xiao Chen
HDFS-9280	Document NFS gateway export point parameter	Trivial	documentation	Zhe Zhang	Xiao Chen
HADOOP-12334	Change Mode Of Copy Operation of HBase WAL Archiving to bypass Azure Storage Throttling after retries	Major	tools	Gaurav Kanade	Gaurav Kanade
HADOOP-7266	Deprecate metrics v1	Blocker	metrics	Luke Lu	Akira Ajisaka
YARN-2913	Fair scheduler should have ability to set MaxResourceDefault for each queue	Major	.	Siqi Li	Siqi Li
HDFS-9264	Minor cleanup of operations on FsVolumeList#volumes	Minor	.	Walter Su	Walter Su
HDFS-8808	dfs.image.transfer.bandwidthPerSec should not apply to -bootstrapStandby	Major	.	Gautam Gopalakrishnan	Zhe Zhang
HDFS-9297	Update TestBlockMissingException to use corruptBlockOnDataNodesByDeletingBlockFile()	Trivial	test	Tony Wu	Tony Wu
HDFS-4015	Safemode should count and report orphaned blocks	Major	namenode	Todd Lipcon	Anu Engineer
YARN-3528	Tests with 12345 as hard-coded port break jenkins	Blocker	.	Steve Loughran	Brahma Reddy Battula
YARN-4285	Display resource usage as percentage of queue and cluster in the RM UI	Major	resourcemanager	Varun Vasudev	Varun Vasudev
HDFS-7284	Add more debug info to BlockInfoUnderConstruction#setGenerationStampAndVerifyReplicas	Major	namenode	Hu Liu,	Wei-Chiu Chuang
HADOOP-12472	Make GenericTestUtils.assertExceptionContains robust	Minor	test	Steve Loughran	Steve Loughran
HDFS-9291	Fix TestInterDatanodeProtocol to be FsDataset-agnostic.	Minor	test	Lei (Eddy) Xu	Lei (Eddy) Xu
HDFS-8945	Update the description about replica placement in HDFS Architecture documentation	Minor	documentation	Masatake Iwasaki	Masatake Iwasaki
HDFS-9292	Make TestFileConcorruption independent to underlying FsDataset Implementation.	Minor	.	Lei (Eddy) Xu	Lei (Eddy) Xu
HDFS-9259	Make SO_SNDBUF size configurable at DFSClient side for hdfs write scenario	Major	.	Ming Ma	Mingliang Liu
HDFS-9299	Give ReplicationMonitor a readable thread name	Trivial	namenode	Staffan Friberg	Staffan Friberg
HDFS-9307	fuseConnect should be private to fuse_connect.c	Trivial	fuse-dfs	Colin P. McCabe	Mingliang Liu
HADOOP-12520	Use XInclude in hadoop-azure test configuration to isolate Azure Storage account keys for service integration tests.	Major	fs/azure, test	Chris Nauroth	Chris Nauroth
HDFS-9311	Support optional offload of NameNode HA service health checks to a separate RPC server.	Major	ha, namenode	Chris Nauroth	Chris Nauroth
HDFS-9255	Consolidate block recovery related implementation into a single class	Minor	datanode	Walter Su	Walter Su
YARN-2573	Integrate ReservationSystem with the RM failover mechanism	Major	capacityscheduler, fairscheduler, resourcemanager	Subru Krishnan	Subru Krishnan
HDFS-6200	Create a separate jar for hdfs-client	Major	build	Haohui Mai	Haohui Mai
HDFS-8545	Refactor FS#getUsed() to use ContentSummary and add an API to fetch the total file length from a specific path	Minor	.	J.Andreina	J.Andreina
HDFS-9229	Expose size of NameNode directory as a metric	Minor	namenode	Zhe Zhang	Surendra Singh Lilhore
YARN-4310	FairScheduler: Log skipping reservation messages at DEBUG level	Minor	fairscheduler	Arun Suresh	Arun Suresh
HDFS-9312	Fix TestReplication to be FsDataset-agnostic.	Minor	.	Lei (Eddy) Xu	Lei (Eddy) Xu
HDFS-9308	Add truncateMeta() and deleteMeta() to MiniDFSCluster	Minor	test	Tony Wu	Tony Wu
HDFS-9331	Modify TestNameNodeMXBean#testNameNodeMXBeanInfo() to account for filesystem entirely allocated for DFS use	Trivial	test	Tony Wu	Tony Wu
HDFS-9363	Add fetchReplica() to FsDatasetTestUtils to return FsDataset-agnostic Replica.	Minor	test	Tony Wu	Tony Wu
HDFS-9282	Make data directory count and storage raw capacity related tests FsDataset-agnostic	Minor	test	Tony Wu	Tony Wu
HADOOP-12344	Improve validateSocketPathSecurity0 error message	Trivial	net	Casey Brotherton	Casey Brotherton
HDFS-9398	Make ByteArraryManager log message in one-line format	Minor	hdfs-client	Mingliang Liu	Mingliang Liu
HDFS-9234	WebHdfs : getContentSummary() should give quota for storage types	Major	webhdfs	Surendra Singh Lilhore	Surendra Singh Lilhore
HDFS-9369	Use ctest to run tests for hadoop-hdfs-native-client	Minor	.	Haohui Mai	Haohui Mai
HADOOP-12562	Make hadoop dockerfile usable by Yetus	Major	build	Allen Wittenauer	Allen Wittenauer
YARN-4287	Capacity Scheduler: Rack Locality improvement	Major	capacityscheduler	Nathan Roberts	Nathan Roberts
MAPREDUCE-5485	Allow repeating job commit by extending OutputCommitter API	Critical	.	Nemon Lou	Junping Du
MAPREDUCE-6499	Add elapsed time for retired job in JobHistoryServer WebUI	Major	webapps	Yiqun Lin	Yiqun Lin
HDFS-9252	Change TestFileTruncate to use FsDatasetTestUtils to get block file size and genstamp.	Major	.	Lei (Eddy) Xu	Lei (Eddy) Xu
HADOOP-12568	Update core-default.xml to describe posixGroups support	Minor	documentation	Wei-Chiu Chuang	Wei-Chiu Chuang
YARN-4279	Mark ApplicationId and ApplicationAttemptId static methods as @Public, @Unstable	Minor	client	Steve Loughran	Steve Loughran
HADOOP-12575	Add build instruction for docker toolbox instead of boot2docker	Trivial	documentation	Kai Sasaki	Kai Sasaki
HDFS-8056	Decommissioned dead nodes should continue to be counted as dead after NN restart	Major	.	Ming Ma	Ming Ma
HADOOP-11901	BytesWritable fails to support 2G chunks due to integer overflow	Major	.	Reynold Xin	Reynold Xin
HDFS-9439	Include status of closeAck into exception message in DataNode#run	Trivial	.	Xiao Chen	Xiao Chen
HDFS-9402	Switch DataNode.LOG to use slf4j	Minor	.	Walter Su	Walter Su
HDFS-3302	Review and improve HDFS trash documentation	Major	documentation	Harsh J	Madhu Kiran
HADOOP-10035	Cleanup TestFilterFileSystem	Major	.	Suresh Srinivas	Suresh Srinivas
HADOOP-10555	Add offset support to MurmurHash	Trivial	.	Sergey Shelukhin	Sergey Shelukhin
HADOOP-10068	Improve log4j regex in testFindContainingJar	Trivial	.	Robert Rati	Robert Rati
HDFS-9024	Deprecate the TotalFiles metric	Major	.	Akira Ajisaka	Akira Ajisaka
HDFS-7988	Replace usage of ExactSizeInputStream with LimitInputStream.	Minor	.	Chris Nauroth	Walter Su
HDFS-9314	Improve BlockPlacementPolicyDefault’s picking of excess replicas	Major	.	Ming Ma	Xiao Chen
MAPREDUCE-5870	Support for passing Job priority through Application Submission Context in Mapreduce Side	Major	client	Sunil Govindan	Sunil Govindan
HDFS-9434	Recommission a datanode with 500k blocks may pause NN for 30 seconds	Major	namenode	Tsz Wo Nicholas Sze	Tsz Wo Nicholas Sze
YARN-4132	Separate configs for nodemanager to resourcemanager connection timeout and retries	Major	nodemanager	Chang Li	Chang Li
HDFS-8512	WebHDFS : GETFILESTATUS should return LocatedBlock with storage type info	Major	webhdfs	Sumana Sathish	Xiaoyu Yao
HADOOP-12600	FileContext and AbstractFileSystem should be annotated as a Stable interface.	Blocker	fs	Chris Nauroth	Chris Nauroth
HDFS-9269	Update the documentation and wrapper for fuse-dfs	Minor	fuse-dfs	Wei-Chiu Chuang	Wei-Chiu Chuang
HDFS-9485	Make BlockManager#removeFromExcessReplicateMap accept BlockInfo instead of Block	Minor	namenode	Mingliang Liu	Mingliang Liu
HDFS-9490	MiniDFSCluster should change block generation stamp via FsDatasetTestUtils	Minor	test	Tony Wu	Tony Wu
HDFS-8831	Trash Support for deletion in HDFS encryption zone	Major	encryption	Xiaoyu Yao	Xiaoyu Yao
HDFS-9474	TestPipelinesFailover should not fail when printing debug message	Major	.	Yongjun Zhang	John Zhuge
YARN-3456	Improve handling of incomplete TimelineEntities	Minor	timelineserver	Steve Loughran	Varun Saxena
HDFS-9527	The return type of FSNamesystem.getBlockCollection should be changed to INodeFile	Minor	namenode	Tsz Wo Nicholas Sze	Tsz Wo Nicholas Sze
HDFS-9472	concat() API does not give proper exception messages on ./reserved relative path	Major	namenode	Rakesh R	Rakesh R
HDFS-9532	Detailed exception info is lost in reportTo method of ErrorReportAction and ReportBadBlockAction	Trivial	datanode	Yongjun Zhang	Yongjun Zhang
HDFS-9528	Cleanup namenode audit/log/exception messages	Minor	namenode	Tsz Wo Nicholas Sze	Tsz Wo Nicholas Sze
HDFS-8860	Remove unused Replica copyOnWrite code	Major	.	Lei (Eddy) Xu	Lei (Eddy) Xu
MAPREDUCE-6436	JobHistory cache issue	Blocker	.	Ryu Kobayashi	Kai Sasaki
HADOOP-12639	Imrpove JavaDoc for getTrimmedStrings	Trivial	util	BELUGA BEHR	BELUGA BEHR
HDFS-9557	Reduce object allocation in PB conversion	Major	hdfs-client	Daryn Sharp	Daryn Sharp
YARN-4207	Add a non-judgemental YARN app completion status	Major	.	Sergey Shelukhin	Rich Haase
HDFS-9198	Coalesce IBR processing in the NN	Major	namenode	Daryn Sharp	Daryn Sharp
HDFS-9552	Document types of permission checks performed for HDFS operations.	Major	documentation	Chris Nauroth	Chris Nauroth
HADOOP-12570	HDFS Secure Mode Documentation updates	Major	documentation	Arpit Agarwal	Arpit Agarwal
YARN-4480	Clean up some inappropriate imports	Major	.	Kai Zheng	Kai Zheng
YARN-4290	Add -showDetails option to YARN Nodes CLI to print all nodes reports information	Major	client	Wangda Tan	Sunil Govindan
YARN-4400	AsyncDispatcher.waitForDrained should be final	Trivial	yarn	Daniel Templeton	Daniel Templeton
MAPREDUCE-6584	Remove trailing whitespaces from mapred-default.xml	Major	documentation	Akira Ajisaka	Akira Ajisaka
HADOOP-12686	Update FileSystemShell documentation to mention the meaning of each columns of fs -du	Minor	documentation, fs	Daisuke Kobayashi	Daisuke Kobayashi
YARN-4544	All the log messages about rolling monitoring interval are shown with WARN level	Minor	log-aggregation, nodemanager	Takashi Ohnishi	Takashi Ohnishi
YARN-4438	Implement RM leader election with curator	Major	.	Jian He	Jian He
HDFS-9630	DistCp minor refactoring and clean up	Minor	distcp	Kai Zheng	Kai Zheng
YARN-4582	Label-related invalid resource request exception should be able to properly handled by application	Major	scheduler	Bibin A Chundatt	Bibin A Chundatt
HDFS-9569	Log the name of the fsimage being loaded for better supportability	Trivial	namenode	Yongjun Zhang	Yongjun Zhang
MAPREDUCE-6473	Job submission can take a long time during Cluster initialization	Major	performance	Kuhu Shukla	Kuhu Shukla
HDFS-9415	Document dfs.cluster.administrators and dfs.permissions.superusergroup	Major	documentation	Arpit Agarwal	Xiaobing Zhou
HDFS-6054	MiniQJMHACluster should not use static port to avoid binding failure in unit test	Major	test	Brandon Li	Yongjun Zhang
YARN-4492	Add documentation for preemption supported in Capacity scheduler	Minor	capacity scheduler	Naganarasimha G R	Naganarasimha G R
YARN-4371	“yarn application -kill” should take multiple application ids	Major	.	Tsuyoshi Ozawa	Sunil Govindan
HDFS-9653	Expose the number of blocks pending deletion through dfsadmin report command	Major	hdfs-client, tools	Weiwei Yang	Weiwei Yang
HADOOP-12731	Remove useless boxing/unboxing code	Minor	performance	Kousuke Saruta	Kousuke Saruta
HDFS-9654	Code refactoring for HDFS-8578	Minor	datanode	Tsz Wo Nicholas Sze	Tsz Wo Nicholas Sze
HDFS-9706	Log more details in debug logs in BlockReceiver’s constructor	Minor	.	Xiao Chen	Xiao Chen
HDFS-9638	Improve DistCp Help and documentation	Minor	distcp	Wei-Chiu Chuang	Wei-Chiu Chuang
HDFS-9566	Remove expensive ‘BlocksMap#getStorages(Block b, final DatanodeStorage.State state)’ method	Major	namenode	Daryn Sharp	Daryn Sharp
HDFS-9721	Allow Delimited PB OIV tool to run upon fsimage that contains INodeReference	Major	.	Xiao Chen	Xiao Chen
HDFS-9669	TcpPeerServer should respect ipc.server.listen.queue.size	Major	.	Elliott Clark	Elliott Clark
HDFS-9715	Check storage ID uniqueness on datanode startup	Major	datanode	Lei (Eddy) Xu	Lei (Eddy) Xu
YARN-4662	Document some newly added metrics	Major	.	Jian He	Jian He
HDFS-9629	Update the footer of Web UI to show year 2016	Major	.	Xiao Chen	Xiao Chen
MAPREDUCE-6566	Add retry support to mapreduce CLI tool	Major	.	Varun Vasudev	Varun Vasudev
HDFS-9726	Refactor IBR code to a new class	Minor	datanode	Tsz Wo Nicholas Sze	Tsz Wo Nicholas Sze
HADOOP-12772	NetworkTopologyWithNodeGroup.getNodeGroup() can loop infinitely for invalid ‘loc’ values	Minor	.	Kuhu Shukla	Kuhu Shukla
HADOOP-12758	Extend CSRF Filter with UserAgent Checks	Major	security	Larry McCay	Larry McCay
HDFS-9686	Remove useless boxing/unboxing code	Minor	performance	Kousuke Saruta	Kousuke Saruta
MAPREDUCE-6626	Reuse ObjectMapper instance in MapReduce	Minor	performance	Yiqun Lin	Yiqun Lin
HADOOP-12788	OpensslAesCtrCryptoCodec should log which random number generator is used.	Minor	.	Wei-Chiu Chuang	Wei-Chiu Chuang
HADOOP-12764	Increase default value of KMS maxHttpHeaderSize and make it configurable	Minor	.	Zhe Zhang	Zhe Zhang
HADOOP-12776	Remove getaclstatus call for non-acl commands in getfacl.	Major	.	Brahma Reddy Battula	Brahma Reddy Battula
HDFS-9768	Reuse objectMapper instance in HDFS to improve the performance	Major	performance	Yiqun Lin	Yiqun Lin
HDFS-9644	Update encryption documentation to reflect nested EZs	Major	documentation, encryption	Zhe Zhang	Zhe Zhang
HDFS-9700	DFSClient and DFSOutputStream should set TCP_NODELAY on sockets for DataTransferProtocol	Major	hdfs-client	Gary Helmling	Gary Helmling
HDFS-9797	Log Standby exceptions thrown by RequestHedgingProxyProvider at DEBUG Level	Minor	hdfs-client	Íñigo Goiri	Íñigo Goiri
YARN-4682	AMRM client to log when AMRM token updated	Major	client	Steve Loughran	Prabhu Joseph
HADOOP-12805	Annotate CanUnbuffer with @InterfaceAudience.Public	Major	.	Ted Yu	Ted Yu
YARN-4690	Skip object allocation in FSAppAttempt#getResourceUsage when possible	Major	.	Ming Ma	Ming Ma
HADOOP-10865	Add a Crc32 chunked verification benchmark for both directly and non-directly buffer cases	Minor	util	Tsz Wo Nicholas Sze	Tsz Wo Nicholas Sze
HDFS-4946	Allow preferLocalNode in BlockPlacementPolicyDefault to be configurable	Major	namenode	James Kinley	Nathan Roberts
HADOOP-11031	Design Document for Credential Provider API	Major	site	Larry McCay	Larry McCay
HADOOP-12828	Print user when services are started	Trivial	.	Brandon Li	Wei-Chiu Chuang
HADOOP-12794	Support additional compression levels for GzipCodec	Major	io	Ravi Mutyala	Ravi Mutyala
HDFS-9425	Expose number of blocks per volume as a metric	Major	.	Brahma Reddy Battula	Brahma Reddy Battula
HADOOP-12668	Support excluding weak Ciphers in HttpServer2 through ssl-server.xml	Critical	security	Vijay Singh	Vijay Singh
HADOOP-12555	WASB to read credentials from a credential provider	Minor	fs/azure	Chris Nauroth	Larry McCay
HDFS-8578	On upgrade, Datanode should process all storage/data dirs in parallel	Critical	datanode	Raju Bairishetti	Vinayakumar B
HADOOP-12535	Run FileSystem contract tests with hadoop-azure.	Major	fs/azure, test	Chris Nauroth	madhumita chakraborty
HDFS-9854	Log cipher suite negotiation more verbosely	Major	encryption	Wei-Chiu Chuang	Wei-Chiu Chuang
HDFS-9843	Document distcp options required for copying between encrypted locations	Major	distcp, documentation, encryption	Xiaoyu Yao	Xiaoyu Yao
HADOOP-12824	Collect network and disk usage on the node running Windows	Major	.	Íñigo Goiri	Íñigo Goiri
YARN-4720	Skip unnecessary NN operations in log aggregation	Major	.	Ming Ma	Jun Gong
HDFS-9831	Document webhdfs retry configuration keys introduced by HDFS-5219/HDFS-5122	Major	documentation, webhdfs	Xiaoyu Yao	Xiaobing Zhou
HDFS-9710	Change DN to send block receipt IBRs in batches	Major	datanode	Tsz Wo Nicholas Sze	Tsz Wo Nicholas Sze
MAPREDUCE-6622	Add capability to set JHS job cache to a task-based limit	Critical	jobhistoryserver	Ray Chiang	Ray Chiang
YARN-4671	There is no need to acquire CS lock when completing a container	Major	.	MENG DING	MENG DING
HADOOP-12853	Change WASB documentation regarding page blob support	Minor	fs/azure	madhumita chakraborty	madhumita chakraborty
HDFS-9887	WebHdfs socket timeouts should be configurable	Major	fs, webhdfs	Austin Donnelly	Austin Donnelly
HADOOP-12859	Disable hiding field style checks in class setters	Major	.	Kai Zheng	Kai Zheng
HDFS-9534	Add CLI command to clear storage policy from a path.	Major	tools	Chris Nauroth	Xiaobing Zhou
HADOOP-12793	Write a new group mapping service guide	Major	documentation	Wei-Chiu Chuang	Wei-Chiu Chuang
HADOOP-12470	In-page TOC of documentation should be automatically generated by doxia macro	Major	documentation	Masatake Iwasaki	Masatake Iwasaki
HDFS-9889	Update balancer/mover document about HDFS-6133 feature	Minor	.	Yongjun Zhang	Yongjun Zhang
MAPREDUCE-6648	Add yarn.app.mapreduce.am.log.level to mapred-default.xml	Trivial	documentation	Harsh J	Harsh J
HDFS-9906	Remove spammy log spew when a datanode is restarted	Major	namenode	Elliott Clark	Brahma Reddy Battula
HADOOP-12901	Add warning log when KMSClientProvider cannot create a connection to the KMS server	Minor	.	Xiao Chen	Xiao Chen
HADOOP-12789	log classpath of ApplicationClassLoader at INFO level	Minor	util	Sangjin Lee	Sangjin Lee
HDFS-9882	Add heartbeatsTotal in Datanode metrics	Minor	datanode	Hua Liu	Hua Liu
HADOOP-12860	Expand section “Data Encryption on HTTP” in SecureMode documentation	Minor	.	Wei-Chiu Chuang	Wei-Chiu Chuang
YARN-4465	SchedulerUtils#validateRequest for Label check should happen only when nodelabel enabled	Minor	.	Bibin A Chundatt	Bibin A Chundatt
HADOOP-12904	Update Yetus to 0.2.0	Blocker	build	Allen Wittenauer	Allen Wittenauer
HADOOP-12798	Update changelog and release notes (2016-03-04)	Major	documentation	Allen Wittenauer	Allen Wittenauer
HADOOP-12905	Clean up CHANGES.txt RAT exclusions from pom.xml files.	Trivial	build	Chris Nauroth	Chris Nauroth
HDFS-9927	Document the new OIV ReverseXML processor	Minor	documentation	Wei-Chiu Chuang	Wei-Chiu Chuang
HDFS-9942	Add an HTrace span when refreshing the groups for a username	Major	.	Colin P. McCabe	Colin P. McCabe
HDFS-9941	Do not log StandbyException on NN, other minor logging fixes	Major	namenode	Arpit Agarwal	Arpit Agarwal
HADOOP-12923	Move the test code in ipc.Client to test	Minor	ipc	Tsz Wo Nicholas Sze	Tsz Wo Nicholas Sze
HDFS-9405	Warmup NameNode EDEK caches in background thread	Major	encryption, namenode	Zhe Zhang	Xiao Chen
HDFS-9951	Use string constants for XML tags in OfflineImageReconstructor	Minor	.	Yiqun Lin	Yiqun Lin
HADOOP-12947	Update documentation Hadoop Groups Mapping to add static group mapping, negative cache	Minor	documentation, security	Wei-Chiu Chuang	Wei-Chiu Chuang
YARN-4117	End to end unit test with mini YARN cluster for AMRMProxy Service	Major	nodemanager, resourcemanager	Kishore Chaliparambil	Giovanni Matteo Fumarola
HADOOP-10965	Print fully qualified path in CommandWithDestination error messages	Minor	.	André Kelpe	John Zhuge
MAPREDUCE-6663	[NNBench] Refactor nnbench as a Tool implementation.	Major	.	Brahma Reddy Battula	Brahma Reddy Battula
HADOOP-12886	Exclude weak ciphers in SSLFactory through ssl-server.xml	Major	.	Wei-Chiu Chuang	Wei-Chiu Chuang
YARN-4884	Fix missing documentation about rmadmin command regarding node labels	Minor	.	Kai Sasaki	Kai Sasaki
HADOOP-12916	Allow RPC scheduler/callqueue backoff using response times	Major	ipc	Xiaoyu Yao	Xiaoyu Yao
HADOOP-12950	ShutdownHookManager should have a timeout for each of the Registered shutdown hook	Major	.	Xiaoyu Yao	Xiaoyu Yao
HADOOP-11661	Deprecate FileUtil#copyMerge	Major	util	Brahma Reddy Battula	Brahma Reddy Battula
HADOOP-11687	Ignore x-* and response headers when copying an Amazon S3 object	Major	fs/s3	Denis Jannot	Harsh J
HADOOP-11212	NetUtils.wrapException to handle SocketException explicitly	Major	util	Steve Loughran	Steve Loughran
HADOOP-12672	RPC timeout should not override IPC ping interval	Major	ipc	Masatake Iwasaki	Masatake Iwasaki
HDFS-10235	[NN UI] Last contact for Live Nodes should be relative time	Major	.	Brahma Reddy Battula	Brahma Reddy Battula
HADOOP-8813	RPC Server and Client classes need InterfaceAudience and InterfaceStability annotations	Trivial	ipc	Brandon Li	Brandon Li
YARN-4756	Unnecessary wait in Node Status Updater during reboot	Major	.	Eric Badger	Eric Badger
HADOOP-12951	Improve documentation on KMS ACLs and delegation tokens	Major	.	Xiao Chen	Xiao Chen
HADOOP-12994	Specify PositionedReadable, add contract tests, fix problems	Major	fs	Steve Loughran	Steve Loughran
YARN-4630	Remove useless boxing/unboxing code	Minor	yarn	Kousuke Saruta	Kousuke Saruta
HDFS-10279	Improve validation of the configured number of tolerated failed volumes	Major	.	Yiqun Lin	Yiqun Lin
HADOOP-12822	Change “Metrics intern cache overflow” log level from WARN to INFO	Minor	metrics	Akira Ajisaka	Andras Bokor
HADOOP-12969	Mark IPC.Client and IPC.Server as @Public, @Evolving	Minor	ipc	Xiaobing Zhou	Xiaobing Zhou
HADOOP-12963	Allow using path style addressing for accessing the s3 endpoint	Minor	fs/s3	Andrew Baptist	Stephen Montgomery
HDFS-10280	Document new dfsadmin command -evictWriters	Minor	documentation	Wei-Chiu Chuang	Wei-Chiu Chuang
HDFS-10292	Add block id when client got Unable to close file exception	Minor	.	Brahma Reddy Battula	Brahma Reddy Battula
HDFS-9412	getBlocks occupies FSLock and takes too long to complete	Major	balancer & mover, namenode	He Tianyi	He Tianyi
HDFS-10302	BlockPlacementPolicyDefault should use default replication considerload value	Trivial	.	Yiqun Lin	Yiqun Lin
HDFS-10264	Logging improvements in FSImageFormatProtobuf.Saver	Major	namenode	Konstantin Shvachko	Xiaobing Zhou
HADOOP-12985	Support MetricsSource interface for DecayRpcScheduler Metrics	Major	.	Xiaoyu Yao	Xiaoyu Yao
HDFS-9894	Add unsetStoragePolicy API to FileContext/AbstractFileSystem and derivatives	Major	.	Xiaobing Zhou	Xiaobing Zhou
HADOOP-12891	S3AFileSystem should configure Multipart Copy threshold and chunk size	Major	fs/s3	Andrew Olson	Andrew Olson
HADOOP-13033	Add missing Javadoc enries to Interns.java	Minor	metrics	Andras Bokor	Andras Bokor
HDFS-10298	Document the usage of distcp -diff option	Major	distcp, documentation	Akira Ajisaka	Takashi Ohnishi
HADOOP-13039	Add documentation for configuration property ipc.maximum.data.length for controlling maximum RPC message size.	Major	documentation	Chris Nauroth	Mingliang Liu
HDFS-10330	Add Corrupt Blocks Information in Metasave Output	Major	.	Kuhu Shukla	Kuhu Shukla
HADOOP-5470	RunJar.unJar() should write the last modified time found in the jar entry to the uncompressed file	Minor	util	Colin Evans	Andras Bokor
HDFS-3702	Add an option for NOT writing the blocks locally if there is a datanode on the same box as the client	Minor	hdfs-client	Nicolas Liochon	Lei (Eddy) Xu
HDFS-10297	Increase default balance bandwidth and concurrent moves	Minor	balancer & mover	John Zhuge	John Zhuge
HADOOP-12957	Limit the number of outstanding async calls	Major	ipc	Xiaobing Zhou	Xiaobing Zhou
HDFS-9902	Support different values of dfs.datanode.du.reserved per storage type	Major	datanode	Pan Yuxuan	Brahma Reddy Battula
HADOOP-13103	Group resolution from LDAP may fail on javax.naming.ServiceUnavailableException	Minor	security	Tsz Wo Nicholas Sze	Tsz Wo Nicholas Sze
MAPREDUCE-6678	Allow ShuffleHandler readahead without drop-behind	Major	nodemanager	Nathan Roberts	Nathan Roberts
HADOOP-12982	Document missing S3A and S3 properties	Minor	documentation, fs/s3, tools	Wei-Chiu Chuang	Wei-Chiu Chuang
YARN-4995	FairScheduler: Display per-queue demand on the scheduler page	Minor	.	xupeng	xupeng
HADOOP-12868	Fix hadoop-openstack undeclared and unused dependencies	Major	tools	Allen Wittenauer	Masatake Iwasaki
HADOOP-12971	FileSystemShell doc should explain relative path	Critical	documentation	John Zhuge	John Zhuge
HADOOP-13148	TestDistCpViewFs to include IOExceptions in test error reports	Minor	tools/distcp	Steve Loughran	Steve Loughran
HADOOP-13146	Refactor RetryInvocationHandler	Minor	io	Tsz Wo Nicholas Sze	Tsz Wo Nicholas Sze
HDFS-10383	Safely close resources in DFSTestUtil	Major	test	Mingliang Liu	Mingliang Liu
YARN-4002	make ResourceTrackerService.nodeHeartbeat more concurrent	Critical	.	Hong Zhiguo	Hong Zhiguo
HDFS-10417	Improve error message from checkBlockLocalPathAccess	Minor	datanode	Tianyin Xu	Tianyin Xu
HADOOP-13168	Support Future.get with timeout in ipc async calls	Major	ipc	Tsz Wo Nicholas Sze	Tsz Wo Nicholas Sze
HADOOP-13145	In DistCp, prevent unnecessary getFileStatus call when not preserving metadata.	Major	tools/distcp	Chris Nauroth	Chris Nauroth
HADOOP-13198	Add support for OWASP’s dependency-check	Minor	build, security	Mike Yoder	Mike Yoder
HDFS-10217	show ‘blockScheduled’ tooltip in datanodes table.	Major	.	Brahma Reddy Battula	Brahma Reddy Battula
HADOOP-13199	Add doc for distcp -filters	Trivial	documentation	John Zhuge	John Zhuge
HADOOP-13193	Upgrade to Apache Yetus 0.3.0	Major	build, documentation, test	Allen Wittenauer	Kengo Seki
HADOOP-13197	Add non-decayed call metrics for DecayRpcScheduler	Major	ipc, metrics	Xiaoyu Yao	Xiaoyu Yao
HDFS-10341	Add a metric to expose the timeout number of pending replication blocks	Major	.	Akira Ajisaka	Akira Ajisaka
HADOOP-13105	Support timeouts in LDAP queries in LdapGroupsMapping.	Major	security	Chris Nauroth	Mingliang Liu
HADOOP-12807	S3AFileSystem should read AWS credentials from environment variables	Minor	fs/s3	Tobin Baker	Tobin Baker
MAPREDUCE-5044	Have AM trigger jstack on task attempts that timeout before killing them	Major	mr-am	Jason Lowe	Eric Payne
HADOOP-10048	LocalDirAllocator should avoid holding locks while accessing the filesystem	Major	.	Jason Lowe	Jason Lowe
MAPREDUCE-6714	Refactor UncompressedSplitLineReader.fillBuffer()	Major	.	Daniel Templeton	Daniel Templeton
HADOOP-12943	Add -w -r options in dfs -test command	Major	fs, scripts, tools	Weiwei Yang	Weiwei Yang
HDFS-10493	Add links to datanode web UI in namenode datanodes page	Major	namenode, ui	Weiwei Yang	Weiwei Yang
HADOOP-13296	Cleanup javadoc for Path	Minor	documentation	Daniel Templeton	Daniel Templeton
HDFS-7597	DelegationTokenIdentifier should cache the TokenIdentifier to UGI mapping	Critical	webhdfs	Daryn Sharp	Daryn Sharp
HADOOP-13307	add rsync to Dockerfile so that precommit archive works	Trivial	build	Allen Wittenauer	Allen Wittenauer
HADOOP-13067	cleanup the dockerfile	Major	.	Allen Wittenauer	Allen Wittenauer
HADOOP-13227	AsyncCallHandler should use an event driven architecture to handle async calls	Major	io, ipc	Tsz Wo Nicholas Sze	Tsz Wo Nicholas Sze
HADOOP-13263	Reload cached groups in background after expiry	Major	.	Stephen O’Donnell	Stephen O’Donnell
HDFS-10440	Improve DataNode web UI	Major	datanode, ui	Weiwei Yang	Weiwei Yang
HADOOP-13239	Deprecate s3:// in branch-2	Major	fs/s3	Mingliang Liu	Mingliang Liu
HDFS-10582	Change deprecated configuration fs.checkpoint.dir to dfs.namenode.checkpoint.dir in HDFS Commands Doc	Minor	documentation	Pan Yuxuan	Pan Yuxuan
HDFS-10488	Update WebHDFS documentation regarding CREATE and MKDIR default permissions	Minor	documentation, webhdfs	Wellington Chevreuil	Wellington Chevreuil
HDFS-10300	TestDistCpSystem should share MiniDFSCluster	Trivial	test	John Zhuge	John Zhuge
HADOOP-13290	Appropriate use of generics in FairCallQueue	Major	ipc	Konstantin Shvachko	Jonathan Hung
HADOOP-13289	Remove unused variables in TestFairCallQueue	Minor	test	Konstantin Shvachko	Ye Zhou
HDFS-10628	Log HDFS Balancer exit message to its own log	Minor	balancer & mover	Jiayi Zhou	Jiayi Zhou
HADOOP-13298	Fix the leftover L&N files in hadoop-build-tools/src/main/resources/META-INF/	Minor	.	Xiao Chen	Tsuyoshi Ozawa
YARN-4883	Make consistent operation name in AdminService	Minor	resourcemanager	Kai Sasaki	Kai Sasaki
YARN-1126	Add validation of users input nodes-states options to nodes CLI	Major	.	Wei Yan	Wei Yan
HDFS-10287	MiniDFSCluster should implement AutoCloseable	Minor	test	John Zhuge	Andras Bokor
HDFS-10225	DataNode hot swap drives should disallow storage type changes.	Major	datanode	Lei (Eddy) Xu	Lei (Eddy) Xu
HDFS-10660	Expose storage policy apis via HDFSAdmin interface	Major	.	Rakesh R	Rakesh R
HDFS-9937	Update dfsadmin command line help and HdfsQuotaAdminGuide	Minor	.	Wei-Chiu Chuang	Kai Sasaki
HDFS-10667	Report more accurate info about data corruption location	Major	datanode, hdfs	Yongjun Zhang	Yuanbo Liu
HDFS-10676	Add namenode metric to measure time spent in generating EDEKs	Major	namenode	Hanisha Koneru	Hanisha Koneru
MAPREDUCE-6746	Replace org.apache.commons.io.Charsets with java.nio.charset.StandardCharsets	Minor	.	Vincent Poon	Vincent Poon
HDFS-10703	HA NameNode Web UI should show last checkpoint time	Minor	ui	John Zhuge	John Zhuge
MAPREDUCE-6729	Accurately compute the test execute time in DFSIO	Minor	benchmarks, performance, test	zhangminglei	zhangminglei
HADOOP-13444	Replace org.apache.commons.io.Charsets with java.nio.charset.StandardCharsets	Minor	.	Vincent Poon	Vincent Poon
YARN-5456	container-executor support for FreeBSD, NetBSD, and others if conf path is absolute	Major	nodemanager, security	Allen Wittenauer	Allen Wittenauer
MAPREDUCE-6730	Use StandardCharsets instead of String overload in TextOutputFormat	Minor	.	Sahil Kang	Sahil Kang
HDFS-10707	Replace org.apache.commons.io.Charsets with java.nio.charset.StandardCharsets	Minor	.	Vincent Poon	Vincent Poon
HADOOP-13442	Optimize UGI group lookups	Major	.	Daryn Sharp	Daryn Sharp
HADOOP-13466	Add an AutoCloseableLock class	Major	.	Chen Liang	Chen Liang
YARN-5483	Optimize RMAppAttempt#pullJustFinishedContainers	Major	.	sandflee	sandflee
HADOOP-13190	Mention LoadBalancingKMSClientProvider in KMS HA documentation	Major	documentation, kms	Wei-Chiu Chuang	Wei-Chiu Chuang
HDFS-10677	Über-jira: Enhancements to NNThroughputBenchmark tool	Major	benchmarks, tools	Mingliang Liu	Mingliang Liu
HDFS-10342	BlockManager#createLocatedBlocks should not check corrupt replicas if none are corrupt	Major	hdfs	Daryn Sharp	Kuhu Shukla
HDFS-10682	Replace FsDatasetImpl object lock with a separate lock object	Major	datanode	Chen Liang	Chen Liang
HADOOP-13503	Improve SaslRpcClient failure logging	Major	security	Xiaobing Zhou	Xiaobing Zhou
HADOOP-13527	Add Spark to CallerContext LimitedPrivate scope	Minor	ipc	Weiqing Yang	Weiqing Yang
MAPREDUCE-6587	Remove unused params in connection-related methods of Fetcher	Minor	.	Yiqun Lin	Yiqun Lin
HADOOP-13538	Deprecate getInstance and initialize methods with Path in TrashPolicy	Minor	.	Yiqun Lin	Yiqun Lin
HDFS-8986	Add option to -du to calculate directory space usage excluding snapshots	Major	snapshots	Gautam Gopalakrishnan	Xiao Chen
HDFS-10798	Make the threshold of reporting FSNamesystem lock contention configurable	Major	logging, namenode	Zhe Zhang	Erik Krogen
YARN-5550	TestYarnCLI#testGetContainers should format according to CONTAINER_PATTERN	Minor	client, test	Jonathan Hung	Jonathan Hung
HDFS-10814	Add assertion for getNumEncryptionZones when no EZ is created	Minor	test	Vinitha Reddy Gankidi	Vinitha Reddy Gankidi
HDFS-10817	Add Logging for Long-held NN Read Locks	Major	logging, namenode	Erik Krogen	Erik Krogen
HADOOP-13465	Design Server.Call to be extensible for unified call queue	Major	ipc	Daryn Sharp	Daryn Sharp
HDFS-10833	Fix JSON errors in WebHDFS.md examples	Trivial	documentation	Andrew Wang	Andrew Wang
HDFS-10742	Measure lock time in FsDatasetImpl	Major	datanode	Chen Liang	Chen Liang
HDFS-10831	Add log when URLConnectionFactory.openConnection failed	Minor	webhdfs	yunjiong zhao	yunjiong zhao
HADOOP-13598	Add eol=lf for unix format files in .gitattributes	Major	.	Akira Ajisaka	Yiqun Lin
HADOOP-13580	If user is unauthorized, log “unauthorized” instead of “Invalid signed text:”	Minor	security	Wei-Chiu Chuang	Wei-Chiu Chuang
HDFS-10489	Deprecate dfs.encryption.key.provider.uri for HDFS encryption zones	Minor	.	Xiao Chen	Xiao Chen
YARN-5540	scheduler spends too much time looking at empty priorities	Major	capacity scheduler, fairscheduler, resourcemanager	Nathan Roberts	Jason Lowe
HADOOP-13169	Randomize file list in SimpleCopyListing	Minor	tools/distcp	Rajesh Balamohan	Rajesh Balamohan
HDFS-10875	Optimize du -x to cache intermediate result	Major	snapshots	Xiao Chen	Xiao Chen
YARN-4591	YARN Web UIs should provide a robots.txt	Trivial	.	Lars Francke	Sidharta Seethana
YARN-5622	TestYarnCLI.testGetContainers fails due to mismatched date formats	Minor	.	Eric Badger	Eric Badger
HDFS-10876	Dispatcher#dispatch should log IOException stacktrace	Trivial	balancer & mover	Wei-Chiu Chuang	Manoj Govindassamy
YARN-3692	Allow REST API to set a user generated message when killing an application	Major	.	Rajat Jain	Rohith Sharma K S
HDFS-10869	Remove the unused method InodeId#checkId()	Major	namenode	Jagadesh Kiran N	Jagadesh Kiran N
YARN-3877	YarnClientImpl.submitApplication swallows exceptions	Minor	client	Steve Loughran	Varun Saxena
HADOOP-13658	Replace config key literal strings with config key names I: hadoop common	Minor	conf	Chen Liang	Chen Liang
HADOOP-13537	Support external calls in the RPC call queue	Major	ipc	Daryn Sharp	Daryn Sharp
HADOOP-13317	Add logs to KMS server-side to improve supportability	Minor	kms	Xiao Chen	Suraj Acharya
HDFS-10940	Reduce performance penalty of block caching when not used	Major	namenode	Daryn Sharp	Daryn Sharp
YARN-4855	Should check if node exists when replace nodelabels	Minor	.	Tao Jie	Tao Jie
HDFS-10690	Optimize insertion/removal of replica in ShortCircuitCache	Major	hdfs-client	Fenghua Hu	Fenghua Hu
HADOOP-13685	Document -safely option of rm command.	Major	.	Xiaoyu Yao	Xiaoyu Yao
MAPREDUCE-6741	add MR support to redact job conf properties	Major	mrv2	Haibo Chen	Haibo Chen
HDFS-10963	Reduce log level when network topology cannot find enough datanodes.	Minor	.	Xiao Chen	Xiao Chen
HADOOP-13323	Downgrade stack trace on FS load from Warn to debug	Minor	fs	Steve Loughran	Steve Loughran
HADOOP-13150	Avoid use of toString() in output of HDFS ACL shell commands.	Minor	.	Chris Nauroth	Chris Nauroth
HADOOP-13689	Do not attach javadoc and sources jars during non-dist build	Major	.	Andrew Wang	Andrew Wang
HADOOP-13641	Update UGI#spawnAutoRenewalThreadForUserCreds to reduce indentation	Minor	.	Xiao Chen	Huafeng Wang
HDFS-10933	Refactor TestFsck	Minor	.	Takanobu Asanuma	Takanobu Asanuma
HADOOP-13684	Snappy may complain Hadoop is built without snappy if libhadoop is not found.	Minor	.	Wei-Chiu Chuang	Wei-Chiu Chuang
HADOOP-13698	Document caveat for KeyShell when underlying KeyProvider does not delete a key	Minor	documentation, kms	Xiao Chen	Xiao Chen
HDFS-10789	Route webhdfs through the RPC call queue	Major	ipc, webhdfs	Daryn Sharp	Daryn Sharp
HDFS-10903	Replace config key literal strings with config key names II: hadoop hdfs	Minor	.	Mingliang Liu	Chen Liang
HADOOP-13710	Supress CachingGetSpaceUsed from logging interrupted exception stacktrace	Minor	fs	Wei-Chiu Chuang	Hanisha Koneru
YARN-5599	Publish AM launch command to ATS	Major	.	Daniel Templeton	Rohith Sharma K S
HDFS-11012	Unnecessary INFO logging on DFSClients for InvalidToken	Minor	fs	Harsh J	Harsh J
HDFS-11003	Expose “XmitsInProgress” through DataNodeMXBean	Major	.	Brahma Reddy Battula	Brahma Reddy Battula
HADOOP-13724	Fix a few typos in site markdown documents	Minor	documentation	Andrew Wang	Ding Fei
HDFS-11009	Add a tool to reconstruct block meta file from CLI	Major	datanode	Xiao Chen	Xiao Chen
HDFS-9480	Expose nonDfsUsed via StorageTypeStats	Major	.	Brahma Reddy Battula	Brahma Reddy Battula
HADOOP-12082	Support multiple authentication schemes via AuthenticationFilter	Major	security	Hrishikesh Gadre	Hrishikesh Gadre
HADOOP-13669	KMS Server should log exceptions before throwing	Major	kms	Xiao Chen	Suraj Acharya
HADOOP-13502	Split fs.contract.is-blobstore flag into more descriptive flags for use by contract tests.	Minor	test	Chris Nauroth	Chris Nauroth
HADOOP-13017	Implementations of InputStream.read(buffer, offset, bytes) to exit 0 if bytes==0	Major	fs, io	Steve Loughran	Steve Loughran
HDFS-11069	Tighten the authorization of datanode RPC	Major	datanode, security	Kihwal Lee	Kihwal Lee
HDFS-11055	Update default-log4j.properties for httpfs to imporve test logging	Major	httpfs, test	Wei-Chiu Chuang	Wei-Chiu Chuang
YARN-4963	capacity scheduler: Make number of OFF_SWITCH assignments per heartbeat configurable	Major	capacityscheduler	Nathan Roberts	Nathan Roberts
HDFS-11047	Remove deep copies of FinalizedReplica to alleviate heap consumption on DataNode	Major	datanode	Xiaobing Zhou	Xiaobing Zhou
MAPREDUCE-6799	Document mapreduce.jobhistory.webapp.https.address in mapred-default.xml	Minor	documentation, jobhistoryserver	Akira Ajisaka	Yiqun Lin
HADOOP-12325	RPC Metrics : Add the ability track and log slow RPCs	Major	ipc, metrics	Anu Engineer	Anu Engineer
HDFS-11074	Remove unused method FsDatasetSpi#getFinalizedBlocksOnPersistentStorage	Major	datanode	Arpit Agarwal	Hanisha Koneru
MAPREDUCE-6795	Update the document for JobConf#setNumReduceTasks	Major	documentation	Akira Ajisaka	Yiqun Lin
HADOOP-13603	Ignore package line length checkstyle rule	Major	build	Shane Kumpf	Shane Kumpf
HADOOP-13583	Incorporate checkcompatibility script which runs Java API Compliance Checker	Major	scripts	Andrew Wang	Andrew Wang
HDFS-11080	Update HttpFS to use ConfigRedactor	Major	.	Sean Mackrory	Sean Mackrory
YARN-5697	Use CliParser to parse options in RMAdminCLI	Major	resourcemanager	Tao Jie	Tao Jie
HADOOP-12453	Support decoding KMS Delegation Token with its own Identifier	Major	kms, security	Xiaoyu Yao	Xiaoyu Yao
HADOOP-7930	Kerberos relogin interval in UserGroupInformation should be configurable	Major	security	Alejandro Abdelnur	Robert Kanter
YARN-5720	Update document for “rmadmin -replaceLabelOnNode”	Minor	.	Tao Jie	Tao Jie
HADOOP-13782	Make MutableRates metrics thread-local write, aggregate-on-read	Major	metrics	Erik Krogen	Erik Krogen
HADOOP-13590	Retry until TGT expires even if the UGI renewal thread encountered exception	Major	security	Xiao Chen	Xiao Chen
HDFS-11120	TestEncryptionZones should waitActive	Minor	test	Xiao Chen	John Zhuge
HDFS-10941	Improve BlockManager#processMisReplicatesAsync log	Major	namenode	Xiaoyu Yao	Chen Liang
HADOOP-13810	Add a test to verify that Configuration handles &-encoded characters	Minor	test	Steve Loughran	Steve Loughran
HADOOP-13742	Expose “NumOpenConnectionsPerUser” as a metric	Major	.	Brahma Reddy Battula	Brahma Reddy Battula
HADOOP-13646	Remove outdated overview.html	Minor	.	Akira Ajisaka	Brahma Reddy Battula
HADOOP-13166	add getFileStatus(“/”) test to AbstractContractGetFileStatusTest	Minor	fs, test	Steve Loughran	Steve Loughran
HADOOP-11603	Metric Snapshot log can be changed #MetricsSystemImpl.java since all the services will be initialized	Minor	metrics	Brahma Reddy Battula	Brahma Reddy Battula
HADOOP-10776	Open up already widely-used APIs for delegation-token fetching & renewal to ecosystem projects	Blocker	.	Robert Joseph Evans	Vinod Kumar Vavilapalli
HDFS-11175	Document uppercase key names are not supported in TransparentEncryption.md	Minor	documentation	Yuanbo Liu	Yiqun Lin
HADOOP-13790	Make qbt script executable	Trivial	scripts	Andrew Wang	Andrew Wang
HDFS-8674	Improve performance of postponed block scans	Critical	namenode	Daryn Sharp	Daryn Sharp
HDFS-10581	Hide redundant table on NameNode WebUI when no nodes are decomissioning	Trivial	hdfs, ui	Weiwei Yang	Weiwei Yang
HDFS-11217	Annotate NameNode and DataNode MXBean interfaces as Private/Stable	Major	.	Akira Ajisaka	Jagadesh Kiran N
HADOOP-13900	Remove snapshot version of SDK dependency from Azure Data Lake Store File System	Major	fs/adl	Vishwajeet Dusane	Vishwajeet Dusane
HDFS-11249	Redundant toString() in DFSConfigKeys.java	Trivial	.	Akira Ajisaka	Jagadesh Kiran N
YARN-5882	Test only changes from YARN-4126	Major	.	Andrew Wang	Jian He
HDFS-11262	Remove unused variables in FSImage.java	Trivial	.	Akira Ajisaka	Jagadesh Kiran N
YARN-4994	Use MiniYARNCluster with try-with-resources in tests	Trivial	test	Andras Bokor	Andras Bokor
YARN-5709	Cleanup leader election configs and pluggability	Critical	resourcemanager	Karthik Kambatla	Karthik Kambatla
HDFS-9483	Documentation does not cover use of “swebhdfs” as URL scheme for SSL-secured WebHDFS.	Major	documentation	Chris Nauroth	Surendra Singh Lilhore
HDFS-11292	log lastWrittenTxId etc info in logSyncAll	Major	hdfs	Yongjun Zhang	Yongjun Zhang
HADOOP-13956	Read ADLS credentials from Credential Provider	Critical	fs/adl	John Zhuge	John Zhuge
HADOOP-13962	Update ADLS SDK to 2.1.4	Major	fs/adl	John Zhuge	John Zhuge
HADOOP-13606	swift FS to add a service load metadata file	Major	fs/swift	Steve Loughran	Steve Loughran
HADOOP-13037	Refactor Azure Data Lake Store as an independent FileSystem	Major	fs/adl	Shrikant Naidu	Vishwajeet Dusane
HADOOP-13946	Document how HDFS updates timestamps in the FS spec; compare with object stores	Minor	documentation, fs	Steve Loughran	Steve Loughran
HDFS-10601	Improve log message to include hostname when the NameNode is in safemode	Minor	.	Kuhu Shukla	Kuhu Shukla
HADOOP-11694	Über-jira: S3a phase II: robustness, scale and performance	Major	fs/s3	Steve Loughran	Steve Loughran
HDFS-8873	Allow the directoryScanner to be rate-limited	Major	datanode	Nathan Roberts	Daniel Templeton
HADOOP-12825	Log slow name resolutions	Major	.	Sidharta Seethana	Sidharta Seethana
HDFS-8865	Improve quota initialization performance	Major	.	Kihwal Lee	Kihwal Lee
HADOOP-12806	Hadoop fs s3a lib not working with temporary credentials in AWS Lambda	Major	fs/s3	Nikolaos Tsipas

BUG FIXES:

JIRA	Summary	Priority	Component	Reporter	Contributor
HADOOP-8818	Should use equals() rather than == to compare String or Text in MD5MD5CRC32FileChecksum and TFileDumper	Minor	fs, io	Brandon Li	Brandon Li
HADOOP-8436	NPE In getLocalPathForWrite ( path, conf ) when the required context item is not configured	Major	fs	Brahma Reddy Battula	Brahma Reddy Battula
HADOOP-9121	InodeTree.java has redundant check for vName while throwing exception	Major	fs	Arup Malakar	Arup Malakar
HADOOP-9242	Duplicate surefire plugin config in hadoop-common	Major	test	Andrey Klochkov	Andrey Klochkov
HADOOP-8419	GzipCodec NPE upon reset with IBM JDK	Major	io	Luke Lu	Yu Li
HDFS-4366	Block Replication Policy Implementation May Skip Higher-Priority Blocks for Lower-Priority Blocks	Major	.	Derek Dagit	Derek Dagit
HADOOP-11559	Add links to RackAwareness and InterfaceClassification to site index	Minor	documentation	Masatake Iwasaki	Masatake Iwasaki
HADOOP-11581	Fix Multithreaded correctness Warnings #org.apache.hadoop.fs.shell.Ls	Major	.	Brahma Reddy Battula	Brahma Reddy Battula
HADOOP-11568	Description on usage of classpath in hadoop command is incomplete.	Trivial	tools	Archana T	Archana T
HADOOP-10027	*Compressor_deflateBytesDirect passes instance instead of jclass to GetStaticObjectField	Minor	native	Eric Abbott	Hui Zheng
HDFS-5356	MiniDFSCluster shoud close all open FileSystems when shutdown()	Critical	test	haosdent	Rakesh R
YARN-3197	Confusing log generated by CapacityScheduler	Minor	capacityscheduler	Hitesh Shah	Varun Saxena
YARN-3243	CapacityScheduler should pass headroom from parent to children to make sure ParentQueue obey its capacity limits.	Major	capacityscheduler, resourcemanager	Wangda Tan	Wangda Tan
YARN-3305	AM-Used Resource for leafqueue is wrongly populated if AM ResourceRequest is less than minimumAllocation	Major	scheduler	Rohith Sharma K S	Rohith Sharma K S
YARN-3205	FileSystemRMStateStore should disable FileSystem Cache to avoid get a Filesystem with an old configuration.	Major	resourcemanager	zhihai xu	zhihai xu
MAPREDUCE-5807	Print usage for TeraSort job.	Trivial	examples	Rohith Sharma K S	Rohith Sharma K S
YARN-3351	AppMaster tracking URL is broken in HA	Major	webapp	Anubhav Dhoot	Anubhav Dhoot
HDFS-7867	Update action param from “start” to “prepare” in rolling upgrade javadoc	Trivial	.	J.Andreina	J.Andreina
MAPREDUCE-6281	Fix javadoc in Terasort	Trivial	.	Albert Chu	Albert Chu
YARN-3269	Yarn.nodemanager.remote-app-log-dir could not be configured to fully qualified path	Major	.	Xuan Gong	Xuan Gong
MAPREDUCE-6213	NullPointerException caused by job history server addr not resolvable	Minor	applicationmaster	Peng Zhang	Peng Zhang
MAPREDUCE-5448	MapFileOutputFormat#getReaders bug with invisible files/folders	Minor	mrv2	Maysam Yabandeh	Maysam Yabandeh
MAPREDUCE-6242	Progress report log is incredibly excessive in application master	Major	applicationmaster	Jian Fang	Varun Saxena
HDFS-3325	When configuring “dfs.namenode.safemode.threshold-pct” to a value greater or equal to 1 there is mismatch in the UI report	Minor	.	J.Andreina	J.Andreina
YARN-3383	AdminService should use “warn” instead of “info” to log exception when operation fails	Major	resourcemanager	Wangda Tan	Li Lu
YARN-3397	yarn rmadmin should skip -failover	Minor	resourcemanager	J.Andreina	J.Andreina
HADOOP-11724	DistCp throws NPE when the target directory is root.	Minor	.	Lei (Eddy) Xu	Lei (Eddy) Xu
YARN-3400	[JDK 8] Build Failure due to unreported exceptions in RPCUtil	Major	.	Robert Kanter	Robert Kanter
HDFS-7990	IBR delete ack should not be delayed	Major	namenode	Daryn Sharp	Daryn Sharp
HADOOP-11760	Fix typo of javadoc in DistCp	Trivial	.	Chen He	Brahma Reddy Battula
MAPREDUCE-6294	Remove an extra parameter described in Javadoc of TockenCache	Trivial	.	Chen He	Brahma Reddy Battula
HDFS-7501	TransactionsSinceLastCheckpoint can be negative on SBNs	Major	namenode	Harsh J	Gautam Gopalakrishnan
HDFS-8002	Website refers to /trash directory	Major	documentation	Mike Drob	Brahma Reddy Battula
HDFS-7261	storageMap is accessed without synchronization in DatanodeDescriptor#updateHeartbeatState()	Major	.	Ted Yu	Brahma Reddy Battula
HDFS-7997	The first non-existing xattr should also throw IOException	Minor	.	zhouyingchao	zhouyingchao
HDFS-6945	BlockManager should remove a block from excessReplicateMap and decrement ExcessBlocks metric when the block is removed	Critical	namenode	Akira Ajisaka	Akira Ajisaka
YARN-3425	NPE from RMNodeLabelsManager.serviceStop when NodeLabelsManager.serviceInit failed	Minor	resourcemanager	Bibin A Chundatt	Bibin A Chundatt
HDFS-7922	ShortCircuitCache#close is not releasing ScheduledThreadPoolExecutors	Major	.	Rakesh R	Rakesh R
HDFS-8026	Trace FSOutputSummer#writeChecksumChunks rather than DFSOutputStream#writeChunk	Minor	.	Colin P. McCabe	Colin P. McCabe
YARN-3415	Non-AM containers can be counted towards amResourceUsage of a Fair Scheduler queue	Critical	fairscheduler	Rohit Agarwal	zhihai xu
HADOOP-11797	releasedocmaker.py needs to put ASF headers on output	Major	build	Allen Wittenauer	Allen Wittenauer
HADOOP-11800	Clean up some test methods in TestCodec.java	Major	test	Akira Ajisaka	Brahma Reddy Battula
MAPREDUCE-4844	Counters / AbstractCounters have constant references not declared final	Major	.	Gera Shegalov	Brahma Reddy Battula
YARN-3435	AM container to be allocated Appattempt AM container shown as null	Trivial	resourcemanager	Bibin A Chundatt	Bibin A Chundatt
YARN-3429	TestAMRMTokens.testTokenExpiry fails Intermittently with error message:Invalid AMRMToken	Major	test	zhihai xu	zhihai xu
HDFS-5215	dfs.datanode.du.reserved is not considered while computing available space	Major	datanode	Brahma Reddy Battula	Brahma Reddy Battula
YARN-3457	NPE when NodeManager.serviceInit fails and stopRecoveryStore called	Minor	nodemanager	Bibin A Chundatt	Bibin A Chundatt
YARN-3459	Fix failiure of TestLog4jWarningErrorMetricsAppender	Blocker	.	Li Lu	Varun Vasudev
HDFS-8046	Allow better control of getContentSummary	Major	.	Kihwal Lee	Kihwal Lee
YARN-2890	MiniYarnCluster should turn on timeline service if configured to do so	Major	.	Mit Desai	Mit Desai
HDFS-7725	Incorrect “nodes in service” metrics caused all writes to fail	Major	.	Ming Ma	Ming Ma
HDFS-8096	DatanodeMetrics#blocksReplicated will get incremented early and even for failed transfers	Major	datanode	Vinayakumar B	Vinayakumar B
YARN-3465	Use LinkedHashMap to preserve order of resource requests	Major	nodemanager	zhihai xu	zhihai xu
HDFS-8099	Change “DFSInputStream has been closed already” message to debug log level	Minor	hdfs-client	Charles Lamb	Charles Lamb
HDFS-8091	ACLStatus and XAttributes not properly presented to INodeAttributesProvider before returning to client	Major	namenode	Arun Suresh	Arun Suresh
MAPREDUCE-6266	Job#getTrackingURL should consistently return a proper URL	Minor	.	Ray Chiang	Ray Chiang
HDFS-8081	Split getAdditionalBlock() into two methods.	Major	.	Konstantin Shvachko	Konstantin Shvachko
HDFS-7939	Two fsimage_rollback_* files are created which are not deleted after rollback.	Critical	.	J.Andreina	J.Andreina
MAPREDUCE-6314	TestPipeApplication fails on trunk	Major	test	Varun Vasudev	Varun Vasudev
YARN-3466	Fix RM nodes web page to sort by node HTTP-address, #containers and node-label column	Major	resourcemanager, webapp	Jason Lowe	Jason Lowe
HDFS-7931	DistributedFIleSystem should not look for keyProvider in cache if Encryption is disabled	Minor	hdfs-client	Arun Suresh	Arun Suresh
HDFS-8111	NPE thrown when invalid FSImage filename given for “hdfs oiv_legacy” cmd	Minor	tools	Archana T	Surendra Singh Lilhore
HADOOP-11811	Fix typos in hadoop-project/pom.xml and TestAccessControlList	Minor	.	Chen He	Brahma Reddy Battula
YARN-3382	Some of UserMetricsInfo metrics are incorrectly set to root queue metrics	Major	webapp	Rohit Agarwal	Rohit Agarwal
YARN-3472	Possible leak in DelegationTokenRenewer#allTokens	Major	.	Jian He	Rohith Sharma K S
YARN-3394	WebApplication proxy documentation is incomplete	Minor	resourcemanager	Bibin A Chundatt	Naganarasimha G R
HADOOP-11819	HttpServerFunctionalTest#prepareTestWebapp should create web app directory if it does not exist.	Minor	.	Rohith Sharma K S	Rohith Sharma K S
HDFS-6666	Abort NameNode and DataNode startup if security is enabled but block access token is not enabled.	Minor	datanode, namenode, security	Chris Nauroth	Vijay Bhat
HDFS-8055	NullPointerException when topology script is missing.	Major	namenode	Anu Engineer	Anu Engineer
YARN-3266	RMContext inactiveNodes should have NodeId as map key	Major	resourcemanager	Chengbing Liu	Chengbing Liu
YARN-3436	Fix URIs in documention of YARN web service REST APIs	Minor	documentation, resourcemanager	Bibin A Chundatt	Bibin A Chundatt
HDFS-8127	NameNode Failover during HA upgrade can cause DataNode to finalize upgrade	Blocker	ha	Jing Zhao	Jing Zhao
YARN-3462	Patches applied for YARN-2424 are inconsistent between trunk and branch-2	Major	.	Sidharta Seethana	Naganarasimha G R
HDFS-8151	Always use snapshot path as source when invalid snapshot names are used for diff based distcp	Minor	distcp	Sushmitha Sreenivasan	Jing Zhao
HDFS-7934	Update RollingUpgrade rollback documentation: should use bootstrapstandby for standby NN	Critical	documentation	J.Andreina	J.Andreina
HDFS-8149	The footer of the Web UI “Hadoop, 2014” is old	Major	.	Akira Ajisaka	Brahma Reddy Battula
HDFS-8142	DistributedFileSystem encryption zone commands should resolve relative paths	Major	.	Rakesh R	Rakesh R
MAPREDUCE-6300	Task list sort by task id broken	Minor	.	Siqi Li	Siqi Li
YARN-3021	YARN’s delegation-token handling disallows certain trust setups to operate properly over DistCp	Major	security	Harsh J	Yongjun Zhang
HDFS-8153	Error Message points to wrong parent directory in case of path component name length error	Major	namenode	Anu Engineer	Anu Engineer
YARN-3493	RM fails to come up with error “Failed to load/recover state” when mem settings are changed	Critical	yarn	Sumana Sathish	Jian He
HDFS-8043	NPE in MiniDFSCluster teardown	Major	test	Steve Loughran	Brahma Reddy Battula
HDFS-8173	NPE thrown at DataNode shutdown when HTTP server was not able to create	Minor	datanode	Archana T	Surendra Singh Lilhore
YARN-3497	ContainerManagementProtocolProxy modifies IPC timeout conf without making a copy	Major	client	Jason Lowe	Jason Lowe
MAPREDUCE-6238	MR2 can’t run local jobs with -libjars command options which is a regression from MR1	Critical	mrv2	zhihai xu	zhihai xu
HDFS-8179	DFSClient#getServerDefaults returns null within 1 hour of system start	Blocker	.	Xiaoyu Yao	Xiaoyu Yao
HDFS-7993	Provide each Replica details in fsck	Major	.	Ming Ma	J.Andreina
HDFS-8163	Using monotonicNow for block report scheduling causes test failures on recently restarted systems	Blocker	datanode	Arpit Agarwal	Arpit Agarwal
HADOOP-11704	DelegationTokenAuthenticationFilter must pass ipaddress instead of hostname to ProxyUsers#authorize()	Major	.	Anubhav Dhoot	Anubhav Dhoot
YARN-3495	Confusing log generated by FairScheduler	Major	.	Brahma Reddy Battula	Brahma Reddy Battula
MAPREDUCE-6293	Set job classloader on uber-job’s LocalContainerLauncher event thread	Major	mr-am	Sangjin Lee	Sangjin Lee
HADOOP-11846	TestCertificateUtil.testCorruptPEM failing on Jenkins JDK8	Major	build, security	Steve Loughran	Larry McCay
HADOOP-11859	PseudoAuthenticationHandler fails with httpcomponents v4.4	Major	.	Eugene Koifman	Eugene Koifman
MAPREDUCE-6330	Fix typo in Task Attempt API’s URL in documentations	Minor	documentation	Ryu Kobayashi	Ryu Kobayashi
HADOOP-11848	Incorrect arguments to sizeof in DomainSocket.c	Major	native	Malcolm Kavalsky	Malcolm Kavalsky
HADOOP-11868	Invalid user logins trigger large backtraces in server log	Major	.	Chang Li	Chang Li
HADOOP-11861	test-patch.sh rewrite addendum patch	Major	build	Anu Engineer	Allen Wittenauer
HADOOP-11864	JWTRedirectAuthenticationHandler breaks java8 javadocs	Major	build	Steve Loughran	Larry McCay
HDFS-4448	Allow HA NN to start in secure mode with wildcard address configured	Major	ha, namenode, security	Aaron T. Myers	Aaron T. Myers
YARN-3522	DistributedShell uses the wrong user to put timeline data	Blocker	timelineserver	Zhijie Shen	Zhijie Shen
HDFS-8147	Mover should not schedule two replicas to the same DN storage	Major	balancer & mover	Surendra Singh Lilhore	Surendra Singh Lilhore
HADOOP-11872	“hadoop dfs” command prints message about using “yarn jar” on Windows(branch-2 only)	Minor	scripts	Varun Vasudev	Varun Vasudev
HADOOP-11730	Regression: s3n read failure recovery broken	Major	fs/s3	Takenori Sato	Takenori Sato
YARN-3516	killing ContainerLocalizer action doesn’t take effect when private localizer receives FETCH_FAILURE status.	Minor	nodemanager	zhihai xu	zhihai xu
HADOOP-11802	DomainSocketWatcher thread terminates sometimes after there is an I/O error during requestShortCircuitShm	Major	.	Eric Payne	Colin P. McCabe
HDFS-8070	Pre-HDFS-7915 DFSClient cannot use short circuit on post-HDFS-7915 DataNode	Blocker	caching	Gopal V	Colin P. McCabe
HDFS-8217	During block recovery for truncate Log new Block Id in case of copy-on-truncate is true.	Major	datanode	Vinayakumar B	Vinayakumar B
HDFS-8231	StackTrace displayed at client while QuotaByStorageType exceeds	Major	hdfs-client	J.Andreina	J.Andreina
HDFS-8191	Fix byte to integer casting in SimulatedFSDataset#simulatedByte	Minor	.	Zhe Zhang	Zhe Zhang
YARN-3387	Previous AM’s container complete message couldn’t pass to current am if am restarted and rm changed	Critical	resourcemanager	sandflee	sandflee
HADOOP-11876	Refactor code to make it more readable, minor maybePrintStats bug	Trivial	tools/distcp	Zoran Dimitrijevic	Zoran Dimitrijevic
YARN-3444	Fix typo capabililty	Trivial	applications/distributed-shell	Gabor Liptak	Gabor Liptak
YARN-3537	NPE when NodeManager.serviceInit fails and stopRecoveryStore invoked	Major	nodemanager	Brahma Reddy Battula	Brahma Reddy Battula
HDFS-8211	DataNode UUID is always null in the JMX counter	Major	datanode	Anu Engineer	Anu Engineer
MAPREDUCE-6333	TestEvents,TestAMWebServicesTasks,TestAppController are broken due to MAPREDUCE-6297	Major	.	Siqi Li	Siqi Li
HDFS-8206	Fix the typos in hadoop-hdfs-httpfs	Major	.	Brahma Reddy Battula	Brahma Reddy Battula
YARN-3464	Race condition in LocalizerRunner kills localizer before localizing all resources	Critical	nodemanager	zhihai xu	zhihai xu
MAPREDUCE-6252	JobHistoryServer should not fail when encountering a missing directory	Major	jobhistoryserver	Craig Welch	Craig Welch
YARN-3530	ATS throws exception on trying to filter results without otherinfo.	Critical	timelineserver	Sreenath Somarajapuram	Zhijie Shen
HDFS-8205	CommandFormat#parse() should not parse option as value of option	Blocker	.	Peter Shi	Peter Shi
HADOOP-11870	[JDK8] AuthenticationFilter, CertificateUtil, SignerSecretProviders, KeyAuthorizationKeyProvider Javadoc issues	Major	build	Robert Kanter	Robert Kanter
MAPREDUCE-6324	Uber jobs fail to update AMRM token when it rolls over	Blocker	mr-am	Jason Lowe	Jason Lowe
HDFS-8232	Missing datanode counters when using Metrics2 sink interface	Major	datanode	Anu Engineer	Anu Engineer
MAPREDUCE-6334	Fetcher#copyMapOutput is leaking usedMemory upon IOException during InMemoryMapOutput shuffle handler	Blocker	.	Eric Payne	Eric Payne
HDFS-8273	FSNamesystem#Delete() should not call logSync() when holding the lock	Blocker	namenode	Jing Zhao	Haohui Mai
YARN-3485	FairScheduler headroom calculation doesn’t consider maxResources for Fifo and FairShare policies	Critical	fairscheduler	Karthik Kambatla	Karthik Kambatla
HDFS-8269	getBlockLocations() does not resolve the .reserved path and generates incorrect edit logs when updating the atime	Blocker	.	Yesha Vora	Haohui Mai
YARN-3517	RM web ui for dumping scheduler logs should be for admins only	Blocker	resourcemanager, security	Varun Vasudev	Varun Vasudev
HDFS-8214	Secondary NN Web UI shows wrong date for Last Checkpoint	Major	namenode	Charles Lamb	Charles Lamb
YARN-3533	Test: Fix launchAM in MockRM to wait for attempt to be scheduled	Major	yarn	Anubhav Dhoot	Anubhav Dhoot
MAPREDUCE-6339	Job history file is not flushed correctly because isTimerActive flag is not set true when flushTimerTask is scheduled.	Critical	mrv2	zhihai xu	zhihai xu
HADOOP-11821	Fix findbugs warnings in hadoop-sls	Major	tools	Akira Ajisaka	Brahma Reddy Battula
YARN-3564	Fix TestContainerAllocation.testAMContainerAllocationWhenDNSUnavailable fails randomly	Major	.	Jian He	Jian He
HADOOP-11891	OsSecureRandom should lazily fill its reservoir	Major	security	Arun Suresh	Arun Suresh
HADOOP-11866	increase readability and reliability of checkstyle, shellcheck, and whitespace reports	Minor	.	Naganarasimha G R	Allen Wittenauer
HDFS-8292	Move conditional in fmt_time from dfs-dust.js to status.html	Minor	namenode	Charles Lamb	Charles Lamb
HDFS-8300	Fix unit test failures and findbugs warning caused by HDFS-8283	Major	.	Jing Zhao	Jing Zhao
HDFS-8276	LazyPersistFileScrubber should be disabled if scrubber interval configured zero	Major	namenode	Surendra Singh Lilhore	Surendra Singh Lilhore
HADOOP-11889	Make checkstyle runnable from root project	Major	build, test	Gera Shegalov	Gera Shegalov
HDFS-8213	DFSClient should use hdfs.client.htrace HTrace configuration prefix rather than hadoop.htrace	Critical	.	Billie Rinaldi	Colin P. McCabe
HDFS-8229	LAZY_PERSIST file gets deleted after NameNode restart.	Major	namenode	Surendra Singh Lilhore	Surendra Singh Lilhore
YARN-2893	AMLaucher: sporadic job failures due to EOFException in readTokenStorageStream	Major	resourcemanager	Gera Shegalov	zhihai xu
HADOOP-11491	HarFs incorrectly declared as requiring an authority	Critical	fs	Gera Shegalov	Brahma Reddy Battula
HADOOP-11900	Add failIfNoTests=false to hadoop-build-tools pom	Major	test	Gera Shegalov	Gera Shegalov
MAPREDUCE-6345	Documentation fix for when CRLA is enabled for MRAppMaster logs	Trivial	documentation	Rohit Agarwal	Rohit Agarwal
YARN-2454	Fix compareTo of variable UNBOUNDED in o.a.h.y.util.resource.Resources.	Major	.	Xu Yang	Xu Yang
YARN-1993	Cross-site scripting vulnerability in TextView.java	Major	webapp	Ted Yu	Kenji Kikushima
MAPREDUCE-5905	CountersStrings.toEscapedCompactStrings outputs unnecessary “null” strings	Minor	.	Akira Ajisaka	Akira Ajisaka
MAPREDUCE-6349	Fix typo in property org.apache.hadoop.mapreduce.lib.chain.Chain.REDUCER_INPUT_VALUE_CLASS	Minor	.	Ray Chiang	Ray Chiang
HADOOP-9658	SnappyCodec#checkNativeCodeLoaded may unexpectedly fail when native code is not loaded	Major	.	Zhijie Shen	Zhijie Shen
YARN-3097	Logging of resource recovery on NM restart has redundancies	Minor	nodemanager	Jason Lowe	Eric Payne
HDFS-8290	WebHDFS calls before namesystem initialization can cause NullPointerException.	Minor	webhdfs	Chris Nauroth	Chris Nauroth
MAPREDUCE-5649	Reduce cannot use more than 2G memory for the final merge	Major	mrv2	stanley shi	Gera Shegalov
MAPREDUCE-6259	IllegalArgumentException due to missing job submit time	Major	jobhistoryserver	zhihai xu	zhihai xu
YARN-3375	NodeHealthScriptRunner.shouldRun() check is performing 3 times for starting NodeHealthScriptRunner	Minor	nodemanager	Devaraj K	Devaraj K
YARN-2725	Adding test cases of retrying requests about ZKRMStateStore	Major	.	Tsuyoshi Ozawa	Tsuyoshi Ozawa
MAPREDUCE-6165	[JDK8] TestCombineFileInputFormat failed on JDK8	Minor	.	Wei Yan	Akira Ajisaka
HADOOP-11328	ZKFailoverController does not log Exception when doRun raises errors	Major	ha	Tianyin Xu	Tianyin Xu
HADOOP-11916	TestStringUtils#testLowerAndUpperStrings failed on MAC due to a JVM bug	Minor	.	Ming Ma	Ming Ma
YARN-3552	RM Web UI shows -1 running containers for completed apps	Trivial	webapp	Rohith Sharma K S	Rohith Sharma K S
HADOOP-11120	hadoop fs -rmr gives wrong advice	Major	.	Allen Wittenauer	Juliet Hougland
YARN-3396	Handle URISyntaxException in ResourceLocalizationService	Major	nodemanager	Chengbing Liu	Brahma Reddy Battula
YARN-2123	Progress bars in Web UI always at 100% due to non-US locale	Major	webapp	Johannes Simon	Akira Ajisaka
HDFS-8305	HDFS INotify: the destination field of RenameOp should always end with the file name	Major	.	Colin P. McCabe	Colin P. McCabe
HADOOP-11917	test-patch.sh should work with ${BASEDIR}/patchprocess setups	Blocker	.	Allen Wittenauer	Allen Wittenauer
HDFS-7847	Modify NNThroughputBenchmark to be able to operate on a remote NameNode	Major	.	Colin P. McCabe	Charles Lamb
HDFS-8219	setStoragePolicy with folder behavior is different after cluster restart	Major	.	Peter Shi	Surendra Singh Lilhore
HADOOP-11898	add nfs3 and portmap starting command in hadoop-daemon.sh in branch-2	Minor	bin, nfs	Brandon Li	Brandon Li
HADOOP-11926	test-patch.sh mv does wrong math	Major	.	Allen Wittenauer	Allen Wittenauer
HADOOP-11912	Extra configuration key used in TraceUtils should respect prefix	Minor	.	Masatake Iwasaki	Masatake Iwasaki
YARN-3582	NPE in WebAppProxyServlet	Major	.	Jian He	Jian He
HDFS-2484	checkLease should throw FileNotFoundException when file does not exist	Major	namenode	Konstantin Shvachko	Rakesh R
YARN-3385	Race condition: KeeperException$NoNodeException will cause RM shutdown during ZK node deletion.	Critical	resourcemanager	zhihai xu	zhihai xu
HDFS-7833	DataNode reconfiguration does not recalculate valid volumes required, based on configured failed volumes tolerated.	Major	datanode	Chris Nauroth	Lei (Eddy) Xu
YARN-3577	Misspelling of threshold in log4j.properties for tests	Minor	test	Brahma Reddy Battula	Brahma Reddy Battula
HDFS-8325	Misspelling of threshold in log4j.properties for tests	Minor	test	Brahma Reddy Battula	Brahma Reddy Battula
HADOOP-10387	Misspelling of threshold in log4j.properties for tests in hadoop-common-project	Minor	conf, test	Kenji Kikushima	Brahma Reddy Battula
MAPREDUCE-6356	Misspelling of threshold in log4j.properties for tests	Minor	test	Brahma Reddy Battula	Brahma Reddy Battula
YARN-3523	Cleanup ResourceManagerAdministrationProtocol interface audience	Major	client, resourcemanager	Wangda Tan	Naganarasimha G R
HDFS-7980	Incremental BlockReport will dramatically slow down the startup of a namenode	Major	.	Hui Zheng	Walter Su
HADOOP-11936	Dockerfile references a removed image	Major	.	Allen Wittenauer	Allen Wittenauer
YARN-3584	[Log mesage correction] : MIssing space in Diagnostics message	Trivial	.	nijel	nijel
HDFS-8321	CacheDirectives and CachePool operations should throw RetriableException in safemode	Major	.	Haohui Mai	Haohui Mai
HDFS-8037	CheckAccess in WebHDFS silently accepts malformed FsActions parameters	Minor	webhdfs	Jake Low	Walter Su
YARN-1832	Fix wrong MockLocalizerStatus#equals implementation	Minor	nodemanager	Hong Zhiguo	Hong Zhiguo
YARN-3572	Correct typos in WritingYarnApplications.md	Minor	documentation	Sandeep Khurana	Gabor Liptak
HADOOP-11922	Misspelling of threshold in log4j.properties for tests in hadoop-tools	Minor	.	Brahma Reddy Battula	Gabor Liptak
HDFS-8257	Namenode rollingUpgrade option is incorrect in document	Major	documentation	J.Andreina	J.Andreina
HDFS-8067	haadmin prints out stale help messages	Minor	hdfs-client	Ajith S	Ajith S
YARN-3592	Fix typos in RMNodeLabelsManager	Trivial	resourcemanager	Junping Du	Sunil Govindan
HDFS-8174	Update replication count to live rep count in fsck report	Minor	.	J.Andreina	J.Andreina
HDFS-6291	FSImage may be left unclosed in BootstrapStandby#doRun()	Minor	ha	Ted Yu	Sanghyun Yun
YARN-3358	Audit log not present while refreshing Service ACLs	Minor	resourcemanager	Varun Saxena	Varun Saxena
YARN-3589	RM and AH web UI display DOCTYPE wrongly	Major	webapp	Rohith Sharma K S	Rohith Sharma K S
HDFS-7998	HDFS Federation : Command mentioned to add a NN to existing federated cluster is wrong	Minor	documentation	Ajith S	Ajith S
HDFS-8222	Remove usage of "dfsadmin -upgradeProgress " from document which is no longer supported	Major	documentation	J.Andreina	J.Andreina
HDFS-8187	Remove usage of “-setStoragePolicy” and “-getStoragePolicy” using dfsadmin cmd (as it is not been supported)	Major	documentation	J.Andreina	J.Andreina
HDFS-8175	Provide information on snapshotDiff for supporting the comparison between snapshot and current status	Major	documentation	J.Andreina	J.Andreina
MAPREDUCE-6342	Make POM project names consistent	Minor	build	Rohith Sharma K S	Rohith Sharma K S
HDFS-6576	Datanode log is generating at root directory in security mode	Minor	datanode, scripts	Surendra Singh Lilhore	Surendra Singh Lilhore
HADOOP-11877	SnappyDecompressor’s Logger class name is wrong	Major	conf	Surendra Singh Lilhore	Surendra Singh Lilhore
HDFS-3384	DataStreamer thread should be closed immediatly when failed to setup a PipelineForAppendOrRecovery	Major	hdfs-client	Brahma Reddy Battula	Uma Maheswara Rao G
YARN-3554	Default value for maximum nodemanager connect wait time is too high	Major	.	Jason Lowe	Naganarasimha G R
HDFS-7894	Rolling upgrade readiness is not updated in jmx until query command is issued.	Critical	.	Kihwal Lee	Brahma Reddy Battula
YARN-3600	AM container link is broken (on a killed application, at least)	Major	.	Sergey Shelukhin	Naganarasimha G R
HDFS-8346	libwebhdfs build fails during link due to unresolved external symbols.	Major	native	Chris Nauroth	Chris Nauroth
HDFS-8274	NFS configuration nfs.dump.dir not working	Major	nfs	Ajith S	Ajith S
HDFS-8340	Fix NFS documentation of nfs.wtmax	Minor	documentation, nfs	Ajith S	Ajith S
HADOOP-10356	Corrections in winutils/chmod.c	Trivial	bin	René Nyffenegger	René Nyffenegger
HADOOP-7165	listLocatedStatus(path, filter) is not redefined in FilterFs	Major	fs	Hairong Kuang	Hairong Kuang
MAPREDUCE-3383	Duplicate job.getOutputValueGroupingComparator() in ReduceTask	Major	.	Binglin Chang	Binglin Chang
HDFS-8311	DataStreamer.transfer() should timeout the socket InputStream.	Major	hdfs-client	Esteban Gutierrez	Esteban Gutierrez
HDFS-8113	Add check for null BlockCollection pointers in BlockInfoContiguous structures	Major	namenode	Chengbing Liu	Chengbing Liu
HADOOP-9729	The example code of org.apache.hadoop.util.Tool is incorrect	Major	util	hellojinjie	hellojinjie
MAPREDUCE-2094	LineRecordReader should not seek into non-splittable, compressed streams.	Major	task	Niels Basjes	Niels Basjes
HDFS-8245	Standby namenode doesn’t process DELETED_BLOCK if the add block request is in edit log.	Major	.	Rushabh S Shah	Rushabh S Shah
YARN-3018	Unify the default value for yarn.scheduler.capacity.node-locality-delay in code and default xml file	Trivial	capacityscheduler	nijel	nijel
HDFS-8326	Documentation about when checkpoints are run is out of date	Major	documentation	Misty Linville	Misty Linville
YARN-3604	removeApplication in ZKRMStateStore should also disable watch.	Minor	resourcemanager	zhihai xu	zhihai xu
YARN-3476	Nodemanager can fail to delete local logs if log aggregation fails	Major	log-aggregation, nodemanager	Jason Lowe	Rohith Sharma K S
YARN-3473	Fix RM Web UI configuration for some properties	Minor	resourcemanager	Ray Chiang	Ray Chiang
HDFS-8097	TestFileTruncate is failing intermittently	Major	test	Rakesh R	Rakesh R
YARN-1912	ResourceLocalizer started without any jvm memory control	Major	nodemanager	stanley shi	Masatake Iwasaki
MAPREDUCE-6359	RM HA setup, “Cluster” tab links populated with AM hostname instead of RM	Minor	.	Aroop Maliakkal	yunjiong zhao
MAPREDUCE-6353	Divide by zero error in MR AM when calculating available containers	Major	mr-am	Anubhav Dhoot	Anubhav Dhoot
YARN-3395	FairScheduler: Trim whitespaces when using username for queuename	Major	fairscheduler	zhihai xu	zhihai xu
HDFS-8351	Remove namenode -finalize option from document	Major	documentation	Akira Ajisaka	Akira Ajisaka
YARN-3587	Fix the javadoc of DelegationTokenSecretManager in projects of yarn, etc.	Minor	documentation	Akira Ajisaka	Gabor Liptak
HADOOP-11663	Remove description about Java 6 from docs	Minor	documentation	Masatake Iwasaki	Masatake Iwasaki
HADOOP-11928	Test-patch check for @author tags incorrectly flags removal of @author tags	Major	.	Sean Busbey	Kengo Seki
HADOOP-11951	test-patch should give better info about failures to handle dev-support updates without resetrepo option	Minor	.	Sean Busbey	Sean Busbey
HADOOP-11947	test-patch should return early from determine-issue when run in jenkins mode.	Minor	.	Sean Busbey	Sean Busbey
HDFS-7916	‘reportBadBlocks’ from datanodes to standby Node BPServiceActor goes for infinite loop	Critical	datanode	Vinayakumar B	Rushabh S Shah
YARN-3434	Interaction between reservations and userlimit can result in significant ULF violation	Major	capacityscheduler	Thomas Graves	Thomas Graves
HDFS-8362	Java Compilation Error in TestHdfsConfigFields.java	Major	.	Mohammad Arshad	Mohammad Arshad
MAPREDUCE-6360	TestMapreduceConfigFields is placed in wrong dir, introducing compile error	Major	.	Vinayakumar B	Mohammad Arshad
MAPREDUCE-6361	NPE issue in shuffle caused by concurrent issue between copySucceeded() in one thread and copyFailed() in another thread on the same host	Critical	.	Junping Du	Junping Du
YARN-3629	NodeID is always printed as “null” in node manager initialization log.	Major	.	nijel	nijel
MAPREDUCE-6251	JobClient needs additional retries at a higher level to address not-immediately-consistent dfs corner cases	Major	jobhistoryserver, mrv2	Craig Welch	Craig Welch
MAPREDUCE-6366	mapreduce.terasort.final.sync configuration in TeraSort doesn’t work	Trivial	examples	Takuya Fukudome	Takuya Fukudome
HDFS-6300	Prevent multiple balancers from running simultaneously	Critical	balancer & mover	Rakesh R	Rakesh R
HDFS-8358	TestTraceAdmin fails	Major	.	Kihwal Lee	Masatake Iwasaki
HADOOP-11966	Variable cygwin is undefined in hadoop-config.sh when executed through hadoop-daemon.sh.	Critical	scripts	Chris Nauroth	Chris Nauroth
HDFS-8380	Always call addStoredBlock on blocks which have been shifted from one storage to another	Major	.	Colin P. McCabe	Colin P. McCabe
HADOOP-8174	Remove confusing comment in Path#isAbsolute()	Trivial	fs	Suresh Srinivas	Suresh Srinivas
HDFS-8150	Make getFileChecksum fail for blocks under construction	Critical	.	Kihwal Lee	J.Andreina
MAPREDUCE-5708	Duplicate String.format in YarnOutputFiles.getSpillFileForWrite	Minor	.	Konstantin Weitz	Konstantin Weitz
YARN-1519	check if sysconf is implemented before using it	Major	nodemanager	Radim Kolar	Radim Kolar
HDFS-8371	Fix test failure in TestHdfsConfigFields for spanreceiver properties	Major	.	Ray Chiang	Ray Chiang
MAPREDUCE-6273	HistoryFileManager should check whether summaryFile exists to avoid FileNotFoundException causing HistoryFileInfo into MOVE_FAILED state	Minor	jobhistoryserver	zhihai xu	zhihai xu
YARN-2421	RM still allocates containers to an app in the FINISHING state	Major	scheduler	Thomas Graves	Chang Li
YARN-3526	ApplicationMaster tracking URL is incorrectly redirected on a QJM cluster	Major	resourcemanager, webapp	Weiwei Yang	Weiwei Yang
HADOOP-11988	Fix typo in the document for hadoop fs -find	Trivial	documentation	Akira Ajisaka	Kengo Seki
HADOOP-10582	Fix the test case for copying to non-existent dir in TestFsShellCopy	Minor	fs	Kousuke Saruta	Kousuke Saruta
HDFS-8345	Storage policy APIs must be exposed via the FileSystem interface	Major	hdfs-client	Arpit Agarwal	Arpit Agarwal
HDFS-8405	Fix a typo in NamenodeFsck	Minor	namenode	Tsz Wo Nicholas Sze	Takanobu Asanuma
HDFS-6348	SecondaryNameNode not terminating properly on runtime exceptions	Major	namenode	Rakesh R	Rakesh R
YARN-3601	Fix UT TestRMFailover.testRMWebAppRedirect	Critical	resourcemanager, webapp	Weiwei Yang	Weiwei Yang
HDFS-8404	Pending block replication can get stuck using older genstamp	Major	namenode	Nathan Roberts	Nathan Roberts
HADOOP-11973	Ensure ZkDelegationTokenSecretManager namespace znodes get created with ACLs	Major	security	Gregory Chanan	Gregory Chanan
HADOOP-11963	Metrics documentation for FSNamesystem misspells PendingDataNodeMessageCount.	Trivial	documentation	Chris Nauroth	Anu Engineer
YARN-2821	Distributed shell app master becomes unresponsive sometimes	Major	applications/distributed-shell	Varun Vasudev	Varun Vasudev
YARN-3677	Fix findbugs warnings in yarn-server-resourcemanager	Minor	resourcemanager	Akira Ajisaka	Vinod Kumar Vavilapalli
YARN-3681	yarn cmd says “could not find main class ‘queue’” in windows	Blocker	yarn	Sumana Sathish	Varun Saxena
YARN-3654	ContainerLogsPage web UI should not have meta-refresh	Major	yarn	Xuan Gong	Xuan Gong
YARN-3694	Fix dead link for TimelineServer REST API	Minor	documentation	Akira Ajisaka	Jagadesh Kiran N
YARN-3646	Applications are getting stuck some times in case of retry policy forever	Major	client	Raju Bairishetti	Raju Bairishetti
HDFS-8421	Move startFile() and related operations into FSDirWriteFileOp	Major	.	Haohui Mai	Haohui Mai
HDFS-8451	DFSClient probe for encryption testing interprets empty URI property for “enabled”	Blocker	encryption	Steve Loughran	Steve Loughran
YARN-3675	FairScheduler: RM quits when node removal races with continousscheduling on the same node	Critical	fairscheduler	Anubhav Dhoot	Anubhav Dhoot
HADOOP-12014	hadoop-config.cmd displays a wrong error message	Minor	scripts	Kengo Seki	Kengo Seki
HADOOP-11955	Fix a typo in the cluster setup doc	Trivial	.	Kihwal Lee	Yanjun Wang
HDFS-8268	Port conflict log for data node server is not sufficient	Minor	datanode	Mohammad Shahid Khan	Mohammad Shahid Khan
YARN-3594	WintuilsProcessStubExecutor.startStreamReader leaks streams	Trivial	nodemanager	Steve Loughran	Lars Francke
HADOOP-11743	maven doesn’t clean all the site files	Minor	documentation	Allen Wittenauer	ramtin
HADOOP-11927	Fix “undefined reference to dlopen” error when compiling libhadooppipes	Major	build, native, tools	Xianyin Xin	Xianyin Xin
YARN-3701	Isolating the error of generating a single app report when getting all apps from generic history service	Blocker	timelineserver	Zhijie Shen	Zhijie Shen
YARN-3707	RM Web UI queue filter doesn’t work	Blocker	.	Wangda Tan	Wangda Tan
YARN-2238	filtering on UI sticks even if I move away from the page	Major	webapp	Sangjin Lee	Jian He
HADOOP-8751	NPE in Token.toString() when Token is constructed using null identifier	Minor	security	Vlad Rozov	Kanaka Kumar Avvaru
HADOOP-11969	ThreadLocal initialization in several classes is not thread safe	Critical	io	Sean Busbey	Sean Busbey
YARN-3626	On Windows localized resources are not moved to the front of the classpath when they should be	Major	yarn	Craig Welch	Craig Welch
HADOOP-9891	CLIMiniCluster instructions fail with MiniYarnCluster ClassNotFoundException	Minor	documentation	Steve Loughran	Darrell Taylor
HDFS-8431	hdfs crypto class not found in Windows	Critical	scripts	Sumana Sathish	Anu Engineer
HADOOP-12004	test-patch breaks with reexec in certain situations	Critical	.	Allen Wittenauer	Sean Busbey
YARN-3723	Need to clearly document primaryFilter and otherInfo value type	Critical	timelineserver	Zhijie Shen	Zhijie Shen
HDFS-8407	libhdfs hdfsListDirectory must set errno to 0 on success	Major	native	Juan Yu	Masatake Iwasaki
HDFS-8429	Avoid stuck threads if there is an error in DomainSocketWatcher that stops the thread	Major	.	zhouyingchao	zhouyingchao
HADOOP-11959	WASB should configure client side socket timeout in storage client blob request options	Major	tools	Ivan Mitic	Ivan Mitic
HADOOP-11934	Use of JavaKeyStoreProvider in LdapGroupsMapping causes infinite loop	Blocker	security	Mike Yoder	Larry McCay
HDFS-7401	Add block info to DFSInputStream’ WARN message when it adds node to deadNodes	Minor	.	Ming Ma	Mohammad Arshad
HADOOP-12042	Users may see TrashPolicy if hdfs dfs -rm is run	Major	.	Allen Wittenauer	J.Andreina
HDFS-7609	Avoid retry cache collision when Standby NameNode loading edits	Critical	namenode	Carrey Zhan	Ming Ma
HADOOP-11885	hadoop-dist dist-layout-stitching.sh does not work with dash	Major	build	Andrew Wang	Andrew Wang
YARN-3725	App submission via REST API is broken in secure mode due to Timeline DT service address is empty	Blocker	resourcemanager, timelineserver	Zhijie Shen	Zhijie Shen
HADOOP-12037	Fix wrong classname in example configuration of hadoop-auth documentation	Trivial	documentation	Masatake Iwasaki	Masatake Iwasaki
HDFS-8256	fsck "-storagepolicies , -blockId ,-replicaDetails " options are missed out in usage and from documentation	Major	documentation	J.Andreina	J.Andreina
HDFS-8486	DN startup may cause severe data loss	Blocker	datanode	Daryn Sharp	Daryn Sharp
HDFS-8386	Improve synchronization of ‘streamer’ reference in DFSOutputStream	Major	hdfs-client	Rakesh R	Rakesh R
HDFS-8513	Rename BlockPlacementPolicyRackFaultTolarent to BlockPlacementPolicyRackFaultTolerant	Minor	namenode	Andrew Wang	Andrew Wang
HADOOP-11991	test-patch.sh isn’t re-executed even if smart-apply-patch.sh is modified	Major	test	Kengo Seki	Kengo Seki
HDFS-8270	create() always retried with hardcoded timeout when file already exists with open lease	Major	hdfs-client	Andrey Stepachev	J.Andreina
HDFS-8470	fsimage loading progress should update inode, delegation token and cache pool count.	Minor	namenode	tongshiquan	Surendra Singh Lilhore
HDFS-8523	Remove usage information on unsupported operation “fsck -showprogress” from branch-2	Major	documentation	J.Andreina	J.Andreina
HDFS-3716	Purger should remove stale fsimage ckpt files	Minor	namenode	suja s	J.Andreina
YARN-3751	TestAHSWebServices fails after YARN-3467	Major	.	Zhijie Shen	Sunil Govindan
YARN-3585	NodeManager cannot exit on SHUTDOWN event triggered and NM recovery is enabled	Critical	.	Peng Zhang	Rohith Sharma K S
MAPREDUCE-6374	Distributed Cache File visibility should check permission of full path	Major	.	Chang Li	Chang Li
YARN-3762	FairScheduler: CME on FSParentQueue#getQueueUserAclInfo	Critical	fairscheduler	Karthik Kambatla	Karthik Kambatla
YARN-3749	We should make a copy of configuration when init MiniYARNCluster with multiple RMs	Major	.	Chun Chen	Chun Chen
MAPREDUCE-5965	Hadoop streaming throws error if list of input files is high. Error is: “error=7, Argument list too long at if number of input file is high”	Major	.	Arup Malakar	Wilfred Spiegelenburg
HADOOP-12018	smart-apply-patch.sh fails if the patch edits CR+LF files and is created by ‘git diff –no-prefix’	Minor	build	Akira Ajisaka	Kengo Seki
HADOOP-12019	update BUILDING.txt to include python for ‘mvn site’ in windows	Major	.	Vinayakumar B	Vinayakumar B
MAPREDUCE-6382	Don’t escape HTML links in Diagnostics in JHS job overview	Major	.	Siqi Li	Siqi Li
HADOOP-12058	Fix dead links to DistCp and Hadoop Archives pages.	Minor	documentation, site	Kazuho Fujii	Kazuho Fujii
HDFS-8463	Calling DFSInputStream.seekToNewSource just after stream creation causes NullPointerException	Minor	.	Masatake Iwasaki	Masatake Iwasaki
YARN-3764	CapacityScheduler should forbid moving LeafQueue from one parent to another	Blocker	.	Wangda Tan	Wangda Tan
HADOOP-11994	smart-apply-patch wrongly assumes that git is infallible	Major	test	Allen Wittenauer	Kengo Seki
HADOOP-11924	Tolerate JDK-8047340-related exceptions in Shell#isSetSidAvailable preventing class init	Major	.	Gera Shegalov	Tsuyoshi Ozawa
YARN-3733	Fix DominantRC#compare() does not work as expected if cluster resource is empty	Blocker	resourcemanager	Bibin A Chundatt	Rohith Sharma K S
MAPREDUCE-6377	JHS sorting on state column not working in webUi	Minor	jobhistoryserver	Bibin A Chundatt	zhihai xu
MAPREDUCE-6387	Serialize the recently added Task#encryptedSpillKey field at the end	Minor	.	Arun Suresh	Arun Suresh
HADOOP-12056	Use DirectoryStream in DiskChecker#checkDirs to detect errors when listing a directory	Major	util	zhihai xu	zhihai xu
HDFS-8522	Change heavily recorded NN logs from INFO to DEBUG level	Major	namenode	Xiaoyu Yao	Xiaoyu Yao
YARN-3655	FairScheduler: potential livelock due to maxAMShare limitation and container reservation	Critical	fairscheduler	zhihai xu	zhihai xu
HDFS-8539	Hdfs doesnt have class ‘debug’ in windows	Major	scripts	Sumana Sathish	Anu Engineer
YARN-3780	Should use equals when compare Resource in RMNodeImpl#ReconnectNodeTransition	Minor	resourcemanager	zhihai xu	zhihai xu
YARN-3747	TestLocalDirsHandlerService should delete the created test directory logDir2	Minor	test	David Moore	David Moore
HDFS-8554	TestDatanodeLayoutUpgrade fails on Windows.	Major	test	Chris Nauroth	Chris Nauroth
YARN-3778	Fix Yarn resourcemanger CLI usage	Major	.	Brahma Reddy Battula	Brahma Reddy Battula
HADOOP-12054	RPC client should not retry for InvalidToken exceptions	Critical	ipc	Daryn Sharp	Varun Saxena
HDFS-8552	Fix hdfs CLI usage message for namenode and zkfc	Major	.	Xiaoyu Yao	Brahma Reddy Battula
HADOOP-12073	Azure FileSystem PageBlobInputStream does not return -1 on EOF	Major	tools	Ivan Mitic	Ivan Mitic
HDFS-8568	TestClusterId#testFormatWithEmptyClusterIdOption is failing	Major	.	Rakesh R	Rakesh R
HADOOP-7817	RawLocalFileSystem.append() should give FSDataOutputStream with accurate .getPos()	Major	fs	Kristofer Tomasette	Kanaka Kumar Avvaru
MAPREDUCE-6350	JobHistory doesn’t support fully-functional search	Critical	jobhistoryserver	Siqi Li	Siqi Li
MAPREDUCE-6389	Fix BaileyBorweinPlouffe CLI usage message	Trivial	.	Brahma Reddy Battula	Brahma Reddy Battula
HADOOP-12052	IPC client downgrades all exception types to IOE, breaks callers trying to use them	Critical	.	Steve Loughran	Brahma Reddy Battula
YARN-3785	Support for Resource as an argument during submitApp call in MockRM test class	Minor	resourcemanager	Sunil Govindan	Sunil Govindan
HADOOP-12074	in Shell.java#runCommand() rethrow InterruptedException as InterruptedIOException	Minor	.	Lavkesh Lahngir	Lavkesh Lahngir
HDFS-8566	HDFS documentation about debug commands wrongly identifies them as “hdfs dfs” commands	Major	documentation	Surendra Singh Lilhore	Surendra Singh Lilhore
HDFS-8583	Document that NFS gateway does not work with rpcbind on SLES 11	Major	documentation	Arpit Agarwal	Arpit Agarwal
HDFS-8572	DN always uses HTTP/localhost@REALM principals in SPNEGO	Blocker	.	Haohui Mai	Haohui Mai
YARN-3794	TestRMEmbeddedElector fails because of ambiguous LOG reference	Major	test	Chengbing Liu	Chengbing Liu
HDFS-8593	Calculation of effective layout version mishandles comparison to current layout version in storage.	Major	namenode	Chris Nauroth	Chris Nauroth
HDFS-8596	TestDistributedFileSystem et al tests are broken in branch-2 due to incorrect setting of “datanode” attribute	Blocker	datanode	Yongjun Zhang	Yongjun Zhang
HDFS-8595	TestCommitBlockSynchronization fails in branch-2.7	Major	test	Arpit Agarwal	Arpit Agarwal
HDFS-8607	TestFileCorruption doesn’t work as expected	Major	test	Walter Su	Walter Su
HADOOP-12001	Limiting LDAP search conflicts with posixGroup addition	Blocker	security	Patrick White	Patrick White
HADOOP-12078	The default retry policy does not handle RetriableException correctly	Critical	ipc	Arpit Agarwal	Arpit Agarwal
HDFS-8576	Lease recovery should return true if the lease can be released and the file can be closed	Major	namenode	J.Andreina	J.Andreina
HDFS-8592	SafeModeException never get unwrapped	Major	.	Haohui Mai	Haohui Mai
HADOOP-12095	org.apache.hadoop.fs.shell.TestCount fails	Major	test	Brahma Reddy Battula	Brahma Reddy Battula
HDFS-4660	Block corruption can happen during pipeline recovery	Blocker	datanode	Peng Zhang	Kihwal Lee
HDFS-8548	Minicluster throws NPE on shutdown	Major	.	Mike Drob	Surendra Singh Lilhore
YARN-3714	AM proxy filter can not get RM webapp address from yarn.resourcemanager.hostname.rm-id	Minor	.	Masatake Iwasaki	Masatake Iwasaki
HDFS-8551	Fix hdfs datanode CLI usage message	Major	.	Xiaoyu Yao	Brahma Reddy Battula
HADOOP-12076	Incomplete Cache Mechanism in CredentialProvider API	Major	security	Larry McCay	Larry McCay
YARN-3617	Fix WindowsResourceCalculatorPlugin.getCpuFrequency() returning always -1	Minor	.	Georg Berendt	J.Andreina
YARN-3804	Both RM are on standBy state when kerberos user not in yarn.admin.acl	Critical	resourcemanager	Bibin A Chundatt	Varun Saxena
HDFS-8446	Separate safemode related operations in GetBlockLocations()	Minor	.	Haohui Mai	Haohui Mai
HDFS-8615	Correct HTTP method in WebHDFS document	Major	documentation	Akira Ajisaka	Brahma Reddy Battula
MAPREDUCE-6373	The logger reports total input paths but it is referring to input files	Trivial	.	Andi Chirita Amdocs	Bibin A Chundatt
YARN-3824	Fix two minor nits in member variable properties of YarnConfiguration	Trivial	yarn	Ray Chiang	Ray Chiang
HADOOP-12100	ImmutableFsPermission should not override applyUmask since that method doesn’t modify the FsPermission	Major	.	Robert Kanter	Bibin A Chundatt
YARN-3802	Two RMNodes for the same NodeId are used in RM sometimes after NM is reconnected.	Major	resourcemanager	zhihai xu	zhihai xu
HDFS-8633	Fix setting of dfs.datanode.readahead.bytes in hdfs-default.xml to match DFSConfigKeys	Minor	datanode	Ray Chiang	Ray Chiang
HDFS-8626	Reserved RBW space is not released if creation of RBW File fails	Blocker	.	Kanaka Kumar Avvaru	Kanaka Kumar Avvaru
MAPREDUCE-6405	NullPointerException in App Attempts page	Major	.	Siqi Li	Siqi Li
HADOOP-12103	Small refactoring of DelegationTokenAuthenticationFilter to allow code sharing	Minor	security	Yongjun Zhang	Yongjun Zhang
HDFS-8337	Accessing httpfs via webhdfs doesn’t work from a jar with kerberos	Major	security, webhdfs	Yongjun Zhang	Yongjun Zhang
MAPREDUCE-6403	Fix typo in the usage of NNBench	Trivial	documentation	Akira Ajisaka	Jagadesh Kiran N
HDFS-8480	Fix performance and timeout issues in HDFS-7929 by using hard-links to preserve old edit logs instead of copying them	Critical	.	Zhe Zhang	Zhe Zhang
MAPREDUCE-5948	org.apache.hadoop.mapred.LineRecordReader does not handle multibyte record delimiters well	Critical	.	Kris Geusebroek	Akira Ajisaka
HDFS-8542	WebHDFS getHomeDirectory behavior does not match specification	Major	webhdfs	Jakob Homan	Kanaka Kumar Avvaru
YARN-3842	NMProxy should retry on NMNotYetReadyException	Critical	.	Karthik Kambatla	Robert Kanter
YARN-3835	hadoop-yarn-server-resourcemanager test package bundles core-site.xml, yarn-site.xml	Minor	resourcemanager	Vamsee Yarlagadda	Vamsee Yarlagadda
MAPREDUCE-6410	Aggregated Logs Deletion doesnt work after refreshing Log Retention Settings in secure cluster	Critical	.	Zhang Wei	Varun Saxena
MAPREDUCE-6400	Multiple shuffle transfer fails because input is closed too early	Blocker	task	Akira Ajisaka	Brahma Reddy Battula
YARN-3809	Failed to launch new attempts because ApplicationMasterLauncher’s threads all hang	Major	resourcemanager	Jun Gong	Jun Gong
YARN-3832	Resource Localization fails on a cluster due to existing cache directories	Critical	nodemanager	Ranga Swamy	Brahma Reddy Battula
YARN-3790	usedResource from rootQueue metrics may get stale data for FS scheduler after recovering the container	Major	fairscheduler, test	Rohith Sharma K S	zhihai xu
HADOOP-11958	MetricsSystemImpl fails to show backtrace when an error occurs	Major	.	Jason Lowe	Jason Lowe
HDFS-8646	Prune cached replicas from DatanodeDescriptor state on replica invalidation	Major	caching	Andrew Wang	Andrew Wang
YARN-3826	Race condition in ResourceTrackerService leads to wrong diagnostics messages	Major	resourcemanager	Chengbing Liu	Chengbing Liu
YARN-3745	SerializedException should also try to instantiate internal exception with the default constructor	Major	.	Lavkesh Lahngir	Lavkesh Lahngir
MAPREDUCE-6413	TestLocalJobSubmission is failing with unknown host	Major	test	Jason Lowe	zhihai xu
HDFS-8665	Fix replication check in DFSTestUtils#waitForReplication	Trivial	test	Andrew Wang	Andrew Wang
HADOOP-8151	Error handling in snappy decompressor throws invalid exceptions	Major	io, native	Todd Lipcon	Matt Foley
YARN-3850	NM fails to read files from full disks which can lead to container logs being lost and other issues	Blocker	log-aggregation, nodemanager	Varun Saxena	Varun Saxena
HDFS-8656	Preserve compatibility of ClientProtocol#rollingUpgrade after finalization	Critical	rolling upgrades	Andrew Wang	Andrew Wang
YARN-3859	LeafQueue doesn’t print user properly for application add	Minor	capacityscheduler	Devaraj K	Varun Saxena
HDFS-8681	BlockScanner is incorrectly disabled by default	Blocker	datanode	Andrew Wang	Arpit Agarwal
YARN-3860	rmadmin -transitionToActive should check the state of non-target node	Major	resourcemanager	Masatake Iwasaki	Masatake Iwasaki
HDFS-8586	Dead Datanode is allocated for write when client is from deadnode	Critical	.	Brahma Reddy Battula	Brahma Reddy Battula
HADOOP-12119	hadoop fs -expunge does not work for federated namespace	Major	.	Vrushali C	J.Andreina
HDFS-8628	Update missing command option for fetchdt	Major	documentation	J.Andreina	J.Andreina
YARN-3695	ServerProxy (NMProxy, etc.) shouldn’t retry forever for non network exception.	Major	.	Junping Du	Raju Bairishetti
HADOOP-12089	StorageException complaining " no lease ID" when updating FolderLastModifiedTime in WASB	Major	tools	Duo Xu	Duo Xu
YARN-3770	SerializedException should also handle java.lang.Error	Major	.	Lavkesh Lahngir	Lavkesh Lahngir
HDFS-8687	Remove the duplicate usage message from Dfsck.java	Major	.	Brahma Reddy Battula	Brahma Reddy Battula
HADOOP-12107	long running apps may have a huge number of StatisticsData instances under FileSystem	Critical	fs	Sangjin Lee	Sangjin Lee
HDFS-8579	Update HDFS usage with missing options	Minor	.	J.Andreina	J.Andreina
HADOOP-12154	FileSystem#getUsed() returns the file length only from root ‘/’	Major	.	tongshiquan	J.Andreina
YARN-3768	ArrayIndexOutOfBoundsException with empty environment variables	Major	yarn	Joe Ferner	zhihai xu
HADOOP-10798	globStatus() should always return a sorted list of files	Minor	.	Felix Borchers	Colin P. McCabe
HADOOP-12124	Add HTrace support for FsShell	Major	.	Colin P. McCabe	Colin P. McCabe
HADOOP-12159	Move DistCpUtils#compareFs() to org.apache.hadoop.fs.FileUtil and fix for HA namespaces	Major	.	Ray Chiang	Ray Chiang
MAPREDUCE-6121	JobResourceUpdater#compareFs() doesn’t handle HA namespaces	Major	mrv2	Thomas Graves	Ray Chiang
HADOOP-12116	Fix unrecommended syntax usages in hadoop/hdfs/yarn script for cygwin in branch-2	Major	scripts	Li Lu	Li Lu
HADOOP-12164	Fix TestMove and TestFsShellReturnCode failed to get command name using reflection.	Minor	.	Lei (Eddy) Xu	Lei (Eddy) Xu
YARN-3823	Fix mismatch in default values for yarn.scheduler.maximum-allocation-vcores property	Minor	.	Ray Chiang	Ray Chiang
YARN-3830	AbstractYarnScheduler.createReleaseCache may try to clean a null attempt	Major	scheduler	nijel	nijel
HDFS-8706	Fix typo in datanode startup options in HDFSCommands.html	Major	.	Brahma Reddy Battula	Brahma Reddy Battula
MAPREDUCE-6420	Interrupted Exception in LocalContainerLauncher should be logged in warn/info level	Major	.	Chang Li	Chang Li
MAPREDUCE-6418	MRApp should not shutdown LogManager during shutdown	Major	test	Chang Li	Chang Li
YARN-3793	Several NPEs when deleting local files on NM recovery	Major	nodemanager	Karthik Kambatla	Varun Saxena
HDFS-8666	speedup TestMover	Major	test	Walter Su	Walter Su
HADOOP-12171	Shorten overly-long htrace span names for server	Major	tracing	Colin P. McCabe	Colin P. McCabe
YARN-3875	FSSchedulerNode#reserveResource() doesn’t print Application Id properly in log	Minor	.	Bibin A Chundatt	Bibin A Chundatt
YARN-3508	Prevent processing preemption events on the main RM dispatcher	Major	resourcemanager, scheduler	Jason Lowe	Varun Saxena
HADOOP-12173	NetworkTopology#add calls NetworkTopology#toString always	Major	.	Íñigo Goiri	Íñigo Goiri
HDFS-8577	Avoid retrying to recover lease on a file which does not exist	Major	.	J.Andreina	J.Andreina
YARN-3882	AggregatedLogFormat should close aclScanner and ownerScanner after create them.	Minor	nodemanager	zhihai xu	zhihai xu
MAPREDUCE-6425	ShuffleHandler passes wrong “base” parameter to getMapOutputInfo if mapId is not in the cache.	Major	mrv2, nodemanager	zhihai xu	zhihai xu
HADOOP-12186	ActiveStandbyElector shouldn’t call monitorLockNodeAsync multiple times	Major	ha	zhihai xu	zhihai xu
HDFS-8686	WebHdfsFileSystem#getXAttr(Path p, final String name) doesn’t work if namespace is in capitals	Major	webhdfs	Jagadesh Kiran N	Kanaka Kumar Avvaru
YARN-3837	javadocs of TimelineAuthenticationFilterInitializer give wrong prefix for auth options	Minor	timelineserver	Steve Loughran	Bibin A Chundatt
HADOOP-12117	Potential NPE from Configuration#loadProperty with allowNullValueProperties set.	Minor	conf	zhihai xu	zhihai xu
MAPREDUCE-6038	A boolean may be set error in the Word Count v2.0 in MapReduce Tutorial	Minor	.	Pei Ma	Tsuyoshi Ozawa
YARN-3892	NPE on RMStateStore#serviceStop when CapacityScheduler#serviceInit fails	Minor	.	Bibin A Chundatt	Bibin A Chundatt
YARN-3690	[JDK8] ‘mvn site’ fails	Major	api, site	Akira Ajisaka	Brahma Reddy Battula
HADOOP-12202	releasedocmaker drops missing component and assignee entries	Blocker	yetus	Allen Wittenauer	Allen Wittenauer
HDFS-8642	Make TestFileTruncate more reliable	Minor	.	Rakesh R	Rakesh R
HADOOP-11878	FileContext.java # fixRelativePart should check for not null for a more informative exception	Major	.	Brahma Reddy Battula	Brahma Reddy Battula
HADOOP-12201	Add tracing to FileSystem#createFileSystem and Globber#glob	Major	.	Colin P. McCabe	Colin P. McCabe
HADOOP-12200	TestCryptoStreamsWithOpensslAesCtrCryptoCodec should be skipped in non-native profile	Minor	test	Masatake Iwasaki	Masatake Iwasaki
MAPREDUCE-6426	TestShuffleHandler#testGetMapOutputInfo is failing	Major	test	Devaraj K	zhihai xu
HDFS-8729	Fix testTruncateWithDataNodesRestartImmediately occasionally failed	Minor	.	Walter Su	Walter Su
YARN-3888	ApplicationMaster link is broken in RM WebUI when appstate is NEW	Minor	resourcemanager	Bibin A Chundatt	Bibin A Chundatt
HDFS-8749	Fix findbugs warning in BlockManager.java	Minor	.	Akira Ajisaka	Brahma Reddy Battula
HDFS-2956	calling fetchdt without a –renewer argument throws NPE	Major	security	Todd Lipcon	Vinayakumar B
HDFS-8751	Remove setBlocks API from INodeFile and misc code cleanup	Major	namenode	Zhe Zhang	Zhe Zhang
YARN-3849	Too much of preemption activity causing continuos killing of containers across queues	Critical	capacityscheduler	Sunil Govindan	Sunil Govindan
YARN-3917	getResourceCalculatorPlugin for the default should intercept all exceptions	Major	.	Gera Shegalov	Gera Shegalov
YARN-3894	RM startup should fail for wrong CS xml NodeLabel capacity configuration	Critical	capacityscheduler	Bibin A Chundatt	Bibin A Chundatt
MAPREDUCE-6421	Fix findbugs warning in RMContainerAllocator.reduceNodeLabelExpression	Major	.	Ray Chiang	Brahma Reddy Battula
HADOOP-12191	Bzip2Factory is not thread safe	Major	io	Jason Lowe	Brahma Reddy Battula
HDFS-7608	hdfs dfsclient newConnectedPeer has no write timeout	Major	fuse-dfs, hdfs-client	zhangshilong	Xiaoyu Yao
HADOOP-12153	ByteBufferReadable doesn’t declare @InterfaceAudience and @InterfaceStability	Minor	fs	Steve Loughran	Brahma Reddy Battula
HDFS-8778	TestBlockReportRateLimiting#testLeaseExpiration can deadlock	Major	test	Arpit Agarwal	Arpit Agarwal
HADOOP-10615	FileInputStream in JenkinsHash#main() is never closed	Minor	.	Ted Yu	Chen He
HADOOP-12240	Fix tests requiring native library to be skipped in non-native profile	Minor	test	Masatake Iwasaki	Masatake Iwasaki
YARN-3805	Update the documentation of Disk Checker based on YARN-90	Minor	documentation	Masatake Iwasaki	Masatake Iwasaki
HDFS-8767	RawLocalFileSystem.listStatus() returns null for UNIX pipefile	Critical	.	Haohui Mai	Kanaka Kumar Avvaru
YARN-3885	ProportionalCapacityPreemptionPolicy doesn’t preempt if queue is more than 2 level	Blocker	yarn	Ajith S	Ajith S
YARN-3453	Fair Scheduler: Parts of preemption logic uses DefaultResourceCalculator even in DRF mode causing thrashing	Major	fairscheduler	Ashwin Shankar	Arun Suresh
YARN-3535	Scheduler must re-request container resources when RMContainer transitions from ALLOCATED to KILLED	Critical	capacityscheduler, fairscheduler, resourcemanager	Peng Zhang	Peng Zhang
YARN-3905	Application History Server UI NPEs when accessing apps run after RM restart	Major	timelineserver	Eric Payne	Eric Payne
HADOOP-12235	hadoop-openstack junit & mockito dependencies should be “provided”	Minor	build, fs/swift	Steve Loughran	Ted Yu
HADOOP-12088	KMSClientProvider uses equalsIgnoreCase(“application/json”)	Major	kms	Steve Loughran	Brahma Reddy Battula
HADOOP-12051	ProtobufRpcEngine.invoke() should use Exception.toString() over getMessage in logging/span events	Minor	ipc	Steve Loughran	Varun Saxena
HADOOP-12237	releasedocmaker.py doesn’t work behind a proxy	Major	yetus	Tsuyoshi Ozawa	Tsuyoshi Ozawa
HDFS-7582	Enforce maximum number of ACL entries separately per access and default.	Major	namenode	Vinayakumar B	Vinayakumar B
HDFS-8773	Few FSNamesystem metrics are not documented in the Metrics page	Major	documentation	Rakesh R	Rakesh R
YARN-3878	AsyncDispatcher can hang while stopping if it is configured for draining events on stop	Critical	.	Varun Saxena	Varun Saxena
HDFS-7728	Avoid updating quota usage while loading edits	Major	.	Jing Zhao	Jing Zhao
HADOOP-11962	Sasl message with MD5 challenge text shouldn’t be LOG out even in debug level.	Critical	ipc, security	Junping Du	Junping Du
HADOOP-12017	Hadoop archives command should use configurable replication factor when closing	Major	.	Zhe Zhang	Bibin A Chundatt
HADOOP-12239	StorageException complaining " no lease ID" when updating FolderLastModifiedTime in WASB	Major	fs/azure, tools	Duo Xu	Duo Xu
YARN-3932	SchedulerApplicationAttempt#getResourceUsageReport and UserInfo should based on total-used-resources	Major	resourcemanager	Bibin A Chundatt	Bibin A Chundatt
YARN-3954	TestYarnConfigurationFields#testCompareConfigurationClassAgainstXml fails in trunk	Major	.	Varun Saxena	Varun Saxena
YARN-2019	Retrospect on decision of making RM crashed if any exception throw in ZKRMStateStore	Critical	.	Junping Du	Jian He
HDFS-8797	WebHdfsFileSystem creates too many connections for pread	Major	webhdfs	Jing Zhao	Jing Zhao
YARN-3941	Proportional Preemption policy should try to avoid sending duplicate PREEMPT_CONTAINER event to scheduler	Major	capacityscheduler	Sunil Govindan	Sunil Govindan
YARN-3900	Protobuf layout of yarn_security_token causes errors in other protos that include it	Major	.	Anubhav Dhoot	Anubhav Dhoot
YARN-3845	Scheduler page does not render RGBA color combinations in IE11	Minor	.	Jagadesh Kiran N	Mohammad Shahid Khan
HDFS-8806	Inconsistent metrics: number of missing blocks with replication factor 1 not properly cleared	Major	.	Zhe Zhang	Zhe Zhang
YARN-3967	Fetch the application report from the AHS if the RM does not know about it	Major	.	Mit Desai	Mit Desai
YARN-3957	FairScheduler NPE In FairSchedulerQueueInfo causing scheduler page to return 500	Major	fairscheduler	Anubhav Dhoot	Anubhav Dhoot
YARN-3925	ContainerLogsUtils#getContainerLogFile fails to read container log files from full disks.	Critical	nodemanager	zhihai xu	zhihai xu
YARN-3973	Recent changes to application priority management break reservation system from YARN-1051	Major	resourcemanager	Carlo Curino	Carlo Curino
YARN-3958	TestYarnConfigurationFields should be moved to hadoop-yarn-api module	Major	.	Varun Saxena	Varun Saxena
HDFS-8810	Correct assertions in TestDFSInotifyEventInputStream class.	Minor	test	Surendra Singh Lilhore	Surendra Singh Lilhore
HDFS-8785	TestDistributedFileSystem is failing in trunk	Major	test	Arpit Agarwal	Xiaoyu Yao
YARN-2194	Cgroups cease to work in RHEL7	Critical	nodemanager	Wei Yan	Wei Yan
YARN-3846	RM Web UI queue filter is not working	Major	yarn	Mohammad Shahid Khan	Mohammad Shahid Khan
HADOOP-12245	References to misspelled REMAINING_QUATA in FileSystemShell.md	Minor	documentation	Gera Shegalov	Gabor Liptak
YARN-3982	container-executor parsing of container-executor.cfg broken in trunk and branch-2	Blocker	nodemanager	Varun Vasudev	Varun Vasudev
HADOOP-12175	FsShell must load SpanReceiverHost to support tracing	Major	tracing	Masatake Iwasaki	Masatake Iwasaki
HDFS-8670	Better to exclude decommissioned nodes for namenode NodeUsage JMX	Major	.	Ming Ma	J.Andreina
HADOOP-10945	4-digit octal umask permissions throws a parse error	Major	fs	Jason Lowe	Chang Li
YARN-3919	NPEs’ while stopping service after exception during CommonNodeLabelsManager#start	Trivial	resourcemanager	Varun Saxena	Varun Saxena
YARN-3963	AddNodeLabel on duplicate label addition shows success	Minor	.	Bibin A Chundatt	Bibin A Chundatt
YARN-3990	AsyncDispatcher may overloaded with RMAppNodeUpdateEvent when Node is connected/disconnected	Critical	resourcemanager	Rohith Sharma K S	Bibin A Chundatt
HDFS-6860	BlockStateChange logs are too noisy	Major	namenode	Arpit Agarwal	Chang Li
HADOOP-12268	AbstractContractAppendTest#testRenameFileBeingAppended misses rename operation.	Major	test	zhihai xu	zhihai xu
HDFS-8847	change TestHDFSContractAppend to not override testRenameFileBeingAppended method.	Major	test	zhihai xu	zhihai xu
HDFS-8850	VolumeScanner thread exits with exception if there is no block pool to be scanned but there are suspicious blocks	Major	datanode	Colin P. McCabe	Colin P. McCabe
HDFS-8844	TestHDFSCLI does not cleanup the test directory	Minor	test	Akira Ajisaka	Masatake Iwasaki
HADOOP-12274	Remove direct download link from BUILDING.txt	Minor	documentation	Caleb Severn	Caleb Severn
HADOOP-12302	Fix native compilation on Windows after HADOOP-7824	Blocker	.	Vinayakumar B	Vinayakumar B
YARN-3983	Make CapacityScheduler to easier extend application allocation logic	Major	.	Wangda Tan	Wangda Tan
HADOOP-12304	Applications using FileContext fail with the default file system configured to be wasb/s3/etc.	Blocker	fs	Chris Nauroth	Chris Nauroth
HADOOP-11932	MetricsSinkAdapter hangs when being stopped	Critical	.	Jian He	Brahma Reddy Battula
HDFS-8856	Make LeaseManager#countPath O(1)	Major	namenode	Arpit Agarwal	Arpit Agarwal
HDFS-8772	Fix TestStandbyIsHot#testDatanodeRestarts which occasionally fails	Major	.	Walter Su	Walter Su
YARN-3966	Fix excessive loggings in CapacityScheduler	Major	.	Jian He	Jian He
HDFS-8866	Typo in docs: Rumtime -> Runtime	Trivial	documentation, webhdfs	Jakob Homan	Gabor Liptak
YARN-3999	RM hangs on draining events	Major	.	Jian He	Jian He
YARN-4026	FiCaSchedulerApp: ContainerAllocator should be able to choose how to order pending resource requests	Major	.	Wangda Tan	Wangda Tan
HDFS-8879	Quota by storage type usage incorrectly initialized upon namenode restart	Major	namenode	Kihwal Lee	Xiaoyu Yao
HADOOP-12258	Need translate java.nio.file.NoSuchFileException to FileNotFoundException to avoid regression	Critical	fs	zhihai xu	zhihai xu
YARN-4005	Completed container whose app is finished is not removed from NMStateStore	Major	.	Jun Gong	Jun Gong
YARN-4047	ClientRMService getApplications has high scheduler lock contention	Major	resourcemanager	Jason Lowe	Jason Lowe
YARN-3987	am container complete msg ack to NM once RM receive it	Major	resourcemanager	sandflee	sandflee
HADOOP-12322	typos in rpcmetrics.java	Trivial	ipc	Anu Engineer	Anu Engineer
HDFS-8565	Typo in dfshealth.html - “Decomissioning”	Trivial	.	nijel	nijel
MAPREDUCE-5817	Mappers get rescheduled on node transition even after all reducers are completed	Major	applicationmaster	Sangjin Lee	Sangjin Lee
HDFS-8891	HDFS concat should keep srcs order	Blocker	.	Yong Zhang	Yong Zhang
MAPREDUCE-6439	AM may fail instead of retrying if RM shuts down during the allocate call	Critical	.	Anubhav Dhoot	Anubhav Dhoot
HDFS-8845	DiskChecker should not traverse the entire tree	Major	.	Chang Li	Chang Li
HDFS-8852	HDFS architecture documentation of version 2.x is outdated about append write support	Major	documentation	Hong Dai Thanh	Ajith S
YARN-3857	Memory leak in ResourceManager with SIMPLE mode	Critical	resourcemanager	mujunchao	mujunchao
YARN-4028	AppBlock page key update and diagnostics value null on recovery	Minor	.	Bibin A Chundatt	Bibin A Chundatt
HDFS-8908	TestAppendSnapshotTruncate may fail with IOException: Failed to replace a bad datanode	Minor	test	Tsz Wo Nicholas Sze	Tsz Wo Nicholas Sze
HDFS-8867	Enable optimized block reports	Major	.	Rushabh S Shah	Daryn Sharp
HADOOP-12317	Applications fail on NM restart on some linux distro because NM container recovery declares AM container as LOST	Critical	.	Anubhav Dhoot	Anubhav Dhoot
HDFS-8863	The remaining space check in BlockPlacementPolicyDefault is flawed	Critical	.	Kihwal Lee	Kihwal Lee
HDFS-8922	Link the native_mini_dfs test library with libdl, since IBM Java requires it	Major	build	Ayappan	Ayappan
HDFS-8809	HDFS fsck reports under construction blocks as “CORRUPT”	Major	tools	Sudhir Prakash	Jing Zhao
MAPREDUCE-6454	MapReduce doesn’t set the HADOOP_CLASSPATH for jar lib in distributed cache.	Critical	.	Junping Du	Junping Du
MAPREDUCE-6357	MultipleOutputs.write() API should document that output committing is not utilized when input path is absolute	Major	documentation	Ivan Mitic	Dustin Cote
YARN-3986	getTransferredContainers in AbstractYarnScheduler should be present in YarnScheduler interface instead	Major	scheduler	Varun Saxena	Varun Saxena
HADOOP-12347	Fix mismatch parameter name in javadocs of AuthToken#setMaxInactives	Trivial	.	Xiaoyu Yao	Xiaoyu Yao
HDFS-8942	Update hyperlink to rack awareness page in HDFS Architecture documentation	Trivial	documentation	Masatake Iwasaki	Masatake Iwasaki
YARN-3896	RMNode transitioned from RUNNING to REBOOTED because its response id had not been reset synchronously	Major	resourcemanager	Jun Gong	Jun Gong
HDFS-8930	Block report lease may leak if the 2nd full block report comes when NN is still in safemode	Minor	.	Jing Zhao	Jing Zhao
HDFS-8932	NPE thrown in NameNode when try to get “TotalSyncCount” metric before editLogStream initialization	Major	.	Surendra Singh Lilhore	Surendra Singh Lilhore
HADOOP-12352	Delay in checkpointing Trash can leave trash for 2 intervals before deleting	Trivial	trash	Casey Brotherton	Casey Brotherton
HDFS-8846	Add a unit test for INotify functionality across a layout version upgrade	Major	namenode	Zhe Zhang	Zhe Zhang
HDFS-8896	DataNode object isn’t GCed when shutdown, because it has GC root in ShutdownHookManager	Minor	test	Walter Su	Walter Su
HDFS-8961	Surpress findbug warnings of o.a.h.hdfs.shortcircuit.DfsClientShmManager.EndpointShmManager in hdfs-client	Major	.	Haohui Mai	Mingliang Liu
HADOOP-12362	Set hadoop.tmp.dir and hadoop.log.dir in pom	Major	.	Charlie Helin	Charlie Helin
HDFS-8969	Clean up findbugs warnings for HDFS-8823 and HDFS-8932	Major	namenode	Anu Engineer	Anu Engineer
HDFS-8963	Fix incorrect sign extension of xattr length in HDFS-8900	Critical	.	Haohui Mai	Colin P. McCabe
YARN-1556	NPE getting application report with a null appId	Minor	client	Steve Loughran	Weiwei Yang
MAPREDUCE-6452	NPE when intermediate encrypt enabled for LocalRunner	Major	.	Bibin A Chundatt	zhihai xu
HDFS-8950	NameNode refresh doesn’t remove DataNodes that are no longer in the allowed list	Major	datanode, namenode	Daniel Templeton	Daniel Templeton
HADOOP-12346	Increase some default timeouts / retries for S3a connector	Major	fs/s3	Sean Mackrory	Sean Mackrory
HADOOP-12359	hadoop fs -getmerge doc is wrong	Major	documentation	Daniel Templeton	Jagadesh Kiran N
HADOOP-10365	BufferedOutputStream in FileUtil#unpackEntries() should be closed in finally block	Minor	util	Ted Yu	Kiran Kumar M R
HDFS-8995	Flaw in registration bookeeping can make DN die on reconnect	Critical	.	Kihwal Lee	Kihwal Lee
HDFS-8388	Time and Date format need to be in sync in NameNode UI page	Minor	.	Archana T	Surendra Singh Lilhore
YARN-4073	Unused ApplicationACLsManager in ContainerManagerImpl	Trivial	.	Naganarasimha G R	Naganarasimha G R
HDFS-9003	ForkJoin thread pool leaks	Major	.	Kihwal Lee	Kihwal Lee
HDFS-8885	ByteRangeInputStream used in webhdfs does not override available()	Minor	webhdfs	Shradha Revankar	Shradha Revankar
HADOOP-10318	Incorrect reference to nodeFile in RumenToSLSConverter error message	Minor	.	Ted Yu	Wei Yan
HADOOP-12213	Interrupted exception can occur when Client#stop is called	Minor	.	Oleg Zhurakousky	Kuhu Shukla
HDFS-9009	Send metrics logs to NullAppender by default	Major	logging	Arpit Agarwal	Arpit Agarwal
HDFS-8964	When validating the edit log, do not read at or beyond the file offset that is being written	Major	journal-node, namenode	Zhe Zhang	Zhe Zhang
HDFS-8939	Test(S)WebHdfsFileContextMainOperations failing on branch-2	Major	webhdfs	Jakob Homan	Chris Nauroth
YARN-4103	RM WebServices missing scheme for appattempts logLinks	Major	.	Jonathan Eagles	Jonathan Eagles
YARN-4105	Capacity Scheduler headroom for DRF is wrong	Major	capacityscheduler	Chang Li	Chang Li
MAPREDUCE-6442	Stack trace is missing when error occurs in client protocol provider’s constructor	Major	client	Chang Li	Chang Li
YARN-3591	Resource localization on a bad disk causes subsequent containers failure	Major	.	Lavkesh Lahngir	Lavkesh Lahngir
YARN-4121	Typos in capacity scheduler documentation.	Trivial	documentation	Kai Sasaki	Kai Sasaki
YARN-4096	App local logs are leaked if log aggregation fails to initialize for the app	Major	log-aggregation, nodemanager	Jason Lowe	Jason Lowe
HADOOP-12388	Fix components’ version information in the web page ‘About the Cluster’	Minor	util	Jun Gong	Jun Gong
HDFS-9033	dfsadmin -metasave prints “NaN” for cache used%	Major	.	Archana T	Brahma Reddy Battula
HDFS-8716	introduce a new config specifically for safe mode block count	Major	.	Chang Li	Chang Li
HDFS-8581	ContentSummary on / skips further counts on yielding lock	Minor	namenode	tongshiquan	J.Andreina
HDFS-6763	Initialize file system-wide quota once on transitioning to active	Major	ha, namenode	Daryn Sharp	Kihwal Lee
MAPREDUCE-6474	ShuffleHandler can possibly exhaust nodemanager file descriptors	Major	mrv2, nodemanager	Nathan Roberts	Kuhu Shukla
YARN-4106	NodeLabels for NM in distributed mode is not updated even after clusterNodelabel addition in RM	Major	.	Bibin A Chundatt	Bibin A Chundatt
YARN-4115	Reduce loglevel of ContainerManagementProtocolProxy to Debug	Minor	.	Anubhav Dhoot	Anubhav Dhoot
HADOOP-12348	MetricsSystemImpl creates MetricsSourceAdapter with wrong time unit parameter.	Major	metrics	zhihai xu	zhihai xu
HDFS-9042	Update document for the Storage policy name	Minor	documentation	J.Andreina	J.Andreina
HDFS-9036	In BlockPlacementPolicyWithNodeGroup#chooseLocalStorage , random node is selected eventhough fallbackToLocalRack is true.	Major	.	J.Andreina	J.Andreina
HADOOP-12407	Test failing: hadoop.ipc.TestSaslRPC	Critical	security, test	Steve Loughran	Steve Loughran
HADOOP-12087	[JDK8] Fix javadoc errors caused by incorrect or illegal tags	Major	documentation	Akira Ajisaka	Akira Ajisaka
HDFS-9069	TestNameNodeMetricsLogger failing -port in use	Critical	test	Steve Loughran	Steve Loughran
HDFS-8996	Consolidate validateLog and scanLog in FJM#EditLogFile	Major	journal-node, namenode	Zhe Zhang	Zhe Zhang
YARN-4151	Fix findbugs errors in hadoop-yarn-server-common module	Major	.	MENG DING	MENG DING
HDFS-9067	o.a.h.hdfs.server.datanode.fsdataset.impl.TestLazyWriter is failing in trunk	Critical	.	Haohui Mai	Surendra Singh Lilhore
MAPREDUCE-6472	MapReduce AM should have java.io.tmpdir=./tmp to be consistent with tasks	Major	mr-am	Jason Lowe	Naganarasimha G R
HADOOP-12374	Description of hdfs expunge command is confusing	Major	documentation, trash	Weiwei Yang	Weiwei Yang
YARN-4078	getPendingResourceRequestForAttempt is present in AbstractYarnScheduler should be present in YarnScheduler interface instead	Minor	resourcemanager	Naganarasimha G R	Naganarasimha G R
HDFS-9072	Fix random failures in TestJMXGet	Critical	test	J.Andreina	J.Andreina
HDFS-9073	Fix failures in TestLazyPersistLockedMemory#testReleaseOnEviction	Critical	test	J.Andreina	J.Andreina
YARN-3433	Jersey tests failing with Port in Use -again	Critical	build, test	Steve Loughran	Brahma Reddy Battula
HADOOP-12417	TestWebDelegationToken failing with port in use	Major	test	Steve Loughran	Mingliang Liu
MAPREDUCE-6481	LineRecordReader may give incomplete record and wrong position/key information for uncompressed input sometimes.	Critical	mrv2	zhihai xu	zhihai xu
MAPREDUCE-5002	AM could potentially allocate a reduce container to a map attempt	Major	mr-am	Jason Lowe	Chang Li
MAPREDUCE-5982	Task attempts that fail from the ASSIGNED state can disappear	Major	mr-am	Jason Lowe	Chang Li
HADOOP-12386	RetryPolicies.RETRY_FOREVER should be able to specify a retry interval	Major	.	Wangda Tan	Sunil Govindan
YARN-3697	FairScheduler: ContinuousSchedulingThread can fail to shutdown	Critical	fairscheduler	zhihai xu	zhihai xu
HDFS-6955	DN should reserve disk space for a full block when creating tmp files	Major	datanode	Arpit Agarwal	Kanaka Kumar Avvaru
HDFS-5802	NameNode does not check for inode type before traversing down a path	Trivial	namenode	Harsh J	Xiao Chen
MAPREDUCE-6460	TestRMContainerAllocator.testAttemptNotFoundCausesRMCommunicatorException fails	Major	test	zhihai xu	zhihai xu
YARN-4167	NPE on RMActiveServices#serviceStop when store is null	Minor	.	Bibin A Chundatt	Bibin A Chundatt
YARN-4113	RM should respect retry-interval when uses RetryPolicies.RETRY_FOREVER	Critical	.	Wangda Tan	Sunil Govindan
YARN-4188	MoveApplicationAcrossQueuesResponse should be an abstract class	Minor	resourcemanager	Giovanni Matteo Fumarola	Giovanni Matteo Fumarola
HDFS-9043	Doc updation for commands in HDFS Federation	Minor	documentation	J.Andreina	J.Andreina
HDFS-9013	Deprecate NameNodeMXBean#getNNStarted in branch2 and remove from trunk	Major	namenode	Surendra Singh Lilhore	Surendra Singh Lilhore
YARN-3975	WebAppProxyServlet should not redirect to RM page if AHS is enabled	Major	.	Mit Desai	Mit Desai
HADOOP-12438	Reset RawLocalFileSystem.useDeprecatedFileStatus in TestLocalFileSystem	Trivial	test	Chris Nauroth	Chris Nauroth
HDFS-9128	TestWebHdfsFileContextMainOperations and TestSWebHdfsFileContextMainOperations fail due to invalid HDFS path on Windows.	Trivial	test	Chris Nauroth	Chris Nauroth
YARN-4152	NM crash with NPE when LogAggregationService#stopContainer called for absent container	Critical	log-aggregation, nodemanager	Bibin A Chundatt	Bibin A Chundatt
YARN-4044	Running applications information changes such as movequeue is not published to TimeLine server	Critical	resourcemanager, timelineserver	Sunil Govindan	Sunil Govindan
HDFS-9076	Log full path instead of inodeId in DFSClient#closeAllFilesBeingWritten()	Major	hdfs-client	Surendra Singh Lilhore	Surendra Singh Lilhore
MAPREDUCE-6484	Yarn Client uses local address instead of RM address as token renewer in a secure cluster when RM HA is enabled.	Major	client, security	zhihai xu	zhihai xu
HADOOP-12437	Allow SecurityUtil to lookup alternate hostnames	Major	net, security	Arpit Agarwal	Arpit Agarwal
HADOOP-12252	LocalDirAllocator should not throw NPE with empty string configuration.	Minor	fs	zhihai xu	zhihai xu
YARN-3624	ApplicationHistoryServer reverses the order of the filters it gets	Major	timelineserver	Mit Desai	Mit Desai
HDFS-9123	Copying from the root to a subdirectory should be forbidden	Minor	fs	Wei-Chiu Chuang	Wei-Chiu Chuang
MAPREDUCE-6480	archive-logs tool may miss applications	Major	.	Robert Kanter	Robert Kanter
HDFS-9107	Prevent NN’s unrecoverable death spiral after full GC	Critical	namenode	Daryn Sharp	Daryn Sharp
HDFS-9133	ExternalBlockReader and ReplicaAccessor need to return -1 on read when at EOF	Major	hdfs-client	Colin P. McCabe	Colin P. McCabe
HDFS-9080	update htrace version to 4.0.1	Major	tracing	Colin P. McCabe	Colin P. McCabe
YARN-4204	ConcurrentModificationException in FairSchedulerQueueInfo	Major	.	Anubhav Dhoot	Anubhav Dhoot
HDFS-9106	Transfer failure during pipeline recovery causes permanent write failures	Critical	.	Kihwal Lee	Kihwal Lee
HDFS-9147	Fix the setting of visibleLength in ExternalBlockReader	Major	hdfs-client	Colin P. McCabe	Colin P. McCabe
MAPREDUCE-6492	AsyncDispatcher exit with NPE on TaskAttemptImpl#sendJHStartEventForAssignedFailTask	Critical	.	Bibin A Chundatt	Bibin A Chundatt
HADOOP-12440	TestRPC#testRPCServerShutdown did not produce the desired thread states before shutting down	Minor	.	Xiao Chen	Xiao Chen
HDFS-9092	Nfs silently drops overlapping write requests and causes data copying to fail	Major	nfs	Yongjun Zhang	Yongjun Zhang
YARN-4180	AMLauncher does not retry on failures when talking to NM	Critical	resourcemanager	Anubhav Dhoot	Anubhav Dhoot
HDFS-9141	Thread leak in Datanode#refreshVolumes	Major	datanode	Uma Maheswara Rao G	Uma Maheswara Rao G
YARN-4066	Large number of queues choke fair scheduler	Major	fairscheduler	Johan Gustavsson	Johan Gustavsson
HADOOP-12447	Clean up some htrace integration issues	Major	tracing	Colin P. McCabe	Colin P. McCabe
HDFS-9174	Fix findbugs warnings in FSOutputSummer.tracer and DirectoryScanner$ReportCompiler.currentThread	Critical	.	Yi Liu	Yi Liu
HDFS-9001	DFSUtil.getNsServiceRpcUris() can return too many entries in a non-HA, non-federated cluster	Major	.	Daniel Templeton	Daniel Templeton
HADOOP-12448	TestTextCommand: use mkdirs rather than mkdir to create test directory	Major	test	Colin P. McCabe	Colin P. McCabe
MAPREDUCE-6494	Permission issue when running archive-logs tool as different users	Major	.	Robert Kanter	Robert Kanter
MAPREDUCE-6497	Fix wrong value of JOB_FINISHED event in JobHistoryEventHandler	Major	.	Shinichi Yamashita	Shinichi Yamashita
HADOOP-10296	Incorrect null check in SwiftRestClient#buildException()	Minor	.	Ted Yu	Kanaka Kumar Avvaru
HADOOP-8437	getLocalPathForWrite should throw IOException for invalid paths	Major	fs	Brahma Reddy Battula	Brahma Reddy Battula
MAPREDUCE-6485	MR job hanged forever because all resources are taken up by reducers and the last map attempt never get resource to run	Critical	applicationmaster	Bob.zhao	Xianyin Xin
HDFS-9191	Typo in Hdfs.java. NoSuchElementException is misspelled	Trivial	documentation	Catherine Palmer	Catherine Palmer
HDFS-9100	HDFS Balancer does not respect dfs.client.use.datanode.hostname	Major	balancer & mover	Yongjun Zhang	Casey Brotherton
YARN-3619	ContainerMetrics unregisters during getMetrics and leads to ConcurrentModificationException	Major	nodemanager	Jason Lowe	zhihai xu
HDFS-9193	Fix incorrect references the usages of the DN in dfshealth.js	Minor	.	Chang Li	Chang Li
HADOOP-11098	[JDK8] Max Non Heap Memory default changed between JDK7 and 8	Major	.	Travis Thompson	Tsuyoshi Ozawa
HADOOP-12441	Fix kill command behavior under some Linux distributions.	Critical	.	Wangda Tan	Wangda Tan
HADOOP-12452	Fix tracing documention reflecting the update to htrace-4	Major	documentation	Masatake Iwasaki	Masatake Iwasaki
YARN-4176	Resync NM nodelabels with RM periodically for distributed nodelabels	Major	.	Bibin A Chundatt	Bibin A Chundatt
HDFS-7899	Improve EOF error message	Minor	hdfs-client	Harsh J	Jagadesh Kiran N
MAPREDUCE-6503	archive-logs tool should use HADOOP_PREFIX instead of HADOOP_HOME	Major	.	Robert Kanter	Robert Kanter
YARN-4209	RMStateStore FENCED state doesn’t work due to updateFencedState called by stateMachine.doTransition	Critical	resourcemanager	zhihai xu	zhihai xu
HDFS-9196	Fix TestWebHdfsContentLength	Major	.	Tsuyoshi Ozawa	Masatake Iwasaki
HDFS-9178	Slow datanode I/O can cause a wrong node to be marked bad	Critical	.	Kihwal Lee	Kihwal Lee
HADOOP-12465	Incorrect javadoc in WritableUtils.java	Minor	documentation	Martin Petricek	Jagadesh Kiran N
HDFS-9176	TestDirectoryScanner#testThrottling often fails.	Minor	test	Yi Liu	Daniel Templeton
HDFS-9211	Fix incorrect version in hadoop-hdfs-native-client/pom.xml from HDFS-9170 branch-2 backport	Major	build	Eric Payne	Eric Payne
HDFS-9137	DeadLock between DataNode#refreshVolumes and BPOfferService#registrationSucceeded	Major	datanode	Uma Maheswara Rao G	Uma Maheswara Rao G
HDFS-8164	cTime is 0 in VERSION file for newly formatted NameNode.	Minor	namenode	Chris Nauroth	Xiao Chen
YARN-4235	FairScheduler PrimaryGroup does not handle empty groups returned for a user	Major	fairscheduler	Anubhav Dhoot	Anubhav Dhoot
MAPREDUCE-6302	Preempt reducers after a configurable timeout irrespective of headroom	Critical	.	mai shurong	Karthik Kambatla
HDFS-9142	Separating Configuration object for namenode(s) in MiniDFSCluster	Major	.	Siqi Li	Siqi Li
HDFS-8941	DistributedFileSystem listCorruptFileBlocks API should resolve relative path	Major	hdfs-client	Rakesh R	Rakesh R
HDFS-9222	Add hadoop-hdfs-client as a dependency of hadoop-hdfs-native-client	Major	.	Haohui Mai	Mingliang Liu
YARN-4201	AMBlacklist does not work for minicluster	Major	resourcemanager	Jun Gong	Jun Gong
HDFS-9215	Suppress the RAT warnings in hdfs-native-client module	Minor	.	Haohui Mai	Haohui Mai
HDFS-9224	TestFileTruncate fails intermittently with BindException	Major	test	Brahma Reddy Battula	Brahma Reddy Battula
YARN-4017	container-executor overuses PATH_MAX	Major	nodemanager	Allen Wittenauer	Sidharta Seethana
HDFS-8676	Delayed rolling upgrade finalization can cause heartbeat expiration and write failures	Critical	.	Kihwal Lee	Walter Su
HADOOP-12474	MiniKMS should use random ports for Jetty server by default	Major	.	Mingliang Liu	Mingliang Liu
HADOOP-12449	TestDNS and TestNetUtils failing if no network	Minor	test	Steve Loughran	Steve Loughran
HADOOP-11515	Upgrade jsch lib to jsch-0.1.51 to avoid problems running on java7	Major	build	Johannes Zillmann	Tsuyoshi Ozawa
HDFS-9235	hdfs-native-client build getting errors when built with cmake 2.6	Minor	hdfs-client	Eric Payne	Eric Payne
HDFS-8779	WebUI fails to display block IDs that are larger than 2^53 - 1	Minor	webhdfs	Walter Su	Haohui Mai
HDFS-9187	Fix null pointer error in Globber when FS was not constructed via FileSystem#createFileSystem	Major	tracing	stack	Colin P. McCabe
HDFS-1172	Blocks in newly completed files are considered under-replicated too quickly	Major	namenode	Todd Lipcon	Masatake Iwasaki
YARN-4250	NPE in AppSchedulingInfo#isRequestLabelChanged	Major	resourcemanager, scheduler	Brahma Reddy Battula	Brahma Reddy Battula
HADOOP-12478	Shell.getWinUtilsPath() has been renamed Shell.getWinutilsPath()	Critical	util	Steve Loughran	Steve Loughran
HDFS-9220	Reading small file (< 512 bytes) that is open for append fails due to incorrect checksum	Blocker	.	Bogdan Raducanu	Jing Zhao
HADOOP-12479	ProtocMojo does not log the reason for a protoc compilation failure.	Minor	build	Chris Nauroth	Chris Nauroth
HADOOP-11628	SPNEGO auth does not work with CNAMEs in JDK8	Blocker	security	Daryn Sharp	Daryn Sharp
YARN-2597	MiniYARNCluster should propagate reason for AHS not starting	Major	test	Steve Loughran	Steve Loughran
YARN-4155	TestLogAggregationService.testLogAggregationServiceWithInterval failing	Critical	test	Steve Loughran	Bibin A Chundatt
HADOOP-10941	Proxy user verification NPEs if remote host is unresolvable	Critical	ipc, security	Daryn Sharp	Benoy Antony
HADOOP-12483	Maintain wrapped SASL ordering for postponed IPC responses	Critical	ipc	Daryn Sharp	Daryn Sharp
HDFS-9237	NPE at TestDataNodeVolumeFailureToleration#tearDown	Major	test	Brahma Reddy Battula	Brahma Reddy Battula
HADOOP-12464	Interrupted client may try to fail-over and retry	Major	ipc	Kihwal Lee	Kihwal Lee
YARN-4270	Limit application resource reservation on nodes for non-node/rack specific requests	Major	fairscheduler	Arun Suresh	Arun Suresh
HDFS-9208	Disabling atime may fail clients like distCp	Major	.	Kihwal Lee	Kihwal Lee
HDFS-9270	TestShortCircuitLocalRead should not leave socket after unit test	Minor	test	Masatake Iwasaki	Masatake Iwasaki
HADOOP-12418	TestRPC.testRPCInterruptedSimple fails intermittently	Major	test	Steve Loughran	Kihwal Lee
MAPREDUCE-6495	Docs for archive-logs tool	Major	documentation	Robert Kanter	Robert Kanter
HDFS-3059	ssl-server.xml causes NullPointer	Minor	datanode, security	Evert Lammerts	Xiao Chen
HDFS-9274	Default value of dfs.datanode.directoryscan.throttle.limit.ms.per.sec should be consistent	Trivial	datanode	Yi Liu	Yi Liu
MAPREDUCE-6518	Set SO_KEEPALIVE on shuffle connections	Major	mrv2, nodemanager	Nathan Roberts	Chang Li
HDFS-9225	Fix intermittent test failure of TestBlockManager.testBlocksAreNotUnderreplicatedInSingleRack	Minor	test	Masatake Iwasaki	Masatake Iwasaki
HDFS-9273	ACLs on root directory may be lost after NN restart	Critical	namenode	Xiao Chen	Xiao Chen
YARN-4000	RM crashes with NPE if leaf queue becomes parent queue during restart	Major	capacityscheduler, resourcemanager	Jason Lowe	Varun Saxena
HADOOP-9692	Improving log message when SequenceFile reader throws EOFException on zero-length file	Major	.	Chu Tong	Zhe Zhang
YARN-4256	YARN fair scheduler vcores with decimal values	Minor	fairscheduler	Prabhu Joseph	Jun Gong
HADOOP-12484	Single File Rename Throws Incorrectly In Potential Race Condition Scenarios	Major	tools	Gaurav Kanade	Gaurav Kanade
HDFS-9286	HttpFs does not parse ACL syntax correctly for operation REMOVEACLENTRIES	Major	fs	Wei-Chiu Chuang	Wei-Chiu Chuang
YARN-4009	CORS support for ResourceManager REST API	Major	.	Prakash Ramachandran	Varun Vasudev
YARN-4041	Slow delegation token renewal can severely prolong RM recovery	Major	resourcemanager	Jason Lowe	Sunil Govindan
HDFS-9290	DFSClient#callAppend() is not backward compatible for slightly older NameNodes	Blocker	.	Tony Wu	Tony Wu
HDFS-9301	HDFS clients can’t construct HdfsConfiguration instances	Major	.	Steve Loughran	Mingliang Liu
YARN-4294	[JDK8] Fix javadoc errors caused by wrong reference and illegal tag	Blocker	build, documentation	Akira Ajisaka	Akira Ajisaka
YARN-4289	TestDistributedShell failing with bind exception	Major	test	Brahma Reddy Battula	Brahma Reddy Battula
YARN-4296	DistributedShell Log.info is not friendly	Major	applications/distributed-shell	Xiaowei Wang	Xiaowei Wang
YARN-4246	NPE while listing app attempt	Major	.	Varun Saxena	nijel
YARN-4223	Findbugs warnings in hadoop-yarn-server-nodemanager project	Minor	nodemanager	Varun Saxena	Varun Saxena
HADOOP-12513	Dockerfile lacks initial ‘apt-get update’	Trivial	build	Akihiro Suda	Akihiro Suda
YARN-4284	condition for AM blacklisting is too narrow	Major	resourcemanager	Sangjin Lee	Sangjin Lee
HDFS-9268	fuse_dfs chown crashes when uid is passed as -1	Minor	.	Wei-Chiu Chuang	Colin P. McCabe
HDFS-9284	fsck command should not print exception trace when file not found	Major	.	Jagadesh Kiran N	Jagadesh Kiran N
HDFS-9305	Delayed heartbeat processing causes storm of subsequent heartbeats	Major	datanode	Chris Nauroth	Arpit Agarwal
YARN-4169	Fix racing condition of TestNodeStatusUpdaterForLabels	Critical	test	Steve Loughran	Naganarasimha G R
YARN-4300	[JDK8] Fix javadoc errors caused by wrong tags	Blocker	build, documentation	Akira Ajisaka	Akira Ajisaka
YARN-4302	SLS not able start due to NPE in SchedulerApplicationAttempt#getResourceUsageReport	Major	.	Bibin A Chundatt	Bibin A Chundatt
HADOOP-12178	NPE during handling of SASL setup if problem with SASL resolver class	Minor	ipc	Steve Loughran	Steve Loughran
HADOOP-11685	StorageException complaining " no lease ID" during HBase distributed log splitting	Major	tools	Duo Xu	Duo Xu
HDFS-9231	fsck doesn’t list correct file path when Bad Replicas/Blocks are in a snapshot	Major	snapshots	Xiao Chen	Xiao Chen
HDFS-9302	WebHDFS truncate throws NullPointerException if newLength is not provided	Minor	webhdfs	Karthik Palaniappan	Jagadesh Kiran N
YARN-4251	TestAMRMClientOnRMRestart#testAMRMClientOnAMRMTokenRollOverOnRMRestart is failing	Major	test	Brahma Reddy Battula	Brahma Reddy Battula
HADOOP-12519	hadoop-azure tests should avoid creating a metrics configuration file in the module root directory.	Minor	fs/azure, test	Chris Nauroth	Chris Nauroth
HDFS-9279	Decomissioned capacity should not be considered for configured/used capacity	Major	.	Kuhu Shukla	Kuhu Shukla
HDFS-9044	Give Priority to FavouredNodes , before selecting nodes from FavouredNode’s Node Group	Major	.	J.Andreina	J.Andreina
YARN-4130	Duplicate declaration of ApplicationId in RMAppManager#submitApplication method	Trivial	resourcemanager	Kai Sasaki	Kai Sasaki
YARN-4288	NodeManager restart should keep retrying to register to RM while connection exception happens during RM failed over.	Critical	nodemanager	Junping Du	Junping Du
MAPREDUCE-6515	Update Application priority in AM side from AM-RM heartbeat	Major	applicationmaster	Sunil Govindan	Sunil Govindan
HDFS-9332	Fix Precondition failures from NameNodeEditLogRoller while saving namespace	Major	.	Andrew Wang	Andrew Wang
YARN-4313	Race condition in MiniMRYarnCluster when getting history server address	Major	.	Jian He	Jian He
YARN-4312	TestSubmitApplicationWithRMHA fails on branch-2.7 and branch-2.6 as some of the test cases time out	Major	.	Varun Saxena	Varun Saxena
YARN-4320	TestJobHistoryEventHandler fails as AHS in MiniYarnCluster no longer binds to default port 8188	Major	.	Varun Saxena	Varun Saxena
MAPREDUCE-6528	Memory leak for HistoryFileManager.getJobSummary()	Critical	jobhistoryserver	Junping Du	Junping Du
MAPREDUCE-6451	DistCp has incorrect chunkFilePath for multiple jobs when strategy is dynamic	Major	distcp	Kuhu Shukla	Kuhu Shukla
HADOOP-12533	Introduce FileNotFoundException in WASB for read and seek API	Major	tools	Dushyanth	Dushyanth
HADOOP-12508	delete fails with exception when lease is held on blob	Blocker	fs/azure	Gaurav Kanade	Gaurav Kanade
HDFS-9329	TestBootstrapStandby#testRateThrottling is flaky because fsimage size is smaller than IO buffer size	Minor	test	Zhe Zhang	Zhe Zhang
HDFS-9313	Possible NullPointerException in BlockManager if no excess replica can be chosen	Major	.	Ming Ma	Ming Ma
HADOOP-12542	TestDNS fails on Windows after HADOOP-12437.	Major	net	Chris Nauroth	Chris Nauroth
YARN-4326	Fix TestDistributedShell timeout as AHS in MiniYarnCluster no longer binds to default port 8188	Major	.	MENG DING	MENG DING
HDFS-9289	Make DataStreamer#block thread safe and verify genStamp in commitBlock	Critical	.	Chang Li	Chang Li
YARN-4127	RM fail with noAuth error if switched from failover mode to non-failover mode	Major	resourcemanager	Jian He	Varun Saxena
HDFS-9351	checkNNStartup() need to be called when fsck calls FSNamesystem.getSnapshottableDirs()	Major	namenode	Yongjun Zhang	Xiao Chen
HADOOP-12296	when setnetgrent returns 0 in linux, exception should be thrown	Major	.	Chang Li	Chang Li
HDFS-9357	NN UI renders icons of decommissioned DN incorrectly	Critical	.	Archana T	Surendra Singh Lilhore
HADOOP-12540	TestAzureFileSystemInstrumentation#testClientErrorMetrics fails intermittently due to assumption that a lease error will be thrown.	Major	fs/azure, test	Chris Nauroth	Gaurav Kanade
HDFS-9360	Storage type usage isn’t updated properly after file deletion	Major	.	Ming Ma	Ming Ma
HDFS-9378	hadoop-hdfs-client tests do not write logs.	Minor	test	Chris Nauroth	Chris Nauroth
HDFS-4937	ReplicationMonitor can infinite-loop in BlockPlacementPolicyDefault#chooseRandom()	Major	namenode	Kihwal Lee	Kihwal Lee
HDFS-9372	Remove dead code in DataStorage.recoverTransitionRead	Major	datanode	Duo Zhang	Duo Zhang
HDFS-9384	TestWebHdfsContentLength intermittently hangs and fails due to TCP conversation mismatch between client and server.	Minor	test	Chris Nauroth	Chris Nauroth
HDFS-6481	DatanodeManager#getDatanodeStorageInfos() should check the length of storageIDs	Minor	namenode	Ted Yu	Tsz Wo Nicholas Sze
HDFS-9318	considerLoad factor can be improved	Major	.	Kuhu Shukla	Kuhu Shukla
HDFS-9236	Missing sanity check for block size during block recovery	Major	datanode	Tony Wu	Tony Wu
HDFS-9394	branch-2 hadoop-hdfs-client fails during FileSystem ServiceLoader initialization, because HftpFileSystem is missing.	Critical	hdfs-client	Chris Nauroth	Mingliang Liu
HADOOP-12526	[Branch-2] there are duplicate dependency definitions in pom’s	Major	build	Sangjin Lee	Sangjin Lee
MAPREDUCE-5763	Warn message about httpshuffle in NM logs	Major	.	Sandy Ryza	Akira Ajisaka
HDFS-9383	TestByteArrayManager#testByteArrayManager fails	Major	.	Kihwal Lee	Tsz Wo Nicholas Sze
HDFS-9249	NPE is thrown if an IOException is thrown in NameNode constructor	Minor	namenode	Wei-Chiu Chuang	Wei-Chiu Chuang
HDFS-2261	AOP unit tests are not getting compiled or run	Minor	test	Giridharan Kesavan	Haohui Mai
HDFS-9401	Fix findbugs warnings in BlockRecoveryWorker	Major	.	Brahma Reddy Battula	Brahma Reddy Battula
HADOOP-12482	Race condition in JMX cache update	Major	.	Tony Wu	Tony Wu
HDFS-9364	Unnecessary DNS resolution attempts when creating NameNodeProxies	Major	ha, performance	Xiao Chen	Xiao Chen
HADOOP-12560	Fix sprintf warnings in {{DomainSocket.c}} introduced by HADOOP-12344	Major	native	Colin P. McCabe	Mingliang Liu
HDFS-9245	Fix findbugs warnings in hdfs-nfs/WriteCtx	Major	nfs	Mingliang Liu	Mingliang Liu
YARN-4241	Fix typo of property name in yarn-default.xml	Major	documentation	Anthony Rojas	Anthony Rojas
MAPREDUCE-6533	testDetermineCacheVisibilities of TestClientDistributedCacheManager is broken	Major	.	Chang Li	Chang Li
HDFS-9396	Total files and directories on jmx and web UI on standby is uninitialized	Blocker	.	Kihwal Lee	Kihwal Lee
MAPREDUCE-6540	TestMRTimelineEventHandling fails	Major	test	Sangjin Lee	Sangjin Lee
YARN-4347	Resource manager fails with Null pointer exception	Major	yarn	Yesha Vora	Jian He
HADOOP-12545	Hadoop javadoc has broken links for AccessControlList, ImpersonationProvider, DefaultImpersonationProvider, and DistCp	Major	documentation	Mohammad Arshad	Mohammad Arshad
YARN-4354	Public resource localization fails with NPE	Blocker	nodemanager	Jason Lowe	Jason Lowe
HDFS-9413	getContentSummary() on standby should throw StandbyException	Critical	.	Brahma Reddy Battula	Brahma Reddy Battula
HDFS-9358	TestNodeCount#testNodeCount timed out	Major	test	Wei-Chiu Chuang	Masatake Iwasaki
HDFS-9397	Fix typo for readChecksum() LOG.warn in BlockSender.java	Trivial	.	Enrique Flores	Enrique Flores
HDFS-9400	TestRollingUpgradeRollback fails on branch-2.	Blocker	.	Chris Nauroth	Brahma Reddy Battula
YARN-4367	SLS webapp doesn’t load	Major	scheduler-load-simulator	Karthik Kambatla	Karthik Kambatla
HDFS-9431	DistributedFileSystem#concat fails if the target path is relative.	Major	hdfs-client	Kazuho Fujii	Kazuho Fujii
YARN-2859	ApplicationHistoryServer binds to default port 8188 in MiniYARNCluster	Critical	timelineserver	Hitesh Shah	Vinod Kumar Vavilapalli
YARN-4374	RM capacity scheduler UI rounds user limit factor	Major	capacityscheduler	Chang Li	Chang Li
YARN-3769	Consider user limit when calculating total pending resource for preemption policy in Capacity Scheduler	Major	capacityscheduler	Eric Payne	Eric Payne
HDFS-9443	Disabling HDFS client socket cache causes logging message printed to console for CLI commands.	Trivial	hdfs-client	Chris Nauroth	Chris Nauroth
HADOOP-11218	Add TLSv1.1,TLSv1.2 to KMS, HttpFS, SSLFactory	Critical	kms	Robert Kanter	Vijay Singh
HADOOP-12467	Respect user-defined JAVA_LIBRARY_PATH in Windows Hadoop scripts	Minor	scripts	Radhey Shah	Radhey Shah
HADOOP-12181	Fix intermittent test failure of TestZKSignerSecretProvider	Minor	.	Masatake Iwasaki	Masatake Iwasaki
HDFS-6885	Fix wrong use of BytesWritable in FSEditLogOp#RenameOp	Minor	namenode	Yi Liu	Yi Liu
HADOOP-12098	Remove redundant test dependencies in Hadoop Archives	Minor	.	Varun Saxena	Varun Saxena
HDFS-7897	Shutdown metrics when stopping JournalNode	Major	.	zhouyingchao	zhouyingchao
HADOOP-11149	Increase the timeout of TestZKFailoverController	Major	test	Rajat Jain	Steve Loughran
HADOOP-11677	Add cookie flags for logs and static contexts	Major	.	nijel	nijel
HDFS-9356	Decommissioning node does not have Last Contact value in the UI	Major	.	Archana T	Surendra Singh Lilhore
HADOOP-12313	NPE in JvmPauseMonitor when calling stop() before start()	Critical	.	Rohith Sharma K S	Gabor Liptak
HDFS-9428	Fix intermittent failure of TestDNFencing.testQueueingWithAppend	Minor	test	Masatake Iwasaki	Masatake Iwasaki
HDFS-9435	TestBlockRecovery#testRBWReplicas is failing intermittently	Major	.	Rakesh R	Rakesh R
HADOOP-12577	Bump up commons-collections version to 3.2.2 to address a security flaw	Blocker	build, security	Wei-Chiu Chuang	Wei-Chiu Chuang
YARN-4344	NMs reconnecting with changed capabilities can lead to wrong cluster resource calculations	Critical	resourcemanager	Varun Vasudev	Varun Vasudev
HADOOP-9822	create constant MAX_CAPACITY in RetryCache rather than hard-coding 16 in RetryCache constructor	Minor	.	Tsuyoshi Ozawa	Tsuyoshi Ozawa
YARN-4298	Fix findbugs warnings in hadoop-yarn-common	Minor	.	Varun Saxena	Sunil Govindan
YARN-4387	Fix typo in FairScheduler log message	Minor	fairscheduler	Xin Wang	Xin Wang
HDFS-6101	TestReplaceDatanodeOnFailure fails occasionally	Major	test	Arpit Agarwal	Wei-Chiu Chuang
HDFS-8855	Webhdfs client leaks active NameNode connections	Major	webhdfs	Bob Hansen	Xiaobing Zhou
HDFS-8335	FSNamesystem should construct FSPermissionChecker only if permission is enabled	Major	.	David Bryson	Gabor Liptak
MAPREDUCE-5883	“Total megabyte-seconds” in job counters is slightly misleading	Minor	.	Nathan Roberts	Nathan Roberts
YARN-4365	FileSystemNodeLabelStore should check for root dir existence on startup	Major	resourcemanager	Jason Lowe	Kuhu Shukla
HDFS-8807	dfs.datanode.data.dir does not handle spaces between storageType and URI correctly	Major	datanode	Anu Engineer	Anu Engineer
HADOOP-12415	hdfs and nfs builds broken on -missing compile-time dependency on netty	Major	nfs	Konstantin Boudnik	Tom Zeng
MAPREDUCE-6553	Replace ‘\u2b05’ with ‘<-’ in rendering job configuration	Minor	jobhistoryserver	Akira Ajisaka	Gabor Liptak
HADOOP-12598	add XML namespace declarations for some hadoop/tools modules	Minor	build, tools	Xin Wang	Xin Wang
YARN-4380	TestResourceLocalizationService.testDownloadingResourcesOnContainerKill fails intermittently	Major	test	Tsuyoshi Ozawa	Varun Saxena
MAPREDUCE-6557	Some tests in mapreduce-client-app are writing outside of target	Blocker	build	Allen Wittenauer	Akira Ajisaka
HDFS-9459	hadoop-hdfs-native-client fails test build on Windows after transition to ctest.	Blocker	build, test	Chris Nauroth	Chris Nauroth
HDFS-9407	TestFileTruncate fails with BindException	Major	test	Brahma Reddy Battula	Brahma Reddy Battula
HDFS-9467	Fix data race accessing writeLockHeldTimeStamp in FSNamesystem	Major	namenode	Mingliang Liu	Mingliang Liu
MAPREDUCE-6549	multibyte delimiters with LineRecordReader cause duplicate records	Major	mrv1, mrv2	Dustin Cote	Wilfred Spiegelenburg
MAPREDUCE-6550	archive-logs tool changes log ownership to the Yarn user when using DefaultContainerExecutor	Major	.	Robert Kanter	Robert Kanter
HADOOP-12468	Partial group resolution failure should not result in user lockout	Minor	security	Wei-Chiu Chuang	Wei-Chiu Chuang
HDFS-9426	Rollingupgrade finalization is not backward compatible	Blocker	.	Kihwal Lee	Kihwal Lee
HADOOP-10406	TestIPC.testIpcWithReaderQueuing may fail	Major	ipc	Tsz Wo Nicholas Sze	Xiao Chen
HDFS-9470	Encryption zone on root not loaded from fsimage after NN restart	Critical	.	Xiao Chen	Xiao Chen
HDFS-9336	deleteSnapshot throws NPE when snapshotname is null	Major	.	Brahma Reddy Battula	Brahma Reddy Battula
HADOOP-12609	Fix intermittent failure of TestDecayRpcScheduler	Minor	ipc, test	Masatake Iwasaki	Masatake Iwasaki
HDFS-6533	TestBPOfferService#testBasicFunctionalitytest fails intermittently	Major	datanode, hdfs-client	Yongjun Zhang	Wei-Chiu Chuang
YARN-4398	Yarn recover functionality causes the cluster running slowly and the cluster usage rate is far below 100	Major	resourcemanager	NING DING	NING DING
HDFS-9294	DFSClient deadlock when close file and failed to renew lease	Blocker	hdfs-client	DENG FEI	Brahma Reddy Battula
HADOOP-12565	Replace DSA with RSA for SSH key type in SingleCluster.md	Minor	documentation	Alexander Veit	Mingliang Liu
YARN-4408	NodeManager still reports negative running containers	Major	nodemanager	Robert Kanter	Robert Kanter
HDFS-9430	Remove waitForLoadingFSImage since checkNNStartup has ensured image loaded and namenode started.	Major	.	Brahma Reddy Battula	Brahma Reddy Battula
YARN-4392	ApplicationCreatedEvent event time resets after RM restart/failover	Critical	.	Xuan Gong	Naganarasimha G R
YARN-4422	Generic AHS sometimes doesn’t show started, node, or logs on App page	Major	.	Eric Payne	Eric Payne
YARN-4424	Fix deadlock in RMAppImpl	Blocker	.	Yesha Vora	Jian He
HADOOP-12617	SPNEGO authentication request to non-default realm gets default realm name inserted in target server principal	Major	security	Matt Foley	Matt Foley
YARN-4431	Not necessary to do unRegisterNM() if NM get stop due to failed to connect to RM	Major	nodemanager	Junping Du	Junping Du
YARN-4421	Remove dead code in RmAppImpl.RMAppRecoveredTransition	Trivial	resourcemanager	Daniel Templeton	Daniel Templeton
HADOOP-12618	NPE in TestSequenceFile	Major	test	Brahma Reddy Battula	Brahma Reddy Battula
YARN-4434	NodeManager Disk Checker parameter documentation is not correct	Minor	documentation, nodemanager	Takashi Ohnishi	Weiwei Yang
HADOOP-12602	TestMetricsSystemImpl#testQSize occasionally fail	Major	test	Wei-Chiu Chuang	Masatake Iwasaki
HDFS-9519	Some coding improvement in SecondaryNameNode#main	Major	namenode	Yongjun Zhang	Xiao Chen
HDFS-9514	TestDistributedFileSystem.testDFSClientPeerWriteTimeout failing; exception being swallowed	Major	hdfs-client, test	Steve Loughran	Wei-Chiu Chuang
HDFS-9535	Newly completed blocks in IBR should not be considered under-replicated too quickly	Major	namenode	Jing Zhao	Mingliang Liu
YARN-4418	AM Resource Limit per partition can be updated to ResourceUsage as well	Major	resourcemanager	Sunil Govindan	Sunil Govindan
YARN-4403	(AM/NM/Container)LivelinessMonitor should use monotonic time when calculating period	Critical	.	Junping Du	Junping Du
YARN-4402	TestNodeManagerShutdown And TestNodeManagerResync fails with bind exception	Major	test	Brahma Reddy Battula	Brahma Reddy Battula
YARN-4439	Clarify NMContainerStatus#toString method.	Major	.	Jian He	Jian He
YARN-4440	FSAppAttempt#getAllowedLocalityLevelByTime should init the lastScheduler time	Major	fairscheduler	Yiqun Lin	Yiqun Lin
HDFS-9516	truncate file fails with data dirs on multiple disks	Major	datanode	Bogdan Raducanu	Plamen Jeliazkov
HDFS-8894	Set SO_KEEPALIVE on DN server sockets	Major	datanode	Nathan Roberts	Kanaka Kumar Avvaru
YARN-4461	Redundant nodeLocalityDelay log in LeafQueue	Trivial	capacityscheduler	Jason Lowe	Eric Payne
YARN-4452	NPE when submit Unmanaged application	Critical	.	Naganarasimha G R	Naganarasimha G R
HDFS-9565	TestDistributedFileSystem.testLocatedFileStatusStorageIdsTypes is flaky due to race condition	Minor	fs, test	Wei-Chiu Chuang	Wei-Chiu Chuang
YARN-4225	Add preemption status to yarn queue -status for capacity scheduler	Minor	capacity scheduler, yarn	Eric Payne	Eric Payne
HDFS-9515	NPE when MiniDFSCluster#shutdown is invoked on uninitialized reference	Minor	.	Wei-Chiu Chuang	Wei-Chiu Chuang
HDFS-9572	Prevent DataNode log spam if a client connects on the data transfer port but sends no data.	Major	datanode	Chris Nauroth	Chris Nauroth
HDFS-9533	seen_txid in the shared edits directory is modified during bootstrapping	Major	ha, namenode	Kihwal Lee	Kihwal Lee
HDFS-9571	Fix ASF Licence warnings in Jenkins reports	Major	test	Brahma Reddy Battula	Brahma Reddy Battula
HDFS-9393	After choosing favored nodes, choosing nodes for remaining replicas should go through BlockPlacementPolicy	Major	.	J.Andreina	J.Andreina
HDFS-9347	Invariant assumption in TestQuorumJournalManager.shutdown() is wrong	Major	test	Wei-Chiu Chuang	Wei-Chiu Chuang
HADOOP-12656	MiniKdc throws “address in use” BindException	Major	.	Wei-Chiu Chuang	Wei-Chiu Chuang
HADOOP-12636	Prevent ServiceLoader failure init for unused FileSystems	Major	fs	Íñigo Goiri	Íñigo Goiri
MAPREDUCE-6583	Clarify confusing sentence in MapReduce tutorial document	Minor	documentation	chris snow	Kai Sasaki
HDFS-9505	HDFS Architecture documentation needs to be refreshed.	Major	documentation	Chris Nauroth	Masatake Iwasaki
YARN-4454	NM to nodelabel mapping going wrong after RM restart	Critical	.	Bibin A Chundatt	Bibin A Chundatt
HDFS-9580	TestComputeInvalidateWork#testDatanodeReRegistration failed due to unexpected number of invalidate blocks.	Major	datanode, namenode, test	Wei-Chiu Chuang	Wei-Chiu Chuang
YARN-4477	FairScheduler: Handle condition which can result in an infinite loop in attemptScheduling.	Major	fairscheduler	Tao Jie	Tao Jie
HDFS-9589	Block files which have been hardlinked should be duplicated before the DataNode appends to the them	Major	datanode	Colin P. McCabe	Colin P. McCabe
HDFS-9458	TestBackupNode always binds to port 50070, which can cause bind failures.	Major	test	Chris Nauroth	Xiao Chen
HDFS-9034	“StorageTypeStats” Metric should not count failed storage.	Major	namenode	Archana T	Surendra Singh Lilhore
YARN-4109	Exception on RM scheduler page loading with labels	Minor	.	Bibin A Chundatt	Mohammad Shahid Khan
MAPREDUCE-6419	JobHistoryServer doesn’t sort properly based on Job ID when Job id’s exceed 9999	Major	webapps	Devaraj K	Mohammad Shahid Khan
HDFS-9597	BaseReplicationPolicyTest should update data node stats after adding a data node	Minor	datanode, test	Wei-Chiu Chuang	Wei-Chiu Chuang
HADOOP-12681	start-build-env.sh fails in branch-2	Blocker	build	Akira Ajisaka	Kengo Seki
HDFS-7163	WebHdfsFileSystem should retry reads according to the configured retry policy.	Major	webhdfs	Eric Payne	Eric Payne
HADOOP-12559	KMS connection failures should trigger TGT renewal	Major	security	Zhe Zhang	Zhe Zhang
MAPREDUCE-6574	MR AM should print host of failed tasks.	Major	.	Wangda Tan	Mohammad Shahid Khan
MAPREDUCE-6589	TestTaskLog outputs a log under directory other than target/test-dir	Major	test	Akira Ajisaka	Akira Ajisaka
YARN-4315	NaN in Queue percentage for cluster apps page	Minor	.	Bibin A Chundatt	Bibin A Chundatt
YARN-1382	Remove unusableRMNodesConcurrentSet (never used) in NodeListManager to get rid of memory leak	Major	resourcemanager	Alejandro Abdelnur	Rohith Sharma K S
HADOOP-12682	Fix TestKMS#testKMSRestart* failure	Major	.	Wei-Chiu Chuang	Wei-Chiu Chuang
HADOOP-12608	Fix exception message in WASB when connecting with anonymous credential	Major	tools	Dushyanth	Dushyanth
YARN-4524	Cleanup AppSchedulingInfo	Major	scheduler	Karthik Kambatla	Karthik Kambatla
YARN-4510	Fix SLS startup failure caused by NPE	Critical	.	Bibin A Chundatt	Bibin A Chundatt
MAPREDUCE-6593	TestJobHistoryEventHandler.testTimelineEventHandling fails on trunk because of NPE	Major	.	Tsuyoshi Ozawa	Naganarasimha G R
HDFS-9445	Datanode may deadlock while handling a bad volume	Blocker	.	Kihwal Lee	Walter Su
HADOOP-12658	Clear javadoc and check style issues around DomainSocket	Trivial	.	Kai Zheng	Kai Zheng
HADOOP-12604	Exception may be swallowed in KMSClientProvider	Major	kms	Yongjun Zhang	Yongjun Zhang
HDFS-9605	Add links to failed volumes to explorer.html in HDFS Web UI	Minor	.	Archana T	Archana T
MAPREDUCE-6577	MR AM unable to load native library without MR_AM_ADMIN_USER_ENV set	Critical	mr-am	Sangjin Lee	Sangjin Lee
HADOOP-12689	S3 filesystem operations stopped working correctly	Major	tools	Matthew Paduano	Matthew Paduano
YARN-4546	ResourceManager crash due to scheduling opportunity overflow	Critical	resourcemanager	Jason Lowe	Jason Lowe
HADOOP-12634	Change Lazy Rename Pending Operation Completion of WASB to address case of potential data loss due to partial copy	Critical	.	Gaurav Kanade	Gaurav Kanade
HDFS-9600	do not check replication if the block is under construction	Critical	.	Phil Yang	Phil Yang
HDFS-9619	SimulatedFSDataset sometimes can not find blockpool for the correct namenode	Major	datanode, test	Wei-Chiu Chuang	Wei-Chiu Chuang
HADOOP-12675	Fix description about retention period in usage of expunge command	Minor	documentation	Masatake Iwasaki	Masatake Iwasaki
HADOOP-12613	TestFind.processArguments occasionally fails	Major	test	Wei-Chiu Chuang	Wei-Chiu Chuang
MAPREDUCE-6508	TestNetworkedJob fails consistently due to delegation token changes on RM.	Major	test	Rohith Sharma K S	Akira Ajisaka
HDFS-9574	Reduce client failures during datanode restart	Major	.	Kihwal Lee	Kihwal Lee
HDFS-9493	Test o.a.h.hdfs.server.namenode.TestMetaSave fails in trunk	Major	test	Mingliang Liu	Tony Wu
HADOOP-12678	Handle empty rename pending metadata file during atomic rename in redo path	Critical	fs/azure	madhumita chakraborty	madhumita chakraborty
HADOOP-12590	TestCompressorDecompressor failing without stack traces	Critical	test	Steve Loughran	John Zhuge
HADOOP-12587	Hadoop AuthToken refuses to work without a maxinactive attribute in issued token	Blocker	security	Steve Loughran	Benoy Antony
HADOOP-12551	Introduce FileNotFoundException for WASB FileSystem API	Major	tools	Dushyanth	Dushyanth
MAPREDUCE-6068	Illegal progress value warnings in map tasks	Major	mrv2, task	Todd Lipcon	Binglin Chang
HDFS-9639	Inconsistent Logging in BootstrapStandby	Minor	ha	BELUGA BEHR	Xiaobing Zhou
HDFS-9584	NPE in distcp when ssl configuration file does not exist in class path.	Major	distcp	Surendra Singh Lilhore	Surendra Singh Lilhore
HADOOP-12584	Disable browsing the static directory in HttpServer2	Major	security	Robert Kanter	Robert Kanter
YARN-4567	javadoc failing on java 8	Blocker	build	Steve Loughran	Steve Loughran
YARN-4414	Nodemanager connection errors are retried at multiple levels	Major	nodemanager	Jason Lowe	Chang Li
HADOOP-12603	TestSymlinkLocalFSFileContext#testSetTimesSymlinkToDir occasionally fail	Major	test	Wei-Chiu Chuang	Wei-Chiu Chuang
YARN-4534	Remove the redundant symbol in yarn rmadmin help msg	Trivial	.	Yiqun Lin	Yiqun Lin
HADOOP-12700	Remove unused import in TestCompressorDecompressor.java	Minor	.	John Zhuge	John Zhuge
MAPREDUCE-6601	Fix typo in Job#setUseNewAPI	Trivial	.	Kai Sasaki	Kai Sasaki
YARN-3446	FairScheduler headroom calculation should exclude nodes in the blacklist	Major	fairscheduler	zhihai xu	zhihai xu
HDFS-9648	TestStartup.testImageChecksum is broken by HDFS-9569’s message change	Trivial	namenode	Wei-Chiu Chuang	Wei-Chiu Chuang
HADOOP-12706	TestLocalFsFCStatistics#testStatisticsThreadLocalDataCleanUp times out occasionally	Major	test	Jason Lowe	Sangjin Lee
YARN-4581	AHS writer thread leak makes RM crash while RM is recovering	Major	resourcemanager	sandflee	sandflee
MAPREDUCE-6554	MRAppMaster servicestart failing with NPE in MRAppMaster#parsePreviousJobHistory	Critical	.	Bibin A Chundatt	Bibin A Chundatt
YARN-4389	“yarn.am.blacklisting.enabled” and “yarn.am.blacklisting.disable-failure-threshold” should be app specific rather than a setting for whole YARN cluster	Critical	applications	Junping Du	Sunil Govindan
HDFS-9612	DistCp worker threads are not terminated after jobs are done.	Major	distcp	Wei-Chiu Chuang	Wei-Chiu Chuang
HADOOP-12712	Fix some cmake plugin and native build warnings	Minor	native	Colin P. McCabe	Colin P. McCabe
YARN-4538	QueueMetrics pending cores and memory metrics wrong	Major	.	Bibin A Chundatt	Bibin A Chundatt
YARN-4596	SystemMetricPublisher should not swallow error messages from TimelineClient#putEntities	Major	timelineserver	Li Lu	Li Lu
YARN-4502	Fix two AM containers get allocated when AM restart	Critical	.	Yesha Vora	Vinod Kumar Vavilapalli
HDFS-9623	Update example configuration of block state change log in log4j.properties	Minor	logging	Masatake Iwasaki	Masatake Iwasaki
YARN-4565	When sizeBasedWeight enabled for FairOrderingPolicy in CapacityScheduler, Sometimes lead to situation where all queue resources consumed by AMs only	Major	capacity scheduler, capacityscheduler	Karam Singh	Wangda Tan
HADOOP-12356	Fix computing CPU usage statistics on Windows	Major	util	Yunqi Zhang	Íñigo Goiri
HDFS-9661	Deadlock in DN.FsDatasetImpl between moveBlockAcrossStorage and createRbw	Major	datanode	ade	ade
HDFS-9655	NN should start JVM pause monitor before loading fsimage	Critical	.	John Zhuge	John Zhuge
YARN-4559	Make leader elector and zk store share the same curator client	Major	.	Jian He	Jian He
HADOOP-12605	Fix intermittent failure of TestIPC.testIpcWithReaderQueuing	Minor	test	Masatake Iwasaki	Masatake Iwasaki
HDFS-9625	set replication for empty file failed when set storage policy	Major	namenode	DENG FEI	DENG FEI
HADOOP-12423	Handle failure of registering shutdownhook by ShutdownHookManager in static block	Minor	fs	Abhishek Agarwal	Abhishek Agarwal
HDFS-9634	webhdfs client side exceptions don’t provide enough details	Major	webhdfs	Eric Payne	Eric Payne
YARN-4608	Redundant code statement in WritingYarnApplications	Minor	documentation	Kai Sasaki	Kai Sasaki
HADOOP-7161	Remove unnecessary oro package from dependency management section	Minor	build	Todd Lipcon	Sean Busbey
YARN-4610	Reservations continue looking for one app causes other apps to starve	Blocker	capacityscheduler	Jason Lowe	Jason Lowe
HADOOP-12659	Incorrect usage of config parameters in token manager of KMS	Major	security	Tianyin Xu	Mingliang Liu
MAPREDUCE-6605	Fix typos mapreduce.map.skip.proc.count.autoincr and mapreduce.reduce.skip.proc.count.autoincr in mapred-default.xml	Major	documentation	Dong Zhen	Kai Sasaki
YARN-4605	Spelling mistake in the help message of “yarn applicationattempt” command	Trivial	client	Manjunath Ballur	Weiwei Yang
HDFS-9682	Fix a typo “aplication” in HttpFS document	Trivial	documentation	Weiwei Yang	Weiwei Yang
HADOOP-12730	Hadoop streaming -mapper and -reducer options are wrongly documented as required	Major	documentation	DeepakVohra	Kengo Seki
HDFS-8898	Create API and command-line argument to get quota and quota usage without detailed content summary	Major	fs	Joep Rottinghuis	Ming Ma
YARN-4598	Invalid event: RESOURCE_FAILED at CONTAINER_CLEANEDUP_AFTER_KILL	Major	nodemanager	tangshangwen	tangshangwen
YARN-4592	Remove unused GetContainerStatus proto	Minor	.	Chang Li	Chang Li
YARN-4520	FinishAppEvent is leaked in leveldb if no app’s container running on this node	Major	nodemanager	sandflee	sandflee
MAPREDUCE-6610	JobHistoryEventHandler should not swallow timeline response	Trivial	.	Li Lu	Li Lu
HDFS-9690	ClientProtocol.addBlock is not idempotent after HDFS-8071	Major	namenode	Tsz Wo Nicholas Sze	Tsz Wo Nicholas Sze
HADOOP-12743	Fix git environment check during test-patch	Major	.	Ray Chiang	Allen Wittenauer
HADOOP-12735	core-default.xml misspells hadoop.workaround.non.threadsafe.getpwuid	Minor	.	Ray Chiang	Ray Chiang
MAPREDUCE-6619	HADOOP_CLASSPATH is overwritten in MR container	Major	mrv2	shanyu zhao	Junping Du
HDFS-8999	Allow a file to be closed with COMMITTED but not yet COMPLETE blocks.	Major	namenode	Jitendra Nath Pandey	Tsz Wo Nicholas Sze
MAPREDUCE-6595	Fix findbugs warnings in OutputCommitter and FileOutputCommitter	Major	.	Akira Ajisaka	Akira Ajisaka
MAPREDUCE-6563	Streaming documentation contains a stray ‘%’ character.	Trivial	documentation	Chris Nauroth	Chris Nauroth
YARN-4519	potential deadlock of CapacityScheduler between decrease container and assign containers	Major	capacityscheduler	sandflee	MENG DING
MAPREDUCE-6616	Fail to create jobhistory file if there are some multibyte characters in the job name	Major	jobhistoryserver	Akira Ajisaka	Kousuke Saruta
YARN-4411	RMAppAttemptImpl#createApplicationAttemptReport throws IllegalArgumentException	Major	resourcemanager	yarntime	Bibin A Chundatt
YARN-4617	LeafQueue#pendingOrderingPolicy should always use fixed ordering policy instead of using same as active applications ordering policy	Major	capacity scheduler	Rohith Sharma K S	Rohith Sharma K S
YARN-4428	Redirect RM page to AHS page when AHS turned on and RM page is not available	Major	.	Chang Li	Chang Li
MAPREDUCE-6618	YarnClientProtocolProvider leaking the YarnClient thread.	Major	.	Xuan Gong	Xuan Gong
HDFS-9210	Fix some misuse of %n in VolumeScanner#printStats	Minor	datanode	Xiaoyu Yao	Xiaoyu Yao
HDFS-9701	DN may deadlock when hot-swapping under load	Major	.	Xiao Chen	Xiao Chen
YARN-3102	Decommisioned Nodes not listed in Web UI	Minor	resourcemanager	Bibin A Chundatt	Kuhu Shukla
HDFS-9406	FSImage may get corrupted after deleting snapshot	Major	namenode	Stanislav Antic	Yongjun Zhang
HDFS-9718	HAUtil#getConfForOtherNodes should unset independent generic keys before initialize	Major	namenode	DENG FEI	DENG FEI
HDFS-9708	FSNamesystem.initAuditLoggers() doesn’t trim classnames	Minor	fs	Steve Loughran	Mingliang Liu
MAPREDUCE-6621	Memory Leak in JobClient#submitJobInternal()	Major	.	Xuan Gong	Xuan Gong
HADOOP-12755	Fix typo in defaultFS warning message	Trivial	.	Andrew Wang	Andrew Wang
HDFS-9739	DatanodeStorage.isValidStorageId() is broken	Critical	hdfs-client	Kihwal Lee	Mingliang Liu
HDFS-9740	Use a reasonable limit in DFSTestUtil.waitForMetric()	Major	test	Kihwal Lee	Chang Li
HADOOP-12761	incremental maven build is not really incremental	Minor	build	Sangjin Lee	Sangjin Lee
HDFS-9748	When addExpectedReplicasToPending is called twice, pendingReplications should avoid duplication	Minor	.	Walter Su	Walter Su
HDFS-9730	Storage ID update does not happen when there is a layout change	Major	datanode	Kihwal Lee	Tsz Wo Nicholas Sze
HDFS-9724	Degraded performance in WebHDFS listing as it does not reuse ObjectMapper	Critical	performance	Akira Ajisaka	Akira Ajisaka
HADOOP-12766	The default value of “hadoop.workaround.non.threadsafe.getpwuid” is different between core-default.xml and NativeIO.java	Minor	.	Akira Ajisaka	Akira Ajisaka
HDFS-9761	Rebalancer sleeps too long between iterations	Blocker	balancer & mover	Adrian Bridgett	Mingliang Liu
HDFS-9713	DataXceiver#copyBlock should return if block is pinned	Major	datanode	Uma Maheswara Rao G	Uma Maheswara Rao G
HADOOP-12773	HBase classes fail to load with client/job classloader enabled	Major	util	Sangjin Lee	Sangjin Lee
HDFS-9777	Fix typos in DFSAdmin command line and documentation	Trivial	hdfs-client	Wei-Chiu Chuang	Wei-Chiu Chuang
HDFS-9784	Example usage is not correct in Transparent Encryption document	Major	documentation	Takashi Ohnishi	Takashi Ohnishi
HDFS-9752	Permanent write failures may happen to slow writers during datanode rolling upgrades	Critical	.	Kihwal Lee	Walter Su
HDFS-9760	WebHDFS AuthFilter cannot be configured with custom AltKerberos auth handler	Major	webhdfs	Ryan Sasson	Ryan Sasson
HDFS-9779	TestReplicationPolicyWithNodeGroup NODE variable picks wrong rack value	Minor	test	Kuhu Shukla	Kuhu Shukla
HADOOP-12792	TestUserGroupInformation#testGetServerSideGroups fails in chroot	Minor	security, test	Eric Badger	Eric Badger
HDFS-9788	Incompatible tag renumbering in HeartbeatResponseProto	Blocker	rolling upgrades	Andrew Wang	Andrew Wang
HADOOP-12795	KMS does not log detailed stack trace for unexpected errors.	Major	kms	Chris Nauroth	Chris Nauroth
HADOOP-12699	TestKMS#testKMSProvider intermittently fails during ‘test rollover draining’	Major	.	Xiao Chen	Xiao Chen
HDFS-9790	HDFS Balancer should exit with a proper message if upgrade is not finalized	Major	.	Xiaobing Zhou	Xiaobing Zhou
HDFS-9801	ReconfigurableBase should update the cached configuration	Major	datanode	Arpit Agarwal	Arpit Agarwal
HADOOP-12780	During WASB atomic rename handle crash when one directory has been renamed but not file under it.	Critical	fs/azure	madhumita chakraborty	madhumita chakraborty
HADOOP-12589	Fix intermittent test failure of TestCopyPreserveFlag	Major	test	Tsuyoshi Ozawa	Masatake Iwasaki
HADOOP-12786	“hadoop key” command usage is not documented	Major	documentation	Akira Ajisaka	Xiao Chen
HDFS-9765	TestBlockScanner#testVolumeIteratorWithCaching fails intermittently	Major	test	Mingliang Liu	Akira Ajisaka
HDFS-9456	BlockPlacementPolicyWithNodeGroup should override verifyBlockPlacement	Major	.	Junping Du	Xiaobing Zhou
HADOOP-12810	FileSystem#listLocatedStatus causes unnecessary RPC calls	Major	fs, fs/s3	Ryan Blue	Ryan Blue
MAPREDUCE-6341	Fix typo in mapreduce tutorial	Trivial	.	John Michael Luy	John Michael Luy
HADOOP-12787	KMS SPNEGO sequence does not work with WEBHDFS	Major	kms, security	Xiaoyu Yao	Xiaoyu Yao
HDFS-9815	Move o.a.h.fs.Hdfs to hadoop-hdfs-client	Blocker	.	Haohui Mai	Vinayakumar B
HDFS-9799	Reimplement getCurrentTrashDir to remove incompatibility	Blocker	.	Zhe Zhang	Zhe Zhang
YARN-4654	Yarn node label CLI should parse “=” correctly when trying to remove all labels on a node	Major	.	Wangda Tan	Naganarasimha G R
HDFS-6832	Fix the usage of ‘hdfs namenode’ command	Minor	.	Akira Ajisaka	Manjunath Ballur
HDFS-8923	Add -source flag to balancer usage message	Trivial	balancer & mover, documentation	Chris Trezzo	Chris Trezzo
HDFS-9764	DistCp doesn’t print value for several arguments including -numListstatusThreads	Minor	distcp	Yongjun Zhang	Wei-Chiu Chuang
MAPREDUCE-6637	Testcase Failure : TestFileInputFormat.testSplitLocationInfo	Major	test	Brahma Reddy Battula	Brahma Reddy Battula
HDFS-9839	Reduce verbosity of processReport logging	Major	namenode	Arpit Agarwal	Arpit Agarwal
HDFS-7452	skip StandbyException log for getCorruptFiles()	Minor	.	Brahma Reddy Battula	Brahma Reddy Battula
YARN-4707	Remove the extra char (>) from SecureContainer.md	Major	documentation	Brahma Reddy Battula	Brahma Reddy Battula
YARN-4386	refreshNodesGracefully() should send recommission event to active RMNodes only	Minor	graceful	Kuhu Shukla	Kuhu Shukla
HDFS-9842	dfs.datanode.balance.bandwidthPerSec should accept friendly size units	Minor	balancer & mover	Yiqun Lin	Yiqun Lin
YARN-4709	NMWebServices produces incorrect JSON for containers	Critical	.	Varun Saxena	Varun Saxena
MAPREDUCE-6635	Unsafe long to int conversion in UncompressedSplitLineReader and IndexOutOfBoundsException	Critical	.	Sergey Shelukhin	Junping Du
HDFS-9549	TestCacheDirectives#testExceedsCapacity is flaky	Major	.	Wei-Chiu Chuang	Xiao Chen
YARN-2046	Out of band heartbeats are sent only on container kill and possibly too early	Major	nodemanager	Jason Lowe	Ming Ma
HDFS-9844	Correct path creation in getTrashRoot to handle root dir	Blocker	encryption	Zhe Zhang	Zhe Zhang
YARN-4722	AsyncDispatcher logs redundant event queue sizes	Major	.	Jason Lowe	Jason Lowe
HADOOP-12716	KerberosAuthenticator#doSpnegoSequence use incorrect class to determine isKeyTab in JDK8	Major	security	Xiaoyu Yao	Xiaoyu Yao
HDFS-9855	Modify TestAuditLoggerWithCommands to workaround the absence of HDFS-8332	Major	test	Kuhu Shukla	Kuhu Shukla
YARN-4723	NodesListManager$UnknownNodeId ClassCastException	Critical	resourcemanager	Jason Lowe	Kuhu Shukla
HADOOP-12849	TestSymlinkLocalFSFileSystem fails intermittently	Major	test	Mingliang Liu	Mingliang Liu
HADOOP-12831	LocalFS/FSOutputSummer NPEs in constructor if bytes per checksum set to 0	Minor	fs	Steve Loughran	Mingliang Liu
HADOOP-12846	Credential Provider Recursive Dependencies	Major	.	Larry McCay	Larry McCay
HDFS-9864	Correct reference for RENEWDELEGATIONTOKEN and CANCELDELEGATIONTOKEN in webhdfs doc	Major	documentation	Brahma Reddy Battula	Brahma Reddy Battula
HADOOP-12622	RetryPolicies (other than FailoverOnNetworkExceptionRetry) should put on retry failed reason or the log from RMProxy’s retry could be very misleading.	Critical	auto-failover	Junping Du	Junping Du
YARN-4748	ApplicationHistoryManagerOnTimelineStore should not swallow exceptions on generateApplicationReport	Major	timelineserver	Li Lu	Li Lu
HADOOP-12851	S3AFileSystem Uptake of ProviderUtils.excludeIncompatibleCredentialProviders	Major	fs/s3	Larry McCay	Larry McCay
HADOOP-12843	Fix findbugs warnings in hadoop-common (branch-2)	Major	.	Akira Ajisaka	Akira Ajisaka
HDFS-9870	Remove unused imports from DFSUtil	Major	.	Brahma Reddy Battula	Brahma Reddy Battula
HDFS-8791	block ID-based DN storage layout can be very slow for datanode on ext4	Blocker	datanode	Nathan Roberts	Chris Trezzo
HDFS-9880	TestDatanodeRegistration fails occasionally	Major	test	Kihwal Lee	Kihwal Lee
HDFS-9881	DistributedFileSystem#getTrashRoot returns incorrect path for encryption zones	Critical	.	Andrew Wang	Andrew Wang
HDFS-9766	TestDataNodeMetrics#testDataNodeTimeSpend fails intermittently	Major	test	Mingliang Liu	Xiao Chen
HDFS-9851	Name node throws NPE when setPermission is called on a path that does not exist	Critical	namenode	David Yan	Brahma Reddy Battula
HDFS-9886	Configuration properties for hedged read is broken	Blocker	.	Akira Ajisaka	Akira Ajisaka
HADOOP-12870	Fix typo admininistration in CommandsManual.md	Minor	documentation	Akira Ajisaka	John Zhuge
HDFS-9048	DistCp documentation is out-of-dated	Major	.	Haohui Mai	Daisuke Kobayashi
HADOOP-12871	Fix dead link to NativeLibraries.html in CommandsManual.md	Minor	documentation	Akira Ajisaka	Brahma Reddy Battula
HADOOP-12872	Fix formatting in ServiceLevelAuth.md	Trivial	documentation	Akira Ajisaka	Brahma Reddy Battula
MAPREDUCE-4785	TestMRApp occasionally fails	Major	mrv2, test	Jason Lowe	Haibo Chen
HADOOP-12717	NPE when trying to rename a directory in Windows Azure Storage FileSystem	Blocker	.	Robert Yokota	Robert Yokota
YARN-4763	RMApps Page crashes with NPE	Major	webapp	Bibin A Chundatt	Bibin A Chundatt
YARN-4761	NMs reconnecting with changed capabilities can lead to wrong cluster resource calculations on fair scheduler	Major	fairscheduler	Sangjin Lee	Sangjin Lee
YARN-4744	Too many signal to container failure in case of LCE	Major	.	Bibin A Chundatt	Sidharta Seethana
YARN-4760	proxy redirect to history server uses wrong URL	Major	webapp	Jason Lowe	Eric Badger
HDFS-9865	TestBlockReplacement fails intermittently in trunk	Major	test	Yiqun Lin	Yiqun Lin
HDFS-9812	Streamer threads leak if failure happens when closing DFSOutputStream	Major	hdfs-client	Yiqun Lin	Yiqun Lin
HADOOP-12688	Fix deadlinks in Compatibility.md	Major	documentation	Akira Ajisaka	Gabor Liptak
HADOOP-12903	IPC Server should allow suppressing exception logging by type, not log ‘server too busy’ messages	Major	ipc	Arpit Agarwal	Arpit Agarwal
HDFS-9934	ReverseXML oiv processor should bail out if the XML file’s layoutVersion doesn’t match oiv’s	Major	tools	Colin P. McCabe	Colin P. McCabe
HDFS-9933	ReverseXML should be capitalized in oiv usage message	Minor	tools	Colin P. McCabe	Colin P. McCabe
HDFS-9953	Download File from UI broken after pagination	Blocker	namenode	Brahma Reddy Battula	Brahma Reddy Battula
HDFS-9904	testCheckpointCancellationDuringUpload occasionally fails	Major	test	Kihwal Lee	Yiqun Lin
MAPREDUCE-6579	JobStatus#getFailureInfo should not output diagnostic information when the job is running	Blocker	test	Rohith Sharma K S	Akira Ajisaka
MAPREDUCE-6645	TestWordStats outputs logs under directories other than target/test-dir	Major	test	Akira Ajisaka	Gabor Liptak
HDFS-9874	Long living DataXceiver threads cause volume shutdown to block.	Critical	datanode	Rushabh S Shah	Rushabh S Shah
HDFS-3677	dfs.namenode.edits.dir.required missing from hdfs-default.xml	Major	documentation, namenode	Todd Lipcon	Mark Yang
HDFS-7166	SbNN Web UI shows #Under replicated blocks and #pending deletion blocks	Major	ha	Juan Yu	Wei-Chiu Chuang
YARN-4686	MiniYARNCluster.start() returns before cluster is completely started	Major	test	Rohith Sharma K S	Eric Badger
MAPREDUCE-6363	[NNBench] Lease mismatch error when running with multiple mappers	Critical	benchmarks	Brahma Reddy Battula	Bibin A Chundatt
HDFS-10189	PacketResponder#toString should include the downstreams for PacketResponderType.HAS_DOWNSTREAM_IN_PIPELINE	Minor	datanode	Joe Pallas	Joe Pallas
MAPREDUCE-6580	Test failure : TestMRJobsWithProfiler	Major	.	Rohith Sharma K S	Eric Badger
MAPREDUCE-6656	[NNBench] OP_DELETE operation isn’t working after MAPREDUCE-6363	Blocker	.	J.Andreina	J.Andreina
HDFS-10193	fuse_dfs segfaults if uid cannot be resolved to a username	Major	fuse-dfs	John Thiltges	John Thiltges
HDFS-10199	Unit tests TestCopyFiles, TestDistCh, TestLogalyzer under org.apache.hadoop.tools are failing	Minor	.	Tibor Kiss	Tibor Kiss
YARN-4820	ResourceManager web redirects in HA mode drops query parameters	Major	.	Varun Vasudev	Varun Vasudev
YARN-4850	test-fair-scheduler.xml isn’t valid xml	Blocker	fairscheduler, test	Allen Wittenauer	Yufei Gu
HADOOP-12962	KMS key names are incorrectly encoded when creating key	Major	.	Xiao Chen	Xiao Chen
HADOOP-12958	PhantomReference for filesystem statistics can trigger OOM	Major	.	Jason Lowe	Sangjin Lee
HADOOP-12873	Remove MRv1 terms from HttpAuthentication.md	Major	documentation	Akira Ajisaka	Brahma Reddy Battula
HDFS-10182	Hedged read might overwrite user’s buf	Major	.	zhouyingchao	zhouyingchao
YARN-4773	Log aggregation performs extraneous filesystem operations when rolling log aggregation is disabled	Minor	nodemanager	Jason Lowe	Jun Gong
MAPREDUCE-6662	Clear ASF Warnings on test data files	Minor	.	Vinayakumar B	Vinayakumar B
HDFS-9871	“Bytes Being Moved” -ve(-1 B) when cluster was already balanced.	Major	.	Brahma Reddy Battula	Brahma Reddy Battula
YARN-4863	AHS Security login should be in serviceInit() instead of serviceStart()	Major	timelineserver	Junping Du	Junping Du
HDFS-10197	TestFsDatasetCache failing intermittently due to timeout	Major	test	Yiqun Lin	Yiqun Lin
HDFS-9478	Reason for failing ipc.FairCallQueue contruction should be thrown	Minor	.	Archana T	Ajith S
HDFS-10228	TestHDFSCLI fails	Major	test	Akira Ajisaka	Akira Ajisaka
YARN-4865	Track Reserved resources in ResourceUsage and QueueCapacities	Major	resourcemanager	Sunil Govindan	Sunil Govindan
HADOOP-12972	Lz4Compressor#getLibraryName returns the wrong version number	Trivial	native	John Zhuge	Colin P. McCabe
HDFS-5177	blocksScheduled count should be decremented for abandoned blocks	Major	namenode	Vinayakumar B	Vinayakumar B
HDFS-10223	peerFromSocketAndKey performs SASL exchange before setting connection timeouts	Major	.	Colin P. McCabe	Colin P. McCabe
HDFS-10221	Add .json to the rat exclusions	Blocker	build	Ming Ma	Ming Ma
HADOOP-12902	JavaDocs for SignerSecretProvider are out-of-date in AuthenticationFilter	Major	documentation	Robert Kanter	Gabor Liptak
YARN-4183	Clarify the behavior of timeline service config properties	Major	.	Mit Desai	Naganarasimha G R
HDFS-10253	Fix TestRefreshCallQueue failure.	Major	.	Brahma Reddy Battula	Xiaoyu Yao
YARN-4746	yarn web services should convert parse failures of appId, appAttemptId and containerId to 400	Minor	webapp	Steve Loughran	Bibin A Chundatt
HDFS-9599	TestDecommissioningStatus.testDecommissionStatus occasionally fails	Major	namenode	Wei-Chiu Chuang	Yiqun Lin
YARN-4706	UI Hosting Configuration in TimelineServer doc is broken	Critical	documentation	Akira Ajisaka	Akira Ajisaka
HDFS-10178	Permanent write failures can happen if pipeline recoveries occur for the first packet	Critical	.	Kihwal Lee	Kihwal Lee
HDFS-8496	Calling stopWriter() with FSDatasetImpl lock held may block other threads	Major	.	zhouyingchao	Colin P. McCabe
HDFS-9917	IBR accumulate more objects when SNN was down for sometime.	Critical	.	Brahma Reddy Battula	Brahma Reddy Battula
HDFS-10239	Fsshell mv fails if port usage doesn’t match in src and destination paths	Major	.	Kuhu Shukla	Kuhu Shukla
YARN-4893	Fix some intermittent test failures in TestRMAdminService	Blocker	.	Junping Du	Brahma Reddy Battula
YARN-4916	TestNMProxy.tesNMProxyRPCRetry fails.	Minor	.	Tibor Kiss	Tibor Kiss
YARN-4915	Fix typo in YARN Secure Containers documentation	Trivial	documentation, yarn	Takashi Ohnishi	Takashi Ohnishi
YARN-4917	Fix typos in documentation of Capacity Scheduler.	Minor	documentation	Takashi Ohnishi	Takashi Ohnishi
HDFS-10261	TestBookKeeperHACheckpoints doesn’t handle ephemeral HTTP ports	Major	.	Eric Badger	Eric Badger
YARN-4699	Scheduler UI and REST o/p is not in sync when -replaceLabelsOnNode is used to change label of a node	Critical	capacity scheduler	Sunil Govindan	Sunil Govindan
HADOOP-12022	fix site -Pdocs -Pdist in hadoop-project-dist; cleanout remaining forrest bits	Blocker	build	Allen Wittenauer	Allen Wittenauer
MAPREDUCE-6670	TestJobListCache#testEviction sometimes fails on Windows with timeout	Minor	test	Gergely Novák	Gergely Novák
HDFS-6520	hdfs fsck -move passes invalid length value when creating BlockReader	Major	.	Shengjun Xin	Xiao Chen
HDFS-10267	Extra “synchronized” on FsDatasetImpl#recoverAppend and FsDatasetImpl#recoverClose	Major	datanode	Colin P. McCabe	Colin P. McCabe
YARN-4740	AM may not receive the container complete msg when it restarts	Major	.	sandflee	sandflee
MAPREDUCE-6633	AM should retry map attempts if the reduce task encounters commpression related errors.	Major	.	Rushabh S Shah	Rushabh S Shah
YARN-4938	MiniYarnCluster should not request transitionToActive to RM on non-HA environment	Major	test	Akira Ajisaka	Eric Badger
HADOOP-12406	AbstractMapWritable.readFields throws ClassNotFoundException with custom writables	Blocker	io	Nadeem Douba	Nadeem Douba
HADOOP-12993	Change ShutdownHookManger complete shutdown log from INFO to DEBUG	Minor	.	Xiaoyu Yao	Xiaoyu Yao
HDFS-10277	PositionedReadable test testReadFullyZeroByteFile failing in HDFS	Major	test	Steve Loughran	Steve Loughran
HDFS-10271	Extra bytes are getting released from reservedSpace for append	Critical	.	Brahma Reddy Battula	Brahma Reddy Battula
HADOOP-12964	Http server vulnerable to clickjacking	Major	.	Haibo Chen	Haibo Chen
YARN-4794	Deadlock in NMClientImpl	Critical	.	Sumana Sathish	Jian He
HDFS-9772	TestBlockReplacement#testThrottler doesn’t work as expected	Minor	test	Yiqun Lin	Yiqun Lin
HDFS-10270	TestJMXGet:testNameNode() fails	Minor	test	Andras Bokor	Gergely Novák
HDFS-10216	distcp -diff relative path exception	Major	distcp	John Zhuge	Takashi Ohnishi
YARN-4924	NM recovery race can lead to container not cleaned up	Major	nodemanager	Nathan Roberts	sandflee
HADOOP-12989	Some tests in org.apache.hadoop.fs.shell.find occasionally time out	Major	test	Akira Ajisaka	Takashi Ohnishi
HADOOP-13026	Should not wrap IOExceptions into a AuthenticationException in KerberosAuthenticator	Critical	.	Xuan Gong	Xuan Gong
YARN-4940	yarn node -list -all failed if RM start with decommissioned node	Major	.	sandflee	sandflee
YARN-4965	Distributed shell AM failed due to ClientHandlerException thrown by jersey	Critical	.	Sumana Sathish	Junping Du
YARN-4934	Reserved Resource for QueueMetrics needs to be handled correctly in few cases	Major	capacity scheduler	Sunil Govindan	Sunil Govindan
HDFS-10291	TestShortCircuitLocalRead failing	Major	test	Steve Loughran	Steve Loughran
HDFS-10275	TestDataNodeMetrics failing intermittently due to TotalWriteTime counted incorrectly	Major	test	Yiqun Lin	Yiqun Lin
MAPREDUCE-6649	getFailureInfo not returning any failure info	Major	.	Eric Badger	Eric Badger
HDFS-10265	OEV tool fails to read edit xml file if OP_UPDATE_BLOCKS has no BLOCK tag	Minor	tools	Wan Chang	Wan Chang
HDFS-9744	TestDirectoryScanner#testThrottling occasionally time out after 300 seconds	Minor	datanode	Wei-Chiu Chuang	Yiqun Lin
HDFS-10308	TestRetryCacheWithHA#testRetryCacheOnStandbyNN failing	Major	test	Rakesh R	Rakesh R
HDFS-10312	Large block reports may fail to decode at NameNode due to 64 MB protobuf maximum length restriction.	Major	namenode	Chris Nauroth	Chris Nauroth
MAPREDUCE-6680	JHS UserLogDir scan algorithm sometime could skip directory with update in CloudFS (Azure FileSystem, S3, etc.)	Major	jobhistoryserver	Junping Du	Junping Du
HDFS-9670	DistCp throws NPE when source is root	Major	distcp	Yongjun Zhang	John Zhuge
HADOOP-13042	Restore lost leveldbjni LICENSE and NOTICE changes	Major	.	Andrew Wang	Andrew Wang
HADOOP-13043	Add LICENSE.txt entries for bundled javascript dependencies	Major	.	Andrew Wang	Andrew Wang
HDFS-10319	Balancer should not try to pair storages with different types	Minor	balancer & mover	Tsz Wo Nicholas Sze	Tsz Wo Nicholas Sze
HDFS-10309	Balancer doesn’t honor dfs.blocksize value defined with suffix k(kilo), m(mega), g(giga)	Minor	balancer & mover	Amit Anand	Amit Anand
HDFS-9555	LazyPersistFileScrubber should still sleep if there are errors in the clear progress	Major	.	Phil Yang	Phil Yang
HADOOP-13052	ChecksumFileSystem mishandles crc file permissions	Major	fs	Daryn Sharp	Daryn Sharp
HDFS-9905	WebHdfsFileSystem#runWithRetry should display original stack trace on error	Major	test	Kihwal Lee	Wei-Chiu Chuang
HADOOP-11418	Property “io.compression.codec.lzo.class” does not work with other value besides default	Major	io	fang fang chen	Yuanbo Liu
HDFS-10318	TestJMXGet hides the real error in case of test failure	Minor	test	Andras Bokor	Andras Bokor
YARN-4556	TestFifoScheduler.testResourceOverCommit fails	Major	scheduler, test	Akihiro Suda	Akihiro Suda
HDFS-10329	Bad initialisation of StringBuffer in RequestHedgingProxyProvider.java	Minor	ha	Max Schaefer	Yiqun Lin
HDFS-10313	Distcp need to enforce the order of snapshot names passed to -diff	Major	distcp	Yongjun Zhang	Yiqun Lin
HADOOP-13030	Handle special characters in passwords in KMS startup script	Major	kms	Xiao Chen	Xiao Chen
YARN-4955	Add retry for SocketTimeoutException in TimelineClient	Critical	.	Xuan Gong	Xuan Gong
HDFS-9958	BlockManager#createLocatedBlocks can throw NPE for corruptBlocks on failed storages.	Major	.	Kuhu Shukla	Kuhu Shukla
YARN-5008	LeveldbRMStateStore database can grow substantially leading to long recovery times	Major	resourcemanager	Jason Lowe	Jason Lowe
YARN-5009	NMLeveldbStateStoreService database can grow substantially leading to longer recovery times	Major	nodemanager	Jason Lowe	Jason Lowe
HADOOP-12378	Fix findbugs warnings in hadoop-tools module	Major	tools	Akira Ajisaka	Akira Ajisaka
HDFS-10260	TestFsDatasetImpl#testCleanShutdownOfVolume often fails	Major	datanode, test	Wei-Chiu Chuang	Rushabh S Shah
HDFS-10335	Mover$Processor#chooseTarget() always chooses the first matching target storage group	Critical	balancer & mover	Mingliang Liu	Mingliang Liu
MAPREDUCE-6672	TestTeraSort fails on Windows	Minor	test	Tibor Kiss	Tibor Kiss
HDFS-10347	Namenode report bad block method doesn’t log the bad block or datanode.	Minor	namenode	Rushabh S Shah	Rushabh S Shah
HADOOP-13072	WindowsGetSpaceUsed constructor should be public	Major	.	Vinayakumar B	Vinayakumar B
MAPREDUCE-6537	Include hadoop-pipes examples in the release tarball	Blocker	pipes	Allen Wittenauer	Kai Sasaki
HDFS-10353	Fix hadoop-hdfs-native-client compilation on Windows	Blocker	build	Brahma Reddy Battula	Brahma Reddy Battula
HDFS-10344	DistributedFileSystem#getTrashRoots should skip encryption zone that does not have .Trash	Major	.	Namit Maheshwari	Xiaoyu Yao
HADOOP-13080	Refresh time in SysInfoWindows is in nanoseconds	Major	util	Íñigo Goiri	Íñigo Goiri
YARN-4834	ProcfsBasedProcessTree doesn’t track daemonized processes	Major	nodemanager	Nathan Roberts	Nathan Roberts
HDFS-10320	Rack failures may result in NN terminate	Major	.	Xiao Chen	Xiao Chen
MAPREDUCE-6675	TestJobImpl.testUnusableNode failed	Major	mrv2	Haibo Chen	Haibo Chen
YARN-4311	Removing nodes from include and exclude lists will not remove them from decommissioned nodes list	Major	.	Kuhu Shukla	Kuhu Shukla
YARN-4984	LogAggregationService shouldn’t swallow exception in handling createAppDir() which cause thread leak.	Critical	log-aggregation	Junping Du	Junping Du
HADOOP-13098	Dynamic LogLevel setting page should accept case-insensitive log level string	Major	.	Junping Du	Junping Du
HDFS-10324	Trash directory in an encryption zone should be pre-created with correct permissions	Major	encryption	Wei-Chiu Chuang	Wei-Chiu Chuang
MAPREDUCE-6514	Job hangs as ask is not updated after ramping down of all reducers	Blocker	applicationmaster	Varun Saxena	Varun Saxena
HDFS-2043	TestHFlush failing intermittently	Major	test	Aaron T. Myers	Yiqun Lin
MAPREDUCE-6689	MapReduce job can infinitely increase number of reducer resource requests	Blocker	.	Wangda Tan	Wangda Tan
YARN-4747	AHS error 500 due to NPE when container start event is missing	Major	timelineserver	Jason Lowe	Varun Saxena
HDFS-9939	Increase DecompressorStream skip buffer size	Major	.	Yongjun Zhang	John Zhuge
YARN-5048	DelegationTokenRenewer#skipTokenRenewal may throw NPE	Major	.	Jian He	Jian He
YARN-4926	Change nodelabel rest API invalid reponse status to 400	Major	.	Bibin A Chundatt	Bibin A Chundatt
HDFS-10372	Fix for failing TestFsDatasetImpl#testCleanShutdownOfVolume	Major	test	Rushabh S Shah	Rushabh S Shah
MAPREDUCE-6684	High contention on scanning of user directory under immediate_done in Job History Server	Critical	jobhistoryserver	Haibo Chen	Haibo Chen
HDFS-6187	Update the document of hftp/hsftp in branch-2 to mention that they are deprecated	Major	documentation	Haohui Mai	Gergely Novák
YARN-4768	getAvailablePhysicalMemorySize can be inaccurate on linux	Major	nodemanager	Nathan Roberts	Nathan Roberts
HADOOP-13125	FS Contract tests don’t report FS initialization errors well	Minor	test	Steve Loughran	Steve Loughran
YARN-5029	RM needs to send update event with YarnApplicationState as Running to ATS/AHS	Critical	.	Xuan Gong	Xuan Gong
HADOOP-13116	Jets3tNativeS3FileSystemContractTest does not run.	Minor	test	Chris Nauroth	Chris Nauroth
MAPREDUCE-6639	Process hangs in LocatedFileStatusFetcher if FileSystem.get throws	Major	mrv2	Ryan Blue	Ryan Blue
HADOOP-11180	Change log message “token.Token: Cannot find class for token kind kms-dt” to debug	Major	kms, security	Yi Liu	Yi Liu
MAPREDUCE-6558	multibyte delimiters with compressed input files generate duplicate records	Major	mrv1, mrv2	Wilfred Spiegelenburg	Wilfred Spiegelenburg
HADOOP-13083	The number of javadocs warnings is limited to 100	Critical	.	Li Lu	Gergely Novák
MAPREDUCE-6513	MR job got hanged forever when one NM unstable for some time	Critical	applicationmaster, resourcemanager	Bob.zhao	Varun Saxena
HDFS-10333	Intermittent org.apache.hadoop.hdfs.TestFileAppend failure in trunk	Major	hdfs	Yongjun Zhang	Yiqun Lin
HADOOP-12942	hadoop credential commands non-obviously use password of “none”	Major	security	Mike Yoder	Mike Yoder
YARN-4325	Nodemanager log handlers fail to send finished/failed events in some cases	Critical	.	Junping Du	Junping Du
HDFS-10242	Cannot create space quota of zero	Major	fs	Takashi Ohnishi	Takashi Ohnishi
MAPREDUCE-6693	ArrayIndexOutOfBoundsException occurs when the length of the job name is equal to mapreduce.jobhistory.jobname.limit	Critical	.	Bibin A Chundatt	Ajith S
HADOOP-13163	Reuse pre-computed filestatus in Distcp-CopyMapper	Minor	tools/distcp	Rajesh Balamohan	Rajesh Balamohan
HDFS-10303	DataStreamer#ResponseProcessor calculates packet ack latency incorrectly.	Major	hdfs-client	Surendra Singh Lilhore	Surendra Singh Lilhore
MAPREDUCE-6698	Increase timeout on TestUnnecessaryBlockingOnHistoryFileInfo.testTwoThreadsQueryingDifferentJobOfSameUser	Major	jobhistoryserver	Haibo Chen	Haibo Chen
HADOOP-13159	Fix potential NPE in Metrics2 source for DecayRpcScheduler	Major	ipc	Xiaoyu Yao	Xiaoyu Yao
HDFS-10397	Distcp should ignore -delete option if -diff option is provided instead of exiting	Major	distcp	Mingliang Liu	Mingliang Liu
HDFS-10381	DataStreamer DataNode exclusion log message should be warning	Minor	hdfs-client	John Zhuge	John Zhuge
HDFS-9226	MiniDFSCluster leaks dependency Mockito via DataNodeTestUtils	Major	test	Josh Elser	Josh Elser
HADOOP-13138	Unable to append to a SequenceFile with Compression.NONE.	Critical	.	Gervais Mickaël	Vinayakumar B
HADOOP-13157	Follow-on improvements to hadoop credential commands	Major	security	Mike Yoder	Mike Yoder
YARN-3840	Resource Manager web ui issue when sorting application by id (with application having id > 9999)	Major	resourcemanager	LINTE	Varun Saxena
HADOOP-13177	Native tests fail on OS X, because DYLD_LIBRARY_PATH is not defined to include libhadoop.dylib.	Minor	build	Chris Nauroth	Chris Nauroth
HADOOP-12767	update apache httpclient version to 4.5.2; httpcore to 4.4.4	Major	build	Artem Aliev	Artem Aliev
YARN-5100	The YarnApplicationState is always running in ATS no matter the application is running or finishes.	Blocker	.	Xuan Gong	Xuan Gong
HADOOP-13183	S3A proxy tests fail after httpclient/httpcore upgrade.	Major	fs/s3	Chris Nauroth	Steve Loughran
YARN-5020	Fix Documentation for Yarn Capacity Scheduler on Resource Calculator	Minor	.	Jo Desmet	Takashi Ohnishi
HDFS-10424	DatanodeLifelineProtocol not able to use under security cluster	Blocker	.	gu-chi	Chris Nauroth
HDFS-10438	When NameNode HA is configured to use the lifeline RPC server, it should log the address of that server.	Minor	ha, namenode	KWON BYUNGCHANG	Chris Nauroth
HDFS-10439	Update setOwner doc in HdfsPermissionsGuide	Minor	documentation	John Zhuge	John Zhuge
MAPREDUCE-6607	Enable regex pattern matching when mapreduce.task.files.preserve.filepattern is set	Minor	applicationmaster	Maysam Yabandeh	Kai Sasaki
YARN-5103	With NM recovery enabled, restarting NM multiple times results in AM restart	Critical	yarn	Sumana Sathish	Junping Du
YARN-5055	max apps per user can be larger than max per queue	Minor	capacityscheduler, resourcemanager	Jason Lowe	Eric Badger
YARN-3971	Skip RMNodeLabelsManager#checkRemoveFromClusterNodeLabelsOfQueue on nodelabel recovery	Critical	resourcemanager	Bibin A Chundatt	Bibin A Chundatt
HDFS-9365	Balancer does not work with the HDFS-6376 HA setup	Major	balancer & mover	Tsz Wo Nicholas Sze	Tsz Wo Nicholas Sze
YARN-3344	Fix warning - procfs stat file is not in the expected format	Major	.	Jon Bringhurst	Ravindra Kumar Naik
YARN-4459	container-executor should only kill process groups	Major	nodemanager	Jun Gong	Jun Gong
YARN-5166	javadoc:javadoc goal fails on hadoop-yarn-client	Major	.	Andras Bokor	Andras Bokor
HDFS-10276	HDFS should not expose path info that user has no permission to see.	Major	fs, security	Kevin Cox	Yuanbo Liu
YARN-5132	Exclude generated protobuf sources from YARN Javadoc build	Critical	.	Subru Krishnan	Subru Krishnan
HADOOP-13132	Handle ClassCastException on AuthenticationException in LoadBalancingKMSClientProvider	Major	kms	Miklos Szurap	Wei-Chiu Chuang
HDFS-10415	TestDistributedFileSystem#MyDistributedFileSystem attempts to set up statistics before initialize() is called	Major	test	Sangjin Lee	Mingliang Liu
HADOOP-13137	TraceAdmin should support Kerberized cluster	Major	tracing	Wei-Chiu Chuang	Wei-Chiu Chuang
HDFS-9476	TestDFSUpgradeFromImage#testUpgradeFromRel1BBWImage occasionally fail	Major	.	Wei-Chiu Chuang	Masatake Iwasaki
HDFS-10367	TestDFSShell.testMoveWithTargetPortEmpty fails with Address bind exception.	Major	test	Brahma Reddy Battula	Brahma Reddy Battula
HDFS-10471	DFSAdmin#SetQuotaCommand’s help msg is not correct	Minor	documentation	Yiqun Lin	Yiqun Lin
YARN-5098	Yarn Application log Aggreagation fails due to NM can not get correct HDFS delegation token	Major	yarn	Yesha Vora	Jian He
HADOOP-13155	Implement TokenRenewer to renew and cancel delegation tokens in KMS	Major	kms, security	Xiao Chen	Xiao Chen
HDFS-10481	HTTPFS server should correctly impersonate as end user to open file	Major	httpfs	Xiao Chen	Xiao Chen
HDFS-10485	Fix findbugs warning in FSEditLog.java	Major	.	Akira Ajisaka	Akira Ajisaka
HDFS-10458	getFileEncryptionInfo should return quickly for non-encrypted cluster	Major	encryption, namenode	Zhe Zhang	Zhe Zhang
YARN-5206	RegistrySecurity includes id:pass in exception text if considered invalid	Minor	client, security	Steve Loughran	Steve Loughran
HDFS-10220	A large number of expired leases can make namenode unresponsive and cause failover	Major	namenode	Nicolas Fraison	Nicolas Fraison
HADOOP-13249	RetryInvocationHandler need wrap InterruptedException in IOException when call Thread.sleep	Major	ipc	zhihai xu	zhihai xu
HADOOP-13213	Small Documentation bug with AuthenticatedURL in hadoop-auth	Minor	documentation	Tom Ellis	Tom Ellis
HADOOP-13079	Add -q option to Ls to print ? instead of non-printable characters	Major	.	John Zhuge	John Zhuge
HDFS-10516	Fix bug when warming up EDEK cache of more than one encryption zone	Major	encryption, namenode	Xiao Chen	Xiao Chen
HADOOP-13270	BZip2CompressionInputStream finds the same compression marker twice in corner case, causing duplicate data blocks	Critical	.	Haibo Chen	Kai Sasaki
HADOOP-13179	GenericOptionsParser is not thread-safe because commons-cli OptionBuilder is not thread-safe	Minor	.	hongbin ma	hongbin ma
HADOOP-13244	o.a.h.ipc.Server#Server should honor handlerCount when queueSizePerHandler is specified in consturctor	Minor	ipc	Xiaoyu Yao	Kai Sasaki
HADOOP-13245	Fix up some misc create-release issues	Blocker	build	Allen Wittenauer	Allen Wittenauer
HDFS-10505	OIV’s ReverseXML processor should support ACLs	Major	tools	Colin P. McCabe	Surendra Singh Lilhore
HDFS-10525	Fix NPE in CacheReplicationMonitor#rescanCachedBlockMap	Major	caching	Xiao Chen	Xiao Chen
YARN-5237	Fix missing log files issue in rolling log aggregation.	Major	.	Siddharth Seth	Xuan Gong
HDFS-10532	Typo in RollingUpgrade docs	Major	documentation	Arpit Agarwal	Yiqun Lin
HADOOP-3733	“s3:” URLs break when Secret Key contains a slash, even if encoded	Minor	fs/s3	Stuart Sierra	Steve Loughran
HDFS-9466	TestShortCircuitCache#testDataXceiverCleansUpSlotsOnFailure is flaky	Major	fs, hdfs-client	Wei-Chiu Chuang	Wei-Chiu Chuang
HADOOP-13255	KMSClientProvider should check and renew tgt when doing delegation token operations.	Major	kms	Xiao Chen	Xiao Chen
HADOOP-13285	DecayRpcScheduler MXBean should only report decayed CallVolumeSummary	Major	ipc	Namit Maheshwari	Xiaoyu Yao
HADOOP-13149	Windows distro build fails on dist-copynativelibs.	Blocker	build	Chris Nauroth	Chris Nauroth
YARN-5246	NMWebAppFilter web redirects drop query parameters	Major	.	Varun Vasudev	Varun Vasudev
HDFS-10474	hftp copy fails when file name with Chinese+special char in branch-2	Critical	.	Brahma Reddy Battula	Brahma Reddy Battula
HADOOP-13192	org.apache.hadoop.util.LineReader cannot handle multibyte delimiters correctly	Critical	util	binde	binde
HDFS-10448	CacheManager#addInternal tracks bytesNeeded incorrectly when dealing with replication factors other than 1	Major	caching	Yiqun Lin	Yiqun Lin
YARN-5197	RM leaks containers if running container disappears from node update	Critical	resourcemanager	Jason Lowe	Jason Lowe
HADOOP-13287	TestS3ACredentials#testInstantiateFromURL fails if AWS secret key contains ‘+’.	Minor	fs/s3, test	Chris Nauroth	Chris Nauroth
HDFS-10556	DistCpOptions should be validated automatically	Major	distcp	Mingliang Liu	Mingliang Liu
MAPREDUCE-6725	Javadoc for CLI#listEvents() contains no-existent param	Minor	client, documentation	Shen Yinjie	Shen Yinjie
HDFS-7959	WebHdfs logging is missing on Datanode	Critical	.	Kihwal Lee	Kihwal Lee
MAPREDUCE-6542	HistoryViewer uses SimpleDateFormat, but SimpleDateFormat is not threadsafe	Major	jobhistoryserver	zhangyubiao	zhangyubiao
HADOOP-13251	Authenticate with Kerberos credentials when renewing KMS delegation token	Major	kms	Xiao Chen	Xiao Chen
HADOOP-13316	Enforce Kerberos authentication for required ops in DelegationTokenAuthenticator	Blocker	kms, security	Xiao Chen	Xiao Chen
HDFS-9852	hdfs dfs -setfacl error message is misleading	Minor	.	Wei-Chiu Chuang	Wei-Chiu Chuang
YARN-5262	Optimize sending RMNodeFinishedContainersPulledByAMEvent for every AM heartbeat	Major	resourcemanager	Rohith Sharma K S	Rohith Sharma K S
HADOOP-12345	Pad hostname correctly in CredentialsSys.java	Critical	nfs	Pradeep Nayak Udupi Kadbet	Pradeep Nayak Udupi Kadbet
HADOOP-13314	Remove ‘package-info.java’ from ‘test\java\org\apache\hadoop\fs\shell\’ to remove eclipse compile error	Trivial	.	Vinayakumar B	Vinayakumar B
HDFS-10589	Javadoc for HAState#HAState and HAState#setStateInternal contains non-existent params	Minor	documentation, hdfs	Shen Yinjie	Shen Yinjie
YARN-5286	Add RPC port info in RM web service’s response when getting app status	Major	.	Jun Gong	Jun Gong
YARN-5214	Pending on synchronized method DirectoryCollection#checkDirs can hang NM’s NodeStatusUpdater	Critical	nodemanager	Junping Du	Junping Du
HADOOP-13350	Additional fix to LICENSE and NOTICE	Blocker	build	Xiao Chen	Xiao Chen
HDFS-10592	Fix intermittent test failure of TestNameNodeResourceChecker#testCheckThatNameNodeResourceMonitorIsRunning	Major	test	Rakesh R	Rakesh R
HADOOP-13320	Fix arguments check in documentation for WordCount v2.0	Minor	documentation	niccolo becchi	niccolo becchi
YARN-5314	ConcurrentModificationException in ATS v1.5 EntityGroupFSTimelineStore	Major	timelineserver	Karam Singh	Li Lu
YARN-4939	the decommissioning Node should keep alive if NM restart	Major	.	sandflee	sandflee
HADOOP-12893	Verify LICENSE.txt and NOTICE.txt	Blocker	build	Allen Wittenauer	Xiao Chen
HADOOP-13352	Make X-FRAME-OPTIONS configurable in HttpServer2	Major	net, security	Anu Engineer	Anu Engineer
HDFS-10336	TestBalancer failing intermittently because of not reseting UserGroupInformation completely	Major	test	Yiqun Lin	Yiqun Lin
HDFS-10512	VolumeScanner may terminate due to NPE in DataNode.reportBadBlocks	Major	datanode	Wei-Chiu Chuang	Yiqun Lin
YARN-5337	Fix OOM issue in DistributedShell. AM failed with “java.lang.OutOfMemoryError: GC overhead limit exceeded”	Major	.	Sumana Sathish	Jian He
HADOOP-13297	Add missing dependency in setting maven-remote-resource-plugin to fix builds	Major	build	Akira Ajisaka	Sean Busbey
YARN-5270	Solve miscellaneous issues caused by YARN-4844	Blocker	.	Wangda Tan	Wangda Tan
HDFS-10579	HDFS web interfaces lack configs for X-FRAME-OPTIONS protection	Major	datanode, namenode	Anu Engineer	Anu Engineer
MAPREDUCE-6625	TestCLI#testGetJob fails occasionally	Major	test	Jason Lowe	Haibo Chen
HADOOP-13315	FileContext#umask is not initialized properly	Minor	.	John Zhuge	John Zhuge
YARN-5353	ResourceManager can leak delegation tokens when they are shared across apps	Critical	resourcemanager	Jason Lowe	Jason Lowe
HADOOP-11361	Fix a race condition in MetricsSourceAdapter.updateJmxCache	Major	.	Brahma Reddy Battula	Brahma Reddy Battula
HDFS-10544	Balancer doesn’t work with IPFailoverProxyProvider	Major	balancer & mover, ha	Zhe Zhang	Zhe Zhang
HADOOP-13351	TestDFSClientSocketSize buffer size tests are flaky	Major	.	Aaron Fabbri	Aaron Fabbri
HADOOP-13202	Avoid possible overflow in org.apache.hadoop.util.bloom.BloomFilter#getNBytes	Major	util	zhengbing li	Kai Sasaki
HDFS-10603	Fix flaky tests in org.apache.hadoop.hdfs.server.namenode.snapshot.TestOpenFilesWithSnapshot	Major	hdfs, namenode	Yongjun Zhang	Yiqun Lin
HADOOP-12991	Conflicting default ports in DelegateToFileSystem	Major	fs	Kevin Hogeland	Kai Sasaki
YARN-5309	Fix SSLFactory truststore reloader thread leak in TimelineClientImpl	Blocker	timelineserver, yarn	Thomas Friedrich	Weiwei Yang
HADOOP-13387	users always get told off for using S3 —even when not using it.	Minor	fs/s3	Steve Loughran	Steve Loughran
YARN-5340	Race condition in RollingLevelDBTimelineStore#getAndSetStartTime()	Critical	timelineserver	Sumana Sathish	Li Lu
HDFS-8914	Document HA support in the HDFS HdfsDesign.md	Major	documentation	Ravindra Babu	Lars Francke
HADOOP-12588	Fix intermittent test failure of TestGangliaMetrics	Major	.	Tsuyoshi Ozawa	Masatake Iwasaki
HADOOP-13240	TestAclCommands.testSetfaclValidations fail	Minor	test	linbao111	John Zhuge
HADOOP-13389	TestS3ATemporaryCredentials.testSTS error when using IAM credentials	Major	fs/s3	Steven K. Wong	Steven K. Wong
HADOOP-13406	S3AFileSystem: Consider reusing filestatus in delete() and mkdirs()	Minor	fs/s3	Rajesh Balamohan	Rajesh Balamohan
MAPREDUCE-6744	Increase timeout on TestDFSIO tests	Major	.	Eric Badger	Eric Badger
HDFS-10688	BPServiceActor may run into a tight loop for sending block report when hitting IOException	Major	datanode	Jing Zhao	Chen Liang
HDFS-10671	Fix typo in HdfsRollingUpgrade.md	Trivial	documentation	Yiqun Lin	Yiqun Lin
HADOOP-13422	ZKDelegationTokenSecretManager JaasConfig does not work well with other ZK users in process	Major	.	Sergey Shelukhin	Sergey Shelukhin
HDFS-10696	TestHDFSCLI fails	Major	test	Akira Ajisaka	Kai Sasaki
YARN-5432	Lock already held by another process while LevelDB cache store creation for dag	Critical	timelineserver	Karam Singh	Li Lu
YARN-5438	TimelineClientImpl leaking FileSystem Instances causing Long running services like HiverServer2 daemon going OOM	Major	timelineserver	Karam Singh	Rohith Sharma K S
HADOOP-13381	KMS clients should use KMS Delegation Tokens from current UGI.	Critical	kms	Xiao Chen	Xiao Chen
HDFS-10691	FileDistribution fails in hdfs oiv command due to ArrayIndexOutOfBoundsException	Major	.	Yiqun Lin	Yiqun Lin
YARN-5121	fix some container-executor portability issues	Blocker	nodemanager, security	Allen Wittenauer	Allen Wittenauer
MAPREDUCE-6724	Single shuffle to memory must not exceed Integer#MAX_VALUE	Major	mrv2	Haibo Chen	Haibo Chen
HDFS-5805	TestCheckpoint.testCheckpoint fails intermittently on branch2	Major	.	Mit Desai	Eric Badger
HADOOP-13459	hadoop-azure runs several test cases repeatedly, causing unnecessarily long running time.	Minor	fs/azure, test	Chris Nauroth	Chris Nauroth
HDFS-742	A down DataNode makes Balancer to hang on repeatingly asking NameNode its partial block list	Minor	balancer & mover	Hairong Kuang	Mit Desai
YARN-4280	CapacityScheduler reservations may not prevent indefinite postponement on a busy cluster	Major	capacity scheduler	Kuhu Shukla	Kuhu Shukla
YARN-5462	TestNodeStatusUpdater.testNodeStatusUpdaterRetryAndNMShutdown fails intermittently	Major	.	Eric Badger	Eric Badger
HDFS-10710	In BlockManager#rescanPostponedMisreplicatedBlocks(), postponed misreplicated block counts should be retrieved with NN lock protection	Major	namenode	Rui Gao	Rui Gao
YARN-5469	Increase timeout of TestAmFilter.testFilter	Minor	.	Eric Badger	Eric Badger
HDFS-10569	A bug causes OutOfIndex error in BlockListAsLongs	Minor	.	Weiwei Yang	Weiwei Yang
HADOOP-13434	Add quoting to Shell class	Major	.	Owen O’Malley	Owen O’Malley
MAPREDUCE-6682	TestMRCJCFileOutputCommitter fails intermittently	Major	test	Brahma Reddy Battula	Akira Ajisaka
HDFS-10716	In Balancer, the target task should be removed when its size < 0.	Minor	balancer & mover	Yiqun Lin	Yiqun Lin
HDFS-10722	Fix race condition in TestEditLog#testBatchedSyncWithClosedLogs	Major	hdfs	Daryn Sharp	Daryn Sharp
HADOOP-13467	Shell#getSignalKillCommand should use the bash builtin on Linux	Major	.	Arpit Agarwal	Arpit Agarwal
HDFS-10717	Fix findbugs warnings of hadoop-hdfs-client in branch-2	Major	.	Akira Ajisaka	Akira Ajisaka
HDFS-10343	BlockManager#createLocatedBlocks may return blocks on failed storages	Major	hdfs	Daryn Sharp	Kuhu Shukla
HDFS-10715	NPE when applying AvailableSpaceBlockPlacementPolicy	Major	namenode	Guangbin Zhu	Guangbin Zhu
YARN-4624	NPE in PartitionQueueCapacitiesInfo while accessing Schduler UI	Major	.	Brahma Reddy Battula	Brahma Reddy Battula
HADOOP-10823	TestReloadingX509TrustManager is flaky	Major	.	Ratandeep Ratti	Mingliang Liu
HADOOP-13457	Remove hardcoded absolute path for shell executable	Major	util	Arpit Agarwal	Chen Liang
HADOOP-13439	Fix race between TestMetricsSystemImpl and TestGangliaMetrics	Minor	test	Masatake Iwasaki	Chen Liang
MAPREDUCE-6750	TestHSAdminServer.testRefreshSuperUserGroups is failing	Minor	test	Kihwal Lee	Kihwal Lee
HADOOP-13473	Tracing in IPC Server is broken	Major	.	Wei-Chiu Chuang	Daryn Sharp
HDFS-10738	Fix TestRefreshUserMappings.testRefreshSuperUserGroupsConfiguration test failure	Major	test	Rakesh R	Rakesh R
HADOOP-13299	JMXJsonServlet is vulnerable to TRACE	Minor	.	Haibo Chen	Haibo Chen
HDFS-8224	Schedule a block for scanning if its metadata file is corrupt	Major	datanode	Rushabh S Shah	Rushabh S Shah
YARN-5382	RM does not audit log kill request for active applications	Major	resourcemanager	Jason Lowe	Vrushali C
HDFS-10643	Namenode should use loginUser(hdfs) to generateEncryptedKey	Major	encryption, namenode	Xiaoyu Yao	Xiaoyu Yao
HDFS-8897	Balancer should handle fs.defaultFS trailing slash in HA	Major	balancer & mover	LINTE	John Zhuge
HDFS-10731	FSDirectory#verifyMaxDirItems does not log path name	Minor	namenode	Wei-Chiu Chuang	Wei-Chiu Chuang
YARN-5476	Not existed application reported as ACCEPTED state by YarnClientImpl	Critical	yarn	Yesha Vora	Junping Du
YARN-5491	Random Failure TestCapacityScheduler#testCSQueueBlocked	Major	test	Bibin A Chundatt	Bibin A Chundatt
HDFS-9696	Garbage snapshot records lingering forever	Critical	.	Kihwal Lee	Kihwal Lee
HADOOP-13333	testConf.xml ls comparators in wrong order	Trivial	fs	John Zhuge	Vrushali C
HADOOP-13470	GenericTestUtils$LogCapturer is flaky	Major	test, util	Mingliang Liu	Mingliang Liu
HADOOP-13494	ReconfigurableBase can log sensitive information	Major	security	Sean Mackrory	Sean Mackrory
HDFS-9530	ReservedSpace is not cleared for abandoned Blocks	Critical	datanode	Fei Hui	Brahma Reddy Battula
HDFS-10549	Correctly revoke file leases when closing files	Major	hdfs-client	Yiqun Lin	Yiqun Lin
HADOOP-13513	Java 1.7 support for org.apache.hadoop.fs.azure testcases	Minor	fs/azure	Tibor Kiss	Tibor Kiss
HADOOP-13512	ReloadingX509TrustManager should keep reloading in case of exception	Critical	security	Mingliang Liu	Mingliang Liu
HDFS-10763	Open files can leak permanently due to inconsistent lease update	Critical	.	Kihwal Lee	Kihwal Lee
YARN-4307	Display blacklisted nodes for AM container in the RM web UI	Major	resourcemanager, webapp	Naganarasimha G R	Naganarasimha G R
MAPREDUCE-6763	Shuffle server listen queue is too small	Major	mrv2	Jason Lowe	Jason Lowe
YARN-4837	User facing aspects of ‘AM blacklisting’ feature need fixing	Critical	.	Vinod Kumar Vavilapalli	Vinod Kumar Vavilapalli
MAPREDUCE-6310	Add jdiff support to MapReduce	Blocker	.	Li Lu	Li Lu
YARN-3388	Allocation in LeafQueue could get stuck because DRF calculator isn’t well supported when computing user-limit	Major	capacityscheduler	Nathan Roberts	Nathan Roberts
YARN-4685	Disable AM blacklisting by default to mitigate situations that application get hanged	Critical	resourcemanager	Rohith Sharma K S	Rohith Sharma K S
HADOOP-13428	Fix hadoop-common to generate jdiff	Blocker	.	Wangda Tan	Wangda Tan
HDFS-10764	Fix INodeFile#getBlocks to not return null	Major	namenode	Arpit Agarwal	Arpit Agarwal
HDFS-10692	Point JDiff base version for HDFS from 2.6.0 to 2.7.2	Blocker	.	Wangda Tan	Wangda Tan
HADOOP-13487	Hadoop KMS should load old delegation tokens from Zookeeper on startup	Major	kms	Alex Ivanov	Xiao Chen
HDFS-10783	The option ‘-maxSize’ and ‘-step’ fail in OfflineImageViewer	Major	tools	Yiqun Lin	Yiqun Lin
HADOOP-13524	mvn eclipse:eclipse generates .gitignore’able files	Major	.	Vinod Kumar Vavilapalli	Vinod Kumar Vavilapalli
HADOOP-13497	fix wrong command in CredentialProviderAPI.md	Trivial	documentation	Yuanbo Liu	Yuanbo Liu
MAPREDUCE-6761	Regression when handling providers - invalid configuration ServiceConfiguration causes Cluster initialization failure	Major	mrv2	Peter Vary	Peter Vary
HDFS-10748	TestFileTruncate#testTruncateWithDataNodesRestart runs sometimes timeout	Major	test	Xiaoyu Yao	Yiqun Lin
HDFS-10793	Fix HdfsAuditLogger binary incompatibility introduced by HDFS-9184	Blocker	.	Andrew Wang	Manoj Govindassamy
HDFS-10652	Add a unit test for HDFS-4660	Major	datanode, hdfs	Yongjun Zhang	Vinayakumar B
HADOOP-13552	RetryInvocationHandler logs all remote exceptions	Blocker	ipc	Jason Lowe	Jason Lowe
HADOOP-12765	HttpServer2 should switch to using the non-blocking SslSelectChannelConnector to prevent performance degradation when handling SSL connections	Major	.	Min Shen	Min Shen
MAPREDUCE-6768	TestRecovery.testSpeculative failed with NPE	Major	mrv2	Haibo Chen	Haibo Chen
HADOOP-13559	Remove close() within try-with-resources in ChecksumFileSystem/ChecksumFs classes	Minor	fs	Aaron Fabbri	Aaron Fabbri
HDFS-4210	Throw helpful exception when DNS entry for JournalNode cannot be resolved	Trivial	ha, journal-node, namenode	Damien Hardy	John Zhuge
MAPREDUCE-4784	TestRecovery occasionally fails	Major	mrv2, test	Jason Lowe	Haibo Chen
HDFS-10760	DataXceiver#run() should not log InvalidToken exception as an error	Major	.	Pan Yuxuan	Pan Yuxuan
HDFS-10729	Improve log message for edit loading failures caused by FS limit checks.	Major	namenode	Wei-Chiu Chuang	Wei-Chiu Chuang
HADOOP-13375	o.a.h.security.TestGroupsCaching.testBackgroundRefreshCounters seems flaky	Major	security, test	Mingliang Liu	Weiwei Yang
YARN-5555	Scheduler UI: “% of Queue” is inaccurate if leaf queue is hierarchically nested.	Minor	.	Eric Payne	Eric Payne
YARN-5549	AMLauncher#createAMContainerLaunchContext() should not log the command to be launched indiscriminately	Critical	resourcemanager	Daniel Templeton	Daniel Templeton
HDFS-10841	Remove duplicate or unused variable in appendFile()	Minor	.	Kihwal Lee	Kihwal Lee
HADOOP-13558	UserGroupInformation created from a Subject incorrectly tries to renew the Kerberos ticket	Major	security	Alejandro Abdelnur	Xiao Chen
HDFS-9038	DFS reserved space is erroneously counted towards non-DFS used.	Major	datanode	Chris Nauroth	Brahma Reddy Battula
HDFS-10832	Propagate ACL bit and isEncrypted bit in HttpFS FileStatus permissions	Critical	httpfs	Andrew Wang	Andrew Wang
YARN-5632	UPDATE_EXECUTION_TYPE causes UpdateContainerRequestPBImpl to throw	Major	api	Jason Lowe	Jason Lowe
HDFS-9781	FsDatasetImpl#getBlockReports can occasionally throw NullPointerException	Major	datanode	Wei-Chiu Chuang	Manoj Govindassamy
HDFS-10830	FsDatasetImpl#removeVolumes crashes with IllegalMonitorStateException when vol being removed is in use	Major	hdfs	Manoj Govindassamy	Arpit Agarwal
YARN-5190	Registering/unregistering container metrics triggered by ContainerEvent and ContainersMonitorEvent are conflict which cause uncaught exception in ContainerMonitorImpl	Blocker	.	Junping Du	Junping Du
HDFS-10856	Update the comment of BPServiceActor$Scheduler#scheduleNextBlockReport	Minor	documentation	Akira Ajisaka	Yiqun Lin
YARN-5630	NM fails to start after downgrade from 2.8 to 2.7	Blocker	nodemanager	Jason Lowe	Jason Lowe
HADOOP-13616	Broken code snippet area in Hadoop Benchmarking	Minor	documentation	Kai Sasaki	Kai Sasaki
HDFS-10862	Typos in 4 log messages	Trivial	.	Mehran Hassani	Mehran Hassani
YARN-4232	TopCLI console support for HA mode	Minor	.	Bibin A Chundatt	Bibin A Chundatt
YARN-5655	TestContainerManagerSecurity#testNMTokens is asserting	Major	.	Jason Lowe	Robert Kanter
HDFS-10879	TestEncryptionZonesWithKMS#testReadWrite fails intermittently	Major	.	Xiao Chen	Xiao Chen
YARN-5539	TimelineClient failed to retry on “java.net.SocketTimeoutException: Read timed out”	Critical	yarn	Sumana Sathish	Junping Du
HADOOP-13643	Math error in AbstractContractDistCpTest	Minor	.	Aaron Fabbri	Aaron Fabbri
HDFS-10886	Replace “fs.default.name” with “fs.defaultFS” in viewfs document	Minor	documentation, federation	Brahma Reddy Battula	Brahma Reddy Battula
HDFS-10843	Update space quota when a UC block is completed rather than committed.	Major	hdfs, namenode	Erik Krogen	Erik Krogen
HADOOP-13535	Add jetty6 acceptor startup issue workaround to branch-2	Major	.	Wei-Chiu Chuang	Min Shen
YARN-5664	Fix Yarn documentation to link to correct versions.	Minor	.	Xiao Chen	Xiao Chen
YARN-5663	Small refactor in ZKRMStateStore	Minor	resourcemanager	Oleksii Dymytrov	Oleksii Dymytrov
HADOOP-12597	In kms-site.xml configuration “hadoop.security.keystore.JavaKeyStoreProvider.password” should be updated with new name	Minor	security	huangyitian	Surendra Singh Lilhore
HADOOP-13638	KMS should set UGI’s Configuration object properly	Major	kms	Wei-Chiu Chuang	Wei-Chiu Chuang
HDFS-9885	Correct the distcp counters name while displaying counters	Minor	distcp	Archana T	Surendra Singh Lilhore
YARN-5660	Wrong audit constants are used in Get/Put of priority in RMWebService	Trivial	resourcemanager	Rohith Sharma K S	Rohith Sharma K S
HDFS-10889	Remove outdated Fault Injection Framework documentaion	Major	documentation	Brahma Reddy Battula	Brahma Reddy Battula
HDFS-10713	Throttle FsNameSystem lock warnings	Major	logging, namenode	Arpit Agarwal	Hanisha Koneru
HDFS-10426	TestPendingInvalidateBlock failed in trunk	Major	test	Yiqun Lin	Yiqun Lin
HDFS-10828	Fix usage of FsDatasetImpl object lock in ReplicaMap	Blocker	.	Arpit Agarwal	Arpit Agarwal
YARN-5631	Missing refreshClusterMaxPriority usage in rmadmin help message	Minor	.	Kai Sasaki	Kai Sasaki
HDFS-9444	Add utility to find set of available ephemeral ports to ServerSocketUtil	Major	.	Brahma Reddy Battula	Masatake Iwasaki
HADOOP-11780	Prevent IPC reader thread death	Critical	ipc	Daryn Sharp	Daryn Sharp
HDFS-10824	MiniDFSCluster#storageCapacities has no effects on real capacity	Major	.	Xiaobing Zhou	Xiaobing Zhou
HDFS-10914	Move remnants of oah.hdfs.client to hadoop-hdfs-client	Critical	hdfs-client	Andrew Wang	Andrew Wang
MAPREDUCE-6771	RMContainerAllocator sends container diagnostics event after corresponding completion event	Major	mrv2	Haibo Chen	Haibo Chen
HADOOP-13640	Fix findbugs warning in VersionInfoMojo.java	Major	.	Tsuyoshi Ozawa	Yuanbo Liu
HDFS-10850	getEZForPath should NOT throw FNF	Blocker	hdfs	Daryn Sharp	Andrew Wang
HDFS-10945	Fix the Findbugwaring FSNamesystem#renameTo(String, String, boolean) in branch-2	Major	.	Brahma Reddy Battula	Brahma Reddy Battula
HDFS-10810	Setreplication removing block from underconstrcution temporarily when batch IBR is enabled.	Major	namenode	Brahma Reddy Battula	Brahma Reddy Battula
HDFS-10944	Correct the javadoc of dfsadmin#disallowSnapshot	Minor	documentation	Jagadesh Kiran N	Jagadesh Kiran N
HDFS-10947	Correct the API name for truncate in webhdfs document	Major	documentation	Surendra Singh Lilhore	Surendra Singh Lilhore
HADOOP-12667	s3a: Support createNonRecursive API	Major	fs/s3	Sean Mackrory	Sean Mackrory
HDFS-10609	Uncaught InvalidEncryptionKeyException during pipeline recovery may abort downstream applications	Major	encryption	Wei-Chiu Chuang	Wei-Chiu Chuang
HDFS-10962	TestRequestHedgingProxyProvider is flaky	Major	test	Andrew Wang	Andrew Wang
MAPREDUCE-6740	Enforce mapreduce.task.timeout to be at least mapreduce.task.progress-report.interval	Minor	mr-am	Haibo Chen	Haibo Chen
YARN-5101	YARN_APPLICATION_UPDATED event is parsed in ApplicationHistoryManagerOnTimelineStore#convertToApplicationReport with reversed order	Major	.	Xuan Gong	Sunil Govindan
YARN-5659	getPathFromYarnURL should use standard methods	Major	.	Sergey Shelukhin	Sergey Shelukhin
HADOOP-12611	TestZKSignerSecretProvider#testMultipleInit occasionally fail	Major	.	Wei-Chiu Chuang	Eric Badger
HDFS-10797	Disk usage summary of snapshots causes renamed blocks to get counted twice	Major	snapshots	Sean Mackrory	Sean Mackrory
HDFS-10991	Export hdfsTruncateFile symbol in libhdfs	Blocker	libhdfs	Surendra Singh Lilhore	Surendra Singh Lilhore
HADOOP-13700	Remove unthrown IOException from TrashPolicy#initialize and #getInstance signatures	Critical	fs	Haibo Chen	Andrew Wang
HDFS-11002	Fix broken attr/getfattr/setfattr links in ExtendedAttributes.md	Major	documentation	Mingliang Liu	Mingliang Liu
HDFS-11000	webhdfs PUT does not work if requests are routed to call queue.	Major	.	Kihwal Lee	Kihwal Lee
HDFS-10987	Make Decommission less expensive when lot of blocks present.	Critical	.	Brahma Reddy Battula	Brahma Reddy Battula
HADOOP-13024	Distcp with -delete feature on raw data not implemented	Major	tools/distcp	Mavin Martin	Mavin Martin
HDFS-10986	DFSAdmin should log detailed error message if any	Major	tools	Mingliang Liu	Mingliang Liu
HDFS-10990	TestPendingInvalidateBlock should wait for IBRs	Minor	.	Yiqun Lin	Yiqun Lin
HDFS-10735	Distcp using webhdfs on secure HA clusters fails with StandbyException	Major	webhdfs	Benoy Antony	Benoy Antony
HDFS-10883	`getTrashRoot`’s behavior is not consistent in DFS after enabling EZ.	Major	.	Yuanbo Liu	Yuanbo Liu
HADOOP-13707	If kerberos is enabled while HTTP SPNEGO is not configured, some links cannot be accessed	Major	.	Yuanbo Liu	Yuanbo Liu
HDFS-10301	BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order	Critical	namenode	Konstantin Shvachko	Vinitha Reddy Gankidi
HDFS-10712	Fix TestDataNodeVolumeFailure on 2.* branches.	Major	.	Konstantin Shvachko	Vinitha Reddy Gankidi
HDFS-10920	TestStorageMover#testNoSpaceDisk is failing intermittently	Major	test	Rakesh R	Rakesh R
HDFS-10960	TestDataNodeHotSwapVolumes#testRemoveVolumeBeingWritten fails at disk error verification after volume remove	Minor	hdfs	Manoj Govindassamy	Manoj Govindassamy
HDFS-10752	Several log refactoring/improvement suggestion in HDFS	Major	.	Nemo Chen	Hanisha Koneru
HDFS-11025	TestDiskspaceQuotaUpdate fails in trunk due to Bind exception	Minor	.	Yiqun Lin	Yiqun Lin
HDFS-11018	Incorrect check and message in FsDatasetImpl#invalidate	Major	datanode	Wei-Chiu Chuang	Yiqun Lin
HADOOP-13236	truncate will fail when we use viewfilesystem	Major	.	Brahma Reddy Battula	Brahma Reddy Battula
HADOOP-13749	KMSClientProvider combined with KeyProviderCache can result in wrong UGI being used	Critical	.	Sergey Shelukhin	Xiaoyu Yao
HDFS-11042	Add missing cleanupSSLConfig() call for tests that use setupSSLConfig()	Major	test	Kuhu Shukla	Kuhu Shukla
HDFS-11015	Enforce timeout in balancer	Major	balancer & mover	Kihwal Lee	Kihwal Lee
YARN-5677	RM should transition to standby when connection is lost for an extended period	Critical	resourcemanager	Daniel Templeton	Daniel Templeton
HDFS-11054	Suppress verbose log message in BlockPlacementPolicyDefault	Major	.	Arpit Agarwal	Chen Liang
HDFS-11050	Change log level to ‘warn’ when ssl initialization fails and defaults to DEFAULT_TIMEOUT_CONN_CONFIGURATOR	Major	.	Kuhu Shukla	Kuhu Shukla
HDFS-10921	TestDiskspaceQuotaUpdate doesn’t wait for NN to get out of safe mode	Major	.	Eric Badger	Eric Badger
HDFS-8492	DN should notify NN when client requests a missing block	Major	.	Daryn Sharp	Walter Su
MAPREDUCE-6541	Exclude scheduled reducer memory when calculating available mapper slots from headroom to avoid deadlock	Major	.	Wangda Tan	Varun Saxena
YARN-3848	TestNodeLabelContainerAllocation is not timing out	Major	test	Jason Lowe	Varun Saxena
HADOOP-13201	Print the directory paths when ViewFs denies the rename operation on internal dirs	Major	viewfs	Tianyin Xu	Rakesh R
YARN-4831	Recovered containers will be killed after NM stateful restart	Major	nodemanager	Siqi Li	Siqi Li
YARN-3432	Cluster metrics have wrong Total Memory when there is reserved memory on CS	Major	capacityscheduler, resourcemanager	Thomas Graves	Brahma Reddy Battula
HDFS-9500	datanodesSoftwareVersions map may counting wrong when rolling upgrade	Major	.	Phil Yang	Erik Krogen
MAPREDUCE-2631	Potential resource leaks in BinaryProtocol$TeeOutputStream.java	Major	.	Ravi Teja Ch N V	Sunil Govindan
HADOOP-13770	Shell.checkIsBashSupported swallowed an interrupted exception	Minor	util	Wei-Chiu Chuang	Wei-Chiu Chuang
YARN-5027	NM should clean up app log dirs after NM restart	Major	nodemanager	sandflee	sandflee
YARN-5767	Fix the order that resources are cleaned up from the local Public/Private caches	Major	.	Chris Trezzo	Chris Trezzo
HDFS-11061	Update dfs -count -t command line help and documentation	Minor	documentation, fs	Wei-Chiu Chuang	Yiqun Lin
YARN-5773	RM recovery too slow due to LeafQueue#activateApplication()	Critical	capacity scheduler, rolling upgrade	Bibin A Chundatt	Bibin A Chundatt
HDFS-10455	Logging the username when deny the setOwner operation	Minor	namenode	Tianyin Xu	Rakesh R
HADOOP-13773	wrong HADOOP_CLIENT_OPTS in hadoop-env on branch-2	Major	conf	Fei Hui	Fei Hui
YARN-5001	Aggregated Logs root directory is created with wrong group if nonexistent	Major	log-aggregation, nodemanager, security	Haibo Chen	Haibo Chen
YARN-5815	Random failure of TestApplicationPriority.testOrderOfActivatingThePriorityApplicationOnRMRestart	Major	.	Bibin A Chundatt	Bibin A Chundatt
HDFS-11097	Fix the jenkins warning related to the deprecated method StorageReceivedDeletedBlocks	Major	.	Yiqun Lin	Yiqun Lin
YARN-5837	NPE when getting node status of a decommissioned node after an RM restart	Major	.	Robert Kanter	Robert Kanter
HADOOP-13798	TestHadoopArchives times out	Major	test	Akira Ajisaka	Akira Ajisaka
HADOOP-13797	Remove hardcoded absolute path for ls	Major	util	Christine Koppelt	Christine Koppelt
HADOOP-13804	MutableStat mean loses accuracy if add(long, long) is used	Minor	metrics	Erik Krogen	Erik Krogen
HDFS-11128	CreateEditsLog throws NullPointerException	Major	hdfs	Hanisha Koneru	Hanisha Koneru
HDFS-11129	TestAppendSnapshotTruncate fails with bind exception	Major	test	Brahma Reddy Battula	Brahma Reddy Battula
HADOOP-13813	TestDelegationTokenFetcher#testDelegationTokenWithoutRenewer is failing	Major	security, test	Mingliang Liu	Mingliang Liu
HDFS-11087	NamenodeFsck should check if the output writer is still writable.	Major	namenode	Konstantin Shvachko	Erik Krogen
HDFS-11135	The tests in TestBalancer run fails due to NPE	Major	test	Yiqun Lin	Yiqun Lin
HDFS-11056	Concurrent append and read operations lead to checksum error	Major	datanode, httpfs	Wei-Chiu Chuang	Wei-Chiu Chuang
MAPREDUCE-6797	Job history server scans can become blocked on a single, slow entry	Critical	jobhistoryserver	Prabhu Joseph	Prabhu Joseph
YARN-4355	NPE while processing localizer heartbeat	Major	nodemanager	Jason Lowe	Varun Saxena
YARN-4218	Metric for resource*time that was preempted	Major	resourcemanager	Chang Li	Chang Li
YARN-5875	TestTokenClientRMService#testTokenRenewalWrongUser fails	Major	.	Varun Saxena	Gergely Novák
HADOOP-13815	TestKMS#testDelegationTokensOpsSimple and TestKMS#testDelegationTokensOpsKerberized Fails in Trunk	Major	test	Brahma Reddy Battula	Xiao Chen
YARN-5836	Malicious AM can kill containers of other apps running in any node its containers are running	Minor	nodemanager	Botong Huang	Botong Huang
HDFS-11134	Fix bind exception threw in TestRenameWhileOpen	Major	.	Yiqun Lin	Yiqun Lin
MAPREDUCE-6801	Fix flaky TestKill.testKillJob()	Major	mrv2	Haibo Chen	Haibo Chen
HADOOP-13814	Sample configuration of KMS HTTP Authentication signature is misleading	Minor	conf, documentation, kms	Masahiro Tanaka	Masahiro Tanaka
HDFS-11144	TestFileCreationDelete#testFileCreationDeleteParent fails wind bind exception	Major	test	Brahma Reddy Battula	Brahma Reddy Battula
HDFS-11101	TestDFSShell#testMoveWithTargetPortEmpty fails intermittently	Major	test	Brahma Reddy Battula	Brahma Reddy Battula
YARN-5859	TestResourceLocalizationService#testParallelDownloadAttemptsForPublicResource sometimes fails	Major	test	Jason Lowe	Eric Badger
HADOOP-13663	Index out of range in SysInfoWindows	Major	native, util	Íñigo Goiri	Íñigo Goiri
HDFS-11174	Wrong HttpFS test command in doc	Minor	documentation, httpfs	John Zhuge	John Zhuge
HADOOP-13820	Replace ugi.getUsername() with ugi.getShortUserName() in viewFS	Minor	viewfs	Archana T	Brahma Reddy Battula
HADOOP-13838	KMSTokenRenewer should close providers	Critical	kms	Xiao Chen	Xiao Chen
HADOOP-13830	Intermittent failure of ITestS3NContractRootDir#testRecursiveRootListing: “Can not create a Path from an empty string”	Minor	fs/s3, test	Steve Loughran	Steve Loughran
YARN-5915	ATS 1.5 FileSystemTimelineWriter causes flush() to be called after every event write	Major	timelineserver	Atul Sikaria	Atul Sikaria
MAPREDUCE-6815	Fix flaky TestKill.testKillTask()	Major	mrv2	Haibo Chen	Haibo Chen
HDFS-11181	Fuse wrapper has a typo	Trivial	fuse-dfs	Wei-Chiu Chuang	Wei-Chiu Chuang
HADOOP-13847	KMSWebApp should close KeyProviderCryptoExtension	Major	kms	Anthony Young-Garner	John Zhuge
YARN-5559	Analyse 2.8.0/3.0.0 jdiff reports and fix any issues	Blocker	resourcemanager	Wangda Tan	Akira Ajisaka
HADOOP-13861	Spelling errors in logging and exceptions for code	Major	common, fs, io, security	Grant Sohn	Grant Sohn
HDFS-11180	Intermittent deadlock in NameNode when failover happens.	Blocker	namenode	Abhishek Modi	Akira Ajisaka
HDFS-11198	NN UI should link DN web address using hostnames	Critical	.	Kihwal Lee	Weiwei Yang
MAPREDUCE-6816	Progress bars in Web UI always at 100%	Blocker	webapps	Shen Yinjie	Shen Yinjie
YARN-5184	Fix up incompatible changes introduced on ContainerStatus and NodeReport	Blocker	api	Karthik Kambatla	Sangjin Lee
YARN-5921	Incorrect synchronization in RMContextImpl#setHAServiceState/getHAServiceState	Major	.	Varun Saxena	Varun Saxena
HDFS-11140	Directory Scanner should log startup message time correctly	Minor	.	Xiao Chen	Yiqun Lin
HDFS-11223	Fix typos in HttpFs documentations	Trivial	documentation	Yiqun Lin	Yiqun Lin
HDFS-11197	Listing encryption zones fails when deleting a EZ that is on a snapshotted directory	Minor	hdfs	Wellington Chevreuil	Wellington Chevreuil
HDFS-11224	Lifeline message should be ignored for dead nodes	Critical	.	Vinayakumar B	Vinayakumar B
HADOOP-13824	FsShell can suppress the real error if no error message is present	Major	fs	Rob Vesse	John Zhuge
MAPREDUCE-6820	Fix dead links in Job relevant classes	Minor	documentation	Yiqun Lin	Yiqun Lin
HDFS-8870	Lease is leaked on write failure	Major	hdfs-client	Rushabh S Shah	Kuhu Shukla
HADOOP-13565	KerberosAuthenticationHandler#authenticate should not rebuild SPN based on client request	Major	security	Xiaoyu Yao	Xiaoyu Yao
HDFS-11229	HDFS-11056 failed to close meta file	Blocker	datanode	Wei-Chiu Chuang	Wei-Chiu Chuang
HDFS-10570	Remove classpath conflicts of netty-all jar in hadoop-hdfs-client	Minor	test	Vinayakumar B	Vinayakumar B
HDFS-10684	WebHDFS DataNode calls fail without parameter createparent	Blocker	webhdfs	Samuel Low	John Zhuge
HDFS-11204	Document the missing options of hdfs zkfc command	Minor	documentation	Yiqun Lin	Yiqun Lin
HADOOP-13890	Maintain HTTP/host as SPNEGO SPN support and fix KerberosName parsing	Major	test	Brahma Reddy Battula	Xiaoyu Yao
HDFS-11094	Send back HAState along with NamespaceInfo during a versionRequest as an optional parameter	Major	datanode	Eric Badger	Eric Badger
HDFS-11160	VolumeScanner reports write-in-progress replicas as corrupt incorrectly	Major	datanode	Wei-Chiu Chuang	Wei-Chiu Chuang
HDFS-11263	ClassCastException when we use Bzipcodec for Fsimage compression	Critical	.	Brahma Reddy Battula	Brahma Reddy Battula
HDFS-11195	Return error when appending files by webhdfs rest api fails	Major	.	Yuanbo Liu	Yuanbo Liu
HDFS-11261	Document missing NameNode metrics	Minor	documentation	Yiqun Lin	Yiqun Lin
HDFS-11258	File mtime change could not save to editlog	Critical	.	Jimmy Xiang	Jimmy Xiang
HDFS-11271	Typo in NameNode UI	Trivial	namenode, ui	Wei-Chiu Chuang	Wei-Chiu Chuang
HDFS-11250	Fix a typo in ReplicaUnderRecovery#setRecoveryID	Trivial	.	Yiqun Lin	Yiqun Lin
HDFS-11270	Document the missing options of NameNode bootstrap command	Minor	documentation	Yiqun Lin	Yiqun Lin
HDFS-11252	TestFileTruncate#testTruncateWithDataNodesRestartImmediately can fail with BindException	Major	.	Jason Lowe	Yiqun Lin
YARN-6024	Capacity Scheduler ‘continuous reservation looking’ doesn’t work when sum of queue’s used and reserved resources is equal to max	Major	.	Wangda Tan	Wangda Tan
HADOOP-13883	Add description of -fs option in generic command usage	Minor	documentation	Yiqun Lin	Yiqun Lin
YARN-6029	CapacityScheduler deadlock when ParentQueue#getQueueUserAclInfo is called by one thread and LeafQueue#assignContainers is releasing excessive reserved container by another thread	Critical	capacityscheduler	Tao Yang	Tao Yang
HADOOP-12733	Remove references to obsolete io.seqfile configuration variables	Minor	.	Ray Chiang	Ray Chiang
HDFS-11280	Allow WebHDFS to reuse HTTP connections to NN	Major	hdfs	Zheng Shao	Zheng Shao
MAPREDUCE-6711	JobImpl fails to handle preemption events on state COMMITTING	Major	.	Li Lu	Prabhu Joseph
HADOOP-13958	Bump up release year to 2017	Blocker	.	Junping Du	Junping Du
YARN-6068	Log aggregation get failed when NM restart even with recovery	Blocker	.	Junping Du	Junping Du
YARN-4148	When killing app, RM releases app’s resource before they are released by NM	Major	resourcemanager	Jun Gong	Jason Lowe
HDFS-11312	Fix incompatible tag number change for nonDfsUsed in DatanodeInfoProto	Blocker	.	Sean Mackrory	Sean Mackrory
YARN-6072	RM unable to start in secure mode	Blocker	resourcemanager	Bibin A Chundatt	Ajith S
HDFS-10733	NameNode terminated after full GC thinking QJM is unresponsive.	Major	namenode, qjm	Konstantin Shvachko	Vinitha Reddy Gankidi
HADOOP-14001	Improve delegation token validity checking	Major	.	Akira Ajisaka	Akira Ajisaka
HDFS-11376	Revert HDFS-8377 Support HTTP/2 in datanode	Major	datanode	Andrew Wang	Xiao Chen
YARN-6151	FS preemption does not consider child queues over fairshare if the parent is under	Major	fairscheduler	Yufei Gu	Yufei Gu
YARN-5271	ATS client doesn’t work with Jersey 2 on the classpath	Major	client, timelineserver	Steve Loughran	Weiwei Yang
YARN-3933	FairScheduler: Multiple calls to completedContainer are not safe	Major	fairscheduler	Lavkesh Lahngir	Shiwei Guo
YARN-6177	Yarn client should exit with an informative error message if an incompatible Jersey library is used at client	Major	.	Weiwei Yang	Weiwei Yang
HDFS-11379	DFSInputStream may infinite loop requesting block locations	Critical	hdfs-client	Daryn Sharp	Daryn Sharp
HADOOP-14092	Typo in hadoop-aws index.md	Trivial	fs/s3	John Zhuge	John Zhuge
HADOOP-13826	S3A Deadlock in multipart copy due to thread pool limits.	Critical	fs/s3	Sean Mackrory	Sean Mackrory
HADOOP-14017	User friendly name for ADLS user and group	Major	fs/adl	John Zhuge	Vishwajeet Dusane
YARN-6175	FairScheduler: Negative vcore for resource needed to preempt	Major	fairscheduler	Yufei Gu	Yufei Gu
HADOOP-14028	S3A BlockOutputStreams doesn’t delete temporary files in multipart uploads or handle part upload failures	Critical	fs/s3	Seth Fitzsimmons	Steve Loughran
YARN-1728	Workaround guice3x-undecoded pathInfo in YARN WebApp	Major	.	Abraham Elmahrek	Yuanbo Liu
HADOOP-12979	IOE in S3a: ${hadoop.tmp.dir}/s3a not configured	Major	.	Steve Loughran	Steve Loughran
YARN-6270	WebUtils.getRMWebAppURLWithScheme() needs to honor RM HA setting	Major	.	Sumana Sathish	Xuan Gong
HDFS-11498	Make RestCsrfPreventionHandler and WebHdfsHandler compatible with Netty 4.0	Major	.	Andrew Wang	Andrew Wang
HADOOP-14087	S3A typo in pom.xml test exclusions	Major	fs/s3	Aaron Fabbri	Aaron Fabbri
HADOOP-14062	ApplicationMasterProtocolPBClientImpl.allocate fails with EOFException when RPC privacy is enabled	Critical	.	Steven Rand	Steven Rand
HDFS-11431	hadoop-hdfs-client JAR does not include ConfiguredFailoverProxyProvider	Blocker	build, hdfs-client	Steven Rand	Steven Rand
YARN-4925	ContainerRequest in AMRMClient, application should be able to specify nodes/racks together with nodeLabelExpression	Major	.	Bibin A Chundatt	Bibin A Chundatt
MAPREDUCE-6433	launchTime may be negative	Major	jobhistoryserver, mrv2	Allen Wittenauer	zhihai xu
HADOOP-12751	While using kerberos Hadoop incorrectly assumes names with ‘@’ to be non-simple	Critical	security	Bolke de Bruin	Bolke de Bruin

TESTS:

JIRA	Summary	Priority	Component	Reporter	Contributor
MAPREDUCE-6191	TestJavaSerialization fails with getting incorrect MR job result	Minor	test	sam liu	sam liu
YARN-3339	TestDockerContainerExecutor should pull a single image and not the entire centos repository	Minor	test	Ravindra Kumar Naik	Ravindra Kumar Naik
YARN-1880	Cleanup TestApplicationClientProtocolOnHA	Trivial	test	Tsuyoshi Ozawa	Tsuyoshi Ozawa
HDFS-6263	Remove DRFA.MaxBackupIndex config from log4j.properties	Minor	.	Akira Ajisaka	Abhiraj Butala
HDFS-6408	Remove redundant definitions in log4j.properties	Minor	test	Abhiraj Butala	Abhiraj Butala
YARN-2666	TestFairScheduler.testContinuousScheduling fails Intermittently	Major	scheduler	Tsuyoshi Ozawa	zhihai xu
HDFS-8247	TestDiskspaceQuotaUpdate#testAppendOverTypeQuota is failing	Major	test	Anu Engineer	Xiaoyu Yao
HADOOP-11881	test-patch.sh javac result is wildly wrong	Major	build, test	Allen Wittenauer	Kengo Seki
HADOOP-11904	test-patch.sh goes into an infinite loop on non-maven builds	Critical	test	Allen Wittenauer	Allen Wittenauer
YARN-3343	TestCapacitySchedulerNodeLabelUpdate.testNodeUpdate sometime fails in trunk	Minor	.	Xuan Gong	Rohith Sharma K S
YARN-3580	[JDK 8] TestClientRMService.testGetLabelsToNodes fails	Major	test	Robert Kanter	Robert Kanter
HDFS-7559	Create unit test to automatically compare HDFS related classes and hdfs-default.xml	Minor	.	Ray Chiang	Ray Chiang
HADOOP-11906	test-patch.sh should use ‘file’ command for patch determinism	Major	.	Allen Wittenauer	Sean Busbey
YARN-3602	TestResourceLocalizationService.testPublicResourceInitializesLocalDir fails Intermittently due to IOException from cleanup	Minor	test	zhihai xu	zhihai xu
HDFS-8243	Files written by TestHostsFiles and TestNameNodeMXBean are causing Release Audit Warnings.	Minor	test	Ruth Wisniewski	Ruth Wisniewski
HADOOP-11884	test-patch.sh should pull the real findbugs version	Minor	test	Allen Wittenauer	Kengo Seki
HADOOP-11944	add option to test-patch to avoid relocating patch process directory	Minor	.	Sean Busbey	Sean Busbey
HADOOP-11949	Add user-provided plugins to test-patch	Major	.	Sean Busbey	Sean Busbey
HADOOP-12000	cannot use –java-home in test-patch	Major	scripts	Allen Wittenauer	Allen Wittenauer
MAPREDUCE-6204	TestJobCounters should use new properties instead of JobConf.MAPRED_TASK_JAVA_OPTS	Minor	test	sam liu	sam liu
HADOOP-12035	shellcheck plugin displays a wrong version potentially	Trivial	build	Kengo Seki	Kengo Seki
HADOOP-12030	test-patch should only report on newly introduced findbugs warnings.	Major	.	Sean Busbey	Sean Busbey
HADOOP-11930	test-patch in offline mode should tell maven to be in offline mode	Major	.	Sean Busbey	Sean Busbey
HADOOP-11965	determine-flaky-tests needs a summary mode	Minor	.	Allen Wittenauer	Yufei Gu
HDFS-8645	Resolve inconsistent code in TestReplicationPolicy between trunk and branch-2	Major	namenode	Zhe Zhang	Zhe Zhang
YARN-2871	TestRMRestart#testRMRestartGetApplicationList sometime fails in trunk	Minor	.	Ted Yu	zhihai xu
YARN-3956	Fix TestNodeManagerHardwareUtils fails on Mac	Minor	nodemanager	Varun Vasudev	Varun Vasudev
HDFS-8834	TestReplication#testReplicationWhenBlockCorruption is not valid after HDFS-6482	Minor	datanode	Lei (Eddy) Xu	Lei (Eddy) Xu
YARN-3992	TestApplicationPriority.testApplicationPriorityAllocation fails intermittently	Major	.	Zhijie Shen	Sunil Govindan
HDFS-2070	Add more unit tests for FsShell getmerge	Major	test	XieXianshan	Daniel Templeton
MAPREDUCE-5045	UtilTest#isCygwin method appears to be unused	Trivial	contrib/streaming, test	Chris Nauroth	Neelesh Srinivas Salian
YARN-3573	MiniMRYarnCluster constructor that starts the timeline server using a boolean should be marked deprecated	Major	timelineserver	Mit Desai	Brahma Reddy Battula
HDFS-9295	Add a thorough test of the full KMS code path	Critical	security, test	Daniel Templeton	Daniel Templeton
HDFS-9339	Extend full test of KMS ACLs	Major	test	Daniel Templeton	Daniel Templeton
HDFS-9354	Fix TestBalancer#testBalancerWithZeroThreadsForMove on Windows	Major	test	Xiaoyu Yao	Xiaoyu Yao
HDFS-9410	Some tests should always reset sysout and syserr	Minor	test	Xiao Chen	Xiao Chen
HADOOP-12564	Upgrade JUnit3 TestCase to JUnit 4 in org.apache.hadoop.io package	Trivial	test	Dustin Cote	Dustin Cote
HDFS-9153	Pretty-format the output for DFSIO	Major	.	Kai Zheng	Kai Zheng
HDFS-9429	Tests in TestDFSAdminWithHA intermittently fail with EOFException	Major	test	Xiao Chen	Xiao Chen
HADOOP-10729	Add tests for PB RPC in case version mismatch of client and server	Major	ipc	Junping Du	Junping Du
HDFS-7553	fix the TestDFSUpgradeWithHA due to BindException	Major	test	Liang Xie	Xiao Chen
HDFS-9626	TestBlockReplacement#testBlockReplacement fails occasionally	Minor	test	Xiao Chen	Xiao Chen
HADOOP-12696	Add Tests for S3FileSystem Contract	Major	tools	Matthew Paduano	Matthew Paduano
MAPREDUCE-6614	Remove unnecessary code in TestMapreduceConfigFields	Minor	test	Akira Ajisaka	Kai Sasaki
HADOOP-12736	TestTimedOutTestsListener#testThreadDumpAndDeadlocks sometimes times out	Major	.	Xiao Chen	Xiao Chen
HADOOP-12715	TestValueQueue#testgetAtMostPolicyALL fails intermittently	Major	.	Xiao Chen	Xiao Chen
HDFS-9773	Remove dead code related to SimulatedFSDataset in tests	Minor	test	Akira Ajisaka	Brahma Reddy Battula
HDFS-9888	Allow reseting KerberosName in unit tests	Minor	.	Xiao Chen	Xiao Chen
YARN-4717	TestResourceLocalizationService.testPublicResourceInitializesLocalDir fails Intermittently due to IllegalArgumentException from cleanup	Minor	nodemanager	Daniel Templeton	Daniel Templeton
HDFS-9949	Add a test case to ensure that the DataNode does not regenerate its UUID when a storage directory is cleared	Minor	.	Harsh J	Harsh J
HADOOP-12738	Create unit test to automatically compare Common related classes and core-default.xml	Minor	.	Ray Chiang	Ray Chiang
HADOOP-12101	Add automatic search of default Configuration variables to TestConfigurationFieldsBase	Major	test	Ray Chiang	Ray Chiang
YARN-4947	Test timeout is happening for TestRMWebServicesNodes	Major	test	Bibin A Chundatt	Bibin A Chundatt
YARN-5069	TestFifoScheduler.testResourceOverCommit race condition	Major	test	Eric Badger	Eric Badger
YARN-5114	Add additional tests in TestRMWebServicesApps and rectify testInvalidAppAttempts failure in 2.8	Minor	.	Bibin A Chundatt	Bibin A Chundatt
HDFS-10375	Remove redundant TestMiniDFSCluster.testDualClusters	Trivial	test	John Zhuge	Jiayi Zhou
YARN-5023	TestAMRestart#testShouldNotCountFailureToMaxAttemptRetry random failure	Major	.	Bibin A Chundatt	sandflee
YARN-5318	TestRMAdminService#testRefreshNodesResourceWithFileSystemBasedConfigurationProvider fails intermittently.	Minor	.	sandflee	Jun Gong
YARN-5037	TestRMRestart#testQueueMetricsOnRMRestart random failure	Major	.	sandflee	sandflee
YARN-5317	testAMRestartNotLostContainerCompleteMsg may fail	Minor	.	sandflee	sandflee
YARN-5159	Wrong Javadoc tag in MiniYarnCluster	Major	documentation	Andras Bokor	Andras Bokor
MAPREDUCE-6738	TestJobListCache.testAddExisting failed intermittently in slow VM testbed	Minor	.	Junping Du	Junping Du
YARN-5092	TestRMDelegationTokens fails intermittently	Major	test	Rohith Sharma K S	Jason Lowe
HADOOP-10980	TestActiveStandbyElector fails occasionally in trunk	Minor	.	Ted Yu	Eric Badger
HADOOP-13395	Enhance TestKMSAudit	Minor	kms	Xiao Chen	Xiao Chen
YARN-5492	TestSubmitApplicationWithRMHA is failing sporadically during precommit builds	Major	test	Jason Lowe	Vrushali C
YARN-5544	TestNodeBlacklistingOnAMFailures fails on trunk	Major	test	Varun Saxena	Sunil Govindan
HDFS-9745	TestSecureNNWithQJM#testSecureMode sometimes fails with timeouts	Minor	.	Xiao Chen	Xiao Chen
YARN-5389	TestYarnClient#testReservationDelete fails	Major	.	Rohith Sharma K S	Sean Po
YARN-5560	Clean up bad exception catching practices in TestYarnClient	Major	.	Sean Po	Sean Po
HDFS-10657	testAclCLI.xml setfacl test should expect mask r-x	Minor	.	John Zhuge	John Zhuge
HDFS-9333	Some tests using MiniDFSCluster errored complaining port in use	Minor	test	Kai Zheng	Masatake Iwasaki
HADOOP-13686	Adding additional unit test for Trash (I)	Major	.	Xiaoyu Yao	Weiwei Yang
YARN-3568	TestAMRMTokens should use some random port	Major	test	Gera Shegalov	Takashi Ohnishi
MAPREDUCE-6804	Add timeout when starting JobHistoryServer in MiniMRYarnCluster	Minor	test	Andras Bokor	Andras Bokor
HDFS-11272	Refine the assert messages in TestFSDirAttrOp	Minor	test	Akira Ajisaka	Jimmy Xiang
HDFS-11278	Add missing @Test annotation for TestSafeMode.testSafeModeUtils()	Trivial	namenode	Lukas Majercak	Lukas Majercak
YARN-5608	TestAMRMClient.setup() fails with ArrayOutOfBoundsException	Major	test	Daniel Templeton	Daniel Templeton

SUB-TASKS:

JIRA	Summary	Priority	Component	Reporter	Contributor
YARN-3356	Capacity Scheduler FiCaSchedulerApp should use ResourceUsage to track used-resources-by-label.	Major	capacityscheduler, resourcemanager	Wangda Tan	Wangda Tan
YARN-3345	Add non-exclusive node label API to RMAdmin protocol and NodeLabelsManager	Major	api, client, resourcemanager	Wangda Tan	Wangda Tan
HDFS-7854	Separate class DataStreamer out of DFSOutputStream	Major	hdfs-client	Li Bo	Li Bo
HDFS-7713	Implement mkdirs in the HDFS Web UI	Major	ui	Ravi Prakash	Ravi Prakash
YARN-2495	Allow admin specify labels from each NM (Distributed configuration)	Major	resourcemanager	Wangda Tan	Naganarasimha G R
HDFS-7893	Update the POM to create a separate hdfs-client jar	Major	build	Haohui Mai	Haohui Mai
YARN-3365	Add support for using the ‘tc’ tool via container-executor	Major	nodemanager	Sidharta Seethana	Sidharta Seethana
HDFS-8034	Fix TestDFSClientRetries#testDFSClientConfigurationLocateFollowingBlockInitialDelay for Windows	Minor	test	Xiaoyu Yao	Xiaoyu Yao
YARN-3110	Few issues in ApplicationHistory web ui	Minor	applications, timelineserver	Bibin A Chundatt	Naganarasimha G R
HDFS-8049	Annotation client implementation as private	Major	hdfs-client	Tsz Wo Nicholas Sze	Takuya Fukudome
HDFS-8079	Separate the client retry conf from DFSConfigKeys	Major	hdfs-client	Tsz Wo Nicholas Sze	Tsz Wo Nicholas Sze
HDFS-8080	Separate JSON related routines used by WebHdfsFileSystem to a package local class	Minor	hdfs-client	Haohui Mai	Haohui Mai
HDFS-8085	Move CorruptFileBlockIterator to the hdfs.client.impl package	Minor	hdfs-client	Tsz Wo Nicholas Sze	Tsz Wo Nicholas Sze
HDFS-8089	Move o.a.h.hdfs.web.resources.* to the client jars	Minor	build	Haohui Mai	Haohui Mai
HDFS-8102	Separate webhdfs retry configuration keys from DFSConfigKeys	Minor	hdfs-client	Haohui Mai	Haohui Mai
YARN-1376	NM need to notify the log aggregation status to RM through Node heartbeat	Major	.	Xuan Gong	Xuan Gong
HDFS-8100	Refactor DFSClient.Conf to a standalone class	Minor	hdfs-client	Tsz Wo Nicholas Sze	Tsz Wo Nicholas Sze
HDFS-8103	Move BlockTokenSecretManager.AccessMode into BlockTokenIdentifier	Minor	security	Haohui Mai	Haohui Mai
HDFS-8084	Separate the client failover conf from DFSConfigKeys	Major	hdfs-client	Tsz Wo Nicholas Sze	Tsz Wo Nicholas Sze
HDFS-8083	Separate the client write conf from DFSConfigKeys	Major	hdfs-client	Tsz Wo Nicholas Sze	Tsz Wo Nicholas Sze
YARN-3347	Improve YARN log command to get AMContainer logs as well as running containers logs	Major	log-aggregation	Xuan Gong	Xuan Gong
YARN-3443	Create a ‘ResourceHandler’ subsystem to ease addition of support for new resource types on the NM	Major	nodemanager	Sidharta Seethana	Sidharta Seethana
HDFS-7701	Support reporting per storage type quota and usage with hadoop/hdfs shell	Major	datanode, namenode	Xiaoyu Yao	Peter Shi
YARN-3361	CapacityScheduler side changes to support non-exclusive node labels	Major	capacityscheduler	Wangda Tan	Wangda Tan
YARN-3318	Create Initial OrderingPolicy Framework and FifoOrderingPolicy	Major	scheduler	Craig Welch	Craig Welch
YARN-3326	Support RESTful API for getLabelsToNodes	Minor	resourcemanager	Naganarasimha G R	Naganarasimha G R
YARN-3354	Container should contains node-labels asked by original ResourceRequests	Major	api, capacityscheduler, nodemanager, resourcemanager	Wangda Tan	Wangda Tan
HDFS-8082	Separate the client read conf from DFSConfigKeys	Major	hdfs-client	Tsz Wo Nicholas Sze	Tsz Wo Nicholas Sze
HDFS-8165	Move GRANDFATHER_GENERATION_STAMP and GRANDFATER_INODE_ID to hdfs-client	Major	build	Haohui Mai	Haohui Mai
YARN-1402	Related Web UI, CLI changes on exposing client API to check log aggregation status	Major	.	Xuan Gong	Xuan Gong
YARN-2696	Queue sorting in CapacityScheduler should consider node label	Major	capacityscheduler, resourcemanager	Wangda Tan	Wangda Tan
YARN-3487	CapacityScheduler scheduler lock obtained unnecessarily when calling getQueue	Critical	capacityscheduler	Jason Lowe	Jason Lowe
YARN-3136	getTransferredContainers can be a bottleneck during AM registration	Major	scheduler	Jason Lowe	Sunil Govindan
HDFS-8169	Move LocatedBlocks and related classes to hdfs-client	Major	build, hdfs-client	Haohui Mai	Haohui Mai
YARN-3463	Integrate OrderingPolicy Framework with CapacityScheduler	Major	capacityscheduler	Craig Welch	Craig Welch
HDFS-8185	Separate client related routines in HAUtil into a new class	Major	build, hdfs-client	Haohui Mai	Haohui Mai
YARN-3225	New parameter or CLI for decommissioning node gracefully in RMAdmin CLI	Major	graceful	Junping Du	Devaraj K
HDFS-8218	Move classes that used by ClientProtocol into hdfs-client	Major	build	Haohui Mai	Haohui Mai
YARN-3366	Outbound network bandwidth : classify/shape traffic originating from YARN containers	Major	.	Sidharta Seethana	Sidharta Seethana
YARN-2605	[RM HA] Rest api endpoints doing redirect incorrectly	Major	resourcemanager	bc Wong	Xuan Gong
YARN-3319	Implement a FairOrderingPolicy	Major	scheduler	Craig Welch	Craig Welch
YARN-3413	Node label attributes (like exclusivity) should settable via addToClusterNodeLabels but shouldn’t be changeable at runtime	Major	api, client, resourcemanager	Wangda Tan	Wangda Tan
YARN-2498	Respect labels in preemption policy of capacity scheduler for inter-queue preemption	Major	resourcemanager	Wangda Tan	Wangda Tan
YARN-2740	Fix NodeLabelsManager to properly handle node label modifications when distributed node label configuration enabled	Major	resourcemanager	Wangda Tan	Naganarasimha G R
YARN-3544	AM logs link missing in the RM UI for a completed app	Blocker	.	Hitesh Shah	Xuan Gong
YARN-2619	NodeManager: Add cgroups support for disk I/O isolation	Major	.	Wei Yan	Varun Vasudev
HDFS-8086	Move LeaseRenewer to the hdfs.client.impl package	Minor	hdfs-client	Tsz Wo Nicholas Sze	Takanobu Asanuma
YARN-3006	Improve the error message when attempting manual failover with auto-failover enabled	Minor	.	Akira Ajisaka	Akira Ajisaka
HDFS-8249	Separate HdfsConstants into the client and the server side class	Major	hdfs-client	Haohui Mai	Haohui Mai
HDFS-8309	Skip unit test using DataNodeTestUtils#injectDataDirFailure() on Windows	Minor	test	Xiaoyu Yao	Xiaoyu Yao
HDFS-8237	Move all protocol classes used by ClientProtocol to hdfs-client	Major	build	Haohui Mai	Haohui Mai
HDFS-8314	Move HdfsServerConstants#IO_FILE_BUFFER_SIZE and SMALL_BUFFER_SIZE to the users	Major	.	Haohui Mai	Li Lu
HDFS-8310	Fix TestCLI.testAll ‘help: help for find’ on Windows	Minor	test	Xiaoyu Yao	Kiran Kumar M R
YARN-3301	Fix the format issue of the new RM web UI and AHS web UI after YARN-3272 / YARN-3262	Major	resourcemanager	Xuan Gong	Xuan Gong
YARN-3448	Add Rolling Time To Lives Level DB Plugin Capabilities	Major	timelineserver	Jonathan Eagles	Jonathan Eagles
YARN-2918	Don’t fail RM if queue’s configured labels are not existed in cluster-node-labels	Major	resourcemanager	Rohith Sharma K S	Wangda Tan
YARN-644	Basic null check is not performed on passed in arguments before using them in ContainerManagerImpl.startContainer	Minor	nodemanager	Omkar Vinit Joshi	Varun Saxena
YARN-3593	Add label-type and Improve “DEFAULT_PARTITION” in Node Labels Page	Major	webapp	Naganarasimha G R	Naganarasimha G R
YARN-2331	Distinguish shutdown during supervision vs. shutdown for rolling upgrade	Major	nodemanager	Jason Lowe	Jason Lowe
YARN-3579	CommonNodeLabelsManager should support NodeLabel instead of string label name when getting node-to-label/label-to-label mappings	Minor	resourcemanager	Sunil Govindan	Sunil Govindan
YARN-3505	Node’s Log Aggregation Report with SUCCEED should not cached in RMApps	Critical	log-aggregation	Junping Du	Xuan Gong
HDFS-8403	Eliminate retries in TestFileCreation#testOverwriteOpenForWrite	Major	test	Arpit Agarwal	Arpit Agarwal
HDFS-8157	Writes to RAM DISK reserve locked memory for block files	Major	datanode	Arpit Agarwal	Arpit Agarwal
YARN-3541	Add version info on timeline service / generic history web UI and REST API	Major	timelineserver	Zhijie Shen	Zhijie Shen
YARN-3565	NodeHeartbeatRequest/RegisterNodeManagerRequest should use NodeLabel object instead of String	Blocker	api, client, resourcemanager	Wangda Tan	Naganarasimha G R
YARN-3583	Support of NodeLabel object instead of plain String in YarnClient side.	Major	client	Sunil Govindan	Sunil Govindan
YARN-3609	Move load labels from storage from serviceInit to serviceStart to make it works with RM HA case.	Major	resourcemanager	Wangda Tan	Wangda Tan
YARN-3684	Change ContainerExecutor’s primary lifecycle methods to use a more extensible mechanism for passing information.	Major	yarn	Sidharta Seethana	Sidharta Seethana
HDFS-8454	Remove unnecessary throttling in TestDatanodeDeath	Major	test	Arpit Agarwal	Arpit Agarwal
YARN-3632	Ordering policy should be allowed to reorder an application when demand changes	Major	capacityscheduler	Craig Welch	Craig Welch
YARN-3686	CapacityScheduler should trim default_node_label_expression	Critical	api, client, resourcemanager	Wangda Tan	Sunil Govindan
YARN-3647	RMWebServices api’s should use updated api from CommonNodeLabelsManager to get NodeLabel object	Major	resourcemanager	Sunil Govindan	Sunil Govindan
YARN-3581	Deprecate -directlyAccessNodeLabelStore in RMAdminCLI	Major	api, client, resourcemanager	Wangda Tan	Naganarasimha G R
HDFS-8482	Rename BlockInfoContiguous to BlockInfo	Major	.	Zhe Zhang	Zhe Zhang
YARN-3700	ATS Web Performance issue at load time when large number of jobs	Major	resourcemanager, webapp, yarn	Xuan Gong	Xuan Gong
YARN-3716	Node-label-expression should be included by ResourceRequestPBImpl.toString	Minor	api	Xianyin Xin	Xianyin Xin
YARN-3740	Fixed the typo with the configuration name: APPLICATION_HISTORY_PREFIX_MAX_APPS	Major	resourcemanager, webapp, yarn	Xuan Gong	Xuan Gong
YARN-2900	Application (Attempt and Container) Not Found in AHS results in Internal Server Error (500)	Major	timelineserver	Jonathan Eagles	Mit Desai
HDFS-8489	Subclass BlockInfo to represent contiguous blocks	Major	namenode	Zhe Zhang	Zhe Zhang
YARN-2392	add more diags about app retry limits on AM failures	Minor	resourcemanager	Steve Loughran	Steve Loughran
YARN-3766	ATS Web UI breaks because of YARN-3467	Blocker	resourcemanager, webapp, yarn	Xuan Gong	Xuan Gong
YARN-1462	AHS API and other AHS changes to handle tags for completed MR jobs	Major	.	Karthik Kambatla	Xuan Gong
YARN-3787	loading applications by filtering appstartedTime period for ATS Web UI	Major	resourcemanager, webapp, yarn	Xuan Gong	Xuan Gong
HDFS-7923	The DataNodes should rate-limit their full block reports by asking the NN on heartbeat messages	Major	.	Colin P. McCabe	Colin P. McCabe
HDFS-8540	Mover should exit with NO_MOVE_BLOCK if no block can be moved	Major	balancer & mover	Tsz Wo Nicholas Sze	Surendra Singh Lilhore
YARN-3711	Documentation of ResourceManager HA should explain configurations about listen addresses	Minor	documentation	Masatake Iwasaki	Masatake Iwasaki
HDFS-8597	Fix TestFSImage#testZeroBlockSize on Windows	Major	datanode, test	Xiaoyu Yao	Xiaoyu Yao
HDFS-7164	Feature documentation for HDFS-6581	Major	documentation	Arpit Agarwal	Arpit Agarwal
HDFS-8238	Move ClientProtocol to the hdfs-client	Major	build	Haohui Mai	Takanobu Asanuma
HDFS-6249	Output AclEntry in PBImageXmlWriter	Minor	tools	Akira Ajisaka	Surendra Singh Lilhore
YARN-3521	Support return structured NodeLabel objects in REST API	Major	api, client, resourcemanager	Wangda Tan	Sunil Govindan
HDFS-8192	Eviction should key off used locked memory instead of ram disk free space	Major	datanode	Arpit Agarwal	Arpit Agarwal
HDFS-8651	Make hadoop-hdfs-project Native code -Wall-clean	Major	native	Alan Burlison	Alan Burlison
HADOOP-12036	Consolidate all of the cmake extensions in one directory	Major	.	Allen Wittenauer	Alan Burlison
HDFS-7390	Provide JMX metrics per storage type	Major	.	Benoy Antony	Benoy Antony
HADOOP-12104	Migrate Hadoop Pipes native build to new CMake framework	Major	build	Alan Burlison	Alan Burlison
HADOOP-12112	Make hadoop-common-project Native code -Wall-clean	Major	native	Alan Burlison	Alan Burlison
HDFS-8493	Consolidate truncate() related implementation in a single class	Major	.	Haohui Mai	Rakesh R
HDFS-8635	Migrate HDFS native build to new CMake framework	Major	build	Alan Burlison	Alan Burlison
YARN-3827	Migrate YARN native build to new CMake framework	Major	build	Alan Burlison	Alan Burlison
MAPREDUCE-6376	Add avro binary support for jhist files	Major	jobhistoryserver	Ray Chiang	Ray Chiang
HDFS-8620	Clean up the checkstyle warinings about ClientProtocol	Major	.	Takanobu Asanuma	Takanobu Asanuma
HDFS-8726	Move protobuf files that define the client-sever protocols to hdfs-client	Major	build	Haohui Mai	Haohui Mai
YARN-1012	Report NM aggregated container resource utilization in heartbeat	Major	nodemanager	Arun C Murthy	Íñigo Goiri
YARN-3800	Reduce storage footprint for ReservationAllocation	Major	capacityscheduler, fairscheduler, resourcemanager	Anubhav Dhoot	Anubhav Dhoot
YARN-3445	Cache runningApps in RMNode for getting running apps on given NodeId	Major	nodemanager, resourcemanager	Junping Du	Junping Du
YARN-3116	[Collector wireup] We need an assured way to determine if a container is an AM container on NM	Major	nodemanager, timelineserver	Zhijie Shen	Giovanni Matteo Fumarola
HDFS-8541	Mover should exit with NO_MOVE_PROGRESS if there is no move progress	Minor	balancer & mover	Tsz Wo Nicholas Sze	Surendra Singh Lilhore
HDFS-8742	Inotify: Support event for OP_TRUNCATE	Major	namenode	Surendra Singh Lilhore	Surendra Singh Lilhore
YARN-1449	AM-NM protocol changes to support container resizing	Major	api	Wangda Tan (No longer used)	MENG DING
HADOOP-11974	Fix FIONREAD #include on Solaris	Minor	net	Alan Burlison	Alan Burlison
YARN-3930	FileSystemNodeLabelsStore should make sure edit log file closed when exception is thrown	Major	api, client, resourcemanager	Dian Fu	Dian Fu
YARN-3844	Make hadoop-yarn-project Native code -Wall-clean	Major	build	Alan Burlison	Alan Burlison
HDFS-8794	Improve CorruptReplicasMap#corruptReplicasMap	Major	.	Yi Liu	Yi Liu
HDFS-7483	Display information per tier on the Namenode UI	Major	.	Benoy Antony	Benoy Antony
YARN-2003	Support for Application priority : Changes in RM and Capacity Scheduler	Major	resourcemanager	Sunil Govindan	Sunil Govindan
HDFS-8721	Add a metric for number of encryption zones	Major	encryption	Rakesh R	Rakesh R
YARN-1645	ContainerManager implementation to support container resizing	Major	nodemanager	Wangda Tan	MENG DING
HDFS-8495	Consolidate append() related implementation into a single class	Major	namenode	Rakesh R	Rakesh R
HDFS-8795	Improve InvalidateBlocks#node2blocks	Major	.	Yi Liu	Yi Liu
HADOOP-12184	Remove unused Linux-specific constants in NativeIO	Major	native	Martin Walsh	Martin Walsh
HDFS-8730	Clean up the import statements in ClientProtocol	Minor	.	Takanobu Asanuma	Takanobu Asanuma
YARN-3969	Allow jobs to be submitted to reservation that is active but does not have any allocations	Major	capacityscheduler, fairscheduler, resourcemanager	Subru Krishnan	Subru Krishnan
HADOOP-12170	hadoop-common’s JNIFlags.cmake is redundant and can be removed	Minor	native	Alan Burlison	Alan Burlison
YARN-3656	LowCost: A Cost-Based Placement Agent for YARN Reservations	Major	capacityscheduler, resourcemanager	Ishai Menache	Jonathan Yaniv
YARN-3852	Add docker container support to container-executor	Major	yarn	Sidharta Seethana	Abin Shahab
YARN-3853	Add docker container runtime support to LinuxContainterExecutor	Major	yarn	Sidharta Seethana	Sidharta Seethana
YARN-3867	ContainerImpl changes to support container resizing	Major	nodemanager	MENG DING	MENG DING
HDFS-7192	DN should ignore lazyPersist hint if the writer is not local	Major	datanode	Arpit Agarwal	Arpit Agarwal
YARN-433	When RM is catching up with node updates then it should not expire acquired containers	Major	resourcemanager	Bikas Saha	Xuan Gong
MAPREDUCE-6394	Speed up Task processing loop in HsTasksBlock#render()	Major	jobhistoryserver	Ray Chiang	Ray Chiang
HADOOP-7824	NativeIO.java flags and identifiers must be set correctly for each platform, not hardcoded to their Linux values	Major	native	Dmytro Shteflyuk	Martin Walsh
YARN-3543	ApplicationReport should be able to tell whether the Application is AM managed or not.	Major	api	Spandan Dutta	Rohith Sharma K S
YARN-4004	container-executor should print output of docker logs if the docker container exits with non-0 exit status	Major	nodemanager	Varun Vasudev	Varun Vasudev
YARN-3736	Add RMStateStore apis to store and load accepted reservations for failover	Major	capacityscheduler, fairscheduler, resourcemanager	Subru Krishnan	Anubhav Dhoot
YARN-1643	Make ContainersMonitor can support change monitoring size of an allocated container in NM side	Major	nodemanager	Wangda Tan	MENG DING
YARN-3974	Refactor the reservation system test cases to use parameterized base test	Major	capacityscheduler, fairscheduler	Subru Krishnan	Subru Krishnan
YARN-3948	Display Application Priority in RM Web UI	Major	webapp	Sunil Govindan	Sunil Govindan
YARN-3873	pendingApplications in LeafQueue should also use OrderingPolicy	Major	capacityscheduler	Sunil Govindan	Sunil Govindan
YARN-3887	Support for changing Application priority during runtime	Major	capacityscheduler, resourcemanager	Sunil Govindan	Sunil Govindan
HDFS-8805	Archival Storage: getStoragePolicy should not need superuser privilege	Major	balancer & mover, namenode	Hui Zheng	Brahma Reddy Battula
HDFS-8052	Move WebHdfsFileSystem into hadoop-hdfs-client	Major	build	Haohui Mai	Haohui Mai
YARN-4023	Publish Application Priority to TimelineServer	Major	timelineserver	Sunil Govindan	Sunil Govindan
HDFS-8824	Do not use small blocks for balancing the cluster	Major	balancer & mover	Tsz Wo Nicholas Sze	Tsz Wo Nicholas Sze
YARN-3534	Collect memory/cpu usage on the node	Major	nodemanager, resourcemanager	Íñigo Goiri	Íñigo Goiri
HDFS-8801	Convert BlockInfoUnderConstruction as a feature	Major	namenode	Zhe Zhang	Jing Zhao
HDFS-8792	BlockManager#postponedMisreplicatedBlocks should use a LightWeightHashSet to save memory	Major	.	Yi Liu	Yi Liu
HDFS-8862	BlockManager#excessReplicateMap should use a HashMap	Major	namenode	Yi Liu	Yi Liu
HDFS-8278	HDFS Balancer should consider remaining storage % when checking for under-utilized machines	Major	balancer & mover	Gopal V	Tsz Wo Nicholas Sze
HDFS-8826	Balancer may not move blocks efficiently in some cases	Major	balancer & mover	Tsz Wo Nicholas Sze	Tsz Wo Nicholas Sze
HDFS-8803	Move DfsClientConf to hdfs-client	Major	build	Haohui Mai	Mingliang Liu
YARN-2923	Support configuration based NodeLabelsProvider Service in Distributed Node Label Configuration Setup	Major	nodemanager	Naganarasimha G R	Naganarasimha G R
YARN-1644	RM-NM protocol changes and NodeStatusUpdater implementation to support container resizing	Major	nodemanager	Wangda Tan	MENG DING
YARN-3868	ContainerManager recovery for container resizing	Major	nodemanager	MENG DING	MENG DING
HDFS-8823	Move replication factor into individual blocks	Major	.	Haohui Mai	Haohui Mai
YARN-221	NM should provide a way for AM to tell it not to aggregate logs.	Major	log-aggregation, nodemanager	Robert Joseph Evans	Ming Ma
HDFS-8934	Move ShortCircuitShm to hdfs-client	Major	build	Mingliang Liu	Mingliang Liu
HDFS-8948	Use GenericTestUtils to set log levels in TestPread and TestReplaceDatanodeOnFailure	Major	build	Mingliang Liu	Mingliang Liu
YARN-4014	Support user cli interface in for Application Priority	Major	client, resourcemanager	Rohith Sharma K S	Rohith Sharma K S
HDFS-8951	Move the shortcircuit package to hdfs-client	Major	build	Mingliang Liu	Mingliang Liu
HDFS-8248	Store INodeId instead of the INodeFile object in BlockInfoContiguous	Major	.	Haohui Mai	Haohui Mai
HDFS-8962	Clean up checkstyle warnings in o.a.h.hdfs.DfsClientConf	Major	build	Mingliang Liu	Mingliang Liu
YARN-3250	Support admin cli interface in for Application Priority	Major	resourcemanager	Sunil Govindan	Rohith Sharma K S
HDFS-8925	Move BlockReaderLocal to hdfs-client	Major	build	Mingliang Liu	Mingliang Liu
HDFS-8980	Remove unnecessary block replacement in INodeFile	Major	namenode	Jing Zhao	Jing Zhao
HDFS-8990	Move RemoteBlockReader to hdfs-client module	Major	build	Mingliang Liu	Mingliang Liu
YARN-4092	RM HA UI redirection needs to be fixed when both RMs are in standby mode	Major	resourcemanager	Xuan Gong	Xuan Gong
YARN-4082	Container shouldn’t be killed when node’s label updated.	Major	capacity scheduler	Wangda Tan	Wangda Tan
YARN-2801	Add documentation for node labels feature	Major	documentation	Gururaj Shetty	Wangda Tan
YARN-3893	Both RM in active state when Admin#transitionToActive failure from refeshAll()	Critical	resourcemanager	Bibin A Chundatt	Bibin A Chundatt
HDFS-8890	Allow admin to specify which blockpools the balancer should run on	Major	balancer & mover	Chris Trezzo	Chris Trezzo
YARN-4101	RM should print alert messages if Zookeeper and Resourcemanager gets connection issue	Critical	yarn	Yesha Vora	Xuan Gong
YARN-3970	REST api support for Application Priority	Major	webapp	Sunil Govindan	Naganarasimha G R
HDFS-9002	Move o.a.h.hdfs.net/*Peer classes to hdfs-client	Major	build	Mingliang Liu	Mingliang Liu
HDFS-9012	Move o.a.h.hdfs.protocol.datatransfer.PipelineAck class to hadoop-hdfs-client module	Major	build	Mingliang Liu	Mingliang Liu
HDFS-8984	Move replication queues related methods in FSNamesystem to BlockManager	Major	.	Haohui Mai	Haohui Mai
YARN-2884	Proxying all AM-RM communications	Major	nodemanager, resourcemanager	Carlo Curino	Kishore Chaliparambil
YARN-4136	LinuxContainerExecutor loses info when forwarding ResourceHandlerException	Trivial	nodemanager	Steve Loughran	Bibin A Chundatt
HDFS-9041	Move entries in META-INF/services/o.a.h.fs.FileSystem to hdfs-client	Major	build	Haohui Mai	Mingliang Liu
HDFS-9010	Replace NameNode.DEFAULT_PORT with HdfsClientConfigKeys.DFS_NAMENODE_RPC_PORT_DEFAULT config key	Major	build	Mingliang Liu	Mingliang Liu
YARN-1651	CapacityScheduler side changes to support increase/decrease container resource.	Major	resourcemanager, scheduler	Wangda Tan	Wangda Tan
YARN-313	Add Admin API for supporting node resource configuration in command line	Critical	client, graceful	Junping Du	Íñigo Goiri
HDFS-9008	Balancer#Parameters class could use a builder pattern	Minor	balancer & mover	Chris Trezzo	Chris Trezzo
YARN-3635	Get-queue-mapping should be a common interface of YarnScheduler	Major	scheduler	Wangda Tan	Tan, Wangda
YARN-3717	Expose app/am/queue’s node-label-expression to RM web UI / CLI / REST-API	Major	.	Naganarasimha G R	Naganarasimha G R
HDFS-7986	Allow files / directories to be deleted from the NameNode UI	Major	ui	Ravi Prakash	Ravi Prakash
HDFS-7995	Implement chmod in the HDFS Web UI	Major	ui	Ravi Prakash	Ravi Prakash
YARN-4034	Render cluster Max Priority in scheduler metrics in RM web UI	Minor	resourcemanager, webapp	Rohith Sharma K S	Rohith Sharma K S
HDFS-9022	Move NameNode.getAddress() and NameNode.getUri() to hadoop-hdfs-client	Major	hdfs-client	Mingliang Liu	Mingliang Liu
YARN-4171	Resolve findbugs/javac warnings in YARN-1197 branch	Major	api, nodemanager, resourcemanager	Wangda Tan	Wangda Tan
YARN-3212	RMNode State Transition Update with DECOMMISSIONING state	Major	graceful, resourcemanager	Junping Du	Junping Du
HDFS-9101	Remove deprecated NameNode.getUri() static helper method	Major	.	Mingliang Liu	Mingliang Liu
HDFS-9004	Add upgrade domain to DatanodeInfo	Major	.	Ming Ma	Ming Ma
HDFS-9111	Move hdfs-client protobuf convert methods from PBHelper to PBHelperClient	Major	.	Mingliang Liu	Mingliang Liu
HDFS-9039	Separate client and server side methods of o.a.h.hdfs.NameNodeProxies	Major	.	Mingliang Liu	Mingliang Liu
HDFS-8733	Keep server related definition in hdfs.proto on server side	Major	.	Yi Liu	Mingliang Liu
HDFS-9131	Move config keys used by hdfs-client to HdfsClientConfigKeys	Major	.	Mingliang Liu	Mingliang Liu
HDFS-7529	Consolidate encryption zone related implementation into a single class	Major	.	Haohui Mai	Rakesh R
HDFS-9134	Move LEASE_{SOFTLIMIT,HARDLIMIT}_PERIOD constants from HdfsServerConstants to HdfsConstants	Major	.	Mingliang Liu	Mingliang Liu
HADOOP-11918	Listing an empty s3a root directory throws FileNotFound.	Minor	fs/s3	Lei (Eddy) Xu	Lei (Eddy) Xu
HDFS-8053	Move DFSIn/OutputStream and related classes to hadoop-hdfs-client	Major	build	Haohui Mai	Mingliang Liu
HDFS-8740	Move DistributedFileSystem to hadoop-hdfs-client	Major	build	Yi Liu	Mingliang Liu
YARN-4141	Runtime Application Priority change should not throw exception for applications at finishing states	Major	resourcemanager	Sunil Govindan	Sunil Govindan
HDFS-9165	Move entries in META-INF/services/o.a.h.fs.FileSystem to hdfs-client	Major	build	Haohui Mai	Mingliang Liu
HDFS-9166	Move hftp / hsftp filesystem to hfds-client	Major	build	Haohui Mai	Mingliang Liu
HDFS-8971	Remove guards when calling LOG.debug() and LOG.trace() in client package	Major	build	Mingliang Liu	Mingliang Liu
HDFS-9015	Refactor TestReplicationPolicy to test different block placement policies	Major	.	Ming Ma	Ming Ma
YARN-1897	CLI and core support for signal container functionality	Major	api	Ming Ma	Ming Ma
HDFS-9158	[OEV-Doc] : Document does not mention about “-f” and “-r” options	Major	.	nijel	nijel
HDFS-9155	OEV should treat .XML files as XML even when the file name extension is uppercase	Major	.	nijel	nijel
YARN-4215	RMNodeLabels Manager Need to verify and replace node labels for the only modified Node Label Mappings in the request	Major	resourcemanager	Naganarasimha G R	Naganarasimha G R
HDFS-9170	Move libhdfs / fuse-dfs / libwebhdfs to hdfs-client	Major	.	Haohui Mai	Haohui Mai
HDFS-9159	[OIV] : return value of the command is not correct if invalid value specified in “-p (processor)” option	Major	.	nijel	nijel
YARN-3964	Support NodeLabelsProvider at Resource Manager side	Major	.	Dian Fu	Dian Fu
YARN-4230	Increasing container resource while there is no headroom left will cause ResourceManager to crash	Critical	resourcemanager	MENG DING	MENG DING
HDFS-9006	Provide BlockPlacementPolicy that supports upgrade domain	Major	.	Ming Ma	Ming Ma
HDFS-9160	[OIV-Doc] : Missing details of “delimited” for processor options	Major	.	nijel	nijel
HDFS-9167	Update pom.xml in other modules to depend on hdfs-client instead of hdfs	Major	build	Haohui Mai	Mingliang Liu
YARN-4255	container-executor does not clean up docker operation command files.	Minor	.	Sidharta Seethana	Sidharta Seethana
HDFS-9223	Code cleanup for DatanodeDescriptor and HeartbeatManager	Minor	namenode	Jing Zhao	Jing Zhao
YARN-4258	Add support for controlling capabilities for docker containers	Major	yarn	Sidharta Seethana	Sidharta Seethana
HDFS-9157	[OEV and OIV] : Unnecessary parsing for mandatory arguements if “-h” option is specified as the only option	Major	.	nijel	nijel
HADOOP-12475	Replace guava Cache with ConcurrentHashMap for caching Connection in ipc Client	Major	conf, io, ipc	Walter Su	Walter Su
YARN-4162	CapacityScheduler: Add resource usage by partition and queue capacity by partition to REST API	Major	api, client, resourcemanager	Naganarasimha G R	Naganarasimha G R
YARN-4170	AM need to be notified with priority in AllocateResponse	Major	resourcemanager	Sunil Govindan	Sunil Govindan
YARN-2556	Tool to measure the performance of the timeline server	Major	timelineserver	Jonathan Eagles	Chang Li
YARN-4262	Allow whitelisted users to run privileged docker containers.	Major	yarn	Sidharta Seethana	Sidharta Seethana
YARN-4267	Add additional logging to container launch implementations in container-executor	Major	yarn	Sidharta Seethana	Sidharta Seethana
YARN-3985	Make ReservationSystem persist state using RMStateStore reservation APIs	Major	resourcemanager	Anubhav Dhoot	Anubhav Dhoot
YARN-2513	Host framework UIs in YARN for use with the ATS	Major	timelineserver	Jonathan Eagles	Jonathan Eagles
YARN-3739	Add reservation system recovery to RM recovery process	Major	capacityscheduler, fairscheduler, resourcemanager	Subru Krishnan	Subru Krishnan
YARN-4243	Add retry on establishing Zookeeper conenction in EmbeddedElectorService#serviceInit	Major	resourcemanager	Xuan Gong	Xuan Gong
YARN-3738	Add support for recovery of reserved apps running under dynamic queues	Major	capacityscheduler, resourcemanager	Subru Krishnan	Subru Krishnan
YARN-3724	Use POSIX nftw(3) instead of fts(3)	Major	.	Malcolm Kavalsky	Alan Burlison
YARN-2729	Support script based NodeLabelsProvider Interface in Distributed Node Label Configuration Setup	Major	nodemanager	Naganarasimha G R	Naganarasimha G R
HDFS-9304	Add HdfsClientConfigKeys class to TestHdfsConfigFields#configurationClasses	Major	build	Mingliang Liu	Mingliang Liu
YARN-3216	Max-AM-Resource-Percentage should respect node labels	Critical	resourcemanager	Wangda Tan	Sunil Govindan
HADOOP-12457	[JDK8] Fix a failure of compiling common by javadoc	Major	.	Tsuyoshi Ozawa	Akira Ajisaka
HDFS-9168	Move client side unit test to hadoop-hdfs-client	Major	build	Haohui Mai	Haohui Mai
HDFS-9343	Empty caller context considered invalid	Major	.	Mingliang Liu	Mingliang Liu
HDFS-9362	TestAuditLogger#testAuditLoggerWithCallContext assumes Unix line endings, fails on Windows.	Minor	test	Chris Nauroth	Chris Nauroth
HDFS-9007	Fix HDFS Balancer to honor upgrade domain policy	Major	.	Ming Ma	Ming Ma
HDFS-9379	Make NNThroughputBenchmark$BlockReportStats support more than 10 datanodes	Major	test	Mingliang Liu	Mingliang Liu
YARN-1510	Make NMClient support change container resources	Major	nodemanager	Wangda Tan (No longer used)	MENG DING
YARN-4345	yarn rmadmin -updateNodeResource doesn’t work	Critical	graceful, resourcemanager	Sushmitha Sreenivasan	Junping Du
YARN-1509	Make AMRMClient support send increase container request and get increased/decreased containers	Major	resourcemanager	Wangda Tan (No longer used)	MENG DING
HDFS-9387	Fix namenodeUri parameter parsing in NNThroughputBenchmark	Major	test	Mingliang Liu	Mingliang Liu
HDFS-9421	NNThroughputBenchmark replication test NPE with -namenode option	Major	benchmarks	Xiaoyu Yao	Mingliang Liu
YARN-4184	Remove update reservation state api from state store as its not used by ReservationSystem	Major	capacityscheduler, fairscheduler, resourcemanager	Anubhav Dhoot	Sean Po
HADOOP-12582	Using BytesWritable’s getLength() and getBytes() instead of get() and getSize()	Major	.	Tsuyoshi Ozawa	Akira Ajisaka
YARN-3454	Add efficient merge operation to RLESparseResourceAllocation	Major	resourcemanager	Carlo Curino	Carlo Curino
HDFS-7796	Include X-editable for slick contenteditable fields in the web UI	Major	ui	Ravi Prakash	Ravi Prakash
YARN-3980	Plumb resource-utilization info in node heartbeat through to the scheduler	Major	resourcemanager, scheduler	Karthik Kambatla	Íñigo Goiri
HADOOP-11954	Solaris does not support RLIMIT_MEMLOCK as in Linux	Major	.	Malcolm Kavalsky	Alan Burlison
YARN-4384	updateNodeResource CLI should not accept negative values for resource	Major	graceful, resourcemanager	Sushmitha Sreenivasan	Junping Du
HDFS-9438	TestPipelinesFailover assumes Linux ifconfig	Minor	test	Alan Burlison	John Zhuge
YARN-4292	ResourceUtilization should be a part of NodeInfo REST API	Major	.	Wangda Tan	Sunil Govindan
HDFS-9436	Make NNThroughputBenchmark$BlockReportStats run with 10 datanodes by default	Minor	test	Mingliang Liu	Mingliang Liu
HDFS-9484	NNThroughputBenchmark$BlockReportStats should not send empty block reports	Major	test	Mingliang Liu	Mingliang Liu
YARN-4405	Support node label store in non-appendable file system	Major	api, client, resourcemanager	Wangda Tan	Wangda Tan
HDFS-9214	Support reconfiguring dfs.datanode.balance.max.concurrent.moves without DN restart	Major	datanode	Xiaobing Zhou	Xiaobing Zhou
YARN-4248	REST API for submit/update/delete Reservations	Major	resourcemanager	Carlo Curino	Carlo Curino
YARN-4358	Improve relationship between SharingPolicy and ReservationAgent	Major	capacityscheduler, fairscheduler, resourcemanager	Carlo Curino	Carlo Curino
YARN-3946	Update exact reason as to why a submitted app is in ACCEPTED state to app’s diagnostic message	Major	capacity scheduler, resourcemanager	Sumit Nigam	Naganarasimha G R
YARN-4309	Add container launch related debug information to container logs when a container fails	Major	nodemanager	Varun Vasudev	Varun Vasudev
YARN-4293	ResourceUtilization should be a part of yarn node CLI	Major	.	Wangda Tan	Sunil Govindan
YARN-4416	Deadlock due to synchronised get Methods in AbstractCSQueue	Minor	capacity scheduler, resourcemanager	Naganarasimha G R	Naganarasimha G R
YARN-3226	UI changes for decommissioning node	Major	graceful	Junping Du	Sunil Govindan
YARN-4164	Retrospect update ApplicationPriority API return type	Major	resourcemanager	Rohith Sharma K S	Rohith Sharma K S
YARN-4234	New put APIs in TimelineClient for ats v1.5	Major	timelineserver	Xuan Gong	Xuan Gong
YARN-4098	Document ApplicationPriority feature	Major	resourcemanager	Rohith Sharma K S	Rohith Sharma K S
HDFS-7779	Support changing ownership, group and replication in HDFS Web UI	Major	ui	Ravi Prakash	Ravi Prakash
YARN-2902	Killing a container that is localizing can orphan resources in the DOWNLOADING state	Major	nodemanager	Jason Lowe	Varun Saxena
YARN-4393	TestResourceLocalizationService#testFailedDirsResourceRelease fails intermittently	Major	test	Varun Saxena	Varun Saxena
YARN-4479	Retrospect app-priority in pendingOrderingPolicy during recovering applications	Major	api, resourcemanager	Rohith Sharma K S	Rohith Sharma K S
HDFS-9621	getListing wrongly associates Erasure Coding policy to pre-existing replicated files under an EC directory	Critical	erasure-coding	Sushmitha Sreenivasan	Jing Zhao
YARN-4537	Pull out priority comparison from fifocomparator and use compound comparator for FifoOrdering policy	Major	capacity scheduler	Rohith Sharma K S	Rohith Sharma K S
HADOOP-11262	Enable YARN to use S3A	Major	fs/s3	Thomas Demoor	Pieter Reuse
YARN-4265	Provide new timeline plugin storage to support fine-grained entity caching	Major	timelineserver	Li Lu	Li Lu
YARN-4304	AM max resource configuration per partition to be displayed/updated correctly in UI and in various partition related metrics	Major	webapp	Sunil Govindan	Sunil Govindan
YARN-4557	Fix improper Queues sorting in PartitionedQueueComparator when accessible-node-labels=*	Major	resourcemanager	Naganarasimha G R	Naganarasimha G R
HDFS-9601	NNThroughputBenchmark.BlockReportStats should handle NotReplicatedYetException on adding block	Major	test	Masatake Iwasaki	Masatake Iwasaki
YARN-4614	TestApplicationPriority#testApplicationPriorityAllocationWithChangeInPriority fails occasionally	Major	test	Jason Lowe	Sunil Govindan
HDFS-9672	o.a.h.hdfs.TestLeaseRecovery2 fails intermittently	Major	test	Mingliang Liu	Mingliang Liu
YARN-4573	TestRMAppTransitions.testAppRunningKill and testAppKilledKilled fail on trunk	Major	resourcemanager, test	Takashi Ohnishi	Takashi Ohnishi
YARN-4643	Container recovery is broken with delegating container runtime	Critical	yarn	Sidharta Seethana	Sidharta Seethana
YARN-4219	New levelDB cache storage for timeline v1.5	Major	.	Li Lu	Li Lu
YARN-4543	TestNodeStatusUpdater.testStopReentrant fails + JUnit misusage	Minor	nodemanager	Akihiro Suda	Akihiro Suda
YARN-4340	Add “list” API to reservation system	Major	capacityscheduler, fairscheduler, resourcemanager	Carlo Curino	Sean Po
YARN-4100	Add Documentation for Distributed and Delegated-Centralized Node Labels feature	Major	api, client, resourcemanager	Naganarasimha G R	Naganarasimha G R
HDFS-9503	Replace -namenode option with -fs for NNThroughputBenchmark	Major	test	Konstantin Shvachko	Mingliang Liu
HADOOP-12292	Make use of DeleteObjects optional	Major	fs/s3	Thomas Demoor	Thomas Demoor
YARN-4667	RM Admin CLI for refreshNodesResources throws NPE when nothing is configured	Critical	client	Naganarasimha G R	Naganarasimha G R
HADOOP-12752	Improve diagnostics/use of envvar/sysprop credential propagation	Minor	security	Steve Loughran	Steve Loughran
YARN-4138	Roll back container resource allocation after resource increase token expires	Major	api, nodemanager, resourcemanager	MENG DING	MENG DING
YARN-2575	Create separate ACLs for Reservation create/update/delete/list ops	Major	capacityscheduler, fairscheduler, resourcemanager	Subru Krishnan	Sean Po
HADOOP-11613	Remove commons-httpclient dependency from hadoop-azure	Major	.	Akira Ajisaka	Masatake Iwasaki
HDFS-9084	Pagination, sorting and filtering of files/directories in the HDFS Web UI	Major	ui	Ravi Prakash	Ravi Prakash
YARN-3223	Resource update during NM graceful decommission	Major	graceful, nodemanager, resourcemanager	Junping Du	Brook Zhou
YARN-4680	TimerTasks leak in ATS V1.5 Writer	Major	timelineserver	Xuan Gong	Xuan Gong
HADOOP-12711	Remove dependency on commons-httpclient for ServletUtil	Major	.	Wei-Chiu Chuang	Wei-Chiu Chuang
YARN-4566	TestMiniYarnClusterNodeUtilization sometimes fails on trunk	Major	test	Takashi Ohnishi	Takashi Ohnishi
HADOOP-12813	Migrate TestRPC and related codes to rebase on ProtobufRpcEngine	Major	.	Kai Zheng	Kai Zheng
YARN-4749	Generalize config file handling in container-executor	Major	nodemanager	Sidharta Seethana	Sidharta Seethana
YARN-4696	Improving EntityGroupFSTimelineStore on exception handling, test setup, and concurrency	Major	timelineserver	Steve Loughran	Steve Loughran
MAPREDUCE-6520	Migrate MR Client test cases part 1	Trivial	test	Dustin Cote	Dustin Cote
YARN-4545	Allow YARN distributed shell to use ATS v1.5 APIs	Major	timelineserver	Li Lu	Li Lu
YARN-4817	Change Log Level to DEBUG for putDomain call in ATS 1.5	Trivial	timelineserver	Xuan Gong	Xuan Gong
YARN-4108	CapacityScheduler: Improve preemption to only kill containers that would satisfy the incoming request	Major	capacity scheduler	Wangda Tan	Wangda Tan
HADOOP-12819	Migrate TestSaslRPC and related codes to rebase on ProtobufRpcEngine	Major	.	Kai Zheng	Kai Zheng
YARN-4815	ATS 1.5 timelineclient impl try to create attempt directory for every event call	Major	timelineserver	Xuan Gong	Xuan Gong
YARN-4814	ATS 1.5 timelineclient impl call flush after every event write	Major	timelineserver	Xuan Gong	Xuan Gong
YARN-998	Keep NM resource updated through dynamic resource config for RM/NM restart	Major	graceful, nodemanager, scheduler	Junping Du	Junping Du
MAPREDUCE-6543	Migrate MR Client test cases part 2	Trivial	test	Dustin Cote	Dustin Cote
YARN-4822	Refactor existing Preemption Policy of CS for easier adding new approach to select preemption candidates	Major	.	Wangda Tan	Wangda Tan
YARN-4634	Scheduler UI/Metrics need to consider cases like non-queue label mappings	Major	.	Sunil Govindan	Sunil Govindan
HADOOP-12169	ListStatus on empty dir in S3A lists itself instead of returning an empty list	Major	fs/s3	Pieter Reuse	Pieter Reuse
HDFS-10186	DirectoryScanner: Improve logs by adding full path of both actual and expected block directories	Minor	datanode	Rakesh R	Rakesh R
YARN-4826	Document configuration of ReservationSystem for CapacityScheduler	Minor	capacity scheduler	Subru Krishnan	Subru Krishnan
HADOOP-12444	Support lazy seek in S3AInputStream	Major	fs/s3	Rajesh Balamohan	Rajesh Balamohan
YARN-4928	Some yarn.server.timeline.* tests fail on Windows attempting to use a test root path containing a colon	Minor	test	Gergely Novák	Gergely Novák
YARN-4168	Test TestLogAggregationService.testLocalFileDeletionOnDiskFull failing	Critical	test	Steve Loughran	Takashi Ohnishi
HADOOP-12973	make DU pluggable	Major	.	Elliott Clark	Elliott Clark
YARN-4886	Add HDFS caller context for EntityGroupFSTimelineStore	Major	timelineserver	Li Lu	Li Lu
HDFS-10281	o.a.h.hdfs.server.namenode.ha.TestPendingCorruptDnMessages fails intermittently	Major	test	Mingliang Liu	Mingliang Liu
YARN-4909	Fix intermittent failures of TestRMWebServices And TestRMWithCSRFFilter	Blocker	.	Brahma Reddy Battula	Bibin A Chundatt
YARN-4468	Document the general ReservationSystem functionality, and the REST API	Major	capacityscheduler, fairscheduler, resourcemanager	Carlo Curino	Carlo Curino
HADOOP-13011	Clearly Document the Password Details for Keystore-based Credential Providers	Major	documentation	Larry McCay	Larry McCay
YARN-3215	Respect labels in CapacityScheduler when computing headroom	Major	capacityscheduler	Wangda Tan	Naganarasimha G R
HDFS-10224	Implement asynchronous rename for DistributedFileSystem	Major	fs, hdfs-client	Xiaobing Zhou	Xiaobing Zhou
YARN-4956	findbug issue on LevelDBCacheTimelineStore	Major	timelineserver	Xuan Gong	Zhiyuan Yang
YARN-4851	Metric improvements for ATS v1.5 storage components	Major	timelineserver	Li Lu	Li Lu
HADOOP-12749	Create a threadpoolexecutor that overrides afterExecute to log uncaught exceptions/errors	Major	.	Sidharta Seethana	Sidharta Seethana
HDFS-10346	Implement asynchronous setPermission/setOwner for DistributedFileSystem	Major	hdfs, hdfs-client	Xiaobing Zhou	Xiaobing Zhou
HADOOP-13122	Customize User-Agent header sent in HTTP requests by S3A.	Minor	fs/s3	Chris Nauroth	Chris Nauroth
HADOOP-12844	Recover when S3A fails on IOException in read()	Major	fs/s3	Pieter Reuse	Pieter Reuse
HADOOP-13028	add low level counter metrics for S3A; use in read performance tests	Major	fs/s3, metrics	Steve Loughran	Steve Loughran
HADOOP-13113	Enable parallel test execution for hadoop-aws.	Minor	test	Chris Nauroth	Chris Nauroth
HADOOP-13158	S3AFileSystem#toString might throw NullPointerException due to null cannedACL.	Minor	fs/s3	Chris Nauroth	Chris Nauroth
YARN-4832	NM side resource value should get updated if change applied in RM side	Critical	nodemanager, resourcemanager	Junping Du	Junping Du
HADOOP-13140	FileSystem#initialize must not attempt to create StorageStatistics objects with null or empty schemes	Major	fs	Brahma Reddy Battula	Mingliang Liu
HADOOP-13130	s3a failures can surface as RTEs, not IOEs	Major	fs/s3	Steve Loughran	Steve Loughran
YARN-3362	Add node label usage in RM CapacityScheduler web UI	Major	capacityscheduler, resourcemanager, webapp	Wangda Tan	Naganarasimha G R
HDFS-10390	Implement asynchronous setAcl/getAclStatus for DistributedFileSystem	Major	fs	Xiaobing Zhou	Xiaobing Zhou
YARN-857	Localization failures should be available in container diagnostics	Critical	.	Hitesh Shah	Vinod Kumar Vavilapalli
HDFS-8057	Move BlockReader implementation to the client implementation package	Major	hdfs-client	Tsz Wo Nicholas Sze	Takanobu Asanuma
YARN-4957	Add getNewReservation in ApplicationClientProtocol	Major	applications, client, resourcemanager	Subru Krishnan	Sean Po
HDFS-10431	Refactor and speedup TestAsyncDFSRename	Minor	test	Xiaobing Zhou	Xiaobing Zhou
YARN-4987	Read cache concurrency issue between read and evict in EntityGroupFS timeline store	Critical	.	Li Lu	Li Lu
HDFS-10430	Reuse FileSystem#access in TestAsyncDFS	Major	hdfs	Xiaobing Zhou	Xiaobing Zhou
HADOOP-13162	Consider reducing number of getFileStatus calls in S3AFileSystem.mkdirs	Minor	fs/s3	Rajesh Balamohan	Rajesh Balamohan
HADOOP-13131	Add tests to verify that S3A supports SSE-S3 encryption	Minor	fs/s3	Steve Loughran	Steve Loughran
HADOOP-13171	Add StorageStatistics to S3A; instrument some more operations	Minor	fs/s3	Steve Loughran	Steve Loughran
YARN-1815	Work preserving recovery of Unmanged AMs	Critical	resourcemanager	Karthik Kambatla	Subru Krishnan
YARN-5165	Fix NoOvercommitPolicy to take advantage of RLE representation of plan	Major	capacityscheduler, fairscheduler, resourcemanager	Carlo Curino	Carlo Curino
YARN-5185	StageAllocaterGreedyRLE: Fix NPE in corner case	Major	capacityscheduler, fairscheduler, resourcemanager	Carlo Curino	Carlo Curino
YARN-4525	Fix bug in RLESparseResourceAllocation.getRangeOverlapping(…)	Major	.	Ishai Menache	Ishai Menache
HADOOP-13237	s3a initialization against public bucket fails if caller lacks any credentials	Minor	fs/s3	Steve Loughran	Chris Nauroth
YARN-5199	Close LogReader in in AHSWebServices#getStreamingOutput and FileInputStream in NMWebServices#getLogs	Major	.	Xuan Gong	Xuan Gong
YARN-3426	Add jdiff support to YARN	Blocker	.	Li Lu	Li Lu
YARN-1942	Deprecate toString/fromString methods from ConverterUtils and move them to records classes like ContainerId/ApplicationId, etc.	Critical	api	Thomas Graves	Wangda Tan
HADOOP-13241	document s3a better	Minor	documentation, fs/s3	Steve Loughran	Steve Loughran
HADOOP-13284	FileSystemStorageStatistics must not attempt to read non-existent rack-aware read stats in branch-2.8	Major	fs	Mingliang Liu	Mingliang Liu
HADOOP-12975	Add jitter to CachingGetSpaceUsed’s thread	Major	.	Elliott Clark	Elliott Clark
HADOOP-13280	FileSystemStorageStatistics#getLong(“readOps“) should return readOps + largeReadOps	Major	fs	Mingliang Liu	Mingliang Liu
HADOOP-13288	Guard null stats key in FileSystemStorageStatistics	Major	fs	Mingliang Liu	Mingliang Liu
HADOOP-13291	Probing stats in DFSOpsCountStatistics/S3AStorageStatistics should be correctly implemented	Major	fs	Mingliang Liu	Mingliang Liu
HDFS-10538	Remove AsyncDistributedFileSystem API	Major	hdfs-client	Xiaobing Zhou	Xiaobing Zhou
HADOOP-13203	S3A: Support fadvise “random” mode for high performance readPositioned() reads	Major	fs/s3	Rajesh Balamohan	Rajesh Balamohan
HADOOP-12229	Fix inconsistent subsection titles in filesystem.md	Minor	documentation	Masatake Iwasaki	Masatake Iwasaki
HADOOP-12242	Add in-page TOC to filesystem specification pages	Minor	documentation	Masatake Iwasaki	Masatake Iwasaki
HADOOP-13305	Define common statistics names across schemes	Major	fs	Mingliang Liu	Mingliang Liu
HADOOP-13283	Support reset operation for new global storage statistics and per FS storage stats	Major	fs	Mingliang Liu	Mingliang Liu
YARN-5080	Cannot obtain logs using YARN CLI -am for either KILLED or RUNNING AM	Critical	yarn	Sumana Sathish	Xuan Gong
HADOOP-13366	Fix dead link in o.a.h.fs.CommonConfigurationKeysPublic javadoc	Minor	documentation	Rakesh R	Rakesh R
YARN-4484	Available Resource calculation for a queue is not correct when used with labels	Major	capacity scheduler	Sunil Govindan	Sunil Govindan
HADOOP-13368	DFSOpsCountStatistics$OpType#fromSymbol and s3a.Statistic#fromSymbol should be O(1) operation	Major	fs	Mingliang Liu	Mingliang Liu
HADOOP-13212	Provide an option to set the socket buffers in S3AFileSystem	Minor	fs/s3	Rajesh Balamohan	Rajesh Balamohan
HDFS-10653	Optimize conversion from path string to components	Major	hdfs	Daryn Sharp	Daryn Sharp
HADOOP-13207	Specify FileSystem listStatus, listFiles and RemoteIterator	Major	documentation, fs	Steve Loughran	Steve Loughran
HADOOP-13188	S3A file-create should throw error rather than overwrite directories	Minor	fs/s3	Raymie Stata	Steve Loughran
HDFS-10642	TestLazyPersistReplicaRecovery#testDnRestartWithSavedReplicas fails intermittently	Major	datanode, test	Mingliang Liu	Mingliang Liu
HDFS-10668	TestDataNodeMXBean#testDataNodeMXBeanBlockCount fails intermittently	Major	test	Mingliang Liu	Mingliang Liu
YARN-5434	Add -client\|server argument for graceful decom	Blocker	graceful	Robert Kanter	Robert Kanter
HADOOP-13429	Dispose of unnecessary SASL servers	Major	ipc	Daryn Sharp	Daryn Sharp
HADOOP-13426	More efficiently build IPC responses	Major	.	Daryn Sharp	Daryn Sharp
HDFS-10656	Optimize conversion of byte arrays back to path string	Major	hdfs	Daryn Sharp	Daryn Sharp
HDFS-10674	Optimize creating a full path from an inode	Major	hdfs	Daryn Sharp	Daryn Sharp
YARN-5342	Improve non-exclusive node partition resource allocation in Capacity Scheduler	Major	.	Wangda Tan	Sunil Govindan
HADOOP-13438	Optimize IPC server protobuf decoding	Major	.	Daryn Sharp	Daryn Sharp
HADOOP-13418	Fix javadoc warnings by JDK8 in hadoop-nfs package	Major	.	Kai Sasaki	Kai Sasaki
HDFS-10724	Document the caller context config keys	Minor	ipc, namenode	Mingliang Liu	Mingliang Liu
HDFS-10678	Documenting NNThroughputBenchmark tool	Major	benchmarks, test	Mingliang Liu	Mingliang Liu
HDFS-10641	TestBlockManager#testBlockReportQueueing fails intermittently	Major	namenode, test	Mingliang Liu	Daryn Sharp
HADOOP-13324	s3a tests don’t authenticate with S3 frankfurt (or other V4 auth only endpoints)	Major	fs/s3	Steve Loughran	Steve Loughran
HADOOP-13208	S3A listFiles(recursive=true) to do a bulk listObjects instead of walking the pseudo-tree of directories	Minor	fs/s3	Steve Loughran	Steve Loughran
HADOOP-13405	doc for “fs.s3a.acl.default” indicates incorrect values	Minor	fs/s3	Shen Yinjie	Shen Yinjie
HDFS-10711	Optimize FSPermissionChecker group membership check	Major	hdfs	Daryn Sharp	Daryn Sharp
HADOOP-13252	Tune S3A provider plugin mechanism	Minor	fs/s3	Steve Loughran	Steve Loughran
HADOOP-13446	Support running isolated unit tests separate from AWS integration tests.	Major	fs/s3	Chris Nauroth	Chris Nauroth
HDFS-10762	Pass IIP for file status related methods	Major	hdfs	Daryn Sharp	Daryn Sharp
HDFS-10772	Reduce byte/string conversions for get listing	Major	hdfs	Daryn Sharp	Daryn Sharp
YARN-3940	Application moveToQueue should check NodeLabel permission	Major	resourcemanager	Bibin A Chundatt	Bibin A Chundatt
HDFS-10768	Optimize mkdir ops	Major	hdfs	Daryn Sharp	Daryn Sharp
HDFS-10655	Fix path related byte array conversion bugs	Major	hdfs	Daryn Sharp	Daryn Sharp
HDFS-10662	Optimize UTF8 string/byte conversions	Major	hdfs	Daryn Sharp	Daryn Sharp
HADOOP-13547	Optimize IPC client protobuf decoding	Major	.	Daryn Sharp	Daryn Sharp
HADOOP-13549	Eliminate intermediate buffer for server-side PB encoding	Major	ipc	Daryn Sharp	Daryn Sharp
HADOOP-13447	Refactor S3AFileSystem to support introduction of separate metadata repository and tests.	Major	fs/s3	Chris Nauroth	Chris Nauroth
HADOOP-13541	explicitly declare the Joda time version S3A depends on	Minor	build, fs/s3	Steve Loughran	Steve Loughran
YARN-5566	Client-side NM graceful decom is not triggered when jobs finish	Major	nodemanager	Robert Kanter	Robert Kanter
HADOOP-10940	RPC client does no bounds checking of responses	Critical	ipc	Daryn Sharp	Daryn Sharp
HADOOP-13540	improve section on troubleshooting s3a auth problems	Minor	documentation, fs/s3	Steve Loughran	Steve Loughran
HDFS-10673	Optimize FSPermissionChecker’s internal path usage	Major	hdfs	Daryn Sharp	Daryn Sharp
HADOOP-13546	Override equals and hashCode to avoid connection leakage	Major	ipc	Xiaobing Zhou	Xiaobing Zhou
HDFS-10744	Internally optimize path component resolution	Major	hdfs	Daryn Sharp	Daryn Sharp
HDFS-10805	Reduce runtime for append test	Minor	test	Gergely Novák	Gergely Novák
HADOOP-13544	JDiff reports unncessarily show unannotated APIs and cause confusion while our javadocs only show annotated and public APIs	Blocker	.	Vinod Kumar Vavilapalli	Vinod Kumar Vavilapalli
HDFS-10779	Rename does not need to re-solve destination	Major	hdfs	Daryn Sharp	Daryn Sharp
HDFS-10892	Add unit tests for HDFS command ‘dfs -tail’ and ‘dfs -stat’	Major	fs, shell, test	Mingliang Liu	Mingliang Liu
HADOOP-13599	s3a close() to be non-synchronized, so avoid risk of deadlock on shutdown	Major	fs/s3	Steve Loughran	Steve Loughran
HADOOP-12974	Create a CachingGetSpaceUsed implementation that uses df	Major	.	Elliott Clark	Elliott Clark
HDFS-10851	FSDirStatAndListingOp: stop passing path as string	Major	hdfs	Daryn Sharp	Daryn Sharp
HDFS-10619	Cache path in InodesInPath	Major	hdfs	Daryn Sharp	Daryn Sharp
HDFS-10934	TestDFSShell.testStat fails intermittently	Major	test	Eric Badger	Eric Badger
HADOOP-13674	S3A can provide a more detailed error message when accessing a bucket through an incorrect S3 endpoint.	Minor	fs/s3	Chris Nauroth	Chris Nauroth
HDFS-10956	Remove rename/delete performance penalty when not using snapshots	Major	hdfs	Daryn Sharp	Daryn Sharp
HDFS-10896	Move lock logging logic from FSNamesystem into FSNamesystemLock	Major	namenode	Erik Krogen	Erik Krogen
HDFS-10745	Directly resolve paths into INodesInPath	Major	hdfs	Daryn Sharp	Daryn Sharp
HDFS-10955	Pass IIP for FSDirAttr methods	Major	hdfs	Daryn Sharp	Daryn Sharp
HADOOP-12977	s3a to handle delete(“/”, true) robustly	Minor	fs/s3	Steve Loughran	Steve Loughran
HDFS-10939	Reduce performance penalty of encryption zones	Major	hdfs	Daryn Sharp	Daryn Sharp
HADOOP-13692	hadoop-aws should declare explicit dependency on Jackson 2 jars to prevent classpath conflicts.	Minor	fs/s3	Chris Nauroth	Chris Nauroth
HDFS-10979	Pass IIP for FSDirDeleteOp methods	Major	hdfs	Daryn Sharp	Daryn Sharp
HDFS-10980	Optimize check for existence of parent directory	Major	hdfs	Daryn Sharp	Daryn Sharp
HDFS-10988	Refactor TestBalancerBandwidth	Major	balancer & mover, test	Brahma Reddy Battula	Brahma Reddy Battula
HDFS-10985	o.a.h.ha.TestZKFailoverController should not use fixed time sleep before assertions	Minor	ha, test	Mingliang Liu	Mingliang Liu
HDFS-10972	Add unit test for HDFS command ‘dfsadmin -getDatanodeInfo’	Major	fs, shell, test	Xiaobing Zhou	Xiaobing Zhou
HDFS-10965	Add unit test for HDFS command ‘dfsadmin -printTopology’	Major	fs, shell, test	Xiaobing Zhou	Xiaobing Zhou
HDFS-11008	Change unit test for testing parsing “-source” parameter in Balancer CLI	Major	test	Mingliang Liu	Mingliang Liu
HADOOP-13419	Fix javadoc warnings by JDK8 in hadoop-common package	Major	.	Kai Sasaki	Kai Sasaki
HDFS-10922	Adding additional unit tests for Trash (II)	Major	test	Xiaoyu Yao	Weiwei Yang
HDFS-10906	Add unit tests for Trash with HDFS encryption zones	Major	encryption	Xiaoyu Yao	Hanisha Koneru
HADOOP-13735	ITestS3AFileContextStatistics.testStatistics() failing	Minor	fs/s3	Steve Loughran	Pieter Reuse
HDFS-10998	Add unit tests for HDFS command ‘dfsadmin -fetchImage’ in HA	Major	test	Xiaobing Zhou	Xiaobing Zhou
HADOOP-13727	S3A: Reduce high number of connections to EC2 Instance Metadata Service caused by InstanceProfileCredentialsProvider.	Minor	fs/s3	Rajesh Balamohan	Chris Nauroth
HADOOP-12774	s3a should use UGI.getCurrentUser.getShortname() for username	Major	fs/s3	Steve Loughran	Steve Loughran
HADOOP-13309	Document S3A known limitations in file ownership and permission model.	Minor	fs/s3	Chris Nauroth	Chris Nauroth
HDFS-11011	Add unit tests for HDFS command ‘dfsadmin -set/clrSpaceQuota’	Major	hdfs-client	Xiaobing Zhou	Xiaobing Zhou
HADOOP-13614	Purge some superfluous/obsolete S3 FS tests that are slowing test runs down	Minor	fs/s3, test	Steve Loughran	Steve Loughran
HADOOP-10597	RPC Server signals backoff to clients when all request queues are full	Major	.	Ming Ma	Ming Ma
HADOOP-13680	fs.s3a.readahead.range to use getLongBytes	Major	fs/s3	Steve Loughran	Abhishek Modi
HDFS-11030	TestDataNodeVolumeFailure#testVolumeFailure is flaky (though passing)	Major	datanode, test	Mingliang Liu	Mingliang Liu
HDFS-10997	Reduce number of path resolving methods	Major	namenode	Daryn Sharp	Daryn Sharp
HDFS-11065	Add space quota tests for heterogenous storages	Major	hdfs	Xiaobing Zhou	Xiaobing Zhou
HDFS-11031	Add additional unit test for DataNode startup behavior when volumes fail	Major	datanode, test	Mingliang Liu	Mingliang Liu
HADOOP-10300	Allowed deferred sending of call responses	Major	ipc	Daryn Sharp	Daryn Sharp
HDFS-11076	Add unit test for extended Acls	Major	test	Chen Liang	Chen Liang
HDFS-11085	Add unit test for NameNode failing to start when name dir is unwritable	Major	namenode, test	Mingliang Liu	Xiaobing Zhou
YARN-5802	updateApplicationPriority api in scheduler should ensure to re-insert app to correct ordering policy	Critical	capacity scheduler	Bibin A Chundatt	Bibin A Chundatt
HDFS-11083	Add unit test for DFSAdmin -report command	Major	shell, test	Mingliang Liu	Xiaobing Zhou
YARN-4498	Application level node labels stats to be available in REST	Major	api, client, resourcemanager	Bibin A Chundatt	Bibin A Chundatt
HADOOP-13720	Add more info to the msgs printed in AbstractDelegationTokenSecretManager for better supportability	Trivial	common, security	Yongjun Zhang	Yongjun Zhang
HDFS-11122	TestDFSAdmin#testReportCommand fails due to timed out	Minor	test	Yiqun Lin	Yiqun Lin
HDFS-10872	Add MutableRate metrics for FSNamesystemLock operations	Major	namenode	Erik Krogen	Erik Krogen
HDFS-11105	TestRBWBlockInvalidation#testRWRInvalidation fails intermittently	Major	namenode, test	Yiqun Lin	Yiqun Lin
HADOOP-13822	Use GlobalStorageStatistics.INSTANCE.reset() at FileSystem#clearStatistics()	Major	fs	Brahma Reddy Battula	Brahma Reddy Battula
HADOOP-11601	Enhance FS spec & tests to mandate FileStatus.getBlocksize() >0 for non-empty files	Minor	fs, test	Steve Loughran	Steve Loughran
HADOOP-13655	document object store use with fs shell and distcp	Major	documentation, fs, fs/s3	Steve Loughran	Steve Loughran
HADOOP-13801	regression: ITestS3AMiniYarnCluster failing	Major	fs/s3	Steve Loughran	Steve Loughran
HADOOP-12804	Read Proxy Password from Credential Providers in S3 FileSystem	Minor	fs/s3	Larry McCay	Larry McCay
HADOOP-13823	s3a rename: fail if dest file exists	Blocker	fs/s3	Steve Loughran	Steve Loughran
HADOOP-13857	S3AUtils.translateException to map (wrapped) InterruptedExceptions to InterruptedIOEs	Major	fs/s3	Steve Loughran	Steve Loughran
HADOOP-13855	Fix a couple of the s3a statistic names to be consistent with the rest	Major	fs/s3	Steve Loughran	Steve Loughran
HADOOP-13257	Improve Azure Data Lake contract tests.	Major	fs/adl	Chris Nauroth	Vishwajeet Dusane
YARN-4390	Do surgical preemption based on reserved container in CapacityScheduler	Major	capacity scheduler	Eric Payne	Wangda Tan
HDFS-8630	WebHDFS : Support get/set/unset StoragePolicy	Major	webhdfs	nijel	Surendra Singh Lilhore
HADOOP-13871	ITestS3AInputStreamPerformance.testTimeToOpenAndReadWholeFileBlocks performance awful	Major	fs/s3	Steve Loughran	Steve Loughran
YARN-2009	CapacityScheduler: Add intra-queue preemption for app priority support	Major	capacityscheduler	Devaraj K	Sunil Govindan
YARN-4844	Add getMemorySize/getVirtualCoresSize to o.a.h.y.api.records.Resource	Blocker	api	Wangda Tan	Wangda Tan
YARN-4990	Re-direction of a particular log file within in a container in NM UI does not redirect properly to Log Server ( history ) on container completion	Major	.	Hitesh Shah	Xuan Gong
YARN-3866	AM-RM protocol changes to support container resizing	Blocker	api	MENG DING	MENG DING
HADOOP-13336	S3A to support per-bucket configuration	Major	fs/s3	Steve Loughran	Steve Loughran
HDFS-8377	Support HTTP/2 in datanode	Major	.	Duo Zhang	Duo Zhang
HADOOP-14019	fix some typos in the s3a docs	Minor	documentation, fs/s3	Steve Loughran	Steve Loughran
HADOOP-14081	S3A: Consider avoiding array copy in S3ABlockOutputStream (ByteArrayBlock)	Minor	fs/s3	Rajesh Balamohan	Rajesh Balamohan
YARN-6143	Fix incompatible issue caused by YARN-3583	Blocker	rolling upgrade	Wangda Tan	Sunil Govindan
HADOOP-14113	review ADL Docs	Minor	documentation, fs/adl	Steve Loughran	Steve Loughran
HADOOP-14123	Remove misplaced ADL service provider config file for FileSystem	Minor	fs/adl	John Zhuge	John Zhuge
HADOOP-14153	ADL module has messed doc structure	Major	fs/adl	Mingliang Liu	Mingliang Liu
HADOOP-14173	Remove unused AdlConfKeys#ADL_EVENTS_TRACKING_SOURCE	Trivial	fs/adl	John Zhuge	John Zhuge
HDFS-7964	Add support for async edit logging	Major	namenode	Daryn Sharp	Daryn Sharp
HDFS-8818	Allow Balancer to run faster	Major	balancer & mover	Tsz Wo Nicholas Sze	Tsz Wo Nicholas Sze
YARN-4140	RM container allocation delayed incase of app submitted to Nodelabel partition	Major	scheduler	Bibin A Chundatt	Bibin A Chundatt

OTHER:

JIRA	Summary	Priority	Component	Reporter	Contributor
YARN-3357	Move TestFifoScheduler to FIFO package	Major	scheduler, test	Rohith Sharma K S	Rohith Sharma K S
HADOOP-11814	Reformat hadoop-annotations, o.a.h.classification.tools	Minor	.	Li Lu	Li Lu
MAPREDUCE-6388	Remove deprecation warnings from JobHistoryServer classes	Minor	jobhistoryserver	Ray Chiang	Ray Chiang
YARN-3026	Move application-specific container allocation logic from LeafQueue to FiCaSchedulerApp	Major	capacityscheduler	Wangda Tan	Wangda Tan
HDFS-8938	Extract BlockToMarkCorrupt and ReplicationWork as standalone classes from BlockManager	Major	.	Mingliang Liu	Mingliang Liu
HDFS-9027	Refactor o.a.h.hdfs.DataStreamer#isLazyPersist() method	Major	.	Mingliang Liu	Mingliang Liu
MAPREDUCE-6477	Replace usage of deprecated NameNode.DEFAULT_PORT in TestFileSystem	Major	.	Mingliang Liu	Mingliang Liu
MAPREDUCE-6483	Replace deprecated method NameNode.getUri() with DFSUtilClient.getNNUri() in TestMRCredentials	Major	test	Mingliang Liu	Mingliang Liu
HDFS-9130	Use GenericTestUtils#setLogLevel to the logging level	Major	.	Mingliang Liu	Mingliang Liu
HADOOP-12446	Undeprecate createNonRecursive()	Major	.	Ted Yu	Ted Yu
HDFS-8979	Clean up checkstyle warnings in hadoop-hdfs-client module	Major	.	Mingliang Liu	Mingliang Liu
HADOOP-11791	Update src/site/markdown/releases to include old versions of Hadoop	Major	build, documentation	Allen Wittenauer	Allen Wittenauer
HADOOP-12514	Make static fields in GenericTestUtils for assertExceptionContains() package-private and final	Minor	test	Mingliang Liu	Mingliang Liu
HDFS-9377	Fix findbugs warnings in FSDirSnapshotOp	Major	namenode	Mingliang Liu	Mingliang Liu
HADOOP-12567	NPE in SaslRpcServer	Major	.	Sergey Shelukhin	Sergey Shelukhin
YARN-4653	Document YARN security model from the perspective of Application Developers	Major	site	Steve Loughran	Steve Loughran
HDFS-10200	Docs for WebHDFS still describe GETDELEGATIONTOKENS operation	Trivial	documentation	Wellington Chevreuil	Wellington Chevreuil
HDFS-9353	Code and comment mismatch in JavaKeyStoreProvider	Trivial	.	nijel	Andras Bokor
HDFS-10984	Expose nntop output as metrics	Major	namenode	Siddharth Wagle	Siddharth Wagle
YARN-5704	Provide config knobs to control enabling/disabling new/work in progress features in container-executor	Major	yarn	Sidharta Seethana	Sidharta Seethana
HADOOP-14091	AbstractFileSystem implementaion for ‘wasbs’ scheme	Major	fs/azure	Varada Hemeswari	Varada Hemeswari
YARN-6274	Documentation refers to incorrect nodemanager health checker interval property	Trivial	documentation	Charles Zhang	Weiwei Yang

General

Common

HDFS

MapReduce

MapReduce REST APIs

YARN

YARN REST APIs

YARN Service

Hadoop Compatible File Systems

Auth

Tools

Reference

Configuration

Apache Hadoop Changelog

Release 2.8.0 - 2017-03-22

INCOMPATIBLE CHANGES:

IMPORTANT ISSUES:

NEW FEATURES:

IMPROVEMENTS:

BUG FIXES:

TESTS:

SUB-TASKS:

OTHER: