| HADOOP-15418 |
Hadoop KMSAuthenticationFilter needs to use getPropsByPrefix instead of iterator to avoid ConcurrentModificationException |
Major |
common |
Suma Shivaprasad |
Suma Shivaprasad |
| HDFS-14004 |
TestLeaseRecovery2#testCloseWhileRecoverLease fails intermittently in trunk |
Major |
. |
Ayush Saxena |
Ayush Saxena |
| HDFS-13959 |
TestUpgradeDomainBlockPlacementPolicy is flaky |
Major |
. |
Ayush Saxena |
Ayush Saxena |
| YARN-8948 |
PlacementRule interface should be for all YarnSchedulers |
Major |
. |
Bibin Chundatt |
Bibin Chundatt |
| HADOOP-16013 |
DecayRpcScheduler decay thread should run as a daemon |
Major |
ipc |
Erik Krogen |
Erik Krogen |
| HDFS-14175 |
EC: Native XOR decoder should reset the output buffer before using it. |
Major |
ec, hdfs |
Surendra Singh Lilhore |
Ayush Saxena |
| HDFS-14202 |
“dfs.disk.balancer.max.disk.throughputInMBperSec” property is not working as per set value. |
Major |
diskbalancer |
Ranith Sardar |
Ranith Sardar |
| HADOOP-16127 |
In ipc.Client, put a new connection could happen after stop |
Major |
ipc |
Tsz-wo Sze |
Tsz-wo Sze |
| YARN-4901 |
QueueMetrics needs to be cleared before MockRM is initialized |
Major |
scheduler |
Daniel Templeton |
Peter Bacsko |
| HADOOP-16161 |
NetworkTopology#getWeightUsingNetworkLocation return unexpected result |
Major |
net |
Xiaoqiao He |
Xiaoqiao He |
| HDFS-14434 |
webhdfs that connect secure hdfs should not use user.name parameter |
Minor |
webhdfs |
KWON BYUNGCHANG |
KWON BYUNGCHANG |
| HDFS-14527 |
Stop all DataNodes may result in NN terminate |
Major |
namenode |
Xiaoqiao He |
Xiaoqiao He |
| HDFS-14494 |
Move Server logging of StatedId inside receiveRequestState() |
Major |
. |
Konstantin Shvachko |
Shweta |
| HDFS-14599 |
HDFS-12487 breaks test TestDiskBalancer.testDiskBalancerWithFedClusterWithOneNameServiceEmpty |
Major |
diskbalancer |
Wei-Chiu Chuang |
Xiaoqiao He |
| HDFS-14618 |
Incorrect synchronization of ArrayList field (ArrayList is thread-unsafe). |
Critical |
. |
Paul Ward |
Paul Ward |
| HDFS-14610 |
HashMap is not thread safe. Field storageMap is typically synchronized by storageMap. However, in one place, field storageMap is not protected with synchronized. |
Critical |
. |
Paul Ward |
Paul Ward |
| HDFS-14499 |
Misleading REM_QUOTA value with snapshot and trash feature enabled for a directory |
Major |
snapshots |
Shashikant Banerjee |
Shashikant Banerjee |
| HADOOP-16451 |
Update jackson-databind to 2.9.9.1 |
Major |
. |
Wei-Chiu Chuang |
Siyao Meng |
| HDFS-14647 |
NPE during secure namenode startup |
Major |
hdfs |
Fengnan Li |
Fengnan Li |
| HADOOP-16461 |
Regression: FileSystem cache lock parses XML within the lock |
Major |
fs |
Gopal Vijayaraghavan |
Gopal Vijayaraghavan |
| HDFS-14660 |
[SBN Read] ObserverNameNode should throw StandbyException for requests not from ObserverProxyProvider |
Major |
. |
Chao Sun |
Chao Sun |
| HADOOP-16460 |
ABFS: fix for Sever Name Indication (SNI) |
Major |
fs/azure |
Thomas Marqardt |
Sneha Vijayarajan |
| HDFS-14569 |
Result of crypto -listZones is not formatted properly |
Major |
. |
Hemanth Boyina |
Hemanth Boyina |
| HADOOP-12282 |
Connection thread’s name should be updated after address changing is detected |
Major |
ipc |
zhouyingchao |
Lisheng Sun |
| HDFS-14686 |
HttpFS: HttpFSFileSystem#getErasureCodingPolicy always returns null |
Major |
httpfs |
Siyao Meng |
Siyao Meng |
| HADOOP-15865 |
ConcurrentModificationException in Configuration.overlay() method |
Major |
. |
Oleksandr Shevchenko |
Oleksandr Shevchenko |
| HADOOP-16487 |
Update jackson-databind to 2.9.9.2 |
Critical |
. |
Siyao Meng |
Siyao Meng |
| HDFS-14759 |
HDFS cat logs an info message |
Major |
. |
Eric Badger |
Eric Badger |
| HADOOP-16533 |
Update jackson-databind to 2.9.9.3 |
Major |
. |
Akira Ajisaka |
Akira Ajisaka |
| HDFS-14699 |
Erasure Coding: Storage not considered in live replica when replication streams hard limit reached to threshold |
Critical |
ec |
Zhao Yi Ming |
Zhao Yi Ming |
| YARN-9833 |
Race condition when DirectoryCollection.checkDirs() runs during container launch |
Major |
. |
Peter Bacsko |
Peter Bacsko |
| YARN-9837 |
YARN Service fails to fetch status for Stopped apps with bigger spec files |
Major |
yarn-native-services |
Tarun Parimi |
Tarun Parimi |
| YARN-2255 |
YARN Audit logging not added to log4j.properties |
Major |
. |
Varun Saxena |
Aihua Xu |
| HDFS-14836 |
FileIoProvider should not increase FileIoErrors metric in datanode volume metric |
Minor |
. |
Aiphago |
Aiphago |
| HADOOP-16582 |
LocalFileSystem’s mkdirs() does not work as expected under viewfs. |
Major |
. |
Kihwal Lee |
Kihwal Lee |
| HADOOP-16581 |
ValueQueue does not trigger an async refill when number of values falls below watermark |
Major |
common, kms |
Yuval Degani |
Yuval Degani |
| HDFS-14853 |
NPE in DFSNetworkTopology#chooseRandomWithStorageType() when the excludedNode is not present |
Major |
. |
Ranith Sardar |
Ranith Sardar |
| HDFS-13660 |
DistCp job fails when new data is appended in the file while the distCp copy job is running |
Critical |
distcp |
Mukund Thakur |
Mukund Thakur |
| HDFS-14808 |
EC: Improper size values for corrupt ec block in LOG |
Major |
ec |
Harshakiran Reddy |
Ayush Saxena |
| HDFS-14849 |
Erasure Coding: the internal block is replicated many times when datanode is decommissioning |
Major |
ec, erasure-coding |
HuangTao |
HuangTao |
| YARN-9858 |
Optimize RMContext getExclusiveEnforcedPartitions |
Major |
. |
Jonathan Hung |
Jonathan Hung |
| HDFS-14492 |
Snapshot memory leak |
Major |
snapshots |
Wei-Chiu Chuang |
Wei-Chiu Chuang |
| HDFS-14418 |
Remove redundant super user priveledge checks from namenode. |
Major |
. |
Ayush Saxena |
Ayush Saxena |
| HADOOP-16619 |
Upgrade jackson and jackson-databind to 2.9.10 |
Major |
. |
Siyao Meng |
Siyao Meng |
| HDFS-14637 |
Namenode may not replicate blocks to meet the policy after enabling upgradeDomain |
Major |
namenode |
Stephen O’Donnell |
Stephen O’Donnell |
| HDFS-14879 |
Header was wrong in Snapshot web UI |
Major |
. |
Hemanth Boyina |
Hemanth Boyina |
| HDFS-14655 |
[SBN Read] Namenode crashes if one of The JN is down |
Critical |
. |
Harshakiran Reddy |
Ayush Saxena |
| HDFS-14859 |
Prevent unnecessary evaluation of costly operation getNumLiveDataNodes when dfs.namenode.safemode.min.datanodes is not zero |
Major |
hdfs |
Srinivasu Majeti |
Srinivasu Majeti |
| YARN-6715 |
Fix documentation about NodeHealthScriptRunner |
Major |
documentation, nodemanager |
Peter Bacsko |
Peter Bacsko |
| YARN-9552 |
FairScheduler: NODE_UPDATE can cause NoSuchElementException |
Major |
fairscheduler |
Peter Bacsko |
Peter Bacsko |
| HDFS-14754 |
Erasure Coding : The number of Under-Replicated Blocks never reduced |
Critical |
ec |
Hemanth Boyina |
Hemanth Boyina |
| HDFS-14245 |
Class cast error in GetGroups with ObserverReadProxyProvider |
Major |
. |
Shen Yinjie |
Erik Krogen |
| HDFS-14373 |
EC : Decoding is failing when block group last incomplete cell fall in to AlignedStripe |
Critical |
ec, hdfs-client |
Surendra Singh Lilhore |
Surendra Singh Lilhore |
| HDFS-14509 |
DN throws InvalidToken due to inequality of password when upgrade NN 2.x to 3.x |
Blocker |
. |
Yuxuan Wang |
Yuxuan Wang |
| HDFS-14886 |
In NameNode Web UI’s Startup Progress page, Loading edits always shows 0 sec |
Major |
. |
Hemanth Boyina |
Hemanth Boyina |
| YARN-8453 |
Additional Unit tests to verify queue limit and max-limit with multiple resource types |
Major |
capacity scheduler |
Sunil G |
Adam Antal |
| HDFS-14890 |
Setting permissions on name directory fails on non posix compliant filesystems |
Blocker |
. |
hirik |
Siddharth Wagle |
| HADOOP-16580 |
Disable retry of FailoverOnNetworkExceptionRetry in case of AccessControlException |
Major |
common |
Adam Antal |
Adam Antal |
| HDFS-14909 |
DFSNetworkTopology#chooseRandomWithStorageType() should not decrease storage count for excluded node which is already part of excluded scope |
Major |
namenode |
Surendra Singh Lilhore |
Surendra Singh Lilhore |
| HADOOP-16662 |
Remove unnecessary InnerNode check in NetworkTopology#add() |
Minor |
. |
Lisheng Sun |
Lisheng Sun |
| HDFS-14847 |
Erasure Coding: Blocks are over-replicated while EC decommissioning |
Critical |
ec |
Hui Fei |
Hui Fei |
| HDFS-14913 |
Correct the value of available count in DFSNetworkTopology#chooseRandomWithStorageType() |
Major |
. |
Ayush Saxena |
Ayush Saxena |
| YARN-9915 |
Fix FindBug issue in QueueMetrics |
Minor |
. |
Prabhu Joseph |
Prabhu Joseph |
| HDFS-12749 |
DN may not send block report to NN after NN restart |
Major |
datanode |
TanYuxin |
Xiaoqiao He |
| HDFS-13901 |
INode access time is ignored because of race between open and rename |
Major |
. |
Jinglun |
Jinglun |
| HDFS-14910 |
Rename Snapshot with Pre Descendants Fail With IllegalArgumentException. |
Blocker |
. |
Íñigo Goiri |
Wei-Chiu Chuang |
| HDFS-14308 |
DFSStripedInputStream curStripeBuf is not freed by unbuffer() |
Major |
ec |
Joe McDonnell |
Zhao Yi Ming |
| HDFS-14931 |
hdfs crypto commands limit column width |
Major |
. |
Eric Badger |
Eric Badger |
| HADOOP-16669 |
TestRawLocalFileSystemContract.testPermission fails if no native library |
Minor |
common, test |
Steve Loughran |
Steve Loughran |
| HDFS-14920 |
Erasure Coding: Decommission may hang If one or more datanodes are out of service during decommission |
Major |
ec |
Hui Fei |
Hui Fei |
| HDFS-13736 |
BlockPlacementPolicyDefault can not choose favored nodes when ‘dfs.namenode.block-placement-policy.default.prefer-local-node’ set to false |
Major |
. |
hu xiaodong |
hu xiaodong |
| HDFS-14925 |
rename operation should check nest snapshot |
Major |
namenode |
Junwang Zhao |
Junwang Zhao |
| YARN-9949 |
Add missing queue configs for root queue in RMWebService#CapacitySchedulerInfo |
Minor |
capacity scheduler |
Prabhu Joseph |
Prabhu Joseph |
| HDFS-14945 |
Revise PacketResponder’s log. |
Minor |
datanode |
Xudong Cao |
Xudong Cao |
| HDFS-14946 |
Erasure Coding: Block recovery failed during decommissioning |
Major |
. |
Hui Fei |
Hui Fei |
| HDFS-14384 |
When lastLocatedBlock token expire, it will take 1~3s second to refetch it. |
Major |
hdfs-client |
Surendra Singh Lilhore |
Surendra Singh Lilhore |
| HDFS-14806 |
Bootstrap standby may fail if used in-progress tailing |
Major |
namenode |
Chen Liang |
Chen Liang |
| HDFS-14941 |
Potential editlog race condition can cause corrupted file |
Major |
namenode |
Chen Liang |
Chen Liang |
| HDFS-14958 |
TestBalancerWithNodeGroup is not using NetworkTopologyWithNodeGroup |
Minor |
hdfs |
Jim Brennan |
Jim Brennan |
| HDFS-14720 |
DataNode shouldn’t report block as bad block if the block length is Long.MAX_VALUE. |
Major |
datanode |
Surendra Singh Lilhore |
Hemanth Boyina |
| HADOOP-16676 |
Backport HADOOP-16152 to branch-3.2 |
Major |
common |
DW |
Siyao Meng |
| HADOOP-16677 |
Recalculate the remaining timeout millis correctly while throwing an InterupptedException in SocketIOWithTimeout. |
Minor |
common |
Xudong Cao |
Xudong Cao |
| HDFS-14884 |
Add sanity check that zone key equals feinfo key while setting Xattrs |
Major |
encryption, hdfs |
Mukul Kumar Singh |
Mukul Kumar Singh |
| HADOOP-15097 |
AbstractContractDeleteTest::testDeleteNonEmptyDirRecursive with misleading path |
Minor |
fs, test |
zhoutai.zt |
Xieming Li |
| HADOOP-16710 |
testing_azure.md documentation is misleading |
Major |
fs/azure, test |
Andras Bokor |
Andras Bokor |
| YARN-9984 |
FSPreemptionThread can cause NullPointerException while app is unregistered with containers running on a node |
Major |
fairscheduler |
Wilfred Spiegelenburg |
Wilfred Spiegelenburg |
| YARN-9983 |
Typo in YARN Service overview documentation |
Trivial |
documentation |
Denes Gerencser |
Denes Gerencser |
| HADOOP-16719 |
Remove the disallowed element config within maven-checkstyle-plugin |
Major |
. |
Wanqiang Ji |
Wanqiang Ji |
| HADOOP-16700 |
RpcQueueTime may be negative when the response has to be sent later |
Minor |
. |
xuzq |
xuzq |
| HADOOP-15686 |
Supress bogus AbstractWadlGeneratorGrammarGenerator in KMS stderr |
Major |
kms |
Wei-Chiu Chuang |
Wei-Chiu Chuang |
| HDFS-14940 |
HDFS Balancer : Do not allow to set balancer maximum network bandwidth more than 1TB |
Minor |
balancer & mover |
Souryakanta Dwivedy |
Hemanth Boyina |
| YARN-9838 |
Fix resource inconsistency for queues when moving app with reserved container to another queue |
Critical |
capacity scheduler |
jiulongzhu |
jiulongzhu |
| YARN-9968 |
Public Localizer is exiting in NodeManager due to NullPointerException |
Major |
nodemanager |
Tarun Parimi |
Tarun Parimi |
| YARN-9011 |
Race condition during decommissioning |
Major |
nodemanager |
Peter Bacsko |
Peter Bacsko |
| HDFS-14973 |
Balancer getBlocks RPC dispersal does not function properly |
Major |
balancer & mover |
Erik Krogen |
Erik Krogen |
| HADOOP-16685 |
FileSystem#listStatusIterator does not check if given path exists |
Major |
fs |
Sahil Takiar |
Sahil Takiar |
| MAPREDUCE-7240 |
Exception ’ Invalid event: TA_TOO_MANY_FETCH_FAILURE at SUCCESS_FINISHING_CONTAINER’ cause job error |
Critical |
. |
luhuachao |
luhuachao |
| MAPREDUCE-7249 |
Invalid event TA_TOO_MANY_FETCH_FAILURE at SUCCESS_CONTAINER_CLEANUP causes job failure |
Critical |
applicationmaster, mrv2 |
Wilfred Spiegelenburg |
Wilfred Spiegelenburg |
| YARN-9993 |
Remove incorrectly committed files from YARN-9011 |
Major |
yarn |
Wilfred Spiegelenburg |
Wilfred Spiegelenburg |
| HDFS-15010 |
BlockPoolSlice#addReplicaThreadPool static pool should be initialized by static method |
Major |
datanode |
Surendra Singh Lilhore |
Surendra Singh Lilhore |
| HADOOP-16744 |
Fix building instruction to enable zstd |
Minor |
documentation |
Masatake Iwasaki |
Masatake Iwasaki |
| YARN-9985 |
Unsupported “transitionToObserver” option displaying for rmadmin command |
Minor |
RM, yarn |
Souryakanta Dwivedy |
Ayush Saxena |
| HADOOP-16754 |
Fix docker failed to build yetus/hadoop |
Blocker |
build |
Kevin Su |
Kevin Su |
| HDFS-15032 |
Balancer crashes when it fails to contact an unavailable NN via ObserverReadProxyProvider |
Major |
balancer & mover |
Erik Krogen |
Erik Krogen |
| HDFS-15036 |
Active NameNode should not silently fail the image transfer |
Major |
namenode |
Konstantin Shvachko |
Chen Liang |
| HDFS-14519 |
NameQuota is not update after concat operation, so namequota is wrong |
Major |
. |
Ranith Sardar |
Ranith Sardar |
| YARN-10055 |
bower install fails |
Blocker |
build, yarn-ui-v2 |
Akira Ajisaka |
Akira Ajisaka |
| HDFS-15076 |
Fix tests that hold FSDirectory lock, without holding FSNamesystem lock. |
Major |
test |
Konstantin Shvachko |
Konstantin Shvachko |
| HDFS-15073 |
Replace curator-shaded guava import with the standard one |
Minor |
hdfs-client |
Akira Ajisaka |
Chandra Sanivarapu |
| HADOOP-16042 |
Update the link to HadoopJavaVersion |
Minor |
documentation |
Akira Ajisaka |
Chandra Sanivarapu |
| HDFS-14934 |
[SBN Read] Standby NN throws many InterruptedExceptions when dfs.ha.tail-edits.period is 0 |
Major |
. |
Takanobu Asanuma |
Ayush Saxena |
| YARN-10053 |
Placement rules do not use correct group service init |
Major |
yarn |
Wilfred Spiegelenburg |
Wilfred Spiegelenburg |
| HDFS-15068 |
DataNode could meet deadlock if invoke refreshVolumes when register |
Major |
datanode |
Xiaoqiao He |
Aiphago |
| MAPREDUCE-7255 |
Fix typo in MapReduce documentaion example |
Trivial |
documentation |
Sergey Pogorelov |
Sergey Pogorelov |
| HDFS-15072 |
HDFS MiniCluster fails to start when run in directory path with a % |
Minor |
. |
Geoffrey Jacoby |
Masatake Iwasaki |
| HDFS-15077 |
Fix intermittent failure of TestDFSClientRetries#testLeaseRenewSocketTimeout |
Minor |
test |
Masatake Iwasaki |
Masatake Iwasaki |
| HDFS-15080 |
Fix the issue in reading persistent memory cached data with an offset |
Major |
caching, datanode |
Feilong He |
Feilong He |
| YARN-7387 |
org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestIncreaseAllocationExpirer fails intermittently |
Major |
. |
Miklos Szegedi |
Jim Brennan |
| YARN-8672 |
TestContainerManager#testLocalingResourceWhileContainerRunning occasionally times out |
Major |
nodemanager |
Jason Darrell Lowe |
Chandni Singh |
| HDFS-14957 |
INodeReference Space Consumed was not same in QuotaUsage and ContentSummary |
Major |
namenode |
Hemanth Boyina |
Hemanth Boyina |
| MAPREDUCE-7252 |
Handling 0 progress in SimpleExponential task runtime estimator |
Minor |
. |
Ahmed Hussein |
Ahmed Hussein |
| HADOOP-16749 |
Configuration parsing of CDATA values are blank |
Major |
conf |
Jonathan Turner Eagles |
Daryn Sharp |
| HDFS-15095 |
Fix accidental comment in flaky test TestDecommissioningStatus |
Major |
hdfs |
Ahmed Hussein |
Ahmed Hussein |
| HDFS-15099 |
[SBN Read] checkOperation(WRITE) should throw ObserverRetryOnActiveException on ObserverNode |
Major |
namenode |
Konstantin Shvachko |
Chen Liang |
| HDFS-14578 |
AvailableSpaceBlockPlacementPolicy always prefers local node |
Major |
block placement |
Wei-Chiu Chuang |
Ayush Saxena |
| HADOOP-16683 |
Disable retry of FailoverOnNetworkExceptionRetry in case of wrapped AccessControlException |
Major |
common |
Adam Antal |
Adam Antal |
| MAPREDUCE-7256 |
Fix javadoc error in SimpleExponentialSmoothing |
Minor |
documentation |
Masatake Iwasaki |
Masatake Iwasaki |
| YARN-8373 |
RM Received RMFatalEvent of type CRITICAL_THREAD_CRASH |
Major |
fairscheduler, resourcemanager |
Girish Bhat |
Wilfred Spiegelenburg |
| MAPREDUCE-7247 |
Modify HistoryServerRest.html content,change The job attempt id‘s datatype from string to int |
Major |
documentation |
zhaoshengjie |
zhaoshengjie |
| YARN-9970 |
Refactor TestUserGroupMappingPlacementRule#verifyQueueMapping |
Major |
. |
Manikandan R |
Manikandan R |
| YARN-8148 |
Update decimal values for queue capacities shown on queue status CLI |
Major |
client |
Prabhu Joseph |
Prabhu Joseph |
| HADOOP-16808 |
Use forkCount and reuseForks parameters instead of forkMode in the config of maven surefire plugin |
Minor |
build |
Akira Ajisaka |
Xieming Li |
| HADOOP-16793 |
Remove WARN log when ipc connection interrupted in Client#handleSaslConnectionFailure() |
Minor |
. |
Lisheng Sun |
Lisheng Sun |
| YARN-9462 |
TestResourceTrackerService.testNodeRemovalGracefully fails sporadically |
Minor |
resourcemanager, test |
Prabhu Joseph |
Prabhu Joseph |
| YARN-9790 |
Failed to set default-application-lifetime if maximum-application-lifetime is less than or equal to zero |
Major |
. |
kyungwan nam |
kyungwan nam |
| HDFS-14993 |
checkDiskError doesn’t work during datanode startup |
Major |
datanode |
Yang Yun |
Yang Yun |
| HDFS-13179 |
TestLazyPersistReplicaRecovery#testDnRestartWithSavedReplicas fails intermittently |
Critical |
fs |
Gabor Bota |
Ahmed Hussein |
| MAPREDUCE-7259 |
testSpeculateSuccessfulWithUpdateEvents fails Intermittently |
Minor |
. |
Ahmed Hussein |
Ahmed Hussein |
| HDFS-15146 |
TestBalancerRPCDelay.testBalancerRPCDelay fails intermittently |
Minor |
. |
Ahmed Hussein |
Ahmed Hussein |
| MAPREDUCE-7079 |
JobHistory#ServiceStop implementation is incorrect |
Major |
. |
Jason Darrell Lowe |
Ahmed Hussein |
| HDFS-15118 |
[SBN Read] Slow clients when Observer reads are enabled but there are no Observers on the cluster. |
Major |
hdfs-client |
Konstantin Shvachko |
Chen Liang |
| HDFS-7175 |
Client-side SocketTimeoutException during Fsck |
Major |
namenode |
Carl Steinbach |
Stephen O’Donnell |
| HDFS-15148 |
dfs.namenode.send.qop.enabled should not apply to primary NN port |
Major |
. |
Chen Liang |
Chen Liang |
| HADOOP-16410 |
Hadoop 3.2 azure jars incompatible with alpine 3.9 |
Minor |
fs/azure |
Jose Luis Pedrosa |
|
| HDFS-15115 |
Namenode crash caused by NPE in BlockPlacementPolicyDefault when dynamically change logger to debug |
Major |
. |
wangzhixiang |
wangzhixiang |
| HDFS-15158 |
The number of failed volumes mismatch with volumeFailures of Datanode metrics |
Minor |
datanode |
Yang Yun |
Yang Yun |
| HADOOP-16849 |
start-build-env.sh behaves incorrectly when username is numeric only |
Minor |
build |
Jihyun Cho |
Jihyun Cho |
| HDFS-15161 |
When evictableMmapped or evictable size is zero, do not throw NoSuchElementException in ShortCircuitCache#close() |
Major |
. |
Lisheng Sun |
Lisheng Sun |
| HDFS-15164 |
Fix TestDelegationTokensWithHA |
Major |
. |
Ayush Saxena |
Ayush Saxena |
| HADOOP-16868 |
ipc.Server readAndProcess threw NullPointerException |
Major |
rpc-server |
Tsz-wo Sze |
Tsz-wo Sze |
| HADOOP-16869 |
Upgrade findbugs-maven-plugin to 3.0.5 to fix mvn findbugs:findbugs failure |
Major |
build |
Akira Ajisaka |
Akira Ajisaka |
| HDFS-15052 |
WebHDFS getTrashRoot leads to OOM due to FileSystem object creation |
Major |
webhdfs |
Wei-Chiu Chuang |
Masatake Iwasaki |
| HDFS-15185 |
StartupProgress reports edits segments until the entire startup completes |
Major |
namenode |
Konstantin Shvachko |
Konstantin Shvachko |
| HDFS-15166 |
Remove redundant field fStream in ByteStringLog |
Major |
. |
Konstantin Shvachko |
Xieming Li |
| YARN-10143 |
YARN-10101 broke Yarn logs CLI |
Blocker |
yarn |
Adam Antal |
Adam Antal |
| HADOOP-16841 |
The description of hadoop.http.authentication.signature.secret.file contains outdated information |
Minor |
documentation |
Akira Ajisaka |
Xieming Li |
| YARN-10156 |
Fix typo ‘complaint’ which means quite different in Federation.md |
Minor |
documentation, federation |
Sungpeo Kook |
Sungpeo Kook |
| HDFS-15147 |
LazyPersistTestCase wait logic is error-prone |
Minor |
. |
Ahmed Hussein |
Ahmed Hussein |
| HDFS-14668 |
Support Fuse with Users from multiple Security Realms |
Critical |
fuse-dfs |
Sailesh Patel |
István Fajth |
| HDFS-15111 |
stopStandbyServices() should log which service state it is transitioning from. |
Major |
hdfs, logging |
Konstantin Shvachko |
Xieming Li |
| HDFS-15199 |
NPE in BlockSender |
Major |
. |
Ayush Saxena |
Ayush Saxena |
| HADOOP-16891 |
Upgrade jackson-databind to 2.9.10.3 |
Blocker |
. |
Siyao Meng |
Siyao Meng |
| HDFS-15204 |
TestRetryCacheWithHA testRemoveCacheDescriptor fails intermittently |
Major |
hdfs |
Ahmed Hussein |
Ahmed Hussein |
| HADOOP-16840 |
AliyunOSS: getFileStatus throws FileNotFoundException in versioning bucket |
Major |
fs/oss |
wujinhu |
wujinhu |
| YARN-9419 |
Log a warning if GPU isolation is enabled but LinuxContainerExecutor is disabled |
Major |
. |
Szilard Nemeth |
Andras Gyori |
| YARN-9427 |
TestContainerSchedulerQueuing.testKillOnlyRequiredOpportunisticContainers fails sporadically |
Major |
scheduler, test |
Prabhu Joseph |
Ahmed Hussein |
| HDFS-15135 |
EC : ArrayIndexOutOfBoundsException in BlockRecoveryWorker#RecoveryTaskStriped. |
Major |
erasure-coding |
Surendra Singh Lilhore |
Ravuri Sushma sree |
| HDFS-14442 |
Disagreement between HAUtil.getAddressOfActive and RpcInvocationHandler.getConnectionId |
Major |
. |
Erik Krogen |
Ravuri Sushma sree |
| HDFS-15216 |
Wrong Use Case of -showprogress in fsck |
Major |
. |
Ravuri Sushma sree |
Ravuri Sushma sree |
| HDFS-15211 |
EC: File write hangs during close in case of Exception during updatePipeline |
Critical |
. |
Ayush Saxena |
Ayush Saxena |
| HDFS-15208 |
Suppress bogus AbstractWadlGeneratorGrammarGenerator in KMS stderr in hdfs |
Trivial |
. |
Wei-Chiu Chuang |
Wei-Chiu Chuang |
| HDFS-15223 |
FSCK fails if one namenode is not available |
Major |
. |
Ayush Saxena |
Ayush Saxena |
| HDFS-15232 |
Fix libhdfspp test failures with GCC 7 |
Major |
native, test |
Akira Ajisaka |
Akira Ajisaka |
| HDFS-15219 |
DFS Client will stuck when ResponseProcessor.run throw Error |
Major |
hdfs-client |
zhengchenyu |
zhengchenyu |
| HDFS-15191 |
EOF when reading legacy buffer in BlockTokenIdentifier |
Major |
hdfs |
Steven Rand |
Steven Rand |
| YARN-10202 |
Fix documentation about NodeAttributes. |
Minor |
documentation |
Sen Zhao |
Sen Zhao |
| HADOOP-16949 |
pylint fails in the build environment |
Critical |
build |
Akira Ajisaka |
Akira Ajisaka |
| HADOOP-14836 |
Upgrade maven-clean-plugin to 3.1.0 |
Major |
build |
Allen Wittenauer |
Akira Ajisaka |
| YARN-10207 |
CLOSE_WAIT socket connection leaks during rendering of (corrupted) aggregated logs on the JobHistoryServer Web UI |
Major |
yarn |
Siddharth Ahuja |
Siddharth Ahuja |
| HDFS-12862 |
CacheDirective becomes invalid when NN restart or failover |
Major |
caching, hdfs |
Wang XL |
Wang XL |
| MAPREDUCE-7272 |
TaskAttemptListenerImpl excessive log messages |
Major |
. |
Ahmed Hussein |
Ahmed Hussein |
| HDFS-15283 |
Cache pool MAXTTL is not persisted and restored on cluster restart |
Major |
namenode |
Stephen O’Donnell |
Stephen O’Donnell |
| HADOOP-16944 |
Use Yetus 0.12.0 in GitHub PR |
Major |
build |
Akira Ajisaka |
Akira Ajisaka |
| HDFS-15276 |
Concat on INodeRefernce fails with illegal state exception |
Critical |
. |
Hemanth Boyina |
Hemanth Boyina |
| YARN-10223 |
Duplicate jersey-test-framework-core dependency in yarn-server-common |
Minor |
build |
Akira Ajisaka |
Akira Ajisaka |
| HDFS-15281 |
ZKFC ignores dfs.namenode.rpc-bind-host and uses dfs.namenode.rpc-address to bind to host address |
Major |
ha, namenode |
Dhiraj Hegde |
Dhiraj Hegde |
| HDFS-15297 |
TestNNHandlesBlockReportPerStorage::blockReport_02 fails intermittently in trunk |
Major |
datanode, test |
Mingliang Liu |
Ayush Saxena |
| HADOOP-17014 |
Upgrade jackson-databind to 2.9.10.4 |
Blocker |
. |
Siyao Meng |
Siyao Meng |
| YARN-9848 |
revert YARN-4946 |
Blocker |
log-aggregation, resourcemanager |
Steven Rand |
Steven Rand |
| HDFS-15286 |
Concat on a same files deleting the file |
Critical |
. |
Hemanth Boyina |
Hemanth Boyina |
| YARN-10256 |
Refactor TestContainerSchedulerQueuing.testContainerUpdateExecTypeGuaranteedToOpportunistic |
Major |
. |
Ahmed Hussein |
Ahmed Hussein |
| HDFS-15270 |
Account for *env == NULL in hdfsThreadDestructor |
Major |
. |
Babneet Singh |
Babneet Singh |
| YARN-8959 |
TestContainerResizing fails randomly |
Minor |
. |
Bibin Chundatt |
Ahmed Hussein |
| HDFS-15323 |
StandbyNode fails transition to active due to insufficient transaction tailing |
Major |
namenode, qjm |
Konstantin Shvachko |
Konstantin Shvachko |
| HADOOP-17025 |
Fix invalid metastore configuration in S3GuardTool tests |
Minor |
fs/s3, test |
Masatake Iwasaki |
Masatake Iwasaki |
| HDFS-15339 |
TestHDFSCLI fails for user names with the dot/dash character |
Major |
test |
Yan Xiaole |
Yan Xiaole |
| HDFS-15250 |
Setting `dfs.client.use.datanode.hostname` to true can crash the system because of unhandled UnresolvedAddressException |
Major |
. |
Ctest |
Ctest |
| HDFS-14367 |
EC: Parameter maxPoolSize in striped reconstruct thread pool isn’t affecting number of threads |
Major |
ec |
Guo Lei |
Guo Lei |
| HADOOP-15565 |
ViewFileSystem.close doesn’t close child filesystems and causes FileSystem objects leak. |
Major |
. |
Jinglun |
Jinglun |
| YARN-9444 |
YARN API ResourceUtils’s getRequestedResourcesFromConfig doesn’t recognize yarn.io/gpu as a valid resource |
Minor |
api |
Gergely Pollak |
Gergely Pollak |
| HADOOP-17044 |
Revert “HADOOP-8143. Change distcp to have -pb on by default” |
Major |
tools/distcp |
Steve Loughran |
Steve Loughran |
| HDFS-15293 |
Relax the condition for accepting a fsimage when receiving a checkpoint |
Critical |
namenode |
Chen Liang |
Chen Liang |
| HADOOP-17024 |
ListStatus on ViewFS root (ls “/”) should list the linkFallBack root (configured target root). |
Major |
fs, viewfs |
Uma Maheswara Rao G |
Abhishek Das |
| HADOOP-17040 |
Fix intermittent failure of ITestBlockingThreadPoolExecutorService |
Minor |
fs/s3, test |
Masatake Iwasaki |
Masatake Iwasaki |
| HDFS-15363 |
BlockPlacementPolicyWithNodeGroup should validate if it is initialized by NetworkTopologyWithNodeGroup |
Major |
. |
Hemanth Boyina |
Hemanth Boyina |
| MAPREDUCE-7278 |
Speculative execution behavior is observed even when mapreduce.map.speculative and mapreduce.reduce.speculative are false |
Major |
task |
Tarun Parimi |
Tarun Parimi |
| HADOOP-7002 |
Wrong description of copyFromLocal and copyToLocal in documentation |
Minor |
. |
Jingguo Yao |
Andras Bokor |
| HADOOP-17052 |
NetUtils.connect() throws unchecked exception (UnresolvedAddressException) causing clients to abort |
Major |
net |
Dhiraj Hegde |
Dhiraj Hegde |
| HADOOP-17062 |
Fix shelldocs path in Jenkinsfile |
Major |
build |
Akira Ajisaka |
Akira Ajisaka |
| HADOOP-17056 |
shelldoc fails in hadoop-common |
Major |
build |
Akira Ajisaka |
Akira Ajisaka |
| YARN-10286 |
PendingContainers bugs in the scheduler outputs |
Critical |
. |
Adam Antal |
Andras Gyori |
| HDFS-15396 |
Fix TestViewFileSystemOverloadSchemeHdfsFileSystemContract#testListStatusRootDir |
Major |
. |
Ayush Saxena |
Ayush Saxena |
| HDFS-15386 |
ReplicaNotFoundException keeps happening in DN after removing multiple DN’s data directories |
Major |
. |
Toshihiro Suzuki |
Toshihiro Suzuki |
| YARN-10300 |
appMasterHost not set in RM ApplicationSummary when AM fails before first heartbeat |
Major |
. |
Eric Badger |
Eric Badger |
| HADOOP-17059 |
ArrayIndexOfboundsException in ViewFileSystem#listStatus |
Major |
viewfs |
Hemanth Boyina |
Hemanth Boyina |
| YARN-10296 |
Make ContainerPBImpl#getId/setId synchronized |
Minor |
. |
Benjamin Teke |
Benjamin Teke |
| YARN-10295 |
CapacityScheduler NPE can cause apps to get stuck without resources |
Major |
capacityscheduler |
Benjamin Teke |
Benjamin Teke |
| HADOOP-17060 |
listStatus and getFileStatus behave inconsistent in the case of ViewFs implementation for isDirectory |
Major |
viewfs |
Srinivasu Majeti |
Uma Maheswara Rao G |
| YARN-10312 |
Add support for yarn logs -logFile to retain backward compatibility |
Major |
client |
Jim Brennan |
Jim Brennan |
| HDFS-15403 |
NPE in FileIoProvider#transferToSocketFully |
Major |
. |
Hemanth Boyina |
Hemanth Boyina |
| HADOOP-17029 |
ViewFS does not return correct user/group and ACL |
Major |
fs, viewfs |
Abhishek Das |
Abhishek Das |
| HDFS-15421 |
IBR leak causes standby NN to be stuck in safe mode |
Blocker |
namenode |
Kihwal Lee |
Akira Ajisaka |
| YARN-9903 |
Support reservations continue looking for Node Labels |
Major |
. |
Tarun Parimi |
Jim Brennan |
| HADOOP-17032 |
Handle an internal dir in viewfs having multiple children mount points pointing to different filesystems |
Major |
fs, viewfs |
Abhishek Das |
Abhishek Das |
| HDFS-15446 |
CreateSnapshotOp fails during edit log loading for /.reserved/raw/path with error java.io.FileNotFoundException: Directory does not exist: /.reserved/raw/path |
Major |
hdfs |
Srinivasu Majeti |
Stephen O’Donnell |
| HADOOP-17081 |
MetricsSystem doesn’t start the sink adapters on restart |
Minor |
metrics |
Madhusoodan |
Madhusoodan |
| HDFS-15451 |
Restarting name node stuck in safe mode when using provided storage |
Major |
namenode |
shanyu zhao |
shanyu zhao |
| HADOOP-17120 |
Fix failure of docker image creation due to pip2 install error |
Major |
. |
Masatake Iwasaki |
Masatake Iwasaki |
| YARN-10347 |
Fix double locking in CapacityScheduler#reinitialize in branch-3.1 |
Critical |
capacity scheduler |
Masatake Iwasaki |
Masatake Iwasaki |
| YARN-10348 |
Allow RM to always cancel tokens after app completes |
Major |
yarn |
Jim Brennan |
Jim Brennan |
| MAPREDUCE-7284 |
TestCombineFileInputFormat#testMissingBlocks fails |
Major |
test |
Akira Ajisaka |
Akira Ajisaka |
| HDFS-14498 |
LeaseManager can loop forever on the file for which create has failed |
Major |
namenode |
Sergey Shelukhin |
Stephen O’Donnell |
| HADOOP-17130 |
Configuration.getValByRegex() shouldn’t update the results while fetching. |
Major |
common |
Mukund Thakur |
Mukund Thakur |
| HADOOP-17119 |
Jetty upgrade to 9.4.x causes MR app fail with IOException |
Major |
. |
Bilwa S T |
Bilwa S T |
| YARN-4771 |
Some containers can be skipped during log aggregation after NM restart |
Major |
nodemanager |
Jason Darrell Lowe |
Jim Brennan |
| MAPREDUCE-7051 |
Fix typo in MultipleOutputFormat |
Trivial |
. |
ywheel |
ywheel |
| HDFS-15313 |
Ensure inodes in active filesystem are not deleted during snapshot delete |
Major |
snapshots |
Shashikant Banerjee |
Shashikant Banerjee |
| HDFS-14950 |
missing libhdfspp libs in dist-package |
Major |
build, libhdfs++ |
Yuan Zhou |
Yuan Zhou |
| HADOOP-17184 |
Add –mvn-custom-repos parameter to yetus calls |
Major |
build |
Mingliang Liu |
Mingliang Liu |
| HDFS-15499 |
Clean up httpfs/pom.xml to remove aws-java-sdk-s3 exclusion |
Major |
httpfs |
Mingliang Liu |
Mingliang Liu |
| HADOOP-17164 |
UGI loginUserFromKeytab doesn’t set the last login time |
Major |
security |
Sandeep Guggilam |
Sandeep Guggilam |
| YARN-4575 |
ApplicationResourceUsageReport should return ALL reserved resource |
Major |
. |
Bibin Chundatt |
Bibin Chundatt |
| HADOOP-17196 |
Fix C/C++ standard warnings |
Major |
build |
Gautham Banasandra |
Gautham Banasandra |
| HADOOP-17204 |
Fix typo in Hadoop KMS document |
Trivial |
documentation, kms |
Akira Ajisaka |
Xieming Li |
| HADOOP-17209 |
Erasure Coding: Native library memory leak |
Major |
native |
Sean Chow |
Sean Chow |
| HADOOP-16925 |
MetricsConfig incorrectly loads the configuration whose value is String list in the properties file |
Major |
metrics |
Jiayi Liu |
Jiayi Liu |
| HDFS-14852 |
Removing from LowRedundancyBlocks does not remove the block from all queues |
Major |
namenode |
Hui Fei |
Hui Fei |
| HDFS-15290 |
NPE in HttpServer during NameNode startup |
Major |
namenode |
Konstantin Shvachko |
Simbarashe Dzinamarira |
| YARN-10430 |
Log improvements in NodeStatusUpdaterImpl |
Minor |
nodemanager |
Bilwa S T |
Bilwa S T |
| MAPREDUCE-7294 |
Only application master should upload resource to Yarn Shared Cache |
Major |
mrv2 |
zhenzhao wang |
zhenzhao wang |
| MAPREDUCE-7289 |
Fix wrong comment in LongLong.java |
Trivial |
documentation, examples |
Akira Ajisaka |
Wanqiang Ji |
| YARN-9809 |
NMs should supply a health status when registering with RM |
Major |
. |
Eric Badger |
Eric Badger |
| YARN-10393 |
MR job live lock caused by completed state container leak in heartbeat between node manager and RM |
Major |
nodemanager, yarn |
zhenzhao wang |
Jim Brennan |
| YARN-10455 |
TestNMProxy.testNMProxyRPCRetry is not consistent |
Major |
. |
Ahmed Hussein |
Ahmed Hussein |
| HADOOP-17223 |
update org.apache.httpcomponents:httpclient to 4.5.13 and httpcore to 4.4.13 |
Blocker |
. |
Pranav Bheda |
Pranav Bheda |
| HDFS-15628 |
HttpFS server throws NPE if a file is a symlink |
Major |
fs, httpfs |
Ahmed Hussein |
Ahmed Hussein |
| HDFS-15627 |
Audit log deletes before collecting blocks |
Major |
logging, namenode |
Ahmed Hussein |
Ahmed Hussein |
| HADOOP-17309 |
Javadoc warnings and errors are ignored in the precommit jobs |
Major |
build, documentation |
Akira Ajisaka |
Akira Ajisaka |
| HDFS-15639 |
[JDK 11] Fix Javadoc errors in hadoop-hdfs-client |
Major |
. |
Takanobu Asanuma |
Takanobu Asanuma |
| HDFS-15618 |
Improve datanode shutdown latency |
Major |
datanode |
Ahmed Hussein |
Ahmed Hussein |
| HDFS-15622 |
Deleted blocks linger in the replications queue |
Major |
hdfs |
Ahmed Hussein |
Ahmed Hussein |
| HDFS-15641 |
DataNode could meet deadlock if invoke refreshNameNode |
Critical |
. |
Hongbing Wang |
Hongbing Wang |
| HDFS-15644 |
Failed volumes can cause DNs to stop block reporting |
Major |
block placement, datanode |
Ahmed Hussein |
Ahmed Hussein |
| YARN-10467 |
ContainerIdPBImpl objects can be leaked in RMNodeImpl.completedContainers |
Major |
resourcemanager |
Haibo Chen |
Haibo Chen |
| HADOOP-17329 |
mvn site commands fails due to MetricsSystemImpl changes |
Major |
. |
Xiaoqiao He |
Xiaoqiao He |
| YARN-10472 |
Backport YARN-10314 to branch-3.2 |
Blocker |
yarn |
Siyao Meng |
Siyao Meng |
| HADOOP-17340 |
TestLdapGroupsMapping failing -string mismatch in exception validation |
Major |
test |
Steve Loughran |
Steve Loughran |
| HADOOP-17352 |
Update PATCH_NAMING_RULE in the personality file |
Minor |
build |
Akira Ajisaka |
Akira Ajisaka |
| HADOOP-17096 |
ZStandardCompressor throws java.lang.InternalError: Error (generic) |
Major |
io |
Stephen Jung (Stripe) |
Stephen Jung (Stripe) |
| HADOOP-17358 |
Improve excessive reloading of Configurations |
Major |
conf |
Ahmed Hussein |
Ahmed Hussein |
| HDFS-15538 |
Fix the documentation for dfs.namenode.replication.max-streams in hdfs-default.xml |
Major |
. |
Xieming Li |
Xieming Li |
| HADOOP-17362 |
Doing hadoop ls on Har file triggers too many RPC calls |
Major |
fs |
Ahmed Hussein |
Ahmed Hussein |
| YARN-10485 |
TimelineConnector swallows InterruptedException |
Major |
. |
Ahmed Hussein |
Ahmed Hussein |
| HADOOP-17360 |
Log the remote address for authentication success |
Minor |
ipc |
Ahmed Hussein |
Ahmed Hussein |
| YARN-10396 |
Max applications calculation per queue disregards queue level settings in absolute mode |
Major |
capacity scheduler |
Benjamin Teke |
Benjamin Teke |
| HADOOP-17346 |
Fair call queue is defeated by abusive service principals |
Major |
common, ipc |
Ahmed Hussein |
Ahmed Hussein |
| YARN-10470 |
When building new web ui with root user, the bower install should support it. |
Major |
build, yarn-ui-v2 |
zhuqi |
zhuqi |
| HADOOP-16080 |
hadoop-aws does not work with hadoop-client-api |
Major |
fs/s3 |
Keith Turner |
Chao Sun |
| HDFS-15707 |
NNTop counts don’t add up as expected |
Major |
hdfs, metrics, namenode |
Ahmed Hussein |
Ahmed Hussein |
| HDFS-15709 |
EC: Socket file descriptor leak in StripedBlockChecksumReconstructor |
Major |
datanode, ec, erasure-coding |
Yushi Hayasaka |
Yushi Hayasaka |
| HDFS-15240 |
Erasure Coding: dirty buffer causes reconstruction block error |
Blocker |
datanode, erasure-coding |
HuangTao |
HuangTao |
