HDFS-2299 |
TestOfflineEditsViewer is failing on trunk |
Major |
test |
Aaron T. Myers |
Uma Maheswara Rao G |
HDFS-2310 |
TestBackupNode fails since HADOOP-7524 went in. |
Major |
test |
Ivan Kelly |
Ivan Kelly |
HDFS-2313 |
Rat excludes has a typo for excluding editsStored files |
Major |
test |
Aaron T. Myers |
Aaron T. Myers |
MAPREDUCE-2978 |
hudson findbugs not reporting properly |
Major |
mrv2 |
Thomas Graves |
Tom White |
HDFS-46 |
The namespace quota of root directory should not be Integer.MAX_VALUE |
Major |
namenode |
Tsz Wo Nicholas Sze |
Uma Maheswara Rao G |
HDFS-2373 |
Commands using webhdfs and hftp print unnecessary debug information on the console with security enabled |
Major |
webhdfs |
Arpit Gupta |
Arpit Gupta |
HADOOP-6220 |
HttpServer wraps InterruptedExceptions by IOExceptions if interrupted in startup |
Minor |
util |
Steve Loughran |
Steve Loughran |
MAPREDUCE-3149 |
add a test to verify that buildDTAuthority works for cases with no authority. |
Major |
test |
John George |
John George |
HADOOP-7769 |
TestJMXJsonServlet is failing |
Major |
test |
Tom White |
Tom White |
HADOOP-8177 |
MBeans shouldn’t try to register when it fails to create MBeanName |
Minor |
metrics |
Devaraj K |
Devaraj K |
HDFS-3116 |
Typo in fetchdt error message |
Trivial |
hdfs-client |
Aaron T. Myers |
AOE Takashi |
HADOOP-7757 |
Test file reference count is at least 3x actual value |
Major |
build |
Jonathan Eagles |
Jonathan Eagles |
HDFS-3265 |
PowerPc Build error. |
Major |
build |
Kumar Ravi |
Kumar Ravi |
HADOOP-8339 |
jenkins complaining about 16 javadoc warnings |
Major |
build |
Thomas Graves |
Robert Joseph Evans |
HADOOP-8354 |
test-patch findbugs may fail if a dependent module is changed |
Major |
build |
Tom White |
Robert Joseph Evans |
HADOOP-8395 |
Text shell command unnecessarily demands that a SequenceFile’s key class be WritableComparable |
Trivial |
util |
Harsh J |
Harsh J |
HDFS-2312 |
FSNamesystem header comment says it’s for the DN |
Trivial |
namenode |
Aaron T. Myers |
Harsh J |
HDFS-3197 |
Incorrect class comments in a few tests |
Trivial |
test |
Aaron T. Myers |
Andy Isaacson |
HADOOP-8360 |
empty-configuration.xml fails xml validation |
Minor |
test |
Radim Kolar |
Radim Kolar |
HADOOP-8413 |
test-patch.sh gives out the wrong links for newPatchFindbugsWarnings |
Minor |
precommit |
Colin P. McCabe |
Colin P. McCabe |
HADOOP-6871 |
When the value of a configuration key is set to its unresolved form, it causes the IllegalStateException in Configuration.get() stating that substitution depth is too large. |
Major |
conf |
Arvind Prabhakar |
Arvind Prabhakar |
MAPREDUCE-3990 |
MRBench allows Long-sized input-lines value but parses CLI argument as an Integer |
Trivial |
benchmarks |
Harsh J |
Harsh J |
HDFS-3462 |
TestDFSClientRetries.busyTest() should restore default xceiver count in the config. |
Major |
test |
Konstantin Shvachko |
madhukara phatak |
HDFS-3550 |
raid added javadoc warnings |
Minor |
build |
Thomas Graves |
Jason Lowe |
HDFS-3549 |
dist tar build fails in hadoop-hdfs-raid project |
Critical |
build |
Jason Lowe |
Jason Lowe |
HADOOP-8548 |
test-patch.sh shows an incorrect link in Jekins builds |
Major |
build |
Kihwal Lee |
Kihwal Lee |
HDFS-3614 |
Revert unused MiniDFSCluster constructor from HDFS-3049 |
Blocker |
. |
Arun C Murthy |
Arun C Murthy |
HADOOP-8584 |
test-patch.sh should not immediately exit when no tests are added or modified |
Major |
. |
Colin P. McCabe |
Colin P. McCabe |
HADOOP-8818 |
Should use equals() rather than == to compare String or Text in MD5MD5CRC32FileChecksum and TFileDumper |
Minor |
fs, io |
Brandon Li |
Brandon Li |
HADOOP-8821 |
Findbugs warning Configuration.dumpDeprecatedKeys() concatenates strings using + in a loop |
Trivial |
conf |
Suresh Srinivas |
Suresh Srinivas |
HADOOP-7256 |
Resource leak during failure scenario of closing of resources. |
Minor |
util |
ramkrishna.s.vasudevan |
ramkrishna.s.vasudevan |
HADOOP-8436 |
NPE In getLocalPathForWrite ( path, conf ) when the required context item is not configured |
Major |
fs |
Brahma Reddy Battula |
Brahma Reddy Battula |
HADOOP-8840 |
Fix the test-patch colorizer to cover all sorts of +1 lines. |
Major |
build |
Harsh J |
Harsh J |
MAPREDUCE-4685 |
DBCount should not use ACCESS |
Major |
examples |
Viji |
Viji |
MAPREDUCE-3223 |
Remove MR1 configs from mapred-default.xml |
Major |
documentation, mrv2 |
Todd Lipcon |
Todd Lipcon |
HADOOP-8839 |
test-patch’s -1 on @author tag presence doesn’t cause a -1 to the overall result |
Trivial |
build |
Harsh J |
Harsh J |
MAPREDUCE-4695 |
Fix LocalRunner on trunk after MAPREDUCE-3223 broke it |
Blocker |
test |
Harsh J |
Harsh J |
HDFS-3735 |
NameNode WebUI should allow sorting live datanode list by fields Block Pool Used, Block Pool Used(%) and Failed Volumes. |
Major |
namenode |
Brahma Reddy Battula |
Brahma Reddy Battula |
HDFS-4003 |
test-patch should build the common native libs before running hdfs tests |
Major |
build |
Eli Collins |
Colin P. McCabe |
MAPREDUCE-4574 |
Fix TotalOrderParitioner to work with non-WritableComparable key types |
Trivial |
client |
Harsh J |
Harsh J |
HADOOP-8918 |
dev-support/test-patch.sh is parsing modified files wrong |
Major |
build |
Raja Aluri |
Raja Aluri |
HADOOP-8910 |
Add examples to GlobExpander#expand method |
Minor |
fs |
Suresh Srinivas |
Suresh Srinivas |
HDFS-2434 |
TestNameNodeMetrics.testCorruptBlock fails intermittently |
Major |
test |
Uma Maheswara Rao G |
Jing Zhao |
HDFS-4067 |
TestUnderReplicatedBlocks may fail due to ReplicaAlreadyExistsException |
Major |
test |
Eli Collins |
Jing Zhao |
HDFS-4115 |
TestHDFSCLI.testAll fails one test due to number format |
Minor |
test |
Trevor Robinson |
Trevor Robinson |
HADOOP-8974 |
TestDFVariations fails on Windows |
Major |
fs |
Chris Nauroth |
Chris Nauroth |
HADOOP-9037 |
Bug in test-patch.sh and precommit build process |
Critical |
build |
Kihwal Lee |
Kihwal Lee |
HADOOP-9121 |
InodeTree.java has redundant check for vName while throwing exception |
Major |
fs |
Arup Malakar |
Arup Malakar |
HDFS-4310 |
fix test org.apache.hadoop.hdfs.server.datanode.TestStartSecureDataNode |
Major |
. |
Ivan A. Veselovsky |
Ivan A. Veselovsky |
HDFS-4275 |
MiniDFSCluster-based tests fail on Windows due to failure to delete test namenode directory |
Major |
test |
Chris Nauroth |
Chris Nauroth |
HDFS-4338 |
TestNameNodeMetrics#testCorruptBlock is flaky |
Major |
namenode |
Andrew Wang |
Andrew Wang |
HADOOP-9139 |
improve script hadoop-common-project/hadoop-common/src/test/resources/kdc/killKdc.sh |
Minor |
. |
Ivan A. Veselovsky |
Ivan A. Veselovsky |
HADOOP-9202 |
test-patch.sh fails during mvn eclipse:eclipse if patch adds a new module to the build |
Major |
build |
Chris Nauroth |
Chris Nauroth |
HADOOP-9242 |
Duplicate surefire plugin config in hadoop-common |
Major |
test |
Andrey Klochkov |
Andrey Klochkov |
HADOOP-9249 |
hadoop-maven-plugins version-info goal causes build failure when running with Clover |
Major |
build |
Chris Nauroth |
Chris Nauroth |
MAPREDUCE-5012 |
Typo in javadoc for IdentityMapper class |
Trivial |
documentation |
Adam Monsen |
Adam Monsen |
HADOOP-8419 |
GzipCodec NPE upon reset with IBM JDK |
Major |
io |
Luke Lu |
Yu Li |
HDFS-4391 |
TestDataTransferKeepalive fails when tests are executed in a certain order. |
Major |
test |
Konstantin Shvachko |
Andrew Wang |
HADOOP-9393 |
TestRPC fails with JDK7 |
Major |
. |
Andrew Wang |
Andrew Wang |
HADOOP-9431 |
TestSecurityUtil#testLocalHostNameForNullOrWild on systems where hostname contains capital letters |
Trivial |
security, test |
Chris Nauroth |
Chris Nauroth |
HADOOP-9261 |
S3n filesystem can move a directory under itself -and so lose data |
Major |
fs/s3 |
Steve Loughran |
Steve Loughran |
HADOOP-9265 |
S3 blockstore filesystem breaks part of the Filesystem contract |
Major |
fs/s3 |
Steve Loughran |
Steve Loughran |
HADOOP-9433 |
TestLocalFileSystem#testHasFileDescriptor leaks file handle |
Major |
fs, test |
Chris Nauroth |
Chris Nauroth |
YARN-524 |
TestYarnVersionInfo failing if generated properties doesn’t include an SVN URL |
Minor |
api |
Steve Loughran |
Steve Loughran |
HDFS-4757 |
Update FSDirectory#inodeMap when replacing an INodeDirectory while setting quota |
Minor |
namenode |
Jing Zhao |
Jing Zhao |
HDFS-4761 |
Refresh INodeMap in FSDirectory#reset() |
Minor |
namenode |
Jing Zhao |
Jing Zhao |
HDFS-4904 |
Remove JournalService |
Major |
namenode |
Suresh Srinivas |
Arpit Agarwal |
HADOOP-9186 |
test-patch.sh should report build failure to JIRA |
Major |
. |
Binglin Chang |
Binglin Chang |
HDFS-4366 |
Block Replication Policy Implementation May Skip Higher-Priority Blocks for Lower-Priority Blocks |
Major |
. |
Derek Dagit |
Derek Dagit |
HADOOP-9583 |
test-patch gives +1 despite build failure when running tests |
Critical |
. |
Jason Lowe |
Jason Lowe |
YARN-1471 |
The SLS simulator is not running the preemption policy for CapacityScheduler |
Minor |
. |
Carlo Curino |
Carlo Curino |
HDFS-5794 |
Fix the inconsistency of layout version number of ADD_DATANODE_AND_STORAGE_UUIDS between trunk and branch-2 |
Minor |
namenode |
Jing Zhao |
Jing Zhao |
MAPREDUCE-5717 |
Task pings are interpreted as task progress |
Major |
. |
Jason Lowe |
Jason Lowe |
HADOOP-10325 |
improve jenkins javadoc warnings from test-patch.sh |
Major |
. |
Colin P. McCabe |
Colin P. McCabe |
MAPREDUCE-5912 |
Task.calculateOutputSize does not handle Windows files after MAPREDUCE-5196 |
Major |
client |
Remus Rusanu |
Remus Rusanu |
HADOOP-10831 |
UserProvider is not thread safe |
Major |
security |
Benoy Antony |
Benoy Antony |
YARN-2436 |
yarn application help doesn’t work |
Major |
scripts |
Allen Wittenauer |
Allen Wittenauer |
HADOOP-11002 |
shell escapes are incompatible with previous releases |
Major |
scripts |
Allen Wittenauer |
Allen Wittenauer |
HADOOP-10996 |
Stop violence in the *_HOME |
Major |
scripts |
Allen Wittenauer |
Allen Wittenauer |
HADOOP-11033 |
shell scripts ignore JAVA_HOME on OS X |
Major |
scripts |
Lei (Eddy) Xu |
Allen Wittenauer |
HADOOP-11052 |
hadoop_verify_secure_prereq’s results aren’t checked in bin/hdfs |
Critical |
scripts |
Allen Wittenauer |
Allen Wittenauer |
HDFS-6893 |
crypto subcommand is not sorted properly in hdfs’s hadoop_usage |
Trivial |
scripts |
Allen Wittenauer |
David Luo |
YARN-2525 |
yarn logs command gives error on trunk |
Minor |
scripts |
Prakash Ramachandran |
Akira Ajisaka |
HADOOP-11055 |
non-daemon pid files are missing |
Blocker |
scripts |
Allen Wittenauer |
Allen Wittenauer |
HADOOP-11022 |
User replaced functions get lost 2-3 levels deep (e.g., sbin) |
Critical |
scripts |
Allen Wittenauer |
Allen Wittenauer |
MAPREDUCE-5875 |
Make Counter limits consistent across JobClient, MRAppMaster, and YarnChild |
Major |
applicationmaster, client, task |
Gera Shegalov |
Gera Shegalov |
HDFS-7204 |
balancer doesn’t run as a daemon |
Blocker |
scripts |
Allen Wittenauer |
Allen Wittenauer |
HADOOP-11240 |
Jenkins build seems to be broken by changes in test-patch.sh |
Blocker |
. |
Zhijie Shen |
Steve Loughran |
HDFS-7213 |
processIncrementalBlockReport performance degradation |
Critical |
namenode |
Daryn Sharp |
Eric Payne |
HDFS-7235 |
DataNode#transferBlock should report blocks that don’t exist using reportBadBlock |
Major |
datanode, namenode |
Yongjun Zhang |
Yongjun Zhang |
HDFS-7263 |
Snapshot read can reveal future bytes for appended files. |
Major |
hdfs-client |
Konstantin Shvachko |
Tao Luo |
HDFS-7319 |
Remove dead link to HFTP documentation from index.xml |
Minor |
documentation |
Masatake Iwasaki |
Masatake Iwasaki |
HADOOP-11267 |
TestSecurityUtil fails when run with JDK8 because of empty principal names |
Minor |
security, test |
Stephen Chu |
Stephen Chu |
HADOOP-10786 |
Fix UGI#reloginFromKeytab on Java 8 |
Major |
security |
Tobi Vollebregt |
Stephen Chu |
HADOOP-11284 |
Fix variable name mismatches in hadoop-functions.sh |
Minor |
scripts |
Masatake Iwasaki |
Masatake Iwasaki |
HADOOP-11298 |
slaves.sh and stop-all.sh are missing slashes |
Trivial |
scripts |
Allen Wittenauer |
Allen Wittenauer |
YARN-2856 |
Application recovery throw InvalidStateTransitonException: Invalid event: ATTEMPT_KILLED at ACCEPTED |
Critical |
resourcemanager |
Rohith Sharma K S |
Rohith Sharma K S |
MAPREDUCE-6161 |
mapred hsadmin command missing from trunk |
Major |
scripts |
Jason Lowe |
Allen Wittenauer |
YARN-2816 |
NM fail to start with NPE during container recovery |
Major |
nodemanager |
zhihai xu |
zhihai xu |
YARN-2414 |
RM web UI: app page will crash if app is failed before any attempt has been created |
Major |
webapp |
Zhijie Shen |
Wangda Tan |
HDFS-7225 |
Remove stale block invalidation work when DN re-registers with different UUID |
Major |
namenode |
Zhe Zhang |
Zhe Zhang |
HDFS-7407 |
Minor typo in privileged pid/out/log names |
Minor |
. |
Allen Wittenauer |
Allen Wittenauer |
YARN-2865 |
Application recovery continuously fails with “Application with id already present. Cannot duplicate” |
Critical |
resourcemanager |
Rohith Sharma K S |
Rohith Sharma K S |
HDFS-7425 |
NameNode block deletion logging uses incorrect appender. |
Minor |
namenode |
Chris Nauroth |
Chris Nauroth |
HDFS-4882 |
Prevent the Namenode’s LeaseManager from looping forever in checkLeases |
Critical |
hdfs-client, namenode |
Zesheng Wu |
Ravi Prakash |
YARN-2906 |
CapacitySchedulerPage shows HTML tags for a queue’s Active Users |
Major |
capacityscheduler |
Jason Lowe |
Jason Lowe |
HADOOP-11333 |
Fix deadlock in DomainSocketWatcher when the notification pipe is full |
Major |
. |
yunjiong zhao |
yunjiong zhao |
YARN-2905 |
AggregatedLogsBlock page can infinitely loop if the aggregated log file is corrupted |
Blocker |
. |
Jason Lowe |
Varun Saxena |
YARN-2894 |
When ACL’s are enabled, if RM switches then application can not be viewed from web. |
Major |
resourcemanager |
Rohith Sharma K S |
Rohith Sharma K S |
HADOOP-11296 |
hadoop-daemons.sh throws ‘host1: bash: host3: command not found…’ |
Major |
scripts |
Vinayakumar B |
Vinayakumar B |
YARN-2874 |
Dead lock in “DelegationTokenRenewer” which blocks RM to execute any further apps |
Blocker |
resourcemanager |
Naganarasimha G R |
Naganarasimha G R |
HADOOP-11343 |
Overflow is not properly handled in caclulating final iv for AES CTR |
Blocker |
security |
Jerry Chen |
Jerry Chen |
HADOOP-10134 |
[JDK8] Fix Javadoc errors caused by incorrect or illegal tags in doc comments |
Minor |
. |
Andrew Purtell |
Andrew Purtell |
HADOOP-11368 |
Fix SSLFactory truststore reloader thread leak in KMSClientProvider |
Major |
kms |
Arun Suresh |
Arun Suresh |
HDFS-7489 |
Incorrect locking in FsVolumeList#checkDirs can hang datanodes |
Critical |
datanode |
Noah Lorang |
Noah Lorang |
YARN-2910 |
FSLeafQueue can throw ConcurrentModificationException |
Major |
fairscheduler |
Wilfred Spiegelenburg |
Wilfred Spiegelenburg |
HDFS-7503 |
Namenode restart after large deletions can cause slow processReport (due to logging) |
Major |
namenode |
Arpit Agarwal |
Arpit Agarwal |
YARN-2917 |
Potential deadlock in AsyncDispatcher when system.exit called in AsyncDispatcher#dispatch and AsyscDispatcher#serviceStop from shutdown hook |
Critical |
resourcemanager |
Rohith Sharma K S |
Rohith Sharma K S |
HADOOP-11238 |
Update the NameNode’s Group Cache in the background when possible |
Minor |
. |
Chris Li |
Chris Li |
HADOOP-11380 |
Restore Rack Awareness documentation |
Major |
. |
Allen Wittenauer |
Allen Wittenauer |
MAPREDUCE-6166 |
Reducers do not validate checksum of map outputs when fetching directly to disk |
Major |
mrv2 |
Eric Payne |
Eric Payne |
HADOOP-11397 |
Can’t override HADOOP_IDENT_STRING |
Trivial |
. |
Allen Wittenauer |
Kengo Seki |
YARN-2964 |
RM prematurely cancels tokens for jobs that submit jobs (oozie) |
Blocker |
resourcemanager |
Daryn Sharp |
Jian He |
HDFS-7552 |
change FsVolumeList toString() to fix TestDataNodeVolumeFailureToleration |
Major |
datanode, test |
Liang Xie |
Liang Xie |
HDFS-7443 |
Datanode upgrade to BLOCKID_BASED_LAYOUT fails if duplicate block files are present in the same volume |
Blocker |
. |
Kihwal Lee |
Colin P. McCabe |
YARN-2952 |
Incorrect version check in RMStateStore |
Major |
. |
Jian He |
Rohith Sharma K S |
YARN-2975 |
FSLeafQueue app lists are accessed without required locks |
Blocker |
. |
Karthik Kambatla |
Karthik Kambatla |
YARN-2340 |
NPE thrown when RM restart after queue is STOPPED. There after RM can not recovery application’s and remain in standby |
Critical |
resourcemanager, scheduler |
Nishan Shetty |
Rohith Sharma K S |
YARN-2992 |
ZKRMStateStore crashes due to session expiry |
Blocker |
resourcemanager |
Karthik Kambatla |
Karthik Kambatla |
YARN-2922 |
ConcurrentModificationException in CapacityScheduler’s LeafQueue |
Major |
capacityscheduler, resourcemanager, scheduler |
Jason Tufo |
Rohith Sharma K S |
HADOOP-10908 |
Common needs updates for shell rewrite |
Major |
documentation |
Allen Wittenauer |
Allen Wittenauer |
YARN-2978 |
ResourceManager crashes with NPE while getting queue info |
Critical |
. |
Jason Tufo |
Varun Saxena |
YARN-2997 |
NM keeps sending already-sent completed containers to RM until containers are removed from context |
Major |
nodemanager |
Chengbing Liu |
Chengbing Liu |
YARN-3002 |
YARN documentation needs updating post-shell rewrite |
Major |
documentation |
Allen Wittenauer |
Allen Wittenauer |
HDFS-7596 |
NameNode should prune dead storages from storageMap |
Major |
namenode |
Arpit Agarwal |
Arpit Agarwal |
HDFS-7533 |
Datanode sometimes does not shutdown on receiving upgrade shutdown command |
Major |
. |
Kihwal Lee |
Eric Payne |
HADOOP-11473 |
test-patch says “-1 overall” even when all checks are +1 |
Major |
build |
Jason Lowe |
Jason Lowe |
HDFS-7470 |
SecondaryNameNode need twice memory when calling reloadFromImageFile |
Major |
namenode |
yunjiong zhao |
yunjiong zhao |
YARN-2637 |
maximum-am-resource-percent could be respected for both LeafQueue/User when trying to activate applications. |
Critical |
resourcemanager |
Wangda Tan |
Craig Welch |
HDFS-7581 |
HDFS documentation needs updating post-shell rewrite |
Major |
documentation |
Allen Wittenauer |
Allen Wittenauer |
HADOOP-11350 |
The size of header buffer of HttpServer is too small when HTTPS is enabled |
Major |
security |
Benoy Antony |
Benoy Antony |
HDFS-7610 |
Fix removal of dynamically added DN volumes |
Major |
datanode |
Lei (Eddy) Xu |
Lei (Eddy) Xu |
HADOOP-11484 |
hadoop-mapreduce-client-nativetask fails to build on ARM AARCH64 due to x86 asm statements |
Minor |
native |
Edward Nevill |
Edward Nevill |
HDFS-3443 |
Fix NPE when namenode transition to active during startup by adding checkNNStartup() in NameNodeRpcServer |
Major |
auto-failover, ha |
suja s |
Vinayakumar B |
HDFS-7575 |
Upgrade should generate a unique storage ID for each volume |
Critical |
. |
Lars Francke |
Arpit Agarwal |
HADOOP-11482 |
Use correct UGI when KMSClientProvider is called by a proxy user |
Major |
. |
Arun Suresh |
Arun Suresh |
HDFS-7667 |
Various typos and improvements to HDFS Federation doc |
Minor |
documentation |
Charles Lamb |
Charles Lamb |
HDFS-3750 |
API docs don’t include HDFS |
Critical |
documentation |
Eli Collins |
Jolly Chen |
HDFS-7320 |
The appearance of hadoop-hdfs-httpfs site docs is inconsistent |
Minor |
documentation |
Masatake Iwasaki |
Masatake Iwasaki |
YARN-3024 |
LocalizerRunner should give DIE action when all resources are localized |
Major |
nodemanager |
Chengbing Liu |
Chengbing Liu |
HADOOP-11316 |
“mvn package -Pdist,docs -DskipTests -Dtar” fails because of non-ascii characters |
Blocker |
. |
Tsuyoshi Ozawa |
Tsuyoshi Ozawa |
YARN-3103 |
AMRMClientImpl does not update AMRM token properly |
Blocker |
client |
Jason Lowe |
Jason Lowe |
MAPREDUCE-6230 |
MR AM does not survive RM restart if RM activated a new AMRM secret key |
Blocker |
mr-am |
Jason Lowe |
Jason Lowe |
HDFS-7707 |
Edit log corruption due to delayed block removal again |
Major |
namenode |
Yongjun Zhang |
Yongjun Zhang |
HDFS-7733 |
NFS: readdir/readdirplus return null directory attribute on failure |
Major |
nfs |
Arpit Agarwal |
Arpit Agarwal |
MAPREDUCE-6237 |
Multiple mappers with DBInputFormat don’t work because of reusing conections |
Major |
mrv2 |
Kannan Rajah |
Kannan Rajah |
HDFS-7670 |
HDFS Quota guide has typos, incomplete command lines |
Major |
documentation |
Allen Wittenauer |
Brahma Reddy Battula |
HDFS-7669 |
HDFS Design Doc references commands that no longer exist. |
Major |
documentation |
Allen Wittenauer |
Brahma Reddy Battula |
HDFS-7755 |
httpfs shell code has hardcoded path to bash |
Major |
scripts |
Dmitry Sivachenko |
Dmitry Sivachenko |
YARN-3094 |
reset timer for liveness monitors after RM recovery |
Major |
resourcemanager |
Jun Gong |
Jun Gong |
MAPREDUCE-4413 |
MR lib dir contains jdiff (which is gpl) |
Critical |
build |
Eli Collins |
Nemon Lou |
HDFS-7714 |
Simultaneous restart of HA NameNodes and DataNode can cause DataNode to register successfully with only one NameNode. |
Major |
datanode |
Chris Nauroth |
Vinayakumar B |
YARN-2246 |
Job History Link in RM UI is redirecting to the URL which contains Job Id twice |
Major |
webapp |
Devaraj K |
Devaraj K |
HADOOP-11559 |
Add links to RackAwareness and InterfaceClassification to site index |
Minor |
documentation |
Masatake Iwasaki |
Masatake Iwasaki |
HADOOP-11581 |
Fix Multithreaded correctness Warnings #org.apache.hadoop.fs.shell.Ls |
Major |
. |
Brahma Reddy Battula |
Brahma Reddy Battula |
HADOOP-11580 |
Remove SingleNodeSetup.md from trunk |
Major |
documentation |
Allen Wittenauer |
Akira Ajisaka |
HADOOP-11583 |
Fix syntax error in SecureMode.md |
Trivial |
documentation |
Masatake Iwasaki |
Masatake Iwasaki |
HADOOP-11437 |
Remove the version and author information from distcp’s README file |
Major |
documentation |
Allen Wittenauer |
Brahma Reddy Battula |
HADOOP-11585 |
Fix formatting in Tracing.md |
Trivial |
documentation |
Masatake Iwasaki |
Masatake Iwasaki |
HDFS-7711 |
Fix various typos in ClusterSetup.md |
Major |
documentation |
Brahma Reddy Battula |
Brahma Reddy Battula |
HDFS-7791 |
dfs count -v should be added to quota documentation |
Major |
documentation |
Allen Wittenauer |
Akira Ajisaka |
HDFS-7803 |
Wrong command mentioned in HDFSHighAvailabilityWithQJM documentation |
Minor |
documentation |
Mohammad Arshad |
Mohammad Arshad |
MAPREDUCE-6234 |
TestHighRamJob fails due to the change in MAPREDUCE-5785 |
Major |
contrib/gridmix, mrv2 |
Masatake Iwasaki |
Masatake Iwasaki |
HADOOP-11295 |
RPC Server Reader thread can’t shutdown if RPCCallQueue is full |
Major |
. |
Ming Ma |
Ming Ma |
HDFS-7788 |
Post-2.6 namenode may not start up with an image containing inodes created with an old release. |
Blocker |
. |
Kihwal Lee |
Rushabh S Shah |
YARN-3194 |
RM should handle NMContainerStatuses sent by NM while registering if NM is Reconnected node |
Blocker |
resourcemanager |
Rohith Sharma K S |
Rohith Sharma K S |
HADOOP-11604 |
Prevent ConcurrentModificationException while closing domain sockets during shutdown of DomainSocketWatcher thread. |
Critical |
net |
Liang Xie |
Chris Nauroth |
YARN-3238 |
Connection timeouts to nodemanagers are retried at multiple levels |
Blocker |
. |
Jason Lowe |
Jason Lowe |
YARN-3207 |
secondary filter matches entites which do not have the key being filtered for. |
Major |
timelineserver |
Prakash Ramachandran |
Zhijie Shen |
HDFS-7009 |
Active NN and standby NN have different live nodes |
Major |
datanode |
Ming Ma |
Ming Ma |
HADOOP-11625 |
Minor fixes to command manual & SLA doc |
Major |
documentation |
Allen Wittenauer |
Allen Wittenauer |
HDFS-7763 |
fix zkfc hung issue due to not catching exception in a corner case |
Major |
ha |
Liang Xie |
Liang Xie |
YARN-3239 |
WebAppProxy does not support a final tracking url which has query fragments and params |
Major |
. |
Hitesh Shah |
Jian He |
HADOOP-11637 |
bash location hard-coded in shell scripts |
Major |
scripts |
Allen Wittenauer |
Allen Wittenauer |
MAPREDUCE-6223 |
TestJobConf#testNegativeValueForTaskVmem failures |
Major |
test |
Gera Shegalov |
Varun Saxena |
HADOOP-10774 |
Update KerberosTestUtils for hadoop-auth tests when using IBM Java |
Major |
security |
sangamesh |
sangamesh |
HDFS-4681 |
TestBlocksWithNotEnoughRacks#testCorruptBlockRereplicatedAcrossRacks fails using IBM java |
Major |
test |
Tian Hong Wang |
Ayappan |
HDFS-7871 |
NameNodeEditLogRoller can keep printing “Swallowing exception” message |
Critical |
. |
Jing Zhao |
Jing Zhao |
YARN-3222 |
RMNodeImpl#ReconnectNodeTransition should send scheduler events in sequential order |
Critical |
resourcemanager |
Rohith Sharma K S |
Rohith Sharma K S |
YARN-3231 |
FairScheduler: Changing queueMaxRunningApps interferes with pending jobs |
Critical |
. |
Siqi Li |
Siqi Li |
YARN-3242 |
Asynchrony in ZK-close can lead to ZKRMStateStore watcher receiving events for old client |
Critical |
resourcemanager |
zhihai xu |
zhihai xu |
HADOOP-11674 |
oneByteBuf in CryptoInputStream and CryptoOutputStream should be non static |
Critical |
io |
Sean Busbey |
Sean Busbey |
HDFS-7885 |
Datanode should not trust the generation stamp provided by client |
Critical |
datanode |
vitthal (Suhas) Gogate |
Tsz Wo Nicholas Sze |
YARN-3227 |
Timeline renew delegation token fails when RM user’s TGT is expired |
Critical |
. |
Jonathan Eagles |
Zhijie Shen |
HADOOP-11653 |
shellprofiles should require .sh extension |
Major |
scripts |
Allen Wittenauer |
Brahma Reddy Battula |
YARN-3287 |
TimelineClient kerberos authentication failure uses wrong login context. |
Major |
. |
Jonathan Eagles |
Daryn Sharp |
HADOOP-11668 |
hadoop-daemons.sh bw compat broke with –slaves change |
Major |
scripts |
Vinayakumar B |
Vinayakumar B |
HDFS-7830 |
DataNode does not release the volume lock when adding a volume fails. |
Major |
datanode |
Lei (Eddy) Xu |
Lei (Eddy) Xu |
HADOOP-11703 |
git should ignore .DS_Store files on Mac OS X |
Major |
. |
Abin Shahab |
Abin Shahab |
HADOOP-10027 |
*Compressor_deflateBytesDirect passes instance instead of jclass to GetStaticObjectField |
Minor |
native |
Eric Abbott |
Hui Zheng |
YARN-3267 |
Timelineserver applies the ACL rules after applying the limit on the number of records |
Major |
. |
Prakash Ramachandran |
Chang Li |
HDFS-7915 |
The DataNode can sometimes allocate a ShortCircuitShm slot and fail to tell the DFSClient about it because of a network error |
Major |
. |
Colin P. McCabe |
Colin P. McCabe |
HDFS-5356 |
MiniDFSCluster shoud close all open FileSystems when shutdown() |
Critical |
test |
haosdent |
Rakesh R |
YARN-3197 |
Confusing log generated by CapacityScheduler |
Minor |
capacityscheduler |
Hitesh Shah |
Varun Saxena |
YARN-3243 |
CapacityScheduler should pass headroom from parent to children to make sure ParentQueue obey its capacity limits. |
Major |
capacityscheduler, resourcemanager |
Wangda Tan |
Wangda Tan |
YARN-3305 |
AM-Used Resource for leafqueue is wrongly populated if AM ResourceRequest is less than minimumAllocation |
Major |
scheduler |
Rohith Sharma K S |
Rohith Sharma K S |
YARN-3205 |
FileSystemRMStateStore should disable FileSystem Cache to avoid get a Filesystem with an old configuration. |
Major |
resourcemanager |
zhihai xu |
zhihai xu |
MAPREDUCE-5807 |
Print usage for TeraSort job. |
Trivial |
examples |
Rohith Sharma K S |
Rohith Sharma K S |
YARN-3351 |
AppMaster tracking URL is broken in HA |
Major |
webapp |
Anubhav Dhoot |
Anubhav Dhoot |
HDFS-7929 |
inotify unable fetch pre-upgrade edit log segments once upgrade starts |
Major |
. |
Zhe Zhang |
Zhe Zhang |
HDFS-7587 |
Edit log corruption can happen if append fails with a quota violation |
Blocker |
namenode |
Kihwal Lee |
Jing Zhao |
HDFS-7867 |
Update action param from “start” to “prepare” in rolling upgrade javadoc |
Trivial |
. |
J.Andreina |
J.Andreina |
MAPREDUCE-6281 |
Fix javadoc in Terasort |
Trivial |
. |
Albert Chu |
Albert Chu |
HDFS-7930 |
commitBlockSynchronization() does not remove locations |
Blocker |
namenode |
Konstantin Shvachko |
Yi Liu |
YARN-3369 |
Missing NullPointer check in AppSchedulingInfo causes RM to die |
Blocker |
resourcemanager |
Giovanni Matteo Fumarola |
Brahma Reddy Battula |
YARN-3269 |
Yarn.nodemanager.remote-app-log-dir could not be configured to fully qualified path |
Major |
. |
Xuan Gong |
Xuan Gong |
MAPREDUCE-6213 |
NullPointerException caused by job history server addr not resolvable |
Minor |
applicationmaster |
Peng Zhang |
Peng Zhang |
MAPREDUCE-5448 |
MapFileOutputFormat#getReaders bug with invisible files/folders |
Minor |
mrv2 |
Maysam Yabandeh |
Maysam Yabandeh |
MAPREDUCE-6242 |
Progress report log is incredibly excessive in application master |
Major |
applicationmaster |
Jian Fang |
Varun Saxena |
YARN-3393 |
Getting application(s) goes wrong when app finishes before starting the attempt |
Critical |
timelineserver |
Zhijie Shen |
Zhijie Shen |
HDFS-7884 |
NullPointerException in BlockSender |
Blocker |
datanode |
Tsz Wo Nicholas Sze |
Brahma Reddy Battula |
HDFS-7960 |
The full block report should prune zombie storages even if they’re not empty |
Critical |
. |
Lei (Eddy) Xu |
Colin P. McCabe |
HDFS-3325 |
When configuring “dfs.namenode.safemode.threshold-pct” to a value greater or equal to 1 there is mismatch in the UI report |
Minor |
. |
J.Andreina |
J.Andreina |
YARN-3383 |
AdminService should use “warn” instead of “info” to log exception when operation fails |
Major |
resourcemanager |
Wangda Tan |
Li Lu |
YARN-3397 |
yarn rmadmin should skip -failover |
Minor |
resourcemanager |
J.Andreina |
J.Andreina |
HADOOP-11724 |
DistCp throws NPE when the target directory is root. |
Minor |
. |
Lei (Eddy) Xu |
Lei (Eddy) Xu |
YARN-3400 |
[JDK 8] Build Failure due to unreported exceptions in RPCUtil |
Major |
. |
Robert Kanter |
Robert Kanter |
HDFS-7804 |
haadmin command usage #HDFSHighAvailabilityWithQJM.html |
Major |
documentation |
Brahma Reddy Battula |
Brahma Reddy Battula |
HDFS-7990 |
IBR delete ack should not be delayed |
Major |
namenode |
Daryn Sharp |
Daryn Sharp |
HADOOP-11760 |
Fix typo of javadoc in DistCp |
Trivial |
. |
Chen He |
Brahma Reddy Battula |
MAPREDUCE-6294 |
Remove an extra parameter described in Javadoc of TockenCache |
Trivial |
. |
Chen He |
Brahma Reddy Battula |
HDFS-7501 |
TransactionsSinceLastCheckpoint can be negative on SBNs |
Major |
namenode |
Harsh J |
Gautam Gopalakrishnan |
HDFS-7742 |
favoring decommissioning node for replication can cause a block to stay underreplicated for long periods |
Major |
namenode |
Nathan Roberts |
Nathan Roberts |
HDFS-8002 |
Website refers to /trash directory |
Major |
documentation |
Mike Drob |
Brahma Reddy Battula |
HDFS-7261 |
storageMap is accessed without synchronization in DatanodeDescriptor#updateHeartbeatState() |
Major |
. |
Ted Yu |
Brahma Reddy Battula |
HDFS-7997 |
The first non-existing xattr should also throw IOException |
Minor |
. |
zhouyingchao |
zhouyingchao |
HDFS-6945 |
BlockManager should remove a block from excessReplicateMap and decrement ExcessBlocks metric when the block is removed |
Critical |
namenode |
Akira Ajisaka |
Akira Ajisaka |
YARN-3425 |
NPE from RMNodeLabelsManager.serviceStop when NodeLabelsManager.serviceInit failed |
Minor |
resourcemanager |
Bibin A Chundatt |
Bibin A Chundatt |
HDFS-7922 |
ShortCircuitCache#close is not releasing ScheduledThreadPoolExecutors |
Major |
. |
Rakesh R |
Rakesh R |
HDFS-8026 |
Trace FSOutputSummer#writeChecksumChunks rather than DFSOutputStream#writeChunk |
Minor |
. |
Colin P. McCabe |
Colin P. McCabe |
MAPREDUCE-6303 |
Read timeout when retrying a fetch error can be fatal to a reducer |
Blocker |
. |
Jason Lowe |
Jason Lowe |
YARN-3415 |
Non-AM containers can be counted towards amResourceUsage of a Fair Scheduler queue |
Critical |
fairscheduler |
Rohit Agarwal |
zhihai xu |
HADOOP-11797 |
releasedocmaker.py needs to put ASF headers on output |
Major |
build |
Allen Wittenauer |
Allen Wittenauer |
HADOOP-11800 |
Clean up some test methods in TestCodec.java |
Major |
test |
Akira Ajisaka |
Brahma Reddy Battula |
MAPREDUCE-4844 |
Counters / AbstractCounters have constant references not declared final |
Major |
. |
Gera Shegalov |
Brahma Reddy Battula |
YARN-3435 |
AM container to be allocated Appattempt AM container shown as null |
Trivial |
resourcemanager |
Bibin A Chundatt |
Bibin A Chundatt |
HDFS-7999 |
FsDatasetImpl#createTemporary sometimes holds the FSDatasetImpl lock for a very long time |
Major |
. |
zhouyingchao |
zhouyingchao |
YARN-3429 |
TestAMRMTokens.testTokenExpiry fails Intermittently with error message:Invalid AMRMToken |
Major |
test |
zhihai xu |
zhihai xu |
HDFS-5215 |
dfs.datanode.du.reserved is not considered while computing available space |
Major |
datanode |
Brahma Reddy Battula |
Brahma Reddy Battula |
YARN-3457 |
NPE when NodeManager.serviceInit fails and stopRecoveryStore called |
Minor |
nodemanager |
Bibin A Chundatt |
Bibin A Chundatt |
YARN-3459 |
Fix failiure of TestLog4jWarningErrorMetricsAppender |
Blocker |
. |
Li Lu |
Varun Vasudev |
HDFS-8072 |
Reserved RBW space is not released if client terminates while writing block |
Major |
datanode |
Arpit Agarwal |
Arpit Agarwal |
HDFS-8046 |
Allow better control of getContentSummary |
Major |
. |
Kihwal Lee |
Kihwal Lee |
YARN-2890 |
MiniYarnCluster should turn on timeline service if configured to do so |
Major |
. |
Mit Desai |
Mit Desai |
HDFS-7725 |
Incorrect “nodes in service” metrics caused all writes to fail |
Major |
. |
Ming Ma |
Ming Ma |
HDFS-8096 |
DatanodeMetrics#blocksReplicated will get incremented early and even for failed transfers |
Major |
datanode |
Vinayakumar B |
Vinayakumar B |
YARN-3465 |
Use LinkedHashMap to preserve order of resource requests |
Major |
nodemanager |
zhihai xu |
zhihai xu |
HDFS-8099 |
Change “DFSInputStream has been closed already” message to debug log level |
Minor |
hdfs-client |
Charles Lamb |
Charles Lamb |
YARN-3055 |
The token is not renewed properly if it’s shared by jobs (oozie) in DelegationTokenRenewer |
Blocker |
security |
Yi Liu |
Daryn Sharp |
HDFS-8091 |
ACLStatus and XAttributes not properly presented to INodeAttributesProvider before returning to client |
Major |
namenode |
Arun Suresh |
Arun Suresh |
MAPREDUCE-6266 |
Job#getTrackingURL should consistently return a proper URL |
Minor |
. |
Ray Chiang |
Ray Chiang |
HDFS-8081 |
Split getAdditionalBlock() into two methods. |
Major |
. |
Konstantin Shvachko |
Konstantin Shvachko |
HDFS-7939 |
Two fsimage_rollback_* files are created which are not deleted after rollback. |
Critical |
. |
J.Andreina |
J.Andreina |
MAPREDUCE-6314 |
TestPipeApplication fails on trunk |
Major |
test |
Varun Vasudev |
Varun Vasudev |
YARN-3466 |
Fix RM nodes web page to sort by node HTTP-address, #containers and node-label column |
Major |
resourcemanager, webapp |
Jason Lowe |
Jason Lowe |
HDFS-7931 |
DistributedFIleSystem should not look for keyProvider in cache if Encryption is disabled |
Minor |
hdfs-client |
Arun Suresh |
Arun Suresh |
HDFS-8111 |
NPE thrown when invalid FSImage filename given for “hdfs oiv_legacy” cmd |
Minor |
tools |
Archana T |
Surendra Singh Lilhore |
HADOOP-11811 |
Fix typos in hadoop-project/pom.xml and TestAccessControlList |
Minor |
. |
Chen He |
Brahma Reddy Battula |
YARN-3382 |
Some of UserMetricsInfo metrics are incorrectly set to root queue metrics |
Major |
webapp |
Rohit Agarwal |
Rohit Agarwal |
YARN-3472 |
Possible leak in DelegationTokenRenewer#allTokens |
Major |
. |
Jian He |
Rohith Sharma K S |
YARN-3394 |
WebApplication proxy documentation is incomplete |
Minor |
resourcemanager |
Bibin A Chundatt |
Naganarasimha G R |
HADOOP-11819 |
HttpServerFunctionalTest#prepareTestWebapp should create web app directory if it does not exist. |
Minor |
. |
Rohith Sharma K S |
Rohith Sharma K S |
HDFS-6666 |
Abort NameNode and DataNode startup if security is enabled but block access token is not enabled. |
Minor |
datanode, namenode, security |
Chris Nauroth |
Vijay Bhat |
HDFS-8055 |
NullPointerException when topology script is missing. |
Major |
namenode |
Anu Engineer |
Anu Engineer |
YARN-3266 |
RMContext inactiveNodes should have NodeId as map key |
Major |
resourcemanager |
Chengbing Liu |
Chengbing Liu |
YARN-3436 |
Fix URIs in documention of YARN web service REST APIs |
Minor |
documentation, resourcemanager |
Bibin A Chundatt |
Bibin A Chundatt |
HDFS-8127 |
NameNode Failover during HA upgrade can cause DataNode to finalize upgrade |
Blocker |
ha |
Jing Zhao |
Jing Zhao |
HDFS-8151 |
Always use snapshot path as source when invalid snapshot names are used for diff based distcp |
Minor |
distcp |
Sushmitha Sreenivasan |
Jing Zhao |
HDFS-7934 |
Update RollingUpgrade rollback documentation: should use bootstrapstandby for standby NN |
Critical |
documentation |
J.Andreina |
J.Andreina |
HDFS-8149 |
The footer of the Web UI “Hadoop, 2014” is old |
Major |
. |
Akira Ajisaka |
Brahma Reddy Battula |
HDFS-8142 |
DistributedFileSystem encryption zone commands should resolve relative paths |
Major |
. |
Rakesh R |
Rakesh R |
MAPREDUCE-6300 |
Task list sort by task id broken |
Minor |
. |
Siqi Li |
Siqi Li |
YARN-3021 |
YARN’s delegation-token handling disallows certain trust setups to operate properly over DistCp |
Major |
security |
Harsh J |
Yongjun Zhang |
HDFS-8153 |
Error Message points to wrong parent directory in case of path component name length error |
Major |
namenode |
Anu Engineer |
Anu Engineer |
YARN-3493 |
RM fails to come up with error “Failed to load/recover state” when mem settings are changed |
Critical |
yarn |
Sumana Sathish |
Jian He |
HDFS-8043 |
NPE in MiniDFSCluster teardown |
Major |
test |
Steve Loughran |
Brahma Reddy Battula |
HDFS-8173 |
NPE thrown at DataNode shutdown when HTTP server was not able to create |
Minor |
datanode |
Archana T |
Surendra Singh Lilhore |
YARN-3497 |
ContainerManagementProtocolProxy modifies IPC timeout conf without making a copy |
Major |
client |
Jason Lowe |
Jason Lowe |
MAPREDUCE-6238 |
MR2 can’t run local jobs with -libjars command options which is a regression from MR1 |
Critical |
mrv2 |
zhihai xu |
zhihai xu |
HDFS-8179 |
DFSClient#getServerDefaults returns null within 1 hour of system start |
Blocker |
. |
Xiaoyu Yao |
Xiaoyu Yao |
HDFS-7993 |
Provide each Replica details in fsck |
Major |
. |
Ming Ma |
J.Andreina |
HDFS-8163 |
Using monotonicNow for block report scheduling causes test failures on recently restarted systems |
Blocker |
datanode |
Arpit Agarwal |
Arpit Agarwal |
HADOOP-11704 |
DelegationTokenAuthenticationFilter must pass ipaddress instead of hostname to ProxyUsers#authorize() |
Major |
. |
Anubhav Dhoot |
Anubhav Dhoot |
YARN-3495 |
Confusing log generated by FairScheduler |
Major |
. |
Brahma Reddy Battula |
Brahma Reddy Battula |
MAPREDUCE-6293 |
Set job classloader on uber-job’s LocalContainerLauncher event thread |
Major |
mr-am |
Sangjin Lee |
Sangjin Lee |
HADOOP-11846 |
TestCertificateUtil.testCorruptPEM failing on Jenkins JDK8 |
Major |
build, security |
Steve Loughran |
Larry McCay |
HADOOP-11859 |
PseudoAuthenticationHandler fails with httpcomponents v4.4 |
Major |
. |
Eugene Koifman |
Eugene Koifman |
MAPREDUCE-6330 |
Fix typo in Task Attempt API’s URL in documentations |
Minor |
documentation |
Ryu Kobayashi |
Ryu Kobayashi |
HADOOP-11848 |
Incorrect arguments to sizeof in DomainSocket.c |
Major |
native |
Malcolm Kavalsky |
Malcolm Kavalsky |
HADOOP-11868 |
Invalid user logins trigger large backtraces in server log |
Major |
. |
Chang Li |
Chang Li |
HADOOP-11861 |
test-patch.sh rewrite addendum patch |
Major |
build |
Anu Engineer |
Allen Wittenauer |
HADOOP-11864 |
JWTRedirectAuthenticationHandler breaks java8 javadocs |
Major |
build |
Steve Loughran |
Larry McCay |
HDFS-4448 |
Allow HA NN to start in secure mode with wildcard address configured |
Major |
ha, namenode, security |
Aaron T. Myers |
Aaron T. Myers |
YARN-3522 |
DistributedShell uses the wrong user to put timeline data |
Blocker |
timelineserver |
Zhijie Shen |
Zhijie Shen |
HDFS-8147 |
Mover should not schedule two replicas to the same DN storage |
Major |
balancer & mover |
Surendra Singh Lilhore |
Surendra Singh Lilhore |
HADOOP-11730 |
Regression: s3n read failure recovery broken |
Major |
fs/s3 |
Takenori Sato |
Takenori Sato |
YARN-3516 |
killing ContainerLocalizer action doesn’t take effect when private localizer receives FETCH_FAILURE status. |
Minor |
nodemanager |
zhihai xu |
zhihai xu |
HADOOP-11802 |
DomainSocketWatcher thread terminates sometimes after there is an I/O error during requestShortCircuitShm |
Major |
. |
Eric Payne |
Colin P. McCabe |
HDFS-8070 |
Pre-HDFS-7915 DFSClient cannot use short circuit on post-HDFS-7915 DataNode |
Blocker |
caching |
Gopal V |
Colin P. McCabe |
HDFS-8217 |
During block recovery for truncate Log new Block Id in case of copy-on-truncate is true. |
Major |
datanode |
Vinayakumar B |
Vinayakumar B |
HDFS-8231 |
StackTrace displayed at client while QuotaByStorageType exceeds |
Major |
hdfs-client |
J.Andreina |
J.Andreina |
HDFS-8110 |
Remove unsupported ‘hdfs namenode -rollingUpgrade downgrade’ from document |
Minor |
documentation |
J.Andreina |
J.Andreina |
HDFS-8191 |
Fix byte to integer casting in SimulatedFSDataset#simulatedByte |
Minor |
. |
Zhe Zhang |
Zhe Zhang |
YARN-3387 |
Previous AM’s container complete message couldn’t pass to current am if am restarted and rm changed |
Critical |
resourcemanager |
sandflee |
sandflee |
HADOOP-11876 |
Refactor code to make it more readable, minor maybePrintStats bug |
Trivial |
tools/distcp |
Zoran Dimitrijevic |
Zoran Dimitrijevic |
YARN-3444 |
Fix typo capabililty |
Trivial |
applications/distributed-shell |
Gabor Liptak |
Gabor Liptak |
YARN-3537 |
NPE when NodeManager.serviceInit fails and stopRecoveryStore invoked |
Major |
nodemanager |
Brahma Reddy Battula |
Brahma Reddy Battula |
HDFS-8211 |
DataNode UUID is always null in the JMX counter |
Major |
datanode |
Anu Engineer |
Anu Engineer |
MAPREDUCE-6333 |
TestEvents,TestAMWebServicesTasks,TestAppController are broken due to MAPREDUCE-6297 |
Major |
. |
Siqi Li |
Siqi Li |
HDFS-7673 |
synthetic load generator docs give incorrect/incomplete commands |
Major |
documentation |
Allen Wittenauer |
Brahma Reddy Battula |
HDFS-8206 |
Fix the typos in hadoop-hdfs-httpfs |
Major |
. |
Brahma Reddy Battula |
Brahma Reddy Battula |
YARN-3464 |
Race condition in LocalizerRunner kills localizer before localizing all resources |
Critical |
nodemanager |
zhihai xu |
zhihai xu |
HADOOP-11865 |
Incorrect path mentioned in document for accessing script files |
Major |
documentation |
J.Andreina |
J.Andreina |
MAPREDUCE-6252 |
JobHistoryServer should not fail when encountering a missing directory |
Major |
jobhistoryserver |
Craig Welch |
Craig Welch |
YARN-3530 |
ATS throws exception on trying to filter results without otherinfo. |
Critical |
timelineserver |
Sreenath Somarajapuram |
Zhijie Shen |
HDFS-8205 |
CommandFormat#parse() should not parse option as value of option |
Blocker |
. |
Peter Shi |
Peter Shi |
HADOOP-11870 |
[JDK8] AuthenticationFilter, CertificateUtil, SignerSecretProviders, KeyAuthorizationKeyProvider Javadoc issues |
Major |
build |
Robert Kanter |
Robert Kanter |
MAPREDUCE-6324 |
Uber jobs fail to update AMRM token when it rolls over |
Blocker |
mr-am |
Jason Lowe |
Jason Lowe |
HDFS-8232 |
Missing datanode counters when using Metrics2 sink interface |
Major |
datanode |
Anu Engineer |
Anu Engineer |
MAPREDUCE-6334 |
Fetcher#copyMapOutput is leaking usedMemory upon IOException during InMemoryMapOutput shuffle handler |
Blocker |
. |
Eric Payne |
Eric Payne |
MAPREDUCE-6343 |
JobConf.parseMaximumHeapSizeMB() fails to parse value greater than 2GB expressed in bytes |
Major |
. |
Hao Xia |
Hao Xia |
HDFS-8273 |
FSNamesystem#Delete() should not call logSync() when holding the lock |
Blocker |
namenode |
Jing Zhao |
Haohui Mai |
YARN-3485 |
FairScheduler headroom calculation doesn’t consider maxResources for Fifo and FairShare policies |
Critical |
fairscheduler |
Karthik Kambatla |
Karthik Kambatla |
HDFS-8269 |
getBlockLocations() does not resolve the .reserved path and generates incorrect edit logs when updating the atime |
Blocker |
. |
Yesha Vora |
Haohui Mai |
YARN-3517 |
RM web ui for dumping scheduler logs should be for admins only |
Blocker |
resourcemanager, security |
Varun Vasudev |
Varun Vasudev |
HDFS-8214 |
Secondary NN Web UI shows wrong date for Last Checkpoint |
Major |
namenode |
Charles Lamb |
Charles Lamb |
YARN-3533 |
Test: Fix launchAM in MockRM to wait for attempt to be scheduled |
Major |
yarn |
Anubhav Dhoot |
Anubhav Dhoot |
MAPREDUCE-6339 |
Job history file is not flushed correctly because isTimerActive flag is not set true when flushTimerTask is scheduled. |
Critical |
mrv2 |
zhihai xu |
zhihai xu |
HADOOP-11821 |
Fix findbugs warnings in hadoop-sls |
Major |
tools |
Akira Ajisaka |
Brahma Reddy Battula |
YARN-3564 |
Fix TestContainerAllocation.testAMContainerAllocationWhenDNSUnavailable fails randomly |
Major |
. |
Jian He |
Jian He |
HADOOP-11891 |
OsSecureRandom should lazily fill its reservoir |
Major |
security |
Arun Suresh |
Arun Suresh |
HADOOP-11866 |
increase readability and reliability of checkstyle, shellcheck, and whitespace reports |
Minor |
. |
Naganarasimha G R |
Allen Wittenauer |
HDFS-8292 |
Move conditional in fmt_time from dfs-dust.js to status.html |
Minor |
namenode |
Charles Lamb |
Charles Lamb |
HDFS-8300 |
Fix unit test failures and findbugs warning caused by HDFS-8283 |
Major |
. |
Jing Zhao |
Jing Zhao |
HDFS-8276 |
LazyPersistFileScrubber should be disabled if scrubber interval configured zero |
Major |
namenode |
Surendra Singh Lilhore |
Surendra Singh Lilhore |
HADOOP-11889 |
Make checkstyle runnable from root project |
Major |
build, test |
Gera Shegalov |
Gera Shegalov |
HDFS-8213 |
DFSClient should use hdfs.client.htrace HTrace configuration prefix rather than hadoop.htrace |
Critical |
. |
Billie Rinaldi |
Colin P. McCabe |
HDFS-8229 |
LAZY_PERSIST file gets deleted after NameNode restart. |
Major |
namenode |
Surendra Singh Lilhore |
Surendra Singh Lilhore |
YARN-2893 |
AMLaucher: sporadic job failures due to EOFException in readTokenStorageStream |
Major |
resourcemanager |
Gera Shegalov |
zhihai xu |
HADOOP-11491 |
HarFs incorrectly declared as requiring an authority |
Critical |
fs |
Gera Shegalov |
Brahma Reddy Battula |
HADOOP-11900 |
Add failIfNoTests=false to hadoop-build-tools pom |
Major |
test |
Gera Shegalov |
Gera Shegalov |
MAPREDUCE-6345 |
Documentation fix for when CRLA is enabled for MRAppMaster logs |
Trivial |
documentation |
Rohit Agarwal |
Rohit Agarwal |
YARN-2454 |
Fix compareTo of variable UNBOUNDED in o.a.h.y.util.resource.Resources. |
Major |
. |
Xu Yang |
Xu Yang |
YARN-1993 |
Cross-site scripting vulnerability in TextView.java |
Major |
webapp |
Ted Yu |
Kenji Kikushima |
MAPREDUCE-5905 |
CountersStrings.toEscapedCompactStrings outputs unnecessary “null” strings |
Minor |
. |
Akira Ajisaka |
Akira Ajisaka |
MAPREDUCE-6349 |
Fix typo in property org.apache.hadoop.mapreduce.lib.chain.Chain.REDUCER_INPUT_VALUE_CLASS |
Minor |
. |
Ray Chiang |
Ray Chiang |
HADOOP-9658 |
SnappyCodec#checkNativeCodeLoaded may unexpectedly fail when native code is not loaded |
Major |
. |
Zhijie Shen |
Zhijie Shen |
YARN-3097 |
Logging of resource recovery on NM restart has redundancies |
Minor |
nodemanager |
Jason Lowe |
Eric Payne |
HDFS-8290 |
WebHDFS calls before namesystem initialization can cause NullPointerException. |
Minor |
webhdfs |
Chris Nauroth |
Chris Nauroth |
MAPREDUCE-5649 |
Reduce cannot use more than 2G memory for the final merge |
Major |
mrv2 |
stanley shi |
Gera Shegalov |
MAPREDUCE-6259 |
IllegalArgumentException due to missing job submit time |
Major |
jobhistoryserver |
zhihai xu |
zhihai xu |
YARN-3375 |
NodeHealthScriptRunner.shouldRun() check is performing 3 times for starting NodeHealthScriptRunner |
Minor |
nodemanager |
Devaraj K |
Devaraj K |
YARN-2725 |
Adding test cases of retrying requests about ZKRMStateStore |
Major |
. |
Tsuyoshi Ozawa |
Tsuyoshi Ozawa |
MAPREDUCE-6165 |
[JDK8] TestCombineFileInputFormat failed on JDK8 |
Minor |
. |
Wei Yan |
Akira Ajisaka |
HADOOP-11328 |
ZKFailoverController does not log Exception when doRun raises errors |
Major |
ha |
Tianyin Xu |
Tianyin Xu |
HADOOP-11916 |
TestStringUtils#testLowerAndUpperStrings failed on MAC due to a JVM bug |
Minor |
. |
Ming Ma |
Ming Ma |
YARN-3552 |
RM Web UI shows -1 running containers for completed apps |
Trivial |
webapp |
Rohith Sharma K S |
Rohith Sharma K S |
HADOOP-11120 |
hadoop fs -rmr gives wrong advice |
Major |
. |
Allen Wittenauer |
Juliet Hougland |
YARN-3396 |
Handle URISyntaxException in ResourceLocalizationService |
Major |
nodemanager |
Chengbing Liu |
Brahma Reddy Battula |
YARN-2123 |
Progress bars in Web UI always at 100% due to non-US locale |
Major |
webapp |
Johannes Simon |
Akira Ajisaka |
HDFS-8305 |
HDFS INotify: the destination field of RenameOp should always end with the file name |
Major |
. |
Colin P. McCabe |
Colin P. McCabe |
HADOOP-11917 |
test-patch.sh should work with ${BASEDIR}/patchprocess setups |
Blocker |
. |
Allen Wittenauer |
Allen Wittenauer |
HDFS-7847 |
Modify NNThroughputBenchmark to be able to operate on a remote NameNode |
Major |
. |
Colin P. McCabe |
Charles Lamb |
HDFS-8219 |
setStoragePolicy with folder behavior is different after cluster restart |
Major |
. |
Peter Shi |
Surendra Singh Lilhore |
HADOOP-11926 |
test-patch.sh mv does wrong math |
Major |
. |
Allen Wittenauer |
Allen Wittenauer |
HADOOP-11912 |
Extra configuration key used in TraceUtils should respect prefix |
Minor |
. |
Masatake Iwasaki |
Masatake Iwasaki |
YARN-3582 |
NPE in WebAppProxyServlet |
Major |
. |
Jian He |
Jian He |
HDFS-2484 |
checkLease should throw FileNotFoundException when file does not exist |
Major |
namenode |
Konstantin Shvachko |
Rakesh R |
YARN-3385 |
Race condition: KeeperException$NoNodeException will cause RM shutdown during ZK node deletion. |
Critical |
resourcemanager |
zhihai xu |
zhihai xu |
HDFS-7833 |
DataNode reconfiguration does not recalculate valid volumes required, based on configured failed volumes tolerated. |
Major |
datanode |
Chris Nauroth |
Lei (Eddy) Xu |
YARN-3577 |
Misspelling of threshold in log4j.properties for tests |
Minor |
test |
Brahma Reddy Battula |
Brahma Reddy Battula |
HDFS-8325 |
Misspelling of threshold in log4j.properties for tests |
Minor |
test |
Brahma Reddy Battula |
Brahma Reddy Battula |
HADOOP-10387 |
Misspelling of threshold in log4j.properties for tests in hadoop-common-project |
Minor |
conf, test |
Kenji Kikushima |
Brahma Reddy Battula |
MAPREDUCE-6356 |
Misspelling of threshold in log4j.properties for tests |
Minor |
test |
Brahma Reddy Battula |
Brahma Reddy Battula |
YARN-3523 |
Cleanup ResourceManagerAdministrationProtocol interface audience |
Major |
client, resourcemanager |
Wangda Tan |
Naganarasimha G R |
HDFS-7980 |
Incremental BlockReport will dramatically slow down the startup of a namenode |
Major |
. |
Hui Zheng |
Walter Su |
HADOOP-11936 |
Dockerfile references a removed image |
Major |
. |
Allen Wittenauer |
Allen Wittenauer |
YARN-3584 |
[Log mesage correction] : MIssing space in Diagnostics message |
Trivial |
. |
nijel |
nijel |
HDFS-8321 |
CacheDirectives and CachePool operations should throw RetriableException in safemode |
Major |
. |
Haohui Mai |
Haohui Mai |
HDFS-8037 |
CheckAccess in WebHDFS silently accepts malformed FsActions parameters |
Minor |
webhdfs |
Jake Low |
Walter Su |
YARN-1832 |
Fix wrong MockLocalizerStatus#equals implementation |
Minor |
nodemanager |
Hong Zhiguo |
Hong Zhiguo |
YARN-3572 |
Correct typos in WritingYarnApplications.md |
Minor |
documentation |
Sandeep Khurana |
Gabor Liptak |
HADOOP-11922 |
Misspelling of threshold in log4j.properties for tests in hadoop-tools |
Minor |
. |
Brahma Reddy Battula |
Gabor Liptak |
HDFS-8257 |
Namenode rollingUpgrade option is incorrect in document |
Major |
documentation |
J.Andreina |
J.Andreina |
HDFS-8067 |
haadmin prints out stale help messages |
Minor |
hdfs-client |
Ajith S |
Ajith S |
YARN-3592 |
Fix typos in RMNodeLabelsManager |
Trivial |
resourcemanager |
Junping Du |
Sunil G |
HDFS-8174 |
Update replication count to live rep count in fsck report |
Minor |
. |
J.Andreina |
J.Andreina |
HDFS-6291 |
FSImage may be left unclosed in BootstrapStandby#doRun() |
Minor |
ha |
Ted Yu |
Sanghyun Yun |
YARN-3358 |
Audit log not present while refreshing Service ACLs |
Minor |
resourcemanager |
Varun Saxena |
Varun Saxena |
HDFS-8349 |
Remove .xml and documentation references to dfs.webhdfs.enabled |
Minor |
. |
Ray Chiang |
Ray Chiang |
YARN-3589 |
RM and AH web UI display DOCTYPE wrongly |
Major |
webapp |
Rohith Sharma K S |
Rohith Sharma K S |
HDFS-7998 |
HDFS Federation : Command mentioned to add a NN to existing federated cluster is wrong |
Minor |
documentation |
Ajith S |
Ajith S |
HDFS-8222 |
Remove usage of "dfsadmin -upgradeProgress " from document which is no longer supported |
Major |
documentation |
J.Andreina |
J.Andreina |
HDFS-8187 |
Remove usage of “-setStoragePolicy” and “-getStoragePolicy” using dfsadmin cmd (as it is not been supported) |
Major |
documentation |
J.Andreina |
J.Andreina |
HDFS-8175 |
Provide information on snapshotDiff for supporting the comparison between snapshot and current status |
Major |
documentation |
J.Andreina |
J.Andreina |
MAPREDUCE-6342 |
Make POM project names consistent |
Minor |
build |
Rohith Sharma K S |
Rohith Sharma K S |
HDFS-6576 |
Datanode log is generating at root directory in security mode |
Minor |
datanode, scripts |
Surendra Singh Lilhore |
Surendra Singh Lilhore |
HADOOP-11877 |
SnappyDecompressor’s Logger class name is wrong |
Major |
conf |
Surendra Singh Lilhore |
Surendra Singh Lilhore |
HDFS-3384 |
DataStreamer thread should be closed immediatly when failed to setup a PipelineForAppendOrRecovery |
Major |
hdfs-client |
Brahma Reddy Battula |
Uma Maheswara Rao G |
YARN-3554 |
Default value for maximum nodemanager connect wait time is too high |
Major |
. |
Jason Lowe |
Naganarasimha G R |
HDFS-7894 |
Rolling upgrade readiness is not updated in jmx until query command is issued. |
Critical |
. |
Kihwal Lee |
Brahma Reddy Battula |
YARN-3600 |
AM container link is broken (on a killed application, at least) |
Major |
. |
Sergey Shelukhin |
Naganarasimha G R |
HDFS-8346 |
libwebhdfs build fails during link due to unresolved external symbols. |
Major |
native |
Chris Nauroth |
Chris Nauroth |
HDFS-8274 |
NFS configuration nfs.dump.dir not working |
Major |
nfs |
Ajith S |
Ajith S |
HDFS-8340 |
Fix NFS documentation of nfs.wtmax |
Minor |
documentation, nfs |
Ajith S |
Ajith S |
HADOOP-10356 |
Corrections in winutils/chmod.c |
Trivial |
bin |
René Nyffenegger |
René Nyffenegger |
HADOOP-7165 |
listLocatedStatus(path, filter) is not redefined in FilterFs |
Major |
fs |
Hairong Kuang |
Hairong Kuang |
MAPREDUCE-3383 |
Duplicate job.getOutputValueGroupingComparator() in ReduceTask |
Major |
. |
Binglin Chang |
Binglin Chang |
HDFS-8311 |
DataStreamer.transfer() should timeout the socket InputStream. |
Major |
hdfs-client |
Esteban Gutierrez |
Esteban Gutierrez |
HDFS-8113 |
Add check for null BlockCollection pointers in BlockInfoContiguous structures |
Major |
namenode |
Chengbing Liu |
Chengbing Liu |
HADOOP-9729 |
The example code of org.apache.hadoop.util.Tool is incorrect |
Major |
util |
hellojinjie |
hellojinjie |
MAPREDUCE-2094 |
LineRecordReader should not seek into non-splittable, compressed streams. |
Major |
task |
Niels Basjes |
Niels Basjes |
HADOOP-11942 |
Add links to SLGUserGuide to site index |
Minor |
documentation |
Masatake Iwasaki |
Masatake Iwasaki |
HDFS-8245 |
Standby namenode doesn’t process DELETED_BLOCK if the add block request is in edit log. |
Major |
. |
Rushabh S Shah |
Rushabh S Shah |
YARN-3018 |
Unify the default value for yarn.scheduler.capacity.node-locality-delay in code and default xml file |
Trivial |
capacityscheduler |
nijel |
nijel |
HDFS-8326 |
Documentation about when checkpoints are run is out of date |
Major |
documentation |
Misty Stanley-Jones |
Misty Stanley-Jones |
YARN-3604 |
removeApplication in ZKRMStateStore should also disable watch. |
Minor |
resourcemanager |
zhihai xu |
zhihai xu |
YARN-3476 |
Nodemanager can fail to delete local logs if log aggregation fails |
Major |
log-aggregation, nodemanager |
Jason Lowe |
Rohith Sharma K S |
YARN-3473 |
Fix RM Web UI configuration for some properties |
Minor |
resourcemanager |
Ray Chiang |
Ray Chiang |
HDFS-8097 |
TestFileTruncate is failing intermittently |
Major |
test |
Rakesh R |
Rakesh R |
HADOOP-11775 |
Fix Javadoc typos in hadoop-openstack module |
Trivial |
documentation |
Chen He |
Yanjun Wang |
YARN-1912 |
ResourceLocalizer started without any jvm memory control |
Major |
nodemanager |
stanley shi |
Masatake Iwasaki |
MAPREDUCE-6359 |
RM HA setup, “Cluster” tab links populated with AM hostname instead of RM |
Minor |
. |
Aroop Maliakkal |
yunjiong zhao |
MAPREDUCE-6353 |
Divide by zero error in MR AM when calculating available containers |
Major |
mr-am |
Anubhav Dhoot |
Anubhav Dhoot |
YARN-3395 |
FairScheduler: Trim whitespaces when using username for queuename |
Major |
fairscheduler |
zhihai xu |
zhihai xu |
HDFS-8351 |
Remove namenode -finalize option from document |
Major |
documentation |
Akira Ajisaka |
Akira Ajisaka |
YARN-3587 |
Fix the javadoc of DelegationTokenSecretManager in projects of yarn, etc. |
Minor |
documentation |
Akira Ajisaka |
Gabor Liptak |
HADOOP-11663 |
Remove description about Java 6 from docs |
Minor |
documentation |
Masatake Iwasaki |
Masatake Iwasaki |
HADOOP-11928 |
Test-patch check for @author tags incorrectly flags removal of @author tags |
Major |
. |
Sean Busbey |
Kengo Seki |
HADOOP-11951 |
test-patch should give better info about failures to handle dev-support updates without resetrepo option |
Minor |
. |
Sean Busbey |
Sean Busbey |
HADOOP-11947 |
test-patch should return early from determine-issue when run in jenkins mode. |
Minor |
. |
Sean Busbey |
Sean Busbey |
HDFS-7916 |
‘reportBadBlocks’ from datanodes to standby Node BPServiceActor goes for infinite loop |
Critical |
datanode |
Vinayakumar B |
Rushabh S Shah |
YARN-3434 |
Interaction between reservations and userlimit can result in significant ULF violation |
Major |
capacityscheduler |
Thomas Graves |
Thomas Graves |
HDFS-8362 |
Java Compilation Error in TestHdfsConfigFields.java |
Major |
. |
Mohammad Arshad |
Mohammad Arshad |
MAPREDUCE-6360 |
TestMapreduceConfigFields is placed in wrong dir, introducing compile error |
Major |
. |
Vinayakumar B |
Mohammad Arshad |
MAPREDUCE-6361 |
NPE issue in shuffle caused by concurrent issue between copySucceeded() in one thread and copyFailed() in another thread on the same host |
Critical |
. |
Junping Du |
Junping Du |
YARN-3629 |
NodeID is always printed as “null” in node manager initialization log. |
Major |
. |
nijel |
nijel |
MAPREDUCE-6251 |
JobClient needs additional retries at a higher level to address not-immediately-consistent dfs corner cases |
Major |
jobhistoryserver, mrv2 |
Craig Welch |
Craig Welch |
MAPREDUCE-6366 |
mapreduce.terasort.final.sync configuration in TeraSort doesn’t work |
Trivial |
examples |
Takuya Fukudome |
Takuya Fukudome |
HDFS-6300 |
Prevent multiple balancers from running simultaneously |
Critical |
balancer & mover |
Rakesh R |
Rakesh R |
HDFS-8358 |
TestTraceAdmin fails |
Major |
. |
Kihwal Lee |
Masatake Iwasaki |
HADOOP-11966 |
Variable cygwin is undefined in hadoop-config.sh when executed through hadoop-daemon.sh. |
Critical |
scripts |
Chris Nauroth |
Chris Nauroth |
HDFS-8380 |
Always call addStoredBlock on blocks which have been shifted from one storage to another |
Major |
. |
Colin P. McCabe |
Colin P. McCabe |
HADOOP-8174 |
Remove confusing comment in Path#isAbsolute() |
Trivial |
fs |
Suresh Srinivas |
Suresh Srinivas |
HDFS-8150 |
Make getFileChecksum fail for blocks under construction |
Critical |
. |
Kihwal Lee |
J.Andreina |
MAPREDUCE-5708 |
Duplicate String.format in YarnOutputFiles.getSpillFileForWrite |
Minor |
. |
Konstantin Weitz |
Konstantin Weitz |
YARN-1519 |
check if sysconf is implemented before using it |
Major |
nodemanager |
Radim Kolar |
Radim Kolar |
HDFS-8371 |
Fix test failure in TestHdfsConfigFields for spanreceiver properties |
Major |
. |
Ray Chiang |
Ray Chiang |
MAPREDUCE-6273 |
HistoryFileManager should check whether summaryFile exists to avoid FileNotFoundException causing HistoryFileInfo into MOVE_FAILED state |
Minor |
jobhistoryserver |
zhihai xu |
zhihai xu |
YARN-2421 |
RM still allocates containers to an app in the FINISHING state |
Major |
scheduler |
Thomas Graves |
Chang Li |
YARN-3526 |
ApplicationMaster tracking URL is incorrectly redirected on a QJM cluster |
Major |
resourcemanager, webapp |
Weiwei Yang |
Weiwei Yang |
HADOOP-11988 |
Fix typo in the document for hadoop fs -find |
Trivial |
documentation |
Akira Ajisaka |
Kengo Seki |
HADOOP-10582 |
Fix the test case for copying to non-existent dir in TestFsShellCopy |
Minor |
fs |
Kousuke Saruta |
Kousuke Saruta |
HDFS-8412 |
Fix the test failures in HTTPFS: In some tests setReplication called after fs close. |
Major |
fs |
Uma Maheswara Rao G |
Uma Maheswara Rao G |
HDFS-8345 |
Storage policy APIs must be exposed via the FileSystem interface |
Major |
hdfs-client |
Arpit Agarwal |
Arpit Agarwal |
HDFS-8405 |
Fix a typo in NamenodeFsck |
Minor |
namenode |
Tsz Wo Nicholas Sze |
Takanobu Asanuma |
HDFS-6348 |
SecondaryNameNode not terminating properly on runtime exceptions |
Major |
namenode |
Rakesh R |
Rakesh R |
YARN-3601 |
Fix UT TestRMFailover.testRMWebAppRedirect |
Critical |
resourcemanager, webapp |
Weiwei Yang |
Weiwei Yang |
HDFS-8404 |
Pending block replication can get stuck using older genstamp |
Major |
namenode |
Nathan Roberts |
Nathan Roberts |
HADOOP-11973 |
Ensure ZkDelegationTokenSecretManager namespace znodes get created with ACLs |
Major |
security |
Gregory Chanan |
Gregory Chanan |
HADOOP-11963 |
Metrics documentation for FSNamesystem misspells PendingDataNodeMessageCount. |
Trivial |
documentation |
Chris Nauroth |
Anu Engineer |
YARN-2821 |
Distributed shell app master becomes unresponsive sometimes |
Major |
applications/distributed-shell |
Varun Vasudev |
Varun Vasudev |
YARN-3677 |
Fix findbugs warnings in yarn-server-resourcemanager |
Minor |
resourcemanager |
Akira Ajisaka |
Vinod Kumar Vavilapalli |
YARN-3681 |
yarn cmd says “could not find main class ‘queue’” in windows |
Blocker |
yarn |
Sumana Sathish |
Varun Saxena |
YARN-3654 |
ContainerLogsPage web UI should not have meta-refresh |
Major |
yarn |
Xuan Gong |
Xuan Gong |
YARN-3694 |
Fix dead link for TimelineServer REST API |
Minor |
documentation |
Akira Ajisaka |
Jagadesh Kiran N |
YARN-3646 |
Applications are getting stuck some times in case of retry policy forever |
Major |
client |
Raju Bairishetti |
Raju Bairishetti |
HDFS-8421 |
Move startFile() and related operations into FSDirWriteFileOp |
Major |
. |
Haohui Mai |
Haohui Mai |
HDFS-8451 |
DFSClient probe for encryption testing interprets empty URI property for “enabled” |
Blocker |
encryption |
Steve Loughran |
Steve Loughran |
YARN-3675 |
FairScheduler: RM quits when node removal races with continousscheduling on the same node |
Critical |
fairscheduler |
Anubhav Dhoot |
Anubhav Dhoot |
HADOOP-12016 |
Typo in FileSystem:: listStatusIterator |
Trivial |
fs |
Jakob Homan |
Arthur Vigil |
HADOOP-12014 |
hadoop-config.cmd displays a wrong error message |
Minor |
scripts |
Kengo Seki |
Kengo Seki |
HADOOP-11955 |
Fix a typo in the cluster setup doc |
Trivial |
. |
Kihwal Lee |
Yanjun Wang |
HDFS-8268 |
Port conflict log for data node server is not sufficient |
Minor |
datanode |
Mohammad Shahid Khan |
Mohammad Shahid Khan |
YARN-3594 |
WintuilsProcessStubExecutor.startStreamReader leaks streams |
Trivial |
nodemanager |
Steve Loughran |
Lars Francke |
HADOOP-11743 |
maven doesn’t clean all the site files |
Minor |
documentation |
Allen Wittenauer |
ramtin |
HADOOP-11927 |
Fix “undefined reference to dlopen” error when compiling libhadooppipes |
Major |
build, native, tools |
Xianyin Xin |
Xianyin Xin |
YARN-3701 |
Isolating the error of generating a single app report when getting all apps from generic history service |
Blocker |
timelineserver |
Zhijie Shen |
Zhijie Shen |
YARN-3707 |
RM Web UI queue filter doesn’t work |
Blocker |
. |
Wangda Tan |
Wangda Tan |
YARN-2238 |
filtering on UI sticks even if I move away from the page |
Major |
webapp |
Sangjin Lee |
Jian He |
HADOOP-8751 |
NPE in Token.toString() when Token is constructed using null identifier |
Minor |
security |
Vlad Rozov |
Kanaka Kumar Avvaru |
HADOOP-11969 |
ThreadLocal initialization in several classes is not thread safe |
Critical |
io |
Sean Busbey |
Sean Busbey |
YARN-3626 |
On Windows localized resources are not moved to the front of the classpath when they should be |
Major |
yarn |
Craig Welch |
Craig Welch |
HADOOP-9891 |
CLIMiniCluster instructions fail with MiniYarnCluster ClassNotFoundException |
Minor |
documentation |
Steve Loughran |
Darrell Taylor |
HDFS-8431 |
hdfs crypto class not found in Windows |
Critical |
scripts |
Sumana Sathish |
Anu Engineer |
HADOOP-12004 |
test-patch breaks with reexec in certain situations |
Critical |
. |
Allen Wittenauer |
Sean Busbey |
YARN-3723 |
Need to clearly document primaryFilter and otherInfo value type |
Critical |
timelineserver |
Zhijie Shen |
Zhijie Shen |
HADOOP-11406 |
xargs -P is not portable |
Critical |
scripts |
Allen Wittenauer |
Kengo Seki |
HADOOP-11983 |
HADOOP_USER_CLASSPATH_FIRST works the opposite of what it is supposed to do |
Major |
scripts |
Sangjin Lee |
Sangjin Lee |
HDFS-8407 |
libhdfs hdfsListDirectory must set errno to 0 on success |
Major |
native |
Juan Yu |
Masatake Iwasaki |
HDFS-8429 |
Avoid stuck threads if there is an error in DomainSocketWatcher that stops the thread |
Major |
. |
zhouyingchao |
zhouyingchao |
HADOOP-11959 |
WASB should configure client side socket timeout in storage client blob request options |
Major |
tools |
Ivan Mitic |
Ivan Mitic |
HADOOP-11934 |
Use of JavaKeyStoreProvider in LdapGroupsMapping causes infinite loop |
Blocker |
security |
Mike Yoder |
Larry McCay |
HDFS-7401 |
Add block info to DFSInputStream’ WARN message when it adds node to deadNodes |
Minor |
. |
Ming Ma |
Mohammad Arshad |
HADOOP-12042 |
Users may see TrashPolicy if hdfs dfs -rm is run |
Major |
. |
Allen Wittenauer |
J.Andreina |
HDFS-7609 |
Avoid retry cache collision when Standby NameNode loading edits |
Critical |
namenode |
Carrey Zhan |
Ming Ma |
HADOOP-11885 |
hadoop-dist dist-layout-stitching.sh does not work with dash |
Major |
build |
Andrew Wang |
Andrew Wang |
YARN-3725 |
App submission via REST API is broken in secure mode due to Timeline DT service address is empty |
Blocker |
resourcemanager, timelineserver |
Zhijie Shen |
Zhijie Shen |
HADOOP-9905 |
remove dependency of zookeeper for hadoop-client |
Major |
. |
Vinayakumar B |
Vinayakumar B |
HADOOP-12037 |
Fix wrong classname in example configuration of hadoop-auth documentation |
Trivial |
documentation |
Masatake Iwasaki |
Masatake Iwasaki |
HDFS-8256 |
fsck "-storagepolicies , -blockId ,-replicaDetails " options are missed out in usage and from documentation |
Major |
documentation |
J.Andreina |
J.Andreina |
HDFS-8486 |
DN startup may cause severe data loss |
Blocker |
datanode |
Daryn Sharp |
Daryn Sharp |
HDFS-8386 |
Improve synchronization of ‘streamer’ reference in DFSOutputStream |
Major |
hdfs-client |
Rakesh R |
Rakesh R |
HDFS-8513 |
Rename BlockPlacementPolicyRackFaultTolarent to BlockPlacementPolicyRackFaultTolerant |
Minor |
namenode |
Andrew Wang |
Andrew Wang |
HADOOP-11991 |
test-patch.sh isn’t re-executed even if smart-apply-patch.sh is modified |
Major |
test |
Kengo Seki |
Kengo Seki |
HDFS-8270 |
create() always retried with hardcoded timeout when file already exists with open lease |
Major |
hdfs-client |
Andrey Stepachev |
J.Andreina |
HDFS-8470 |
fsimage loading progress should update inode, delegation token and cache pool count. |
Minor |
namenode |
tongshiquan |
Surendra Singh Lilhore |
HDFS-8523 |
Remove usage information on unsupported operation “fsck -showprogress” from branch-2 |
Major |
documentation |
J.Andreina |
J.Andreina |
HDFS-3716 |
Purger should remove stale fsimage ckpt files |
Minor |
namenode |
suja s |
J.Andreina |
YARN-3751 |
TestAHSWebServices fails after YARN-3467 |
Major |
. |
Zhijie Shen |
Sunil G |
YARN-3585 |
NodeManager cannot exit on SHUTDOWN event triggered and NM recovery is enabled |
Critical |
. |
Peng Zhang |
Rohith Sharma K S |
MAPREDUCE-6374 |
Distributed Cache File visibility should check permission of full path |
Major |
. |
Chang Li |
Chang Li |
YARN-3762 |
FairScheduler: CME on FSParentQueue#getQueueUserAclInfo |
Critical |
fairscheduler |
Karthik Kambatla |
Karthik Kambatla |
YARN-3749 |
We should make a copy of configuration when init MiniYARNCluster with multiple RMs |
Major |
. |
Chun Chen |
Chun Chen |
MAPREDUCE-5965 |
Hadoop streaming throws error if list of input files is high. Error is: “error=7, Argument list too long at if number of input file is high” |
Major |
. |
Arup Malakar |
Wilfred Spiegelenburg |
HADOOP-12018 |
smart-apply-patch.sh fails if the patch edits CR+LF files and is created by ‘git diff –no-prefix’ |
Minor |
build |
Akira Ajisaka |
Kengo Seki |
HADOOP-12019 |
update BUILDING.txt to include python for ‘mvn site’ in windows |
Major |
. |
Vinayakumar B |
Vinayakumar B |
MAPREDUCE-6382 |
Don’t escape HTML links in Diagnostics in JHS job overview |
Major |
. |
Siqi Li |
Siqi Li |
HADOOP-12058 |
Fix dead links to DistCp and Hadoop Archives pages. |
Minor |
documentation, site |
Kazuho Fujii |
Kazuho Fujii |
HDFS-8463 |
Calling DFSInputStream.seekToNewSource just after stream creation causes NullPointerException |
Minor |
. |
Masatake Iwasaki |
Masatake Iwasaki |
YARN-3764 |
CapacityScheduler should forbid moving LeafQueue from one parent to another |
Blocker |
. |
Wangda Tan |
Wangda Tan |
HADOOP-11994 |
smart-apply-patch wrongly assumes that git is infallible |
Major |
test |
Allen Wittenauer |
Kengo Seki |
HADOOP-11924 |
Tolerate JDK-8047340-related exceptions in Shell#isSetSidAvailable preventing class init |
Major |
. |
Gera Shegalov |
Tsuyoshi Ozawa |
YARN-3733 |
Fix DominantRC#compare() does not work as expected if cluster resource is empty |
Blocker |
resourcemanager |
Bibin A Chundatt |
Rohith Sharma K S |
MAPREDUCE-6377 |
JHS sorting on state column not working in webUi |
Minor |
jobhistoryserver |
Bibin A Chundatt |
zhihai xu |
MAPREDUCE-6387 |
Serialize the recently added Task#encryptedSpillKey field at the end |
Minor |
. |
Arun Suresh |
Arun Suresh |
HADOOP-12056 |
Use DirectoryStream in DiskChecker#checkDirs to detect errors when listing a directory |
Major |
util |
zhihai xu |
zhihai xu |
HDFS-8522 |
Change heavily recorded NN logs from INFO to DEBUG level |
Major |
namenode |
Xiaoyu Yao |
Xiaoyu Yao |
YARN-3655 |
FairScheduler: potential livelock due to maxAMShare limitation and container reservation |
Critical |
fairscheduler |
zhihai xu |
zhihai xu |
HDFS-8539 |
Hdfs doesnt have class ‘debug’ in windows |
Major |
scripts |
Sumana Sathish |
Anu Engineer |
YARN-3780 |
Should use equals when compare Resource in RMNodeImpl#ReconnectNodeTransition |
Minor |
resourcemanager |
zhihai xu |
zhihai xu |
YARN-3747 |
TestLocalDirsHandlerService should delete the created test directory logDir2 |
Minor |
test |
David Moore |
David Moore |
HDFS-8554 |
TestDatanodeLayoutUpgrade fails on Windows. |
Major |
test |
Chris Nauroth |
Chris Nauroth |
YARN-3778 |
Fix Yarn resourcemanger CLI usage |
Major |
. |
Brahma Reddy Battula |
Brahma Reddy Battula |
HADOOP-12054 |
RPC client should not retry for InvalidToken exceptions |
Critical |
ipc |
Daryn Sharp |
Varun Saxena |
HDFS-8552 |
Fix hdfs CLI usage message for namenode and zkfc |
Major |
. |
Xiaoyu Yao |
Brahma Reddy Battula |
HADOOP-12073 |
Azure FileSystem PageBlobInputStream does not return -1 on EOF |
Major |
tools |
Ivan Mitic |
Ivan Mitic |
HDFS-8568 |
TestClusterId#testFormatWithEmptyClusterIdOption is failing |
Major |
. |
Rakesh R |
Rakesh R |
HADOOP-7817 |
RawLocalFileSystem.append() should give FSDataOutputStream with accurate .getPos() |
Major |
fs |
Kristofer Tomasette |
Kanaka Kumar Avvaru |
MAPREDUCE-6350 |
JobHistory doesn’t support fully-functional search |
Critical |
jobhistoryserver |
Siqi Li |
Siqi Li |
MAPREDUCE-6389 |
Fix BaileyBorweinPlouffe CLI usage message |
Trivial |
. |
Brahma Reddy Battula |
Brahma Reddy Battula |
HADOOP-12052 |
IPC client downgrades all exception types to IOE, breaks callers trying to use them |
Critical |
. |
Steve Loughran |
Brahma Reddy Battula |
YARN-3785 |
Support for Resource as an argument during submitApp call in MockRM test class |
Minor |
resourcemanager |
Sunil G |
Sunil G |
HADOOP-12074 |
in Shell.java#runCommand() rethrow InterruptedException as InterruptedIOException |
Minor |
. |
Lavkesh Lahngir |
Lavkesh Lahngir |
HDFS-8566 |
HDFS documentation about debug commands wrongly identifies them as “hdfs dfs” commands |
Major |
documentation |
Surendra Singh Lilhore |
Surendra Singh Lilhore |
HDFS-8583 |
Document that NFS gateway does not work with rpcbind on SLES 11 |
Major |
documentation |
Arpit Agarwal |
Arpit Agarwal |
HDFS-8572 |
DN always uses HTTP/localhost@REALM principals in SPNEGO |
Blocker |
. |
Haohui Mai |
Haohui Mai |
YARN-3794 |
TestRMEmbeddedElector fails because of ambiguous LOG reference |
Major |
test |
Chengbing Liu |
Chengbing Liu |
HDFS-8593 |
Calculation of effective layout version mishandles comparison to current layout version in storage. |
Major |
namenode |
Chris Nauroth |
Chris Nauroth |
HDFS-8596 |
TestDistributedFileSystem et al tests are broken in branch-2 due to incorrect setting of “datanode” attribute |
Blocker |
datanode |
Yongjun Zhang |
Yongjun Zhang |
HDFS-8595 |
TestCommitBlockSynchronization fails in branch-2.7 |
Major |
test |
Arpit Agarwal |
Arpit Agarwal |
HDFS-8607 |
TestFileCorruption doesn’t work as expected |
Major |
test |
Walter Su |
Walter Su |
HADOOP-12001 |
Limiting LDAP search conflicts with posixGroup addition |
Blocker |
security |
Patrick White |
Patrick White |
HADOOP-12078 |
The default retry policy does not handle RetriableException correctly |
Critical |
ipc |
Arpit Agarwal |
Arpit Agarwal |
MAPREDUCE-6396 |
TestPipeApplication fails by NullPointerException |
Major |
test |
Akira Ajisaka |
Brahma Reddy Battula |
HDFS-8576 |
Lease recovery should return true if the lease can be released and the file can be closed |
Major |
namenode |
J.Andreina |
J.Andreina |
HDFS-8592 |
SafeModeException never get unwrapped |
Major |
. |
Haohui Mai |
Haohui Mai |
HADOOP-12095 |
org.apache.hadoop.fs.shell.TestCount fails |
Major |
test |
Brahma Reddy Battula |
Brahma Reddy Battula |
HDFS-4660 |
Block corruption can happen during pipeline recovery |
Blocker |
datanode |
Peng Zhang |
Kihwal Lee |
HDFS-8548 |
Minicluster throws NPE on shutdown |
Major |
. |
Mike Drob |
Surendra Singh Lilhore |
YARN-3714 |
AM proxy filter can not get RM webapp address from yarn.resourcemanager.hostname.rm-id |
Minor |
. |
Masatake Iwasaki |
Masatake Iwasaki |
HDFS-8551 |
Fix hdfs datanode CLI usage message |
Major |
. |
Xiaoyu Yao |
Brahma Reddy Battula |
HADOOP-12076 |
Incomplete Cache Mechanism in CredentialProvider API |
Major |
security |
Larry McCay |
Larry McCay |
YARN-3617 |
Fix WindowsResourceCalculatorPlugin.getCpuFrequency() returning always -1 |
Minor |
. |
Georg Berendt |
J.Andreina |
YARN-3804 |
Both RM are on standBy state when kerberos user not in yarn.admin.acl |
Critical |
resourcemanager |
Bibin A Chundatt |
Varun Saxena |
HDFS-8446 |
Separate safemode related operations in GetBlockLocations() |
Minor |
. |
Haohui Mai |
Haohui Mai |
HDFS-8615 |
Correct HTTP method in WebHDFS document |
Major |
documentation |
Akira Ajisaka |
Brahma Reddy Battula |
MAPREDUCE-6373 |
The logger reports total input paths but it is referring to input files |
Trivial |
. |
Andi Chirita Amdocs |
Bibin A Chundatt |
YARN-3824 |
Fix two minor nits in member variable properties of YarnConfiguration |
Trivial |
yarn |
Ray Chiang |
Ray Chiang |
HADOOP-12100 |
ImmutableFsPermission should not override applyUmask since that method doesn’t modify the FsPermission |
Major |
. |
Robert Kanter |
Bibin A Chundatt |
YARN-3802 |
Two RMNodes for the same NodeId are used in RM sometimes after NM is reconnected. |
Major |
resourcemanager |
zhihai xu |
zhihai xu |
HDFS-8633 |
Fix setting of dfs.datanode.readahead.bytes in hdfs-default.xml to match DFSConfigKeys |
Minor |
datanode |
Ray Chiang |
Ray Chiang |
HDFS-8626 |
Reserved RBW space is not released if creation of RBW File fails |
Blocker |
. |
Kanaka Kumar Avvaru |
Kanaka Kumar Avvaru |
MAPREDUCE-6405 |
NullPointerException in App Attempts page |
Major |
. |
Siqi Li |
Siqi Li |
HADOOP-12103 |
Small refactoring of DelegationTokenAuthenticationFilter to allow code sharing |
Minor |
security |
Yongjun Zhang |
Yongjun Zhang |
HDFS-8337 |
Accessing httpfs via webhdfs doesn’t work from a jar with kerberos |
Major |
security, webhdfs |
Yongjun Zhang |
Yongjun Zhang |
MAPREDUCE-6403 |
Fix typo in the usage of NNBench |
Trivial |
documentation |
Akira Ajisaka |
Jagadesh Kiran N |
HDFS-8480 |
Fix performance and timeout issues in HDFS-7929 by using hard-links to preserve old edit logs instead of copying them |
Critical |
. |
Zhe Zhang |
Zhe Zhang |
MAPREDUCE-5948 |
org.apache.hadoop.mapred.LineRecordReader does not handle multibyte record delimiters well |
Critical |
. |
Kris Geusebroek |
Akira Ajisaka |
HDFS-8542 |
WebHDFS getHomeDirectory behavior does not match specification |
Major |
webhdfs |
Jakob Homan |
Kanaka Kumar Avvaru |
YARN-3842 |
NMProxy should retry on NMNotYetReadyException |
Critical |
. |
Karthik Kambatla |
Robert Kanter |
YARN-3835 |
hadoop-yarn-server-resourcemanager test package bundles core-site.xml, yarn-site.xml |
Minor |
resourcemanager |
Vamsee Yarlagadda |
Vamsee Yarlagadda |
MAPREDUCE-6406 |
Update FileOutputCommitter.FILEOUTPUTCOMMITTER_ALGORITHM_VERSION_DEFAULT to match mapred-default.xml |
Minor |
mrv2 |
Ray Chiang |
Ray Chiang |
MAPREDUCE-6410 |
Aggregated Logs Deletion doesnt work after refreshing Log Retention Settings in secure cluster |
Critical |
. |
Zhang Wei |
Varun Saxena |
MAPREDUCE-6400 |
Multiple shuffle transfer fails because input is closed too early |
Blocker |
task |
Akira Ajisaka |
Brahma Reddy Battula |
YARN-3809 |
Failed to launch new attempts because ApplicationMasterLauncher’s threads all hang |
Major |
resourcemanager |
Jun Gong |
Jun Gong |
YARN-3832 |
Resource Localization fails on a cluster due to existing cache directories |
Critical |
nodemanager |
Ranga Swamy |
Brahma Reddy Battula |
YARN-3790 |
usedResource from rootQueue metrics may get stale data for FS scheduler after recovering the container |
Major |
fairscheduler, test |
Rohith Sharma K S |
zhihai xu |
HADOOP-11958 |
MetricsSystemImpl fails to show backtrace when an error occurs |
Major |
. |
Jason Lowe |
Jason Lowe |
HDFS-8646 |
Prune cached replicas from DatanodeDescriptor state on replica invalidation |
Major |
caching |
Andrew Wang |
Andrew Wang |
YARN-3826 |
Race condition in ResourceTrackerService leads to wrong diagnostics messages |
Major |
resourcemanager |
Chengbing Liu |
Chengbing Liu |
YARN-3745 |
SerializedException should also try to instantiate internal exception with the default constructor |
Major |
. |
Lavkesh Lahngir |
Lavkesh Lahngir |
MAPREDUCE-6413 |
TestLocalJobSubmission is failing with unknown host |
Major |
test |
Jason Lowe |
zhihai xu |
HDFS-8665 |
Fix replication check in DFSTestUtils#waitForReplication |
Trivial |
test |
Andrew Wang |
Andrew Wang |
HADOOP-8151 |
Error handling in snappy decompressor throws invalid exceptions |
Major |
io, native |
Todd Lipcon |
Matt Foley |
YARN-3850 |
NM fails to read files from full disks which can lead to container logs being lost and other issues |
Blocker |
log-aggregation, nodemanager |
Varun Saxena |
Varun Saxena |
HDFS-8656 |
Preserve compatibility of ClientProtocol#rollingUpgrade after finalization |
Critical |
rolling upgrades |
Andrew Wang |
Andrew Wang |
YARN-3859 |
LeafQueue doesn’t print user properly for application add |
Minor |
capacityscheduler |
Devaraj K |
Varun Saxena |
HDFS-8681 |
BlockScanner is incorrectly disabled by default |
Blocker |
datanode |
Andrew Wang |
Arpit Agarwal |
YARN-3860 |
rmadmin -transitionToActive should check the state of non-target node |
Major |
resourcemanager |
Masatake Iwasaki |
Masatake Iwasaki |
HDFS-8586 |
Dead Datanode is allocated for write when client is from deadnode |
Critical |
. |
Brahma Reddy Battula |
Brahma Reddy Battula |
HADOOP-12119 |
hadoop fs -expunge does not work for federated namespace |
Major |
. |
Vrushali C |
J.Andreina |
HDFS-8628 |
Update missing command option for fetchdt |
Major |
documentation |
J.Andreina |
J.Andreina |
YARN-3695 |
ServerProxy (NMProxy, etc.) shouldn’t retry forever for non network exception. |
Major |
. |
Junping Du |
Raju Bairishetti |
HADOOP-12089 |
StorageException complaining " no lease ID" when updating FolderLastModifiedTime in WASB |
Major |
tools |
Duo Xu |
Duo Xu |
YARN-3770 |
SerializedException should also handle java.lang.Error |
Major |
. |
Lavkesh Lahngir |
Lavkesh Lahngir |
HDFS-8687 |
Remove the duplicate usage message from Dfsck.java |
Major |
. |
Brahma Reddy Battula |
Brahma Reddy Battula |
HADOOP-12107 |
long running apps may have a huge number of StatisticsData instances under FileSystem |
Critical |
fs |
Sangjin Lee |
Sangjin Lee |
HDFS-8579 |
Update HDFS usage with missing options |
Minor |
. |
J.Andreina |
J.Andreina |
HADOOP-12154 |
FileSystem#getUsed() returns the file length only from root ‘/’ |
Major |
. |
tongshiquan |
J.Andreina |
HDFS-8627 |
NPE thrown if unable to fetch token from Namenode |
Major |
. |
J.Andreina |
J.Andreina |
YARN-3768 |
ArrayIndexOutOfBoundsException with empty environment variables |
Major |
yarn |
Joe Ferner |
zhihai xu |
HADOOP-10798 |
globStatus() should always return a sorted list of files |
Minor |
. |
Felix Borchers |
Colin P. McCabe |
HADOOP-12124 |
Add HTrace support for FsShell |
Major |
. |
Colin P. McCabe |
Colin P. McCabe |
HADOOP-12159 |
Move DistCpUtils#compareFs() to org.apache.hadoop.fs.FileUtil and fix for HA namespaces |
Major |
. |
Ray Chiang |
Ray Chiang |
MAPREDUCE-6121 |
JobResourceUpdater#compareFs() doesn’t handle HA namespaces |
Major |
mrv2 |
Thomas Graves |
Ray Chiang |
HADOOP-12116 |
Fix unrecommended syntax usages in hadoop/hdfs/yarn script for cygwin in branch-2 |
Major |
scripts |
Li Lu |
Li Lu |
HADOOP-12164 |
Fix TestMove and TestFsShellReturnCode failed to get command name using reflection. |
Minor |
. |
Lei (Eddy) Xu |
Lei (Eddy) Xu |
YARN-3823 |
Fix mismatch in default values for yarn.scheduler.maximum-allocation-vcores property |
Minor |
. |
Ray Chiang |
Ray Chiang |
YARN-3830 |
AbstractYarnScheduler.createReleaseCache may try to clean a null attempt |
Major |
scheduler |
nijel |
nijel |
HDFS-8706 |
Fix typo in datanode startup options in HDFSCommands.html |
Major |
. |
Brahma Reddy Battula |
Brahma Reddy Battula |
MAPREDUCE-6420 |
Interrupted Exception in LocalContainerLauncher should be logged in warn/info level |
Major |
. |
Chang Li |
Chang Li |
MAPREDUCE-6418 |
MRApp should not shutdown LogManager during shutdown |
Major |
test |
Chang Li |
Chang Li |
YARN-3793 |
Several NPEs when deleting local files on NM recovery |
Major |
nodemanager |
Karthik Kambatla |
Varun Saxena |
HDFS-8666 |
speedup TestMover |
Major |
test |
Walter Su |
Walter Su |
HADOOP-12171 |
Shorten overly-long htrace span names for server |
Major |
tracing |
Colin P. McCabe |
Colin P. McCabe |
YARN-3875 |
FSSchedulerNode#reserveResource() doesn’t print Application Id properly in log |
Minor |
. |
Bibin A Chundatt |
Bibin A Chundatt |
YARN-3508 |
Prevent processing preemption events on the main RM dispatcher |
Major |
resourcemanager, scheduler |
Jason Lowe |
Varun Saxena |
HADOOP-12173 |
NetworkTopology#add calls NetworkTopology#toString always |
Major |
. |
Íñigo Goiri |
Íñigo Goiri |
HDFS-8577 |
Avoid retrying to recover lease on a file which does not exist |
Major |
. |
J.Andreina |
J.Andreina |
YARN-3882 |
AggregatedLogFormat should close aclScanner and ownerScanner after create them. |
Minor |
nodemanager |
zhihai xu |
zhihai xu |
MAPREDUCE-6425 |
ShuffleHandler passes wrong “base” parameter to getMapOutputInfo if mapId is not in the cache. |
Major |
mrv2, nodemanager |
zhihai xu |
zhihai xu |
HADOOP-12186 |
ActiveStandbyElector shouldn’t call monitorLockNodeAsync multiple times |
Major |
ha |
zhihai xu |
zhihai xu |
HDFS-8686 |
WebHdfsFileSystem#getXAttr(Path p, final String name) doesn’t work if namespace is in capitals |
Major |
webhdfs |
Jagadesh Kiran N |
Kanaka Kumar Avvaru |
YARN-3837 |
javadocs of TimelineAuthenticationFilterInitializer give wrong prefix for auth options |
Minor |
timelineserver |
Steve Loughran |
Bibin A Chundatt |
HADOOP-12117 |
Potential NPE from Configuration#loadProperty with allowNullValueProperties set. |
Minor |
conf |
zhihai xu |
zhihai xu |
MAPREDUCE-6038 |
A boolean may be set error in the Word Count v2.0 in MapReduce Tutorial |
Minor |
. |
Pei Ma |
Tsuyoshi Ozawa |
YARN-3892 |
NPE on RMStateStore#serviceStop when CapacityScheduler#serviceInit fails |
Minor |
. |
Bibin A Chundatt |
Bibin A Chundatt |
YARN-3690 |
[JDK8] ‘mvn site’ fails |
Major |
api, site |
Akira Ajisaka |
Brahma Reddy Battula |
HADOOP-12202 |
releasedocmaker drops missing component and assignee entries |
Blocker |
yetus |
Allen Wittenauer |
Allen Wittenauer |
HDFS-8642 |
Make TestFileTruncate more reliable |
Minor |
. |
Rakesh R |
Rakesh R |
HADOOP-11878 |
FileContext.java # fixRelativePart should check for not null for a more informative exception |
Major |
. |
Brahma Reddy Battula |
Brahma Reddy Battula |
HADOOP-12201 |
Add tracing to FileSystem#createFileSystem and Globber#glob |
Major |
. |
Colin P. McCabe |
Colin P. McCabe |
HADOOP-12200 |
TestCryptoStreamsWithOpensslAesCtrCryptoCodec should be skipped in non-native profile |
Minor |
test |
Masatake Iwasaki |
Masatake Iwasaki |
MAPREDUCE-6426 |
TestShuffleHandler#testGetMapOutputInfo is failing |
Major |
test |
Devaraj K |
zhihai xu |
HDFS-8729 |
Fix testTruncateWithDataNodesRestartImmediately occasionally failed |
Minor |
. |
Walter Su |
Walter Su |
YARN-3888 |
ApplicationMaster link is broken in RM WebUI when appstate is NEW |
Minor |
resourcemanager |
Bibin A Chundatt |
Bibin A Chundatt |
HDFS-8749 |
Fix findbugs warning in BlockManager.java |
Minor |
. |
Akira Ajisaka |
Brahma Reddy Battula |
HDFS-2956 |
calling fetchdt without a –renewer argument throws NPE |
Major |
security |
Todd Lipcon |
Vinayakumar B |
HDFS-8751 |
Remove setBlocks API from INodeFile and misc code cleanup |
Major |
namenode |
Zhe Zhang |
Zhe Zhang |
YARN-3849 |
Too much of preemption activity causing continuos killing of containers across queues |
Critical |
capacityscheduler |
Sunil G |
Sunil G |
YARN-3917 |
getResourceCalculatorPlugin for the default should intercept all exceptions |
Major |
. |
Gera Shegalov |
Gera Shegalov |
YARN-3894 |
RM startup should fail for wrong CS xml NodeLabel capacity configuration |
Critical |
capacityscheduler |
Bibin A Chundatt |
Bibin A Chundatt |
MAPREDUCE-6421 |
Fix findbugs warning in RMContainerAllocator.reduceNodeLabelExpression |
Major |
. |
Ray Chiang |
Brahma Reddy Battula |
HADOOP-12191 |
Bzip2Factory is not thread safe |
Major |
io |
Jason Lowe |
Brahma Reddy Battula |
HDFS-7608 |
hdfs dfsclient newConnectedPeer has no write timeout |
Major |
fuse-dfs, hdfs-client |
zhangshilong |
Xiaoyu Yao |
HADOOP-12153 |
ByteBufferReadable doesn’t declare @InterfaceAudience and @InterfaceStability |
Minor |
fs |
Steve Loughran |
Brahma Reddy Battula |
HDFS-8778 |
TestBlockReportRateLimiting#testLeaseExpiration can deadlock |
Major |
test |
Arpit Agarwal |
Arpit Agarwal |
HADOOP-10615 |
FileInputStream in JenkinsHash#main() is never closed |
Minor |
. |
Ted Yu |
Chen He |
HADOOP-12240 |
Fix tests requiring native library to be skipped in non-native profile |
Minor |
test |
Masatake Iwasaki |
Masatake Iwasaki |
YARN-3805 |
Update the documentation of Disk Checker based on YARN-90 |
Minor |
documentation |
Masatake Iwasaki |
Masatake Iwasaki |
HDFS-8767 |
RawLocalFileSystem.listStatus() returns null for UNIX pipefile |
Critical |
. |
Haohui Mai |
Kanaka Kumar Avvaru |
YARN-3885 |
ProportionalCapacityPreemptionPolicy doesn’t preempt if queue is more than 2 level |
Blocker |
yarn |
Ajith S |
Ajith S |
YARN-3453 |
Fair Scheduler: Parts of preemption logic uses DefaultResourceCalculator even in DRF mode causing thrashing |
Major |
fairscheduler |
Ashwin Shankar |
Arun Suresh |
YARN-3535 |
Scheduler must re-request container resources when RMContainer transitions from ALLOCATED to KILLED |
Critical |
capacityscheduler, fairscheduler, resourcemanager |
Peng Zhang |
Peng Zhang |
YARN-3905 |
Application History Server UI NPEs when accessing apps run after RM restart |
Major |
timelineserver |
Eric Payne |
Eric Payne |
HADOOP-12235 |
hadoop-openstack junit & mockito dependencies should be “provided” |
Minor |
build, fs/swift |
Steve Loughran |
Ted Yu |
HADOOP-12088 |
KMSClientProvider uses equalsIgnoreCase(“application/json”) |
Major |
kms |
Steve Loughran |
Brahma Reddy Battula |
HADOOP-12051 |
ProtobufRpcEngine.invoke() should use Exception.toString() over getMessage in logging/span events |
Minor |
ipc |
Steve Loughran |
Varun Saxena |
HADOOP-12237 |
releasedocmaker.py doesn’t work behind a proxy |
Major |
yetus |
Tsuyoshi Ozawa |
Tsuyoshi Ozawa |
HDFS-8657 |
Update docs for mSNN |
Minor |
. |
Jesse Yates |
Jesse Yates |
HDFS-7582 |
Enforce maximum number of ACL entries separately per access and default. |
Major |
namenode |
Vinayakumar B |
Vinayakumar B |
HDFS-8800 |
hdfs –daemon stop namenode corrupts logs |
Major |
scripts |
John Smith |
John Smith |
YARN-3915 |
scmadmin help message correction |
Minor |
yarn |
Bibin A Chundatt |
Bibin A Chundatt |
MAPREDUCE-5801 |
Uber mode’s log message is missing a vcore reason |
Minor |
. |
Steven K. Wong |
Steven K. Wong |
HADOOP-11762 |
Enable swift distcp to secure HDFS |
Major |
fs/swift |
Chen He |
Chen He |
HDFS-8773 |
Few FSNamesystem metrics are not documented in the Metrics page |
Major |
documentation |
Rakesh R |
Rakesh R |
YARN-3878 |
AsyncDispatcher can hang while stopping if it is configured for draining events on stop |
Critical |
. |
Varun Saxena |
Varun Saxena |
HDFS-7728 |
Avoid updating quota usage while loading edits |
Major |
. |
Jing Zhao |
Jing Zhao |
HADOOP-11962 |
Sasl message with MD5 challenge text shouldn’t be LOG out even in debug level. |
Critical |
ipc, security |
Junping Du |
Junping Du |
HADOOP-12017 |
Hadoop archives command should use configurable replication factor when closing |
Major |
. |
Zhe Zhang |
Bibin A Chundatt |
HADOOP-12239 |
StorageException complaining " no lease ID" when updating FolderLastModifiedTime in WASB |
Major |
fs/azure, tools |
Duo Xu |
Duo Xu |
YARN-3932 |
SchedulerApplicationAttempt#getResourceUsageReport and UserInfo should based on total-used-resources |
Major |
resourcemanager |
Bibin A Chundatt |
Bibin A Chundatt |
YARN-3954 |
TestYarnConfigurationFields#testCompareConfigurationClassAgainstXml fails in trunk |
Major |
. |
Varun Saxena |
Varun Saxena |
YARN-2019 |
Retrospect on decision of making RM crashed if any exception throw in ZKRMStateStore |
Critical |
. |
Junping Du |
Jian He |
HDFS-8797 |
WebHdfsFileSystem creates too many connections for pread |
Major |
webhdfs |
Jing Zhao |
Jing Zhao |
YARN-3941 |
Proportional Preemption policy should try to avoid sending duplicate PREEMPT_CONTAINER event to scheduler |
Major |
capacityscheduler |
Sunil G |
Sunil G |
YARN-3900 |
Protobuf layout of yarn_security_token causes errors in other protos that include it |
Major |
. |
Anubhav Dhoot |
Anubhav Dhoot |
YARN-3845 |
Scheduler page does not render RGBA color combinations in IE11 |
Minor |
. |
Jagadesh Kiran N |
Mohammad Shahid Khan |
HDFS-8806 |
Inconsistent metrics: number of missing blocks with replication factor 1 not properly cleared |
Major |
. |
Zhe Zhang |
Zhe Zhang |
YARN-3967 |
Fetch the application report from the AHS if the RM does not know about it |
Major |
. |
Mit Desai |
Mit Desai |
YARN-3957 |
FairScheduler NPE In FairSchedulerQueueInfo causing scheduler page to return 500 |
Major |
fairscheduler |
Anubhav Dhoot |
Anubhav Dhoot |
YARN-3925 |
ContainerLogsUtils#getContainerLogFile fails to read container log files from full disks. |
Critical |
nodemanager |
zhihai xu |
zhihai xu |
YARN-3973 |
Recent changes to application priority management break reservation system from YARN-1051 |
Major |
resourcemanager |
Carlo Curino |
Carlo Curino |
YARN-3958 |
TestYarnConfigurationFields should be moved to hadoop-yarn-api module |
Major |
. |
Varun Saxena |
Varun Saxena |
HDFS-8810 |
Correct assertions in TestDFSInotifyEventInputStream class. |
Minor |
test |
Surendra Singh Lilhore |
Surendra Singh Lilhore |
HDFS-8785 |
TestDistributedFileSystem is failing in trunk |
Major |
test |
Arpit Agarwal |
Xiaoyu Yao |
YARN-2194 |
Cgroups cease to work in RHEL7 |
Critical |
nodemanager |
Wei Yan |
Wei Yan |
YARN-3846 |
RM Web UI queue filter is not working |
Major |
yarn |
Mohammad Shahid Khan |
Mohammad Shahid Khan |
HADOOP-12245 |
References to misspelled REMAINING_QUATA in FileSystemShell.md |
Minor |
documentation |
Gera Shegalov |
Gabor Liptak |
YARN-3982 |
container-executor parsing of container-executor.cfg broken in trunk and branch-2 |
Blocker |
nodemanager |
Varun Vasudev |
Varun Vasudev |
HADOOP-12175 |
FsShell must load SpanReceiverHost to support tracing |
Major |
tracing |
Masatake Iwasaki |
Masatake Iwasaki |
HDFS-8670 |
Better to exclude decommissioned nodes for namenode NodeUsage JMX |
Major |
. |
Ming Ma |
J.Andreina |
HADOOP-10945 |
4-digit octal umask permissions throws a parse error |
Major |
fs |
Jason Lowe |
Chang Li |
YARN-3919 |
NPEs’ while stopping service after exception during CommonNodeLabelsManager#start |
Trivial |
resourcemanager |
Varun Saxena |
Varun Saxena |
YARN-3963 |
AddNodeLabel on duplicate label addition shows success |
Minor |
. |
Bibin A Chundatt |
Bibin A Chundatt |
YARN-3990 |
AsyncDispatcher may overloaded with RMAppNodeUpdateEvent when Node is connected/disconnected |
Critical |
resourcemanager |
Rohith Sharma K S |
Bibin A Chundatt |
HDFS-6860 |
BlockStateChange logs are too noisy |
Major |
namenode |
Arpit Agarwal |
Chang Li |
HADOOP-12268 |
AbstractContractAppendTest#testRenameFileBeingAppended misses rename operation. |
Major |
test |
zhihai xu |
zhihai xu |
HDFS-8847 |
change TestHDFSContractAppend to not override testRenameFileBeingAppended method. |
Major |
test |
zhihai xu |
zhihai xu |
HDFS-8850 |
VolumeScanner thread exits with exception if there is no block pool to be scanned but there are suspicious blocks |
Major |
datanode |
Colin P. McCabe |
Colin P. McCabe |
HDFS-8844 |
TestHDFSCLI does not cleanup the test directory |
Minor |
test |
Akira Ajisaka |
Masatake Iwasaki |
HADOOP-12274 |
Remove direct download link from BUILDING.txt |
Minor |
documentation |
Caleb Severn |
Caleb Severn |
HADOOP-12302 |
Fix native compilation on Windows after HADOOP-7824 |
Blocker |
. |
Vinayakumar B |
Vinayakumar B |
YARN-3983 |
Make CapacityScheduler to easier extend application allocation logic |
Major |
. |
Wangda Tan |
Wangda Tan |
HADOOP-12304 |
Applications using FileContext fail with the default file system configured to be wasb/s3/etc. |
Blocker |
fs |
Chris Nauroth |
Chris Nauroth |
HADOOP-11932 |
MetricsSinkAdapter hangs when being stopped |
Critical |
. |
Jian He |
Brahma Reddy Battula |
MAPREDUCE-6257 |
Document encrypted spills |
Major |
security |
Allen Wittenauer |
Bibin A Chundatt |
HDFS-8856 |
Make LeaseManager#countPath O(1) |
Major |
namenode |
Arpit Agarwal |
Arpit Agarwal |
HDFS-8772 |
Fix TestStandbyIsHot#testDatanodeRestarts which occasionally fails |
Major |
. |
Walter Su |
Walter Su |
YARN-3966 |
Fix excessive loggings in CapacityScheduler |
Major |
. |
Jian He |
Jian He |
HDFS-8866 |
Typo in docs: Rumtime -> Runtime |
Trivial |
documentation, webhdfs |
Jakob Homan |
Gabor Liptak |
YARN-3999 |
RM hangs on draining events |
Major |
. |
Jian He |
Jian He |
YARN-4026 |
FiCaSchedulerApp: ContainerAllocator should be able to choose how to order pending resource requests |
Major |
. |
Wangda Tan |
Wangda Tan |
HDFS-8879 |
Quota by storage type usage incorrectly initialized upon namenode restart |
Major |
namenode |
Kihwal Lee |
Xiaoyu Yao |
HADOOP-12258 |
Need translate java.nio.file.NoSuchFileException to FileNotFoundException to avoid regression |
Critical |
fs |
zhihai xu |
zhihai xu |
YARN-4005 |
Completed container whose app is finished is not removed from NMStateStore |
Major |
. |
Jun Gong |
Jun Gong |
YARN-4047 |
ClientRMService getApplications has high scheduler lock contention |
Major |
resourcemanager |
Jason Lowe |
Jason Lowe |
YARN-3987 |
am container complete msg ack to NM once RM receive it |
Major |
resourcemanager |
sandflee |
sandflee |
HADOOP-12322 |
typos in rpcmetrics.java |
Trivial |
ipc |
Anu Engineer |
Anu Engineer |
HDFS-8565 |
Typo in dfshealth.html - “Decomissioning” |
Trivial |
. |
nijel |
nijel |
MAPREDUCE-5817 |
Mappers get rescheduled on node transition even after all reducers are completed |
Major |
applicationmaster |
Sangjin Lee |
Sangjin Lee |
HDFS-8891 |
HDFS concat should keep srcs order |
Blocker |
. |
Yong Zhang |
Yong Zhang |
MAPREDUCE-6439 |
AM may fail instead of retrying if RM shuts down during the allocate call |
Critical |
. |
Anubhav Dhoot |
Anubhav Dhoot |
HDFS-8845 |
DiskChecker should not traverse the entire tree |
Major |
. |
Chang Li |
Chang Li |
HDFS-8852 |
HDFS architecture documentation of version 2.x is outdated about append write support |
Major |
documentation |
Hong Dai Thanh |
Ajith S |
YARN-3857 |
Memory leak in ResourceManager with SIMPLE mode |
Critical |
resourcemanager |
mujunchao |
mujunchao |
YARN-4028 |
AppBlock page key update and diagnostics value null on recovery |
Minor |
. |
Bibin A Chundatt |
Bibin A Chundatt |
HDFS-8908 |
TestAppendSnapshotTruncate may fail with IOException: Failed to replace a bad datanode |
Minor |
test |
Tsz Wo Nicholas Sze |
Tsz Wo Nicholas Sze |
HDFS-8867 |
Enable optimized block reports |
Major |
. |
Rushabh S Shah |
Daryn Sharp |
HADOOP-12317 |
Applications fail on NM restart on some linux distro because NM container recovery declares AM container as LOST |
Critical |
. |
Anubhav Dhoot |
Anubhav Dhoot |
HDFS-8863 |
The remaining space check in BlockPlacementPolicyDefault is flawed |
Critical |
. |
Kihwal Lee |
Kihwal Lee |
HDFS-8922 |
Link the native_mini_dfs test library with libdl, since IBM Java requires it |
Major |
build |
Ayappan |
Ayappan |
HDFS-8809 |
HDFS fsck reports under construction blocks as “CORRUPT” |
Major |
tools |
Sudhir Prakash |
Jing Zhao |
MAPREDUCE-6357 |
MultipleOutputs.write() API should document that output committing is not utilized when input path is absolute |
Major |
documentation |
Ivan Mitic |
Dustin Cote |
YARN-3986 |
getTransferredContainers in AbstractYarnScheduler should be present in YarnScheduler interface instead |
Major |
scheduler |
Varun Saxena |
Varun Saxena |
HADOOP-12347 |
Fix mismatch parameter name in javadocs of AuthToken#setMaxInactives |
Trivial |
. |
Xiaoyu Yao |
Xiaoyu Yao |
HDFS-8942 |
Update hyperlink to rack awareness page in HDFS Architecture documentation |
Trivial |
documentation |
Masatake Iwasaki |
Masatake Iwasaki |
YARN-3896 |
RMNode transitioned from RUNNING to REBOOTED because its response id had not been reset synchronously |
Major |
resourcemanager |
Jun Gong |
Jun Gong |
HDFS-8930 |
Block report lease may leak if the 2nd full block report comes when NN is still in safemode |
Minor |
. |
Jing Zhao |
Jing Zhao |
HDFS-8932 |
NPE thrown in NameNode when try to get “TotalSyncCount” metric before editLogStream initialization |
Major |
. |
Surendra Singh Lilhore |
Surendra Singh Lilhore |
HADOOP-12352 |
Delay in checkpointing Trash can leave trash for 2 intervals before deleting |
Trivial |
trash |
Casey Brotherton |
Casey Brotherton |
HDFS-8846 |
Add a unit test for INotify functionality across a layout version upgrade |
Major |
namenode |
Zhe Zhang |
Zhe Zhang |
HDFS-8896 |
DataNode object isn’t GCed when shutdown, because it has GC root in ShutdownHookManager |
Minor |
test |
Walter Su |
Walter Su |
HDFS-8961 |
Surpress findbug warnings of o.a.h.hdfs.shortcircuit.DfsClientShmManager.EndpointShmManager in hdfs-client |
Major |
. |
Haohui Mai |
Mingliang Liu |
HADOOP-12362 |
Set hadoop.tmp.dir and hadoop.log.dir in pom |
Major |
. |
Charlie Helin |
Charlie Helin |
HDFS-8969 |
Clean up findbugs warnings for HDFS-8823 and HDFS-8932 |
Major |
namenode |
Anu Engineer |
Anu Engineer |
HDFS-8963 |
Fix incorrect sign extension of xattr length in HDFS-8900 |
Critical |
. |
Haohui Mai |
Colin P. McCabe |
YARN-1556 |
NPE getting application report with a null appId |
Minor |
client |
Steve Loughran |
Weiwei Yang |
MAPREDUCE-6452 |
NPE when intermediate encrypt enabled for LocalRunner |
Major |
. |
Bibin A Chundatt |
zhihai xu |
HDFS-8950 |
NameNode refresh doesn’t remove DataNodes that are no longer in the allowed list |
Major |
datanode, namenode |
Daniel Templeton |
Daniel Templeton |
HADOOP-12346 |
Increase some default timeouts / retries for S3a connector |
Major |
fs/s3 |
Sean Mackrory |
Sean Mackrory |
HADOOP-12359 |
hadoop fs -getmerge doc is wrong |
Major |
documentation |
Daniel Templeton |
Jagadesh Kiran N |
HADOOP-10365 |
BufferedOutputStream in FileUtil#unpackEntries() should be closed in finally block |
Minor |
util |
Ted Yu |
Kiran Kumar M R |
HDFS-8995 |
Flaw in registration bookeeping can make DN die on reconnect |
Critical |
. |
Kihwal Lee |
Kihwal Lee |
HDFS-8388 |
Time and Date format need to be in sync in NameNode UI page |
Minor |
. |
Archana T |
Surendra Singh Lilhore |
YARN-4073 |
Unused ApplicationACLsManager in ContainerManagerImpl |
Trivial |
. |
Naganarasimha G R |
Naganarasimha G R |
HDFS-9003 |
ForkJoin thread pool leaks |
Major |
. |
Kihwal Lee |
Kihwal Lee |
HDFS-8885 |
ByteRangeInputStream used in webhdfs does not override available() |
Minor |
webhdfs |
Shradha Revankar |
Shradha Revankar |
HADOOP-10318 |
Incorrect reference to nodeFile in RumenToSLSConverter error message |
Minor |
. |
Ted Yu |
Wei Yan |
HADOOP-12213 |
Interrupted exception can occur when Client#stop is called |
Minor |
. |
Oleg Zhurakousky |
Kuhu Shukla |
HDFS-9009 |
Send metrics logs to NullAppender by default |
Major |
logging |
Arpit Agarwal |
Arpit Agarwal |
HDFS-8964 |
When validating the edit log, do not read at or beyond the file offset that is being written |
Major |
journal-node, namenode |
Zhe Zhang |
Zhe Zhang |
HDFS-8939 |
Test(S)WebHdfsFileContextMainOperations failing on branch-2 |
Major |
webhdfs |
Jakob Homan |
Chris Nauroth |
YARN-4103 |
RM WebServices missing scheme for appattempts logLinks |
Major |
. |
Jonathan Eagles |
Jonathan Eagles |
YARN-4105 |
Capacity Scheduler headroom for DRF is wrong |
Major |
capacityscheduler |
Chang Li |
Chang Li |
MAPREDUCE-6442 |
Stack trace is missing when error occurs in client protocol provider’s constructor |
Major |
client |
Chang Li |
Chang Li |
YARN-3591 |
Resource localization on a bad disk causes subsequent containers failure |
Major |
. |
Lavkesh Lahngir |
Lavkesh Lahngir |
YARN-4121 |
Typos in capacity scheduler documentation. |
Trivial |
documentation |
Kai Sasaki |
Kai Sasaki |
YARN-4096 |
App local logs are leaked if log aggregation fails to initialize for the app |
Major |
log-aggregation, nodemanager |
Jason Lowe |
Jason Lowe |
HADOOP-12388 |
Fix components’ version information in the web page ‘About the Cluster’ |
Minor |
util |
Jun Gong |
Jun Gong |
HDFS-9033 |
dfsadmin -metasave prints “NaN” for cache used% |
Major |
. |
Archana T |
Brahma Reddy Battula |
HDFS-8716 |
introduce a new config specifically for safe mode block count |
Major |
. |
Chang Li |
Chang Li |
HDFS-8581 |
ContentSummary on / skips further counts on yielding lock |
Minor |
namenode |
tongshiquan |
J.Andreina |
HDFS-6763 |
Initialize file system-wide quota once on transitioning to active |
Major |
ha, namenode |
Daryn Sharp |
Kihwal Lee |
MAPREDUCE-6474 |
ShuffleHandler can possibly exhaust nodemanager file descriptors |
Major |
mrv2, nodemanager |
Nathan Roberts |
Kuhu Shukla |
YARN-4106 |
NodeLabels for NM in distributed mode is not updated even after clusterNodelabel addition in RM |
Major |
. |
Bibin A Chundatt |
Bibin A Chundatt |
YARN-4115 |
Reduce loglevel of ContainerManagementProtocolProxy to Debug |
Minor |
. |
Anubhav Dhoot |
Anubhav Dhoot |
HADOOP-12348 |
MetricsSystemImpl creates MetricsSourceAdapter with wrong time unit parameter. |
Major |
metrics |
zhihai xu |
zhihai xu |
HDFS-9042 |
Update document for the Storage policy name |
Minor |
documentation |
J.Andreina |
J.Andreina |
HDFS-9036 |
In BlockPlacementPolicyWithNodeGroup#chooseLocalStorage , random node is selected eventhough fallbackToLocalRack is true. |
Major |
. |
J.Andreina |
J.Andreina |
HADOOP-12407 |
Test failing: hadoop.ipc.TestSaslRPC |
Critical |
security, test |
Steve Loughran |
Steve Loughran |
HADOOP-12087 |
[JDK8] Fix javadoc errors caused by incorrect or illegal tags |
Major |
documentation |
Akira Ajisaka |
Akira Ajisaka |
HDFS-9069 |
TestNameNodeMetricsLogger failing -port in use |
Critical |
test |
Steve Loughran |
Steve Loughran |
HDFS-8996 |
Consolidate validateLog and scanLog in FJM#EditLogFile |
Major |
journal-node, namenode |
Zhe Zhang |
Zhe Zhang |
YARN-4151 |
Fix findbugs errors in hadoop-yarn-server-common module |
Major |
. |
MENG DING |
MENG DING |
HDFS-9067 |
o.a.h.hdfs.server.datanode.fsdataset.impl.TestLazyWriter is failing in trunk |
Critical |
. |
Haohui Mai |
Surendra Singh Lilhore |
MAPREDUCE-6472 |
MapReduce AM should have java.io.tmpdir=./tmp to be consistent with tasks |
Major |
mr-am |
Jason Lowe |
Naganarasimha G R |
HADOOP-12374 |
Description of hdfs expunge command is confusing |
Major |
documentation, trash |
Weiwei Yang |
Weiwei Yang |
YARN-4078 |
getPendingResourceRequestForAttempt is present in AbstractYarnScheduler should be present in YarnScheduler interface instead |
Minor |
resourcemanager |
Naganarasimha G R |
Naganarasimha G R |
HDFS-9072 |
Fix random failures in TestJMXGet |
Critical |
test |
J.Andreina |
J.Andreina |
HDFS-9073 |
Fix failures in TestLazyPersistLockedMemory#testReleaseOnEviction |
Critical |
test |
J.Andreina |
J.Andreina |
YARN-3433 |
Jersey tests failing with Port in Use -again |
Critical |
build, test |
Steve Loughran |
Brahma Reddy Battula |
HADOOP-12417 |
TestWebDelegationToken failing with port in use |
Major |
test |
Steve Loughran |
Mingliang Liu |
MAPREDUCE-6481 |
LineRecordReader may give incomplete record and wrong position/key information for uncompressed input sometimes. |
Critical |
mrv2 |
zhihai xu |
zhihai xu |
MAPREDUCE-5002 |
AM could potentially allocate a reduce container to a map attempt |
Major |
mr-am |
Jason Lowe |
Chang Li |
MAPREDUCE-5982 |
Task attempts that fail from the ASSIGNED state can disappear |
Major |
mr-am |
Jason Lowe |
Chang Li |
HADOOP-12386 |
RetryPolicies.RETRY_FOREVER should be able to specify a retry interval |
Major |
. |
Wangda Tan |
Sunil G |
YARN-3697 |
FairScheduler: ContinuousSchedulingThread can fail to shutdown |
Critical |
fairscheduler |
zhihai xu |
zhihai xu |
HDFS-6955 |
DN should reserve disk space for a full block when creating tmp files |
Major |
datanode |
Arpit Agarwal |
Kanaka Kumar Avvaru |
HDFS-5802 |
NameNode does not check for inode type before traversing down a path |
Trivial |
namenode |
Harsh J |
Xiao Chen |
MAPREDUCE-6460 |
TestRMContainerAllocator.testAttemptNotFoundCausesRMCommunicatorException fails |
Major |
test |
zhihai xu |
zhihai xu |
YARN-4167 |
NPE on RMActiveServices#serviceStop when store is null |
Minor |
. |
Bibin A Chundatt |
Bibin A Chundatt |
YARN-4113 |
RM should respect retry-interval when uses RetryPolicies.RETRY_FOREVER |
Critical |
. |
Wangda Tan |
Sunil G |
YARN-4188 |
MoveApplicationAcrossQueuesResponse should be an abstract class |
Minor |
resourcemanager |
Giovanni Matteo Fumarola |
Giovanni Matteo Fumarola |
HDFS-9043 |
Doc updation for commands in HDFS Federation |
Minor |
documentation |
J.Andreina |
J.Andreina |
HDFS-9013 |
Deprecate NameNodeMXBean#getNNStarted in branch2 and remove from trunk |
Major |
namenode |
Surendra Singh Lilhore |
Surendra Singh Lilhore |
YARN-3975 |
WebAppProxyServlet should not redirect to RM page if AHS is enabled |
Major |
. |
Mit Desai |
Mit Desai |
HADOOP-12438 |
Reset RawLocalFileSystem.useDeprecatedFileStatus in TestLocalFileSystem |
Trivial |
test |
Chris Nauroth |
Chris Nauroth |
HDFS-9128 |
TestWebHdfsFileContextMainOperations and TestSWebHdfsFileContextMainOperations fail due to invalid HDFS path on Windows. |
Trivial |
test |
Chris Nauroth |
Chris Nauroth |
YARN-4152 |
NM crash with NPE when LogAggregationService#stopContainer called for absent container |
Critical |
log-aggregation, nodemanager |
Bibin A Chundatt |
Bibin A Chundatt |
YARN-4044 |
Running applications information changes such as movequeue is not published to TimeLine server |
Critical |
resourcemanager, timelineserver |
Sunil G |
Sunil G |
HDFS-9076 |
Log full path instead of inodeId in DFSClient#closeAllFilesBeingWritten() |
Major |
hdfs-client |
Surendra Singh Lilhore |
Surendra Singh Lilhore |
MAPREDUCE-6484 |
Yarn Client uses local address instead of RM address as token renewer in a secure cluster when RM HA is enabled. |
Major |
client, security |
zhihai xu |
zhihai xu |
HADOOP-12437 |
Allow SecurityUtil to lookup alternate hostnames |
Major |
net, security |
Arpit Agarwal |
Arpit Agarwal |
HADOOP-12252 |
LocalDirAllocator should not throw NPE with empty string configuration. |
Minor |
fs |
zhihai xu |
zhihai xu |
YARN-3624 |
ApplicationHistoryServer reverses the order of the filters it gets |
Major |
timelineserver |
Mit Desai |
Mit Desai |
HDFS-9123 |
Copying from the root to a subdirectory should be forbidden |
Minor |
fs |
Wei-Chiu Chuang |
Wei-Chiu Chuang |
MAPREDUCE-6480 |
archive-logs tool may miss applications |
Major |
. |
Robert Kanter |
Robert Kanter |
HDFS-9107 |
Prevent NN’s unrecoverable death spiral after full GC |
Critical |
namenode |
Daryn Sharp |
Daryn Sharp |
HDFS-9133 |
ExternalBlockReader and ReplicaAccessor need to return -1 on read when at EOF |
Major |
hdfs-client |
Colin P. McCabe |
Colin P. McCabe |
HDFS-9080 |
update htrace version to 4.0.1 |
Major |
tracing |
Colin P. McCabe |
Colin P. McCabe |
YARN-4204 |
ConcurrentModificationException in FairSchedulerQueueInfo |
Major |
. |
Anubhav Dhoot |
Anubhav Dhoot |
HDFS-9106 |
Transfer failure during pipeline recovery causes permanent write failures |
Critical |
. |
Kihwal Lee |
Kihwal Lee |
HDFS-9147 |
Fix the setting of visibleLength in ExternalBlockReader |
Major |
hdfs-client |
Colin P. McCabe |
Colin P. McCabe |
MAPREDUCE-6492 |
AsyncDispatcher exit with NPE on TaskAttemptImpl#sendJHStartEventForAssignedFailTask |
Critical |
. |
Bibin A Chundatt |
Bibin A Chundatt |
HADOOP-12440 |
TestRPC#testRPCServerShutdown did not produce the desired thread states before shutting down |
Minor |
. |
Xiao Chen |
Xiao Chen |
HDFS-9092 |
Nfs silently drops overlapping write requests and causes data copying to fail |
Major |
nfs |
Yongjun Zhang |
Yongjun Zhang |
YARN-4180 |
AMLauncher does not retry on failures when talking to NM |
Critical |
resourcemanager |
Anubhav Dhoot |
Anubhav Dhoot |
HDFS-9141 |
Thread leak in Datanode#refreshVolumes |
Major |
datanode |
Uma Maheswara Rao G |
Uma Maheswara Rao G |
YARN-4066 |
Large number of queues choke fair scheduler |
Major |
fairscheduler |
Johan Gustavsson |
Johan Gustavsson |
HADOOP-12447 |
Clean up some htrace integration issues |
Major |
tracing |
Colin P. McCabe |
Colin P. McCabe |
HDFS-9174 |
Fix findbugs warnings in FSOutputSummer.tracer and DirectoryScanner$ReportCompiler.currentThread |
Critical |
. |
Yi Liu |
Yi Liu |
HDFS-9001 |
DFSUtil.getNsServiceRpcUris() can return too many entries in a non-HA, non-federated cluster |
Major |
. |
Daniel Templeton |
Daniel Templeton |
HADOOP-12448 |
TestTextCommand: use mkdirs rather than mkdir to create test directory |
Major |
test |
Colin P. McCabe |
Colin P. McCabe |
MAPREDUCE-6494 |
Permission issue when running archive-logs tool as different users |
Major |
. |
Robert Kanter |
Robert Kanter |
MAPREDUCE-6497 |
Fix wrong value of JOB_FINISHED event in JobHistoryEventHandler |
Major |
. |
Shinichi Yamashita |
Shinichi Yamashita |
HADOOP-10296 |
Incorrect null check in SwiftRestClient#buildException() |
Minor |
. |
Ted Yu |
Kanaka Kumar Avvaru |
HADOOP-8437 |
getLocalPathForWrite should throw IOException for invalid paths |
Major |
fs |
Brahma Reddy Battula |
Brahma Reddy Battula |
MAPREDUCE-6485 |
MR job hanged forever because all resources are taken up by reducers and the last map attempt never get resource to run |
Critical |
applicationmaster |
Bob.zhao |
Xianyin Xin |
HDFS-9185 |
Fix null tracer in ErasureCodingWorker |
Critical |
erasure-coding |
Rakesh R |
Rakesh R |
HDFS-9191 |
Typo in Hdfs.java. NoSuchElementException is misspelled |
Trivial |
documentation |
Catherine Palmer |
Catherine Palmer |
HDFS-9100 |
HDFS Balancer does not respect dfs.client.use.datanode.hostname |
Major |
balancer & mover |
Yongjun Zhang |
Casey Brotherton |
YARN-3619 |
ContainerMetrics unregisters during getMetrics and leads to ConcurrentModificationException |
Major |
nodemanager |
Jason Lowe |
zhihai xu |
HDFS-9193 |
Fix incorrect references the usages of the DN in dfshealth.js |
Minor |
. |
Chang Li |
Chang Li |
HADOOP-11098 |
[JDK8] Max Non Heap Memory default changed between JDK7 and 8 |
Major |
. |
Travis Thompson |
Tsuyoshi Ozawa |
HADOOP-12441 |
Fix kill command behavior under some Linux distributions. |
Critical |
. |
Wangda Tan |
Wangda Tan |
HADOOP-12452 |
Fix tracing documention reflecting the update to htrace-4 |
Major |
documentation |
Masatake Iwasaki |
Masatake Iwasaki |
YARN-4176 |
Resync NM nodelabels with RM periodically for distributed nodelabels |
Major |
. |
Bibin A Chundatt |
Bibin A Chundatt |
HDFS-7899 |
Improve EOF error message |
Minor |
hdfs-client |
Harsh J |
Jagadesh Kiran N |
MAPREDUCE-6503 |
archive-logs tool should use HADOOP_PREFIX instead of HADOOP_HOME |
Major |
. |
Robert Kanter |
Robert Kanter |
YARN-4209 |
RMStateStore FENCED state doesn’t work due to updateFencedState called by stateMachine.doTransition |
Critical |
resourcemanager |
zhihai xu |
zhihai xu |
HDFS-9196 |
Fix TestWebHdfsContentLength |
Major |
. |
Tsuyoshi Ozawa |
Masatake Iwasaki |
HDFS-9178 |
Slow datanode I/O can cause a wrong node to be marked bad |
Critical |
. |
Kihwal Lee |
Kihwal Lee |
HDFS-9182 |
Cleanup the findbugs and other issues after HDFS EC merged to trunk. |
Critical |
erasure-coding |
Yi Liu |
Uma Maheswara Rao G |
HADOOP-12465 |
Incorrect javadoc in WritableUtils.java |
Minor |
documentation |
Martin Petricek |
Jagadesh Kiran N |
HDFS-9176 |
TestDirectoryScanner#testThrottling often fails. |
Minor |
test |
Yi Liu |
Daniel Templeton |
HDFS-9137 |
DeadLock between DataNode#refreshVolumes and BPOfferService#registrationSucceeded |
Major |
datanode |
Uma Maheswara Rao G |
Uma Maheswara Rao G |
HDFS-8164 |
cTime is 0 in VERSION file for newly formatted NameNode. |
Minor |
namenode |
Chris Nauroth |
Xiao Chen |
HDFS-9204 |
DatanodeDescriptor#PendingReplicationWithoutTargets is wrongly calculated |
Major |
. |
Jing Zhao |
Mingliang Liu |
HDFS-9217 |
Fix broken findbugsExcludeFile.xml for hadoop-hdfs-client module |
Critical |
build |
Mingliang Liu |
Mingliang Liu |
YARN-4235 |
FairScheduler PrimaryGroup does not handle empty groups returned for a user |
Major |
fairscheduler |
Anubhav Dhoot |
Anubhav Dhoot |
MAPREDUCE-6302 |
Preempt reducers after a configurable timeout irrespective of headroom |
Critical |
. |
mai shurong |
Karthik Kambatla |
HDFS-9142 |
Separating Configuration object for namenode(s) in MiniDFSCluster |
Major |
. |
Siqi Li |
Siqi Li |
HDFS-8941 |
DistributedFileSystem listCorruptFileBlocks API should resolve relative path |
Major |
hdfs-client |
Rakesh R |
Rakesh R |
HDFS-9222 |
Add hadoop-hdfs-client as a dependency of hadoop-hdfs-native-client |
Major |
. |
Haohui Mai |
Mingliang Liu |
YARN-4201 |
AMBlacklist does not work for minicluster |
Major |
resourcemanager |
Jun Gong |
Jun Gong |
HDFS-9215 |
Suppress the RAT warnings in hdfs-native-client module |
Minor |
. |
Haohui Mai |
Haohui Mai |
HDFS-9224 |
TestFileTruncate fails intermittently with BindException |
Major |
test |
Brahma Reddy Battula |
Brahma Reddy Battula |
YARN-4017 |
container-executor overuses PATH_MAX |
Major |
nodemanager |
Allen Wittenauer |
Sidharta Seethana |
HDFS-8676 |
Delayed rolling upgrade finalization can cause heartbeat expiration and write failures |
Critical |
. |
Kihwal Lee |
Walter Su |
HADOOP-12474 |
MiniKMS should use random ports for Jetty server by default |
Major |
. |
Mingliang Liu |
Mingliang Liu |
HADOOP-12449 |
TestDNS and TestNetUtils failing if no network |
Minor |
test |
Steve Loughran |
Steve Loughran |
HADOOP-11515 |
Upgrade jsch lib to jsch-0.1.51 to avoid problems running on java7 |
Major |
build |
Johannes Zillmann |
Tsuyoshi Ozawa |
HDFS-9235 |
hdfs-native-client build getting errors when built with cmake 2.6 |
Minor |
hdfs-client |
Eric Payne |
Eric Payne |
HDFS-8779 |
WebUI fails to display block IDs that are larger than 2^53 - 1 |
Minor |
webhdfs |
Walter Su |
Haohui Mai |
HDFS-9187 |
Fix null pointer error in Globber when FS was not constructed via FileSystem#createFileSystem |
Major |
tracing |
stack |
Colin P. McCabe |
HDFS-1172 |
Blocks in newly completed files are considered under-replicated too quickly |
Major |
namenode |
Todd Lipcon |
Masatake Iwasaki |
YARN-4250 |
NPE in AppSchedulingInfo#isRequestLabelChanged |
Major |
resourcemanager, scheduler |
Brahma Reddy Battula |
Brahma Reddy Battula |
HADOOP-12364 |
Deleting pid file after stop is causing the daemons to keep restarting |
Minor |
. |
Siqi Li |
Siqi Li |
HADOOP-12478 |
Shell.getWinUtilsPath() has been renamed Shell.getWinutilsPath() |
Critical |
util |
Steve Loughran |
Steve Loughran |
HDFS-9220 |
Reading small file (< 512 bytes) that is open for append fails due to incorrect checksum |
Blocker |
. |
Bogdan Raducanu |
Jing Zhao |
HADOOP-12479 |
ProtocMojo does not log the reason for a protoc compilation failure. |
Minor |
build |
Chris Nauroth |
Chris Nauroth |
HADOOP-11628 |
SPNEGO auth does not work with CNAMEs in JDK8 |
Blocker |
security |
Daryn Sharp |
Daryn Sharp |
YARN-2597 |
MiniYARNCluster should propagate reason for AHS not starting |
Major |
test |
Steve Loughran |
Steve Loughran |
YARN-4155 |
TestLogAggregationService.testLogAggregationServiceWithInterval failing |
Critical |
test |
Steve Loughran |
Bibin A Chundatt |
HADOOP-10941 |
Proxy user verification NPEs if remote host is unresolvable |
Critical |
ipc, security |
Daryn Sharp |
Benoy Antony |
HADOOP-12483 |
Maintain wrapped SASL ordering for postponed IPC responses |
Critical |
ipc |
Daryn Sharp |
Daryn Sharp |
HDFS-9237 |
NPE at TestDataNodeVolumeFailureToleration#tearDown |
Major |
test |
Brahma Reddy Battula |
Brahma Reddy Battula |
HADOOP-12464 |
Interrupted client may try to fail-over and retry |
Major |
ipc |
Kihwal Lee |
Kihwal Lee |
HADOOP-12493 |
bash unit tests are failing |
Major |
. |
Allen Wittenauer |
Allen Wittenauer |
YARN-4270 |
Limit application resource reservation on nodes for non-node/rack specific requests |
Major |
fairscheduler |
Arun Suresh |
Arun Suresh |
HDFS-9208 |
Disabling atime may fail clients like distCp |
Major |
. |
Kihwal Lee |
Kihwal Lee |
HDFS-9270 |
TestShortCircuitLocalRead should not leave socket after unit test |
Minor |
test |
Masatake Iwasaki |
Masatake Iwasaki |
HADOOP-12418 |
TestRPC.testRPCInterruptedSimple fails intermittently |
Major |
test |
Steve Loughran |
Kihwal Lee |
MAPREDUCE-6495 |
Docs for archive-logs tool |
Major |
documentation |
Robert Kanter |
Robert Kanter |
HDFS-3059 |
ssl-server.xml causes NullPointer |
Minor |
datanode, security |
Evert Lammerts |
Xiao Chen |
HDFS-9274 |
Default value of dfs.datanode.directoryscan.throttle.limit.ms.per.sec should be consistent |
Trivial |
datanode |
Yi Liu |
Yi Liu |
MAPREDUCE-6518 |
Set SO_KEEPALIVE on shuffle connections |
Major |
mrv2, nodemanager |
Nathan Roberts |
Chang Li |
HDFS-9225 |
Fix intermittent test failure of TestBlockManager.testBlocksAreNotUnderreplicatedInSingleRack |
Minor |
test |
Masatake Iwasaki |
Masatake Iwasaki |
HDFS-9273 |
ACLs on root directory may be lost after NN restart |
Critical |
namenode |
Xiao Chen |
Xiao Chen |
YARN-4000 |
RM crashes with NPE if leaf queue becomes parent queue during restart |
Major |
capacityscheduler, resourcemanager |
Jason Lowe |
Varun Saxena |
HADOOP-9692 |
Improving log message when SequenceFile reader throws EOFException on zero-length file |
Major |
. |
Chu Tong |
Zhe Zhang |
YARN-4256 |
YARN fair scheduler vcores with decimal values |
Minor |
fairscheduler |
Prabhu Joseph |
Jun Gong |
HADOOP-12484 |
Single File Rename Throws Incorrectly In Potential Race Condition Scenarios |
Major |
tools |
Gaurav Kanade |
Gaurav Kanade |
HDFS-9286 |
HttpFs does not parse ACL syntax correctly for operation REMOVEACLENTRIES |
Major |
fs |
Wei-Chiu Chuang |
Wei-Chiu Chuang |
YARN-4009 |
CORS support for ResourceManager REST API |
Major |
. |
Prakash Ramachandran |
Varun Vasudev |
YARN-4041 |
Slow delegation token renewal can severely prolong RM recovery |
Major |
resourcemanager |
Jason Lowe |
Sunil G |
HDFS-9290 |
DFSClient#callAppend() is not backward compatible for slightly older NameNodes |
Blocker |
. |
Tony Wu |
Tony Wu |
HDFS-9301 |
HDFS clients can’t construct HdfsConfiguration instances |
Major |
. |
Steve Loughran |
Mingliang Liu |
YARN-4294 |
[JDK8] Fix javadoc errors caused by wrong reference and illegal tag |
Blocker |
build, documentation |
Akira Ajisaka |
Akira Ajisaka |
YARN-4289 |
TestDistributedShell failing with bind exception |
Major |
test |
Brahma Reddy Battula |
Brahma Reddy Battula |
YARN-4296 |
DistributedShell Log.info is not friendly |
Major |
applications/distributed-shell |
Xiaowei Wang |
Xiaowei Wang |
YARN-4246 |
NPE while listing app attempt |
Major |
. |
Varun Saxena |
nijel |
YARN-4223 |
Findbugs warnings in hadoop-yarn-server-nodemanager project |
Minor |
nodemanager |
Varun Saxena |
Varun Saxena |
HADOOP-12513 |
Dockerfile lacks initial ‘apt-get update’ |
Trivial |
build |
Akihiro Suda |
Akihiro Suda |
YARN-4284 |
condition for AM blacklisting is too narrow |
Major |
resourcemanager |
Sangjin Lee |
Sangjin Lee |
HDFS-9268 |
fuse_dfs chown crashes when uid is passed as -1 |
Minor |
. |
Wei-Chiu Chuang |
Colin P. McCabe |
HDFS-9284 |
fsck command should not print exception trace when file not found |
Major |
. |
Jagadesh Kiran N |
Jagadesh Kiran N |
HDFS-9305 |
Delayed heartbeat processing causes storm of subsequent heartbeats |
Major |
datanode |
Chris Nauroth |
Arpit Agarwal |
YARN-4169 |
Fix racing condition of TestNodeStatusUpdaterForLabels |
Critical |
test |
Steve Loughran |
Naganarasimha G R |
YARN-4300 |
[JDK8] Fix javadoc errors caused by wrong tags |
Blocker |
build, documentation |
Akira Ajisaka |
Akira Ajisaka |
HADOOP-12515 |
Mockito dependency is missing in hadoop-kafka module |
Major |
test |
Kai Zheng |
Kai Zheng |
YARN-4302 |
SLS not able start due to NPE in SchedulerApplicationAttempt#getResourceUsageReport |
Major |
. |
Bibin A Chundatt |
Bibin A Chundatt |
HADOOP-12178 |
NPE during handling of SASL setup if problem with SASL resolver class |
Minor |
ipc |
Steve Loughran |
Steve Loughran |
HADOOP-12494 |
fetchdt stores the token based on token kind instead of token service |
Major |
. |
HeeSoo Kim |
HeeSoo Kim |
HADOOP-11685 |
StorageException complaining " no lease ID" during HBase distributed log splitting |
Major |
tools |
Duo Xu |
Duo Xu |
HDFS-9231 |
fsck doesn’t list correct file path when Bad Replicas/Blocks are in a snapshot |
Major |
snapshots |
Xiao Chen |
Xiao Chen |
HDFS-9302 |
WebHDFS truncate throws NullPointerException if newLength is not provided |
Minor |
webhdfs |
Karthik Palaniappan |
Jagadesh Kiran N |
YARN-4251 |
TestAMRMClientOnRMRestart#testAMRMClientOnAMRMTokenRollOverOnRMRestart is failing |
Major |
test |
Brahma Reddy Battula |
Brahma Reddy Battula |
HADOOP-12519 |
hadoop-azure tests should avoid creating a metrics configuration file in the module root directory. |
Minor |
fs/azure, test |
Chris Nauroth |
Chris Nauroth |
HDFS-9279 |
Decomissioned capacity should not be considered for configured/used capacity |
Major |
. |
Kuhu Shukla |
Kuhu Shukla |
HDFS-9044 |
Give Priority to FavouredNodes , before selecting nodes from FavouredNode’s Node Group |
Major |
. |
J.Andreina |
J.Andreina |
YARN-4130 |
Duplicate declaration of ApplicationId in RMAppManager#submitApplication method |
Trivial |
resourcemanager |
Kai Sasaki |
Kai Sasaki |
YARN-4288 |
NodeManager restart should keep retrying to register to RM while connection exception happens during RM failed over. |
Critical |
nodemanager |
Junping Du |
Junping Du |
MAPREDUCE-6515 |
Update Application priority in AM side from AM-RM heartbeat |
Major |
applicationmaster |
Sunil G |
Sunil G |
HDFS-9332 |
Fix Precondition failures from NameNodeEditLogRoller while saving namespace |
Major |
. |
Andrew Wang |
Andrew Wang |
YARN-4313 |
Race condition in MiniMRYarnCluster when getting history server address |
Major |
. |
Jian He |
Jian He |
YARN-4320 |
TestJobHistoryEventHandler fails as AHS in MiniYarnCluster no longer binds to default port 8188 |
Major |
. |
Varun Saxena |
Varun Saxena |
MAPREDUCE-6528 |
Memory leak for HistoryFileManager.getJobSummary() |
Critical |
jobhistoryserver |
Junping Du |
Junping Du |
MAPREDUCE-6451 |
DistCp has incorrect chunkFilePath for multiple jobs when strategy is dynamic |
Major |
distcp |
Kuhu Shukla |
Kuhu Shukla |
MAPREDUCE-6525 |
Fix test failure of TestMiniMRClientCluster.testRestart |
Minor |
test |
Masatake Iwasaki |
Masatake Iwasaki |
HADOOP-12533 |
Introduce FileNotFoundException in WASB for read and seek API |
Major |
tools |
Dushyanth |
Dushyanth |
HADOOP-12508 |
delete fails with exception when lease is held on blob |
Blocker |
fs/azure |
Gaurav Kanade |
Gaurav Kanade |
HDFS-9329 |
TestBootstrapStandby#testRateThrottling is flaky because fsimage size is smaller than IO buffer size |
Minor |
test |
Zhe Zhang |
Zhe Zhang |
HDFS-9313 |
Possible NullPointerException in BlockManager if no excess replica can be chosen |
Major |
. |
Ming Ma |
Ming Ma |
HADOOP-12542 |
TestDNS fails on Windows after HADOOP-12437. |
Major |
net |
Chris Nauroth |
Chris Nauroth |
YARN-4326 |
Fix TestDistributedShell timeout as AHS in MiniYarnCluster no longer binds to default port 8188 |
Major |
. |
MENG DING |
MENG DING |
HDFS-9289 |
Make DataStreamer#block thread safe and verify genStamp in commitBlock |
Critical |
. |
Chang Li |
Chang Li |
YARN-4127 |
RM fail with noAuth error if switched from failover mode to non-failover mode |
Major |
resourcemanager |
Jian He |
Varun Saxena |
HDFS-9351 |
checkNNStartup() need to be called when fsck calls FSNamesystem.getSnapshottableDirs() |
Major |
namenode |
Yongjun Zhang |
Xiao Chen |
HADOOP-12296 |
when setnetgrent returns 0 in linux, exception should be thrown |
Major |
. |
Chang Li |
Chang Li |
HDFS-9357 |
NN UI renders icons of decommissioned DN incorrectly |
Critical |
. |
Archana T |
Surendra Singh Lilhore |
HADOOP-12540 |
TestAzureFileSystemInstrumentation#testClientErrorMetrics fails intermittently due to assumption that a lease error will be thrown. |
Major |
fs/azure, test |
Chris Nauroth |
Gaurav Kanade |
HDFS-9360 |
Storage type usage isn’t updated properly after file deletion |
Major |
. |
Ming Ma |
Ming Ma |
HDFS-9378 |
hadoop-hdfs-client tests do not write logs. |
Minor |
test |
Chris Nauroth |
Chris Nauroth |
HDFS-4937 |
ReplicationMonitor can infinite-loop in BlockPlacementPolicyDefault#chooseRandom() |
Major |
namenode |
Kihwal Lee |
Kihwal Lee |
HDFS-9372 |
Remove dead code in DataStorage.recoverTransitionRead |
Major |
datanode |
Duo Zhang |
Duo Zhang |
MAPREDUCE-3914 |
Mismatched free() / delete / delete [] in HadoopPipes |
Major |
pipes |
Charles Earl |
Joe Mudd |
MAPREDUCE-1125 |
SerialUtils.cc: deserializeFloat is out of sync with SerialUtils.hh |
Major |
pipes |
Simone Leo |
Simone Leo |
HDFS-9384 |
TestWebHdfsContentLength intermittently hangs and fails due to TCP conversation mismatch between client and server. |
Minor |
test |
Chris Nauroth |
Chris Nauroth |
HDFS-6481 |
DatanodeManager#getDatanodeStorageInfos() should check the length of storageIDs |
Minor |
namenode |
Ted Yu |
Tsz Wo Nicholas Sze |
HDFS-9318 |
considerLoad factor can be improved |
Major |
. |
Kuhu Shukla |
Kuhu Shukla |
HDFS-9236 |
Missing sanity check for block size during block recovery |
Major |
datanode |
Tony Wu |
Tony Wu |
HDFS-9394 |
branch-2 hadoop-hdfs-client fails during FileSystem ServiceLoader initialization, because HftpFileSystem is missing. |
Critical |
hdfs-client |
Chris Nauroth |
Mingliang Liu |
HADOOP-12553 |
[JDK8] Fix javadoc error caused by illegal tag |
Blocker |
build, documentation |
Akira Ajisaka |
Akira Ajisaka |
MAPREDUCE-5763 |
Warn message about httpshuffle in NM logs |
Major |
. |
Sandy Ryza |
Akira Ajisaka |
HDFS-9383 |
TestByteArrayManager#testByteArrayManager fails |
Major |
. |
Kihwal Lee |
Tsz Wo Nicholas Sze |
HDFS-9249 |
NPE is thrown if an IOException is thrown in NameNode constructor |
Minor |
namenode |
Wei-Chiu Chuang |
Wei-Chiu Chuang |
HDFS-2261 |
AOP unit tests are not getting compiled or run |
Minor |
test |
Giridharan Kesavan |
Haohui Mai |
HDFS-9401 |
Fix findbugs warnings in BlockRecoveryWorker |
Major |
. |
Brahma Reddy Battula |
Brahma Reddy Battula |
HADOOP-12482 |
Race condition in JMX cache update |
Major |
. |
Tony Wu |
Tony Wu |
HDFS-9364 |
Unnecessary DNS resolution attempts when creating NameNodeProxies |
Major |
ha, performance |
Xiao Chen |
Xiao Chen |
HADOOP-12560 |
Fix sprintf warnings in {{DomainSocket.c}} introduced by HADOOP-12344 |
Major |
native |
Colin P. McCabe |
Mingliang Liu |
HDFS-9245 |
Fix findbugs warnings in hdfs-nfs/WriteCtx |
Major |
nfs |
Mingliang Liu |
Mingliang Liu |
YARN-4241 |
Fix typo of property name in yarn-default.xml |
Major |
documentation |
Anthony Rojas |
Anthony Rojas |
MAPREDUCE-6533 |
testDetermineCacheVisibilities of TestClientDistributedCacheManager is broken |
Major |
. |
Chang Li |
Chang Li |
HDFS-9396 |
Total files and directories on jmx and web UI on standby is uninitialized |
Blocker |
. |
Kihwal Lee |
Kihwal Lee |
MAPREDUCE-6540 |
TestMRTimelineEventHandling fails |
Major |
test |
Sangjin Lee |
Sangjin Lee |
YARN-4347 |
Resource manager fails with Null pointer exception |
Major |
yarn |
Yesha Vora |
Jian He |
HADOOP-12545 |
Hadoop javadoc has broken links for AccessControlList, ImpersonationProvider, DefaultImpersonationProvider, and DistCp |
Major |
documentation |
Mohammad Arshad |
Mohammad Arshad |
YARN-4354 |
Public resource localization fails with NPE |
Blocker |
nodemanager |
Jason Lowe |
Jason Lowe |
HDFS-9413 |
getContentSummary() on standby should throw StandbyException |
Critical |
. |
Brahma Reddy Battula |
Brahma Reddy Battula |
HDFS-9358 |
TestNodeCount#testNodeCount timed out |
Major |
test |
Wei-Chiu Chuang |
Masatake Iwasaki |
HDFS-9397 |
Fix typo for readChecksum() LOG.warn in BlockSender.java |
Trivial |
. |
Enrique Flores |
Enrique Flores |
HDFS-9400 |
TestRollingUpgradeRollback fails on branch-2. |
Blocker |
. |
Chris Nauroth |
Brahma Reddy Battula |
HDFS-9431 |
DistributedFileSystem#concat fails if the target path is relative. |
Major |
hdfs-client |
Kazuho Fujii |
Kazuho Fujii |
YARN-2859 |
ApplicationHistoryServer binds to default port 8188 in MiniYARNCluster |
Critical |
timelineserver |
Hitesh Shah |
Vinod Kumar Vavilapalli |
YARN-4374 |
RM capacity scheduler UI rounds user limit factor |
Major |
capacityscheduler |
Chang Li |
Chang Li |
YARN-3769 |
Consider user limit when calculating total pending resource for preemption policy in Capacity Scheduler |
Major |
capacityscheduler |
Eric Payne |
Eric Payne |
HDFS-9443 |
Disabling HDFS client socket cache causes logging message printed to console for CLI commands. |
Trivial |
hdfs-client |
Chris Nauroth |
Chris Nauroth |
HADOOP-11218 |
Add TLSv1.1,TLSv1.2 to KMS, HttpFS, SSLFactory |
Critical |
kms |
Robert Kanter |
Vijay Singh |
HADOOP-12467 |
Respect user-defined JAVA_LIBRARY_PATH in Windows Hadoop scripts |
Minor |
scripts |
Radhey Shah |
Radhey Shah |
HADOOP-12181 |
Fix intermittent test failure of TestZKSignerSecretProvider |
Minor |
. |
Masatake Iwasaki |
Masatake Iwasaki |
HDFS-6885 |
Fix wrong use of BytesWritable in FSEditLogOp#RenameOp |
Minor |
namenode |
Yi Liu |
Yi Liu |
HADOOP-12098 |
Remove redundant test dependencies in Hadoop Archives |
Minor |
. |
Varun Saxena |
Varun Saxena |
HDFS-7897 |
Shutdown metrics when stopping JournalNode |
Major |
. |
zhouyingchao |
zhouyingchao |
HADOOP-11149 |
Increase the timeout of TestZKFailoverController |
Major |
test |
Rajat Jain |
Steve Loughran |
HADOOP-11677 |
Add cookie flags for logs and static contexts |
Major |
. |
nijel |
nijel |
HDFS-9356 |
Decommissioning node does not have Last Contact value in the UI |
Major |
. |
Archana T |
Surendra Singh Lilhore |
HADOOP-12313 |
NPE in JvmPauseMonitor when calling stop() before start() |
Critical |
. |
Rohith Sharma K S |
Gabor Liptak |
HDFS-9428 |
Fix intermittent failure of TestDNFencing.testQueueingWithAppend |
Minor |
test |
Masatake Iwasaki |
Masatake Iwasaki |
HDFS-9435 |
TestBlockRecovery#testRBWReplicas is failing intermittently |
Major |
. |
Rakesh R |
Rakesh R |
HADOOP-12577 |
Bump up commons-collections version to 3.2.2 to address a security flaw |
Blocker |
build, security |
Wei-Chiu Chuang |
Wei-Chiu Chuang |
YARN-4344 |
NMs reconnecting with changed capabilities can lead to wrong cluster resource calculations |
Critical |
resourcemanager |
Varun Vasudev |
Varun Vasudev |
HADOOP-9822 |
create constant MAX_CAPACITY in RetryCache rather than hard-coding 16 in RetryCache constructor |
Minor |
. |
Tsuyoshi Ozawa |
Tsuyoshi Ozawa |
HDFS-9423 |
Fix intermittent failure of TestEditLogTailer |
Minor |
test |
Masatake Iwasaki |
Masatake Iwasaki |
YARN-4298 |
Fix findbugs warnings in hadoop-yarn-common |
Minor |
. |
Varun Saxena |
Sunil G |
YARN-4387 |
Fix typo in FairScheduler log message |
Minor |
fairscheduler |
Xin Wang |
Xin Wang |
HDFS-6101 |
TestReplaceDatanodeOnFailure fails occasionally |
Major |
test |
Arpit Agarwal |
Wei-Chiu Chuang |
HDFS-8855 |
Webhdfs client leaks active NameNode connections |
Major |
webhdfs |
Bob Hansen |
Xiaobing Zhou |
HDFS-8335 |
FSNamesystem should construct FSPermissionChecker only if permission is enabled |
Major |
. |
David Bryson |
Gabor Liptak |
MAPREDUCE-5883 |
“Total megabyte-seconds” in job counters is slightly misleading |
Minor |
. |
Nathan Roberts |
Nathan Roberts |
YARN-4365 |
FileSystemNodeLabelStore should check for root dir existence on startup |
Major |
resourcemanager |
Jason Lowe |
Kuhu Shukla |
HDFS-8807 |
dfs.datanode.data.dir does not handle spaces between storageType and URI correctly |
Major |
datanode |
Anu Engineer |
Anu Engineer |
HADOOP-12415 |
hdfs and nfs builds broken on -missing compile-time dependency on netty |
Major |
nfs |
Konstantin Boudnik |
Tom Zeng |
MAPREDUCE-6553 |
Replace ‘\u2b05’ with ‘<-’ in rendering job configuration |
Minor |
jobhistoryserver |
Akira Ajisaka |
Gabor Liptak |
MAPREDUCE-6555 |
TestMRAppMaster fails on trunk |
Major |
. |
Varun Saxena |
Junping Du |
HADOOP-12598 |
add XML namespace declarations for some hadoop/tools modules |
Minor |
build, tools |
Xin Wang |
Xin Wang |
YARN-4380 |
TestResourceLocalizationService.testDownloadingResourcesOnContainerKill fails intermittently |
Major |
test |
Tsuyoshi Ozawa |
Varun Saxena |
MAPREDUCE-6557 |
Some tests in mapreduce-client-app are writing outside of target |
Blocker |
build |
Allen Wittenauer |
Akira Ajisaka |
HDFS-9459 |
hadoop-hdfs-native-client fails test build on Windows after transition to ctest. |
Blocker |
build, test |
Chris Nauroth |
Chris Nauroth |
HDFS-9451 |
Clean up depreated umasks and related unit tests |
Major |
. |
Wei-Chiu Chuang |
Wei-Chiu Chuang |
HDFS-9407 |
TestFileTruncate fails with BindException |
Major |
test |
Brahma Reddy Battula |
Brahma Reddy Battula |
HDFS-9467 |
Fix data race accessing writeLockHeldTimeStamp in FSNamesystem |
Major |
namenode |
Mingliang Liu |
Mingliang Liu |
MAPREDUCE-6549 |
multibyte delimiters with LineRecordReader cause duplicate records |
Major |
mrv1, mrv2 |
Dustin Cote |
Wilfred Spiegelenburg |
MAPREDUCE-6550 |
archive-logs tool changes log ownership to the Yarn user when using DefaultContainerExecutor |
Major |
. |
Robert Kanter |
Robert Kanter |
HADOOP-12468 |
Partial group resolution failure should not result in user lockout |
Minor |
security |
Wei-Chiu Chuang |
Wei-Chiu Chuang |
HDFS-9426 |
Rollingupgrade finalization is not backward compatible |
Blocker |
. |
Kihwal Lee |
Kihwal Lee |
HADOOP-10406 |
TestIPC.testIpcWithReaderQueuing may fail |
Major |
ipc |
Tsz Wo Nicholas Sze |
Xiao Chen |
HDFS-9470 |
Encryption zone on root not loaded from fsimage after NN restart |
Critical |
. |
Xiao Chen |
Xiao Chen |
HDFS-9336 |
deleteSnapshot throws NPE when snapshotname is null |
Major |
. |
Brahma Reddy Battula |
Brahma Reddy Battula |
HADOOP-12609 |
Fix intermittent failure of TestDecayRpcScheduler |
Minor |
ipc, test |
Masatake Iwasaki |
Masatake Iwasaki |
HDFS-6533 |
TestBPOfferService#testBasicFunctionalitytest fails intermittently |
Major |
datanode, hdfs-client |
Yongjun Zhang |
Wei-Chiu Chuang |
YARN-4398 |
Yarn recover functionality causes the cluster running slowly and the cluster usage rate is far below 100 |
Major |
resourcemanager |
NING DING |
NING DING |
HDFS-9294 |
DFSClient deadlock when close file and failed to renew lease |
Blocker |
hdfs-client |
DENG FEI |
Brahma Reddy Battula |
HADOOP-12565 |
Replace DSA with RSA for SSH key type in SingleCluster.md |
Minor |
documentation |
Alexander Veit |
Mingliang Liu |
YARN-4408 |
NodeManager still reports negative running containers |
Major |
nodemanager |
Robert Kanter |
Robert Kanter |
HDFS-9430 |
Remove waitForLoadingFSImage since checkNNStartup has ensured image loaded and namenode started. |
Major |
. |
Brahma Reddy Battula |
Brahma Reddy Battula |
YARN-4392 |
ApplicationCreatedEvent event time resets after RM restart/failover |
Critical |
. |
Xuan Gong |
Naganarasimha G R |
YARN-4422 |
Generic AHS sometimes doesn’t show started, node, or logs on App page |
Major |
. |
Eric Payne |
Eric Payne |
YARN-4424 |
Fix deadlock in RMAppImpl |
Blocker |
. |
Yesha Vora |
Jian He |
HADOOP-12617 |
SPNEGO authentication request to non-default realm gets default realm name inserted in target server principal |
Major |
security |
Matt Foley |
Matt Foley |
YARN-4431 |
Not necessary to do unRegisterNM() if NM get stop due to failed to connect to RM |
Major |
nodemanager |
Junping Du |
Junping Du |
YARN-4421 |
Remove dead code in RmAppImpl.RMAppRecoveredTransition |
Trivial |
resourcemanager |
Daniel Templeton |
Daniel Templeton |
HADOOP-12618 |
NPE in TestSequenceFile |
Major |
test |
Brahma Reddy Battula |
Brahma Reddy Battula |
YARN-4434 |
NodeManager Disk Checker parameter documentation is not correct |
Minor |
documentation, nodemanager |
Takashi Ohnishi |
Weiwei Yang |
HADOOP-12602 |
TestMetricsSystemImpl#testQSize occasionally fail |
Major |
test |
Wei-Chiu Chuang |
Masatake Iwasaki |
HDFS-9519 |
Some coding improvement in SecondaryNameNode#main |
Major |
namenode |
Yongjun Zhang |
Xiao Chen |
HDFS-9514 |
TestDistributedFileSystem.testDFSClientPeerWriteTimeout failing; exception being swallowed |
Major |
hdfs-client, test |
Steve Loughran |
Wei-Chiu Chuang |
HDFS-9535 |
Newly completed blocks in IBR should not be considered under-replicated too quickly |
Major |
namenode |
Jing Zhao |
Mingliang Liu |
YARN-4418 |
AM Resource Limit per partition can be updated to ResourceUsage as well |
Major |
resourcemanager |
Sunil G |
Sunil G |
HADOOP-12638 |
UnsatisfiedLinkError while checking ISA-L in checknative command. |
Minor |
native |
Kai Sasaki |
Kai Sasaki |
YARN-4403 |
(AM/NM/Container)LivelinessMonitor should use monotonic time when calculating period |
Critical |
. |
Junping Du |
Junping Du |
YARN-4402 |
TestNodeManagerShutdown And TestNodeManagerResync fails with bind exception |
Major |
test |
Brahma Reddy Battula |
Brahma Reddy Battula |
YARN-4439 |
Clarify NMContainerStatus#toString method. |
Major |
. |
Jian He |
Jian He |
YARN-4440 |
FSAppAttempt#getAllowedLocalityLevelByTime should init the lastScheduler time |
Major |
fairscheduler |
Yiqun Lin |
Yiqun Lin |
HDFS-9516 |
truncate file fails with data dirs on multiple disks |
Major |
datanode |
Bogdan Raducanu |
Plamen Jeliazkov |
HDFS-8894 |
Set SO_KEEPALIVE on DN server sockets |
Major |
datanode |
Nathan Roberts |
Kanaka Kumar Avvaru |
HADOOP-12192 |
update releasedocmaker commands |
Blocker |
. |
Allen Wittenauer |
Allen Wittenauer |
YARN-4461 |
Redundant nodeLocalityDelay log in LeafQueue |
Trivial |
capacityscheduler |
Jason Lowe |
Eric Payne |
YARN-4452 |
NPE when submit Unmanaged application |
Critical |
. |
Naganarasimha G R |
Naganarasimha G R |
HDFS-9570 |
Minor typos, grammar, and case sensitivity cleanup in HdfsPermissionsGuide.md’s |
Trivial |
documentation |
Travis Campbell |
Travis Campbell |
HDFS-9565 |
TestDistributedFileSystem.testLocatedFileStatusStorageIdsTypes is flaky due to race condition |
Minor |
fs, test |
Wei-Chiu Chuang |
Wei-Chiu Chuang |
YARN-4225 |
Add preemption status to yarn queue -status for capacity scheduler |
Minor |
capacity scheduler, yarn |
Eric Payne |
Eric Payne |
HADOOP-12615 |
Fix NPE in MiniKMS.start() |
Minor |
kms, test |
Wei-Chiu Chuang |
Wei-Chiu Chuang |
HDFS-9515 |
NPE when MiniDFSCluster#shutdown is invoked on uninitialized reference |
Minor |
. |
Wei-Chiu Chuang |
Wei-Chiu Chuang |
HDFS-9572 |
Prevent DataNode log spam if a client connects on the data transfer port but sends no data. |
Major |
datanode |
Chris Nauroth |
Chris Nauroth |
HDFS-9533 |
seen_txid in the shared edits directory is modified during bootstrapping |
Major |
ha, namenode |
Kihwal Lee |
Kihwal Lee |
HDFS-9571 |
Fix ASF Licence warnings in Jenkins reports |
Major |
test |
Brahma Reddy Battula |
Brahma Reddy Battula |
HDFS-9393 |
After choosing favored nodes, choosing nodes for remaining replicas should go through BlockPlacementPolicy |
Major |
. |
J.Andreina |
J.Andreina |
HADOOP-12647 |
Add /usr/lib default for ISAL library and fix missing .c file in CMakeLists |
Major |
. |
Kai Zheng |
Kai Zheng |
HDFS-9347 |
Invariant assumption in TestQuorumJournalManager.shutdown() is wrong |
Major |
test |
Wei-Chiu Chuang |
Wei-Chiu Chuang |
HADOOP-12656 |
MiniKdc throws “address in use” BindException |
Major |
. |
Wei-Chiu Chuang |
Wei-Chiu Chuang |
HADOOP-12636 |
Prevent ServiceLoader failure init for unused FileSystems |
Major |
fs |
Íñigo Goiri |
Íñigo Goiri |
MAPREDUCE-6583 |
Clarify confusing sentence in MapReduce tutorial document |
Minor |
documentation |
chris snow |
Kai Sasaki |
HDFS-9505 |
HDFS Architecture documentation needs to be refreshed. |
Major |
documentation |
Chris Nauroth |
Masatake Iwasaki |
YARN-4454 |
NM to nodelabel mapping going wrong after RM restart |
Critical |
. |
Bibin A Chundatt |
Bibin A Chundatt |
HDFS-9580 |
TestComputeInvalidateWork#testDatanodeReRegistration failed due to unexpected number of invalidate blocks. |
Major |
datanode, namenode, test |
Wei-Chiu Chuang |
Wei-Chiu Chuang |
YARN-4477 |
FairScheduler: Handle condition which can result in an infinite loop in attemptScheduling. |
Major |
fairscheduler |
Tao Jie |
Tao Jie |
HDFS-9589 |
Block files which have been hardlinked should be duplicated before the DataNode appends to the them |
Major |
datanode |
Colin P. McCabe |
Colin P. McCabe |
HDFS-9458 |
TestBackupNode always binds to port 50070, which can cause bind failures. |
Major |
test |
Chris Nauroth |
Xiao Chen |
YARN-4109 |
Exception on RM scheduler page loading with labels |
Minor |
. |
Bibin A Chundatt |
Mohammad Shahid Khan |
YARN-4156 |
TestAMRestart#testAMBlacklistPreventsRestartOnSameNode assumes CapacityScheduler |
Major |
. |
Anubhav Dhoot |
Anubhav Dhoot |
MAPREDUCE-6419 |
JobHistoryServer doesn’t sort properly based on Job ID when Job id’s exceed 9999 |
Major |
webapps |
Devaraj K |
Mohammad Shahid Khan |
HDFS-9597 |
BaseReplicationPolicyTest should update data node stats after adding a data node |
Minor |
datanode, test |
Wei-Chiu Chuang |
Wei-Chiu Chuang |
HDFS-7163 |
WebHdfsFileSystem should retry reads according to the configured retry policy. |
Major |
webhdfs |
Eric Payne |
Eric Payne |
HADOOP-12559 |
KMS connection failures should trigger TGT renewal |
Major |
security |
Zhe Zhang |
Zhe Zhang |
MAPREDUCE-6574 |
MR AM should print host of failed tasks. |
Major |
. |
Wangda Tan |
Mohammad Shahid Khan |
YARN-4417 |
Make RM and Timeline-server REST APIs more consistent |
Major |
. |
Wangda Tan |
Wangda Tan |
MAPREDUCE-6589 |
TestTaskLog outputs a log under directory other than target/test-dir |
Major |
test |
Akira Ajisaka |
Akira Ajisaka |
YARN-4315 |
NaN in Queue percentage for cluster apps page |
Minor |
. |
Bibin A Chundatt |
Bibin A Chundatt |
HDFS-9376 |
TestSeveralNameNodes fails occasionally |
Major |
test |
Kihwal Lee |
Masatake Iwasaki |
YARN-1382 |
Remove unusableRMNodesConcurrentSet (never used) in NodeListManager to get rid of memory leak |
Major |
resourcemanager |
Alejandro Abdelnur |
Rohith Sharma K S |
HADOOP-12682 |
Fix TestKMS#testKMSRestart* failure |
Major |
. |
Wei-Chiu Chuang |
Wei-Chiu Chuang |
HADOOP-12608 |
Fix exception message in WASB when connecting with anonymous credential |
Major |
tools |
Dushyanth |
Dushyanth |
YARN-4524 |
Cleanup AppSchedulingInfo |
Major |
scheduler |
Karthik Kambatla |
Karthik Kambatla |
YARN-4522 |
Queue acl can be checked at app submission |
Major |
. |
Jian He |
Jian He |
YARN-4510 |
Fix SLS startup failure caused by NPE |
Critical |
. |
Bibin A Chundatt |
Bibin A Chundatt |
YARN-4530 |
LocalizedResource trigger a NPE Cause the NodeManager exit |
Major |
. |
tangshangwen |
tangshangwen |
MAPREDUCE-6593 |
TestJobHistoryEventHandler.testTimelineEventHandling fails on trunk because of NPE |
Major |
. |
Tsuyoshi Ozawa |
Naganarasimha G R |
HDFS-9445 |
Datanode may deadlock while handling a bad volume |
Blocker |
. |
Kihwal Lee |
Walter Su |
HADOOP-12658 |
Clear javadoc and check style issues around DomainSocket |
Trivial |
. |
Kai Zheng |
Kai Zheng |
HADOOP-12604 |
Exception may be swallowed in KMSClientProvider |
Major |
kms |
Yongjun Zhang |
Yongjun Zhang |
HDFS-9605 |
Add links to failed volumes to explorer.html in HDFS Web UI |
Minor |
. |
Archana T |
Archana T |
MAPREDUCE-6577 |
MR AM unable to load native library without MR_AM_ADMIN_USER_ENV set |
Critical |
mr-am |
Sangjin Lee |
Sangjin Lee |
HADOOP-12689 |
S3 filesystem operations stopped working correctly |
Major |
tools |
Matthew Paduano |
Matthew Paduano |
YARN-4546 |
ResourceManager crash due to scheduling opportunity overflow |
Critical |
resourcemanager |
Jason Lowe |
Jason Lowe |
HDFS-9615 |
Fix variable name typo in DFSConfigKeys |
Trivial |
. |
Ray Chiang |
Ray Chiang |
HADOOP-12634 |
Change Lazy Rename Pending Operation Completion of WASB to address case of potential data loss due to partial copy |
Critical |
. |
Gaurav Kanade |
Gaurav Kanade |
HDFS-9600 |
do not check replication if the block is under construction |
Critical |
. |
Phil Yang |
Phil Yang |
HDFS-9619 |
SimulatedFSDataset sometimes can not find blockpool for the correct namenode |
Major |
datanode, test |
Wei-Chiu Chuang |
Wei-Chiu Chuang |
HADOOP-12675 |
Fix description about retention period in usage of expunge command |
Minor |
documentation |
Masatake Iwasaki |
Masatake Iwasaki |
HADOOP-12655 |
TestHttpServer.testBindAddress bind port range is wider than expected |
Major |
. |
Wei-Chiu Chuang |
Wei-Chiu Chuang |
HADOOP-12613 |
TestFind.processArguments occasionally fails |
Major |
test |
Wei-Chiu Chuang |
Wei-Chiu Chuang |
HADOOP-12573 |
TestRPC.testClientBackOff failing |
Major |
test |
Steve Loughran |
Xiao Chen |
MAPREDUCE-6508 |
TestNetworkedJob fails consistently due to delegation token changes on RM. |
Major |
test |
Rohith Sharma K S |
Akira Ajisaka |
HDFS-9574 |
Reduce client failures during datanode restart |
Major |
. |
Kihwal Lee |
Kihwal Lee |
HDFS-9493 |
Test o.a.h.hdfs.server.namenode.TestMetaSave fails in trunk |
Major |
test |
Mingliang Liu |
Tony Wu |
HADOOP-12678 |
Handle empty rename pending metadata file during atomic rename in redo path |
Critical |
fs/azure |
madhumita chakraborty |
madhumita chakraborty |
HADOOP-12590 |
TestCompressorDecompressor failing without stack traces |
Critical |
test |
Steve Loughran |
John Zhuge |
HADOOP-12587 |
Hadoop AuthToken refuses to work without a maxinactive attribute in issued token |
Blocker |
security |
Steve Loughran |
Benoy Antony |
HADOOP-12551 |
Introduce FileNotFoundException for WASB FileSystem API |
Major |
tools |
Dushyanth |
Dushyanth |
MAPREDUCE-6068 |
Illegal progress value warnings in map tasks |
Major |
mrv2, task |
Todd Lipcon |
Binglin Chang |
HDFS-9639 |
Inconsistent Logging in BootstrapStandby |
Minor |
ha |
BELUGA BEHR |
Xiaobing Zhou |
HDFS-9584 |
NPE in distcp when ssl configuration file does not exist in class path. |
Major |
distcp |
Surendra Singh Lilhore |
Surendra Singh Lilhore |
HADOOP-12584 |
Disable browsing the static directory in HttpServer2 |
Major |
security |
Robert Kanter |
Robert Kanter |
YARN-4567 |
javadoc failing on java 8 |
Blocker |
build |
Steve Loughran |
Steve Loughran |
YARN-4414 |
Nodemanager connection errors are retried at multiple levels |
Major |
nodemanager |
Jason Lowe |
Chang Li |
HADOOP-12653 |
Use SO_REUSEADDR to avoid getting “Address already in use” when using kerberos and attempting to bind to any port on the local IP address |
Major |
net |
Colin P. McCabe |
Colin P. McCabe |
HADOOP-12603 |
TestSymlinkLocalFSFileContext#testSetTimesSymlinkToDir occasionally fail |
Major |
test |
Wei-Chiu Chuang |
Wei-Chiu Chuang |
YARN-4571 |
Make app id/name available to the yarn authorizer provider for better auditing |
Major |
. |
Jian He |
Jian He |
YARN-4551 |
Address the duplication between StatusUpdateWhenHealthy and StatusUpdateWhenUnhealthy transitions |
Minor |
nodemanager |
Karthik Kambatla |
Sunil G |
HDFS-9517 |
Fix missing @Test annotation on TestDistCpUtils.testUnpackAttributes |
Trivial |
distcp |
Wei-Chiu Chuang |
Wei-Chiu Chuang |
YARN-4534 |
Remove the redundant symbol in yarn rmadmin help msg |
Trivial |
. |
Yiqun Lin |
Yiqun Lin |
HADOOP-12700 |
Remove unused import in TestCompressorDecompressor.java |
Minor |
. |
John Zhuge |
John Zhuge |
MAPREDUCE-6601 |
Fix typo in Job#setUseNewAPI |
Trivial |
. |
Kai Sasaki |
Kai Sasaki |
YARN-3446 |
FairScheduler headroom calculation should exclude nodes in the blacklist |
Major |
fairscheduler |
zhihai xu |
zhihai xu |
HDFS-9648 |
TestStartup.testImageChecksum is broken by HDFS-9569’s message change |
Trivial |
namenode |
Wei-Chiu Chuang |
Wei-Chiu Chuang |
HADOOP-12706 |
TestLocalFsFCStatistics#testStatisticsThreadLocalDataCleanUp times out occasionally |
Major |
test |
Jason Lowe |
Sangjin Lee |
YARN-4581 |
AHS writer thread leak makes RM crash while RM is recovering |
Major |
resourcemanager |
sandflee |
sandflee |
MAPREDUCE-6554 |
MRAppMaster servicestart failing with NPE in MRAppMaster#parsePreviousJobHistory |
Critical |
. |
Bibin A Chundatt |
Bibin A Chundatt |
YARN-4389 |
“yarn.am.blacklisting.enabled” and “yarn.am.blacklisting.disable-failure-threshold” should be app specific rather than a setting for whole YARN cluster |
Critical |
applications |
Junping Du |
Sunil G |
HDFS-9612 |
DistCp worker threads are not terminated after jobs are done. |
Major |
distcp |
Wei-Chiu Chuang |
Wei-Chiu Chuang |
HDFS-9624 |
DataNode start slowly due to the initial DU command operations |
Major |
. |
Yiqun Lin |
Yiqun Lin |
HADOOP-12712 |
Fix some cmake plugin and native build warnings |
Minor |
native |
Colin P. McCabe |
Colin P. McCabe |
HADOOP-12714 |
Fix hadoop-mapreduce-client-nativetask unit test which fails because it is not able to open the “glibc bug spill” file. |
Major |
native |
Colin P. McCabe |
Colin P. McCabe |
YARN-4538 |
QueueMetrics pending cores and memory metrics wrong |
Major |
. |
Bibin A Chundatt |
Bibin A Chundatt |
YARN-4596 |
SystemMetricPublisher should not swallow error messages from TimelineClient#putEntities |
Major |
timelineserver |
Li Lu |
Li Lu |
YARN-4502 |
Fix two AM containers get allocated when AM restart |
Critical |
. |
Yesha Vora |
Vinod Kumar Vavilapalli |
HDFS-9623 |
Update example configuration of block state change log in log4j.properties |
Minor |
logging |
Masatake Iwasaki |
Masatake Iwasaki |
YARN-4565 |
When sizeBasedWeight enabled for FairOrderingPolicy in CapacityScheduler, Sometimes lead to situation where all queue resources consumed by AMs only |
Major |
capacity scheduler, capacityscheduler |
Karam Singh |
Wangda Tan |
HADOOP-12356 |
Fix computing CPU usage statistics on Windows |
Major |
util |
Yunqi Zhang |
Íñigo Goiri |
HDFS-9661 |
Deadlock in DN.FsDatasetImpl between moveBlockAcrossStorage and createRbw |
Major |
datanode |
ade |
ade |
HDFS-9655 |
NN should start JVM pause monitor before loading fsimage |
Critical |
. |
John Zhuge |
John Zhuge |
YARN-4559 |
Make leader elector and zk store share the same curator client |
Major |
. |
Jian He |
Jian He |
YARN-4611 |
Fix scheduler load simulator to support multi-layer network location |
Major |
. |
Ming Ma |
Ming Ma |
HADOOP-12605 |
Fix intermittent failure of TestIPC.testIpcWithReaderQueuing |
Minor |
test |
Masatake Iwasaki |
Masatake Iwasaki |
HDFS-9625 |
set replication for empty file failed when set storage policy |
Major |
namenode |
DENG FEI |
DENG FEI |
HADOOP-12423 |
Handle failure of registering shutdownhook by ShutdownHookManager in static block |
Minor |
fs |
Abhishek Agarwal |
Abhishek Agarwal |
HDFS-9634 |
webhdfs client side exceptions don’t provide enough details |
Major |
webhdfs |
Eric Payne |
Eric Payne |
YARN-4608 |
Redundant code statement in WritingYarnApplications |
Minor |
documentation |
Kai Sasaki |
Kai Sasaki |
HADOOP-7161 |
Remove unnecessary oro package from dependency management section |
Minor |
build |
Todd Lipcon |
Sean Busbey |
YARN-4610 |
Reservations continue looking for one app causes other apps to starve |
Blocker |
capacityscheduler |
Jason Lowe |
Jason Lowe |
HADOOP-12659 |
Incorrect usage of config parameters in token manager of KMS |
Major |
security |
Tianyin Xu |
Mingliang Liu |
YARN-4584 |
RM startup failure when AM attempts greater than max-attempts |
Critical |
. |
Bibin A Chundatt |
Bibin A Chundatt |
HDFS-9618 |
Fix mismatch between log level and guard in BlockManager#computeRecoveryWorkForBlocks |
Minor |
namenode |
Masatake Iwasaki |
Masatake Iwasaki |
MAPREDUCE-6605 |
Fix typos mapreduce.map.skip.proc.count.autoincr and mapreduce.reduce.skip.proc.count.autoincr in mapred-default.xml |
Major |
documentation |
Dong Zhen |
Kai Sasaki |
YARN-4605 |
Spelling mistake in the help message of “yarn applicationattempt” command |
Trivial |
client |
Manjunath Ballur |
Weiwei Yang |
HDFS-9682 |
Fix a typo “aplication” in HttpFS document |
Trivial |
documentation |
Weiwei Yang |
Weiwei Yang |
HADOOP-12730 |
Hadoop streaming -mapper and -reducer options are wrongly documented as required |
Major |
documentation |
DeepakVohra |
Kengo Seki |
YARN-4497 |
RM might fail to restart when recovering apps whose attempts are missing |
Critical |
. |
Jun Gong |
Jun Gong |
HDFS-8898 |
Create API and command-line argument to get quota and quota usage without detailed content summary |
Major |
fs |
Joep Rottinghuis |
Ming Ma |
YARN-4598 |
Invalid event: RESOURCE_FAILED at CONTAINER_CLEANEDUP_AFTER_KILL |
Major |
nodemanager |
tangshangwen |
tangshangwen |
YARN-4592 |
Remove unused GetContainerStatus proto |
Minor |
. |
Chang Li |
Chang Li |
YARN-4520 |
FinishAppEvent is leaked in leveldb if no app’s container running on this node |
Major |
nodemanager |
sandflee |
sandflee |
MAPREDUCE-6610 |
JobHistoryEventHandler should not swallow timeline response |
Trivial |
. |
Li Lu |
Li Lu |
HDFS-9690 |
ClientProtocol.addBlock is not idempotent after HDFS-8071 |
Major |
namenode |
Tsz Wo Nicholas Sze |
Tsz Wo Nicholas Sze |
HADOOP-12743 |
Fix git environment check during test-patch |
Major |
. |
Ray Chiang |
Allen Wittenauer |
YARN-4612 |
Fix rumen and scheduler load simulator handle killed tasks properly |
Major |
. |
Ming Ma |
Ming Ma |
HADOOP-12492 |
maven install triggers bats test |
Major |
build |
Allen Wittenauer |
Allen Wittenauer |
HADOOP-12735 |
core-default.xml misspells hadoop.workaround.non.threadsafe.getpwuid |
Minor |
. |
Ray Chiang |
Ray Chiang |
HDFS-8999 |
Allow a file to be closed with COMMITTED but not yet COMPLETE blocks. |
Major |
namenode |
Jitendra Nath Pandey |
Tsz Wo Nicholas Sze |
MAPREDUCE-6595 |
Fix findbugs warnings in OutputCommitter and FileOutputCommitter |
Major |
. |
Akira Ajisaka |
Akira Ajisaka |
MAPREDUCE-6563 |
Streaming documentation contains a stray ‘%’ character. |
Trivial |
documentation |
Chris Nauroth |
Chris Nauroth |
YARN-4519 |
potential deadlock of CapacityScheduler between decrease container and assign containers |
Major |
capacityscheduler |
sandflee |
MENG DING |
MAPREDUCE-6616 |
Fail to create jobhistory file if there are some multibyte characters in the job name |
Major |
jobhistoryserver |
Akira Ajisaka |
Kousuke Saruta |
YARN-4411 |
RMAppAttemptImpl#createApplicationAttemptReport throws IllegalArgumentException |
Major |
resourcemanager |
yarntime |
Bibin A Chundatt |
YARN-4617 |
LeafQueue#pendingOrderingPolicy should always use fixed ordering policy instead of using same as active applications ordering policy |
Major |
capacity scheduler |
Rohith Sharma K S |
Rohith Sharma K S |
YARN-4428 |
Redirect RM page to AHS page when AHS turned on and RM page is not available |
Major |
. |
Chang Li |
Chang Li |
HDFS-9659 |
EditLogTailerThread to Active Namenode RPC should timeout |
Critical |
ha, namenode |
Surendra Singh Lilhore |
Surendra Singh Lilhore |
MAPREDUCE-6618 |
YarnClientProtocolProvider leaking the YarnClient thread. |
Major |
. |
Xuan Gong |
Xuan Gong |
HDFS-9210 |
Fix some misuse of %n in VolumeScanner#printStats |
Minor |
datanode |
Xiaoyu Yao |
Xiaoyu Yao |
HDFS-9701 |
DN may deadlock when hot-swapping under load |
Major |
. |
Xiao Chen |
Xiao Chen |
YARN-3102 |
Decommisioned Nodes not listed in Web UI |
Minor |
resourcemanager |
Bibin A Chundatt |
Kuhu Shukla |
HDFS-9406 |
FSImage may get corrupted after deleting snapshot |
Major |
namenode |
Stanislav Antic |
Yongjun Zhang |
HDFS-9718 |
HAUtil#getConfForOtherNodes should unset independent generic keys before initialize |
Major |
namenode |
DENG FEI |
DENG FEI |
HDFS-9708 |
FSNamesystem.initAuditLoggers() doesn’t trim classnames |
Minor |
fs |
Steve Loughran |
Mingliang Liu |
HADOOP-12757 |
Findbug compilation fails for ‘Kafka Library support’ |
Major |
. |
Rohith Sharma K S |
Akira Ajisaka |
MAPREDUCE-6621 |
Memory Leak in JobClient#submitJobInternal() |
Major |
. |
Xuan Gong |
Xuan Gong |
HADOOP-12755 |
Fix typo in defaultFS warning message |
Trivial |
. |
Andrew Wang |
Andrew Wang |
MAPREDUCE-6620 |
Jobs that did not start are shown as starting in 1969 in the JHS web UI |
Major |
jobhistoryserver |
Daniel Templeton |
Haibo Chen |
HDFS-9739 |
DatanodeStorage.isValidStorageId() is broken |
Critical |
hdfs-client |
Kihwal Lee |
Mingliang Liu |
HDFS-9740 |
Use a reasonable limit in DFSTestUtil.waitForMetric() |
Major |
test |
Kihwal Lee |
Chang Li |
YARN-4625 |
Make ApplicationSubmissionContext and ApplicationSubmissionContextInfo more consistent |
Major |
. |
Xuan Gong |
Xuan Gong |
HADOOP-12761 |
incremental maven build is not really incremental |
Minor |
build |
Sangjin Lee |
Sangjin Lee |
YARN-4594 |
container-executor fails to remove directory tree when chmod required |
Major |
nodemanager |
Colin P. McCabe |
Colin P. McCabe |
HDFS-9748 |
When addExpectedReplicasToPending is called twice, pendingReplications should avoid duplication |
Minor |
. |
Walter Su |
Walter Su |
YARN-4669 |
Fix logging statements in resource manager’s Application class |
Trivial |
. |
Sidharta Seethana |
Sidharta Seethana |
HDFS-9730 |
Storage ID update does not happen when there is a layout change |
Major |
datanode |
Kihwal Lee |
Tsz Wo Nicholas Sze |
HDFS-9724 |
Degraded performance in WebHDFS listing as it does not reuse ObjectMapper |
Critical |
performance |
Akira Ajisaka |
Akira Ajisaka |
HADOOP-12766 |
The default value of “hadoop.workaround.non.threadsafe.getpwuid” is different between core-default.xml and NativeIO.java |
Minor |
. |
Akira Ajisaka |
Akira Ajisaka |
HDFS-9761 |
Rebalancer sleeps too long between iterations |
Blocker |
balancer & mover |
Adrian Bridgett |
Mingliang Liu |
HDFS-9713 |
DataXceiver#copyBlock should return if block is pinned |
Major |
datanode |
Uma Maheswara Rao G |
Uma Maheswara Rao G |
HADOOP-12773 |
HBase classes fail to load with client/job classloader enabled |
Major |
util |
Sangjin Lee |
Sangjin Lee |
HDFS-9777 |
Fix typos in DFSAdmin command line and documentation |
Trivial |
hdfs-client |
Wei-Chiu Chuang |
Wei-Chiu Chuang |
HDFS-9784 |
Example usage is not correct in Transparent Encryption document |
Major |
documentation |
Takashi Ohnishi |
Takashi Ohnishi |
HDFS-9752 |
Permanent write failures may happen to slow writers during datanode rolling upgrades |
Critical |
. |
Kihwal Lee |
Walter Su |
HDFS-9760 |
WebHDFS AuthFilter cannot be configured with custom AltKerberos auth handler |
Major |
webhdfs |
Ryan Sasson |
Ryan Sasson |
HDFS-9779 |
TestReplicationPolicyWithNodeGroup NODE variable picks wrong rack value |
Minor |
test |
Kuhu Shukla |
Kuhu Shukla |
YARN-4629 |
Distributed shell breaks under strong security |
Major |
applications/distributed-shell, security |
Daniel Templeton |
Daniel Templeton |
HADOOP-12792 |
TestUserGroupInformation#testGetServerSideGroups fails in chroot |
Minor |
security, test |
Eric Badger |
Eric Badger |
HDFS-9788 |
Incompatible tag renumbering in HeartbeatResponseProto |
Blocker |
rolling upgrades |
Andrew Wang |
Andrew Wang |
HADOOP-12795 |
KMS does not log detailed stack trace for unexpected errors. |
Major |
kms |
Chris Nauroth |
Chris Nauroth |
HADOOP-12699 |
TestKMS#testKMSProvider intermittently fails during ‘test rollover draining’ |
Major |
. |
Xiao Chen |
Xiao Chen |
HDFS-9790 |
HDFS Balancer should exit with a proper message if upgrade is not finalized |
Major |
. |
Xiaobing Zhou |
Xiaobing Zhou |
HDFS-9801 |
ReconfigurableBase should update the cached configuration |
Major |
datanode |
Arpit Agarwal |
Arpit Agarwal |
HADOOP-12780 |
During WASB atomic rename handle crash when one directory has been renamed but not file under it. |
Critical |
fs/azure |
madhumita chakraborty |
madhumita chakraborty |
HADOOP-12589 |
Fix intermittent test failure of TestCopyPreserveFlag |
Major |
test |
Tsuyoshi Ozawa |
Masatake Iwasaki |
HADOOP-12786 |
“hadoop key” command usage is not documented |
Major |
documentation |
Akira Ajisaka |
Xiao Chen |
HDFS-9765 |
TestBlockScanner#testVolumeIteratorWithCaching fails intermittently |
Major |
test |
Mingliang Liu |
Akira Ajisaka |
HDFS-9456 |
BlockPlacementPolicyWithNodeGroup should override verifyBlockPlacement |
Major |
. |
Junping Du |
Xiaobing Zhou |
HADOOP-12810 |
FileSystem#listLocatedStatus causes unnecessary RPC calls |
Major |
fs, fs/s3 |
Ryan Blue |
Ryan Blue |
HDFS-9787 |
SNNs stop uploading FSImage to ANN once isPrimaryCheckPointer changed to false. |
Major |
ha |
Guocui Mi |
Guocui Mi |
MAPREDUCE-6341 |
Fix typo in mapreduce tutorial |
Trivial |
. |
John Michael Luy |
John Michael Luy |
HADOOP-12787 |
KMS SPNEGO sequence does not work with WEBHDFS |
Major |
kms, security |
Xiaoyu Yao |
Xiaoyu Yao |
HDFS-9815 |
Move o.a.h.fs.Hdfs to hadoop-hdfs-client |
Blocker |
. |
Haohui Mai |
Vinayakumar B |
HDFS-9608 |
Disk IO imbalance in HDFS with heterogeneous storages |
Major |
. |
Wei Zhou |
Wei Zhou |
HDFS-9799 |
Reimplement getCurrentTrashDir to remove incompatibility |
Blocker |
. |
Zhe Zhang |
Zhe Zhang |
YARN-4689 |
FairScheduler: Cleanup preemptContainer to be more readable |
Trivial |
fairscheduler |
Karthik Kambatla |
Kai Sasaki |
YARN-4654 |
Yarn node label CLI should parse “=” correctly when trying to remove all labels on a node |
Major |
. |
Wangda Tan |
Naganarasimha G R |
HDFS-6832 |
Fix the usage of ‘hdfs namenode’ command |
Minor |
. |
Akira Ajisaka |
Manjunath Ballur |
HDFS-8923 |
Add -source flag to balancer usage message |
Trivial |
balancer & mover, documentation |
Chris Trezzo |
Chris Trezzo |
HDFS-9764 |
DistCp doesn’t print value for several arguments including -numListstatusThreads |
Minor |
distcp |
Yongjun Zhang |
Wei-Chiu Chuang |
MAPREDUCE-6637 |
Testcase Failure : TestFileInputFormat.testSplitLocationInfo |
Major |
test |
Brahma Reddy Battula |
Brahma Reddy Battula |
HDFS-9839 |
Reduce verbosity of processReport logging |
Major |
namenode |
Arpit Agarwal |
Arpit Agarwal |
HDFS-7452 |
skip StandbyException log for getCorruptFiles() |
Minor |
. |
Brahma Reddy Battula |
Brahma Reddy Battula |
YARN-4707 |
Remove the extra char (>) from SecureContainer.md |
Major |
documentation |
Brahma Reddy Battula |
Brahma Reddy Battula |
YARN-4386 |
refreshNodesGracefully() should send recommission event to active RMNodes only |
Minor |
graceful |
Kuhu Shukla |
Kuhu Shukla |
HDFS-9842 |
dfs.datanode.balance.bandwidthPerSec should accept friendly size units |
Minor |
balancer & mover |
Yiqun Lin |
Yiqun Lin |
YARN-4709 |
NMWebServices produces incorrect JSON for containers |
Critical |
. |
Varun Saxena |
Varun Saxena |
MAPREDUCE-6635 |
Unsafe long to int conversion in UncompressedSplitLineReader and IndexOutOfBoundsException |
Critical |
. |
Sergey Shelukhin |
Junping Du |
YARN-4651 |
movetoqueue option does not documented in ‘YARN Commands’ |
Major |
documentation |
Takashi Ohnishi |
Takashi Ohnishi |
YARN-4648 |
Move preemption related tests from TestFairScheduler to TestFairSchedulerPreemption |
Major |
fairscheduler |
Karthik Kambatla |
Kai Sasaki |
HDFS-9549 |
TestCacheDirectives#testExceedsCapacity is flaky |
Major |
. |
Wei-Chiu Chuang |
Xiao Chen |
YARN-2046 |
Out of band heartbeats are sent only on container kill and possibly too early |
Major |
nodemanager |
Jason Lowe |
Ming Ma |
HDFS-9844 |
Correct path creation in getTrashRoot to handle root dir |
Blocker |
encryption |
Zhe Zhang |
Zhe Zhang |
YARN-4722 |
AsyncDispatcher logs redundant event queue sizes |
Major |
. |
Jason Lowe |
Jason Lowe |
HADOOP-12070 |
Some of the bin/hadoop subcommands are not available on Windows |
Major |
scripts |
Kengo Seki |
Kengo Seki |
HADOOP-12716 |
KerberosAuthenticator#doSpnegoSequence use incorrect class to determine isKeyTab in JDK8 |
Major |
security |
Xiaoyu Yao |
Xiaoyu Yao |
YARN-4729 |
SchedulerApplicationAttempt#getTotalRequiredResources can throw an NPE |
Major |
scheduler |
Karthik Kambatla |
Karthik Kambatla |
YARN-4701 |
When task logs are not available, port 8041 is referenced instead of port 8042 |
Major |
yarn |
Haibo Chen |
Haibo Chen |
HDFS-9858 |
RollingFileSystemSink can throw an NPE on non-secure clusters |
Major |
. |
Daniel Templeton |
Daniel Templeton |
YARN-4723 |
NodesListManager$UnknownNodeId ClassCastException |
Critical |
resourcemanager |
Jason Lowe |
Kuhu Shukla |
HADOOP-12849 |
TestSymlinkLocalFSFileSystem fails intermittently |
Major |
test |
Mingliang Liu |
Mingliang Liu |
HADOOP-12831 |
LocalFS/FSOutputSummer NPEs in constructor if bytes per checksum set to 0 |
Minor |
fs |
Steve Loughran |
Mingliang Liu |
HADOOP-12846 |
Credential Provider Recursive Dependencies |
Major |
. |
Larry McCay |
Larry McCay |
HDFS-9864 |
Correct reference for RENEWDELEGATIONTOKEN and CANCELDELEGATIONTOKEN in webhdfs doc |
Major |
documentation |
Brahma Reddy Battula |
Brahma Reddy Battula |
YARN-4731 |
container-executor should not follow symlinks in recursive_unlink_children |
Blocker |
. |
Bibin A Chundatt |
Colin P. McCabe |
HADOOP-12622 |
RetryPolicies (other than FailoverOnNetworkExceptionRetry) should put on retry failed reason or the log from RMProxy’s retry could be very misleading. |
Critical |
auto-failover |
Junping Du |
Junping Du |
YARN-4748 |
ApplicationHistoryManagerOnTimelineStore should not swallow exceptions on generateApplicationReport |
Major |
timelineserver |
Li Lu |
Li Lu |
HADOOP-10321 |
TestCompositeService should cover all enumerations of adding a service to a parent service |
Major |
. |
Karthik Kambatla |
Ray Chiang |
HADOOP-12851 |
S3AFileSystem Uptake of ProviderUtils.excludeIncompatibleCredentialProviders |
Major |
fs/s3 |
Larry McCay |
Larry McCay |
HDFS-9870 |
Remove unused imports from DFSUtil |
Major |
. |
Brahma Reddy Battula |
Brahma Reddy Battula |
HDFS-8791 |
block ID-based DN storage layout can be very slow for datanode on ext4 |
Blocker |
datanode |
Nathan Roberts |
Chris Trezzo |
HDFS-9880 |
TestDatanodeRegistration fails occasionally |
Major |
test |
Kihwal Lee |
Kihwal Lee |
HDFS-9881 |
DistributedFileSystem#getTrashRoot returns incorrect path for encryption zones |
Critical |
. |
Andrew Wang |
Andrew Wang |
HDFS-9766 |
TestDataNodeMetrics#testDataNodeTimeSpend fails intermittently |
Major |
test |
Mingliang Liu |
Xiao Chen |
HDFS-9851 |
Name node throws NPE when setPermission is called on a path that does not exist |
Critical |
namenode |
David Yan |
Brahma Reddy Battula |
HDFS-9886 |
Configuration properties for hedged read is broken |
Blocker |
. |
Akira Ajisaka |
Akira Ajisaka |
HADOOP-12870 |
Fix typo admininistration in CommandsManual.md |
Minor |
documentation |
Akira Ajisaka |
John Zhuge |
HDFS-9048 |
DistCp documentation is out-of-dated |
Major |
. |
Haohui Mai |
Daisuke Kobayashi |
HADOOP-12871 |
Fix dead link to NativeLibraries.html in CommandsManual.md |
Minor |
documentation |
Akira Ajisaka |
Brahma Reddy Battula |
HADOOP-12872 |
Fix formatting in ServiceLevelAuth.md |
Trivial |
documentation |
Akira Ajisaka |
Brahma Reddy Battula |
MAPREDUCE-4785 |
TestMRApp occasionally fails |
Major |
mrv2, test |
Jason Lowe |
Haibo Chen |
HADOOP-12717 |
NPE when trying to rename a directory in Windows Azure Storage FileSystem |
Blocker |
. |
Robert Yokota |
Robert Yokota |
YARN-4763 |
RMApps Page crashes with NPE |
Major |
webapp |
Bibin A Chundatt |
Bibin A Chundatt |
YARN-4761 |
NMs reconnecting with changed capabilities can lead to wrong cluster resource calculations on fair scheduler |
Major |
fairscheduler |
Sangjin Lee |
Sangjin Lee |
YARN-4737 |
Add CSRF filter support in YARN |
Major |
nodemanager, resourcemanager, webapp |
Jonathan Maron |
Jonathan Maron |
YARN-4744 |
Too many signal to container failure in case of LCE |
Major |
. |
Bibin A Chundatt |
Sidharta Seethana |
YARN-4760 |
proxy redirect to history server uses wrong URL |
Major |
webapp |
Jason Lowe |
Eric Badger |
HDFS-9865 |
TestBlockReplacement fails intermittently in trunk |
Major |
test |
Yiqun Lin |
Yiqun Lin |
YARN-4762 |
NMs failing on DelegatingLinuxContainerRuntime init with LCE on |
Blocker |
. |
Vinod Kumar Vavilapalli |
Sidharta Seethana |
HDFS-9812 |
Streamer threads leak if failure happens when closing DFSOutputStream |
Major |
hdfs-client |
Yiqun Lin |
Yiqun Lin |
HDFS-9919 |
TestStandbyCheckpoints#testNonPrimarySBNUploadFSImage waitForCheckpoint incorrectly |
Minor |
test |
Yiqun Lin |
Yiqun Lin |
YARN-4764 |
Application submission fails when submitted queue is not available in scheduler xml |
Major |
. |
Bibin A Chundatt |
Bibin A Chundatt |
HADOOP-12895 |
SSLFactory#createSSLSocketFactory exception message is wrong |
Trivial |
. |
Wei-Chiu Chuang |
Wei-Chiu Chuang |
HADOOP-12688 |
Fix deadlinks in Compatibility.md |
Major |
documentation |
Akira Ajisaka |
Gabor Liptak |
HADOOP-12903 |
IPC Server should allow suppressing exception logging by type, not log ‘server too busy’ messages |
Major |
ipc |
Arpit Agarwal |
Arpit Agarwal |
HADOOP-12906 |
AuthenticatedURL should convert a 404/Not Found into an FileNotFoundException. |
Minor |
io, security |
Steve Loughran |
Steve Loughran |
HDFS-9934 |
ReverseXML oiv processor should bail out if the XML file’s layoutVersion doesn’t match oiv’s |
Major |
tools |
Colin P. McCabe |
Colin P. McCabe |
HDFS-9933 |
ReverseXML should be capitalized in oiv usage message |
Minor |
tools |
Colin P. McCabe |
Colin P. McCabe |
HADOOP-12899 |
External distribution stitching scripts do not work correctly on Windows. |
Blocker |
build |
Chris Nauroth |
Chris Nauroth |
HDFS-9953 |
Download File from UI broken after pagination |
Blocker |
namenode |
Brahma Reddy Battula |
Brahma Reddy Battula |
HDFS-9947 |
Block#toString should not output information from derived classes |
Minor |
. |
Colin P. McCabe |
Colin P. McCabe |
YARN-4816 |
SystemClock API broken in 2.9.0 |
Major |
. |
Siddharth Seth |
Siddharth Seth |
HDFS-9904 |
testCheckpointCancellationDuringUpload occasionally fails |
Major |
test |
Kihwal Lee |
Yiqun Lin |
MAPREDUCE-6579 |
JobStatus#getFailureInfo should not output diagnostic information when the job is running |
Blocker |
test |
Rohith Sharma K S |
Akira Ajisaka |
HDFS-9780 |
RollingFileSystemSink doesn’t work on secure clusters |
Critical |
. |
Daniel Templeton |
Daniel Templeton |
HADOOP-12888 |
Shell to disable bash and setsid support when running under JVM security manager |
Major |
security |
Costin Leau |
Costin Leau |
YARN-4593 |
Deadlock in AbstractService.getConfig() |
Major |
yarn |
Steve Loughran |
Steve Loughran |
HDFS-10173 |
Typo in DataXceiverServer |
Trivial |
datanode |
Michael Han |
Michael Han |
MAPREDUCE-6645 |
TestWordStats outputs logs under directories other than target/test-dir |
Major |
test |
Akira Ajisaka |
Gabor Liptak |
YARN-4812 |
TestFairScheduler#testContinuousScheduling fails intermittently |
Major |
fairscheduler |
Karthik Kambatla |
Karthik Kambatla |
HDFS-9874 |
Long living DataXceiver threads cause volume shutdown to block. |
Critical |
datanode |
Rushabh S Shah |
Rushabh S Shah |
HDFS-3677 |
dfs.namenode.edits.dir.required missing from hdfs-default.xml |
Major |
documentation, namenode |
Todd Lipcon |
Mark Yang |
HADOOP-12626 |
Intel ISA-L libraries should be added to the Dockerfile |
Blocker |
io |
Allen Wittenauer |
Kai Zheng |
HDFS-7166 |
SbNN Web UI shows #Under replicated blocks and #pending deletion blocks |
Major |
ha |
Juan Yu |
Wei-Chiu Chuang |
YARN-4686 |
MiniYARNCluster.start() returns before cluster is completely started |
Major |
test |
Rohith Sharma K S |
Eric Badger |
MAPREDUCE-6363 |
[NNBench] Lease mismatch error when running with multiple mappers |
Critical |
benchmarks |
Brahma Reddy Battula |
Bibin A Chundatt |
MAPREDUCE-6110 |
JobHistoryServer CLI throws NullPointerException with job ids that do not exist |
Minor |
jobhistoryserver |
Li Lu |
Kai Sasaki |
HDFS-10189 |
PacketResponder#toString should include the downstreams for PacketResponderType.HAS_DOWNSTREAM_IN_PIPELINE |
Minor |
datanode |
Joe Pallas |
Joe Pallas |
MAPREDUCE-6580 |
Test failure : TestMRJobsWithProfiler |
Major |
. |
Rohith Sharma K S |
Eric Badger |
MAPREDUCE-6656 |
[NNBench] OP_DELETE operation isn’t working after MAPREDUCE-6363 |
Blocker |
. |
J.Andreina |
J.Andreina |
HDFS-10193 |
fuse_dfs segfaults if uid cannot be resolved to a username |
Major |
fuse-dfs |
John Thiltges |
John Thiltges |
YARN-4820 |
ResourceManager web redirects in HA mode drops query parameters |
Major |
. |
Varun Vasudev |
Varun Vasudev |
YARN-4850 |
test-fair-scheduler.xml isn’t valid xml |
Blocker |
fairscheduler, test |
Allen Wittenauer |
Yufei Gu |
MAPREDUCE-6535 |
TaskID default constructor results in NPE on toString() |
Major |
mrv2 |
Daniel Templeton |
Daniel Templeton |
HADOOP-12962 |
KMS key names are incorrectly encoded when creating key |
Major |
. |
Xiao Chen |
Xiao Chen |
HADOOP-12958 |
PhantomReference for filesystem statistics can trigger OOM |
Major |
. |
Jason Lowe |
Sangjin Lee |
HADOOP-12873 |
Remove MRv1 terms from HttpAuthentication.md |
Major |
documentation |
Akira Ajisaka |
Brahma Reddy Battula |
HDFS-10182 |
Hedged read might overwrite user’s buf |
Major |
. |
zhouyingchao |
zhouyingchao |
MAPREDUCE-6655 |
Fix a typo (STRICT_IE6) in Encrypted Shuffle |
Trivial |
documentation |
Wei-Chiu Chuang |
Wei-Chiu Chuang |
HADOOP-12954 |
Add a way to change hadoop.security.token.service.use_ip |
Major |
security |
Robert Kanter |
Robert Kanter |
YARN-4773 |
Log aggregation performs extraneous filesystem operations when rolling log aggregation is disabled |
Minor |
nodemanager |
Jason Lowe |
Jun Gong |
MAPREDUCE-6662 |
Clear ASF Warnings on test data files |
Minor |
. |
Vinayakumar B |
Vinayakumar B |
HDFS-9871 |
“Bytes Being Moved” -ve(-1 B) when cluster was already balanced. |
Major |
. |
Brahma Reddy Battula |
Brahma Reddy Battula |
YARN-4863 |
AHS Security login should be in serviceInit() instead of serviceStart() |
Major |
timelineserver |
Junping Du |
Junping Du |
HDFS-10197 |
TestFsDatasetCache failing intermittently due to timeout |
Major |
test |
Yiqun Lin |
Yiqun Lin |
HDFS-9478 |
Reason for failing ipc.FairCallQueue contruction should be thrown |
Minor |
. |
Archana T |
Ajith S |
HDFS-10228 |
TestHDFSCLI fails |
Major |
test |
Akira Ajisaka |
Akira Ajisaka |
YARN-4865 |
Track Reserved resources in ResourceUsage and QueueCapacities |
Major |
resourcemanager |
Sunil G |
Sunil G |
HADOOP-12972 |
Lz4Compressor#getLibraryName returns the wrong version number |
Trivial |
native |
John Zhuge |
Colin P. McCabe |
HDFS-5177 |
blocksScheduled count should be decremented for abandoned blocks |
Major |
namenode |
Vinayakumar B |
Vinayakumar B |
HDFS-10223 |
peerFromSocketAndKey performs SASL exchange before setting connection timeouts |
Major |
. |
Colin P. McCabe |
Colin P. McCabe |
HDFS-10221 |
Add .json to the rat exclusions |
Blocker |
build |
Ming Ma |
Ming Ma |
HADOOP-12902 |
JavaDocs for SignerSecretProvider are out-of-date in AuthenticationFilter |
Major |
documentation |
Robert Kanter |
Gabor Liptak |
YARN-4183 |
Clarify the behavior of timeline service config properties |
Major |
. |
Mit Desai |
Naganarasimha G R |
HADOOP-12955 |
Fix bugs in the initialization of the ISA-L library JNI bindings |
Major |
native |
Kai Zheng |
Kai Zheng |
YARN-4657 |
Javadoc comment is broken for Resources.multiplyByAndAddTo() |
Trivial |
. |
Daniel Templeton |
Daniel Templeton |
HDFS-10253 |
Fix TestRefreshCallQueue failure. |
Major |
. |
Brahma Reddy Battula |
Xiaoyu Yao |
YARN-4746 |
yarn web services should convert parse failures of appId, appAttemptId and containerId to 400 |
Minor |
webapp |
Steve Loughran |
Bibin A Chundatt |
HDFS-9599 |
TestDecommissioningStatus.testDecommissionStatus occasionally fails |
Major |
namenode |
Wei-Chiu Chuang |
Yiqun Lin |
YARN-4706 |
UI Hosting Configuration in TimelineServer doc is broken |
Critical |
documentation |
Akira Ajisaka |
Akira Ajisaka |
HDFS-10178 |
Permanent write failures can happen if pipeline recoveries occur for the first packet |
Critical |
. |
Kihwal Lee |
Kihwal Lee |
HDFS-8496 |
Calling stopWriter() with FSDatasetImpl lock held may block other threads |
Major |
. |
zhouyingchao |
Colin P. McCabe |
HDFS-9917 |
IBR accumulate more objects when SNN was down for sometime. |
Critical |
. |
Brahma Reddy Battula |
Brahma Reddy Battula |
YARN-4880 |
Running TestZKRMStateStorePerf with real zookeeper cluster throws NPE |
Major |
. |
Rohith Sharma K S |
Sunil G |
YARN-4609 |
RM Nodes list page takes too much time to load |
Major |
webapp |
Bibin A Chundatt |
Bibin A Chundatt |
HDFS-10239 |
Fsshell mv fails if port usage doesn’t match in src and destination paths |
Major |
. |
Kuhu Shukla |
Kuhu Shukla |
YARN-4893 |
Fix some intermittent test failures in TestRMAdminService |
Blocker |
. |
Junping Du |
Brahma Reddy Battula |
YARN-4916 |
TestNMProxy.tesNMProxyRPCRetry fails. |
Minor |
. |
Tibor Kiss |
Tibor Kiss |
YARN-4915 |
Fix typo in YARN Secure Containers documentation |
Trivial |
documentation, yarn |
Takashi Ohnishi |
Takashi Ohnishi |
YARN-4917 |
Fix typos in documentation of Capacity Scheduler. |
Minor |
documentation |
Takashi Ohnishi |
Takashi Ohnishi |
HDFS-10261 |
TestBookKeeperHACheckpoints doesn’t handle ephemeral HTTP ports |
Major |
. |
Eric Badger |
Eric Badger |
YARN-4699 |
Scheduler UI and REST o/p is not in sync when -replaceLabelsOnNode is used to change label of a node |
Critical |
capacity scheduler |
Sunil G |
Sunil G |
YARN-4906 |
Capture container start/finish time in container metrics |
Major |
. |
Jian He |
Jian He |
HADOOP-12022 |
fix site -Pdocs -Pdist in hadoop-project-dist; cleanout remaining forrest bits |
Blocker |
build |
Allen Wittenauer |
Allen Wittenauer |
MAPREDUCE-6670 |
TestJobListCache#testEviction sometimes fails on Windows with timeout |
Minor |
test |
Gergely Novák |
Gergely Novák |
HDFS-10192 |
Namenode safemode not coming out during failover |
Major |
namenode |
Brahma Reddy Battula |
Brahma Reddy Battula |
HDFS-6520 |
hdfs fsck -move passes invalid length value when creating BlockReader |
Major |
. |
Shengjun Xin |
Xiao Chen |
MAPREDUCE-6647 |
MR usage counters use the resources requested instead of the resources allocated |
Major |
. |
Haibo Chen |
Haibo Chen |
HDFS-10267 |
Extra “synchronized” on FsDatasetImpl#recoverAppend and FsDatasetImpl#recoverClose |
Major |
datanode |
Colin P. McCabe |
Colin P. McCabe |
HADOOP-13006 |
FileContextMainOperationsBaseTest.testListStatusThrowsExceptionForNonExistentFile() doesnt run |
Minor |
test |
Steve Loughran |
Kai Sasaki |
YARN-4740 |
AM may not receive the container complete msg when it restarts |
Major |
. |
sandflee |
sandflee |
MAPREDUCE-6633 |
AM should retry map attempts if the reduce task encounters commpression related errors. |
Major |
. |
Rushabh S Shah |
Rushabh S Shah |
YARN-4927 |
TestRMHA#testTransitionedToActiveRefreshFail fails with FairScheduler |
Major |
test |
Karthik Kambatla |
Bibin A Chundatt |
YARN-4938 |
MiniYarnCluster should not request transitionToActive to RM on non-HA environment |
Major |
test |
Akira Ajisaka |
Eric Badger |
YARN-4562 |
YARN WebApp ignores the configuration passed to it for keystore settings |
Major |
. |
Sergey Shelukhin |
Sergey Shelukhin |
HADOOP-12406 |
AbstractMapWritable.readFields throws ClassNotFoundException with custom writables |
Blocker |
io |
Nadeem Douba |
Nadeem Douba |
HADOOP-12993 |
Change ShutdownHookManger complete shutdown log from INFO to DEBUG |
Minor |
. |
Xiaoyu Yao |
Xiaoyu Yao |
YARN-4897 |
dataTables_wrapper change min height |
Minor |
. |
Bibin A Chundatt |
Bibin A Chundatt |
HDFS-10277 |
PositionedReadable test testReadFullyZeroByteFile failing in HDFS |
Major |
test |
Steve Loughran |
Steve Loughran |
HDFS-10271 |
Extra bytes are getting released from reservedSpace for append |
Critical |
. |
Brahma Reddy Battula |
Brahma Reddy Battula |
HDFS-8356 |
Document missing properties in hdfs-default.xml |
Major |
documentation |
Ray Chiang |
Ray Chiang |
YARN-4810 |
NM applicationpage cause internal error 500 |
Major |
. |
Bibin A Chundatt |
Bibin A Chundatt |
HDFS-10273 |
Remove duplicate logSync() and log message in FSN#enterSafemode() |
Minor |
. |
Vinayakumar B |
Vinayakumar B |
HADOOP-12964 |
Http server vulnerable to clickjacking |
Major |
. |
Haibo Chen |
Haibo Chen |
YARN-4794 |
Deadlock in NMClientImpl |
Critical |
. |
Sumana Sathish |
Jian He |
HDFS-9772 |
TestBlockReplacement#testThrottler doesn’t work as expected |
Minor |
test |
Yiqun Lin |
Yiqun Lin |
HDFS-10270 |
TestJMXGet:testNameNode() fails |
Minor |
test |
Andras Bokor |
Gergely Novák |
HDFS-10282 |
The VolumeScanner should warn about replica files which are misplaced |
Major |
datanode |
Colin P. McCabe |
Colin P. McCabe |
HDFS-10216 |
distcp -diff relative path exception |
Major |
distcp |
John Zhuge |
Takashi Ohnishi |
YARN-4924 |
NM recovery race can lead to container not cleaned up |
Major |
nodemanager |
Nathan Roberts |
sandflee |
HADOOP-12989 |
Some tests in org.apache.hadoop.fs.shell.find occasionally time out |
Major |
test |
Akira Ajisaka |
Takashi Ohnishi |
HADOOP-13026 |
Should not wrap IOExceptions into a AuthenticationException in KerberosAuthenticator |
Critical |
. |
Xuan Gong |
Xuan Gong |
HDFS-10283 |
o.a.h.hdfs.server.namenode.TestFSImageWithSnapshot#testSaveLoadImageWithAppending fails intermittently |
Major |
test |
Mingliang Liu |
Mingliang Liu |
YARN-4940 |
yarn node -list -all failed if RM start with decommissioned node |
Major |
. |
sandflee |
sandflee |
YARN-4965 |
Distributed shell AM failed due to ClientHandlerException thrown by jersey |
Critical |
. |
Sumana Sathish |
Junping Du |
YARN-4934 |
Reserved Resource for QueueMetrics needs to be handled correctly in few cases |
Major |
capacity scheduler |
Sunil G |
Sunil G |
HDFS-10291 |
TestShortCircuitLocalRead failing |
Major |
test |
Steve Loughran |
Steve Loughran |
HDFS-10275 |
TestDataNodeMetrics failing intermittently due to TotalWriteTime counted incorrectly |
Major |
test |
Yiqun Lin |
Yiqun Lin |
MAPREDUCE-6649 |
getFailureInfo not returning any failure info |
Major |
. |
Eric Badger |
Eric Badger |
HDFS-10265 |
OEV tool fails to read edit xml file if OP_UPDATE_BLOCKS has no BLOCK tag |
Minor |
tools |
Wan Chang |
Wan Chang |
HDFS-10306 |
SafeModeMonitor should not leave safe mode if name system is starting active service |
Major |
namenode |
Mingliang Liu |
Mingliang Liu |
HDFS-9744 |
TestDirectoryScanner#testThrottling occasionally time out after 300 seconds |
Minor |
datanode |
Wei-Chiu Chuang |
Yiqun Lin |
HDFS-10308 |
TestRetryCacheWithHA#testRetryCacheOnStandbyNN failing |
Major |
test |
Rakesh R |
Rakesh R |
HDFS-10312 |
Large block reports may fail to decode at NameNode due to 64 MB protobuf maximum length restriction. |
Major |
namenode |
Chris Nauroth |
Chris Nauroth |
MAPREDUCE-6680 |
JHS UserLogDir scan algorithm sometime could skip directory with update in CloudFS (Azure FileSystem, S3, etc.) |
Major |
jobhistoryserver |
Junping Du |
Junping Du |
YARN-4935 |
TestYarnClient#testSubmitIncorrectQueue fails with FairScheduler |
Major |
test |
Yufei Gu |
Yufei Gu |
MAPREDUCE-2398 |
MRBench: setting the baseDir parameter has no effect |
Minor |
benchmarks |
Michael Noll |
Wilfred Spiegelenburg |
YARN-4976 |
Missing NullPointer check in ContainerLaunchContextPBImpl causes RM to die |
Major |
resourcemanager |
Giovanni Matteo Fumarola |
Giovanni Matteo Fumarola |
HDFS-9670 |
DistCp throws NPE when source is root |
Major |
distcp |
Yongjun Zhang |
John Zhuge |
HADOOP-13042 |
Restore lost leveldbjni LICENSE and NOTICE changes |
Major |
. |
Andrew Wang |
Andrew Wang |
HADOOP-13043 |
Add LICENSE.txt entries for bundled javascript dependencies |
Major |
. |
Andrew Wang |
Andrew Wang |
HDFS-10319 |
Balancer should not try to pair storages with different types |
Minor |
balancer & mover |
Tsz Wo Nicholas Sze |
Tsz Wo Nicholas Sze |
HDFS-10309 |
Balancer doesn’t honor dfs.blocksize value defined with suffix k(kilo), m(mega), g(giga) |
Minor |
balancer & mover |
Amit Anand |
Amit Anand |
HDFS-9555 |
LazyPersistFileScrubber should still sleep if there are errors in the clear progress |
Major |
. |
Phil Yang |
Phil Yang |
HADOOP-13052 |
ChecksumFileSystem mishandles crc file permissions |
Major |
fs |
Daryn Sharp |
Daryn Sharp |
HDFS-9905 |
WebHdfsFileSystem#runWithRetry should display original stack trace on error |
Major |
test |
Kihwal Lee |
Wei-Chiu Chuang |
HADOOP-11418 |
Property “io.compression.codec.lzo.class” does not work with other value besides default |
Major |
io |
fang fang chen |
Yuanbo Liu |
HDFS-10318 |
TestJMXGet hides the real error in case of test failure |
Minor |
test |
Andras Bokor |
Andras Bokor |
HDFS-10325 |
TestDFSShell#testMoveWithTargetPortEmpty fails |
Major |
test |
Takanobu Asanuma |
Takanobu Asanuma |
YARN-4795 |
ContainerMetrics drops records |
Major |
resourcemanager |
Daniel Templeton |
Daniel Templeton |
YARN-4556 |
TestFifoScheduler.testResourceOverCommit fails |
Major |
scheduler, test |
Akihiro Suda |
Akihiro Suda |
HDFS-10329 |
Bad initialisation of StringBuffer in RequestHedgingProxyProvider.java |
Minor |
ha |
Max Schaefer |
Yiqun Lin |
HDFS-10313 |
Distcp need to enforce the order of snapshot names passed to -diff |
Major |
distcp |
Yongjun Zhang |
Yiqun Lin |
YARN-4983 |
JVM and UGI metrics disappear after RM is once transitioned to standby mode |
Major |
. |
Li Lu |
Li Lu |
HADOOP-13030 |
Handle special characters in passwords in KMS startup script |
Major |
kms |
Xiao Chen |
Xiao Chen |
YARN-4955 |
Add retry for SocketTimeoutException in TimelineClient |
Critical |
. |
Xuan Gong |
Xuan Gong |
HDFS-9958 |
BlockManager#createLocatedBlocks can throw NPE for corruptBlocks on failed storages. |
Major |
. |
Kuhu Shukla |
Kuhu Shukla |
YARN-5008 |
LeveldbRMStateStore database can grow substantially leading to long recovery times |
Major |
resourcemanager |
Jason Lowe |
Jason Lowe |
YARN-5009 |
NMLeveldbStateStoreService database can grow substantially leading to longer recovery times |
Major |
nodemanager |
Jason Lowe |
Jason Lowe |
HADOOP-12378 |
Fix findbugs warnings in hadoop-tools module |
Major |
tools |
Akira Ajisaka |
Akira Ajisaka |
HDFS-10260 |
TestFsDatasetImpl#testCleanShutdownOfVolume often fails |
Major |
datanode, test |
Wei-Chiu Chuang |
Rushabh S Shah |
HDFS-10335 |
Mover$Processor#chooseTarget() always chooses the first matching target storage group |
Critical |
balancer & mover |
Mingliang Liu |
Mingliang Liu |
MAPREDUCE-6672 |
TestTeraSort fails on Windows |
Minor |
test |
Tibor Kiss |
Tibor Kiss |
HDFS-10347 |
Namenode report bad block method doesn’t log the bad block or datanode. |
Minor |
namenode |
Rushabh S Shah |
Rushabh S Shah |
HADOOP-13012 |
yetus-wrapper should fail sooner when download fails |
Minor |
yetus |
Steven K. Wong |
Steven K. Wong |
HADOOP-13072 |
WindowsGetSpaceUsed constructor should be public |
Major |
. |
Vinayakumar B |
Vinayakumar B |
MAPREDUCE-6537 |
Include hadoop-pipes examples in the release tarball |
Blocker |
pipes |
Allen Wittenauer |
Kai Sasaki |
HDFS-10353 |
Fix hadoop-hdfs-native-client compilation on Windows |
Blocker |
build |
Brahma Reddy Battula |
Brahma Reddy Battula |
HDFS-10344 |
DistributedFileSystem#getTrashRoots should skip encryption zone that does not have .Trash |
Major |
. |
Namit Maheshwari |
Xiaoyu Yao |
HADOOP-13080 |
Refresh time in SysInfoWindows is in nanoseconds |
Major |
util |
Íñigo Goiri |
Íñigo Goiri |
YARN-4834 |
ProcfsBasedProcessTree doesn’t track daemonized processes |
Major |
nodemanager |
Nathan Roberts |
Nathan Roberts |
HADOOP-12469 |
distcp should not ignore the ignoreFailures option |
Critical |
tools/distcp |
Gera Shegalov |
Mingliang Liu |
HDFS-10320 |
Rack failures may result in NN terminate |
Major |
. |
Xiao Chen |
Xiao Chen |
MAPREDUCE-6677 |
LocalContainerAllocator doesn’t specify resource of the containers allocated. |
Major |
mr-am |
Haibo Chen |
Haibo Chen |
MAPREDUCE-6675 |
TestJobImpl.testUnusableNode failed |
Major |
mrv2 |
Haibo Chen |
Haibo Chen |
YARN-4311 |
Removing nodes from include and exclude lists will not remove them from decommissioned nodes list |
Major |
. |
Kuhu Shukla |
Kuhu Shukla |
YARN-4984 |
LogAggregationService shouldn’t swallow exception in handling createAppDir() which cause thread leak. |
Critical |
log-aggregation |
Junping Du |
Junping Du |
HADOOP-13077 |
Handle special characters in passwords in httpfs.sh |
Major |
. |
Xiao Chen |
Xiao Chen |
HADOOP-13098 |
Dynamic LogLevel setting page should accept case-insensitive log level string |
Major |
. |
Junping Du |
Junping Du |
HDFS-10324 |
Trash directory in an encryption zone should be pre-created with correct permissions |
Major |
encryption |
Wei-Chiu Chuang |
Wei-Chiu Chuang |
MAPREDUCE-6514 |
Job hangs as ask is not updated after ramping down of all reducers |
Blocker |
applicationmaster |
Varun Saxena |
Varun Saxena |
HDFS-2043 |
TestHFlush failing intermittently |
Major |
test |
Aaron T. Myers |
Yiqun Lin |
HADOOP-12751 |
While using kerberos Hadoop incorrectly assumes names with ‘@’ to be non-simple |
Critical |
security |
Bolke de Bruin |
Bolke de Bruin |
YARN-5002 |
getApplicationReport call may raise NPE for removed queues |
Critical |
. |
Sumana Sathish |
Jian He |
MAPREDUCE-6689 |
MapReduce job can infinitely increase number of reducer resource requests |
Blocker |
. |
Wangda Tan |
Wangda Tan |
YARN-4747 |
AHS error 500 due to NPE when container start event is missing |
Major |
timelineserver |
Jason Lowe |
Varun Saxena |
HDFS-9939 |
Increase DecompressorStream skip buffer size |
Major |
. |
Yongjun Zhang |
John Zhuge |
HDFS-10374 |
typo in HDFSHighAvailabilityWithQJM doc. |
Minor |
documentation |
Takashi Ohnishi |
Takashi Ohnishi |
YARN-5048 |
DelegationTokenRenewer#skipTokenRenewal may throw NPE |
Major |
. |
Jian He |
Jian He |
YARN-4926 |
Change nodelabel rest API invalid reponse status to 400 |
Major |
. |
Bibin A Chundatt |
Bibin A Chundatt |
HDFS-10372 |
Fix for failing TestFsDatasetImpl#testCleanShutdownOfVolume |
Major |
test |
Rushabh S Shah |
Rushabh S Shah |
MAPREDUCE-6684 |
High contention on scanning of user directory under immediate_done in Job History Server |
Critical |
jobhistoryserver |
Haibo Chen |
Haibo Chen |
HADOOP-13118 |
Fix IOUtils#cleanup and IOUtils#closeStream javadoc |
Trivial |
io |
Wei-Chiu Chuang |
Wei-Chiu Chuang |
YARN-4768 |
getAvailablePhysicalMemorySize can be inaccurate on linux |
Major |
nodemanager |
Nathan Roberts |
Nathan Roberts |
HADOOP-10694 |
Remove synchronized input streams from Writable deserialization |
Major |
io |
Gopal V |
Gopal V |
HADOOP-13125 |
FS Contract tests don’t report FS initialization errors well |
Minor |
test |
Steve Loughran |
Steve Loughran |
YARN-5029 |
RM needs to send update event with YarnApplicationState as Running to ATS/AHS |
Critical |
. |
Xuan Gong |
Xuan Gong |
HADOOP-13116 |
Jets3tNativeS3FileSystemContractTest does not run. |
Minor |
test |
Chris Nauroth |
Chris Nauroth |
MAPREDUCE-6639 |
Process hangs in LocatedFileStatusFetcher if FileSystem.get throws |
Major |
mrv2 |
Ryan Blue |
Ryan Blue |
HADOOP-11180 |
Change log message “token.Token: Cannot find class for token kind kms-dt” to debug |
Major |
kms, security |
Yi Liu |
Yi Liu |
MAPREDUCE-6558 |
multibyte delimiters with compressed input files generate duplicate records |
Major |
mrv1, mrv2 |
Wilfred Spiegelenburg |
Wilfred Spiegelenburg |
HADOOP-13083 |
The number of javadocs warnings is limited to 100 |
Critical |
. |
Li Lu |
Gergely Novák |
MAPREDUCE-6513 |
MR job got hanged forever when one NM unstable for some time |
Critical |
applicationmaster, resourcemanager |
Bob.zhao |
Varun Saxena |
HDFS-10333 |
Intermittent org.apache.hadoop.hdfs.TestFileAppend failure in trunk |
Major |
hdfs |
Yongjun Zhang |
Yiqun Lin |
HADOOP-12942 |
hadoop credential commands non-obviously use password of “none” |
Major |
security |
Mike Yoder |
Mike Yoder |
YARN-4325 |
Nodemanager log handlers fail to send finished/failed events in some cases |
Critical |
. |
Junping Du |
Junping Du |
HDFS-10410 |
RedundantEditLogInputStream#LOG is set to wrong class |
Minor |
. |
John Zhuge |
John Zhuge |
HDFS-10208 |
Addendum for HDFS-9579: to handle the case when client machine can’t resolve network path |
Major |
. |
Ming Ma |
Ming Ma |
HDFS-10242 |
Cannot create space quota of zero |
Major |
fs |
Takashi Ohnishi |
Takashi Ohnishi |
MAPREDUCE-6693 |
ArrayIndexOutOfBoundsException occurs when the length of the job name is equal to mapreduce.jobhistory.jobname.limit |
Critical |
. |
Bibin A Chundatt |
Ajith S |
HADOOP-13163 |
Reuse pre-computed filestatus in Distcp-CopyMapper |
Minor |
tools/distcp |
Rajesh Balamohan |
Rajesh Balamohan |
HDFS-10303 |
DataStreamer#ResponseProcessor calculates packet ack latency incorrectly. |
Major |
hdfs-client |
Surendra Singh Lilhore |
Surendra Singh Lilhore |
MAPREDUCE-6701 |
application master log can not be available when clicking jobhistory’s am logs link |
Critical |
jobhistoryserver |
chenyukang |
Haibo Chen |
MAPREDUCE-6698 |
Increase timeout on TestUnnecessaryBlockingOnHistoryFileInfo.testTwoThreadsQueryingDifferentJobOfSameUser |
Major |
jobhistoryserver |
Haibo Chen |
Haibo Chen |
HDFS-10404 |
Fix formatting of CacheAdmin command usage help text |
Major |
caching |
Yiqun Lin |
Yiqun Lin |
MAPREDUCE-6657 |
job history server can fail on startup when NameNode is in start phase |
Major |
jobhistoryserver |
Haibo Chen |
Haibo Chen |
HADOOP-13159 |
Fix potential NPE in Metrics2 source for DecayRpcScheduler |
Major |
ipc |
Xiaoyu Yao |
Xiaoyu Yao |
HDFS-10397 |
Distcp should ignore -delete option if -diff option is provided instead of exiting |
Major |
distcp |
Mingliang Liu |
Mingliang Liu |
HDFS-10381 |
DataStreamer DataNode exclusion log message should be warning |
Minor |
hdfs-client |
John Zhuge |
John Zhuge |
HDFS-10360 |
DataNode may format directory and lose blocks if current/VERSION is missing |
Major |
datanode |
Wei-Chiu Chuang |
Wei-Chiu Chuang |
HDFS-9226 |
MiniDFSCluster leaks dependency Mockito via DataNodeTestUtils |
Major |
test |
Josh Elser |
Josh Elser |
HADOOP-13138 |
Unable to append to a SequenceFile with Compression.NONE. |
Critical |
. |
Gervais Mickaël |
Vinayakumar B |
HADOOP-13157 |
Follow-on improvements to hadoop credential commands |
Major |
security |
Mike Yoder |
Mike Yoder |
YARN-3840 |
Resource Manager web ui issue when sorting application by id (with application having id > 9999) |
Major |
resourcemanager |
LINTE |
Varun Saxena |
YARN-5107 |
TestContainerMetrics fails |
Major |
test |
Akira Ajisaka |
Akira Ajisaka |
HADOOP-13177 |
Native tests fail on OS X, because DYLD_LIBRARY_PATH is not defined to include libhadoop.dylib. |
Minor |
build |
Chris Nauroth |
Chris Nauroth |
HADOOP-12767 |
update apache httpclient version to 4.5.2; httpcore to 4.4.4 |
Major |
build |
Artem Aliev |
Artem Aliev |
YARN-5100 |
The YarnApplicationState is always running in ATS no matter the application is running or finishes. |
Blocker |
. |
Xuan Gong |
Xuan Gong |
YARN-5076 |
YARN web interfaces lack XFS protection |
Major |
nodemanager, resourcemanager, timelineserver |
Jonathan Maron |
Jonathan Maron |
HADOOP-13183 |
S3A proxy tests fail after httpclient/httpcore upgrade. |
Major |
fs/s3 |
Chris Nauroth |
Steve Loughran |
YARN-5020 |
Fix Documentation for Yarn Capacity Scheduler on Resource Calculator |
Minor |
. |
Jo Desmet |
Takashi Ohnishi |
HDFS-10424 |
DatanodeLifelineProtocol not able to use under security cluster |
Blocker |
. |
gu-chi |
Chris Nauroth |
HDFS-10438 |
When NameNode HA is configured to use the lifeline RPC server, it should log the address of that server. |
Minor |
ha, namenode |
KWON BYUNGCHANG |
Chris Nauroth |
HDFS-10439 |
Update setOwner doc in HdfsPermissionsGuide |
Minor |
documentation |
John Zhuge |
John Zhuge |
MAPREDUCE-6607 |
Enable regex pattern matching when mapreduce.task.files.preserve.filepattern is set |
Minor |
applicationmaster |
Maysam Yabandeh |
Kai Sasaki |
YARN-5112 |
Excessive log warnings for directory permission issue on NM recovery. |
Major |
. |
Jian He |
Jian He |
YARN-5103 |
With NM recovery enabled, restarting NM multiple times results in AM restart |
Critical |
yarn |
Sumana Sathish |
Junping Du |
YARN-5055 |
max apps per user can be larger than max per queue |
Minor |
capacityscheduler, resourcemanager |
Jason Lowe |
Eric Badger |
YARN-4979 |
FSAppAttempt demand calculation considers demands at multiple locality levels different |
Major |
fairscheduler |
zhihai xu |
zhihai xu |
YARN-3971 |
Skip RMNodeLabelsManager#checkRemoveFromClusterNodeLabelsOfQueue on nodelabel recovery |
Critical |
resourcemanager |
Bibin A Chundatt |
Bibin A Chundatt |
HDFS-9365 |
Balancer does not work with the HDFS-6376 HA setup |
Major |
balancer & mover |
Tsz Wo Nicholas Sze |
Tsz Wo Nicholas Sze |
MAPREDUCE-6703 |
Add flag to allow MapReduce AM to request for OPPORTUNISTIC containers |
Major |
. |
Arun Suresh |
Arun Suresh |
YARN-5131 |
Distributed shell AM fails when extra container arrives during finishing |
Major |
. |
Sumana Sathish |
Wangda Tan |
YARN-3344 |
Fix warning - procfs stat file is not in the expected format |
Major |
. |
Jon Bringhurst |
Ravindra Kumar Naik |
YARN-4459 |
container-executor should only kill process groups |
Major |
nodemanager |
Jun Gong |
Jun Gong |
YARN-4866 |
FairScheduler: AMs can consume all vcores leading to a livelock when using FAIR policy |
Major |
fairscheduler |
Karthik Kambatla |
Yufei Gu |
HDFS-10463 |
TestRollingFileSystemSinkWithHdfs needs some cleanup |
Critical |
. |
Daniel Templeton |
Daniel Templeton |
YARN-5166 |
javadoc:javadoc goal fails on hadoop-yarn-client |
Major |
. |
Andras Bokor |
Andras Bokor |
HDFS-10276 |
HDFS should not expose path info that user has no permission to see. |
Major |
. |
Kevin Cox |
Yuanbo Liu |
YARN-5132 |
Exclude generated protobuf sources from YARN Javadoc build |
Critical |
. |
Subru Krishnan |
Subru Krishnan |
HADOOP-13132 |
Handle ClassCastException on AuthenticationException in LoadBalancingKMSClientProvider |
Major |
kms |
Miklos Szurap |
Wei-Chiu Chuang |
HDFS-10415 |
TestDistributedFileSystem#MyDistributedFileSystem attempts to set up statistics before initialize() is called |
Major |
test |
Sangjin Lee |
Mingliang Liu |
HADOOP-13137 |
TraceAdmin should support Kerberized cluster |
Major |
tracing |
Wei-Chiu Chuang |
Wei-Chiu Chuang |
HDFS-9476 |
TestDFSUpgradeFromImage#testUpgradeFromRel1BBWImage occasionally fail |
Major |
. |
Wei-Chiu Chuang |
Masatake Iwasaki |
HDFS-10367 |
TestDFSShell.testMoveWithTargetPortEmpty fails with Address bind exception. |
Major |
test |
Brahma Reddy Battula |
Brahma Reddy Battula |
HADOOP-13224 |
Grep job in Single Cluster document fails |
Major |
documentation |
Akira Ajisaka |
Akira Ajisaka |
HDFS-10471 |
DFSAdmin#SetQuotaCommand’s help msg is not correct |
Minor |
documentation |
Yiqun Lin |
Yiqun Lin |
YARN-5098 |
Yarn Application log Aggreagation fails due to NM can not get correct HDFS delegation token |
Major |
yarn |
Yesha Vora |
Jian He |
HADOOP-13155 |
Implement TokenRenewer to renew and cancel delegation tokens in KMS |
Major |
kms, security |
Xiao Chen |
Xiao Chen |
HDFS-10481 |
HTTPFS server should correctly impersonate as end user to open file |
Major |
httpfs |
Xiao Chen |
Xiao Chen |
HDFS-10485 |
Fix findbugs warning in FSEditLog.java |
Major |
. |
Akira Ajisaka |
Akira Ajisaka |
HDFS-10458 |
getFileEncryptionInfo should return quickly for non-encrypted cluster |
Major |
encryption, namenode |
Zhe Zhang |
Zhe Zhang |
HDFS-10468 |
HDFS read ends up ignoring an interrupt |
Major |
. |
Siddharth Seth |
Jing Zhao |
YARN-5206 |
RegistrySecurity includes id:pass in exception text if considered invalid |
Minor |
client, security |
Steve Loughran |
Steve Loughran |
HDFS-10220 |
A large number of expired leases can make namenode unresponsive and cause failover |
Major |
namenode |
Nicolas Fraison |
Nicolas Fraison |
MAPREDUCE-6240 |
Hadoop client displays confusing error message |
Major |
client |
Mohammad Kamrul Islam |
Gera Shegalov |
YARN-4308 |
ContainersAggregated CPU resource utilization reports negative usage in first few heartbeats |
Major |
nodemanager |
Sunil G |
Sunil G |
HDFS-10508 |
DFSInputStream should set thread’s interrupt status after catching InterruptException from sleep |
Major |
. |
Jing Zhao |
Jing Zhao |
HADOOP-13249 |
RetryInvocationHandler need wrap InterruptedException in IOException when call Thread.sleep |
Major |
ipc |
zhihai xu |
zhihai xu |
HADOOP-13213 |
Small Documentation bug with AuthenticatedURL in hadoop-auth |
Minor |
documentation |
Tom Ellis |
Tom Ellis |
HADOOP-13243 |
TestRollingFileSystemSink.testSetInitialFlushTime() fails intermittently |
Minor |
test |
Daniel Templeton |
Daniel Templeton |
HADOOP-13079 |
Add -q option to Ls to print ? instead of non-printable characters |
Major |
. |
John Zhuge |
John Zhuge |
HDFS-10516 |
Fix bug when warming up EDEK cache of more than one encryption zone |
Major |
encryption, namenode |
Xiao Chen |
Xiao Chen |
HADOOP-13270 |
BZip2CompressionInputStream finds the same compression marker twice in corner case, causing duplicate data blocks |
Critical |
. |
Haibo Chen |
Kai Sasaki |
HADOOP-13179 |
GenericOptionsParser is not thread-safe because commons-cli OptionBuilder is not thread-safe |
Minor |
. |
hongbin ma |
hongbin ma |
HADOOP-13244 |
o.a.h.ipc.Server#Server should honor handlerCount when queueSizePerHandler is specified in consturctor |
Minor |
ipc |
Xiaoyu Yao |
Kai Sasaki |
HADOOP-13245 |
Fix up some misc create-release issues |
Blocker |
build |
Allen Wittenauer |
Allen Wittenauer |
HDFS-10505 |
OIV’s ReverseXML processor should support ACLs |
Major |
tools |
Colin P. McCabe |
Surendra Singh Lilhore |
HDFS-10525 |
Fix NPE in CacheReplicationMonitor#rescanCachedBlockMap |
Major |
caching |
Xiao Chen |
Xiao Chen |
YARN-5237 |
Fix missing log files issue in rolling log aggregation. |
Major |
. |
Siddharth Seth |
Xuan Gong |
HDFS-10532 |
Typo in RollingUpgrade docs |
Major |
documentation |
Arpit Agarwal |
Yiqun Lin |
HADOOP-3733 |
“s3:” URLs break when Secret Key contains a slash, even if encoded |
Minor |
fs/s3 |
Stuart Sierra |
Steve Loughran |
HDFS-9466 |
TestShortCircuitCache#testDataXceiverCleansUpSlotsOnFailure is flaky |
Major |
fs, hdfs-client |
Wei-Chiu Chuang |
Wei-Chiu Chuang |
HADOOP-13255 |
KMSClientProvider should check and renew tgt when doing delegation token operations. |
Major |
kms |
Xiao Chen |
Xiao Chen |
HADOOP-13242 |
Authenticate to Azure Data Lake using client ID and keys |
Major |
fs/adl |
Atul Sikaria |
Atul Sikaria |
HADOOP-13285 |
DecayRpcScheduler MXBean should only report decayed CallVolumeSummary |
Major |
ipc |
Namit Maheshwari |
Xiaoyu Yao |
HADOOP-13149 |
Windows distro build fails on dist-copynativelibs. |
Blocker |
build |
Chris Nauroth |
Chris Nauroth |
YARN-5077 |
Fix FSLeafQueue#getFairShare() for queues with zero fairshare |
Major |
. |
Yufei Gu |
Yufei Gu |
HDFS-10437 |
ReconfigurationProtocol not covered by HDFSPolicyProvider. |
Major |
namenode |
Chris Nauroth |
Arpit Agarwal |
YARN-5246 |
NMWebAppFilter web redirects drop query parameters |
Major |
. |
Varun Vasudev |
Varun Vasudev |
HADOOP-13192 |
org.apache.hadoop.util.LineReader cannot handle multibyte delimiters correctly |
Critical |
util |
binde |
binde |
HDFS-10448 |
CacheManager#addInternal tracks bytesNeeded incorrectly when dealing with replication factors other than 1 |
Major |
caching |
Yiqun Lin |
Yiqun Lin |
HADOOP-13287 |
TestS3ACredentials#testInstantiateFromURL fails if AWS secret key contains ‘+’. |
Minor |
fs/s3, test |
Chris Nauroth |
Chris Nauroth |
MAPREDUCE-6197 |
Cache MapOutputLocations in ShuffleHandler |
Major |
. |
Siddharth Seth |
Junping Du |
MAPREDUCE-6641 |
TestTaskAttempt fails in trunk |
Major |
test |
Tsuyoshi Ozawa |
Haibo Chen |
YARN-5266 |
Wrong exit code while trying to get app logs using regex via CLI |
Critical |
yarn |
Sumana Sathish |
Xuan Gong |
HDFS-10561 |
test_native_mini_dfs fails by NoClassDefFoundError |
Major |
native, test |
Akira Ajisaka |
Akira Ajisaka |
HDFS-10555 |
Unable to loadFSEdits due to a failure in readCachePoolInfo |
Critical |
caching, namenode |
Uma Maheswara Rao G |
Uma Maheswara Rao G |
MAPREDUCE-6725 |
Javadoc for CLI#listEvents() contains no-existent param |
Minor |
client, documentation |
Shen Yinjie |
Shen Yinjie |
HDFS-7959 |
WebHdfs logging is missing on Datanode |
Critical |
. |
Kihwal Lee |
Kihwal Lee |
HDFS-10536 |
Standby NN can not trigger log roll after EditLogTailer thread failed 3 times in EditLogTailer.triggerActiveLogRoll method. |
Critical |
auto-failover |
XingFeng Shen |
XingFeng Shen |
MAPREDUCE-6542 |
HistoryViewer uses SimpleDateFormat, but SimpleDateFormat is not threadsafe |
Major |
jobhistoryserver |
zhangyubiao |
zhangyubiao |
HADOOP-13251 |
Authenticate with Kerberos credentials when renewing KMS delegation token |
Major |
kms |
Xiao Chen |
Xiao Chen |
HADOOP-13316 |
Enforce Kerberos authentication for required ops in DelegationTokenAuthenticator |
Blocker |
kms, security |
Xiao Chen |
Xiao Chen |
MAPREDUCE-5803 |
Counters page display all task neverthless of task type( Map or Reduce) |
Minor |
jobhistoryserver |
Rohith Sharma K S |
Kai Sasaki |
HADOOP-9888 |
KerberosName static initialization gets default realm, which is unneeded in non-secure deployment. |
Major |
security |
Chris Nauroth |
Dmytro Kabakchei |
HDFS-9852 |
hdfs dfs -setfacl error message is misleading |
Minor |
. |
Wei-Chiu Chuang |
Wei-Chiu Chuang |
YARN-5262 |
Optimize sending RMNodeFinishedContainersPulledByAMEvent for every AM heartbeat |
Major |
resourcemanager |
Rohith Sharma K S |
Rohith Sharma K S |
YARN-5182 |
MockNodes.newNodes creates one more node per rack than requested |
Major |
test |
Karthik Kambatla |
Karthik Kambatla |
HADOOP-12345 |
Pad hostname correctly in CredentialsSys.java |
Critical |
nfs |
Pradeep Nayak Udupi Kadbet |
Pradeep Nayak Udupi Kadbet |
YARN-5282 |
Fix typos in CapacityScheduler documentation |
Trivial |
documentation |
Ray Chiang |
Ray Chiang |
HADOOP-13314 |
Remove ‘package-info.java’ from ‘test\java\org\apache\hadoop\fs\shell\’ to remove eclipse compile error |
Trivial |
. |
Vinayakumar B |
Vinayakumar B |
HDFS-10572 |
Fix TestOfflineEditsViewer#testGenerated |
Blocker |
test |
Xiaoyu Yao |
Surendra Singh Lilhore |
HDFS-10589 |
Javadoc for HAState#HAState and HAState#setStateInternal contains non-existent params |
Minor |
documentation, hdfs |
Shen Yinjie |
Shen Yinjie |
YARN-5286 |
Add RPC port info in RM web service’s response when getting app status |
Major |
. |
Jun Gong |
Jun Gong |
HADOOP-13342 |
ISAL download is breaking the Dockerfile |
Blocker |
build |
Allen Wittenauer |
Allen Wittenauer |
YARN-5214 |
Pending on synchronized method DirectoryCollection#checkDirs can hang NM’s NodeStatusUpdater |
Critical |
nodemanager |
Junping Du |
Junping Du |
YARN-5296 |
NMs going OutOfMemory because ContainerMetrics leak in ContainerMonitorImpl |
Major |
nodemanager |
Karam Singh |
Junping Du |
YARN-5294 |
Pass remote ip address down to YarnAuthorizationProvider |
Major |
. |
Jian He |
Jian He |
HADOOP-13350 |
Additional fix to LICENSE and NOTICE |
Blocker |
build |
Xiao Chen |
Xiao Chen |
HDFS-10592 |
Fix intermittent test failure of TestNameNodeResourceChecker#testCheckThatNameNodeResourceMonitorIsRunning |
Major |
test |
Rakesh R |
Rakesh R |
HADOOP-13349 |
HADOOP_CLASSPATH vs HADOOP_USER_CLASSPATH |
Blocker |
scripts |
Allen Wittenauer |
Allen Wittenauer |
HADOOP-13320 |
Fix arguments check in documentation for WordCount v2.0 |
Minor |
documentation |
niccolo becchi |
niccolo becchi |
YARN-5314 |
ConcurrentModificationException in ATS v1.5 EntityGroupFSTimelineStore |
Major |
timelineserver |
Karam Singh |
Li Lu |
YARN-4939 |
the decommissioning Node should keep alive if NM restart |
Major |
. |
sandflee |
sandflee |
HADOOP-12893 |
Verify LICENSE.txt and NOTICE.txt |
Blocker |
build |
Allen Wittenauer |
Xiao Chen |
HADOOP-13352 |
Make X-FRAME-OPTIONS configurable in HttpServer2 |
Major |
net, security |
Anu Engineer |
Anu Engineer |
HDFS-10336 |
TestBalancer failing intermittently because of not reseting UserGroupInformation completely |
Major |
test |
Yiqun Lin |
Yiqun Lin |
HDFS-10512 |
VolumeScanner may terminate due to NPE in DataNode.reportBadBlocks |
Major |
datanode |
Wei-Chiu Chuang |
Yiqun Lin |
YARN-5337 |
Fix OOM issue in DistributedShell. AM failed with “java.lang.OutOfMemoryError: GC overhead limit exceeded” |
Major |
. |
Sumana Sathish |
Jian He |
HADOOP-13297 |
Add missing dependency in setting maven-remote-resource-plugin to fix builds |
Major |
build |
Akira Ajisaka |
Sean Busbey |
YARN-5270 |
Solve miscellaneous issues caused by YARN-4844 |
Blocker |
. |
Wangda Tan |
Wangda Tan |
YARN-5354 |
TestDistributedShell.checkTimelineV2() may fail for concurrent tests |
Major |
timelineserver |
Sangjin Lee |
Sangjin Lee |
MAPREDUCE-6731 |
TestMRTimelineEventHandling.testMRNewTimelineServiceEventHandling() may fail for concurrent tests |
Major |
test |
Sangjin Lee |
Sangjin Lee |
HDFS-10579 |
HDFS web interfaces lack configs for X-FRAME-OPTIONS protection |
Major |
datanode, namenode |
Anu Engineer |
Anu Engineer |
YARN-4366 |
Fix Lint Warnings in YARN Common |
Major |
yarn |
Daniel Templeton |
Daniel Templeton |
MAPREDUCE-6625 |
TestCLI#testGetJob fails occasionally |
Major |
test |
Jason Lowe |
Haibo Chen |
HADOOP-13315 |
FileContext#umask is not initialized properly |
Minor |
. |
John Zhuge |
John Zhuge |
YARN-5353 |
ResourceManager can leak delegation tokens when they are shared across apps |
Critical |
resourcemanager |
Jason Lowe |
Jason Lowe |
HDFS-10590 |
Fix TestReconstructStripedBlocks.testCountLiveReplicas test failures |
Major |
. |
Rakesh R |
Rakesh R |
HADOOP-11361 |
Fix a race condition in MetricsSourceAdapter.updateJmxCache |
Major |
. |
Brahma Reddy Battula |
Brahma Reddy Battula |
YARN-5362 |
TestRMRestart#testFinishedAppRemovalAfterRMRestart can fail |
Major |
. |
Jason Lowe |
sandflee |
YARN-5359 |
FileSystemTimelineReader/Writer uses unix-specific default storage path |
Minor |
. |
Sangjin Lee |
Sangjin Lee |
YARN-5364 |
timelineservice modules have indirect dependencies on mapreduce artifacts |
Minor |
timelineserver |
Sangjin Lee |
Sangjin Lee |
HDFS-10544 |
Balancer doesn’t work with IPFailoverProxyProvider |
Major |
balancer & mover, ha |
Zhe Zhang |
Zhe Zhang |
HDFS-10617 |
PendingReconstructionBlocks.size() should be synchronized |
Major |
. |
Eric Badger |
Eric Badger |
HADOOP-13351 |
TestDFSClientSocketSize buffer size tests are flaky |
Major |
. |
Aaron Fabbri |
Aaron Fabbri |
YARN-5379 |
TestHBaseTimelineStorage. testWriteApplicationToHBase() fails intermittently |
Minor |
test, timelineserver |
Sangjin Lee |
Vrushali C |
YARN-5383 |
Fix findbugs for nodemanager & checkstyle warnings in nodemanager.ContainerExecutor |
Major |
nodemanager |
Vrushali C |
Vrushali C |
MAPREDUCE-6733 |
MapReduce JerseyTest tests failing with “java.net.BindException: Address already in use” |
Critical |
test |
Vinod Kumar Vavilapalli |
Vinod Kumar Vavilapalli |
HADOOP-13254 |
Create framework for configurable disk checkers |
Major |
util |
Yufei Gu |
Yufei Gu |
YARN-5272 |
Handle queue names consistently in FairScheduler |
Major |
fairscheduler |
Wilfred Spiegelenburg |
Wilfred Spiegelenburg |
HDFS-10639 |
Fix typos in HDFSDiskbalancer.md |
Trivial |
documentation |
Akira Ajisaka |
Yiqun Lin |
HADOOP-13073 |
RawLocalFileSystem does not react on changing umask |
Major |
fs |
Andras Bokor |
Andras Bokor |
HADOOP-13202 |
Avoid possible overflow in org.apache.hadoop.util.bloom.BloomFilter#getNBytes |
Major |
util |
zhengbing li |
Kai Sasaki |
YARN-5213 |
Fix a bug in LogCLIHelpers which cause TestLogsCLI#testFetchApplictionLogs fails intermittently |
Major |
test |
Rohith Sharma K S |
Xuan Gong |
HDFS-10603 |
Fix flaky tests in org.apache.hadoop.hdfs.server.namenode.snapshot.TestOpenFilesWithSnapshot |
Major |
hdfs, namenode |
Yongjun Zhang |
Yiqun Lin |
HADOOP-12991 |
Conflicting default ports in DelegateToFileSystem |
Major |
fs |
Kevin Hogeland |
Kai Sasaki |
YARN-5309 |
Fix SSLFactory truststore reloader thread leak in TimelineClientImpl |
Blocker |
timelineserver, yarn |
Thomas Friedrich |
Weiwei Yang |
YARN-5340 |
Race condition in RollingLevelDBTimelineStore#getAndSetStartTime() |
Critical |
timelineserver |
Sumana Sathish |
Li Lu |
HDFS-8914 |
Document HA support in the HDFS HdfsDesign.md |
Major |
documentation |
Ravindra Babu |
Lars Francke |
HADOOP-12588 |
Fix intermittent test failure of TestGangliaMetrics |
Major |
. |
Tsuyoshi Ozawa |
Masatake Iwasaki |
HADOOP-13240 |
TestAclCommands.testSetfaclValidations fail |
Minor |
test |
linbao111 |
John Zhuge |
HADOOP-13393 |
[Azure Data Lake] Correction needed in fs.defaultFS support in documentation |
Major |
fs/adl |
Vishwajeet Dusane |
Vishwajeet Dusane |
HADOOP-13392 |
[Azure Data Lake] OAuth2 configuration should be default set to true when AdlFileSystem is configured. |
Major |
fs/adl |
Vishwajeet Dusane |
Vishwajeet Dusane |
HADOOP-13389 |
TestS3ATemporaryCredentials.testSTS error when using IAM credentials |
Major |
fs/s3 |
Steven K. Wong |
Steven K. Wong |
HADOOP-13406 |
S3AFileSystem: Consider reusing filestatus in delete() and mkdirs() |
Minor |
fs/s3 |
Rajesh Balamohan |
Rajesh Balamohan |
MAPREDUCE-6744 |
Increase timeout on TestDFSIO tests |
Major |
. |
Eric Badger |
Eric Badger |
HDFS-10688 |
BPServiceActor may run into a tight loop for sending block report when hitting IOException |
Major |
datanode |
Jing Zhao |
Chen Liang |
HDFS-10671 |
Fix typo in HdfsRollingUpgrade.md |
Trivial |
documentation |
Yiqun Lin |
Yiqun Lin |
HADOOP-13422 |
ZKDelegationTokenSecretManager JaasConfig does not work well with other ZK users in process |
Major |
. |
Sergey Shelukhin |
Sergey Shelukhin |
YARN-5195 |
RM intermittently crashed with NPE while handling APP_ATTEMPT_REMOVED event when async-scheduling enabled in CapacityScheduler |
Major |
resourcemanager |
Karam Singh |
sandflee |
HADOOP-9427 |
Use JUnit assumptions to skip platform-specific tests |
Major |
test |
Arpit Agarwal |
Gergely Novák |
YARN-5441 |
Fixing minor Scheduler test case failures |
Major |
. |
Subru Krishnan |
Subru Krishnan |
YARN-5431 |
TimeLineReader daemon start should allow to pass its own reader opts |
Major |
scripts, timelinereader |
Rohith Sharma K S |
Rohith Sharma K S |
HDFS-10696 |
TestHDFSCLI fails |
Major |
test |
Akira Ajisaka |
Kai Sasaki |
YARN-5432 |
Lock already held by another process while LevelDB cache store creation for dag |
Critical |
timelineserver |
Karam Singh |
Li Lu |
YARN-5440 |
Use AHSClient in YarnClient when TimelineServer is running |
Major |
. |
Xuan Gong |
Xuan Gong |
YARN-5438 |
TimelineClientImpl leaking FileSystem Instances causing Long running services like HiverServer2 daemon going OOM |
Major |
timelineserver |
Karam Singh |
Rohith Sharma K S |
YARN-5203 |
Return ResourceRequest JAXB object in ResourceManager Cluster Applications REST API |
Major |
. |
Subru Krishnan |
Ellen Hui |
HDFS-9276 |
Failed to Update HDFS Delegation Token for long running application in HA mode |
Major |
fs, ha, security |
Liangliang Gu |
Liangliang Gu |
YARN-5436 |
Race in AsyncDispatcher can cause random test failures in Tez (probably YARN also) |
Major |
. |
Zhiyuan Yang |
Zhiyuan Yang |
HADOOP-13381 |
KMS clients should use KMS Delegation Tokens from current UGI. |
Critical |
kms |
Xiao Chen |
Xiao Chen |
HDFS-10691 |
FileDistribution fails in hdfs oiv command due to ArrayIndexOutOfBoundsException |
Major |
. |
Yiqun Lin |
Yiqun Lin |
YARN-5121 |
fix some container-executor portability issues |
Blocker |
nodemanager, security |
Allen Wittenauer |
Allen Wittenauer |
HADOOP-13440 |
FileContext does not react on changing umask via configuration |
Major |
. |
Yufei Gu |
Akira Ajisaka |
YARN-5444 |
Fix failing unit tests in TestLinuxContainerExecutorWithMocks |
Major |
nodemanager |
Yufei Gu |
Yufei Gu |
MAPREDUCE-6724 |
Single shuffle to memory must not exceed Integer#MAX_VALUE |
Major |
mrv2 |
Haibo Chen |
Haibo Chen |
HDFS-5805 |
TestCheckpoint.testCheckpoint fails intermittently on branch2 |
Major |
. |
Mit Desai |
Eric Badger |
HADOOP-13459 |
hadoop-azure runs several test cases repeatedly, causing unnecessarily long running time. |
Minor |
fs/azure, test |
Chris Nauroth |
Chris Nauroth |
HDFS-742 |
A down DataNode makes Balancer to hang on repeatingly asking NameNode its partial block list |
Minor |
balancer & mover |
Hairong Kuang |
Mit Desai |
YARN-4280 |
CapacityScheduler reservations may not prevent indefinite postponement on a busy cluster |
Major |
capacity scheduler |
Kuhu Shukla |
Kuhu Shukla |
YARN-5462 |
TestNodeStatusUpdater.testNodeStatusUpdaterRetryAndNMShutdown fails intermittently |
Major |
. |
Eric Badger |
Eric Badger |
HDFS-10710 |
In BlockManager#rescanPostponedMisreplicatedBlocks(), postponed misreplicated block counts should be retrieved with NN lock protection |
Major |
namenode |
Rui Gao |
Rui Gao |
YARN-5469 |
Increase timeout of TestAmFilter.testFilter |
Minor |
. |
Eric Badger |
Eric Badger |
HDFS-10569 |
A bug causes OutOfIndex error in BlockListAsLongs |
Minor |
. |
Weiwei Yang |
Weiwei Yang |
HADOOP-13434 |
Add quoting to Shell class |
Major |
. |
Owen O’Malley |
Owen O’Malley |
MAPREDUCE-6682 |
TestMRCJCFileOutputCommitter fails intermittently |
Major |
test |
Brahma Reddy Battula |
Akira Ajisaka |
HADOOP-13443 |
KMS should check the type of underlying keyprovider of KeyProviderExtension before falling back to default |
Minor |
kms |
Anthony Young-Garner |
Anthony Young-Garner |
HDFS-10716 |
In Balancer, the target task should be removed when its size < 0. |
Minor |
balancer & mover |
Yiqun Lin |
Yiqun Lin |
HDFS-10722 |
Fix race condition in TestEditLog#testBatchedSyncWithClosedLogs |
Major |
hdfs |
Daryn Sharp |
Daryn Sharp |
HADOOP-13467 |
Shell#getSignalKillCommand should use the bash builtin on Linux |
Major |
. |
Arpit Agarwal |
Arpit Agarwal |
HDFS-10343 |
BlockManager#createLocatedBlocks may return blocks on failed storages |
Major |
hdfs |
Daryn Sharp |
Kuhu Shukla |
HDFS-10715 |
NPE when applying AvailableSpaceBlockPlacementPolicy |
Major |
namenode |
Guangbin Zhu |
Guangbin Zhu |
YARN-5333 |
Some recovered apps are put into default queue when RM HA |
Major |
. |
Jun Gong |
Jun Gong |
HADOOP-13353 |
LdapGroupsMapping getPassward shouldn’t return null when IOException throws |
Major |
security |
Zhaohao Liang |
Wei-Chiu Chuang |
YARN-4624 |
NPE in PartitionQueueCapacitiesInfo while accessing Schduler UI |
Major |
. |
Brahma Reddy Battula |
Brahma Reddy Battula |
HADOOP-10823 |
TestReloadingX509TrustManager is flaky |
Major |
. |
Ratandeep Ratti |
Mingliang Liu |
HADOOP-13403 |
AzureNativeFileSystem rename/delete performance improvements |
Major |
fs/azure |
Subramanyam Pattipaka |
Subramanyam Pattipaka |
HADOOP-13457 |
Remove hardcoded absolute path for shell executable |
Major |
util |
Arpit Agarwal |
Chen Liang |
HDFS-10457 |
DataNode should not auto-format block pool directory if VERSION is missing |
Major |
datanode |
Wei-Chiu Chuang |
Wei-Chiu Chuang |
HDFS-4176 |
EditLogTailer should call rollEdits with a timeout |
Major |
ha, namenode |
Todd Lipcon |
Lei (Eddy) Xu |
HADOOP-13439 |
Fix race between TestMetricsSystemImpl and TestGangliaMetrics |
Minor |
test |
Masatake Iwasaki |
Chen Liang |
YARN-5474 |
Typo mistake in AMRMClient#getRegisteredTimeineClient API |
Trivial |
. |
Rohith Sharma K S |
Naganarasimha G R |
MAPREDUCE-6750 |
TestHSAdminServer.testRefreshSuperUserGroups is failing |
Minor |
test |
Kihwal Lee |
Kihwal Lee |
HADOOP-13473 |
Tracing in IPC Server is broken |
Major |
. |
Wei-Chiu Chuang |
Daryn Sharp |
HDFS-10738 |
Fix TestRefreshUserMappings.testRefreshSuperUserGroupsConfiguration test failure |
Major |
test |
Rakesh R |
Rakesh R |
HADOOP-13299 |
JMXJsonServlet is vulnerable to TRACE |
Minor |
. |
Haibo Chen |
Haibo Chen |
HADOOP-13476 |
CredentialProviderFactory fails at class loading from libhdfs (JNI) |
Major |
fs/s3 |
Aaron Fabbri |
Aaron Fabbri |
HDFS-8224 |
Schedule a block for scanning if its metadata file is corrupt |
Major |
datanode |
Rushabh S Shah |
Rushabh S Shah |
YARN-5382 |
RM does not audit log kill request for active applications |
Major |
resourcemanager |
Jason Lowe |
Vrushali C |
HDFS-10643 |
Namenode should use loginUser(hdfs) to generateEncryptedKey |
Major |
encryption, namenode |
Xiaoyu Yao |
Xiaoyu Yao |
HADOOP-13461 |
NPE in KeyProvider.rollNewVersion |
Minor |
. |
Colm O hEigeartaigh |
Colm O hEigeartaigh |
HDFS-10720 |
Fix intermittent test failure of TestDataNodeErasureCodingMetrics |
Major |
. |
Rakesh R |
Rakesh R |
HDFS-8897 |
Balancer should handle fs.defaultFS trailing slash in HA |
Major |
balancer & mover |
LINTE |
John Zhuge |
HADOOP-13441 |
Document LdapGroupsMapping keystore password properties |
Minor |
security |
Wei-Chiu Chuang |
Yuanbo Liu |
HDFS-10731 |
FSDirectory#verifyMaxDirItems does not log path name |
Minor |
namenode |
Wei-Chiu Chuang |
Wei-Chiu Chuang |
YARN-4833 |
For Queue AccessControlException client retries multiple times on both RM |
Major |
. |
Bibin A Chundatt |
Bibin A Chundatt |
YARN-5476 |
Not existed application reported as ACCEPTED state by YarnClientImpl |
Critical |
yarn |
Yesha Vora |
Junping Du |
YARN-5491 |
Random Failure TestCapacityScheduler#testCSQueueBlocked |
Major |
test |
Bibin A Chundatt |
Bibin A Chundatt |
HDFS-9696 |
Garbage snapshot records lingering forever |
Critical |
. |
Kihwal Lee |
Kihwal Lee |
YARN-5521 |
TestCapacityScheduler#testKillAllAppsInQueue fails randomly |
Major |
. |
Varun Saxena |
sandflee |
HADOOP-13333 |
testConf.xml ls comparators in wrong order |
Trivial |
fs |
John Zhuge |
Vrushali C |
HADOOP-13437 |
KMS should reload whitelist and default key ACLs when hot-reloading |
Major |
kms |
Xiao Chen |
Xiao Chen |
YARN-5475 |
Test failed for TestAggregatedLogFormat on trunk |
Major |
. |
Junping Du |
Jun Gong |
HADOOP-13470 |
GenericTestUtils$LogCapturer is flaky |
Major |
test, util |
Mingliang Liu |
Mingliang Liu |
YARN-5523 |
Yarn running container log fetching causes OutOfMemoryError |
Major |
log-aggregation |
Prasanth Jayachandran |
Xuan Gong |
HADOOP-13494 |
ReconfigurableBase can log sensitive information |
Major |
security |
Sean Mackrory |
Sean Mackrory |
HDFS-9530 |
ReservedSpace is not cleared for abandoned Blocks |
Critical |
datanode |
Fei Hui |
Brahma Reddy Battula |
HADOOP-11786 |
Fix Javadoc typos in org.apache.hadoop.fs.FileSystem |
Trivial |
documentation |
Chen He |
Andras Bokor |
HDFS-10549 |
Correctly revoke file leases when closing files |
Major |
hdfs-client |
Yiqun Lin |
Yiqun Lin |
HDFS-10773 |
BlockSender should not synchronize on the dataset object |
Major |
datanode |
Arpit Agarwal |
Chen Liang |
HADOOP-13513 |
Java 1.7 support for org.apache.hadoop.fs.azure testcases |
Minor |
fs/azure |
Tibor Kiss |
Tibor Kiss |
HADOOP-13512 |
ReloadingX509TrustManager should keep reloading in case of exception |
Critical |
security |
Mingliang Liu |
Mingliang Liu |
HDFS-10763 |
Open files can leak permanently due to inconsistent lease update |
Critical |
. |
Kihwal Lee |
Kihwal Lee |
YARN-4307 |
Display blacklisted nodes for AM container in the RM web UI |
Major |
resourcemanager, webapp |
Naganarasimha G R |
Naganarasimha G R |
YARN-5533 |
JMX AM Used metrics for queue wrong when app submited to nodelabel partition |
Major |
. |
Bibin A Chundatt |
Bibin A Chundatt |
MAPREDUCE-6763 |
Shuffle server listen queue is too small |
Major |
mrv2 |
Jason Lowe |
Jason Lowe |
YARN-4837 |
User facing aspects of ‘AM blacklisting’ feature need fixing |
Critical |
. |
Vinod Kumar Vavilapalli |
Vinod Kumar Vavilapalli |
MAPREDUCE-6310 |
Add jdiff support to MapReduce |
Blocker |
. |
Li Lu |
Li Lu |
YARN-3388 |
Allocation in LeafQueue could get stuck because DRF calculator isn’t well supported when computing user-limit |
Major |
capacityscheduler |
Nathan Roberts |
Nathan Roberts |
YARN-4685 |
Disable AM blacklisting by default to mitigate situations that application get hanged |
Critical |
resourcemanager |
Rohith Sharma K S |
Rohith Sharma K S |
HADOOP-13428 |
Fix hadoop-common to generate jdiff |
Blocker |
. |
Wangda Tan |
Wangda Tan |
HDFS-10764 |
Fix INodeFile#getBlocks to not return null |
Major |
namenode |
Arpit Agarwal |
Arpit Agarwal |
MAPREDUCE-6762 |
ControlledJob#toString failed with NPE when job status is not successfully updated |
Major |
. |
Weiwei Yang |
Weiwei Yang |
HDFS-10692 |
Point JDiff base version for HDFS from 2.6.0 to 2.7.2 |
Blocker |
. |
Wangda Tan |
Wangda Tan |
HADOOP-13487 |
Hadoop KMS should load old delegation tokens from Zookeeper on startup |
Major |
kms |
Alex Ivanov |
Xiao Chen |
HADOOP-13526 |
Add detailed logging in KMS for the authentication failure of proxy user |
Minor |
kms |
Suraj Acharya |
Suraj Acharya |
HDFS-8312 |
Trash does not descent into child directories to check for permissions |
Critical |
fs, security |
Eric Yang |
Weiwei Yang |
HDFS-10783 |
The option ‘-maxSize’ and ‘-step’ fail in OfflineImageViewer |
Major |
tools |
Yiqun Lin |
Yiqun Lin |
HADOOP-13524 |
mvn eclipse:eclipse generates .gitignore’able files |
Major |
. |
Vinod Kumar Vavilapalli |
Vinod Kumar Vavilapalli |
HADOOP-13497 |
fix wrong command in CredentialProviderAPI.md |
Trivial |
documentation |
Yuanbo Liu |
Yuanbo Liu |
MAPREDUCE-6761 |
Regression when handling providers - invalid configuration ServiceConfiguration causes Cluster initialization failure |
Major |
mrv2 |
Peter Vary |
Peter Vary |
MAPREDUCE-6767 |
TestSlive fails after a common change |
Major |
. |
Kihwal Lee |
Daniel Templeton |
YARN-5537 |
Intermittent test failure of TestAMRMClient#testAMRMClientWithContainerResourceChange |
Major |
. |
Varun Saxena |
Bibin A Chundatt |
HADOOP-13532 |
Fix typo in hadoop_connect_to_hosts error message |
Trivial |
scripts |
Albert Chu |
Albert Chu |
HADOOP-13533 |
User cannot set empty HADOOP_SSH_OPTS environment variable option |
Minor |
scripts |
Albert Chu |
Albert Chu |
HDFS-10748 |
TestFileTruncate#testTruncateWithDataNodesRestart runs sometimes timeout |
Major |
test |
Xiaoyu Yao |
Yiqun Lin |
YARN-5430 |
Return container’s ip and host from NM ContainerStatus call |
Major |
. |
Jian He |
Jian He |
HDFS-8915 |
TestFSNamesystem.testFSLockGetWaiterCount fails intermittently in jenkins |
Minor |
test |
Anu Engineer |
Masatake Iwasaki |
YARN-5373 |
NPE listing wildcard directory in containerLaunch |
Blocker |
nodemanager |
Haibo Chen |
Daniel Templeton |
HDFS-10793 |
Fix HdfsAuditLogger binary incompatibility introduced by HDFS-9184 |
Blocker |
. |
Andrew Wang |
Manoj Govindassamy |
HDFS-10652 |
Add a unit test for HDFS-4660 |
Major |
datanode, hdfs |
Yongjun Zhang |
Vinayakumar B |
HADOOP-13552 |
RetryInvocationHandler logs all remote exceptions |
Blocker |
ipc |
Jason Lowe |
Jason Lowe |
HADOOP-12765 |
HttpServer2 should switch to using the non-blocking SslSelectChannelConnector to prevent performance degradation when handling SSL connections |
Major |
. |
Min Shen |
Min Shen |
MAPREDUCE-6768 |
TestRecovery.testSpeculative failed with NPE |
Major |
mrv2 |
Haibo Chen |
Haibo Chen |
HADOOP-13559 |
Remove close() within try-with-resources in ChecksumFileSystem/ChecksumFs classes |
Minor |
fs |
Aaron Fabbri |
Aaron Fabbri |
HDFS-4210 |
Throw helpful exception when DNS entry for JournalNode cannot be resolved |
Trivial |
ha, journal-node, namenode |
Damien Hardy |
John Zhuge |
YARN-5190 |
Registering/unregistering container metrics triggered by ContainerEvent and ContainersMonitorEvent are conflict which cause uncaught exception in ContainerMonitorImpl |
Blocker |
. |
Junping Du |
Junping Du |
HADOOP-12597 |
In kms-site.xml configuration “hadoop.security.keystore.JavaKeyStoreProvider.password” should be updated with new name |
Minor |
security |
huangyitian |
Surendra Singh Lilhore |
HDFS-10423 |
Increase default value of httpfs maxHttpHeaderSize |
Minor |
hdfs |
Nicolae Popa |
Nicolae Popa |
HADOOP-13410 |
RunJar adds the content of the jar twice to the classpath |
Major |
util |
Sangjin Lee |
Yuanbo Liu |
HDFS-10570 |
Remove classpath conflicts of netty-all jar in hadoop-hdfs-client |
Minor |
test |
Vinayakumar B |
Vinayakumar B |
YARN-5234 |
ResourceManager REST API missing descriptions for what’s returned when using Fair Scheduler |
Minor |
documentation, fairscheduler, resourcemanager |
Grant Sohn |
|
HDFS-10620 |
StringBuilder created and appended even if logging is disabled |
|