Apache Hadoop Changelog

Release 2.7.6 - 2018-04-16

NEW FEATURES:

JIRA Summary Priority Component Reporter Contributor
HADOOP-9477 Add posixGroups support for LDAP groups mapping service Major . Kai Zheng Dapeng Sun

IMPROVEMENTS:

JIRA Summary Priority Component Reporter Contributor
HADOOP-12472 Make GenericTestUtils.assertExceptionContains robust Minor test Steve Loughran Steve Loughran
HADOOP-12568 Update core-default.xml to describe posixGroups support Minor documentation Wei-Chiu Chuang Wei-Chiu Chuang
HADOOP-13105 Support timeouts in LDAP queries in LdapGroupsMapping. Major security Chris Nauroth Mingliang Liu
HADOOP-13263 Reload cached groups in background after expiry Major . Stephen O’Donnell Stephen O’Donnell
HDFS-11003 Expose “XmitsInProgress” through DataNodeMXBean Major . Brahma Reddy Battula Brahma Reddy Battula
HADOOP-14246 Authentication Tokens should use SecureRandom instead of Random and 256 bit secrets Major security Robert Kanter Robert Kanter
YARN-7590 Improve container-executor validation check Major security, yarn Eric Yang Eric Yang
HADOOP-15212 Add independent secret manager method for logging expired tokens Major security Daryn Sharp Daryn Sharp
MAPREDUCE-7048 Uber AM can crash due to unknown task in statusUpdate Major mr-am Peter Bacsko Peter Bacsko
HDFS-11187 Optimize disk access for last partial chunk checksum of Finalized replica Major datanode Wei-Chiu Chuang Gabor Bota
HADOOP-15279 increase maven heap size recommendations Minor build, documentation, test Allen Wittenauer Allen Wittenauer
HDFS-12884 BlockUnderConstructionFeature.truncateBlock should be of type BlockInfo Major namenode Konstantin Shvachko chencan
HADOOP-15345 Backport HADOOP-12185 to branch-2.7: NetworkTopology is not efficient adding/getting/removing nodes Major . He Xiaoqiao He Xiaoqiao

BUG FIXES:

JIRA Summary Priority Component Reporter Contributor
YARN-3425 NPE from RMNodeLabelsManager.serviceStop when NodeLabelsManager.serviceInit failed Minor resourcemanager Bibin A Chundatt Bibin A Chundatt
HADOOP-12001 Limiting LDAP search conflicts with posixGroup addition Blocker security Patrick White Patrick White
YARN-4167 NPE on RMActiveServices#serviceStop when store is null Minor . Bibin A Chundatt Bibin A Chundatt
HADOOP-12181 Fix intermittent test failure of TestZKSignerSecretProvider Minor . Masatake Iwasaki Masatake Iwasaki
HDFS-7959 WebHdfs logging is missing on Datanode Critical . Kihwal Lee Kihwal Lee
HDFS-4210 Throw helpful exception when DNS entry for JournalNode cannot be resolved Trivial ha, journal-node, namenode Damien Hardy John Zhuge
HADOOP-13375 o.a.h.security.TestGroupsCaching.testBackgroundRefreshCounters seems flaky Major security, test Mingliang Liu Weiwei Yang
HADOOP-12611 TestZKSignerSecretProvider#testMultipleInit occasionally fail Major . Wei-Chiu Chuang Eric Badger
HADOOP-13508 FsPermission string constructor does not recognize sticky bit Major . Atul Sikaria Atul Sikaria
HDFS-12299 Race Between update pipeline and DN Re-Registration Critical . Brahma Reddy Battula Brahma Reddy Battula
HDFS-12371 “BlockVerificationFailures” and “BlocksVerified” show up as 0 in Datanode JMX Major metrics Sai Nukavarapu Hanisha Koneru
MAPREDUCE-5124 AM lacks flow control for task events Major mr-am Jason Lowe Peter Bacsko
HDFS-12881 Output streams closed with IOUtils suppressing write errors Major . Jason Lowe Ajay Kumar
YARN-7661 NodeManager metrics return wrong value after update node resource Major . Yang Wang Yang Wang
HDFS-12347 TestBalancerRPCDelay#testBalancerRPCDelay fails very frequently Critical test Xiao Chen Bharat Viswanadham
YARN-6632 Backport YARN-3425 to branch 2.7 Major . Íñigo Goiri Íñigo Goiri
HADOOP-15143 NPE due to Invalid KerberosTicket in UGI Major . Jitendra Nath Pandey Mukul Kumar Singh
MAPREDUCE-7028 Concurrent task progress updates causing NPE in Application Master Blocker mr-am Gergo Repas Gergo Repas
HADOOP-12751 While using kerberos Hadoop incorrectly assumes names with ‘@’ to be non-simple Critical security Bolke de Bruin Bolke de Bruin
MAPREDUCE-7020 Task timeout in uber mode can crash AM Major mr-am Akira Ajisaka Peter Bacsko
HDFS-13126 Backport [HDFS-7959] to branch-2.7 to re-enable HTTP request logging for WebHDFS Major datanode, webhdfs Erik Krogen Erik Krogen
HDFS-13120 Snapshot diff could be corrupted after concat Major namenode, snapshots Xiaoyu Yao Xiaoyu Yao
HDFS-10453 ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster. Major namenode He Xiaoqiao He Xiaoqiao
MAPREDUCE-7052 TestFixedLengthInputFormat#testFormatCompressedIn is flaky Major client, test Peter Bacsko Peter Bacsko
HDFS-13112 Token expiration edits may cause log corruption or deadlock Critical namenode Daryn Sharp Daryn Sharp
HADOOP-15206 BZip2 drops and duplicates records when input split size is small Major . Aki Tanaka Aki Tanaka
HADOOP-15283 Upgrade from findbugs 3.0.1 to spotbugs 3.1.2 in branch-2 to fix docker image build Major . Xiao Chen Akira Ajisaka
HDFS-13195 DataNode conf page cannot display the current value after reconfig Minor datanode maobaolong maobaolong
HADOOP-12862 LDAP Group Mapping over SSL can not specify trust store Major . Wei-Chiu Chuang Wei-Chiu Chuang
YARN-7249 Fix CapacityScheduler NPE issue when a container preempted while the node is being removed Blocker . Wangda Tan Wangda Tan

OTHER:

JIRA Summary Priority Component Reporter Contributor
YARN-6633 Backport YARN-4167 to branch 2.7 Major . Íñigo Goiri Íñigo Goiri
HADOOP-15177 Update the release year to 2018 Blocker build Akira Ajisaka Bharat Viswanadham