Skip to content

Conversation

@whbing
Copy link
Owner

@whbing whbing commented May 10, 2021

NOTICE

Please create an issue in ASF JIRA before opening a pull request,
and you need to set the title of the pull request which starts with
the corresponding JIRA issue number. (e.g. HADOOP-XXXXX. Fix a typo in YYY.)
For more details, please see https://cwiki.apache.org/confluence/display/HADOOP/How+To+Contribute

aajisaka and others added 30 commits April 23, 2021 19:52
Reviewed-by: Wei-Chiu Chuang <weichiu@apache.org>
… removed when the container is actually reserved, not assigned in FairScheduler. Contributed by Siddharth Ahuja.
…ll. (#2861). Contributed by Ayush Saxena.

Signed-off-by: Vinayakumar B <vinayakumarb@apache.org>
Followup to HADOOP-13327, which changed S3A output stream hsync/hflush calls
to raise an exception.

Adds a new option fs.s3a.downgrade.syncable.exceptions

When true, calls to Syncable hsync/hflush on S3A output streams will
log once at warn (for entire process life, not just the stream), then
increment IOStats with the relevant operation counter

With the downgrade option false (default)
* IOStats are incremented
* The UnsupportedOperationException current raised includes a link to the
  JIRA.

Contributed by Steve Loughran.
…. Contributed by Siddharth Ahuja

This is required to highlight that an implementation at framework level is needed for the stop/start functionality to work.
… killed because exceeding container log size limit. Contributed by Qi Zhu.
nodemanager port, broken by YARN-10647. Contributed by D M Murali Krishna Reddy
…#2377)"

This reverts commit 394b9f7.

Ref: HDFS-15995.
Had to revert this commit, so we can commit HDFS-15566 (a critical bug preventing rolling upgrade to Hadoop 3.3)
Will re-work this fix again later.
… 3.3.0. Contributed by Brahma Reddy Battula.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
Reviewed-by: Akira Ajisaka <aajisaka@apache.org>
Reviewed-by: Hui Fei <ferhui@apache.org>
Signed-off-by: Takanobu Asanuma <tasanuma@apache.org>
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>

Change-Id: I7de255cb9a167e3a5e25ae339b050e82cb4b7c30
…n is enabled while having snapshottable directories (#2881)
…very to take too much time. Contributed by Qi Zhu.
Reviewed-by: Wei-Chiu Chuang <weichiu@apache.org>
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>

Change-Id: Ib2a4bf775a5804641a91c6f9a486772c9d87c17e
Reviewed-by: Tsz-Wo Nicholas Sze <szetszwo@apache.org>
…#2955)

1. puts NVDIMM to the end of storage type enum to make sure compatibility.
2. adds check to make sure the software layout version is satisfied

Co-authored-by: su xu <kevinbrandon@163.com>
Co-authored-by: huangtianhua <huangtianhua223@gmail.com>
Co-authored-by: YaYun-Wang <34060507+YaYun-Wang@users.noreply.github.com>

Signed-off-by: Mingliang Liu <liuml07@apache.org>
Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
Signed-off-by: Vinayakumar B <vinayakumarb@apache.org>

Change-Id: I3c58beef50730827a09b3c968e9ad637baa57d44
). Contributed by Fengnan Li.

Reviewed-by: He Xiaoqiao <hexiaoqiao@apache.org>
ericbadger and others added 18 commits April 29, 2021 17:42
…te Node GPU Utilization to use. Contributed by Qi Zhu
Reviewed-by: Steve Loughran <stevel@apache.org>
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
Reviewed-by: Inigo Goiri <inigoiri@apache.org>
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
… fall back to flush, if hflush is not supported (#2949)


Co-authored-by: Kishen Das <kishen@cloudera.com>
Reviewed-by: Steve Loughran <stevel@apache.org>
Contributed by Tor Arvid Lund.

Change-Id: Iadfe9b2f355cf373031075bfbe681705a2c65bdc
…erval between batch configurable. Contributed by Qi Zhu. (#2833)

Signed-off-by: Ayush Saxena <ayushsaxena@apache.org>
…uava 15+ (#2973)

Reviewed-by: Wei-Chiu Chuang <weichiu@apache.org>
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
)

Reviewed-by: Viraj Jasani <vjasani@apache.org>
Reviewed-by: Bilwa S T <stbilwa@gmail.com>
Signed-off-by: Takanobu Asanuma <tasanuma@apache.org>
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
…e value of FSEditLogOpCodes. (#2980)

Reviewed-by: Xiaoqiao He <hexiaoqiao@apache.org>
…rs (#2819). Contributed by zhuobin zheng.

Reviewed-by: Jinglun <jinglun@apache.org>
Reviewed-by: Inigo Goiri <inigoiri@apache.org>
@whbing whbing merged commit 97aab8c into whbing:trunk May 10, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.