Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[DocDB] ASAN test failures due to insufficient disk space #23035

Closed
1 task done
SrivastavaAnubhav opened this issue Jun 27, 2024 · 1 comment
Closed
1 task done

[DocDB] ASAN test failures due to insufficient disk space #23035

SrivastavaAnubhav opened this issue Jun 27, 2024 · 1 comment
Assignees
@hari90
Labels
area/docdb YugabyteDB core features kind/bug This issue is a bug priority/medium Medium priority issue

Comments

@SrivastavaAnubhav
Copy link
Contributor

SrivastavaAnubhav commented Jun 27, 2024 •
edited by hari90
Loading

Jira Link: DB-11967

Description

Many tests are failing in ASAN because of insufficient disk space. This is likely caused by the recent commit to reject writes if disks have insufficient space: f32d9ec

Bad status: Network error (yb/yql/pgwrapper/libpq_utils.cc:412): Execute of 'CREATE DATABASE test_namespace' failed: 7, message: ERROR:  Write to tablet 00000000000000000000000000000000 rejected. Node 04c9204ef2784cd6852304fabd15f6c7 has insufficient disk space (pgsql error XX000) (aux msg ERROR:  Write to tablet 00000000000000000000000000000000 rejected. Node 04c9204ef2784cd6852304fabd15f6c7 has insufficient disk space)

Issue Type

kind/bug

Warning: Please confirm that this issue does not contain any sensitive information

  • I confirm this issue does not contain any sensitive information.
@SrivastavaAnubhav SrivastavaAnubhav added area/docdb YugabyteDB core features priority/medium Medium priority issue labels Jun 27, 2024
@yugabyte-ci yugabyte-ci added the kind/bug This issue is a bug label Jun 27, 2024
@hari90
Copy link
Contributor

hari90 commented Jun 27, 2024

m-1] E0627 03:15:33.434794 145211 log.cc:2164] Not enough disk space available on ${TEST_TMPDIR}/pg_index_backfill-test.PgIndexBackfillTest.Tablegroup.1719458115031959-144873/minicluster-data/master-0/yb-data/master/wals/table-sys.catalog.uuid/tablet-{sys_catalog_tablet_id}/wal-000000001. Free space: 1910415360 bytes

@hari90 hari90 changed the title [DocDB] ASAN and TSAN test failures due to insufficient disk space [DocDB] ASAN test failures due to insufficient disk space Jul 2, 2024
@hari90 hari90 closed this as completed in ab09fc1 Jul 3, 2024
jasonyb pushed a commit that referenced this issue Jul 3, 2024
@yugabyte-ci @jaki
[BACKPORT pg15-cherrypicks] all: Bulk port from master - 47
691b287 
Summary:
 Excluded: eb77547 [#21886] DocDB: Add read-time option of ysql_dump to --help output
 5b193c8 [#22807] docdb: Add gflag to control of RWCLock debug logging
 Excluded: 471c7c4 [#22967] YSQL: Import 'Repair more failures with SubPlans in multi-row VALUES lists.'
 Excluded: 8142fdc [#23013] XClusterDDLRepl: Link producer table to consumer table by table id
 7dc7da5 [DOC-403] Added PG CVE table (#22913)
 cf17238 [PLAT-14557][xCluster] DrConfigGetResp.class must be passed as the DR GET API response to swagger
 81a5b3c [PLAT-14535][PLAT-14149] Azure provider validation fixes
 15f302d [#22619] DocDB: Fix test issue with PgGetLockStatusTestRF3.TestLocksOfSingleShardWaiters
 b7c3da8 [DEVOPS-3144] build: Remove release_package_docker_test sanity test from jenkins build
 3106dc0 [PLAT-14165] Fixed unit tests and ran swagger Gen
 ab09fc1 [#23035] DocDB: Disable disk full checks on ASAN
 Excluded: f86020d [#23044] xCluster: Move xCluster members from CatalogManager to XClusterManager
 8d929e9 [PLAT-14173] UserIntentOverrides into v2 UniverseSpec
 19c6049 [PLAT-14536] Missing XmlElement dependency
 e2e9f93 [PLAT-14473][PLAT-14554]Add gflags from groups at runtime
 Excluded: b8fedf6 [#21198] YSQL: Pushdown Aggregates on YB Bitmap Table Scans

Test Plan: Jenkins: rebase: pg15-cherrypicks

Reviewers: jason, tfoucher

Tags: #jenkins-ready

Differential Revision: https://phorge.dev.yugabyte.com/D36374
hari90 added a commit that referenced this issue Aug 29, 2024
@hari90
[BACKPORT 2024.1][#23035] DocDB: Disable disk full checks on ASAN
14fdb9d 
Summary:
Original commit: ab09fc1 / D36347
ASAN tests run on machines with limited disk space, and the disk full checks in DocDB can cause them to fail. This diff disables the disk full checks on ASAN.

Fixes #23035
Jira: DB-11967

Test Plan: Jenkins

Reviewers: asrivastava, yyan

Reviewed By: yyan

Subscribers: ybase

Differential Revision: https://phorge.dev.yugabyte.com/D37650
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@hari90 hari90

Labels
area/docdb YugabyteDB core features kind/bug This issue is a bug priority/medium Medium priority issue
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@hari90 @yugabyte-ci @SrivastavaAnubhav