Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Ingest sst file does not overwrite the old data #2722

Closed
Nicole00 opened this issue Aug 27, 2021 · 6 comments
Closed

Ingest sst file does not overwrite the old data #2722

Nicole00 opened this issue Aug 27, 2021 · 6 comments
Assignees
Labels
priority/hi-pri Priority: high type/bug Type: something is unexpected
Milestone

Comments

@Nicole00
Copy link
Contributor

After the SST file was imported through INGEST, it doesn't overwrite the data that was previously inserted.

operations:

  1. Insert a point data: insert vertex user(name) values ​​1:("tom")
  2. Generate sst based on csv file, csv has only two records of data: (the first col is vid, the second col is name)
1, jina
2, tina
  1. After INGEST is imported, the show stats shows two records, and the vertex with id 2 can be found through the fetch statement. The name of the vertex with id 1 is still tom, which has not been overwritten with jina.

extra info:
version: 2.5.0 rpm
image

image

@CPWstatic CPWstatic transferred this issue from vesoft-inc/nebula-storage Aug 28, 2021
@CPWstatic CPWstatic added the type/bug Type: something is unexpected label Aug 28, 2021
@CPWstatic CPWstatic added this to the v2.6.0 milestone Aug 30, 2021
@CPWstatic CPWstatic added the priority/hi-pri Priority: high label Aug 30, 2021
@darionyaphet
Copy link
Contributor

I have try to replay this case, but it didn't happen.

First, insert some vertex into the database and then ingest an SST file. I can read the new value created by ingest file.

@darionyaphet
Copy link
Contributor

(root@nebula) [test]> CREATE TAG t(name string)
Execution succeeded (time spent 2765/3299 us)

Sun, 19 Sep 2021 05:39:59 CST

(root@nebula) [test]> INGEST
Execution succeeded (time spent 297210/297759 us)

Sun, 19 Sep 2021 05:40:50 CST

(root@nebula) [test]> FETCH PROP ON t 1
+------------------------+
| vertices_              |
+------------------------+
| (1 :t{name: "darion"}) |
+------------------------+
Got 1 rows (time spent 4338/5118 us)

Sun, 19 Sep 2021 05:40:54 CST

(root@nebula) [test]> FETCH PROP ON t 2
+------------------------+
| vertices_              |
+------------------------+
| (2 :t{name: "yaphet"}) |
+------------------------+
Got 1 rows (time spent 3404/4088 us)

Sun, 19 Sep 2021 05:40:56 CST

(root@nebula) [test]> INGEST
Execution succeeded (time spent 289964/290602 us)

Sun, 19 Sep 2021 05:41:33 CST

(root@nebula) [test]> FETCH PROP ON t 1
+-------------------------------+
| vertices_                     |
+-------------------------------+
| (1 :t{name: "darion.yaphet"}) |
+-------------------------------+
Got 1 rows (time spent 4251/5015 us)

Sun, 19 Sep 2021 05:41:36 CST

(root@nebula) [test]> INSERT VERTEX t(name) VALUES 1:("d")
Execution succeeded (time spent 7870/8561 us)

Sun, 19 Sep 2021 05:43:51 CST

(root@nebula) [test]> FETCH PROP ON t 1
+-------------------+
| vertices_         |
+-------------------+
| (1 :t{name: "d"}) |
+-------------------+
Got 1 rows (time spent 3697/4386 us)

Sun, 19 Sep 2021 05:43:53 CST

(root@nebula) [test]> INGEST
Execution succeeded (time spent 291909/292424 us)

Sun, 19 Sep 2021 05:43:56 CST

(root@nebula) [test]> FETCH PROP ON t 1
+-------------------------------+
| vertices_                     |
+-------------------------------+
| (1 :t{name: "darion.yaphet"}) |
+-------------------------------+
Got 1 rows (time spent 4246/5040 us)

Sun, 19 Sep 2021 05:43:59 CST

@darionyaphet
Copy link
Contributor

you should set enable_vertex_cache is false to make sure ingest SST file into system

@wey-gu
Copy link
Contributor

wey-gu commented Sep 23, 2021

you should set enable_vertex_cache is false to make sure ingest SST file into the system

I think this should be documented/highlighted in SST chapters

cc @randomJoe211 @cooper-lzy

@cooper-lzy
Copy link
Contributor

you should set enable_vertex_cache is false to make sure ingest SST file into the system

I think this should be documented/highlighted in SST chapters

cc @randomJoe211 @cooper-lzy

It is only updated in 2.5.0 and 2.5.1 branch, because the parameter enable_vertex_cache has not been available since 2.6.

image

@wey-gu
Copy link
Contributor

wey-gu commented Sep 23, 2021

you should set enable_vertex_cache is false to make sure ingest SST file into the system

I think this should be documented/highlighted in SST chapters
cc @randomJoe211 @cooper-lzy

It is only updated in 2.5.0 and 2.5.1 branch, because the parameter enable_vertex_cache has not been available since 2.6.

image

Sorry, I didn't realize it's already there, thanks!!!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
priority/hi-pri Priority: high type/bug Type: something is unexpected
Projects
None yet
Development

No branches or pull requests

5 participants