Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

lakeFS incompatibility issues with Spark (2.4.7) DeleteObjects request #1706

Closed
itaiad200 opened this issue Apr 2, 2021 · 1 comment · Fixed by #1708
Closed

lakeFS incompatibility issues with Spark (2.4.7) DeleteObjects request #1706

itaiad200 opened this issue Apr 2, 2021 · 1 comment · Fixed by #1708
Assignees
Labels
area/gateway Changes to the gateway bug Something isn't working

Comments

@itaiad200
Copy link
Contributor

time="2021-04-02T12:54:22Z" level=debug msg="object set for deletion" func="pkg/gateway/operations.(*DeleteObjects).Handle" file="pkg/gateway/operations/deleteobjects.go:75" h
ost="medium.s3.itai-local-test.lakefs.dev:8000" key=main/dummy-data-32/ method=POST path="/?delete" repository=medium request_id=fcc3cd03-c0b6-487b-83f6-78b136b65b44 service_n
ame=s3_gateway user=Itai

time="2021-04-02T12:54:22Z" level=error msg="failed deleting object" func="pkg/gateway/operations.(*DeleteObjects).Handle" file="pkg/gateway/operations/deleteobjects.go:67" error="argument path: required value" host="medium.s3.itai-local-test.lakefs.dev:8000" key=main/ method=POST path="/?delete" repository=medium request_id=fcc3cd03-c0b6-487b-83f6-78b136b65b44 service_name=s3_gateway user=Itai

@itaiad200 itaiad200 added bug Something isn't working area/gateway Changes to the gateway labels Apr 2, 2021
@itaiad200 itaiad200 self-assigned this Apr 2, 2021
@itaiad200
Copy link
Contributor Author

Example request body that failed

<Delete>
	<Object>
		<Key>main/dummy-data-36/</Key>
	</Object>
	<Object>
		<Key>main/</Key>
	</Object>
</Delete>

It's obvious that deleting a branch isn't an option, not really clear on why Spark even wants the root prefix to be deleted.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/gateway Changes to the gateway bug Something isn't working
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant