Skip to content
This repository has been archived by the owner on Jul 29, 2024. It is now read-only.

updated the base docker to delta 3.0 and spark 3.5. #60

Merged
merged 8 commits into from
Oct 24, 2023

Conversation

newfront
Copy link
Contributor

@newfront newfront commented Oct 22, 2023

Updated all docs, examples, and bumped Cargo.toml for delta-rs.

docker build -t delta-docker:3.0.0 -f Dockerfile_delta_quickstart .
docker volume create rustbuild
docker run --name delta_quickstart --rm -it --entrypoint bash delta-docker3.0.0
docker run --name delta_quickstart -v rustbuild:/tmp --rm -it --entrypoint bash delta-docker:3.0.0

cc: @dennyglee @P7h

Open Questions

I'm not sure how versioning is working here. Should we bump to 1.0.0 or follow the delta version 3.0.0?

Note: copied the Dockerfile_quickstart_delta to Dockerfile

docker buildx create --name deltabuilder
docker buildx use deltabuilder
docker buildx inspect --bootstrap
docker buildx build --platform linux/amd64,linux/arm64 -t newfrontdocker/delta-docker:3.0.0 --push .

I popped the test build into my dockerhub (https://hub.docker.com/repository/docker/newfrontdocker/delta-docker/general) - supporting for both linux/[amd|arm]64.

https://hub.docker.com/layers/newfrontdocker/delta-docker/3.0.0/images/sha256-d8e4899c1185598a11e54dece581178c72f1e342737f58d1e40b3518a36041b9?tab=layers

… examples, and bumped Cargo.toml for delta-rs
@netlify
Copy link

netlify bot commented Oct 22, 2023

Deploy Preview for delta-docs ready!

Name Link
🔨 Latest commit fd1db1d
🔍 Latest deploy log https://app.netlify.com/sites/delta-docs/deploys/6537eb10a99d5400088abd3d
😎 Deploy Preview https://deploy-preview-60--delta-docs.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify site configuration.

@dennyglee
Copy link
Contributor

Hi @newfront - could you do a lint check on your side to validate this is working?

@newfront
Copy link
Contributor Author

Yep. I'll resolve the lint issue in the morning and make sure this passes the checks

@dennyglee
Copy link
Contributor

thanks @newfront !

@dennyglee dennyglee merged commit c79bbc1 into delta-io:main Oct 24, 2023
5 checks passed
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants