Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

docs: Add steps to install "using pip" to the "AWS Glue Python Shell Jobs" part of the install docs #2911

Merged
merged 2 commits into from
Jul 25, 2024
Merged

docs: Add steps to install "using pip" to the "AWS Glue Python Shell Jobs" part of the install docs #2911

Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
beb2047
add using pip as install method to docs
mc51 Jul 25, 2024
0c910db
shorten line length
mc51 Jul 25, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
18 changes: 17 additions & 1 deletion docs/source/install.rst
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -183,13 +183,29 @@ AWS Glue Python Shell Jobs

.. note:: Glue Python Shell Python3.9 has version 2.15.1 of awswrangler `baked in <https://aws.amazon.com/blogs/big-data/aws-glue-python-shell-now-supports-python-3-9-with-a-flexible-pre-loaded-environment-and-support-to-install-additional-libraries/>`_. If you need a different version, follow instructions below:

Using pip
^^^^^^^^^

1 - In the AWS console, open your Glue Python Shell job's *Job details* tab.

2 - Scroll down and expand the *Advanced properties*.

3 - In the *Job parameters* section, add `--additional-python-modules` as *Key* and `awswrangler` as *Value*.

You can also specify optional dependencies or set a version in the *Value* field, e.g. `awswrangler[redshift]==3.9.0`.
For details, see reference below.


Using a Whl file
^^^^^^^^^^^^^^^^^

1 - Go to `GitHub's release page <https://github.com/aws/aws-sdk-pandas/releases>`_ and download the wheel file
(.whl) related to the desired version. Alternatively, you can download the wheel from the `public artifacts bucket <https://aws-sdk-pandas.readthedocs.io/en/latest/install.html#public-artifacts>`_.

2 - Upload the wheel file to the Amazon S3 location of your choice.

3 - Go to your Glue Python Shell job and point to the S3 wheel file in
the *Python library path* field.
the *Python library path* field of the *Job details* tab.

`Official Glue Python Shell Reference <https://docs.aws.amazon.com/glue/latest/dg/add-job-python.html#create-python-extra-library>`_

Expand Down
Loading