
Writing requirements to /glue/lib/installation/pyarrow-0.12.1-p圓.6-linux-x86_64.egg/EGG-INFO/requires.txt Installing pyarrow-0.12.1-cp27-cp27mu-manylinux1_x86_64.whl to /glue/lib/installation Here's an example of a successful output: Searching for pyarrow To confirm, check the Amazon CloudWatch Logs group for Python shell jobs ( /aws-glue/python-jobs/output). The module is now installed in your Python shell job. Note: If you receive errors when running AWS Command Line Interface (AWS CLI) commands, make sure that you’re using the most recent AWS CLI version.Ħ.

MOA_EDM_cdc_controller_g2-0.2.9-p圓-none-any.whl to s3://doc-example-bucket/glue-libs/python-shell-jobs/MOA_EDM_cdc_controller_g2-0.2.9-p圓-none-any.whl Example: dist aws s3 cp MOA_EDM_cdc_controller_g2-0.2.9-p圓-none-any.whl s3://doc-example-bucket/glue-libs/python-shell-jobs/ For more information, see Providing your own Python library. whl file from the dist folder to an Amazon Simple Storage Service (Amazon S3) bucket.

Installing plasma_store script to /usr/local/binĬreate a. Using /usr/local/lib/python3.6/site-packagesĪdding pyarrow 0.12.1 to easy-install.pth file Using /Users/test/Library/Python/3.6/lib/python/site-packagesĪdding pandas 0.24.2 to easy-install.pth file Redshift-module 0.1 is already the active version in easy-install.pth Writing manifest file 'redshift_module.egg-info/SOURCES.txt'Ĭreating /usr/local/lib/python3.6/site-packages/redshift-module.egg-link (link to. Reading manifest file 'redshift_module.egg-info/SOURCES.txt' Writing dependency_links to redshift_module.egg-info/dependency_links.txt

Writing top-level names to redshift_module.egg-info/top_level.txt Writing redshift_module.egg-info/PKG-INFO Writing requirements to redshift_module.egg-info/requires.txt Then, install the packages: $ python setup.py develop Create a folder named reshift_module under the current directory: $ mkdir redshift_module Create the setup.py file and add the install_requires parameter to list the modules that you want to import: from setuptools import setup For more information, see AWS Glue version support policy.

Note: Starting June 1, 2022, Python shell jobs support only Python 3. egg file with Python 3, use Python 3 for the AWS Glue Python shell job. To maintain compatibility, be sure that your local build environment uses the same Python version as the Python shell job.
