Self-host and maintained bedrock-access-gateway, which is under MIT No Attribution License
Why this project:
- No AWS infrastructure needed
- Improved performance: aws-samples/bedrock-access-gateway#22
- Bug fix and new features: aws-samples/bedrock-access-gateway#92, aws-samples/bedrock-access-gateway#88
- Easy to deploy
- Quick response to community requests
pip install bedway
then bedway serve
Or use docker image
docker pull wh1isper/bedway
docker run --name bedway \
-p 9128:9128 \
-e "AWS_ACCESS_KEY_ID=<access_key_id>" \
-e "AWS_SECRET_ACCESS_KEY=<secret_access_key>" \
-e "AWS_REGION=<aws_region>" \
-e "DEFAULT_MODEL_NAME=<default_model_name>" \
-e "API_KEY=<api_key_for_this_service>" \
wh1isper/bedway
See more settings in setting.py
Install pre-commit before commit
pip install pre-commit
pre-commit install
Install package locally
pip install -e .[test]
TODO: Write some test..
pytest -v