Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Create API endpoints in the server to export and import Airbyte Configuration files for upgrades #1526

Closed
ChristopheDuong opened this issue Jan 5, 2021 · 2 comments · Fixed by #1587
Labels
type/enhancement New feature or request

Comments

@ChristopheDuong
Copy link
Contributor

Tell us about the problem you're trying to solve

As part of #1402, we need to expose API endpoints to trigger export and import methods from the UI.

Describe the solution you’d like

  • An API endpoint in the airbyte Server to trigger exports
  • An API endpoint in the airbyte Server to trigger imports

The export/import archive files produced by airbyte-migration may contain multiple files but they should be compressed into a single archive file including the VERSION tag in a file.

This tarball would then be downloadable/uploadable through the UI so that migration scripts can be applied on top of it externally with a CLI tool.

@ChristopheDuong ChristopheDuong added the type/enhancement New feature or request label Jan 5, 2021
@ChristopheDuong
Copy link
Contributor Author

The tarball produced by this endpoint should look like this:

├── VERSION
├── AirbyteConfig
│   └── DESTINATION_CONNECTION.yml
│   └── STANDARD_DESTINATION_DEFINITION.yml
│   └── STANDARD_SYNC.yml
│   └── STANDARD_WORKSPACE.yml
│   └── SOURCE_CONNECTION.yml
│   └── STANDARD_SOURCE_DEFINITION.yml
│   └── STANDARD_SYNC_SCHEDULE.yml
└── Jobs
    └── jobs.yml

@cgardens
Copy link
Contributor

cgardens commented Jan 6, 2021

@ChristopheDuong this structure looks good. I think we are missing from the jobs category attempts.yml and airbyte_metadata.yaml. These are just the other tables in that database.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
type/enhancement New feature or request
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants