kedro-airflow: Allow passing conf_source to the created DAG

[ankatiyar]

Description

Add --conf-source flag to kedro airflow create which will pass this on to the Jinja template used to generate the DAGs airflow_dag_template.j2

Context

To run a Kedro project as a DAG on airflow currently -

• You should package and install your kedro project in the executor env
• Copy the config from the Kedro project to the Airflow project folder https://docs.kedro.org/en/stable/deployment/airflow.html#create-prepare-and-package-example-kedro-project
• If something changes in the conf, one must also remember to copy over the changes

Additionally,

• KedroSession.create() now allows passing conf_source path
• kedro package creates a .whl file for the project pipelines etc and a .tar.gz file for the conf/ folder of the project which can be saved elsewhere

Possible Implementation

• Add --conf-source to the CLI command which passes this info the Jinja template airflow_dag_template.j2

Possible Alternatives

(Optional) Describe any alternative solutions or features you've considered.

[astrojuanlu]

xref kedro-org/kedro#770 (comment)

[astrojuanlu]

@DimedS: "This change would be quite useful to deploy Kedro to some cloud Airflow because it's sometimes impossible to put configuration in the working directory" (paraphrasing)