Able to pass arguments to --conf not specified in parameters argument

[aamster]

Apache Airflow version

2.5.0

What happened

Given the following

import datetime

from airflow.models.dag import dag


@dag(
    dag_id="foo",
    schedule=None,
    start_date=datetime.datetime.now()
)
def foo():
    pass


foo()


if __name__ == '__main__':
    foo().test(run_conf={'foo': 1})

It runs fine.

The same is true if params is {'bar': Param(default=None)}

What you think should happen instead

This should result in an exception since foo is not a parameter of the dag. Either the parameters idea needs to be fully implemented or not at all. Currently it is only partially implemented.

How to reproduce

No response

Operating System

mac osx

Versions of Apache Airflow Providers

No response

Deployment

Official Apache Airflow Helm Chart

Deployment details

No response

Anything else

No response

Are you willing to submit PR?

• Yes I am willing to submit a PR!

Code of Conduct

• I agree to follow this project's Code of Conduct

[hussein-awala]

The problem is that there is currently no way to provide params directly, instead we provide the parameters as dag_run.conf which is a free dictionary without any validation. Airflow overrides the params values by using this dictionary when core.dag_run_conf_overrides_params is not disabled.

I was working on a PR to add params argument for the different Airflow APIs (UI, CLI, Python API, and REST API) to provide the values directly with a validation, and I would be happy to finish it.
@potiuk what do you think?

[potiuk]

yes.

[github-actions]

This issue has been automatically marked as stale because it has been open for 365 days without any activity. There has been several Airflow releases since last activity on this issue. Kindly asking to recheck the report against latest Airflow version and let us know if the issue is reproducible. The issue will be closed in next 30 days if no further activity occurs from the issue author.

[github-actions]

This issue has been closed because it has not received response from the issue author.