feat(ingestion/airflow): Added support of datajob entity as input lineage

[shubhamjagtap639]

Checklist

• The PR conforms to DataHub's Contributing Guideline (particularly Commit Message Format)
• Links to related issues (if applicable)
• Tests for the changes have been added/updated (if applicable)
• Docs related to the changes have been added/updated (if applicable). If a new feature has been added a Usage Guide has been added for the same.
• For any breaking change/potential downtime/deprecation/big changes an entry has been made in Updating DataHub

[hsheth2]

one suggestion, mostly looking good

[hsheth2]

why'd this change?

[hsheth2]

how about a entities_to_urn_list(list, allowed_entities={"dataset, "datajob"})

[shubhamjagtap639]

If we use common method to extend both iolets and upstrem_jobs, we get lint error as:
src/datahub_airflow_plugin/datahub_listener.py:279: error: Argument 1 to "extend" of "list" has incompatible type "list[DatasetUrn | DataJobUrn]"; expected "Iterable[DatasetUrn]" [arg-type]
with below method definition:
def entities_to_urn_list( iolets: List[str], allowed_entities: Set[str] ) -> List[Union[DatasetUrn, DataJobUrn]]: urn_list: List[Union[DatasetUrn, DataJobUrn]] = [] for let in iolets: entity = guess_entity_type(let) if entity in allowed_entities: if entity == "dataset": urn_list.append(DatasetUrn.create_from_string(let)) elif entity == "dataJob": urn_list.append(DataJobUrn.create_from_string(let)) return urn_list

[hsheth2]

@shubhamjagtap639 can you move this PR to open-source?