Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
163 commits
Select commit Hold shift + click to select a range
f816cd3
tests passed
ahmadtfarhan Mar 4, 2025
47bbbe2
narrow down CI
ahmadtfarhan Mar 4, 2025
3b4869c
Merge branch 'main' of https://github.com/ahmadfarhan97/airflow into …
ahmadtfarhan Mar 4, 2025
9e9a7e8
fix host
ahmadtfarhan Mar 4, 2025
0141a86
add drill for testing
ahmadtfarhan Mar 4, 2025
1da83ae
add docker inspect
ahmadtfarhan Mar 4, 2025
8b1a084
create a funtion
ahmadtfarhan Mar 4, 2025
a446cb7
minor changes
ahmadtfarhan Mar 4, 2025
b4061e6
change the inspect
ahmadtfarhan Mar 4, 2025
c538bee
add status condition
ahmadtfarhan Mar 4, 2025
eebef12
change host to zeros
ahmadtfarhan Mar 4, 2025
1b5d918
rewrite the pipeline
ahmadtfarhan Mar 4, 2025
f0cc71c
push image and reuse
ahmadtfarhan Mar 5, 2025
535a634
remove tag
ahmadtfarhan Mar 5, 2025
470d67f
rename tag
ahmadtfarhan Mar 5, 2025
749e0d7
change to locally pushed image
ahmadtfarhan Mar 5, 2025
de3fc67
add sha to image name
ahmadtfarhan Mar 5, 2025
ac83dcb
add sha to image name
ahmadtfarhan Mar 5, 2025
faefd60
add debug and login
ahmadtfarhan Mar 5, 2025
3cdf6e5
change token name
ahmadtfarhan Mar 5, 2025
1fccc34
change token name
ahmadtfarhan Mar 5, 2025
cc6327b
remove login
ahmadtfarhan Mar 5, 2025
f06e13e
remove login
ahmadtfarhan Mar 5, 2025
c6297f3
remove login
ahmadtfarhan Mar 5, 2025
1493d10
move token to hight level
ahmadtfarhan Mar 5, 2025
7033f44
copy from ci
ahmadtfarhan Mar 5, 2025
3631a10
change to secrets
ahmadtfarhan Mar 5, 2025
078abef
test workflow
ahmadtfarhan Mar 5, 2025
f9f0008
test workflow
ahmadtfarhan Mar 5, 2025
7d12aa2
rerun on CI login
ahmadtfarhan Mar 5, 2025
4a8a664
rerun on CI login
ahmadtfarhan Mar 5, 2025
6646fcf
logout
ahmadtfarhan Mar 5, 2025
a8a4e99
revert logout
ahmadtfarhan Mar 5, 2025
d4cc6aa
revert login
ahmadtfarhan Mar 5, 2025
976c309
remove cleanup
ahmadtfarhan Mar 5, 2025
ee09099
readd cleanup
ahmadtfarhan Mar 5, 2025
099475a
change docker pass
ahmadtfarhan Mar 5, 2025
68a69a2
add login to action
ahmadtfarhan Mar 5, 2025
4be2867
move up
ahmadtfarhan Mar 5, 2025
02237b5
chage token
ahmadtfarhan Mar 5, 2025
ff51343
one job
ahmadtfarhan Mar 5, 2025
1488ec6
one job
ahmadtfarhan Mar 5, 2025
f74e792
remove action
ahmadtfarhan Mar 5, 2025
fea442d
delete if condition
ahmadtfarhan Mar 5, 2025
7fbe9ef
rename image
ahmadtfarhan Mar 5, 2025
f9e4317
fix tar name
ahmadtfarhan Mar 5, 2025
ccd8e4e
fix tar name
ahmadtfarhan Mar 5, 2025
84bd1ae
fix tar name
ahmadtfarhan Mar 5, 2025
60007b1
remove status
ahmadtfarhan Mar 5, 2025
21780aa
remove stdin
ahmadtfarhan Mar 5, 2025
6ad9ef1
add logs and hostname
ahmadtfarhan Mar 5, 2025
92d119d
removed restart
ahmadtfarhan Mar 5, 2025
a472453
add chmod
ahmadtfarhan Mar 5, 2025
264a171
create entry sh
ahmadtfarhan Mar 5, 2025
b2d66cb
create entry sh
ahmadtfarhan Mar 5, 2025
c0bb1b3
add status
ahmadtfarhan Mar 5, 2025
b80d053
remove failure
ahmadtfarhan Mar 5, 2025
0d7883f
add user
ahmadtfarhan Mar 5, 2025
47708cd
revert back all ci yamls
ahmadtfarhan Mar 5, 2025
350555e
revert back shell script
ahmadtfarhan Mar 5, 2025
c9e458b
fix tinkerpop
ahmadtfarhan Mar 5, 2025
057ec62
change back to gremlin in the providers list
ahmadtfarhan Mar 5, 2025
426e356
change docs
ahmadtfarhan Mar 5, 2025
7f9264b
change docs
ahmadtfarhan Mar 5, 2025
b8e65ad
Merge branch 'main' of https://github.com/ahmadfarhan97/airflow into …
ahmadtfarhan Mar 5, 2025
95e9a2a
add conn_name_attr
ahmadtfarhan Mar 5, 2025
2c3549b
Merge branch 'main' of https://github.com/ahmadfarhan97/airflow into …
ahmadtfarhan Mar 6, 2025
1bc9330
move system test
ahmadtfarhan Mar 6, 2025
e3eefc3
change to cap
ahmadtfarhan Mar 6, 2025
916750e
change to 1.0.0
ahmadtfarhan Mar 6, 2025
665ce48
fix sh
ahmadtfarhan Mar 6, 2025
f4929c1
Merge branch 'main' into create-apache-tinkerpop-provider
ahmadtfarhan Mar 6, 2025
e0c7c36
Merge branch 'main' of https://github.com/ahmadfarhan97/airflow into …
ahmadtfarhan Mar 7, 2025
c760a78
Merge branch 'main' of https://github.com/ahmadfarhan97/airflow into …
ahmadtfarhan Mar 7, 2025
89b770c
removed serializer and some changes
ahmadtfarhan Mar 7, 2025
2bb3519
fixing docs
ahmadtfarhan Mar 7, 2025
348d51d
Merge branch 'main' of https://github.com/ahmadfarhan97/airflow into …
ahmadtfarhan Mar 8, 2025
07f2e63
update provider
ahmadtfarhan Mar 8, 2025
605db4b
Merge branch 'main' of https://github.com/ahmadfarhan97/airflow into …
ahmadtfarhan Mar 10, 2025
9c438a2
change to 2.9.0 and add spell check
ahmadtfarhan Mar 10, 2025
84c99ad
Merge branch 'main' of https://github.com/ahmadfarhan97/airflow into …
ahmadtfarhan Mar 11, 2025
a761047
ran breeze release management
ahmadtfarhan Mar 11, 2025
e62e94e
add doc strings
ahmadtfarhan Mar 11, 2025
4a635db
Merge branch 'main' of https://github.com/ahmadfarhan97/airflow into …
ahmadtfarhan Mar 11, 2025
5869e31
add asterisk
ahmadtfarhan Mar 11, 2025
dd028a4
moved operators doc
ahmadtfarhan Mar 12, 2025
f641129
Merge branch 'main' of https://github.com/ahmadfarhan97/airflow into …
ahmadtfarhan Mar 12, 2025
9125e71
Merge branch 'main' into create-apache-tinkerpop-provider
ahmadtfarhan Mar 12, 2025
9e37c2d
Merge branch 'main' of https://github.com/ahmadfarhan97/airflow into …
ahmadtfarhan Mar 12, 2025
d8e44f8
Merge branch 'create-apache-tinkerpop-provider' of https://github.com…
ahmadtfarhan Mar 12, 2025
3903a4f
Merge branch 'main' of https://github.com/ahmadfarhan97/airflow into …
ahmadtfarhan Mar 13, 2025
868dc90
Merge branch 'main' of https://github.com/ahmadfarhan97/airflow into …
ahmadtfarhan Mar 13, 2025
ddbf49e
Merge branch 'main' into create-apache-tinkerpop-provider
ahmadtfarhan Mar 14, 2025
afadf54
Merge branch 'main' of https://github.com/ahmadfarhan97/airflow into …
ahmadtfarhan Mar 14, 2025
29b68fd
Merge branch 'create-apache-tinkerpop-provider' of https://github.com…
ahmadtfarhan Mar 14, 2025
1250faf
fixed docs
ahmadtfarhan Mar 14, 2025
c9fe40b
Merge branch 'main' of https://github.com/ahmadfarhan97/airflow into …
ahmadtfarhan Mar 14, 2025
095fc72
merge main and add tinkerpop commands
ahmadtfarhan Mar 15, 2025
810ef49
Merge branch 'main' of https://github.com/ahmadfarhan97/airflow into …
ahmadtfarhan Mar 17, 2025
a091122
fixed pyproject
ahmadtfarhan Mar 17, 2025
158c3ee
Merge branch 'main' into create-apache-tinkerpop-provider
ahmadtfarhan Mar 19, 2025
a4dfb01
merge main
ahmadtfarhan Mar 21, 2025
d0890d7
Merge remote-tracking branch 'apache/main' into create-apache-tinkerp…
ahmadtfarhan Mar 21, 2025
094a092
merged conflicts
ahmadtfarhan Mar 24, 2025
8ba5882
merge conflicts
ahmadtfarhan Mar 31, 2025
05c78c5
Merge branch 'main' of https://github.com/ahmadfarhan97/airflow into …
ahmadtfarhan Mar 31, 2025
4a7bfca
Merge Conflicts
ahmadtfarhan Apr 2, 2025
0d5897c
Merge branch 'main' of https://github.com/ahmadfarhan97/airflow into …
ahmadtfarhan Apr 3, 2025
a2de893
Merge Conflicts
ahmadtfarhan Apr 3, 2025
af00939
minor change to docs
ahmadtfarhan Apr 3, 2025
6b75ccb
Merge branch 'main' of https://github.com/ahmadfarhan97/airflow into …
ahmadtfarhan Apr 4, 2025
27b88fe
add conf.py
ahmadtfarhan Apr 4, 2025
efd0d68
fixed docs
ahmadtfarhan Apr 4, 2025
2c9627a
Merge branch 'main' of https://github.com/ahmadfarhan97/airflow into …
ahmadtfarhan Apr 5, 2025
a0f7ce4
fix toml
ahmadtfarhan Apr 5, 2025
b21dc1c
fixed conflicts
ahmadtfarhan Apr 6, 2025
cc81560
Merge branch 'main' of https://github.com/ahmadfarhan97/airflow into …
ahmadtfarhan Apr 7, 2025
da326ff
changed to 2.10
ahmadtfarhan Apr 7, 2025
e945613
Merge branch 'main' of https://github.com/ahmadfarhan97/airflow into …
ahmadtfarhan Apr 7, 2025
ede979d
Merge branch 'main' of https://github.com/ahmadfarhan97/airflow into …
ahmadtfarhan Apr 7, 2025
02bee40
Merge branch 'main' of https://github.com/ahmadfarhan97/airflow into …
ahmadtfarhan Apr 7, 2025
40e276b
Merge branch 'main' of https://github.com/ahmadfarhan97/airflow into …
ahmadtfarhan Apr 8, 2025
efe0a75
remove fab from tinkerpop
ahmadtfarhan Apr 8, 2025
2579874
merge conflicts
ahmadtfarhan Apr 8, 2025
d29ec75
merge conflicts
ahmadtfarhan Apr 9, 2025
8a5cc4a
fix prov info
ahmadtfarhan Apr 9, 2025
cc30649
add close method
ahmadtfarhan Apr 9, 2025
d318088
resolve conflicts
ahmadtfarhan Apr 9, 2025
106477b
fix integration
ahmadtfarhan Apr 9, 2025
db7498a
Merge branch 'main' of https://github.com/ahmadfarhan97/airflow into …
ahmadtfarhan Apr 9, 2025
1287039
change gremlin host
ahmadtfarhan Apr 9, 2025
e06fbc3
change gremlin host back
ahmadtfarhan Apr 9, 2025
8b78f43
Merge branch 'main' of https://github.com/ahmadfarhan97/airflow into …
ahmadtfarhan Apr 9, 2025
600e708
remove async
ahmadtfarhan Apr 9, 2025
93947d5
Merge branch 'main' of https://github.com/ahmadfarhan97/airflow into …
ahmadtfarhan Apr 9, 2025
c30fb21
remove package
ahmadtfarhan Apr 10, 2025
8aaa934
Merge branch 'main' of https://github.com/ahmadfarhan97/airflow into …
ahmadtfarhan Apr 10, 2025
dc45d87
Merge branch 'main' of https://github.com/ahmadfarhan97/airflow into …
ahmadtfarhan Apr 10, 2025
5532c2a
merge conflicts
ahmadtfarhan Apr 12, 2025
8f1673a
Merge branch 'main' of https://github.com/ahmadfarhan97/airflow into …
ahmadtfarhan Apr 12, 2025
60f0e94
Merge branch 'main' of https://github.com/ahmadfarhan97/airflow into …
ahmadtfarhan Apr 12, 2025
36a2fdc
fix pyproject
ahmadtfarhan Apr 13, 2025
545b38d
merge conflicts
ahmadtfarhan Apr 13, 2025
a6ede36
Merge branch 'main' of https://github.com/ahmadfarhan97/airflow into …
ahmadtfarhan Apr 14, 2025
d7e61a5
merge conflicts
ahmadtfarhan Apr 14, 2025
c5c02e1
merge conflicts
ahmadtfarhan Apr 14, 2025
5e7d8ab
Merge branch 'main' of https://github.com/ahmadfarhan97/airflow into …
ahmadtfarhan Apr 15, 2025
ccb33a0
Merge branch 'main' of https://github.com/ahmadfarhan97/airflow into …
ahmadtfarhan Apr 15, 2025
7842b05
Merge branch 'main' of https://github.com/ahmadfarhan97/airflow into …
ahmadtfarhan Apr 15, 2025
652c4d4
Merge branches 'create-apache-tinkerpop-provider' and 'main' of https…
ahmadtfarhan Apr 16, 2025
5c8dd7c
Merge branch 'main' of https://github.com/ahmadfarhan97/airflow into …
ahmadtfarhan Apr 16, 2025
4c2b9df
fix conflicts
ahmadtfarhan Apr 17, 2025
6e64173
Merge branch 'main' of https://github.com/ahmadfarhan97/airflow into …
ahmadtfarhan Apr 17, 2025
6e52ff7
Merge branch 'main' of https://github.com/ahmadfarhan97/airflow into …
ahmadtfarhan Apr 17, 2025
933ccdd
Merge branch 'main' of https://github.com/ahmadfarhan97/airflow into …
ahmadtfarhan Apr 22, 2025
7d2f724
Merge branch 'main' of https://github.com/ahmadfarhan97/airflow into …
ahmadtfarhan Apr 22, 2025
eda5413
Merge branch 'main' of https://github.com/ahmadfarhan97/airflow into …
ahmadtfarhan Apr 22, 2025
54701f7
Merge branch 'main' of https://github.com/ahmadfarhan97/airflow into …
ahmadtfarhan Apr 22, 2025
6910593
Merge branch 'main' of https://github.com/ahmadfarhan97/airflow into …
ahmadtfarhan Apr 23, 2025
543049e
fix test
ahmadtfarhan Apr 23, 2025
06c5978
Merge branch 'main' of https://github.com/ahmadfarhan97/airflow into …
ahmadtfarhan Apr 23, 2025
59d12dd
Merge branch 'main' into create-apache-tinkerpop-provider
potiuk Apr 23, 2025
e832ab3
Merge branch 'main' into create-apache-tinkerpop-provider
potiuk Apr 23, 2025
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions .github/ISSUE_TEMPLATE/airflow_providers_bug_report.yml
Original file line number Diff line number Diff line change
Expand Up @@ -41,6 +41,7 @@ body:
- apache-pig
- apache-pinot
- apache-spark
- apache-tinkerpop
- apprise
- arangodb
- asana
Expand Down
3 changes: 3 additions & 0 deletions .github/boring-cyborg.yml
Original file line number Diff line number Diff line change
Expand Up @@ -72,6 +72,9 @@ labelPRBasedOnFilePath:
provider:apache-spark:
- providers/apache/spark/**

provider:apache-tinkerpop:
- providers/apache/tinkerpop/**

provider:apprise:
- providers/apprise/**

Expand Down
4 changes: 4 additions & 0 deletions .pre-commit-config.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -246,6 +246,9 @@ repos:
name: Check that executables have shebang
- id: check-xml
name: Check XML files with xmllint
exclude: >
(?x)
^scripts/ci/docker-compose/gremlin/.
- id: trailing-whitespace
name: Remove trailing whitespace at end of line
exclude: ^airflow-core/docs/img/.*\.dot$|^dev/breeze/doc/images/output.*$
Expand Down Expand Up @@ -970,6 +973,7 @@ repos:
exclude: >
(?x)
^scripts/ci/docker-compose/grafana/.|
^scripts/ci/docker-compose/gremlin/.|
^scripts/ci/docker-compose/.+-config\.ya?ml$
require_serial: true
additional_dependencies: ['jsonschema>=3.2.0,<5.0', 'pyyaml>=6.0.2', 'requests==2.32.3', 'rich>=12.4.4']
Expand Down
2 changes: 2 additions & 0 deletions airflow-core/docs/extra-packages-ref.rst
Original file line number Diff line number Diff line change
Expand Up @@ -198,6 +198,8 @@ custom bash/python providers).
+---------------------+-----------------------------------------------------+------------------------------------------------+
| apache-spark | ``pip install 'apache-airflow[apache-spark]'`` | All Spark related operators & hooks |
+---------------------+-----------------------------------------------------+------------------------------------------------+
| apache-tinkerpop | ``pip install apache-airflow[apache-tinkerpop]`` | Apache-tinkerpop hooks and operators |
+---------------------+-----------------------------------------------------+------------------------------------------------+
| apache-webhdfs | ``pip install 'apache-airflow[apache-webhdfs]'`` | HDFS hooks and operators |
+---------------------+-----------------------------------------------------+------------------------------------------------+

Expand Down
9 changes: 9 additions & 0 deletions airflow-core/src/airflow/utils/db.py
Original file line number Diff line number Diff line change
Expand Up @@ -352,6 +352,15 @@ def create_default_connections(session: Session = NEW_SESSION):
),
session,
)
merge_conn(
Connection(
conn_id="gremlin_default",
conn_type="gremlin",
host="gremlin",
port=8182,
),
session,
)
merge_conn(
Connection(
conn_id="hive_cli_default",
Expand Down
2 changes: 2 additions & 0 deletions contributing-docs/testing/integration_tests.rst
Original file line number Diff line number Diff line change
Expand Up @@ -64,6 +64,8 @@ core or provider type of test.
+--------------+-------------------------------------------------------+
| drill | Integration required for drill operator and hook. |
+--------------+-------------------------------------------------------+
| gremlin | Integration required for gremlin operator and hook. |
+--------------+-------------------------------------------------------+
| kafka | Integration required for Kafka hooks. |
+--------------+-------------------------------------------------------+
| kerberos | Integration that provides Kerberos authentication. |
Expand Down
2 changes: 1 addition & 1 deletion dev/breeze/doc/images/output-commands.svg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Loading