Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Refactor#3622 #3638

Closed
wants to merge 3 commits into from
Closed

Refactor#3622 #3638

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
7cfd3e3
REDACTOR-#3622 Centralize Tests for modin.pandas
teaVeloper Oct 29, 2021
c1df92e
REFACTOR-#3622: Fix import Error
teaVeloper Oct 30, 2021
00e7248
REFACTOR-#3622 Fix references to pandas*test
teaVeloper Oct 30, 2021
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
128 changes: 64 additions & 64 deletions .github/workflows/ci.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -147,7 +147,7 @@ jobs:
conda list
- run: sudo apt update && sudo apt install -y libhdf5-dev
- name: Api tests
run: python -m pytest modin/pandas/test/test_api.py
run: python -m pytest modin/test/pandas/test_api.py
- name: Executions Api tests
run: python -m pytest modin/test/test_executions_api.py

Expand Down Expand Up @@ -282,22 +282,22 @@ jobs:
run: sudo apt update && sudo apt install -y libhdf5-dev
- run: pytest modin/experimental/xgboost/test/test_default.py --execution=${{ matrix.execution }}
- run: python -m pytest -n 2 modin/test/storage_formats/base/test_internals.py --execution=${{ matrix.execution }}
- run: pytest -n 2 modin/pandas/test/dataframe/test_binary.py --execution=${{ matrix.execution }}
- run: pytest -n 2 modin/pandas/test/dataframe/test_default.py --execution=${{ matrix.execution }}
- run: pytest -n 2 modin/pandas/test/dataframe/test_indexing.py --execution=${{ matrix.execution }}
- run: pytest -n 2 modin/pandas/test/dataframe/test_iter.py --execution=${{ matrix.execution }}
- run: pytest -n 2 modin/pandas/test/dataframe/test_join_sort.py --execution=${{ matrix.execution }}
- run: pytest -n 2 modin/pandas/test/dataframe/test_map_metadata.py --execution=${{ matrix.execution }}
- run: pytest -n 2 modin/pandas/test/dataframe/test_reduction.py --execution=${{ matrix.execution }}
- run: pytest -n 2 modin/pandas/test/dataframe/test_udf.py --execution=${{ matrix.execution }}
- run: pytest -n 2 modin/pandas/test/dataframe/test_window.py --execution=${{ matrix.execution }}
- run: pytest -n 2 modin/pandas/test/dataframe/test_pickle.py --execution=${{ matrix.execution }}
- run: python -m pytest -n 2 modin/pandas/test/test_series.py --execution=${{ matrix.execution }}
- run: python -m pytest -n 2 modin/pandas/test/test_rolling.py --execution=${{ matrix.execution }}
- run: python -m pytest -n 2 modin/pandas/test/test_concat.py --execution=${{ matrix.execution }}
- run: python -m pytest -n 2 modin/pandas/test/test_groupby.py --execution=${{ matrix.execution }}
- run: python -m pytest -n 2 modin/pandas/test/test_reshape.py --execution=${{ matrix.execution }}
- run: python -m pytest -n 2 modin/pandas/test/test_general.py --execution=${{ matrix.execution }}
- run: pytest -n 2 modin/test/pandas/dataframe/test_binary.py --execution=${{ matrix.execution }}
- run: pytest -n 2 modin/test/pandas/dataframe/test_default.py --execution=${{ matrix.execution }}
- run: pytest -n 2 modin/test/pandas/dataframe/test_indexing.py --execution=${{ matrix.execution }}
- run: pytest -n 2 modin/test/pandas/dataframe/test_iter.py --execution=${{ matrix.execution }}
- run: pytest -n 2 modin/test/pandas/dataframe/test_join_sort.py --execution=${{ matrix.execution }}
- run: pytest -n 2 modin/test/pandas/dataframe/test_map_metadata.py --execution=${{ matrix.execution }}
- run: pytest -n 2 modin/test/pandas/dataframe/test_reduction.py --execution=${{ matrix.execution }}
- run: pytest -n 2 modin/test/pandas/dataframe/test_udf.py --execution=${{ matrix.execution }}
- run: pytest -n 2 modin/test/pandas/dataframe/test_window.py --execution=${{ matrix.execution }}
- run: pytest -n 2 modin/test/pandas/dataframe/test_pickle.py --execution=${{ matrix.execution }}
- run: python -m pytest -n 2 modin/test/pandas/test_series.py --execution=${{ matrix.execution }}
- run: python -m pytest -n 2 modin/test/pandas/test_rolling.py --execution=${{ matrix.execution }}
- run: python -m pytest -n 2 modin/test/pandas/test_concat.py --execution=${{ matrix.execution }}
- run: python -m pytest -n 2 modin/test/pandas/test_groupby.py --execution=${{ matrix.execution }}
- run: python -m pytest -n 2 modin/test/pandas/test_reshape.py --execution=${{ matrix.execution }}
- run: python -m pytest -n 2 modin/test/pandas/test_general.py --execution=${{ matrix.execution }}
- run: |
curl -o codecov https://codecov.io/bash
VERSION=$(grep -o 'VERSION=\"[0-9\.]*\"' codecov | cut -d'"' -f2);
Expand Down Expand Up @@ -337,9 +337,9 @@ jobs:
conda list
- name: Install HDF5
run: sudo apt update && sudo apt install -y libhdf5-dev
- run: MODIN_BENCHMARK_MODE=True pytest modin/pandas/test/internals/test_benchmark_mode.py
- run: MODIN_BENCHMARK_MODE=True pytest modin/test/pandas/internals/test_benchmark_mode.py
- run: pytest modin/experimental/core/execution/native/implementations/omnisci_on_native/test/test_dataframe.py
- run: pytest modin/pandas/test/test_io.py::TestCsv --verbose
- run: pytest modin/test/pandas/test_io.py::TestCsv --verbose
- run: |
curl -o codecov https://codecov.io/bash
VERSION=$(grep -o 'VERSION=\"[0-9\.]*\"' codecov | cut -d'"' -f2);
Expand Down Expand Up @@ -443,30 +443,30 @@ jobs:
conda list
- name: Install HDF5
run: sudo apt update && sudo apt install -y libhdf5-dev
- run: MODIN_BENCHMARK_MODE=True pytest modin/pandas/test/internals/test_benchmark_mode.py
- run: MODIN_BENCHMARK_MODE=True pytest modin/test/pandas/internals/test_benchmark_mode.py
- run: pytest -n 2 modin/experimental/xgboost/test/test_default.py
- run: pytest -n 2 modin/experimental/xgboost/test/test_xgboost.py
if: matrix.engine == 'ray'
- run: pytest -n 2 modin/pandas/test/dataframe/test_binary.py
- run: pytest -n 2 modin/pandas/test/dataframe/test_default.py
- run: pytest -n 2 modin/pandas/test/dataframe/test_indexing.py
- run: pytest -n 2 modin/pandas/test/dataframe/test_iter.py
- run: pytest -n 2 modin/pandas/test/dataframe/test_join_sort.py
- run: pytest -n 2 modin/pandas/test/dataframe/test_map_metadata.py
- run: pytest -n 2 modin/pandas/test/dataframe/test_reduction.py
- run: pytest -n 2 modin/pandas/test/dataframe/test_udf.py
- run: pytest -n 2 modin/pandas/test/dataframe/test_window.py
- run: pytest -n 2 modin/pandas/test/dataframe/test_pickle.py
- run: python -m pytest -n 2 modin/pandas/test/test_series.py
- run: python -m pytest -n 2 modin/pandas/test/test_rolling.py
- run: python -m pytest -n 2 modin/pandas/test/test_concat.py
- run: pytest -n 2 modin/test/pandas/dataframe/test_binary.py
- run: pytest -n 2 modin/test/pandas/dataframe/test_default.py
- run: pytest -n 2 modin/test/pandas/dataframe/test_indexing.py
- run: pytest -n 2 modin/test/pandas/dataframe/test_iter.py
- run: pytest -n 2 modin/test/pandas/dataframe/test_join_sort.py
- run: pytest -n 2 modin/test/pandas/dataframe/test_map_metadata.py
- run: pytest -n 2 modin/test/pandas/dataframe/test_reduction.py
- run: pytest -n 2 modin/test/pandas/dataframe/test_udf.py
- run: pytest -n 2 modin/test/pandas/dataframe/test_window.py
- run: pytest -n 2 modin/test/pandas/dataframe/test_pickle.py
- run: python -m pytest -n 2 modin/test/pandas/test_series.py
- run: python -m pytest -n 2 modin/test/pandas/test_rolling.py
- run: python -m pytest -n 2 modin/test/pandas/test_concat.py
if: matrix.engine == 'python'
- run: python -m pytest modin/pandas/test/test_concat.py # Ray and Dask versions fails with -n 2
- run: python -m pytest modin/test/pandas/test_concat.py # Ray and Dask versions fails with -n 2
if: matrix.engine != 'python'
- run: python -m pytest -n 2 modin/pandas/test/test_groupby.py
- run: python -m pytest -n 2 modin/pandas/test/test_reshape.py
- run: python -m pytest -n 2 modin/pandas/test/test_general.py
- run: python -m pytest modin/pandas/test/test_io.py --verbose
- run: python -m pytest -n 2 modin/test/pandas/test_groupby.py
- run: python -m pytest -n 2 modin/test/pandas/test_reshape.py
- run: python -m pytest -n 2 modin/test/pandas/test_general.py
- run: python -m pytest modin/test/pandas/test_io.py --verbose
- run: python -m pytest modin/experimental/pandas/test/test_io_exp.py
- run: pip install "dfsql>=0.4.2" "pyparsing<=2.4.7" && pytest modin/experimental/sql/test/test_sql.py
- run: |
Expand Down Expand Up @@ -506,9 +506,9 @@ jobs:
run: |
conda info
conda list
- run: python -m pytest -n 2 modin/pandas/test/dataframe/test_map_metadata.py
- run: python -m pytest -n 2 modin/pandas/test/test_series.py
- run: python -m pytest modin/pandas/test/test_io.py --verbose
- run: python -m pytest -n 2 modin/test/pandas/dataframe/test_map_metadata.py
- run: python -m pytest -n 2 modin/test/pandas/test_series.py
- run: python -m pytest modin/test/pandas/test_io.py --verbose
- run: |
curl -o codecov https://codecov.io/bash
VERSION=$(grep -o 'VERSION=\"[0-9\.]*\"' codecov | cut -d'"' -f2);
Expand Down Expand Up @@ -546,9 +546,9 @@ jobs:
run: |
conda info
conda list
- run: python -m pytest --simulate-cloud=normal modin/pandas/test/test_io.py --verbose
- run: python -m pytest --simulate-cloud=normal modin/test/pandas/test_io.py --verbose
- # When running without parameters, some of the tests fail
run: python -m pytest --simulate-cloud=normal modin/pandas/test/dataframe/test_binary.py::test_math_functions[add-rows-scalar]
run: python -m pytest --simulate-cloud=normal modin/test/pandas/dataframe/test_binary.py::test_math_functions[add-rows-scalar]
- run: |
curl -o codecov https://codecov.io/bash
VERSION=$(grep -o 'VERSION=\"[0-9\.]*\"' codecov | cut -d'"' -f2);
Expand All @@ -571,23 +571,23 @@ jobs:
python-version: ["3.7", "3.8"]
engine: ["ray", "dask"]
test-task:
- modin/pandas/test/dataframe/test_binary.py
- modin/pandas/test/dataframe/test_default.py
- modin/pandas/test/dataframe/test_indexing.py
- modin/pandas/test/dataframe/test_iter.py
- modin/pandas/test/dataframe/test_join_sort.py
- modin/pandas/test/dataframe/test_map_metadata.py
- modin/pandas/test/dataframe/test_reduction.py
- modin/pandas/test/dataframe/test_udf.py
- modin/pandas/test/dataframe/test_window.py
- modin/pandas/test/dataframe/test_pickle.py
- modin/pandas/test/test_series.py
- modin/pandas/test/test_rolling.py
- modin/pandas/test/test_concat.py
- modin/pandas/test/test_groupby.py
- modin/pandas/test/test_reshape.py
- modin/pandas/test/test_general.py
- modin/pandas/test/test_io.py
- modin/test/pandas/dataframe/test_binary.py
- modin/test/pandas/dataframe/test_default.py
- modin/test/pandas/dataframe/test_indexing.py
- modin/test/pandas/dataframe/test_iter.py
- modin/test/pandas/dataframe/test_join_sort.py
- modin/test/pandas/dataframe/test_map_metadata.py
- modin/test/pandas/dataframe/test_reduction.py
- modin/test/pandas/dataframe/test_udf.py
- modin/test/pandas/dataframe/test_window.py
- modin/test/pandas/dataframe/test_pickle.py
- modin/test/pandas/test_series.py
- modin/test/pandas/test_rolling.py
- modin/test/pandas/test_concat.py
- modin/test/pandas/test_groupby.py
- modin/test/pandas/test_reshape.py
- modin/test/pandas/test_general.py
- modin/test/pandas/test_io.py
env:
MODIN_ENGINE: ${{matrix.engine}}
MODIN_MEMORY: 1000000000
Expand All @@ -609,10 +609,10 @@ jobs:
conda info
conda list
- run: python -m pytest ${{matrix.test-task}}
if: matrix.test-task != 'modin/pandas/test/test_io.py'
if: matrix.test-task != 'modin/test/pandas/test_io.py'
- timeout-minutes: 30
run: python -m pytest modin/pandas/test/test_io.py --verbose
if: matrix.test-task == 'modin/pandas/test/test_io.py'
run: python -m pytest modin/test/pandas/test_io.py --verbose
if: matrix.test-task == 'modin/test/pandas/test_io.py'
- run: choco install codecov
- run: codecov -f ./coverage.xml

Expand Down Expand Up @@ -645,7 +645,7 @@ jobs:
conda info
conda list
- run: sudo apt update && sudo apt install -y libhdf5-dev
- run: python -m pytest modin/pandas/test/test_io.py::TestCsv --verbose
- run: python -m pytest modin/test/pandas/test_io.py::TestCsv --verbose

test-spreadsheet:
needs: [ lint-commit, lint-flake8, lint-black, test-api, test-headers ]
Expand Down
68 changes: 34 additions & 34 deletions .github/workflows/push-to-master.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -31,22 +31,22 @@ jobs:
- name: Run Modin tests
run: |
pytest modin/experimental/xgboost/test/test_default.py
pytest modin/pandas/test/dataframe/test_binary.py
pytest modin/pandas/test/dataframe/test_default.py
pytest modin/pandas/test/dataframe/test_indexing.py
pytest modin/pandas/test/dataframe/test_iter.py
pytest modin/pandas/test/dataframe/test_join_sort.py
pytest modin/pandas/test/dataframe/test_map_metadata.py
pytest modin/pandas/test/dataframe/test_reduction.py
pytest modin/pandas/test/dataframe/test_udf.py
pytest modin/pandas/test/dataframe/test_window.py
pytest modin/pandas/test/test_series.py
pytest modin/pandas/test/test_rolling.py
pytest modin/pandas/test/test_concat.py
pytest modin/pandas/test/test_groupby.py
pytest modin/pandas/test/test_reshape.py
pytest modin/pandas/test/test_general.py
pytest modin/pandas/test/test_io.py
pytest modin/test/pandas/dataframe/test_binary.py
pytest modin/test/pandas/dataframe/test_default.py
pytest modin/test/pandas/dataframe/test_indexing.py
pytest modin/test/pandas/dataframe/test_iter.py
pytest modin/test/pandas/dataframe/test_join_sort.py
pytest modin/test/pandas/dataframe/test_map_metadata.py
pytest modin/test/pandas/dataframe/test_reduction.py
pytest modin/test/pandas/dataframe/test_udf.py
pytest modin/test/pandas/dataframe/test_window.py
pytest modin/test/pandas/test_series.py
pytest modin/test/pandas/test_rolling.py
pytest modin/test/pandas/test_concat.py
pytest modin/test/pandas/test_groupby.py
pytest modin/test/pandas/test_reshape.py
pytest modin/test/pandas/test_general.py
pytest modin/test/pandas/test_io.py
pytest modin/experimental/pandas/test/test_io_exp.py

test-docs:
Expand Down Expand Up @@ -83,23 +83,23 @@ jobs:
matrix:
python-version: ["3.7", "3.8"]
test-task:
- modin/pandas/test/dataframe/test_binary.py
- modin/pandas/test/dataframe/test_default.py
- modin/pandas/test/dataframe/test_indexing.py
- modin/pandas/test/dataframe/test_iter.py
- modin/pandas/test/dataframe/test_join_sort.py
- modin/pandas/test/dataframe/test_map_metadata.py
- modin/pandas/test/dataframe/test_reduction.py
- modin/pandas/test/dataframe/test_udf.py
- modin/pandas/test/dataframe/test_window.py
- modin/pandas/test/dataframe/test_pickle.py
- modin/pandas/test/test_series.py
- modin/pandas/test/test_rolling.py
- modin/pandas/test/test_concat.py
- modin/pandas/test/test_groupby.py
- modin/pandas/test/test_reshape.py
- modin/pandas/test/test_general.py
- modin/pandas/test/test_io.py
- modin/test/pandas/dataframe/test_binary.py
- modin/test/pandas/dataframe/test_default.py
- modin/test/pandas/dataframe/test_indexing.py
- modin/test/pandas/dataframe/test_iter.py
- modin/test/pandas/dataframe/test_join_sort.py
- modin/test/pandas/dataframe/test_map_metadata.py
- modin/test/pandas/dataframe/test_reduction.py
- modin/test/pandas/dataframe/test_udf.py
- modin/test/pandas/dataframe/test_window.py
- modin/test/pandas/dataframe/test_pickle.py
- modin/test/pandas/test_series.py
- modin/test/pandas/test_rolling.py
- modin/test/pandas/test_concat.py
- modin/test/pandas/test_groupby.py
- modin/test/pandas/test_reshape.py
- modin/test/pandas/test_general.py
- modin/test/pandas/test_io.py
env:
MODIN_ENGINE: ray
MODIN_MEMORY: 1000000000
Expand All @@ -124,4 +124,4 @@ jobs:
if: matrix.python-version == '3.8'
- name: Install HDF5
run: sudo apt update && sudo apt install -y libhdf5-dev
- run: python -m pytest ${{matrix.test-task}}
- run: python -m pytest ${{matrix.test-task}}
Loading