Skip to content
This repository has been archived by the owner on Jun 22, 2022. It is now read-only.

Dev #113

Merged
merged 14 commits into from
Jul 10, 2018
Merged

Dev #113

merged 14 commits into from
Jul 10, 2018

Conversation

jakubczakon
Copy link
Contributor

  • dropped redundant aggregation steps (it was one-per-fold now one-per-training)
  • added prev-application features
  • added dynamic (trend-based) installment features
  • sped-up installments
  • added some cleaning on burau/prev applications

jakubczakon and others added 10 commits July 4, 2018 09:45
* Dynamic features

* Smart features (#61)

* Update README.md

* Update README.md

* Update

* Smart features update

* More descriptive transformer name

* Reading all data in main

* More application features

* Transformer for cleaning

* Multiinput data dictionary

* Fix (#63)

* fixed configs

* dropped redundand steps, moved stuff to cleaning, refactored groupby (#64)

* dropped redundand steps, moved stuff to cleanining, refactored groupby

* restructured, added stacking + CV

* Fix format string

* Update pipeline_manager.py

clipped prediction -> prediction

* added stratified kfold option (#77)

* Update config (#79)

* dropped redundand steps, moved stuff to cleanining, refactored groupby

* restructured, added stacking + CV

* Update pipeline_config.py

* Dev review (#81)

* dropped feature by type split, refactored pipleine_config

* dropped feature by type split method

* explored application features

* trash

* reverted refactor of aggs

* fixed/updated bureau features

* cleared notebooks

* agg features added to notebook bureau

* credit card cleaned

* added other feature notebooks

* added rank mean

* updated model arch

* reverted to old params

* fixed rank mean calculations

* ApplicationCleaning update (#84)

* Cleaning - application

* Clear output in notebook

* clenaed names in steps, refactored mergeaggregate transformer, changed caching/saving specs (#85)

* local trash

* External sources notebook (#86)

* Update

* External sources notebook

* Dev lgbm params (#88)

* local trash

* updated configs

* dropped comment

* updated lgb params

* Dev app agg fix (#90)

* dropped app_aggs

* app agg features fixed

* cleaned leftovers

* dropped fast read-in for debug

* External_sources statistics (#89)

* Speed-up ext_src notebook

* exernal_sources statistics

* Weighted mean and notebook fix

* application notebook update

* clear notebook output

* Fix auto submission (#95)

* CreditCardBalance monthly diff mean

* POSCASH remaining installments

* POSCASH completed_contracts

* notebook update

* Resolve conflicts

* Fix

* Update neptune.yaml

* Update neptune_random_search.yaml

* Split static and dynamic features - credit card balance
* added nan_count

* added nan count with parameter
* added simple features, parallel groupby, last-installment features

* refactored last_installment features

* added features for the very last installment
* added dynamic-trend features

* formated configs

* added skew/iqr features
* added number of credit agreement change features

* reverted sample size
* previous_application handcrafted features

* previous application cleaning

* Update neptune.yaml

* code improvement

* Update notebook
* refactored aggs to calculate only once per training, sped up installment and credit card (only single index groupby)

* sped up all hand crafted

* fixed bureau worker errors

* fixed isntallment names

* fixed isntallment names

* fixed bureau and prev_app naming bugs

* reverted to vectorized where possible

* updated hyperparams

* updated early stopping params to meet convergence

* reverted to old fallback neptune file

* updated paths

* updated paths, explored prev-app features
@jakubczakon jakubczakon mentioned this pull request Jul 9, 2018
Jakub Czakon and others added 4 commits July 9, 2018 10:19
* Notebook - feature importance

* Notebook - feature importance - search by text

* Notebook - feature importance - search by text

* Notebook - feature importance - Plots description
@kamil-kaczmarek kamil-kaczmarek merged commit 323e860 into master Jul 10, 2018
@kamil-kaczmarek kamil-kaczmarek deleted the dev branch July 10, 2018 09:43
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants