Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Data Type Optimization #782

Merged
merged 50 commits into from
Feb 13, 2024
Merged

Data Type Optimization #782

merged 50 commits into from
Feb 13, 2024

Commits on Jul 25, 2023

  1. trying pandas categorical dtype

    @i-am-sijia
    i-am-sijia committed Jul 25, 2023
    Configuration menu
    Copy the full SHA
    84a2a0c View commit details
    Browse the repository at this point in the history

  2. sweeping out string variables

    @i-am-sijia
    i-am-sijia committed Jul 25, 2023
    Configuration menu
    Copy the full SHA
    228cc28 View commit details
    Browse the repository at this point in the history

  3. telecommute freq string

    @i-am-sijia
    i-am-sijia committed Jul 25, 2023
    Configuration menu
    Copy the full SHA
    c128447 View commit details
    Browse the repository at this point in the history

  4. vehicle type strings

    @i-am-sijia
    i-am-sijia committed Jul 25, 2023
    Configuration menu
    Copy the full SHA
    93c427f View commit details
    Browse the repository at this point in the history

  5. categorical is not recognized by numpy

    @i-am-sijia
    i-am-sijia committed Jul 25, 2023
    Configuration menu
    Copy the full SHA
    e91a115 View commit details
    Browse the repository at this point in the history

  6. df info verbose

    @i-am-sijia
    i-am-sijia committed Jul 25, 2023
    Configuration menu
    Copy the full SHA
    0de0043 View commit details
    Browse the repository at this point in the history

Commits on Aug 2, 2023

  1. categoricals for school escorting

    @i-am-sijia
    i-am-sijia committed Aug 2, 2023
    Configuration menu
    Copy the full SHA
    224474c View commit details
    Browse the repository at this point in the history

  2. categoricals for vehicle allocation

    @i-am-sijia
    i-am-sijia committed Aug 2, 2023
    Configuration menu
    Copy the full SHA
    575ef45 View commit details
    Browse the repository at this point in the history

  3. add condition for pandas categoricals

    @i-am-sijia
    i-am-sijia committed Aug 2, 2023
    Configuration menu
    Copy the full SHA
    ef6fbbf View commit details
    Browse the repository at this point in the history

  4. adhoc string variables to categoricals

    @i-am-sijia
    i-am-sijia committed Aug 2, 2023
    Configuration menu
    Copy the full SHA
    9a582da View commit details
    Browse the repository at this point in the history

Commits on Aug 22, 2023

  1. auto downcast for interim variables

    @i-am-sijia
    i-am-sijia committed Aug 22, 2023
    Configuration menu
    Copy the full SHA
    fabd596 View commit details
    Browse the repository at this point in the history

  2. not use unsigned int

    @i-am-sijia
    i-am-sijia committed Aug 22, 2023
    Configuration menu
    Copy the full SHA
    4453877 View commit details
    Browse the repository at this point in the history

  3. numeric overflow on chaperone weights

    @i-am-sijia
    i-am-sijia committed Aug 22, 2023
    Configuration menu
    Copy the full SHA
    6f64dd2 View commit details
    Browse the repository at this point in the history

  4. numeric overflow in veh type preprocessor

    @i-am-sijia
    i-am-sijia committed Aug 22, 2023
    Configuration menu
    Copy the full SHA
    e420633 View commit details
    Browse the repository at this point in the history

  5. downcast tour variables in source code

    @i-am-sijia
    i-am-sijia committed Aug 22, 2023
    Configuration menu
    Copy the full SHA
    5c7ee34 View commit details
    Browse the repository at this point in the history

Commits on Oct 6, 2023

  1. condition the temps

    @i-am-sijia
    i-am-sijia committed Oct 6, 2023
    Configuration menu
    Copy the full SHA
    282885d View commit details
    Browse the repository at this point in the history

  2. sort time period cat in tour scheduling

    @i-am-sijia
    i-am-sijia committed Oct 6, 2023
    Configuration menu
    Copy the full SHA
    e06bd7d View commit details
    Browse the repository at this point in the history

  3. add loggings

    @i-am-sijia
    i-am-sijia committed Oct 6, 2023
    Configuration menu
    Copy the full SHA
    9018aa4 View commit details
    Browse the repository at this point in the history

  4. formatting

    @i-am-sijia
    i-am-sijia committed Oct 6, 2023
    Configuration menu
    Copy the full SHA
    7cffe4f View commit details
    Browse the repository at this point in the history

  5. update dependencies

    @i-am-sijia
    i-am-sijia committed Oct 6, 2023
    Configuration menu
    Copy the full SHA
    3fd3ed5 View commit details
    Browse the repository at this point in the history

Commits on Dec 7, 2023

  1. update unit tests under util\test

    @i-am-sijia
    i-am-sijia committed Dec 7, 2023
    Configuration menu
    Copy the full SHA
    be8c087 View commit details
    Browse the repository at this point in the history

  2. update unit tests under abm.test

    @i-am-sijia
    i-am-sijia committed Dec 7, 2023
    Configuration menu
    Copy the full SHA
    0a34951 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'develop' into data-type-op-pd-cat

    @i-am-sijia
    i-am-sijia authored Dec 7, 2023
    Configuration menu
    Copy the full SHA
    37e7ab5 View commit details
    Browse the repository at this point in the history

  4. make int downcast an option

    @i-am-sijia
    i-am-sijia committed Dec 7, 2023
    Configuration menu
    Copy the full SHA
    cbe6310 View commit details
    Browse the repository at this point in the history

Commits on Dec 11, 2023

  1. test moving str comp out of utility evaluation

    @i-am-sijia
    i-am-sijia committed Dec 11, 2023
    Configuration menu
    Copy the full SHA
    e4e73d3 View commit details
    Browse the repository at this point in the history

  2. fix mtc and sandag ci tests

    @i-am-sijia
    i-am-sijia committed Dec 11, 2023
    Configuration menu
    Copy the full SHA
    51f9a24 View commit details
    Browse the repository at this point in the history

Commits on Dec 12, 2023

  1. get categories from alternatives

    @i-am-sijia
    i-am-sijia committed Dec 12, 2023
    Configuration menu
    Copy the full SHA
    e1e5d41 View commit details
    Browse the repository at this point in the history

  2. black formatting

    @i-am-sijia
    i-am-sijia committed Dec 12, 2023
    Configuration menu
    Copy the full SHA
    ed2ae96 View commit details
    Browse the repository at this point in the history

Commits on Dec 16, 2023

  1. add downcast_int and downcast_float into settings

    @i-am-sijia
    i-am-sijia committed Dec 16, 2023
    Configuration menu
    Copy the full SHA
    e02b0b4 View commit details
    Browse the repository at this point in the history

  2. fix primary purpose in school escorting

    @i-am-sijia
    i-am-sijia committed Dec 16, 2023
    Configuration menu
    Copy the full SHA
    3aefc59 View commit details
    Browse the repository at this point in the history

Commits on Dec 27, 2023

  1. sort mode categories

    @i-am-sijia
    i-am-sijia committed Dec 27, 2023
    Configuration menu
    Copy the full SHA
    21fdb9f View commit details
    Browse the repository at this point in the history

  2. fix estimation tests

    @i-am-sijia
    i-am-sijia committed Dec 27, 2023
    Configuration menu
    Copy the full SHA
    379c4f4 View commit details
    Browse the repository at this point in the history

Commits on Jan 2, 2024

  1. fix typo

    @i-am-sijia
    i-am-sijia committed Jan 2, 2024
    Configuration menu
    Copy the full SHA
    78db977 View commit details
    Browse the repository at this point in the history

Commits on Jan 31, 2024

  1. remove code in comments

    @i-am-sijia
    i-am-sijia committed Jan 31, 2024
    Configuration menu
    Copy the full SHA
    08f3be8 View commit details
    Browse the repository at this point in the history

  2. add check column type in the tests in util/test

    @i-am-sijia
    i-am-sijia committed Jan 31, 2024
    Configuration menu
    Copy the full SHA
    cfe034a View commit details
    Browse the repository at this point in the history

  3. remove unwanted tracing 

    @jpn-- I'm gonna remove these files. I used them to write out the memory of each column in the interaction_df. It was useful when I did the diagnosis, but probably not needed in actual implementation.
    @i-am-sijia
    i-am-sijia committed Jan 31, 2024
    Configuration menu
    Copy the full SHA
    83d9e67 View commit details
    Browse the repository at this point in the history

  4. blacken

    @i-am-sijia
    i-am-sijia committed Jan 31, 2024
    Configuration menu
    Copy the full SHA
    3c60efc View commit details
    Browse the repository at this point in the history

Commits on Feb 1, 2024

  1. move comment

    @i-am-sijia
    i-am-sijia committed Feb 1, 2024
    Configuration menu
    Copy the full SHA
    a9dd383 View commit details
    Browse the repository at this point in the history

Commits on Feb 2, 2024

  1. relax progressive checks for categorical dtypes

    @jpn--
    jpn-- committed Feb 2, 2024
    Configuration menu
    Copy the full SHA
    ccc195c View commit details
    Browse the repository at this point in the history

  2. update pointers

    @jpn--
    jpn-- committed Feb 2, 2024
    Configuration menu
    Copy the full SHA
    f81211a View commit details
    Browse the repository at this point in the history

Commits on Feb 6, 2024

  1. use empty string as NaN

    @jpn--
    jpn-- committed Feb 6, 2024
    Configuration menu
    Copy the full SHA
    54afbb0 View commit details
    Browse the repository at this point in the history

  2. Merge commit '25e4f6c9055cccaeee2145b2924bdc7d00459abc' into data-typ… 

    …e-dev-merge

# Conflicts:
#	activitysim/core/util.py
    @jpn--
    jpn-- committed Feb 6, 2024
    Configuration menu
    Copy the full SHA
    f09ac76 View commit details
    Browse the repository at this point in the history

  3. Merge pull request #8 from camsys/data-type-op-pd-cat 

    relax progressive checks for categorical dtypes
    @i-am-sijia
    i-am-sijia authored Feb 6, 2024
    Configuration menu
    Copy the full SHA
    ae126f1 View commit details
    Browse the repository at this point in the history

  4. update mtc_ext progressive test for categorical outputs

    @jpn--
    jpn-- committed Feb 6, 2024
    Configuration menu
    Copy the full SHA
    277bbb8 View commit details
    Browse the repository at this point in the history

  5. Merge commit 'ae126f1f85b7ac858f921a762e49e9da534a9efb' into data-typ… 

    …e-dev-merge
    @jpn--
    jpn-- committed Feb 6, 2024
    Configuration menu
    Copy the full SHA
    74d4f96 View commit details
    Browse the repository at this point in the history

  6. Merge commit '69465d9534e2ca889ad5a5acaed1eadc9a330a6f' into data-typ… 

    …e-dev-merge

# Conflicts:
#	activitysim/core/interaction_simulate.py
    @jpn--
    jpn-- committed Feb 6, 2024
    Configuration menu
    Copy the full SHA
    9cd9bbe View commit details
    Browse the repository at this point in the history

  7. Merge pull request #9 from camsys/data-type-dev-merge 

    Merge Develop Branch
    @i-am-sijia
    i-am-sijia authored Feb 6, 2024
    Configuration menu
    Copy the full SHA
    42d4e8c View commit details
    Browse the repository at this point in the history

Commits on Feb 7, 2024

  1. Merge pull request #10 from wsp-sag/develop 

    Bring in the latest Develop
    @i-am-sijia
    i-am-sijia authored Feb 7, 2024
    Configuration menu
    Copy the full SHA
    a3cb622 View commit details
    Browse the repository at this point in the history

Commits on Feb 9, 2024

  1. Merge branch 'develop' into data-type-op-pd-cat 

    # Conflicts:
#	activitysim/abm/models/vehicle_type_choice.py
    @jpn--
    jpn-- committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    1f40c06 View commit details
    Browse the repository at this point in the history

Commits on Feb 13, 2024

  1. Merge pull request #11 from camsys/data-type-op-pd-cat 

    latest updates from other PRs
    @i-am-sijia
    i-am-sijia authored Feb 13, 2024
    Configuration menu
    Copy the full SHA
    db03dae View commit details
    Browse the repository at this point in the history