Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Processing XML for enwik9 data #1292

Merged
merged 19 commits into from
May 2, 2021
Merged

Processing XML for enwik9 data #1292

merged 19 commits into from
May 2, 2021

Commits on Apr 23, 2021

  1. preprocessing xml for enwik9 dataset

    @parmeet
    parmeet committed Apr 23, 2021
    Configuration menu
    Copy the full SHA
    6c3e100 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' of github.com:pytorch/text into enwik9data

    @parmeet
    parmeet committed Apr 23, 2021
    Configuration menu
    Copy the full SHA
    afd4d0e View commit details
    Browse the repository at this point in the history

Commits on Apr 26, 2021

  1. Merge branch 'master' of github.com:pytorch/text into enwik9data

    @parmeet
    parmeet committed Apr 26, 2021
    Configuration menu
    Copy the full SHA
    8dbf48a View commit details
    Browse the repository at this point in the history

  2. fixing tests and moving common code-base to utils

    @parmeet
    parmeet committed Apr 26, 2021
    Configuration menu
    Copy the full SHA
    2a13569 View commit details
    Browse the repository at this point in the history

  3. fixing unicode error

    @parmeet
    parmeet committed Apr 26, 2021
    Configuration menu
    Copy the full SHA
    3b84202 View commit details
    Browse the repository at this point in the history

  4. figuring out issue regarding OSError: libmkl_intel_lp64.so.1

    @parmeet
    parmeet committed Apr 26, 2021
    Configuration menu
    Copy the full SHA
    15c26ec View commit details
    Browse the repository at this point in the history

  5. reverting

    @parmeet
    parmeet committed Apr 26, 2021
    Configuration menu
    Copy the full SHA
    0ca7b7a View commit details
    Browse the repository at this point in the history

Commits on Apr 27, 2021

  1. Merge branch 'master' of github.com:pytorch/text into enwik9data

    @parmeet
    parmeet committed Apr 27, 2021
    Configuration menu
    Copy the full SHA
    2318d5c View commit details
    Browse the repository at this point in the history

  2. creating pure iterator for wiki xml dumps

    @parmeet
    parmeet committed Apr 27, 2021
    Configuration menu
    Copy the full SHA
    26dae2c View commit details
    Browse the repository at this point in the history

  3. fix linter

    @parmeet
    parmeet committed Apr 27, 2021
    Configuration menu
    Copy the full SHA
    fda854e View commit details
    Browse the repository at this point in the history

  4. fix linter

    @parmeet
    parmeet committed Apr 27, 2021
    Configuration menu
    Copy the full SHA
    99a94aa View commit details
    Browse the repository at this point in the history

Commits on Apr 29, 2021

  1. creating functional for filtering wiki xml lines

    @parmeet
    parmeet committed Apr 29, 2021
    Configuration menu
    Copy the full SHA
    306ffe0 View commit details
    Browse the repository at this point in the history

  2. removing line

    @parmeet
    parmeet committed Apr 29, 2021
    Configuration menu
    Copy the full SHA
    47bb685 View commit details
    Browse the repository at this point in the history

  3. adding doc and example usage

    @parmeet
    parmeet committed Apr 29, 2021
    Configuration menu
    Copy the full SHA
    0e400d2 View commit details
    Browse the repository at this point in the history

  4. remove redundancy in code

    @parmeet
    parmeet committed Apr 29, 2021
    Configuration menu
    Copy the full SHA
    236f32b View commit details
    Browse the repository at this point in the history

  5. linter issue

    @parmeet
    parmeet committed Apr 29, 2021
    Configuration menu
    Copy the full SHA
    24d7988 View commit details
    Browse the repository at this point in the history

  6. minor code changes

    @parmeet
    parmeet committed Apr 29, 2021
    Configuration menu
    Copy the full SHA
    bf07a30 View commit details
    Browse the repository at this point in the history

Commits on May 1, 2021

  1. Merge branch 'master' of github.com:pytorch/text into enwik9data

    @parmeet
    parmeet committed May 1, 2021
    Configuration menu
    Copy the full SHA
    e010241 View commit details
    Browse the repository at this point in the history

  2. modified functional name and doc

    @parmeet
    parmeet committed May 1, 2021
    Configuration menu
    Copy the full SHA
    84bdf9f View commit details
    Browse the repository at this point in the history