Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Introduces new operator to get the lemma logits for factored vocabulary models for GPU inference #776

Open
wants to merge 18 commits into
base: master
Choose a base branch
from

Commits on Dec 11, 2020

  1. Introduces a special operator to handle getting factor logits for inf…

    …erence when processing the lemmas
    rhenry-nv committed Dec 11, 2020
    Configuration menu
    Copy the full SHA
    1100596 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    8694fd9 View commit details
    Browse the repository at this point in the history
  3. Adds cub as a submodule

    rhenry-nv committed Dec 11, 2020
    Configuration menu
    Copy the full SHA
    0fd9aa1 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    d700727 View commit details
    Browse the repository at this point in the history
  5. Bug fix in add factor maxes

    rhenry-nv committed Dec 11, 2020
    Configuration menu
    Copy the full SHA
    f7aba6d View commit details
    Browse the repository at this point in the history
  6. Removes sync before free in addFactorMaxes. I think it is not needed …

    …since the allocator has a memory pool that it manages for it won't get released by a cuda free. Additionally, two kernels may get the same pointer but they cannot execute concurrently since a single thread does not launch concurrent kernels. Since there is an allocator per thread, this means that no two kernels can ever race on the same pointer (I think). I have not seen any issues after removing this sync
    rhenry-nv committed Dec 11, 2020
    Configuration menu
    Copy the full SHA
    7aba3b4 View commit details
    Browse the repository at this point in the history
  7. WIP - Rework addFactorMaxes. Starts splitting it into two kernels to …

    …expose more parallelism when adding into the lemmas
    rhenry-nv committed Dec 11, 2020
    Configuration menu
    Copy the full SHA
    baab83f View commit details
    Browse the repository at this point in the history
  8. Configuration menu
    Copy the full SHA
    f2d77e0 View commit details
    Browse the repository at this point in the history
  9. Configuration menu
    Copy the full SHA
    706bbe7 View commit details
    Browse the repository at this point in the history
  10. Small refactoring

    rhenry-nv committed Dec 11, 2020
    Configuration menu
    Copy the full SHA
    edebe59 View commit details
    Browse the repository at this point in the history

Commits on Dec 12, 2020

  1. Configuration menu
    Copy the full SHA
    07de32d View commit details
    Browse the repository at this point in the history
  2. More refactorings

    rhenry-nv committed Dec 12, 2020
    Configuration menu
    Copy the full SHA
    eb49d6c View commit details
    Browse the repository at this point in the history
  3. Fixes bug in factor maxes

    rhenry-nv committed Dec 12, 2020
    Configuration menu
    Copy the full SHA
    975682b View commit details
    Browse the repository at this point in the history

Commits on Dec 13, 2020

  1. Configuration menu
    Copy the full SHA
    f0ffee1 View commit details
    Browse the repository at this point in the history

Commits on Dec 14, 2020

  1. Updates changelog

    rhenry-nv committed Dec 14, 2020
    Configuration menu
    Copy the full SHA
    4f57fdb View commit details
    Browse the repository at this point in the history

Commits on Dec 15, 2020

  1. Configuration menu
    Copy the full SHA
    de5449b View commit details
    Browse the repository at this point in the history

Commits on Mar 6, 2021

  1. Configuration menu
    Copy the full SHA
    22d13b3 View commit details
    Browse the repository at this point in the history

Commits on Jul 9, 2021

  1. 1 Configuration menu
    Copy the full SHA
    7be492a View commit details
    Browse the repository at this point in the history