Skip to content

PECOS v0.2.1
Compare
Choose a tag to compare
@weiliw-amz weiliw-amz released this 27 Oct 03:39
· 128 commits to mainline since this release
v0.2.1
034d7d0
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.

Highlights

  • Remove support of Ubuntu 16.04
  • Implemented XR-Transformer
  • Enabled HNSW functionality
  • Enabled cost-sensitive learning in PECOS

Enhancements

ANN HNSW

  • Initial implementation of HNSW in C++ with single-thread [#44] (@OctoberChang)
  • Refactor HNSW in C++ to support sparse/dense features and multi-threading [#49] (@rofuyu)
  • Initial implementation of HNSW Python interface [#53] (@OctoberChang)
  • Refactor HNSW python API and readme markdown [#63] (@OctoberChang)
  • Refactor HNSW C++ to reuse priority queue for different inference calls within the same Searcher [#65] (@rofuyu)
  • Enable HNSW save/load functionality [#71] (@OctoberChang)
  • Add serialization version in HNSW save/load [#77] (@rofuyu)
  • Enable HNSW python command line interface [#79] (@OctoberChang)

Cost-sensitive Learning

XR-Transformer [#27, #64] (@jiong-zhang)

  • Refactor pecos.xmc.xtransformer and enable end2end XR-Transformer training
  • CLI tool for generating embeddings pecos.xmc.xtransformer.encode
  • Faster transformer text tokenizers using huggingface's C implementation
  • Allow training XR-Transformer without numerical features.

Better control over parameters for XLinear, XTransformer and Text2text [#64, #78, #80] (@jiong-zhang)

  • Enable advanced control of parameters via JSON input file
  • Add utility tool to generate parameter skeleton for further modification

Other new functionalities

  • Added support for predicting on select outputs [#37, #43, #47] (@bhl00)
  • Added new primal solver L2R_L2LOSS_SVC_PRIMAL for XLinear [#67] (@yuhchenlin)
  • Add Makefile for easy format, install, clean and unittest. [#12] (@weiliw-amz)

Bug Fixes

  • (#17) Fixed issues with github information obtaining when installing from .zip. [#21, #29] (@weiliw-amz)
  • (#42) Fixed transformer training issue on single GPU [#14] (@jiong-zhang)
  • Removed PECOS source-installation dependency on NumPy BLAS library. [#81] (@weili-amz)

Contributors

OctoberChang, bhl00, and 4 other contributors
Assets 2
Loading