Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[MERGE 2/2] merge fbsync branch to main #1950

Merged
merged 173 commits into from
Oct 19, 2022
Merged

[MERGE 2/2] merge fbsync branch to main #1950

Changes from all commits
Commits
Show all changes
173 commits
Select commit Hold shift + click to select a range
599bf07
include pytorch 1.5.0-rc1 for CI test
Mar 25, 2020
442fcf0
bump up the version
Mar 25, 2020
b56cb04
Merge branch 'master' into 0.6.0
Apr 9, 2020
3a54c7f
Merge remote-tracking branch 'upstream/master' into 0.6.0
Apr 10, 2020
db4d4fd
Set up ShipIt
Apr 30, 2020
db354a3
Re-sync with internal repository (#749)
cpuhrsch May 1, 2020
ab3c93b
20200429 pytorch/text import
cpuhrsch May 1, 2020
efdf20d
20200430 torchtext import script to include additional meta files
cpuhrsch May 1, 2020
bfbdaec
torchtext flake8, github, travis metafiles
cpuhrsch May 1, 2020
5aeca8d
Import torchtext 20200520 and update build
mthrok May 27, 2020
b79875b
Import torchtext 20200528
mthrok May 28, 2020
be0f749
20200604 torchtext github import
cpuhrsch Jun 5, 2020
4fd0fe2
Import torchtext 20200605
Nayef211 Jun 8, 2020
2fe0031
Back out "Import torchtext 20200605"
Nayef211 Jun 10, 2020
3bdf414
Import torchtext 2020/06/22
Nayef211 Jun 24, 2020
3088591
Fix torch.testing._internal module not found
zhangguanheng66 Jul 1, 2020
8233815
Import torchtext 2020/07/07
Nayef211 Jul 8, 2020
8003a02
remediation of S205607
StanislavGlebik Jul 18, 2020
4e653d1
remediation of S205607
StanislavGlebik Jul 18, 2020
5521477
Import torchtext 2020/07/21
Nayef211 Jul 21, 2020
9d0c4e1
Remove .python3 markers
zertosh Aug 6, 2020
1a786ca
Import torchtext 2020/08/06
Nayef211 Aug 10, 2020
d7762a0
Import torchtext 2020/08/18
Nayef211 Aug 19, 2020
4a7bc10
Import torchtext from 8aecbb9
zhangguanheng66 Sep 1, 2020
f668e3c
Import torchtext 9/4/2020
zhangguanheng66 Sep 4, 2020
d2e1af4
Import github torchtext on 9/9/2020
zhangguanheng66 Sep 13, 2020
8c374dd
Add property support for ScriptModules (#42390)
Sep 15, 2020
2ac6d79
sync with OSS torchtext 9/15/20
zhangguanheng66 Sep 25, 2020
84174db
Import Github torchtext on 9/28/2020
zhangguanheng66 Sep 28, 2020
24b304e
Enable @unused syntax for ignoring properties (#45261)
Sep 29, 2020
5cd2bb2
Import Github torchtext on 10/11/2020
zhangguanheng66 Oct 12, 2020
b074e00
make duplicate def() calls an error in the dispatcher. Updating all f…
bdhirsh Nov 16, 2020
854f715
Revert D24714803: make duplicate def() calls an error in the dispatch…
bdhirsh Nov 17, 2020
522e59b
Import torchtext on Nov 20, 2020
zhangguanheng66 Nov 30, 2020
d1686a9
Updating all call-sites of the legacy dispatcher registration API in …
bdhirsh Dec 2, 2020
e22375e
Import torchtext from github into fbcode on 1/11/2021
zhangguanheng66 Jan 11, 2021
83e53ba
Import torchtext from github #1121 d56fffe
mthrok Jan 20, 2021
6f8a2ce
Import the hidden files in torchtext github repo
zhangguanheng66 Jan 25, 2021
310eac1
add a newline mark to config.yml file (#1128)
datumbox Feb 15, 2021
35a8720
Replace model with full name when spacy load is used (#1140)
datumbox Feb 15, 2021
ab53f2f
Fix the num_lines argument of the setup_iter func in RawTextIterableD…
datumbox Feb 15, 2021
8168aba
Fix broken CI tests due to spacy 3.0 release (#1138)
datumbox Feb 15, 2021
86cc913
Switch data_select in dataset signature to split (#1143)
datumbox Feb 15, 2021
ce0cb15
Add offset arg in the raw text dataset (#1145)
datumbox Feb 15, 2021
125684c
switch to_ivalue to __prepare_scriptable__ (#1080)
datumbox Feb 15, 2021
c34c150
Pass an embedding layer to the constructor of the BertModel class (#1…
datumbox Feb 15, 2021
6a69d55
add __next__ method to RawTextIterableDataset (#1141)
datumbox Feb 15, 2021
3c0ed6a
Add func to count the total number of parameters in a model (#1134)
datumbox Feb 15, 2021
68958f8
Retire the legacy code in torchtext library and fix the dependency of…
zhangguanheng66 Feb 17, 2021
eb2eeae
Sync torchtext GH<->fbcode until GH commit 1197514eb8cc33ccff10f58853…
cpuhrsch Mar 4, 2021
8fdea5d
20210304[2] Sync torchtext GH<->fbcode until GH commit 2764143865678c…
cpuhrsch Mar 8, 2021
81b24b5
20210308 Sync torchtext GH <-> fbcode
cpuhrsch Mar 8, 2021
03c91d4
Re-name raw_datasets.json file with jsonl extension
zhangguanheng66 Mar 9, 2021
066200c
20210329 Sync torchtext up to GH commit eb5e39d3d40525c0064c8e7b7c976…
hwangjeff Mar 29, 2021
f96f374
Import torchtext #1267 93b03e4
parmeet Apr 2, 2021
6a46a5c
Import torchtext #1266 ba0bf52
mthrok Apr 16, 2021
bc5e6e3
Import torchtext #1287 fab63ed
Apr 22, 2021
dac4b9c
Import torchtext #1293 d2a0776
parmeet Apr 26, 2021
b9a38f2
Import torchtext #1291 0790ce6
cpuhrsch Apr 29, 2021
9b3a0af
adding __contains__ method to experimental vocab (#1297)
parmeet Apr 30, 2021
37a41de
Import torchtext #1292 ede6ce65eb5405ff1f8801ff6b354bb1cd242108
NicolasHug May 10, 2021
6231993
Added APIs for default index and removed unk token (#1302)
cpuhrsch May 17, 2021
c8bced1
Swapping experimental Vocab and retiring current Vocab into legacy (#…
parmeet May 19, 2021
3142f4e
Import torchtext #1313 36e33e2
parmeet May 20, 2021
0c55dd9
Adding API usage logging
parmeet May 25, 2021
e9d7593
Import torchtext #1314 99557efd98dd0e74346975d75183dd8aa32eb37e
datumbox May 25, 2021
c56bfbd
Import torchtext #1325 57a1df3
mthrok Jun 9, 2021
625c11d
Import torchtext #1328 ca514f6
mthrok Jun 15, 2021
8816411
up the priority of numpy array comparisons in self.assertEqual (#5906…
heitorschueroff Jun 22, 2021
056bf31
Re-sync with internal repository (#1343)
facebook-github-bot Jun 25, 2021
9b387bc
up the priority of numpy array comparisons in self.assertEqual (#59067)
pmeier Jun 22, 2021
97f66bf
Import torchtext #1300 0435df13924fd4582d67e5b17bc09f6ded18be8b
vincentqb Jun 25, 2021
282aa1d
Import torchtext #1345 8cf471c
parmeet Jun 29, 2021
9534b15
Import torchtext #1352 7ab50af
parmeet Jul 6, 2021
968bdd5
Enabling torchtext datasets access via manifold and iopath
parmeet Jul 6, 2021
929238e
Import torchtext #1361 05cb992
parmeet Jul 23, 2021
cd50c0f
Import torchtext #1365 c57b1fb
yangarbiter Jul 27, 2021
61c1127
Moving Roberta building blocks to torchtext
parmeet Jul 27, 2021
41b3512
Enabling torchtext availability in @mode/opt
parmeet Aug 24, 2021
da5ea68
Import torchtext #1382 aa12e9a
mthrok Aug 27, 2021
2930dba
Simplify cpp extension initialization process
Nayef211 Sep 2, 2021
ae13bc6
fixed bug with incorrect variable name in dataset_utils.py
Nayef211 Sep 23, 2021
579c519
Import torchtext #1410 0930843
parmeet Oct 19, 2021
e6a9677
Import torchtext #1406 1fb2aed
parmeet Oct 19, 2021
d1544d8
Import from github 10/18/21
Nayef211 Oct 21, 2021
963dcaa
Import torchtext #1420 0153ead
parmeet Oct 24, 2021
42e43df
Import torchtext #1421 bcc1455
Nayef211 Oct 24, 2021
18ec37b
Enable OSS torchtext XLMR Base/Large model on fbcode
parmeet Oct 25, 2021
30ca7cf
enabling SST2 dataset usage in fbcode
Nayef211 Oct 26, 2021
6b437b1
Import torchtext #1426 4be2792
parmeet Oct 28, 2021
b7805a6
Import torchtext #1428 b962c51
parmeet Oct 29, 2021
aae996f
Import torchtext #1430 4cf19ed
parmeet Nov 4, 2021
19bf744
Allow inferred scaling in MultiheadSelfAttention for head_dim != 64
ebsmothers Nov 5, 2021
1886092
Updated sst2 dataset to accept `validate_hash` parameter
Nayef211 Nov 9, 2021
0c2d4a2
Import torchtext #1431 ba20fc5
parmeet Nov 10, 2021
280791d
Fixed file filtering bug in SST2 dataset
Nayef211 Nov 11, 2021
60c24b5
Squashed commits (9314b44 to e691934)
parmeet Nov 16, 2021
c256e7f
Refactor OnDiskCache (#61)
ejguan Nov 22, 2021
5af1436
Add a class method in Model Bundler to facilitate model creation with…
parmeet Nov 23, 2021
63882e5
Import torchtext from github aea6ad6,#1449 to 9f2fb3f,#1452
parmeet Dec 1, 2021
68dc59c
Fix SST2Dataset test iterator
Nayef211 Dec 1, 2021
8d19c03
Fix issue in label Transform
parmeet Dec 7, 2021
f898310
Import torchtext #1437 2cebac3
abhinavarora Dec 8, 2021
232d763
Import torchtext #1457 d801e99
parmeet Dec 9, 2021
c6f808c
Import torchtext #1459 8ef1b15
abhinavarora Dec 10, 2021
7223650
Fixing typing issues DataSet -> DataType
VitalyFedyunin Dec 30, 2021
9d57dd4
Import torchtext #1470 52d38e8
parmeet Jan 5, 2022
6e7fd5f
Import torchtext #1486 4908d3c
abhinavarora Jan 6, 2022
19d74b1
Import torchtext #1488 2c98927
Nayef211 Jan 8, 2022
5524b28
Update load_state_dict_from_url method to skip download if file is ca…
Nayef211 Jan 10, 2022
e04e1b3
Import torchtext #1482 0e7cf21
Nayef211 Jan 11, 2022
e1ef8b9
Import torchtext #1509 1a2fc00
Nayef211 Jan 13, 2022
4e0d944
Import torchtext #1532 ce1ce9
Nayef211 Feb 1, 2022
395b8e1
Import torchtext #1538 d72124c
Nayef211 Feb 4, 2022
b98782d
Import torchtext from commits e0c5528 to 8808e7e
parmeet Mar 9, 2022
326c494
Import torchtext #1635 69f67f3
parmeet Mar 9, 2022
042015e
Import TorchText from Github
Mar 9, 2022
de36a72
Import TorchText from Github
Mar 11, 2022
30eefde
Import TorchText from Github
abhinavarora Mar 16, 2022
5d10571
Import TorchText from Github
Mar 16, 2022
050372e
Import TorchText from Github
Apr 1, 2022
771b6bc
Import TorchText from Github
Apr 1, 2022
3f00324
Import TorchText from Github
Nayef211 Apr 5, 2022
ca4cca3
Import TorchText from Github
Apr 6, 2022
af39a78
torchx integration
hudeven Apr 8, 2022
6abda6a
Import TorchText from Github
Apr 28, 2022
0ff1488
BetterTransformer support for torchtext (#1690)
zrphercule2 Apr 29, 2022
6e8b4d6
Kill to_better by having native load_from_state_dict and init
zrphercule2 Apr 29, 2022
479f208
Remove unneeded modules after using nn.Module for BetterTransformer (…
mikekgfb Apr 29, 2022
b511e25
Import TorchText from Github
May 4, 2022
9d7d7fd
Replace TransformerEncoder in torchtext with better transformer (#34)
zrphercule2 May 5, 2022
f71f067
Import TorchText from Github
May 9, 2022
7e1dc68
Import TorchText from Github
May 11, 2022
5318e53
Enable model testing in FBCode
parmeet May 11, 2022
6877196
Import TorchText from Github
May 16, 2022
aacdb70
Import TorchText from Github
May 17, 2022
5e0544b
Import TorchText from Github
May 20, 2022
72506f5
Import torchtext #1794 a54be1f3a7ac534509ac9c066a1b35127936dd77
parmeet Jun 21, 2022
40be2bc
Import TorchText from Github
Jun 21, 2022
fd27451
Import TorchText from Github
Jun 24, 2022
daf4331
Import TorchText from Github
Nayef211 Jun 27, 2022
4a12f93
Import TorchText from Github
Jun 28, 2022
e5f2d92
Adding TARGETS file for torchtext benchmarks
Nayef211 Jun 28, 2022
8d8ec4d
Import TorchText from Github
Jun 29, 2022
d91f450
Import TorchText from Github
Jul 6, 2022
7a18717
Import TorchText from Github
Jul 7, 2022
daf6ca4
Import TorchText from Github
Jul 8, 2022
eed7119
Import TorchText from Github
Jul 15, 2022
8aa9940
Import TorchText from Github
Jul 22, 2022
d32aa6d
Import TorchText from Github
Jul 25, 2022
ce1e78c
Import TorchText from Github
Jul 26, 2022
0b27627
Import TorchText from Github
Aug 1, 2022
f238b96
Import TorchText from Github
Aug 2, 2022
7eadbb6
Import TorchText from Github
Aug 3, 2022
58d6620
Import TorchText from Github
Aug 4, 2022
e45d84c
Import TorchText from Github
Aug 9, 2022
543fc19
Import TorchText from Github
pmabbo13 Aug 17, 2022
16a0eb5
Import torchtext #1879 72966f0
joecummings Aug 17, 2022
f94843a
Import TorchText from Github
Aug 22, 2022
0303323
Remove dependency on the torch::jit::script::Module for mobile builds
Aug 25, 2022
fd6e5cd
Replace `pytext_lib`'s `MaskTransform` with new one from `torchtext`
joecummings Aug 30, 2022
3d1c635
Import TorchText from Github
Sep 6, 2022
60737d9
move PATH_MANAGER to OSS
hudeven Sep 7, 2022
131533c
Turn off mask checking for torchtext which is known to have a legal m…
mikekgfb Sep 13, 2022
13692db
Back out "move PATH_MANAGER to OSS" (#1724)
hudeven Sep 21, 2022
b8e12fe
Import TorchText from Github
Nayef211 Sep 26, 2022
a85fd57
Import TorchText from Github
Nayef211 Sep 30, 2022
f44310f
Import TorchText from Github
Oct 11, 2022
bedb667
Import TorchText from Github
Oct 12, 2022
bac09bf
Add Character Level BPE Tokenizer (#1936)
Oct 14, 2022
aa369b8
Add padding_masks and tests for T5Model (#1935)
Oct 17, 2022
549e5c7
Import TorchText from Github
Oct 18, 2022
db987ed
Merge branch 'main' into merge_main_to_fbsync
Nayef211 Oct 18, 2022
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view

These merge commits were added into this branch cleanly.

There are no new changes to show.