Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

At text classification example #945

Open
wants to merge 89 commits into
base: master
Choose a base branch
from
Open
Changes from 1 commit
Commits
Show all changes
89 commits
Select commit Hold shift + click to select a range
de5f44c
examples added + changed nd4j backend in pom.xml to run on DGX1
atuzhykov Feb 20, 2020
d65fa9a
examples added + changed nd4j backend in pom.xml to run on DGX1
atuzhykov Feb 21, 2020
c2967df
other small changes
atuzhykov Feb 21, 2020
9e87835
small fix to match cuda version with container
atuzhykov Feb 21, 2020
41530e1
small fix to match cuda version with container
atuzhykov Feb 21, 2020
3198021
lr 1e-3 > 4e-3 (as multiplying batchsize*k, lr*sqrt(k))
atuzhykov Feb 22, 2020
9a1ba54
lr 1e-3 > 4e-3 (as multiplying batchsize*k, lr*sqrt(k))
atuzhykov Feb 23, 2020
95aa639
experiment0
atuzhykov Feb 24, 2020
7501626
experiment1 (notes belong to commit name are here http://tiny.cc/yashkz)
atuzhykov Feb 25, 2020
091c386
experiment2 (notes belong to commit name are here http://tiny.cc/yashkz)
atuzhykov Feb 25, 2020
86a6518
experiment3 (notes belong to commit name are here http://tiny.cc/yashkz)
atuzhykov Feb 25, 2020
d669d6f
experiment4 (notes belong to commit name are here http://tiny.cc/yashkz)
atuzhykov Feb 25, 2020
578a186
experiment5 (notes belong to commit name are here http://tiny.cc/yashkz)
atuzhykov Feb 25, 2020
fe42967
experiment6 (notes belong to commit name are here http://tiny.cc/yashkz)
atuzhykov Feb 25, 2020
302f7bb
experiment7 (notes belong to commit name are here http://tiny.cc/yashkz)
atuzhykov Feb 25, 2020
bb933c5
experiment8 (notes belong to commit name are here http://tiny.cc/yashkz)
atuzhykov Feb 25, 2020
000f7d8
experiment9 (notes belong to commit name are here http://tiny.cc/yashkz)
atuzhykov Feb 25, 2020
79014f8
experiment9 (notes belong to commit name are here http://tiny.cc/yashkz)
atuzhykov Feb 25, 2020
4a5cffd
experiment10 (notes belong to commit name are here http://tiny.cc/yas…
atuzhykov Feb 25, 2020
8ef7519
experiment10 (notes belong to commit name are here http://tiny.cc/yas…
atuzhykov Feb 25, 2020
b99d59a
experiment11 (notes belong to commit name are here http://tiny.cc/yas…
atuzhykov Feb 25, 2020
1aabba1
experiment12 (notes belong to commit name are here http://tiny.cc/yas…
atuzhykov Feb 26, 2020
dc3f3b3
experiment12 (notes belong to commit name are here http://tiny.cc/yas…
atuzhykov Feb 26, 2020
f16d8ac
experiment12 (notes belong to commit name are here http://tiny.cc/yas…
atuzhykov Feb 26, 2020
36ae8ee
experiment12 (notes belong to commit name are here http://tiny.cc/yas…
atuzhykov Feb 26, 2020
0de07d8
experiment13 (notes belong to commit name are here http://tiny.cc/yas…
atuzhykov Feb 26, 2020
f2eece6
experiment14 (notes belong to commit name are here http://tiny.cc/yas…
atuzhykov Feb 26, 2020
ff91a96
baseline conf + LengthHandling.FIXED_LENGTH=256
atuzhykov Feb 27, 2020
2e99c55
baselineconf+LengthHandling.FIXED_LENGTH=256+Bidirectional_lstm
atuzhykov Feb 28, 2020
e107c2c
baselineconf+LengthHandling.FIXED_LENGTH=256+Bidirectional_lstm+lr1e-4
atuzhykov Feb 28, 2020
c09746d
baselineconf+LengthHandling.FIXED_LENGTH=256+Bidirectional_lstm_256
atuzhykov Feb 28, 2020
2b6414a
baselineconf+LengthHandling.FIXED_LENGTH=256+Bidirectional_lstm_256_l…
atuzhykov Feb 28, 2020
834c338
base_conf+bidir_LSTM_256_layersize_Adam_lr1e-3_SGD_lr1e-3_for_EmbdLayer
Mar 2, 2020
d6b2644
base_conf+bidir_LSTM_256_layersize_Adam_lr1e-3_SGD_lr1e-3_for_EmbdLayer
atuzhykov Mar 2, 2020
615657f
base_conf+bidir_LSTM_256_layersize_Nadam_lr1e-3
atuzhykov Mar 2, 2020
77d6c27
base_conf+bidir_LSTM_256_layersize_Nadam_lr1e-3
atuzhykov Mar 2, 2020
d4ef045
base_conf+bidir_LSTM_256_layersize_Nadam_lr1e-3
atuzhykov Mar 2, 2020
8a74305
base_conf+3x_bidir_LSTM_256_layersize_Nadam_lr1e-3
atuzhykov Mar 2, 2020
1668928
base_conf+3xbidir_LSTM_256_layersize_Adam_lr1e-3_l21e-5
atuzhykov Mar 2, 2020
022c4dc
base_conf+3x_bidir_LSTM_256_layersize_Adam_Sheduled_lr
atuzhykov Mar 2, 2020
c7f5393
base_conf+2x_bidir_LSTM_256_Adam_lr1e-3_lstm_dropout_075
atuzhykov Mar 3, 2020
ccecf71
prefinal examples
atuzhykov Mar 4, 2020
51e30c3
examples added + changed nd4j backend in pom.xml to run on DGX1
atuzhykov Feb 20, 2020
b42580e
examples added + changed nd4j backend in pom.xml to run on DGX1
atuzhykov Feb 21, 2020
aa0c749
other small changes
atuzhykov Feb 21, 2020
5f5625e
small fix to match cuda version with container
atuzhykov Feb 21, 2020
61ca555
small fix to match cuda version with container
atuzhykov Feb 21, 2020
f6c95c2
lr 1e-3 > 4e-3 (as multiplying batchsize*k, lr*sqrt(k))
atuzhykov Feb 22, 2020
a20525a
lr 1e-3 > 4e-3 (as multiplying batchsize*k, lr*sqrt(k))
atuzhykov Feb 23, 2020
6d60af5
experiment0
atuzhykov Feb 24, 2020
5b1082c
experiment1 (notes belong to commit name are here http://tiny.cc/yashkz)
atuzhykov Feb 25, 2020
c0d363e
experiment2 (notes belong to commit name are here http://tiny.cc/yashkz)
atuzhykov Feb 25, 2020
b92aa8f
experiment3 (notes belong to commit name are here http://tiny.cc/yashkz)
atuzhykov Feb 25, 2020
407feae
experiment4 (notes belong to commit name are here http://tiny.cc/yashkz)
atuzhykov Feb 25, 2020
9adc5e4
experiment5 (notes belong to commit name are here http://tiny.cc/yashkz)
atuzhykov Feb 25, 2020
2e73eae
experiment6 (notes belong to commit name are here http://tiny.cc/yashkz)
atuzhykov Feb 25, 2020
88ea863
experiment7 (notes belong to commit name are here http://tiny.cc/yashkz)
atuzhykov Feb 25, 2020
f4aadbe
experiment8 (notes belong to commit name are here http://tiny.cc/yashkz)
atuzhykov Feb 25, 2020
772d38e
experiment9 (notes belong to commit name are here http://tiny.cc/yashkz)
atuzhykov Feb 25, 2020
096eca4
experiment9 (notes belong to commit name are here http://tiny.cc/yashkz)
atuzhykov Feb 25, 2020
b2f6510
experiment10 (notes belong to commit name are here http://tiny.cc/yas…
atuzhykov Feb 25, 2020
c5de18f
experiment10 (notes belong to commit name are here http://tiny.cc/yas…
atuzhykov Feb 25, 2020
145e1fd
experiment11 (notes belong to commit name are here http://tiny.cc/yas…
atuzhykov Feb 25, 2020
2a72f0a
experiment12 (notes belong to commit name are here http://tiny.cc/yas…
atuzhykov Feb 26, 2020
3f07a38
experiment12 (notes belong to commit name are here http://tiny.cc/yas…
atuzhykov Feb 26, 2020
6256e85
experiment12 (notes belong to commit name are here http://tiny.cc/yas…
atuzhykov Feb 26, 2020
da14588
experiment12 (notes belong to commit name are here http://tiny.cc/yas…
atuzhykov Feb 26, 2020
cb26a75
experiment13 (notes belong to commit name are here http://tiny.cc/yas…
atuzhykov Feb 26, 2020
f0e1241
experiment14 (notes belong to commit name are here http://tiny.cc/yas…
atuzhykov Feb 26, 2020
c4f9d9a
baseline conf + LengthHandling.FIXED_LENGTH=256
atuzhykov Feb 27, 2020
02d47fd
baselineconf+LengthHandling.FIXED_LENGTH=256+Bidirectional_lstm
atuzhykov Feb 28, 2020
61b63f8
baselineconf+LengthHandling.FIXED_LENGTH=256+Bidirectional_lstm+lr1e-4
atuzhykov Feb 28, 2020
820eda5
baselineconf+LengthHandling.FIXED_LENGTH=256+Bidirectional_lstm_256
atuzhykov Feb 28, 2020
2c757c0
baselineconf+LengthHandling.FIXED_LENGTH=256+Bidirectional_lstm_256_l…
atuzhykov Feb 28, 2020
53efeec
base_conf+bidir_LSTM_256_layersize_Adam_lr1e-3_SGD_lr1e-3_for_EmbdLayer
Mar 2, 2020
1bbb9e0
base_conf+bidir_LSTM_256_layersize_Adam_lr1e-3_SGD_lr1e-3_for_EmbdLayer
atuzhykov Mar 2, 2020
880cd30
base_conf+bidir_LSTM_256_layersize_Nadam_lr1e-3
atuzhykov Mar 2, 2020
9555d55
base_conf+bidir_LSTM_256_layersize_Nadam_lr1e-3
atuzhykov Mar 2, 2020
8aab2fb
base_conf+bidir_LSTM_256_layersize_Nadam_lr1e-3
atuzhykov Mar 2, 2020
542db86
base_conf+3x_bidir_LSTM_256_layersize_Nadam_lr1e-3
atuzhykov Mar 2, 2020
46dffc0
base_conf+3xbidir_LSTM_256_layersize_Adam_lr1e-3_l21e-5
atuzhykov Mar 2, 2020
c5a979a
base_conf+3x_bidir_LSTM_256_layersize_Adam_Sheduled_lr
atuzhykov Mar 2, 2020
6e390eb
base_conf+2x_bidir_LSTM_256_Adam_lr1e-3_lstm_dropout_075
atuzhykov Mar 3, 2020
7945508
prefinal examples
atuzhykov Mar 4, 2020
74162ff
prefinal
atuzhykov Mar 4, 2020
13a2392
changed package and class name, added trained model URL
atuzhykov Mar 5, 2020
5b1b710
fixed required changes
atuzhykov Mar 6, 2020
a22956d
fixed new round of required changes
atuzhykov Mar 11, 2020
5e7df4f
small issue belong to match BertIterator and DataSetIterator in Evalu…
atuzhykov Mar 11, 2020
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
baselineconf+LengthHandling.FIXED_LENGTH=256+Bidirectional_lstm+lr1e-4
Signed-off-by: atuzhykov <andrewtuzhykov@gmail.com>
atuzhykov committed Feb 28, 2020
commit e107c2cffecb7f6497a01b0c8d8a561b458bd9ee
Original file line number Diff line number Diff line change
@@ -99,7 +99,7 @@ public static void main(String[] args) throws Exception {

MultiLayerConfiguration conf = new NeuralNetConfiguration.Builder()
.seed(seed)
.updater(new Adam(1e-3))
.updater(new Adam(1e-4))
.l2(1e-6)
.weightInit(WeightInit.XAVIER)
.list()