-
Notifications
You must be signed in to change notification settings - Fork 23
/
Copy patheval.log
118 lines (118 loc) · 11.1 KB
/
eval.log
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
Running the following version of UD tools:
commit c1984d97df0ecdcc1b50fbeaa8c96419c6321432
Author: Dan Zeman <zeman@ufal.mff.cuni.cz>
Date: Sun Nov 10 10:33:45 2024 +0100
Evaluating the following revision of UD_Chinese-GSD:
commit d24a30bbb72c135d5bc07f8f531db5822a6e1198
Author: Dan Zeman <zeman@ufal.mff.cuni.cz>
Date: Sun May 5 11:58:51 2024 +0200
Size: counted 123291 of 123291 words (nodes).
Size: min(0, log((N/1000)**2)) = 9.62909482961094.
Size: maximum value 13.815511 is for 1000000 words or more.
Split: Found more than 10000 training words.
Split: Found at least 10000 development words.
Split: Found at least 10000 test words.
Lemmas: source of annotation (from README) factor is 0.5.
Universal POS tags: 16 out of 17 found in the corpus.
Universal POS tags: source of annotation (from README) factor is 0.8.
Features: 13784 out of 123291 total words have one or more features.
Features: source of annotation (from README) factor is 0.5.
Universal relations: 32 out of 37 found in the corpus.
Universal relations: source of annotation (from README) factor is 0.8.
Udapi:
TOTAL 21851
Udapi: found 21851 bugs.
Udapi: worst expected case (threshold) is one bug per 10 words. There are 123291 words.
Genres: found 1 out of 17 known.
/net/work/people/zeman/unidep/tools/validate.py --lang zh --max-err=10 UD_Chinese-GSD/zh_gsd-ud-dev.conllu
[Line 268 Sent dev-s11 Node 12]: [L3 Syntax too-many-subjects] Multiple subjects [4, 9] not subtyped as ':outer'. Outer subjects are allowed if a clause acts as the predicate of another clause.
[Line 401 Sent dev-s16 Node 4]: [L3 Warning flat-foreign-upos-feats] The child of a flat:foreign relation should have UPOS X and Foreign=Yes (but no other features).
[Line 400 Sent dev-s16 Node 3]: [L3 Warning flat-foreign-upos-feats] The parent of a flat:foreign relation should have UPOS X and Foreign=Yes (but no other features).
[Line 1389 Sent dev-s46 Node 34]: [L3 Warning flat-foreign-upos-feats] The child of a flat:foreign relation should have UPOS X and Foreign=Yes (but no other features).
[Line 1387 Sent dev-s46 Node 32]: [L3 Warning flat-foreign-upos-feats] The parent of a flat:foreign relation should have UPOS X and Foreign=Yes (but no other features).
[Line 1740 Sent dev-s56 Node 16]: [L3 Syntax too-many-subjects] Multiple subjects [10, 14] not subtyped as ':outer'.
[Line 2291 Sent dev-s72 Node 25]: [L3 Warning flat-foreign-upos-feats] The child of a flat:foreign relation should have UPOS X and Foreign=Yes (but no other features).
[Line 2290 Sent dev-s72 Node 24]: [L3 Warning flat-foreign-upos-feats] The parent of a flat:foreign relation should have UPOS X and Foreign=Yes (but no other features).
[Line 2366 Sent dev-s74 Node 25]: [L3 Warning flat-foreign-upos-feats] The child of a flat:foreign relation should have UPOS X and Foreign=Yes (but no other features).
[Line 2364 Sent dev-s74 Node 23]: [L3 Warning flat-foreign-upos-feats] The parent of a flat:foreign relation should have UPOS X and Foreign=Yes (but no other features).
[Line 2375 Sent dev-s74 Node 34]: [L3 Warning flat-foreign-upos-feats] The child of a flat:foreign relation should have UPOS X and Foreign=Yes (but no other features).
[Line 2373 Sent dev-s74 Node 32]: [L3 Warning flat-foreign-upos-feats] The parent of a flat:foreign relation should have UPOS X and Foreign=Yes (but no other features).
[Line 2433 Sent dev-s76 Node 8]: [L3 Syntax too-many-subjects] Multiple subjects [4, 7] not subtyped as ':outer'.
...suppressing further errors regarding Warning
[Line 4572 Sent dev-s149 Node 27]: [L3 Syntax too-many-subjects] Multiple subjects [23, 26] not subtyped as ':outer'.
[Line 6101 Sent dev-s206 Node 19]: [L3 Syntax too-many-subjects] Multiple subjects [9, 18] not subtyped as ':outer'.
[Line 6249 Sent dev-s211 Node 30]: [L3 Syntax too-many-subjects] Multiple subjects [23, 28] not subtyped as ':outer'.
[Line 7176 Sent dev-s243 Node 31]: [L3 Syntax too-many-subjects] Multiple subjects [12, 26] not subtyped as ':outer'.
[Line 9740 Sent dev-s331 Node 21]: [L3 Syntax too-many-subjects] Multiple subjects [14, 20] not subtyped as ':outer'.
[Line 10630 Sent dev-s362 Node 12]: [L3 Syntax too-many-subjects] Multiple subjects [7, 11] not subtyped as ':outer'.
[Line 10951 Sent dev-s374 Node 16]: [L3 Syntax too-many-subjects] Multiple subjects [1, 15] not subtyped as ':outer'.
...suppressing further errors regarding Syntax
Syntax errors: 11
Warnings: 69
*** FAILED *** with 11 errors
Exit code: 1
/net/work/people/zeman/unidep/tools/validate.py --lang zh --max-err=10 UD_Chinese-GSD/zh_gsd-ud-test.conllu
[Line 107 Sent test-s5 Node 10]: [L3 Syntax too-many-subjects] Multiple subjects [4, 9] not subtyped as ':outer'. Outer subjects are allowed if a clause acts as the predicate of another clause.
[Line 183 Sent test-s7 Node 28]: [L3 Warning flat-foreign-upos-feats] The child of a flat:foreign relation should have UPOS X and Foreign=Yes (but no other features).
[Line 182 Sent test-s7 Node 27]: [L3 Warning flat-foreign-upos-feats] The parent of a flat:foreign relation should have UPOS X and Foreign=Yes (but no other features).
[Line 434 Sent test-s15 Node 19]: [L3 Warning leaf-clf] 'clf' not expected to have children (19:種:clf --> 18:這:det)
[Line 701 Sent test-s24 Node 13]: [L3 Syntax too-many-subjects] Multiple subjects [9, 12] not subtyped as ':outer'.
[Line 719 Sent test-s25 Node 5]: [L3 Warning flat-foreign-upos-feats] The child of a flat:foreign relation should have UPOS X and Foreign=Yes (but no other features).
[Line 718 Sent test-s25 Node 4]: [L3 Warning flat-foreign-upos-feats] The parent of a flat:foreign relation should have UPOS X and Foreign=Yes (but no other features).
[Line 720 Sent test-s25 Node 6]: [L3 Warning flat-foreign-upos-feats] The child of a flat:foreign relation should have UPOS X and Foreign=Yes (but no other features).
[Line 718 Sent test-s25 Node 4]: [L3 Warning flat-foreign-upos-feats] The parent of a flat:foreign relation should have UPOS X and Foreign=Yes (but no other features).
[Line 721 Sent test-s25 Node 7]: [L3 Warning flat-foreign-upos-feats] The child of a flat:foreign relation should have UPOS X and Foreign=Yes (but no other features).
[Line 718 Sent test-s25 Node 4]: [L3 Warning flat-foreign-upos-feats] The parent of a flat:foreign relation should have UPOS X and Foreign=Yes (but no other features).
[Line 1105 Sent test-s42 Node 6]: [L3 Warning flat-foreign-upos-feats] The child of a flat:foreign relation should have UPOS X and Foreign=Yes (but no other features).
...suppressing further errors regarding Warning
[Line 3333 Sent test-s121 Node 50]: [L3 Syntax too-many-subjects] Multiple subjects [43, 48] not subtyped as ':outer'.
[Line 4289 Sent test-s156 Node 27]: [L3 Syntax too-many-subjects] Multiple subjects [14, 25] not subtyped as ':outer'.
[Line 4843 Sent test-s175 Node 15]: [L3 Syntax too-many-subjects] Multiple subjects [1, 12] not subtyped as ':outer'.
[Line 5265 Sent test-s189 Node 11]: [L3 Syntax too-many-subjects] Multiple subjects [5, 10] not subtyped as ':outer'.
[Line 6135 Sent test-s223 Node 6]: [L3 Syntax too-many-subjects] Multiple subjects [3, 5] not subtyped as ':outer'.
[Line 6582 Sent test-s238 Node 14]: [L3 Syntax too-many-subjects] Multiple subjects [2, 15] not subtyped as ':outer'.
[Line 9294 Sent test-s334 Node 56]: [L3 Syntax too-many-subjects] Multiple subjects [49, 54] not subtyped as ':outer'.
[Line 12860 Sent test-s460 Node 13]: [L3 Syntax too-many-subjects] Multiple subjects [11, 18] not subtyped as ':outer'.
Syntax errors: 10
Warnings: 76
*** FAILED *** with 10 errors
Exit code: 1
/net/work/people/zeman/unidep/tools/validate.py --lang zh --max-err=10 UD_Chinese-GSD/zh_gsd-ud-train.conllu
[Line 57 Sent train-s2 Node 10]: [L3 Syntax too-many-subjects] Multiple subjects [2, 8] not subtyped as ':outer'. Outer subjects are allowed if a clause acts as the predicate of another clause.
[Line 81 Sent train-s3 Node 2]: [L3 Warning leaf-clf] 'clf' not expected to have children (2:次:clf --> 1:這:det)
[Line 260 Sent train-s9 Node 7]: [L3 Warning leaf-clf] 'clf' not expected to have children (7:個:clf --> 6:這:det)
[Line 565 Sent train-s16 Node 6]: [L3 Warning leaf-clf] 'clf' not expected to have children (6:個:clf --> 5:這:det)
[Line 622 Sent train-s16 Node 62]: [L3 Warning flat-foreign-upos-feats] The child of a flat:foreign relation should have UPOS X and Foreign=Yes (but no other features).
[Line 621 Sent train-s16 Node 61]: [L3 Warning flat-foreign-upos-feats] The parent of a flat:foreign relation should have UPOS X and Foreign=Yes (but no other features).
[Line 1036 Sent train-s31 Node 22]: [L3 Warning flat-foreign-upos-feats] The child of a flat:foreign relation should have UPOS X and Foreign=Yes (but no other features).
[Line 1035 Sent train-s31 Node 21]: [L3 Warning flat-foreign-upos-feats] The parent of a flat:foreign relation should have UPOS X and Foreign=Yes (but no other features).
[Line 1037 Sent train-s31 Node 23]: [L3 Warning flat-foreign-upos-feats] The child of a flat:foreign relation should have UPOS X and Foreign=Yes (but no other features).
[Line 1035 Sent train-s31 Node 21]: [L3 Warning flat-foreign-upos-feats] The parent of a flat:foreign relation should have UPOS X and Foreign=Yes (but no other features).
[Line 1735 Sent train-s57 Node 3]: [L3 Warning leaf-clf] 'clf' not expected to have children (3:個:clf --> 2:這:det)
...suppressing further errors regarding Warning
[Line 3294 Sent train-s114 Node 16]: [L3 Syntax too-many-subjects] Multiple subjects [5, 9] not subtyped as ':outer'.
[Line 3891 Sent train-s138 Node 8]: [L3 Syntax too-many-subjects] Multiple subjects [3, 7] not subtyped as ':outer'.
[Line 4112 Sent train-s145 Node 30]: [L3 Syntax too-many-subjects] Multiple subjects [2, 20] not subtyped as ':outer'.
[Line 8211 Sent train-s294 Node 21]: [L3 Syntax too-many-subjects] Multiple subjects [6, 20] not subtyped as ':outer'.
[Line 9036 Sent train-s330 Node 16]: [L3 Syntax too-many-subjects] Multiple subjects [7, 15] not subtyped as ':outer'.
[Line 11904 Sent train-s438 Node 20]: [L3 Syntax too-many-subjects] Multiple subjects [3, 19] not subtyped as ':outer'.
[Line 12687 Sent train-s468 Node 22]: [L3 Syntax too-many-subjects] Multiple subjects [1, 19] not subtyped as ':outer'.
[Line 15490 Sent train-s564 Node 11]: [L3 Syntax too-many-subjects] Multiple subjects [6, 10] not subtyped as ':outer'.
[Line 16958 Sent train-s617 Node 16]: [L3 Syntax too-many-subjects] Multiple subjects [1, 15] not subtyped as ':outer'.
...suppressing further errors regarding Syntax
Syntax errors: 73
Warnings: 742
*** FAILED *** with 73 errors
Exit code: 1
Validity: 0.01
(weight=0.0769230769230769) * (score{features}=0.15) = 0.0115384615384615
(weight=0.0769230769230769) * (score{genres}=0.0588235294117647) = 0.00452488687782805
(weight=0.0769230769230769) * (score{lemmas}=0.5) = 0.0384615384615385
(weight=0.256410256410256) * (score{size}=0.696977125037194) = 0.17871208334287
(weight=0.0512820512820513) * (score{split}=1) = 0.0512820512820513
(weight=0.0769230769230769) * (score{tags}=0.752941176470588) = 0.0579185520361991
(weight=0.307692307692308) * (score{udapi}=0.01) = 0.00307692307692308
(weight=0.0769230769230769) * (score{udeprels}=0.691891891891892) = 0.0532224532224532
(TOTAL score=0.398736949838325) * (availability=1) * (validity=0.01) = 0.00398736949838325
STARS = 0
UD_Chinese-GSD 0.00398736949838325 0