-
Notifications
You must be signed in to change notification settings - Fork 1
/
Copy patheval.log
56 lines (56 loc) · 3.87 KB
/
eval.log
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
Running the following version of UD tools:
commit c1984d97df0ecdcc1b50fbeaa8c96419c6321432
Author: Dan Zeman <[email protected]>
Date: Sun Nov 10 10:33:45 2024 +0100
Evaluating the following revision of UD_Western_Armenian-ArmTDP:
commit 122ac4538362d9111a1f6b5f7386e7d66ef0b362
Author: Dan Zeman <[email protected]>
Date: Sun May 5 13:40:21 2024 +0200
Size: counted 122907 of 122907 words (nodes).
Size: min(0, log((N/1000)**2)) = 9.62285594365103.
Size: maximum value 13.815511 is for 1000000 words or more.
Split: Found more than 10000 training words.
Split: Found at least 10000 development words.
Split: Found at least 10000 test words.
Lemmas: source of annotation (from README) factor is 1.
Universal POS tags: 17 out of 17 found in the corpus.
Universal POS tags: source of annotation (from README) factor is 1.
Features: 85409 out of 122907 total words have one or more features.
Features: source of annotation (from README) factor is 1.
Universal relations: 35 out of 37 found in the corpus.
Universal relations: source of annotation (from README) factor is 1.
Udapi:
TOTAL 133
Udapi: found 133 bugs.
Udapi: worst expected case (threshold) is one bug per 10 words. There are 122907 words.
Genres: found 9 out of 17 known.
/net/work/people/zeman/unidep/tools/validate.py --lang hyw --max-err=10 UD_Western_Armenian-ArmTDP/hyw_armtdp-ud-dev.conllu
[Line 16219 Sent nonfiction-0009-000S00E5 Node 25]: [L3 Warning leaf-det] 'det' not expected to have children (25:այն:det --> 31:կրնար:advcl)
Warnings: 1
*** PASSED ***
/net/work/people/zeman/unidep/tools/validate.py --lang hyw --max-err=10 UD_Western_Armenian-ArmTDP/hyw_armtdp-ud-test.conllu
*** PASSED ***
/net/work/people/zeman/unidep/tools/validate.py --lang hyw --max-err=10 UD_Western_Armenian-ArmTDP/hyw_armtdp-ud-train.conllu
[Line 8001 Sent news-0035-000606J4 Node 21]: [L3 Warning leaf-det] 'det' not expected to have children (21:այն:det --> 32:զգայ:acl)
[Line 8295 Sent news-0035-000706JA Node 47]: [L3 Warning leaf-det] 'det' not expected to have children (47:նոյն:det --> 51:պաշտպանելու:appos)
[Line 54356 Sent blog-0026-00070450 Node 4]: [L3 Warning leaf-det] 'det' not expected to have children (4:մըն:det --> 5:է:cop)
[Line 62418 Sent news-001V-000P03L3 Node 8]: [L3 Warning leaf-det] 'det' not expected to have children (8:այս:det --> 7:ստեղծուած:acl)
[Line 67628 Sent news-001U-000403FR Node 2]: [L3 Warning leaf-det] 'det' not expected to have children (2:բոլոր:det --> 4:տասներկու:appos)
[Line 73136 Sent news-001O-000803CM Node 9]: [L3 Warning leaf-det] 'det' not expected to have children (9:այնպիսի:det --> 20:վնասուէր:advcl)
[Line 74562 Sent news-001M-0002038B Node 13]: [L3 Warning leaf-det] 'det' not expected to have children (13:որեւէ:det --> 12:խելամիտ:amod)
[Line 91358 Sent nonfiction-000R-000H01U0 Node 1]: [L3 Warning leaf-det] 'det' not expected to have children (1:Այս:det --> 3:2:appos)
[Line 108696 Sent nonfiction-000I-0006019C Node 17]: [L3 Warning leaf-det] 'det' not expected to have children (17:այնպիսի:det --> 30:բերեն:advcl)
Warnings: 9
*** PASSED ***
Validity: 1
(weight=0.0769230769230769) * (score{features}=1) = 0.0769230769230769
(weight=0.0769230769230769) * (score{genres}=0.529411764705882) = 0.0407239819004525
(weight=0.0769230769230769) * (score{lemmas}=1) = 0.0769230769230769
(weight=0.256410256410256) * (score{size}=0.696525539412925) = 0.17859629215716
(weight=0.0512820512820513) * (score{split}=1) = 0.0512820512820513
(weight=0.0769230769230769) * (score{tags}=1) = 0.0769230769230769
(weight=0.307692307692308) * (score{udapi}=0.989178809994549) = 0.304362710767554
(weight=0.0769230769230769) * (score{udeprels}=0.945945945945946) = 0.0727650727650728
(TOTAL score=0.878499339641521) * (availability=1) * (validity=1) = 0.878499339641521
STARS = 4.5
UD_Western_Armenian-ArmTDP 0.878499339641521 4.5