-
Notifications
You must be signed in to change notification settings - Fork 0
/
log.txt
86 lines (86 loc) · 3.25 KB
/
log.txt
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
2015/06/24 10:38:59
output dir exists: output/test
Running ngram for computing perplexities on input file:./input/target.word-level.ch with lm file: ./lang_resources/chinese/chinese_lm.lm
Executing: /export/tools/srilm/bin/i686-m64/ngram -lm ./lang_resources/chinese/chinese_lm.lm -order 3 -debug 1 -ppl ./input/target.word-level.ch > input/test/chinese/target.word-level.ch.ppl
Finished computing perplexities in 1.29 sec
Running ngram for computing perplexities on input file:./input/source.word-level.en with lm file: ./lang_resources/english/english_lm.lm
Executing: /export/tools/srilm/bin/i686-m64/ngram -lm ./lang_resources/english/english_lm.lm -order 3 -debug 1 -ppl ./input/source.word-level.en > input/test/english/source.word-level.en.ppl
Finished computing perplexities in 0.361 sec
Building the word model for the input file
10 words identified. Computing frequencies...
***********Initiating PosTagger***************
PosTagger parameters: type=source name:shef.mt.tools.PosTreeTagger
Executable: /export/tools/tree-tagger/tree-tagger-chinese
Input: /export/data/ghpaetzold/questplusplus/./input/target.word-level.ch
Output: /export/data/ghpaetzold/questplusplus/input/test/chinese/target.word-level.ch.pos
Running TreeTagger...
TreeTagger exited with exit value 0
TreeTagger completed in 0.45 sec
***********Initiating PosTagger***************
PosTagger parameters: type=target name:shef.mt.tools.PosTreeTagger
Executable: /export/tools/tree-tagger/cmd/tree-tagger-english-utf8
Input: /export/data/ghpaetzold/questplusplus/./input/source.word-level.en
Output: /export/data/ghpaetzold/questplusplus/input/test/english/source.word-level.en.pos
Running TreeTagger...
TreeTagger exited with exit value 0
TreeTagger completed in 0.257 sec
Running ngram for computing perplexities on input file:/export/data/ghpaetzold/questplusplus/input/test/english/source.word-level.en.pos.XPOS with lm file: ./lang_resources/english/pos_lm.en
Executing: /export/tools/srilm/bin/i686-m64/ngram -lm ./lang_resources/english/pos_lm.en -order 3 -debug 1 -ppl /export/data/ghpaetzold/questplusplus/input/test/english/source.word-level.en.pos.XPOS > /export/data/ghpaetzold/questplusplus/input/test/english/source.word-level.en.pos.XPOS.ppl
Finished computing perplexities in 0.017 sec
initiating Giza from file: ./lang_resources/giza/lex.c2e
Loading Giza...
Giza loaded in 0.19 sec
Loading language model...
Cut-off frequencies:
0-grams:
quartile 1: 4
quartile 2: 8
quartile 3: 22
quartile 4: 745817
1-grams:
quartile 1: 3
quartile 2: 5
quartile 3: 9
quartile 4: 481475
2-grams:
quartile 1: 3
quartile 2: 4
quartile 3: 7
quartile 4: 8007
Language model loaded in 0.186 sec
Loading language model...
Cut-off frequencies:
0-grams:
quartile 1: 4
quartile 2: 8
quartile 3: 22
quartile 4: 745817
1-grams:
quartile 1: 3
quartile 2: 5
quartile 3: 9
quartile 4: 481475
2-grams:
quartile 1: 3
quartile 2: 4
quartile 3: 7
quartile 4: 8007
Language model loaded in 0.171 sec
Loading language model...
Cut-off frequencies:
0-grams:
quartile 1: 4
quartile 2: 7
quartile 3: 18
quartile 4: 72549
1-grams:
quartile 1: 3
quartile 2: 5
quartile 3: 9
quartile 4: 8511
2-grams:
quartile 1: 3
quartile 2: 4
quartile 3: 6
quartile 4: 666
Language model loaded in 0.084 sec