Table 4
Isolated experiments. The subscript shows the parameters found on IN2EN-dev and used for IN2EN-test. The superscript shows the absolute test improvement over the ML2EN and the IN2EN baselines. Scores that are statistically significantly better than ML2EN and IN2EN (p < 0.01, Collins' sign test) are shown in bold and are underlined, respectively. The last line shows system combination results using MEMT.
| System | n-gram precision | BLEU | TER | METEOR | ||||
|---|---|---|---|---|---|---|---|---|
| 1-gr. | 2-gr. | 3-gr. | 4-gr. | |||||
| ML2EN (baseline) | 48.34 | 19.22 | 9.54 | 4.98 | 14.50 | 67.14 | 43.28 | |
| IN2EN (baseline) | 55.04 | 23.90 | 12.87 | 7.18 | 18.67 | 61.99 | 54.34 | |
| (i) | CN:word | 54.50 | 24.41 | 13.09 | 7.35 |  | 61.94 | 51.07 |
| CN:word′ | 55.05 | 25.09 | 13.60 | 7.69 |  | 61.25 | 51.97 | |
| CN:word′+morph | 55.97 | 25.73 | 14.06 | 7.99 |  | 60.31 | 55.65 | |
| (ii) | PPT:phrase1 | 55.11 | 25.04 | 13.66 | 7.80 |  | 60.92 | 51.93 |
| PPT:phrase4 | 56.64 | 26.20 | 14.53 | 8.40 |  | 59.33 | 54.23 | |
| PPT:phrase4::CN:morph | 56.91 | 26.53 | 14.76 | 8.55 |  | 59.30 | 57.19 | |
| (iii) | DD:word′ | 56.57 | 26.15 | 14.39 | 8.18 |  | 59.33 | 56.66 |
| DD:word′+morph | 56.74 | 26.22 | 14.41 | 8.18 |  | 59.50 | 56.89 | |
| DD:phrase4 | 57.14 | 26.49 | 14.72 | 8.49 |  | 58.79 | 57.33 | |
| DD:phrase4+morph | 57.35 | 26.71 | 14.92 | 8.63 |  | 58.55 | 57.53 | |
| System combination: (i)+(ii)+(iii) | 58.46 | 27.64 | 15.46 | 9.07 |  | 57.26 | 58.04 | |
| System | n-gram precision | BLEU | TER | METEOR | ||||
|---|---|---|---|---|---|---|---|---|
| 1-gr. | 2-gr. | 3-gr. | 4-gr. | |||||
| ML2EN (baseline) | 48.34 | 19.22 | 9.54 | 4.98 | 14.50 | 67.14 | 43.28 | |
| IN2EN (baseline) | 55.04 | 23.90 | 12.87 | 7.18 | 18.67 | 61.99 | 54.34 | |
| (i) | CN:word | 54.50 | 24.41 | 13.09 | 7.35 | | 61.94 | 51.07 |
| CN:word′ | 55.05 | 25.09 | 13.60 | 7.69 | | 61.25 | 51.97 | |
| CN:word′+morph | 55.97 | 25.73 | 14.06 | 7.99 | | 60.31 | 55.65 | |
| (ii) | PPT:phrase1 | 55.11 | 25.04 | 13.66 | 7.80 | | 60.92 | 51.93 |
| PPT:phrase4 | 56.64 | 26.20 | 14.53 | 8.40 | | 59.33 | 54.23 | |
| PPT:phrase4::CN:morph | 56.91 | 26.53 | 14.76 | 8.55 | | 59.30 | 57.19 | |
| (iii) | DD:word′ | 56.57 | 26.15 | 14.39 | 8.18 | | 59.33 | 56.66 |
| DD:word′+morph | 56.74 | 26.22 | 14.41 | 8.18 | | 59.50 | 56.89 | |
| DD:phrase4 | 57.14 | 26.49 | 14.72 | 8.49 | | 58.79 | 57.33 | |
| DD:phrase4+morph | 57.35 | 26.71 | 14.92 | 8.63 | | 58.55 | 57.53 | |
| System combination: (i)+(ii)+(iii) | 58.46 | 27.64 | 15.46 | 9.07 | | 57.26 | 58.04 | |