Percent of WMT systems using each optimization method, including all systems, or systems that achieved the best results on at least one language pair.
. | WMT All . | 2011 Best . | WMT All . | 2012 Best . | WMT All . | 2013 Best . | WMT All . | 2014 Best . |
---|---|---|---|---|---|---|---|---|
MERT | 80 | 100 | 79 | 100 | 68 | 25 | 63 | 50 |
MIRA | 0 | 0 | 0 | 0 | 20 | 75 | 27 | 50 |
Ranking | 0 | 0 | 4 | 0 | 8 | 0 | 5 | 0 |
Softmax | 3 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
Risk | 3 | 0 | 0 | 0 | 0 | 0 | 5 | 0 |
None | 17 | 0 | 17 | 0 | 4 | 0 | 0 | 0 |
. | WMT All . | 2011 Best . | WMT All . | 2012 Best . | WMT All . | 2013 Best . | WMT All . | 2014 Best . |
---|---|---|---|---|---|---|---|---|
MERT | 80 | 100 | 79 | 100 | 68 | 25 | 63 | 50 |
MIRA | 0 | 0 | 0 | 0 | 20 | 75 | 27 | 50 |
Ranking | 0 | 0 | 4 | 0 | 8 | 0 | 5 | 0 |
Softmax | 3 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
Risk | 3 | 0 | 0 | 0 | 0 | 0 | 5 | 0 |
None | 17 | 0 | 17 | 0 | 4 | 0 | 0 | 0 |