Table 4: 
Membership inference accuracy per subcorpus. The right-most 4 columns are results for out-of-domain subcorpora. Note that ParaCrawl is out-of-domain for Bob and his classifier, although it is in-domain for Alice and her MT model.
ParaCrawlCommonCrawlEuroparlNewsRapidEMEAKoranSubtitlesTED
50.0 50.0 50.0 50.0 50.0 100.0 100.0 100.0 100.0 
DT 50.3 51.1 49.7 50.7 50.0 67.2 94.1 80.2 67.1 
NB 50.1 51.2 49.9 50.6 50.2 69.5 96.1 81.7 70.5 
NN 49.4 50.7 50.3 49.7 49.2 43.3 52.6 48.7 49.9 
MLP 49.6 50.8 49.9 50.3 50.7 73.6 97.9 84.8 85.0 
ParaCrawlCommonCrawlEuroparlNewsRapidEMEAKoranSubtitlesTED
50.0 50.0 50.0 50.0 50.0 100.0 100.0 100.0 100.0 
DT 50.3 51.1 49.7 50.7 50.0 67.2 94.1 80.2 67.1 
NB 50.1 51.2 49.9 50.6 50.2 69.5 96.1 81.7 70.5 
NN 49.4 50.7 50.3 49.7 49.2 43.3 52.6 48.7 49.9 
MLP 49.6 50.8 49.9 50.3 50.7 73.6 97.9 84.8 85.0 
Close Modal

or Create an Account

Close Modal
Close Modal