Skip to Main Content
Table 2 

Comparison of different evaluation methods for tweet classification with different feature combinations. Standard deviations are given in parentheses when applicable.

Features10-Fold CVBorder CVNeighborTimeTime-Border
Disaster or Not 
 Unigram 86.2 (±1.9) 76.3 (±14.4) 89.8 78.5 78.9 
 Unigram+Hashtag 92.8 (±0.9) 81.8 (±14.6) 89.7 80.1 77.5 
 Unigram+Hashtag Count 87.9 (±1.5) 79.3 (±12.3) 85.1 82.0 81.6 
 Unigram+Mention 86.6 (±1.7) 74.8 (±19.1) 89.7 78.8 79.0 
 Unigram+Hashtag Count+Mention Count+Link 88.0 (±1.4) 78.9 (±12.6) 85.2 82.0 81.4 
 Unigram+Bigram 86.5 (±1.3) 74.4 (±16.7) 89.8 78.5 78.6 
 Unigram+Bigram+Hashtag 92.3 (±1.0) 79.5 (±16.6) 90.0 77.3 73.7 
 
Disaster Type 
 Unigram 83.4 (±1.8) 66.8 (±20.4) 85.4 68.9 69.0 
 Unigram+Hashtag 92.7 (±1.1) 79.4 (±17.7) 89.4 77.8 74.5 
 Unigram+Hashtag Count 84.3 (±1.5) 67.1 (±20.9) 81.4 68.6 67.5 
 Unigram+Mention 83.9 (±1.6) 66.9 (±20.3) 85.5 69.1 68.2 
 Unigram+Hashtag Count+Mention Count+Link 84.4 (±1.6) 66.7 (±20.9) 81.4 68.0 67.0 
 Unigram+Bigram 83.0 (±1.7) 63.8 (±24.9) 88.5 66.7 65.8 
 Unigram+Bigram+Hashtag 91.1 (±1.0) 73.5 (±21.2) 88.3 72.0 69.4 
Features10-Fold CVBorder CVNeighborTimeTime-Border
Disaster or Not 
 Unigram 86.2 (±1.9) 76.3 (±14.4) 89.8 78.5 78.9 
 Unigram+Hashtag 92.8 (±0.9) 81.8 (±14.6) 89.7 80.1 77.5 
 Unigram+Hashtag Count 87.9 (±1.5) 79.3 (±12.3) 85.1 82.0 81.6 
 Unigram+Mention 86.6 (±1.7) 74.8 (±19.1) 89.7 78.8 79.0 
 Unigram+Hashtag Count+Mention Count+Link 88.0 (±1.4) 78.9 (±12.6) 85.2 82.0 81.4 
 Unigram+Bigram 86.5 (±1.3) 74.4 (±16.7) 89.8 78.5 78.6 
 Unigram+Bigram+Hashtag 92.3 (±1.0) 79.5 (±16.6) 90.0 77.3 73.7 
 
Disaster Type 
 Unigram 83.4 (±1.8) 66.8 (±20.4) 85.4 68.9 69.0 
 Unigram+Hashtag 92.7 (±1.1) 79.4 (±17.7) 89.4 77.8 74.5 
 Unigram+Hashtag Count 84.3 (±1.5) 67.1 (±20.9) 81.4 68.6 67.5 
 Unigram+Mention 83.9 (±1.6) 66.9 (±20.3) 85.5 69.1 68.2 
 Unigram+Hashtag Count+Mention Count+Link 84.4 (±1.6) 66.7 (±20.9) 81.4 68.0 67.0 
 Unigram+Bigram 83.0 (±1.7) 63.8 (±24.9) 88.5 66.7 65.8 
 Unigram+Bigram+Hashtag 91.1 (±1.0) 73.5 (±21.2) 88.3 72.0 69.4 
Close Modal

or Create an Account

Close Modal
Close Modal