Working with small data sets is much harder than working with big data sets. Even with small labeling errors, the impact on the data set can be significant.