GROUND TRUTH QUALITY FOR MACHINE LEARNING MODELS

摘要

Methods, systems and computer program products for improving ground truth quality for modeling are provided. Aspects include receiving a plurality of data inputs, wherein each of the plurality of data inputs has an associated label. Aspects also include training a model based on the plurality of data inputs. Aspects also include generating a plurality of vector representations corresponding to the plurality of data inputs based on the model. Aspects also include clustering the plurality of vector representations into one or more clusters. Aspects also include identifying at least one anomalous data input based on the one or more clusters. The at least one anomalous data input can be a data input of the plurality of data inputs that is mislabeled, contributes to an ambiguous class structure or is an outlier. Aspects also include outputting a notification that provides an indication of the at least one anomalous data input.