Pietro Barbiero, Giovanni Squillero, Alberto Tonda
A coreset is a subset of the training set, using which a machine learning algorithm obtains performances similar to what it would deliver if trained over the whole original data. Coreset discovery is an active and open line of research as it allows improving training speed for the algorithms and may help human understanding the results. Building on previous works, a novel approach is presented: candidate corsets are iteratively optimized, adding and removing samples. As there is an obvious trade-off between limiting training size and quality of the results, a multi-objective evolutionary algorithm is used to minimize simultaneously the number of points in the set and the classification error. Experimental results on non-trivial benchmarks show that the proposed approach is able to deliver results that allow a classifier to obtain lower error and better ability of generalizing on unseen data than state-of-the-art coreset discovery techniques.
| Task | Dataset | Metric | Value | Model |
|---|---|---|---|---|
| Core set discovery | Glass identification | F1(10-fold) | 64.3 | EvoCore |
| Core set discovery | Abalone | F1(10-fold) | 18.6 | EvoCore |
| Core set discovery | Amazon-employee-access | F1(10-fold) | 91.5 | EvoCore |
| Core set discovery | micro-mass | F1(10-fold) | 83.9 | EvoCore |
| Core set discovery | MNIST | F1(10-fold) | 77.2 | EvoCore |
| Core set discovery | Mozilla4 | F1(10-fold) | 91.2 | EvoCore |
| Core set discovery | ISOLET | F1(10-fold) | 90.5 | EvoCore |
| Core set discovery | Electricity | F1(10-fold) | 69.3 | EvoCore |
| Core set discovery | Letter | F1(10-fold) | 65.9 | EvoCore |
| Core set discovery | Soybean | F1(10-fold) | 91.1 | EvoCore |
| Core set discovery | UCI GAS | F1(10-fold) | 94.6 | EvoCore |
| Core set discovery | Kr-vs-kp | F1(10-fold) | 93.7 | EvoCore |
| Core set discovery | JM1 | F1(10-fold) | 77.1 | EvoCore |
| Core set discovery | Credit-g | F1(10-fold) | 74.3 | EvoCore |