Description
TABBIE is a pretraining objective (corrupt cell detection) that learns exclusively from tabular data. Unlike other approaches, TABBIE provides embeddings of all table substructures (cells, rows, and columns). TABBIE can be seen as a table embedding model trained to detect corrupted cells, inspired by the ELECTRA objective function.