TabFM-Auto: Self-Evolving Pipelines for Tabular Foundation Models
TabFM-Auto uses an agent to evolve data pipelines and leads TabArena and MLE-Bench tabular results.
TabFM-Auto pairs the tabular foundation model TabFM with a language-model agent that iteratively improves data cleaning, feature engineering, context selection, and post-processing using dataset metadata and validation feedback. Across all 51 TabArena datasets, five configurations occupy the top five overall ranks, and the best raises TabFM from 1785 to 2013 Elo. Discovered pipelines transfer to other frozen tabular foundation models for gains of +69 to +143 Elo without further search. On the eight tabular competitions in MLE-Bench, TabFM-Auto ranks first among MLE agents.