TabFM-Auto: Self-Evolving Pipelines for Tabular Foundation Models
TabFM-Auto uses an agent to evolve data pipelines and leads TabArena and MLE-Bench tabular results.
TabFM-Auto pairs the tabular foundation model TabFM with a language-model agent that iteratively improves data cleaning, feature engineering, context selection, and post-processing using dataset metadata and validation feedback. Across all 51 TabArena datasets, five configurations occupy the top five overall ranks, and the best raises TabFM from 1785 to 2013 Elo. Discovered pipelines transfer to other frozen tabular foundation models for gains of +69 to +143 Elo without further search. On the eight tabular competitions in MLE-Bench, TabFM-Auto ranks first among MLE agents.
- A language-model agent evolves cleaning, features, context, and post-processing.
- Five TabFM-Auto setups take the top five spots on all 51 TabArena datasets.
- Best configuration lifts TabFM from 1785 to 2013 Elo.
- Pipelines transfer to other frozen tabular models for +69 to +143 Elo.
- Ranks first overall among MLE agents on eight MLE-Bench tabular contests.
- AI models
- TabFMTabFM-Auto
From the original article
1 min read at huggingface.coTabular foundation models achieve strong zero-shot accuracy on structured data by pretraining on synthetic tables, but they ignore the column names, task descriptions, and auxiliary files that carry dataset semantics.
By Deqing Fu, Huangyuan Su, Rajat Sen · huggingface.co
A short excerpt; the article and its images belong to the publisher. Summary, key facts and assessment above are AI-written from the article and can be wrong.