The Illusion of Replacement: Rethinking Specialized Machine Learning Models in the Foundation Model Era

A review of 159 papers across nine modalities shows that language-based models do not universally replace specialized machine learning architectures. Instead of…