"Large Language Models Like GPT-4 and Claude 3 Excel in Regression Tasks, Surpass Traditional Methods, Finds New Study"

From Words to Numbers: Your Large Language Model Is Secretly A Capable Regressor When Given In-Context Examples

View PDF HTML (experimental) Abstract:We analyze how well pre-trained large language models (e.g., Llama2, GPT-4, Claude 3, etc) can do linear and non-linear regression when given in-context examples, without any additional training or gradient updates. Our findings reveal that several large language models (e.g., GPT-4, Claude 3) are able to perform regression tasks with a performance rivaling (or even outperforming) that of traditional supervised methods such as Random Forest, Bagging, or Grad...