Glossary · term
Deep Learning Is Hitting a Wall
Gary Marcus's essay in Nautilus arguing that scaling LLMs has fundamental limitations (compositionality, abstract reasoning, hallucinations). Cited pejoratively by scaling proponents, but Marcus's points (hallucinations, brittle reasoning) proved accurate. A symbol of rational skepticism toward AGI timelines.
Debate2022+ExternalMaturity: 3/5
Maturity rationale
Deep Learning Is Hitting a Wall — Marcus's canonical critical essay, 2022
References
Author: Gary Marcus