Glossary · term

Deep Learning Is Hitting a Wall

Gary Marcus's essay in Nautilus arguing that scaling LLMs has fundamental limitations (compositionality, abstract reasoning, hallucinations). Cited pejoratively by scaling proponents, but Marcus's points (hallucinations, brittle reasoning) proved accurate. A symbol of rational skepticism toward AGI timelines.

Debate2022+ExternalMaturity: 3/5

Maturity rationale

Deep Learning Is Hitting a Wall — Marcus's canonical critical essay, 2022

References

Author: Gary Marcus