Atlas · GenAI 2026

NLP

NLP foundations (tokenization, embeddings, semantic similarity)

conceptPeak: 2019NLP FoundationsAI consensus: 2/3

Prerequisites

  • Embeddings ARE vectors; cosine similarity IS a dot product; tokenization maps to vocabulary indices — NLP is applied linear algebra

Recommended reference

Jurafsky & Martin (2024) Speech and Language Processing, 3rd ed. draft — free at web.stanford.edu/~jurafsky/slp3; Ch.6 on embeddings, Ch.2 on tokenization

Notes from AI deep research

Anthropic Opus

Jurafsky & Martin SLP3 = biblia. Tokenizacja, embeddingi, similarity — fundament RAG

OpenAI Deep Research

Podstawa RAG; chunking, dystanse, jakość [OA#6]

Google Deep Think

Tokenizacja jako fundament [G implied]

Related skills