Lecture word embeddings (#68)

pkeilbach · Jan 15, 2024 · eacd897 · eacd897
1 parent d27e2a0
commit eacd897
Show file tree

Hide file tree

Showing 10 changed files with 1,950 additions and 0 deletions.
diff --git a/docs/img/word-embeddings-cbow-architecture.drawio.svg b/docs/img/word-embeddings-cbow-architecture.drawio.svg
diff --git a/docs/img/word-embeddings-cbow-schema.drawio.svg b/docs/img/word-embeddings-cbow-schema.drawio.svg
diff --git a/docs/img/word-embeddings-cbow-transformation.drawio.svg b/docs/img/word-embeddings-cbow-transformation.drawio.svg
diff --git a/docs/img/word-embeddings-cbow.drawio.svg b/docs/img/word-embeddings-cbow.drawio.svg
diff --git a/docs/img/word-embeddings-one-hot-encoding-distance.png b/docs/img/word-embeddings-one-hot-encoding-distance.png
diff --git a/docs/img/word-embeddings-process.drawio.svg b/docs/img/word-embeddings-process.drawio.svg
diff --git a/docs/img/word-embeddings.drawio.svg b/docs/img/word-embeddings.drawio.svg
diff --git a/docs/lectures/language_models.md b/docs/lectures/language_models.md
@@ -49,6 +49,8 @@ A text corpus is a large and structured **set of texts**, such as:
 - Blog posts
 - Tweets
 
+A corpus can be **general**, such as Wikipedia or news articles, or it can be **domain specific**, such as medical texts or legal documents.
+
 !!! note "Vocabulary size vs. corpus size"
 
  Note that the **vocabulary size** $|V|$ is the number of unique words in the corpus, whereas the **corpus size** $|C|$ is the total number of words in the corpus.

diff --git a/docs/lectures/word_embeddings.md b/docs/lectures/word_embeddings.md
diff --git a/mkdocs.yml b/mkdocs.yml
@@ -62,6 +62,7 @@ nav:
  - lectures/vector_space_models.md
  - lectures/minimum_edit_distance.md
  - lectures/language_models.md
+ - lectures/word_embeddings.md
  - Assignments: assignments.md
  - Presentations:
  - presentations/presentations.md