From 8c1958ce008086c621383bd33574231c91629fe8 Mon Sep 17 00:00:00 2001
From: Dmitri Soshnikov <dmitri@soshnikov.com>
Date: Wed, 30 Mar 2022 18:30:42 +0300
Subject: [PATCH] Add mindmap

---
 Mindmap.md                      | 49 -----------------------------
 README.md                       |  3 +-
 X-Extras/1-MultiModal/README.md |  6 ++++
 etc/Mindmap.html                | 25 +++++++++++++++
 etc/Mindmap.md                  | 56 +++++++++++++++++++++++++++++++++
 Mindmap.svg => etc/Mindmap.svg  |  0
 6 files changed, 89 insertions(+), 50 deletions(-)
 delete mode 100644 Mindmap.md
 create mode 100644 X-Extras/1-MultiModal/README.md
 create mode 100644 etc/Mindmap.html
 create mode 100644 etc/Mindmap.md
 rename Mindmap.svg => etc/Mindmap.svg (100%)

diff --git a/Mindmap.md b/Mindmap.md
deleted file mode 100644
index 7624cc72..00000000
--- a/Mindmap.md
+++ /dev/null
@@ -1,49 +0,0 @@
-# AI
-
-## Introduction to AI
- - [AI Definition](https://github.com/microsoft/AI-For-Beginners/blob/main/1-Intro/README.md#different-approaches-to-ai)
- - [History of AI](https://github.com/microsoft/AI-For-Beginners/blob/main/1-Intro/README.md#different-approaches-to-ai)
- - [Approaches to AI](https://github.com/microsoft/AI-For-Beginners/blob/main/1-Intro/README.md#different-approaches-to-ai)
-
-## Sybmbolic AI
- - Knowledge Representation
- - Expert Systems
-
-## [Neural Networks](https://github.com/microsoft/AI-For-Beginners/blob/main/3-NeuralNetworks/README.md)
- - [Perceptron](https://github.com/microsoft/AI-For-Beginners/blob/main/3-NeuralNetworks/03-Perceptron/README.md)
- - [Multi-Layered Networks](https://github.com/microsoft/AI-For-Beginners/blob/main/3-NeuralNetworks/04-OwnFramework/README.md)
- - [Intro to Frameworks](https://github.com/microsoft/AI-For-Beginners/blob/main/3-NeuralNetworks/05-Frameworks/README.md)
-   - [PyTorch](https://github.com/microsoft/AI-For-Beginners/blob/main/3-NeuralNetworks/05-Frameworks/IntroPyTorch.ipynb)
-   - [TensorFlow](https://github.com/microsoft/AI-For-Beginners/blob/main/3-NeuralNetworks/05-Frameworks/IntroKerasTF.md)
-   - [Overfitting](https://github.com/microsoft/AI-For-Beginners/blob/main/3-NeuralNetworks/05-Frameworks/Overfitting.md)
-
-## Computer Vision
- - Intro to CV. OpenCV
- - Convolutional Networks
-   - Training Tricks
-   - Architectures
- - Trasnsfer Learning
- - Autoencoders and VAEs
- - Generative Adversarial Networks
- - Object Detection
- - Segmentation
- 
-## Natural Language Processing
- - Text Representation
-    - Bag of Words
-    - TF/IDF
- - Semantic Embeddings
-    - Word2Vec
-    - GloVE
- - Language Modeling
- - Recurrent Neural Networks
- - Generative Recurrent Networks
- - Transformers and BERT
- - Named Entity Recognition
- - Text Generation and GPT
-## Other Techniques
- - Genetic Algorithms
- - Deep Reinforcement Learning
- - Multi-Agent Systems
-
-## AI Ethics
\ No newline at end of file
diff --git a/README.md b/README.md
index 29a7f28e..d5b85356 100644
--- a/README.md
+++ b/README.md
@@ -87,13 +87,14 @@ For a gentle introduction to *AI in the Cloud* topic you may consider taking the
 <tr><td>1</td><td>Multi-Modal Networks, CLIP and VQGAN</td><td><a href="X-Extras/1-MultiModal/README.md">Text</a></td><td></td><td></td><td></td></tr>
 </table>
 
+**[Mindmap of the Course](etc/Mindmap.html)**
+
 Each lesson contains some pre-reading material (linked as **Text** above), and some executable Jupyter Notebooks, which are often specific to the framework (**PyTorch** or **TensorFlow**). The executable notebook also contains a lot of theoretical material, so to understand the topic you need to go through at least one version of the notebooks (either PyTorch or TensorFlow). There are also **Labs** available for some topics, which give you an opportunity to try applying the material you have learnt to a specific problem. 
 
 Some sections also contain links to **MS Learn** modules that cover related topics. Microsoft Learn provides a convenient GPU-enabled learning environment, although in terms of content you can expect this curriculum to go a bit deeper.
 
 Course sections also include the links to **PAT**s - Progress Assessment Tool, a list of items that you are likely to get to know after completing the module. You can review it and assess your progress on the course yourself. 
 
-![Mindmap of the Course](Mindmap.svg)
 
 # Getting Started
 
diff --git a/X-Extras/1-MultiModal/README.md b/X-Extras/1-MultiModal/README.md
new file mode 100644
index 00000000..376b7164
--- /dev/null
+++ b/X-Extras/1-MultiModal/README.md
@@ -0,0 +1,6 @@
+# Multi-Modal Networks
+
+After the success of transformer models for solving NLP tasks, there were many attempts to apply the same or similar architectures to computer vision tasks. Also, there is a growing interest in building models that would *combine* vision and natural language capabilities. One of such attempts was done by OpenAI, which is called CLIP.
+
+## Contrastive Image Pre-Training (CLIP)
+
diff --git a/etc/Mindmap.html b/etc/Mindmap.html
new file mode 100644
index 00000000..c6cb35ac
--- /dev/null
+++ b/etc/Mindmap.html
@@ -0,0 +1,25 @@
+<!DOCTYPE html>
+<html>
+<head>
+<meta charset="UTF-8">
+<meta name="viewport" content="width=device-width, initial-scale=1.0">
+<meta http-equiv="X-UA-Compatible" content="ie=edge">
+<title>Markmap</title>
+<style>
+* {
+  margin: 0;
+  padding: 0;
+}
+#mindmap {
+  display: block;
+  width: 100vw;
+  height: 100vh;
+}
+</style>
+
+</head>
+<body>
+<svg id="mindmap"></svg>
+<script src="https://cdn.jsdelivr.net/npm/d3@6.7.0"></script><script src="https://cdn.jsdelivr.net/npm/markmap-view@0.2.7"></script><script>((c,d,p)=>{const{Markmap:g}=c();window.mm=g.create("svg#mindmap",d==null?void 0:d(),p)})(()=>window.markmap,c=>(c=c||window.d3,{color:(N=>E=>N(E.p.i))(c.scaleOrdinal(c.schemeCategory10))}),{"t":"heading","d":1,"p":{"lines":[0,1]},"v":"AI","c":[{"t":"heading","d":2,"p":{"lines":[2,3]},"v":"Introduction to AI","c":[{"t":"list_item","d":4,"p":{"lines":[3,4]},"v":"<a href=\"https://github.com/microsoft/AI-For-Beginners/blob/main/1-Intro/README.md#different-approaches-to-ai\">AI Definition</a>"},{"t":"list_item","d":4,"p":{"lines":[4,5]},"v":"<a href=\"https://github.com/microsoft/AI-For-Beginners/blob/main/1-Intro/README.md#different-approaches-to-ai\">History of AI</a>"},{"t":"list_item","d":4,"p":{"lines":[5,6]},"v":"<a href=\"https://github.com/microsoft/AI-For-Beginners/blob/main/1-Intro/README.md#different-approaches-to-ai\">Approaches to AI</a>"}]},{"t":"heading","d":2,"p":{"lines":[7,8]},"v":"Sybmbolic AI","c":[{"t":"list_item","d":4,"p":{"lines":[8,9]},"v":"Knowledge Representation"},{"t":"list_item","d":4,"p":{"lines":[9,10]},"v":"Expert Systems"}]},{"t":"heading","d":2,"p":{"lines":[11,12]},"v":"<a href=\"https://github.com/microsoft/AI-For-Beginners/blob/main/3-NeuralNetworks/README.md\">Neural Networks</a>","c":[{"t":"list_item","d":4,"p":{"lines":[12,13]},"v":"<a href=\"https://github.com/microsoft/AI-For-Beginners/blob/main/3-NeuralNetworks/03-Perceptron/README.md\">Perceptron</a>"},{"t":"list_item","d":4,"p":{"lines":[13,14]},"v":"<a href=\"https://github.com/microsoft/AI-For-Beginners/blob/main/3-NeuralNetworks/04-OwnFramework/README.md\">Multi-Layered Networks</a>"},{"t":"list_item","d":4,"p":{"lines":[14,15]},"v":"<a href=\"https://github.com/microsoft/AI-For-Beginners/blob/main/3-NeuralNetworks/05-Frameworks/README.md\">Intro to Frameworks</a>","c":[{"t":"list_item","d":6,"p":{"lines":[15,16]},"v":"<a href=\"https://github.com/microsoft/AI-For-Beginners/blob/main/3-NeuralNetworks/05-Frameworks/IntroPyTorch.ipynb\">PyTorch</a>"},{"t":"list_item","d":6,"p":{"lines":[16,17]},"v":"<a href=\"https://github.com/microsoft/AI-For-Beginners/blob/main/3-NeuralNetworks/05-Frameworks/IntroKerasTF.md\">TensorFlow</a>"},{"t":"list_item","d":6,"p":{"lines":[17,18]},"v":"<a href=\"https://github.com/microsoft/AI-For-Beginners/blob/main/3-NeuralNetworks/05-Frameworks/Overfitting.md\">Overfitting</a>"}]}]},{"t":"heading","d":2,"p":{"lines":[19,20]},"v":"<a href=\"https://github.com/microsoft/AI-For-Beginners/blob/main/4-ComputerVision/README.md\">Computer Vision</a>","c":[{"t":"list_item","d":4,"p":{"lines":[20,21]},"v":"Intro to CV. OpenCV"},{"t":"list_item","d":4,"p":{"lines":[21,22]},"v":"<a href=\"https://github.com/microsoft/AI-For-Beginners/blob/main/4-ComputerVision/07-ConvNets/README.md\">Convolutional Networks</a>","c":[{"t":"list_item","d":6,"p":{"lines":[22,23]},"v":"<a href=\"https://github.com/microsoft/AI-For-Beginners/blob/main/4-ComputerVision/07-ConvNets/CNN_Architectures.md\">Architectures</a>"}]},{"t":"list_item","d":4,"p":{"lines":[23,24]},"v":"<a href=\"https://github.com/microsoft/AI-For-Beginners/blob/main/4-ComputerVision/08-TransferLearning/README.md\">Trasnsfer Learning</a>","c":[{"t":"list_item","d":6,"p":{"lines":[24,25]},"v":"<a href=\"https://github.com/microsoft/AI-For-Beginners/blob/main/4-ComputerVision/08-TransferLearning/TrainingTricks.md\">Training Tricks</a>"}]},{"t":"list_item","d":4,"p":{"lines":[25,26]},"v":"<a href=\"https://github.com/microsoft/AI-For-Beginners/blob/main/4-ComputerVision/09-Autoencoders/README.md\">Autoencoders and VAEs</a>"},{"t":"list_item","d":4,"p":{"lines":[26,27]},"v":"<a href=\"https://github.com/microsoft/AI-For-Beginners/blob/main/4-ComputerVision/10-GANs/README.md\">Generative Adversarial Networks</a>"},{"t":"list_item","d":4,"p":{"lines":[27,28]},"v":"Object Detection"},{"t":"list_item","d":4,"p":{"lines":[28,29]},"v":"Segmentation"}]},{"t":"heading","d":2,"p":{"lines":[30,31]},"v":"<a href=\"https://github.com/microsoft/AI-For-Beginners/blob/main/5-NLP/README.md\">Natural Language Processing</a>","c":[{"t":"list_item","d":4,"p":{"lines":[31,32]},"v":"<a href=\"https://github.com/microsoft/AI-For-Beginners/blob/main/5-NLP/13-TextRep/README.md\">Text Representation</a>","c":[{"t":"list_item","d":6,"p":{"lines":[32,33]},"v":"Bag of Words"},{"t":"list_item","d":6,"p":{"lines":[33,34]},"v":"TF/IDF"}]},{"t":"list_item","d":4,"p":{"lines":[34,35]},"v":"<a href=\"https://github.com/microsoft/AI-For-Beginners/blob/main/5-NLP/14-Embeddings/README.md\">Semantic Embeddings</a>","c":[{"t":"list_item","d":6,"p":{"lines":[35,36]},"v":"Word2Vec"},{"t":"list_item","d":6,"p":{"lines":[36,37]},"v":"GloVE"}]},{"t":"list_item","d":4,"p":{"lines":[37,38]},"v":"<a href=\"https://github.com/microsoft/AI-For-Beginners/blob/main/5-NLP/15-LanguageModeling\">Language Modeling</a>"},{"t":"list_item","d":4,"p":{"lines":[38,39]},"v":"<a href=\"https://github.com/microsoft/AI-For-Beginners/blob/main/5-NLP/16-RNN/README.md\">Recurrent Neural Networks</a>","c":[{"t":"list_item","d":6,"p":{"lines":[39,40]},"v":"LSTM"},{"t":"list_item","d":6,"p":{"lines":[40,41]},"v":"GRU"}]},{"t":"list_item","d":4,"p":{"lines":[41,42]},"v":"<a href=\"https://github.com/microsoft/AI-For-Beginners/blob/main/5-NLP/17-GenerativeNetworks/README.md\">Generative Recurrent Networks</a>"},{"t":"list_item","d":4,"p":{"lines":[42,43]},"v":"<a href=\"https://github.com/microsoft/AI-For-Beginners/blob/main/5-NLP/18-Transformers/README.md\">Transformers and BERT</a>"},{"t":"list_item","d":4,"p":{"lines":[43,44]},"v":"Named Entity Recognition"},{"t":"list_item","d":4,"p":{"lines":[44,45]},"v":"Text Generation and GPT"}]},{"t":"heading","d":2,"p":{"lines":[45,46]},"v":"Other Techniques","c":[{"t":"list_item","d":4,"p":{"lines":[46,47]},"v":"<a href=\"https://github.com/microsoft/AI-For-Beginners/blob/main/6-Other/21-GeneticAlgorithms/README.md\">Genetic Algorithms</a>"},{"t":"list_item","d":4,"p":{"lines":[47,48]},"v":"Deep Reinforcement Learning"},{"t":"list_item","d":4,"p":{"lines":[48,49]},"v":"<a href=\"https://github.com/microsoft/AI-For-Beginners/blob/main/6-Other/23-MultiagentSystems/README.md\">Multi-Agent Systems</a>"}]},{"t":"heading","d":2,"p":{"lines":[50,51]},"v":"<a href=\"https://github.com/microsoft/AI-For-Beginners/blob/main/7-Ethics/README.md\">AI Ethics</a>"},{"t":"heading","d":2,"p":{"lines":[51,52]},"v":"Extras","c":[{"t":"list_item","d":4,"p":{"lines":[52,53]},"v":"Multimodal Networks","c":[{"t":"list_item","d":6,"p":{"lines":[53,54]},"v":"CLIP"},{"t":"list_item","d":6,"p":{"lines":[54,55]},"v":"DALL-E"},{"t":"list_item","d":6,"p":{"lines":[55,56]},"v":"VQ-GAN"}]}]}]})</script>
+</body>
+</html>
diff --git a/etc/Mindmap.md b/etc/Mindmap.md
new file mode 100644
index 00000000..b188841e
--- /dev/null
+++ b/etc/Mindmap.md
@@ -0,0 +1,56 @@
+# AI
+
+## Introduction to AI
+ - [AI Definition](https://github.com/microsoft/AI-For-Beginners/blob/main/1-Intro/README.md#different-approaches-to-ai)
+ - [History of AI](https://github.com/microsoft/AI-For-Beginners/blob/main/1-Intro/README.md#different-approaches-to-ai)
+ - [Approaches to AI](https://github.com/microsoft/AI-For-Beginners/blob/main/1-Intro/README.md#different-approaches-to-ai)
+
+## Sybmbolic AI
+ - Knowledge Representation
+ - Expert Systems
+
+## [Neural Networks](https://github.com/microsoft/AI-For-Beginners/blob/main/3-NeuralNetworks/README.md)
+ - [Perceptron](https://github.com/microsoft/AI-For-Beginners/blob/main/3-NeuralNetworks/03-Perceptron/README.md)
+ - [Multi-Layered Networks](https://github.com/microsoft/AI-For-Beginners/blob/main/3-NeuralNetworks/04-OwnFramework/README.md)
+ - [Intro to Frameworks](https://github.com/microsoft/AI-For-Beginners/blob/main/3-NeuralNetworks/05-Frameworks/README.md)
+   - [PyTorch](https://github.com/microsoft/AI-For-Beginners/blob/main/3-NeuralNetworks/05-Frameworks/IntroPyTorch.ipynb)
+   - [TensorFlow](https://github.com/microsoft/AI-For-Beginners/blob/main/3-NeuralNetworks/05-Frameworks/IntroKerasTF.md)
+   - [Overfitting](https://github.com/microsoft/AI-For-Beginners/blob/main/3-NeuralNetworks/05-Frameworks/Overfitting.md)
+
+## [Computer Vision](https://github.com/microsoft/AI-For-Beginners/blob/main/4-ComputerVision/README.md)
+ - Intro to CV. OpenCV
+ - [Convolutional Networks](https://github.com/microsoft/AI-For-Beginners/blob/main/4-ComputerVision/07-ConvNets/README.md)
+   - [Architectures](https://github.com/microsoft/AI-For-Beginners/blob/main/4-ComputerVision/07-ConvNets/CNN_Architectures.md)
+ - [Trasnsfer Learning](https://github.com/microsoft/AI-For-Beginners/blob/main/4-ComputerVision/08-TransferLearning/README.md)
+   - [Training Tricks](https://github.com/microsoft/AI-For-Beginners/blob/main/4-ComputerVision/08-TransferLearning/TrainingTricks.md)
+ - [Autoencoders and VAEs](https://github.com/microsoft/AI-For-Beginners/blob/main/4-ComputerVision/09-Autoencoders/README.md)
+ - [Generative Adversarial Networks](https://github.com/microsoft/AI-For-Beginners/blob/main/4-ComputerVision/10-GANs/README.md)
+ - Object Detection
+ - Segmentation
+ 
+## [Natural Language Processing](https://github.com/microsoft/AI-For-Beginners/blob/main/5-NLP/README.md)
+ - [Text Representation](https://github.com/microsoft/AI-For-Beginners/blob/main/5-NLP/13-TextRep/README.md)
+    - Bag of Words
+    - TF/IDF
+ - [Semantic Embeddings](https://github.com/microsoft/AI-For-Beginners/blob/main/5-NLP/14-Embeddings/README.md)
+    - Word2Vec
+    - GloVE
+ - [Language Modeling](https://github.com/microsoft/AI-For-Beginners/blob/main/5-NLP/15-LanguageModeling)
+ - [Recurrent Neural Networks](https://github.com/microsoft/AI-For-Beginners/blob/main/5-NLP/16-RNN/README.md)
+     - LSTM
+     - GRU
+ - [Generative Recurrent Networks](https://github.com/microsoft/AI-For-Beginners/blob/main/5-NLP/17-GenerativeNetworks/README.md)
+ - [Transformers and BERT](https://github.com/microsoft/AI-For-Beginners/blob/main/5-NLP/18-Transformers/README.md)
+ - Named Entity Recognition
+ - Text Generation and GPT
+## Other Techniques
+ - [Genetic Algorithms](https://github.com/microsoft/AI-For-Beginners/blob/main/6-Other/21-GeneticAlgorithms/README.md)
+ - Deep Reinforcement Learning
+ - [Multi-Agent Systems](https://github.com/microsoft/AI-For-Beginners/blob/main/6-Other/23-MultiagentSystems/README.md)
+
+## [AI Ethics](https://github.com/microsoft/AI-For-Beginners/blob/main/7-Ethics/README.md)
+## Extras
+ - Multimodal Networks
+   - CLIP
+   - DALL-E
+   - VQ-GAN
\ No newline at end of file
diff --git a/Mindmap.svg b/etc/Mindmap.svg
similarity index 100%
rename from Mindmap.svg
rename to etc/Mindmap.svg