RomanNum3ral
/
AI-For-Beginners
mirror of https://github.com/microsoft/AI-For-Beginners.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity

Merge pull request #256 from gurjot03/patch-1 

Update README.md of NLP lesson
This commit is contained in:
Pikachú 2024-05-29 18:14:18 +03:00 committed by GitHub
parent d5c968eacf 54d8d1a33f
commit fda65ecde6
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 7 additions and 5 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

12
lessons/5-NLP/README.md
View File

@ -39,11 +39,13 @@ pip install -r requirements-tf.txt
## GPU Warning
In this section, in some of the examples we will be training quite large models. It is advisable to run notebooks on GPU-enabled computer to minimize waiting time.
When running on GPU, you may experience situations when you run out of GPU memory. During training, the amount of GPU memory consumed depends on many factors, including the minibatch size. If you experience any memory problems - you may try to minimize the minibatch size in the code.
Also, some older versions of TensorFlow do not release GPU memory correctly if you are training multiple models in one Python kernel. In order to use GPU memory cautiously, you may set TensorFlow option to grow GPU memory allocation only when required. You would need to include the following code in your notebooks:
In this section, in some of the examples we will be training quite large models.
* **Use a GPU-Enabled Computer**: It's advisable to run your notebooks on a GPU-enabled computer to reduce waiting times when working with large models.
* **GPU Memory Constraints**: Running on a GPU may lead to situations where you run out of GPU memory, especially when training large models.
* **GPU Memory Consumption**: The amount of GPU memory consumed during training depends on various factors, including the minibatch size.
* **Minimize Minibatch Size**: If you encounter GPU memory issues, consider reducing the minibatch size in your code as a potential solution.
* **TensorFlow GPU Memory Release**: Older versions of TensorFlow may not release GPU memory correctly when training multiple models within one Python kernel. To manage GPU memory usage effectively, you can configure TensorFlow to allocate GPU memory only as needed.
* **Code Inclusion**: To set TensorFlow to grow GPU memory allocation only when required, include the following code in your notebooks:
```python
physical_devices = tf.config.list_physical_devices('GPU')