import nemo error

[X10nD]

I am a beginner. Please let me know why the errors are coming

OS: Win 10

Jupyter import errors:

---

ModuleNotFoundError Traceback (most recent call last)
in
----> 1 import nemo
2 import nemo.collections.asr
3 import collections.nlp
4 import collections.tts

~\Downloads\nemo.py in
1 import nemo
2 # Import Speech Recognition collection
----> 3 import nemo.collections.asr as nemo_asr
4 # Import Natural Language Processing collection
5 import nemo.collections.nlp as nemo_nlp

ModuleNotFoundError: No module named 'nemo.collections'; 'nemo' is not a package

### CLI Import errors

import nemo
import nemo.collections.asr as nemo_asr
[NeMo W 2021-04-14 09:55:19 optimizers:46] Apex was not found. Using the lamb optimizer will error out.
Traceback (most recent call last):
File "C:\Program Files\Python37\lib\tempfile.py", line 258, in _mkstemp_inner
fd = _os.open(file, flags, 0o600)
PermissionError: [Errno 13] Permission denied: 'C:\Program Files\Python37\lib\site-packages\librosa\util\pycache\tmp0umeblet'

During handling of the above exception, another exception occurred:

[ericharper]

Hi, we only support MacOS and Linux. Linux is the main platform for using NeMo.

[X10nD]

Here is an entry from linux cli

import nemo
import nemo.collections.asr
import collections.nlp
Traceback (most recent call last):
File "", line 1, in
ModuleNotFoundError: No module named 'collections.nlp'
import collections.tts
Traceback (most recent call last):
File "", line 1, in
ModuleNotFoundError: No module named 'collections.tts'

same error as win 10..

how about support?

[titu1994]

Did you do pip install nemo_toolkit[all] in Linux? The collections are installed optionally, they are not part of the main install so you can chose which collection you would like to install.

[X10nD]

After pip install nemo_toolkit[all] on win and linux:

note the error on jupyter below, if theres an apex install, pls provide the link

LINUX

import nemo
import nemo.collections.asr
################################################################################
WARNING, path does not exist: KALDI_ROOT=/mnt/matylda5/iveselyk/Tools/kaldi-trunk
(please add 'export KALDI_ROOT=<your_path>' in your $HOME/.profile)
(or run as: KALDI_ROOT=<your_path> python <your_script>.py)
################################################################################

[NeMo W 2021-04-20 10:39:07 audio_preprocessing:56] Could not import torchaudio. Some features might not work.

import nemo.collections.nlp
Traceback (most recent call last):
File "", line 1, in
File "/home/j/.local/lib/python3.8/site-packages/nemo/collections/nlp/init.py", line 17, in
from nemo.collections.nlp import callbacks, data, nm, utils
File "/home/j/.local/lib/python3.8/site-packages/nemo/collections/nlp/callbacks/init.py", line 22, in
from nemo.collections.nlp.callbacks.machine_translation_callback import *
File "/home/j/.local/lib/python3.8/site-packages/nemo/collections/nlp/callbacks/machine_translation_callback.py", line 21, in
from nemo.collections.nlp.metrics.sacrebleu import corpus_bleu
File "/home/j/.local/lib/python3.8/site-packages/nemo/collections/nlp/metrics/sacrebleu.py", line 59, in
from nemo.collections.nlp.data.tokenizers.fairseq_tokenizer import tokenize_en
File "/home/j/.local/lib/python3.8/site-packages/nemo/collections/nlp/data/init.py", line 17, in
from nemo.collections.nlp.data.datasets import *
File "/home/j/.local/lib/python3.8/site-packages/nemo/collections/nlp/data/datasets/init.py", line 34, in
from nemo.collections.nlp.data.datasets.qa_squad_dataset.qa_squad_dataset import SquadDataset
File "/home/j/.local/lib/python3.8/site-packages/nemo/collections/nlp/data/datasets/qa_squad_dataset/qa_squad_dataset.py", line 33, in
from nemo.collections.nlp.metrics.squad_metrics import (
File "/home/j/.local/lib/python3.8/site-packages/nemo/collections/nlp/metrics/squad_metrics.py", line 21, in
from transformers.tokenization_bert import BasicTokenizer
ModuleNotFoundError: No module named 'transformers.tokenization_bert'

WIN

import nemo
import nemo.collections.asr as nemo_asr
[NeMo W 2021-04-20 10:49:40 optimizers:46] Apex was not found. Using the lamb optimizer will error out.
Traceback (most recent call last):
File "C:\Program Files\Python37\lib\tempfile.py", line 258, in _mkstemp_inner
fd = _os.open(file, flags, 0o600)
PermissionError: [Errno 13] Permission denied: 'C:\Program Files\Python37\lib\site-packages\librosa\util\pycache\tmppspt2w3m'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "", line 1, in
File "C:\Users\J\AppData\Roaming\Python\Python37\site-packages\nemo\collections\asr_init_.py", line 15, in
from nemo.collections.asr import data, losses, models, modules
File "C:\Users\J\AppData\Roaming\Python\Python37\site-packages\nemo\collections\asr\models_init_.py", line 16, in
from nemo.collections.asr.models.classification_models import EncDecClassificationModel
File "C:\Users\J\AppData\Roaming\Python\Python37\site-packages\nemo\collections\asr\models\classification_models.py", line 31, in
from nemo.collections.asr.parts.features import WaveformFeaturizer
File "C:\Users\J\AppData\Roaming\Python\Python37\site-packages\nemo\collections\asr\parts\features.py", line 37, in
import librosa
File "C:\Program Files\Python37\lib\site-packages\librosa_init_.py", line 211, in
from . import core
File "C:\Program Files\Python37\lib\site-packages\librosa\core_init_.py", line 5, in
from .convert import * # pylint: disable=wildcard-import
File "C:\Program Files\Python37\lib\site-packages\librosa\core\convert.py", line 7, in
from . import notation
File "C:\Program Files\Python37\lib\site-packages\librosa\core\notation.py", line 8, in
from ..util.exceptions import ParameterError
File "C:\Program Files\Python37\lib\site-packages\librosa\util_init_.py", line 83, in
from .utils import * # pylint: disable=wildcard-import
File "C:\Program Files\Python37\lib\site-packages\librosa\util\utils.py", line 1848, in
def __shear_dense(X, factor=+1, axis=-1):
File "C:\Program Files\Python37\lib\site-packages\numba\core\decorators.py", line 214, in wrapper
disp.enable_caching()
File "C:\Program Files\Python37\lib\site-packages\numba\core\dispatcher.py", line 812, in enable_caching
self._cache = FunctionCache(self.py_func)
File "C:\Program Files\Python37\lib\site-packages\numba\core\caching.py", line 610, in init
self._impl = self._impl_class(py_func)
File "C:\Program Files\Python37\lib\site-packages\numba\core\caching.py", line 343, in init
locator = cls.from_function(py_func, source_path)
File "C:\Program Files\Python37\lib\site-packages\numba\core\caching.py", line 193, in from_function
self.ensure_cache_path()
File "C:\Program Files\Python37\lib\site-packages\numba\core\caching.py", line 120, in ensure_cache_path
tempfile.TemporaryFile(dir=path).close()
File "C:\Program Files\Python37\lib\tempfile.py", line 547, in NamedTemporaryFile
(fd, name) = _mkstemp_inner(dir, prefix, suffix, flags, output_type)
File "C:\Program Files\Python37\lib\tempfile.py", line 258, in _mkstemp_inner
fd = _os.open(file, flags, 0o600)
KeyboardInterrupt

import nemo.collections.nlp as nlp
No CUDA runtime is found, using CUDA_HOME='C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v11.2'

JUPYTER

import nemo
import nemo.collections.asr as nemo_asr
import nemo.collections.nlp as nlp

[NeMo W 2021-04-20 10:53:18 optimizers:46] Apex was not found. Using the lamb optimizer will error out.

[X10nD]

Selecting my question is the answer?

[X10nD]

Well whats the solution??

[X10nD]

There seems to be no solutions that is why you arent reply?

[X10nD]

Adding to the above, the strike out appeared when I hit reply, its a legit install and not a strikeout

[titu1994]

The first install is wrong, the second is correct. At this point, I don't know what's going on. You might have multiple python installed, and you do pip3 install so it gets installed there. Are you sure you can run any of the example scripts using python3? Are you sure your ipython/Jupiter notebook is using the correct python installation. Beyond this, I can't think of any reason why it won't work.

The colab notebooks are another option, but having a local installation is good to run longer experiments.

[X10nD]

I dont know what is wrong so I approached you but you seemed to not know what is wrong either.

j@X:~$ python3 --version
Python 3.8.5

screenshot of jupyter installed locally running just fine.

[X10nD]

Do you have a particular script for me to execute so you could know what is wrong?

[titu1994]

These are colab tutorials - https://docs.nvidia.com/deeplearning/nemo/user-guide/docs/en/r1.0.0rc1/starthere/tutorials.html

After following tutorials you can try the example scripts here - and try on some toy dataset like AN 4. https://github.com/NVIDIA/NeMo/tree/main/examples/asr