Questions tagged [sentencepiece]
21 questions
0
votes
0 answers
ImportError: CamembertTokenizer requires the SentencePiece library but it was not found in your environment
I try to create a .exe from a Python code. Here is my .spec:
# -*- mode: python ; coding: utf-8 -*-
from PyInstaller.utils.hooks import copy_metadata
datas = [("C:/Users/pierr/OneDrive/Bureau/Projet_perso/Traitement BPU 2.1/BT42.xlsx","."),
…
pierrevslouis
- 11
- 2
0
votes
0 answers
_sentencepiece.SentencePieceProcessor_LoadFromFile No such file or directory
I'm trying to run script of deepparse NN.
But got this mistake.
_sentencepiece.SentencePieceProcessor_LoadFromFile(self, arg)
OSError: Not found: "C:\Users\MyUserName\.cache\deepparse\multi\multi.wiki.bpe.vs100000.model": No such file or…
MR.Max
- 36
- 4
0
votes
0 answers
TypeError: 'NoneType' object is not callable. Pegasus Tokenizer
Getting the error "TypeError: 'NoneType' object is not callable", even after running "pip install sentencepiece".
TypeError Traceback (most recent call last)
in
3…
Ashutosh mondal
- 1
- 1
0
votes
0 answers
Load tokenizer from .model and .vocab files
I trained a sentencepiece tokenizer, but can't seem to be able to load it using BertTokenizer.from_pretrained('/path to .model file'). The directory I saved the sentencepiece tokenizer contains a .model and .vocab file only.
GradStudent
- 166
- 1
- 3
- 12
0
votes
0 answers
RuntimeError: Graph is finalized and cannot be modified
After running below sample:
def embed_muse(module):
with tf.Graph().as_default():
sentences = tf.placeholder(tf.string)
embed = hub.load(module)
embeddings = embed(sentences)
session = tf.train.MonitoredSession()
…
Sweety Tripathi
- 25
- 6