Questions tagged [token]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0
votes
1answer
43 views

Tokenizer adds space before text

When I tokenize my text, it is adding a space before it, and I am unable to strip it. tokenizer = nltk.tokenize.TweetTokenizer() tokens = tokenizer.tokenize(text) x = 0 for i in tokens: token = ...
0
votes
1answer
208 views

pset6 sentiments PYTHON analyze

Hello stack overflow I am really having trouble with sentiments as I feel like I put the write functions down but it is not working. A question that I have is can someone help me understand how the ...
3
votes
1answer
953 views

Instance of 'Analyzer' has no 'tokenizer' member

tokens = self.tokenizer.tokenize(text) I have the same code as in the walkthrough, yet I'm getting the error in the title.
0
votes
1answer
245 views

Pset7 phpmyadmin token mismatch error

I'm unable to proceed with pset7 due to this issue, it seems I'm not the only one. I've tried everything I've found in forums. I'm using chrome. I've downgraded to CS50 IDE 57. Changed the timeout ...