Instance of 'Analyzer' has no 'tokenizer' member

Question

tokens = self.tokenizer.tokenize(text)

I have the same code as in the walkthrough, yet I'm getting the error in the title.

Answer 1

You don't have a "thing" named tokenizer. Review the hints section of the spec:

Odds are you’ll find nltk.tokenize.casual.TweetTokenizer of interest, which can be used to tokenize a tweet (i.e., split it up into a list of words) with code like:

   tokenizer = nltk.tokenize.TweetTokenizer()  
   tokens = tokenizer.tokenize(tweet)