Why is NLTK so slow people

AMZN small instance (snail style)

 ### Took 92.35s to parse 10005 words 351 sentences (76.64% passed.) 0.26s per sentence.

Mac Pro

### Took 26.47s to parse 10005 words 351 sentences (76.64% passed.) 0.08s per sentence.

Where “parse” is pos_tag, an NP chunker (RegexpParser w/ our own grammar.) Most of the work is in pos_tag.

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s