How to grab streaming data from twitter using nltk - regular expression

Question

I am newbie in Python and given a task from my boss to do this :

Grab streaming data from twitter in JSON
Parsing using NLTK and Regular Expression
Save it to file base or database file, ok

Is there anyone know how to grab a streaming data from twitter using the step above ?

Your help would be very grateful :)

if you're getting it as json why would you need regular expressions? — Ilia Choly, Jul 28 '11 at 02:00
no, that's not how this site works. Edit your question with new information. — Ilia Choly, Jul 28 '11 at 03:27

score 2 · Answer 1 · answered Jul 28 '11 at 01:56

2

A quick Google search yields Tweepy, which is a python library for accessing the Twitter API. This should get you started. In terms of parsing the data, you'll need to be a little more specific as to what you want to parse.

answered Jul 28 '11 at 01:56

kjakeb

6,810
5
20
34

score 1 · Answer 2 · answered Jul 28 '11 at 02:15

This should point you in the right direction

import urllib2, simplejson

json = urllib2.urlopen('http://search.twitter.com/search.json?q=from%3Aalexiskold').read()
tweets = simplejson.loads(json)["results"]
for tweet in tweets: print tweet["text"]

it wouldn't eval so i used simplejson http://simplejson.github.com/simplejson/

score 0 · Answer 3 · edited May 23 '17 at 12:26

0

You posted the same question twice, appearently: I answered in the other post. How to grab streaming data from twitter connect with pycurl using nltk - regular expression

edited May 23 '17 at 12:26

Community

1
1

answered Aug 08 '11 at 09:56

Savino Sguera

3,522
21
20

How to grab streaming data from twitter using nltk - regular expression

3 Answers3