-1

I have followed cloudera's tutorial (http://blog.cloudera.com/blog/2012/09/analyzing-twitter-data-with-hadoop/) for an application to ingest twitter data into HDFS using Apache Flume. Twitter has restricted its api connection to SSL/TLS only with effect from 15th January 2014. After this change my Flume agent has stopped streaming the twitter data. Kindly reply if you have already implemented the respective changes to cater for new requirements based on specs in follwoing article. https://dev.twitter.com/docs/security/using-ssl

Thanks, Hussnain

Hussnain
  • 186
  • 9
  • Post some code. If you followed some tutorial you should have written some code. – nestedloop Jan 16 '14 at 13:22
  • My flume.conf have following code for source \n TwitterAgent.sources.Twitter.type = com.cloudera.flume.source.TwitterSource TwitterAgent.sources.Twitter.channels = MemChannel TwitterAgent.sources.Twitter.consumerKey = TwitterAgent.sources.Twitter.consumerSecret = TwitterAgent.sources.Twitter.accessToken = TwitterAgent.sources.Twitter.accessTokenSecret = – Hussnain Jan 17 '14 at 05:35
  • TwitterSource file has following code for access
    public void configure(Context context) { consumerKey = context.getString(TwitterSourceConstants.CONSUMER_KEY_KEY); consumerSecret = context.getString(TwitterSourceConstants.CONSUMER_SECRET_KEY); accessToken = context.getString(TwitterSourceConstants.ACCESS_TOKEN_KEY); accessTokenSecret = context.getString(TwitterSourceConstants.ACCESS_TOKEN_SECRET_KEY); String keywordString = context.getString(TwitterSourceConstants.KEYWORDS_KEY, "");     – Hussnain Jan 17 '14 at 05:44
  • issue got resolved after I installed newer version of twitter4j i.e v 3.0.3 that is using HTTPS. For reference see
    http://jira.twitter4j.org/browse/TFJ-632
    and comments on
    http://www.datadansandler.com/2013/03/making-clouderas-twitter-stream-real.html     – Hussnain Jan 17 '14 at 06:02

1 Answers1

0

issue got resolved after I installed newer version of twitter4j i.e v 3.0.3 that is using HTTPS. For reference see
jira.twitter4j.org/browse/TFJ-632
and comments on

http://www.datadansandler.com/2013/03/making-clouderas-twitter-stream-real.html?showComment=1390047763159#c8713000610110252026

Hussnain
  • 186
  • 9