Python website source extraction

Question

i'm using urllib2 to download the source of a website, but something is going wrong. The source comes from this website: http://www.starfm.com/ All i want to do is to download the entire html , and then parse it extracting the "Now playing" section from the website.

But, when i download the source with this code

response = urllib2.urlopen('http://www.starfm.com/')
html = response.read()
a = open("C:\\users\\Leonardo\\Desktop\\source.txt","w")
a.write(html)
a.close()

the final source does not show the current artist in the website's "Now playing" section.

Why? What should i do?

Thanks so much in advance.

-Leonardo

You missed the brackets on `a.close`. It should be `a.close()`. — anon582847382, Mar 30 '14 at 20:48
Just copied from last command line try, the original source has brackets. — user3423076, Mar 30 '14 at 20:53
Visit that page with JavaScript disabled on your browser and you will answer your own question. — Two-Bit Alchemist, Mar 30 '14 at 20:56
Yes i know that the problem is javascript, but i've tried with libs like http://phantomjs.org/quick-start.html or http://jeanphix.me/Ghost.py/ and i was not able to do anything. Could anyone tell me where am i doing wrong? — user3423076, Mar 30 '14 at 21:09

score 0 · Accepted Answer · edited May 23 '17 at 12:20

0

"now playing" comes from javascript, maybe it loads that info on the onload() event , in this case your code is just reading the content.

maybe this question will help you

Get page generated with Javascript in Python

edited May 23 '17 at 12:20

Community

1
1

answered Mar 30 '14 at 21:35

Geoffrey-ap

380
3
12

Python website source extraction

1 Answers1