How to get some specific real-time data from several websites continuously using Python (Django)?

Question

I am working on a web application that needs to pull data from other websites continuously. For example, the price of a product. If the price changes on the original website, my site's price will also be changed automatically.

Is it possible to scrape/pull/get data from other websites continuously like this?

you can't directly fetch the data from other websites, use their API. — Pankaj Sharma, Oct 28 '18 at 04:52
@PankajSharma Is it illegal to do or it's not entirely possible to do? Is it possible to fetch some specific data using URL parse? — sksoumik, Oct 28 '18 at 05:36

score -1 · Answer 1 · answered Oct 28 '18 at 04:27

-1

you can write a background job to fetch data from remote host every hour/minutes/... then update your data if changed.

answered Oct 28 '18 at 04:27

vorujack

1,778
16
22

How to get some specific real-time data from several websites continuously using Python (Django)?

1 Answers1