4

I am looking to identify the most popular pages in a Wikipedia Category (for example, which graph algorithms had the highest page views in the last year?). However, there seems to be little up-to-date information of Wikipedia APIs, especially for obtaining statistics.

For example, the StackOverflow post on How to use Wikipedia API to get the page view statistics of a particular page in Wikipedia? contains answers that no longer seem to work.

I have dug around a bit, but I am unable to find any usable APIs, other than a really nice website, where I could potentially do this manually, by typing page titles one by one (max. up to ten pages only): https://tools.wmflabs.org/pageviews/. Would appreciate any help. Thanks!

Community
  • 1
  • 1
Karthik Raman
  • 103
  • 7
  • 3
    Well, I made a semi-automated effort to do the above, using the tools.wmflabs.org page: follow [this link](http://tools.wmflabs.org/pageviews/?project=en.wikipedia.org&platform=all-access&agent=user&start=2015-07-01&end=2016-06-30&pages=Dijkstra%27s_algorithm|A*_search_algorithm|Tree_traversal|Breadth-first_search|Travelling_salesman_problem|Depth-first_search|Minimax|Kruskal%27s_algorithm|Prim%27s_algorithm|Topological_sorting) to see the Top 10 Graph Algorithm Pages on Wikipedia! – Karthik Raman Jul 13 '16 at 11:01

2 Answers2

2

You can use a MediaWiki API call like this to get the titles in the category: https://en.wikipedia.org/w/api.php?action=query&list=categorymembers&cmtitle=Category:Physics Then you can use this to get page view statistics for each page: https://wikimedia.org/api/rest_v1/#!/Pageviews_data/get_metrics_pageviews_per_article_project_access_agent_article_granularity_start_end (careful of the rate limit)

E.g. for the last year, article "Physics" (part of the Physics category): https://wikimedia.org/api/rest_v1/metrics/pageviews/per-article/en.wikipedia.org/all-access/all-agents/Physics/daily/20151104/20161104

If you're dealing with large categories, it may be best to start downloading statistics from https://dumps.wikimedia.org/other/pageviews/2016/2016-11/ to avoid making so many REST API calls.

Krenair
  • 570
  • 5
  • 21
0

TreeViews is a tool designed to do exactly this. Getting good data is going to be hard if your category contains thousands of pages, in which case you'd better do the calculations yourself as Krenair suggests.

Nemo
  • 2,441
  • 2
  • 29
  • 63