colly is a web scraping framework written in Go. Import it as https://github.com/gocolly/colly. You will typically use this tag together with the main tag [go].
Questions tagged [go-colly]
63 questions
0
votes
1 answer
gocolly: How to Prevent duplicate crawling, restrict to unique url crawling ONCE
I was experimenting with go-colly with below code, it seems to crawl same url multiple times, how do I restrict to one time crawling?
I suspected the 'Parallellsim:2' was causing the duplicates, however, some of the crawl message urls repeated more…
Espresso
- 5,378
- 4
- 35
- 66
-1
votes
1 answer
Click Button/Dropdown using Colly | Golang
Is there a way to "click" a button using colly in go?
I basically need scrape data from a dynamic website, e.g. "open a dropdown", klick on different options so that other parts of the website update.
This can be easily done using Python / Selenium…
fxmb
- 23
- 6
-3
votes
2 answers
Printing 2 statements on the same line
I've successfully made a scraper that scrapes all 109 pages of the iPhone section on eBay.
The problem is that I need them to print on the same line. This is what it currently looks like
package main
import (
"fmt"
…
goggins
- 33
- 5