Stack Overflow
Stack Overflow

Questions tagged [ironwebscraper]

7 questions
1
vote
1 answer

Unable to locate or select a select element from dropdown menu with Selenium - element not visible

edited: [https://www.bellsofsteel.us/checkout/][1] I'm unable to locate or select an option from a drop-down menu using selenium. I'm attempting to get the various taxes and shipping for an item, by iterating through a list with cities, states and…
pedro flores
  • 27
  • 4
1
vote
0 answers

Web scraping using Octoparse

I have been trying to use Octoparse to scrape data from a particular webpage. It has a total of 361 pages and 10 data rows on each page (total of 3610 data points). However, what I get is only 3260 data points. Normally the process works fine and…
Anthony Nguyen
  • 27
  • 5
0
votes
1 answer

Looking for a way to capture the updated text of an element after input with Selenium

I've been creating a webscraper with selenium that will select several items, fill a cart, and then cycle through a list of zip codes, cities, and states to calculate the total cost + shipping + tax for a variety of locations. The scraper has been…
PeterFonteneau
  • 55
  • 9
0
votes
0 answers

Python web scrapping - Len(containers) returns 0 when I add class or id

I am trying my first web scraping project in Jupyter notebook. When I try to find just div with the find_all function, It works well and returns the real length of containers. all_page = doc.find_all('div') len(all_page) The answer is 262. But,…
Khyati
  • 3
  • 3
0
votes
1 answer

C# IronWebScraper can iterate but unable to access one element at a time

The webscraper from the library works in htmlnodes, it's hard to explain but I am sort of scraping a tag and then the inside and I want to handle the inside like an array, which it is by default in this library but the issue is, I can iterate over…
David Shnayder
  • 333
  • 4
  • 14
0
votes
1 answer

How to continue scraping the next URL if one URL is return a 404 when using IronWebScraper

I'm building a small scraper that navigates through a set of URL. Currently I've something like: public class MyScraper: WebScraper{ private Queue _urlToParse = new Queue(); public override void Init(){ …
J4N
  • 19,480
  • 39
  • 187
  • 340
-2
votes
2 answers

Best way to scrape job details from job descriptions

New to web scrapers and I prefer to use Python. Does anyone have any ideas for the easiest way to scrape job descriptions and input them into an excel file? Which scraper would you use?
Jonathan Ambriz
  • 29
  • 1
  • 7