Stack Overflow
Stack Overflow

Questions tagged [proxies]

215 questions
1
vote
0 answers

Accessing website through proxy with requests sometimes doesn't work (http.client.RemoteDisconnected: Remote end closed connection without response)

I've been trying to access a website through a proxy in python using the requests module (I'm accessing api.ipify.org in my example because it should print the proxy's ip). I've tested the proxy using the same program before, and it has worked. But…
HoneyPoop
  • 473
  • 1
  • 6
  • 25
1
vote
0 answers

Make get api requests using Python over Tor

I'm trying to load JSON data through a tor session. URL_1 works fine, but URL_2 does not work (Example I). I don't know why.. Here is the type of error I get: IP: I can well recover Json api data without tor session (Example II)…
Laurent
  • 43
  • 1
  • 6
1
vote
1 answer

How can i load proxies from a txt file in python?

How can i load proxies from a txt file in python? The proxies are the following format: 1.1.1.1:80 1.1.1.2:80 All of them are open on port 80. Here is what i tried but without success it only gets 1 proxy from the file for some reasons. import…
Eduardo Decker
  • 51
  • 2
  • 7
1
vote
1 answer

How to incorporate a time delay and/or switch proxies to avoid getting throttled?

I'm currently working with a function that pulls corporate filings via a library that allows for scraping the SEC Edgar database. The issue I believe I'm having is that I'm trying to build a dataset of a few hundred companies through a loop that…
GRobs
  • 11
  • 2
1
vote
0 answers

Proxy request getting errors

Hi i'm trying to use different proxy to scrape this [website][1], But i'm keep getting errors. import requests from bs4 import BeautifulSoup import pandas as pd import urllib3 url2=…
Barak Shireto
  • 11
  • 2
1
vote
0 answers

Proxies not created when publish function app

I have created a function app with ARM template and deployed my functions with Azure Functions Core Tools: func azure functionapp publish myfunctionapp Now, when I add proxies.json file and deploy again my functionapp with above command it seems…
Davide Bracaglia
  • 159
  • 1
  • 1
  • 12
1
vote
2 answers

How can I format 51.xx.xx.xx:33xxx:user:pass into user:pass@51.xx.xx.xx:33xxx

This is what I have so far but it returns only one proxy because it rewrites over it x (however many proxies) times. I do not want to make a new file but instead rewrite proxies.txt with every proxy. const fs = require("fs"); const formatProxies =…
user11917876
1
vote
1 answer

EFCore 3 with UseLazyLoadingProxies enabled throws System.NotSupportedException: 'Parent does not have a default constructor

I am writting a DDD application and I am trying to use LazyLoading option. The problem I am facing is that I can run my application OK if I don't use LazyLoading, but once I try to use UseLazyLoadingProxies(), when I get an entity I get the title…
gds03
  • 1,349
  • 3
  • 18
  • 39
1
vote
0 answers

How to use a list of proxies with a requests session

I have the following proxy list: proxies = [ { 'http': 'http://user:pass@10.10.1.10:3128', 'https': 'http://user:pass@10.10.1.10:3128' }, { 'http': 'http://user:pass@10.10.1.10:3128', 'https':…
Lukas
  • 53
  • 6
1
vote
2 answers

C# proxy question

Does someone know library, that reduces amounts of boilerplate code when writing object proxies? My proxies right now look the following way and I think it's a nasty approach :) public class SampleTenantProxy : Tenant { public override int? Id …
Yippie-Ki-Yay
  • 22,026
  • 26
  • 90
  • 148
1
vote
0 answers

Python Proxy Dictionary issue

I'm having trouble with using a Proxy Dictionary with the requests library. I am using a virtual environment and testing it all out and trying to reach httpbin.org/ip. I'm getting this error: requests.exceptions.ProxyError:…
StephenB
  • 166
  • 2
  • 14
1
vote
2 answers

Proxies in Python Requests

So I used Proxy Broker to scrape some proxies. Sometimes the proxies are dead when scraped so I wanted to check them before I used them. So I wrote a program using Python Requests to check them. Here it is: import time import random import…
Kunwar Sodhi
  • 213
  • 2
  • 5
  • 13
1
vote
0 answers

python+selenium+phantomjs+proxies works occasionally but mostly returns empty page ''

I see lots of examples and occasionally (like 2 out of 100) this works but not most of the time and I'm not seeing why? Any ideas much appreciated! I'm not that familiar with utilizing proxies and I suspect that the data is just not passing back…
observer7
  • 45
  • 1
  • 6
1
vote
1 answer

Does CDI reuse proxies for RequestScoped?

If I create a bean annotated with @RequestScoped I expect that it will instantiate a new proxy instance with each new request. From the other hand each request is associated with its own thread. My question is: will CDI reuse previously created…
Andremoniy
  • 34,031
  • 20
  • 135
  • 241
1
vote
0 answers

Get request hanging using Python selenium and PhantomJS headless browser

I'm trying to scrape product information from Adidas but for some reason when making a get request using PhantomJS the session is hanging and not receiving a response. I've tried the same using Selenium with Chrome and headless with Chrome and it…
cbmteller
  • 11
  • 2
1 2 3
…
14 15