ruby mechanize proxy retry until connected

Question

What I want to do is this

I have a proxy list with ip|port

Now Mechanize is using those proxy and I have set

open_timeout = 20 
read_timeout = 20

What I want it todo is to retry, but it will retry with the same proxy even if I have "proxies = @proxies.order("RANDOM()").first" it will not load a new proxy, but instead it will load from cache

here is my code that I use :

begin
    proxies = @proxies.order("RANDOM()").first
    proxy_ip = proxies.ip
    proxy_port = proxies.port
    puts proxy_ip
    puts proxy_port

    agent = Mechanize.new
    agent.open_timeout = 20
    agent.read_timeout = 20
    agent.set_proxy(proxy_ip, proxy_port)


    page = agent.get("http://whatismyip.org/"
rescue
     puts "oh shit, error"
     retry

end
    doc = page.parser
    ip_ad = doc.css('span').text
    puts ip_ad

Now my question is how do I make it load a new proxy instead of using it from the cache

Your question is should you use a loop? Yes, you probably should. — pguardiario, May 22 '15 at 05:54
and where should I put that loop? at the 'page = agent.get("http://whatismyip.org/"' and how do I know if it is 200 ok ? — Cyrus Zei, May 28 '15 at 16:26
I woud suggest `while proxies = @proxies.order("RANDOM()").first` and checking `page.code` — pguardiario, May 30 '15 at 01:18

score 0 · Answer 1 · answered Oct 11 '16 at 10:19

For anybody that comes here from google this is how I solved it

offset = rand(Proxy.count)
proxies = @proxies.offset(offset).first

I use the offset and it works like a charm and this is

begin page = minion.submit(form,button)

        rescue Mechanize::ResponseCodeError => e

            offset = rand(Proxy.count)
            proxies = @proxies.offset(offset).first
            proxy_ip = proxies.ip
            proxy_port = proxies.port
            puts proxy_ip
            puts proxy_port

            minion.open_timeout = 3.0
            minion.read_timeout = 3.0
            minion.cookie_jar.clear!
            minion.max_history = 0
            #minion.set_proxy(proxy_ip, proxy_port)

            sleep 5.0

            if page.parser.xpath('//h2[contains(@class,"name")]').text == "Ingen träff"
                puts "ingen träff"
            else
                puts "retrying"
                retry
            end

    end

Enjoy guys

ruby mechanize proxy retry until connected

1 Answers1