Curb gem: How do I get the body as UTF-8?

Question

I'm using the Curb gem (https://github.com/taf2/curb) to get the HTML of a page that has special characters:

http = Curl.get("http://www.baidu.com/")
puts http.body_str

http.body_str.encoding is ASCII-8BIT. How do get the the body_str as UTF-8 without having to convert it after the fact?

`http = Curl.get("http://www.baidu.com/", {:encoding => "utf-8"}) puts http.body_str` seems it works . — Gupta, Dec 28 '15 at 11:10
@Vinay When I run that, `http.body_str` doesn't show any special characters, and when I call `http_body_str.encoding` it's ASCII-8BIT, not UTF-8. — ill_always_be_a_warriors, Dec 28 '15 at 11:13

score 1 · Answer 1 · answered Dec 28 '15 at 10:46

1

answered Dec 28 '15 at 10:46

Auli

I just tried this, and it seems my encoding is not UTF-8 still. `2.1.2 :192 > c = Curl::Easy.new("http://www.baidu.com") => # 2.1.2 :193 > c.encoding = 'utf-8' => "utf-8" 2.1.2 :194 > c.perform => true 2.1.2 :195 > c.body_str.encoding => #``` – ill_always_be_a_warriors Dec 28 '15 at 11:03
It's curb problem, github.com/vcr/vcr/issues/150 Not yet to solve. you only can completed again to encoding. – Auli Dec 28 '15 at 11:24

1 Answers1