5

I'm using HTML Tidy Online (http://infohound.net/tidy/) to tidy up some very old and messed up HTML file which contains some Hebrew characters. Whenever the page is processed by Tidy the output turns Hebrew characters into gibberish, even after changing encoding methods in the settings. Using different settings, I do manage to get the same output with the Hebrew characters as unicode entities. I Googled around for a possible solution but found none. I had a couple ideas in mind, but I'm not sure exactly how to approach them, if at all (maybe someone has a better solution).

  1. I thought maybe I could (after processing the page) scan the page for unicode entities and replace them with the corresponding Hebrew characters (in a systematic way, of course).
  2. Maybe I could take the HTML Tidy source code and modify it to output Hebrew characters appropriately. The problem with this is that I doubt I am knowledgeable enough to even get started on something like this.
Charles
  • 157
  • 1
  • 10
  • Did you declare a charset in your HTML file? If so, which one? Exactly what do you mean by "gibberish"? Show us a hex dump. – dan04 Jul 29 '11 at 16:58

2 Answers2

2

I had a similar problem. Document in UTF-8, containing unicode characters. HTML Tidy turned them into HTML entities. This in HTMLTIDY.CFG fixed it:

char-encoding: utf8
input-encoding: utf8
output-encoding: utf8

Hope it helps.

Jake
  • 126
  • 2
  • 3
0

The website http://infohound.net/tidy/ that you are using has a "Char encoding" clause at the bottom right. You need to choose utf-8, but first you need to make sure that the page is encoded in UTF-8 in your test editor. In Notepad++ for example, you can go to Encoding > Convert to UTF-8 without BOM.

Ynhockey
  • 3,845
  • 5
  • 33
  • 51