fetch response replaces Hebrew with question marks in black diamonds

Question

 const fetch = require("node-fetch")

 fetch("https://www.example.com")
 .then(res => res.text())
 .then(data => console.log(data))

The output is HTML string, but Hebrew words replaced with ��

How to set proper encoding to show Hebrew text properly? The final goal is to check whether multiple websites contain certain Hebrew keyword.

Can you provide an example URL? – Nino Filiu Feb 22 '19 at 20:57 — Nino Filiu, Feb 22 '19 at 20:57

score 2 · Accepted Answer · answered Feb 22 '19 at 21:08

By default (res.text()) assumes utf8 has been used, but, as pointed out by this issue, it's not always the case. That might be your case, in which case you might want to try replacing res.text() by res.textConverted() so as to perform encoding sniffing before converting to a string.

fetch response replaces Hebrew with question marks in black diamonds

1 Answers1