There is a serious debate about how good animal models are in predicting the effect of new drugs on humans. This is a very complicated issue, and the answer is very likely to be completely different for different animal models.
There are indications that some animal models that were widely used turned out to be almost useless. One example is shown in the paper "Genomic responses in mouse models poorly mimic human inflammatory diseases" published in PNAS (see also the blog post from Derek Lowe on this paper):
Here, we show that, although acute inflammatory stresses from
different etiologies result in highly similar genomic responses in
humans, the responses in corresponding mouse models correlate poorly
with the human conditions and also, one another.
Another paper examining multiple animal models is "Comparison of treatment effects between animal experiments and clinical trials: systematic review" published in BMJ:
Conclusions Discordance between animal and human studies may be due to bias or to the failure of animal models to mimic clinical disease adequately.
There are multiple reasons why animal studies would fail to correctly predict the result of specific drug candidates in humans. There could be fundamental differences in the biology between e.g. mice and humans in the specific parts affected by the disease and the drug candidate. But there are also some indications that the problem is in part due to flaws in the animal studies themselves. The paper "Can Animal Models of Disease Reliably Inform Human Studies?" published in PLOS Medicine states:
The value of animal experiments for predicting the effectiveness of
treatment strategies in clinical trials has remained controversial,
mainly because of a recurrent failure of interventions apparently
promising in animal models to translate to the clinic.
Translational
failure may be explained in part by methodological flaws in animal
studies, leading to systematic bias and thereby to inadequate data and
incorrect conclusions about efficacy.
Failures also result because of
critical disparities, usually disease specific, between the animal
models and the clinical trials testing the treatment strategy.
Systematic flaws in animal studies and issues like publication bias are something that can be changed, they are not an unavoidable issue. Cases where the biology is too different between the laboratory animals and humans are much more difficult.
The fundamental issue is that we just don't have anything better available than animal experiments in most cases. Studies in humans have to meet very high ethical barriers. And in vitro experiments and cell cultures are much, much farther away from the actual human biology than even the flawed animal models. Derek Lowe writes about animal experiments from the perspective of a chemist in the pharmaceutical industry::
So that's my answer: we use animals because we have (as yet) no alternative. And our animal assays prove that to us over and over by surprising us with things we didn't know, and that we would have had no other opportunity to learn. We'd very much like to be able to do things differently, since "differently" would surely mean "faster and more cheaply". None of us enjoy it when our compounds sicken healthy animals, or have no effect on sick ones. Just the wasted time and effort alone is enough to make any drug discoverer think so. There are billions of dollars waiting to be picked up by anyone who finds a better way.
Animal models are certainly problematic in many cases, but they are still the best we have. There are no real alternatives in most cases.