From Is Sleep Essential? (2008):
It has been argued that the assumption that sleep is universal is based on poor evidence 7).
Summary of some of the “difficult” cases:

The bullfrog is often promoted as an example of an animal that does not sleep. There is, however, only one study on this topic, published in 1967 23).
This report concluded that bullfrogs do not sleep because even during the resting phase they never failed to show a change in respiratory responses after painful stimuli (cutaneous shock).
The same report acknowledged that arousal thresholds could not be measured during the cyclic phases with the lowest respiratory activity, nor could they be tested with other physiological stimuli, such as light or sound.
Also, the underlying assumption in that study was that shocks delivered late at night (presumably in the middle of sleep) should elicit less respiratory response than those given early in the night (when sleep had just started); however, the opposite was found 23).
In fact, we now know that in rodents and humans the deepest sleep occurs early after sleep onset.
At the very least, it seems that more experiments are needed before concluding that bullfrogs do not sleep.
Ask a Biologist (Arizona State University) summarises it:
The bullfrog was chosen as an animal that doesn’t sleep because when tested for responsiveness by being shocked, it had the same reaction whether awake or resting.
However, there were some problems with how the bullfrogs were tested. These problems convinced the scientists there wasn’t enough evidence that bullfrogs didn’t sleep.