No, checked exceptions do not violate OCP, for the simple reason that OCP applies to modules, not to methods.
If you consider a checked exception is just another piece of a method signature, this question is the same as whether method names or method parameters or method return types violate OCP. The principle simply does not apply at this granular level.
Without knowing how the method is implemented, or more importantly, how the method is exposed via its module's API, we have nothing to judge. For example, a method may rely on a hard-coded constant; but if the method can be overridden by clients, it is still open for extension. Nothing about the existence of a checked exception informs us whether or not a module is extensible.
On the other hand if checked exceptions caused a method to be final, and if such a method was exposed by a module as part of its public API, and if that module provided no alternative to that API, then it would be an OCP violation.