I have no idea what happened. I was doing some Agda work in one window, and I had a C project in another. Restarted VS Code to work on the C project, now every time I try to use arrow keys I get the error message mentioned in the title, and my cursor won't move.
I looked at my Keyboard shortcuts and found this:
Disabling the extension and restarting didn't work.