you should update the client version, and keep multiple version of kubectl
base on the cluster. or if you are going to decrease version of kubectl server
then consider the comment, which i do not think what you will need.
you can use asdf tool version manager, almost a similar tool like tfswitch.
For mac
brew install asdf
Manage multiple runtime versions with a single CLI tool
getting-started or install-asdf
asdf plugin-add kubectl
asdf install kubectl 1.24.3
asdf global kubectl 1.24.3
asdf list kubectl
#already installed list
#1.21.3
#1.23.3
#1.24.3
source ~/.zshrc

to use kubectl from asdf
run this for zsh, as you might be using kubectl from other source
echo -e "\n. $(brew --prefix asdf)/libexec/asdf.sh" >> ${ZDOTDIR:-~}/.zshrc
getting-started-shell
or you can checklist of all available version
asdf list all kubectl