authorized_keys2 or more commonly authorized_keys are the default filenames. At least with OpenSSH server you are able to rename the file as you like with the AuthorizedKeysFile directive:
AuthorizedKeysFile
Specifies the file that contains the public keys that can be used for user authentication. AuthorizedKeysFile may contain tokens of the form %T which are substituted during connection setup. The following tokens are defined: %% is replaced by a literal ’%’, %h is replaced by the home directory of the user being authenticated, and %u is replaced by the username of that user. After expansion, AuthorizedKeysFile is taken to be an absolute path or one relative to the user’s home directory. The default is “.ssh/authorized_keys”.
The distinction from authorized_keys versus authorized_keys2 comes about during the transition from SSH v1 to SSH v2. Now SSH v2 is the "default standard" so the name has converged back to authorized_keys in most cases.
The "key" (pardon the pun) point to understand is the private key remains private and is stored on the client machine only. The public key may be published to one or many servers as access needs dictate. In that way, ability to see/view/copy the public key only grants additional access to the private key but importantly may not be used by itself to gain access.
EDIT:
My favorite series of articles regarding SSH key based authentication were published by IBM several years ago.
Keep in mind these articles are 10 years old now and some things have changed. Still, they remain the most comprehensive explanation for all the nuances involved I have found to date.