When I release a new version of my project (tag the master branch to the version) I want to commit the compiled files
Why not.
I would simply recommend not doing it in the same referential.
A source version control system will retain the history of what you are putting inside, and binaries don't diff well, consuming space quickly.
An artifact repository (like Nexus, or other alternatives) is much more suited for that kind of release (for binaries or any kind of generated files), the idea being that you can very easily purge old releases from the referential (a simple flat files-based system).
Don't forget to include in your release a file text declaring the SHA1 or your source repo, in order to keep a link between the exact revision of your sources from which you produced said binaries.