I am developing an Android app and to test in app purchases I had to set up its page in Google Play Developer console. This required me to upload an .apk, so I uploaded a blank project created IntelliJ IDEA. IntelliJ has an option to sign with its default certificate (whose password is public), I used this option thinking it doesnt matter because I would later upload my app signed with my own certificate.
But to my best knowledge Google does not allow me to change the .apk's signing certificate after the app is published (I published to closed alpha testing). My only option would be to create a new app in Google Play console, but that needs to have a different app ID, and I really do not want this.
What kind of risks does it involve if I release my app and everyone can find out the password for the certificate I used to sign my app (and they can download the certificate too)? Are there any?