We don't know how risky aluminum is. (Source.)
In Germany, the Federal Institute for Risk Assessment (BfR) wondered about cooking pans too.
They wrote an article named "FAQs about aluminium in food and products intended for consumers". I shall quote a bunch from that article; their final answer is at the end of my post.
What health risks does aluminium absorption pose?
Any assessment of the hazardous potential of aluminium focuses is on its effects on the nervous system and the fact that it is toxic to reproduction (effects on fertility and unborn life) as well as the effects of aluminium on bone development.
When aluminium is ingested with food, its acute toxicity is low. ... But even in healthy individuals, the light metal accumulates in the body in the course of a lifetime, especially in the lungs and the skeletal system.
...
What quantities of aluminium can be absorbed ... without any health risks?
For oral intake from food, the European Food Safety Authority (EFSA) has derived a tolerable weekly intake (TWI) of 1 milligramme (mg) of aluminium per kilogramme of bodyweight.
Finally, later in their article, they answer your question:
Can I continue to use aluminium cooking pots / pressure cookers?
Provided that they are coated, yes. If they are not, no salty or acidic foods such as apple purée, rhubarb or salted herring should be prepared or stored in such pots.