Hi, it is most unlikely that the issue is due to acidity in the water. Copper needs to be exposed to a fairly strong acid before it reacts.
In my my view it is more likely to be a result of electrolytic reaction between dissimilar metals in the system ( galvanised iron to copper?). This has probably been protected by an sacrificial anode inside the cylinder that has now come to the end of its life (dissolved).
The solution is to try to find the dissimilar metals in the system and remove / change them. Replace the cylinder - preferably for one with a Magnesium Alloy anode.
Fitting stainless steel (ss) cylinder ( provided that it is a decent grade of ss) will only move the corrosion point to where the dissimilar metals are in the system. Stainless steel will only react with very strong acids - I guess ones that would make you quite ill before the cylinder corroded through. The copper tank will have corroded where the anode was connected, once the anode had fully dissolved, the attack on the copper will have commenced
Hope this helps