John. Surely all an emergency plumber could do is isolate the boiler until he or she has obtained the replacement part to make a proper repair, which isn't going to happen at this time of night!
I think Chalked gave you the answer you needed, but didn't fully explain. At a guess, what Chalked means is that combustion air can cause condensation = water, but combustion air will also contain CO. There is no pure CO anywhere that can leak, but the combustion air will always contain at least a small percentage of partially burned carbon, so any leaking combustion air will be a source of CO.
Worth noting that CO alarms only ring at a high level of CO concentration, so not reliable as a test for a leak. Basically, a boiler has the potential to be dangerous. If you have a professional diagnosis that it is likely to be dangerous, then you need to go with it really.