It is bad enough when you can see it, but by far the most serious consequences are when it is hidden behind plasterwork, floors, panelling and other hidden parts.
Keep your rainwater disposal in good condition and avoid situations where rainwater can be allowed to penetrate the building periodically. The consequences of dry rot can be very serious.