The Cocoa Cottage water system is fed by a spring close by. We are not using the city water, even though we have a connection which we can activate any time. The spring water is very clean, and you can drink it without any problems, right from the tap.
On the rest of the island, we recommend that you at least ask if the tap water is OK to drink. You might be better off with buying bottled water.