National water agency PUB is investigating after a pipe had water gushing out several metres high in Orchard Road on April 11.