We've got pretty good water here too, so I pretty much only drink from the tap.
There's a water fountain (bubbler) at work that I use often.
I had one of those metal canteen things to carry with me, but the water would always taste metallic after a bit so I stopped using it.
The girlfriend has one of them plastic canteen things, but that makes the water taste plasticky.