If you do not for a minute do not leave with the music, the novelty called iSH2-Waterproof Headset ($ 80) just for you.
With it you can listen to music directly under water, also included is specifically designed for this iPod Shuffle.
I think it's funny to see a man in the pool or sea, who will try to beat sailing leg favorite rhythm or sing :-)