GPS elevation computation has traditionally been less accurate than horizontal computation thanks to the geometry of using the satellites. That said, they've been getting more accurate all the time, and units (as noted) that have sophisticated GPS that works in concert with a good barometer can be pretty damned accurate. Calibration is very important.
I've been using GPS for a long time for mountain navigation and in the last 10 years they've become incredibly accurate and reliable.