if the reproduction environment imposes significant distortion as to degrade the perceived response (freq/time-domain), or the ambient noise floor is high, etc etc ... then of course headphones can function as a net benefit. however issues localized to your environment do not allow for a catch-all generalization for all reproduction systems across all acoustical spaces. it's the equivalent of writing off the performance or abilities all automobiles based on your experience with one particular model who may or may not have even be operating within the confines of the deigned envelope in the first place.
distinguishing details of panning does not imply accurate stereo imaging, as with speakers within a bounded space of which the pertinent signals destructive to imagine are mitigated.