Very true, oft forgotten factor in these calculations.
I can never forget it. I've had to travel Y a couple of times NYC-TLV in recent years, and it's been a disaster to recuperate from (not to mention the one time there was a bochur from a certain Yeshiva that desperately needed a shower, and even worse, had some serious odor issues from his feet, and decided to remove his shoes).
I have friends question why I am willing to pay an extra $1,000-$1,500 for J, after all it's only a few hours... but when I land, I need to be able to function, both at work and as a husband and father. DW OTOH refuses that I book her in J when she travels alone. At least I managed to convince her to get a prescription for Ambien for her flights.