I would agree that getting on and off the ship are the two areas that most people dislike. What I don't understand is that all the luggage is sitting in the warehouse there waiting for people to come and claim it by early morning. It doesn't make sense why they make people wait forever to get off the ship. We are willing to roll our own luggage to save that painful wait.
I totally understand the prioritization: flights have to be met that are booked in too close, IMO. Otherwise, everyone - most who do NOT have such an issue - would clog up the process. What I didn't like last time (Celebrity, FLL) was calling us when the lines were way too long and slowly moving, then having to wait in a long hot line. Rather wait in an A/C lounge or some other place. It's actually one of the nicest times - no one is on the ship! We are often one of the last groups off, mostly by design (don't want to stress trying to meet a flight). Besides, I hate to see the end of a cruise and leaving the ship, so we enjoy taking it all in with relative solitude.