That's why my wife and I have separate bedrooms. No one ever has to give up their own bed. It works out well since everyone gets a good night sleep.
Every night before I go to bed, I stop by her room and throw my hat on her bed before going to my room. Sometimes she throws it back and sometimes she brings it back...:D