It's definitely difficult - that's why I limit my gym-time to 3 times a week otherwise I would never get anything done and my poor DH would feel very neglected!!!
I'd like to get some home exercise equipment though so I can exercise at home and then I can talk to DH, watch tv etc. while I'm exercising at the same time.