I think as far as your husband goes, although I don't know him I work with a lot of husbands of my girls in the business. Generally speaking, men:
Want to have a happy, fulfilled wife, BUT;
They don't want to be married to a stamp nazi who spends every waking moment obsessing over stamps and her stamp business.
They want their wives to have some extra money to play with, BUT;
They don't want a lot of cr*p lying around the house reminding them of how much their wife is spending on her new hobby/business.
Want their wife to have something to work toward, to have goals, BUT;
They don't want to be stuck at home with a cranky 2 year old 5 nights a week while we are out stamping.
They want to hear about our successes and help us with our challenges, BUT;
They don't want to hear us complain,vent, and worry about our businesses. They feel like they have to "rescue" us from our terrible, naughty bad stamp business if we share too many of our frustrations. Make sure your spouse hears all the good things about your business and how happy it makes you!
THey want to hear about how much fun you are having, BUT;
If we want our significant others to respect our business, then they need to see us treating it like a business. It doesn't mean that we need to have a mega corporation, even a very part time business needs to have a plan and some goals, and you need to be working it consistently.
Most men(just like anyone else) will not resent our businesses if they feel that their needs are being met. If they feel underappreciated and neglected, they will resent anything you are doing, whether that is plucking chickens, going to church, or running a stamp camp.
I know this is way beyond what you were asking, punkie! To answer your specific question, I would sit down with your husband and ask for his support in this. Ask him what he feels would be an appropriate amount of time each month that you could spend working your business, and tell him that if he will support you in this, he can look forward to his ideal date night every week (or something like that to make him feel valued).
Good luck to you in your decision!