That's just the beginning of your life together with him. You'll fight amongst each other regardless of how much you love each other. Why? Because it's human nature to disagree and have your own opinions.
Does that mean it's not worth it? Not neccesarily.
If your fiance is willing to talk with you about this and you two can manage some sort of understanding and see eye to eye, you're on the right track to a healthy marriage. Show him that you do work to keep the house, and baby organised and healthy. With out proper house keeping, you can get harmful, and even deadly molds. Dust build up is bad for a newborns lungs and is a large allergin. There are many problems that can be associated with a dirty house. Obviously I don't need to tell you why you need to take care of your child.
I'm sure your fiance was just angry after work, seeing you relax perhaps set him off because he had a rough day. It doesn't mean it's right for him to do this. Talking with him about what you do, and why he would say such a thing is the first step in the right direction.
Communication is the key to Victory in war, technology, research, school and relationships.