Money in a relationship, is it the breaking factor?

I know men are always quick to yell out the term, “gold digger”. However, they are typically the ones that go for the most beautiful women. So I was wondering, what you guys thought. Does money make a difference in a relationship? Would you date someone who had everything you wanted, even great sex, but he was broke? That with that there is a possible that if you got married and had children you would be carrying the weight?