Can two people with a lot of baggage from their past be together?

I was recently chatting with a new acquaintance, My partner and I both got rather sketchy pasts. Lies, deceit, abuse, dramatic and traumatic changes and occurrences. Well this acquaintance said that no 2 people with that amount of baggage would ever last together. Is this true? We do have our UPS and Downs but that's normal for a relationship right?? My partner was severely abused as a child and we have fought on 3 occasions when it has become violent. he doesn't abuse me but lets just say we physically fight, and its often me that provokes the fight. IS this normal?? People say im crazy.... I love him and i know he loves me... and essentially we have everything we need., live enriched lives and love each other and have fun, but we do go through phases that would be appropriate on the jerry springer show!