A friend of us (who doesn't know that we are...

A friend of us (who doesn't know that we are swingers) said the other night that swingers are just married cheaters. Do you agree with him? Is he right I found it kinda offensive, to be honest...