My wife and I are married for about 4 years...

My wife and I are married for about 4 years and we are into the LS for about 1 year. Recently, a friend of us stated that swingers are just married cheaters. He doesn't know that we are swingers. Do you think he's right?