Jax Taylormight have been one of the only people who wasn’t surprised thatTom Sandovalcheated on hisgirlfriend of nine years,Ariana Madix, with costarRaquel Leviss.

“I got a text message. It said, ‘You were right all along,'” Taylor, 43, tells PEOPLE of how he first heard the news. “It wasn’t shocking to me. I’ve known Tom Sandoval for 20 years, we grew up together. I just know his lifestyle. I know who he is, and I’ve said it many times. No one wanted to believe me.”

Taylor’s wife andVPRalumBrittany Cartwright, however, didn’t see it coming. “It was with Raquel, right under their noses — that’s what’s so shocking,” Cartwright, who’s launching theWhen Reality Hitspodcast with Taylor onPodcastOneMarch 28, says.

Jax Taylor and Brittany Cartwright.Charles Sykes/Bravo/NBCU Photo Bank via Getty

Jax Taylor, Brittany Cartwright

Taylor acknowledges he doesn’t “have a leg to stand on” when it comes to infidelity, but he has a theory about why Sandoval, 40, pursued a relationship with Leviss, 28.

“There’s a reason why it’s Raquel. [It’s] because she can be controlled,” he explains. “Ariana’s a very strong, independent woman — that’s how Brittany is — but you can’t control her. And I think Raquel’s very easily influenced. I think he likes to be able to tell her what to do. I think she’s very codependent, and I think he preys on that. He can control her and she’ll do whatever he says. And she’s a fangirl a little bit. That wasn’t happening with Ariana.”

Cartwright, 34, says she “did not see” Leviss “doing that to Ariana.”

“It’s just all bad,” acknowledges the momof 23-month-old son Cruz. “I feel terrible for Ariana having to go through this so publicly.I know that feeling.I feel for her big-time.”

Ariana Madix, Tom Sandoval and Raquel Leviss.Amanda Edwards/Getty; Emma McIntyre/WireImage; Charles Sykes/Bravo/Getty

Ariana Madix attends the Friends and Family Opening at Schwartz & Sandy’s with the cast of “Vanderpump Rules” at Schwartz & Sandy’s Lounge on July 26, 2022 in Los Angeles, California. (Photo by Amanda Edwards/Getty Images); Tom Sandoval arrives at the Los Angeles premiere of Universal Pictures’ ‘Jurassic World Dominion’ on June 06, 2022 in Los Angeles, California. (Photo by Emma McIntyre/WireImage); Raquel Leviss – (Photo by: Charles Sykes/Bravo via Getty Images)

Taylor takes issue withthe initial apology Sandoval issuedon March 4, in which the musician wrote that he understands fans' “disappointment towards me” and asks them to leave friend and business partnerTom Schwartz, as well as “my friends and family out of this situation.”

Says Taylor, “I’ve done my fair share of bad things, but where I have a problem is having your crisis PR team write you a message. You got to step down from your little pedestal for a minute. Stop making this about Tom Sandoval and making do better decisions. You should have called [Ariana] first. There’s just no empathy there.”

Allen Berezovsky/Getty; Jeff Kravitz/Getty

Jax Taylor attends the House Of Sillage Holiday Boutique Launch event at House of Sillage on November 01, 2018 in Costa Mesa, California., Tom Sandoval attends the 2022 MTV Movie & TV Awards: UNSCRIPTED at Barker Hangar in Santa Monica, California and broadcast on June 5, 2022.

Days later, Sandoval posted anapology to Madix, calling himself “selfish” and expressing regret for the “reckless decisions that hurt somebody I love.”

“Because he didn’t say ‘I’m sorry’ to Ariana first, I think that’s what was not a good look,” Cartwright says.

RELATED VIDEO:Ariana Madix Breaks Silence on Tom Sandoval and Raquel Leviss’s Affair: ‘What Doesn’t Kill Me Better Run’

Fans and cast members alike have wondered if Sandoval’s best friend and business partner knew about the affair with Leviss before the news broke. Taylor thinks he did.

“Schwartz has known,” Taylor insists. “I talk to Schwartz all the time. He told me. I don’t know how long, but it’s been at least a couple months. Again, this is a controlling thing. He controls Schwartz. One can’t be without the other. They’re not good separate, they’re only good together.”

Cartwright also heard Schwartz, 40, “found out recently, before it dropped.”

Cindy Ord/Bravo via Getty

BRAVOCON – BravoCon 2022 Red Carpet from the Javits Center in New York City on Saturday, October 15, 2022 – Pictured: (l-r) Tom Schwartz, Tom Sandoval – (Photo by: Cindy Ord/Bravo via Getty Images)

Taylor puts the blame on Sandoval, not Schwartz.

“I think Schwartz is a good guy,” Taylor says. “He’s not going to rat on his friends. Sandoval’s being very selfish. He shouldn’t have put Tom in that position.”

Cartwright calls the Scandoval “a really hard situation.”

“Sandoval should have just broke up with Ariana if he was going to do that,” the Kentucky native says, adding that that she heard Sandoval wants to stay with Leviss moving forward.

Taylor thinks Sandoval carried on the affair because he felt invincible.

“When you get to a certain point, you think you have this diva mentality where you’re just not going to get in trouble and you’re not going to get caught,” Taylor says. “He’s gotten to that point where he’s [thinking], ‘I can’t be touched. I can do whatever I want.’ And it caught up with him.”

Despite no longer appearing onVanderpump Rules, the couple has stayed close with a lot of the cast and hangs out them often, including Sandoval and Leviss. “There’s times and events where I saw them together and it just didn’t even click until now,” Taylor says. “We saw them Labor Day at our friend’s house. They were together. But I wouldn’t have thought anything until this came up.”

Taylor questioned Sandoval’s character for years, but now, “I don’t want to say I told you so,” he says. “I’ve been down this road. It’s a scary, dark place where he is right now, but he put himself there. He’s got to be man enough to own it and give Ariana her space.”

Cartwright adds, “Hopefully Tom will learn from all this.”

Bravo approached former castmate Kristen Doute, whodated Sandovalbefore Madix, about filming for the current season after news of her ex’s affair broke. Cartwright says she and Taylor “would definitely” be open to making an appearance, too.

Never miss a story — sign up forPEOPLE’s free daily newsletterto stay up-to-date on the best of what PEOPLE has to offer, from juicy celebrity news to compelling human interest stories.

Vanderpump Rulesairs Wednesdays at 9 p.m. ET on Bravo.

source: people.com