Kody and Robyn Sister Wives

TLC

In an interview with PEOPLE, the 44-year-oldSister Wivesstar revealed how the Brown family patriarch, 54, had been “pushing me away” sinceMeri,ChristineandJanelle Brownleft theirplural marriage.

“It’s been hard on our relationship,” she said as part of the family’sPEOPLE cover story in August. “It’s been really hard on our relationship because I think when you’re going through a divorce, you start questioning yourself.”

The cast of ‘Sister Wives’.Bryant Livingston/TLC/Everett

SISTER WIVES, Kody Brown (center), surrounded by wives Meri, Janelle, Christine, and wife-to-be Robyn Sullivan, (Season 1), 2010-. photo: Bryant Livingston / © TLC / Courtesy: Everett Collection

“For him, he’s straight, so he questions the opposite sex. So it’s this kind of huge upheaval in the way that you think about yourself and others,” the TLC personality said.

“I think he is starting to do better,” she noted. “But it’s been a couple of years of this and then picking fights and then just acting like he’s … almost like he’s stressed out that I’ll leave him too or something.”

kody brown, robyn brown

“Anybody who’s gone through a divorce knows that it brings out the worst in you and sides of somebody that you didn’t know existed, type of a thing,” she continued. “I always look at divorce as the opposite of all of the effort and the beauty and the wonder and the happiness of marriage. It’s like the opposite of that and it’s been very difficult.”

Season 10 Sister Wives Janelle Brown, Christine Brown, Kody Brown, Meri Brown, Robyn Brown

Kody also acknowledged how hard this period has been for his now-last-remaining wife while speaking to his brother-in-law Nathan.

Never miss a story — sign up forPEOPLE’s free weekly newsletterto get the biggest news of the week delivered to your inbox every Friday.

Sister Wivesairs Sundays at 10 p.m. ET on TLC.

source: people.com