Little People, Big World star Matt Roloff is looking forward to spending the rest of his life with fiancée Caryn Chandler, but the couple may be reconsidering actually tying the knot.

In the latest episode of the hit TLC series, Matt, 62, opened up to his friends, including his ex-wife Amy’s husband Chris Marek, about how he’s feeling “petrified” of getting married again. Although he said that doesn’t see himself “with anybody other than Caryn,” the reality star explained that he’s worried their relationship could change after they walk down the aisle.

While spending a night kicking back at his log cabin, Matt admitted that he’s feeling “petrified” about getting married when his friend Ty noted that he seemed “scared” about it.

The reality star shared that he and his fiancée (who he proposed to in April of last year) have talked about feeling “afraid” that their dynamic could change, especially because “it’s working so well” right now.

Matt said, “We have the whole, ‘Don’t fix what’s not broke.’ We got that whole thing going.”

Matt Roloff, Chris Marek and friends on ‘Little People, Big World’.
Warner Bros. Discovery

He continued, “Not that anything we have against the institution of marriage — we both like it and have been married — but do we need to do that exactly?”

The Roloff Farms owner explained that, at this point, he and Caryn, 56, are simply taking their engagement day by day. “We’re not doing anything off the table,” the TV personality told his friends. “When we talk about it, we always say, ‘We’ll talk about it again in a couple weeks or months or whatever.’”

To reassure his buddy who he’s gotten closer with in recent years, Chris, 61, spoke candidly about how he experienced similar feelings before he and Amy were wed in 2021.

“I was concerned about that, too,” he revealed. “At 59, it’s not like I felt like I had to get married, but I have heard so many stories from other couples that were together for a long time and, as soon as they got married, the relationship changed.”

“Fortunately, that didn’t happen,” the real estate agent continued. “If anything, it became easier.”

Caryn Chandler and Matt Roloff.
Matt Roloff Instagram

In a confessional, the LPBW star opened up about how he and Caryn saw securing their Arizona property as “testing the waters” in the next phase of their relationship.

“We did talk about once the house is real, then we would revisit [our wedding plans], so we’re starting that process of, ‘Hey, does this change anything?’” he revealed. “We’re both going, ‘Not necessarily, other than you might sell your house and move in.’”

Matt added, “We very much respect and appreciate the concept of marriage and the principles behind it and we’re weighing all of our options.”

PEOPLE exclusively revealed that Matt and Caryn were engaged after six years of dating in April of last year. “After six wonderful years together, I asked Caryn to marry me and she said yes!” the reality TV star said at the time. “Our plan is to enjoy our engagement and we are looking forward to a simple but elegant wedding in 2024.”

The couple originally met because Caryn was previously an employee at Roloff Farms.

Matt has since expressed how excited he is about his engagement. In the caption of an Instagram post in May, he wrote he had mostly been “making TV shows and mostly just enjoying my engagement and Time with Caryn!”

In an additional comment on the post, the entrepreneur told his fans: “You all kept telling me to ‘put a ring on her,'” adding, “So I did. 💍”

Matt was previously married to Amy, his costar on LPBW, for 28 years until the two divorced in 2015.

Never miss a story — sign up for PEOPLE’s free daily newsletter to stay up-to-date on the best of what PEOPLE has to offer, from celebrity news to compelling human interest stories.