Even though some members of the Duggar family from "19 Kids and Counting" have expressed optimism that things will work out for the better now that eldest son Josh Duggar has finished his stint in rehab and has returned home, a close relative believes the family is up for more trying times ahead.

Dillon King, who married fun-loving Duggar cousin Amy, told InTouch Weekly that there is no going back from Josh's mistakes.

"It's not ever going to be the same," Dillon explained. "It's not ever going to be what it was."

An unnamed Duggar family member added that even though the Duggars themselves have forgiven Josh, others still haven't and might not want to go anywhere near him.

"There are people in the extended family who definitely won't bring their children near Josh," the source said. "Who would want their kids around him after all he's done?"

Another source close to the family even said the Duggars are now a family divided when it comes to welcoming Josh back into their lives.

"While the Duggars have publicly claimed to support Josh, some in the family are not that overjoyed by his return," the source claimed.

Josh's parents Jim Bob and Michelle Duggar earlier thanked their supporters in a statement for keeping them in their prayers while they went through that difficult time.

"Josh has completed his residential rehabilitation program. We are so thankful for everyone who worked with Josh in this program. It was a crucial first step in recovery and healing for Josh. Josh has now returned to Arkansas, where he will continue professional counselling and focus on rebuilding relationships with his family," they said. "We look to God for help and guidance and place all of our trust in Him. We are forever grateful for the love and prayers offered by so many and hope you will continue to pray in the days ahead."