Josh Duggar's kids miss him on Christmas, keep asking 'Where's daddy?'

Josh and Anna Duggar with two of their four children back in 2013.(Facebook/19 Kids and Counting)

This Christmas will be the first one that reality TV star Josh Duggar from the cancelled "19 Kids and Counting" will not be spending with his family, and his wife Anna is sharing just how difficult it is for their four kids that their father has to face the holidays in rehab.

"I don't think he's going to be back for Christmas," a source told People. "I would be surprised. There would be a huge elephant in the room."

As awkward as it might be for Josh to face his family after his Ashley Madison scandal broke out, the source said his four kids—Mackenzie, Michael, Marcus, and Meredith Grace—still want to be with him.

"It's so hard when it comes to the kids," the source said. "They miss their dad. They're like 'Where's daddy?' They've said it before."

The Duggar confidante added that the family is planning a huge Christmas celebration to focus on all the blessings they have received as opposed to the negativity that weighed the family down this year.

"Regardless of all the negativity that has happened in the past few months, we are going to be positive and celebrate Christmas," the source said.

Earlier, Anna and her second daughter Meredith Grace visited Josh briefly in rehab. The union was short and sweet for the couple. As difficult as it would be to spend the holidays apart, Josh can at least be assured that his wife is not leaving him.

"She said, 'It was the best three days of my life,' the source said. "Jim Bob keeps saying this is just another new level of forgiveness."

During the TLC documentary "Jill and Jessa: Counting On," Anna said that as much as she respects the opinion of other people urging her to divorce Josh, she believes in second chances.

"It's such a betrayal for a spouse ... and it was hard," she said. "(But) in my heart, when I got married, I vowed to God first and then to Joshua, 'For better or for worse. 'Til death do we part. I pray that through all of this that I would be an extension of God's love to Joshua, that I would love him and forgive him and wait patiently and allow God to work through our hearts."