Even though her husband Josh Duggar from the cancelled TLC show "19 Kids and Counting" was the one who admittedly engaged in extramarital affairs using the adultery website Ashley Madison, Anna Duggar is reportedly blaming herself for his infidelity.

A source close to the family told PEOPLE that Anna will never leave Josh despite the Ashley Madison scandal, adding that the good-natured Christian wife is even telling herself that she was the one at fault.

"Anna will not leave him," the source said. "As with her in-laws, she is turning more to her faith than ever. She and Josh are probably praying around the clock right now, I would assume."

In fact, the source would not be surprised if "on some level" Anna tries to "absorb some of the blame."

"Maybe not publicly, ever, but privately, there will be some suggestion of whether or not she should have been more aware of the pressures Josh was under, of the issues he was facing, and how she could have better counselled him or helped him," said the source. "She is fully and permanently committed to her marriage and her children. And she'll have the support of Jim Bob and Michelle and everyone else in their circle in terms of staying with him and making this work. Divorce is not even something that will be discussed."

Josh's parents Jim Bob and Michelle are equally devastated to discover about their son's infidelity, so soon after they backed him up regarding his child molestation raps. "When we learned of this... our hearts were broken. As we continue to place our trust in God, we ask for your prayers for Josh, Anna, our grandchildren and our entire family," they wrote in their blog.

For his part, Josh admitted to being the "biggest hypocrite ever" and apologised for the "double life" that he has been living. "

"I have brought hurt and a reproach to my family, close friends and the fans of our show with my actions," he said. "I deeply regret all the hurt I have caused so many by being such a bad example. I humbly ask for your forgiveness. Please pray for my precious wife Anna and our family during this time."