The Duggar family from "19 Kids and Counting" has found another supporter in their pastor, Dr. Ronnie Floyd, 59, of the Pinnacle Cross Church in Roger, Arkansas.

Speaking to PEOPLE, Floyd said God is always forgiving with arms always open for those who repent their sins. "Everyone does wrong, and what was wrong was very wrong as to what was testified to, and it's completely unacceptable," he said. "But I'm thankful, whether it's him or any other one, that I serve a God who can forgive everything.''

Floyd has been a pastor for over 37 years and has been with Cross Church since 1986. When Josh Duggar's child molestation scandal was brought to light, Floyd admitted that he and the rest of the congregation were very shocked.

"All of us were surprised by the news because... their reputation in Arkansas is that they are a very Christian family," he said.

Despite the scandal though, the senior pastor said their "evangelical Christian ministry is alive and well."

It was not the first time that a scandal has rocked their church, so it's not something that will affect their day-to-day activities.

"Things like the scandal have happened before and will happen again,'' he said.

After the news surfaced, Josh resigned from his position at the Family Research Council and offered this statement of apology: "Twelve years ago, as a young teenager I acted inexcusably for which I am extremely sorry and deeply regret. I hurt others, including my family and close friends."

He confessed this to his parents Jim Bob and Michelle, who took steps to help him address the situation. Josh and those he has wronged have received counselling since then. Even before he married his wife Anna, Josh had told her all about his past.

"I can imagine the shock many of you are going through reading this. I remember feeling that same shock," said Anna. She praised her husband for being "someone who had gone down a wrong path and had humbled himself before God and those whom he had offended."