A West Virginia transgender woman who served as a youth minister in several churches was arrested Tuesday and charged with sexually abusing a young girl for years.

James "Jimmy" Lilly, 24, a man who identifies himself as a woman, is facing one count of incest, one count of second-degree sexual assault and 31 counts of first-degree sexual abuse, Detective K.L. Adams of the Bluefield Police Department told the Bluefield Daily Telegraph.

Adams said the victim is a juvenile female and the abuse started in 2009 when the victim was 9 to 10 years old and it continued until she was 16. The abuse occurred at home and not at the church.

Lilly is studying to get a teaching degree at Bluefield State College and worked at numerous churches. He worked at Episcopal churches in Bluefield.

"He was a youth minister, but also involved with children in other ways," Adams said. "Mr. Lilly, by his own admission, is transgender. He is in the process of becoming a woman."

Investigation on Lilly started last December after the police were alerted that he had been sexually abusing a girl since 2009, according to the Christian News Network.

Lilly was released after posting a $125,000 bond but the police are looking into claims that he also abused other children while he was a youth leader in Mechanicsville, Virginia and Atlanta, Georgia.

"Of course in this investigation, we put out there in the news for any other victims to come forward and contact the Bluefield Police Department," Adams said. "There has been some allegations arise out of state at other churches that he has worked—possible victims there that have come forward."

According to local TV station WVVA, officials at the Christ Episcopal Church of Bluefield said Lilly never raised any flags on his behaviour.

"After interviewing the victim in this case, hearing all the stuff that has happened and also everything that has led up to and speaking with individuals that have been involved in Mr. Lilly's life, we find it pertinent that he is guilty of these charges," Adams said.