A teacher at South Cache Middle school was arrested on Wednesday morning for allegedly having an inappropriate relationship with a student at the middle school.

Officials believe 51-year-old Duane Berhmann had a relationship with one student. The case is under investigation, according to a news release.

The victim’s parents reported the relationship to police on Tuesday after they found something on their teenager’s phone.

The information they found led them to believe the relationship had been going on for at least two months, according to Cache County Sheriff’s Lt. Brian Locke.

According to the school’s website, Berhmann teaches history.