Can I be arrested or prosecuted?

My ex husband and I had an abusive relationship. At one point he took my son to another state for a visit, but after he arrived told me he had no intention on bringing him back. I filed for a restraining order that gave me exclusive custody in my state. I went to the state where he had fled to take my son back to the residential state, but he found out I was coming up there and claimed numerous child abuse allegations against me to try and prevent me from taking him back. There was an emergency hearing and I agreed to temporary custody based on a fraudulent lie he told me. He said my kids faced foster care if I didn't give him that temporary custody and I found out the next day that it was all a lie! I filed a motion for divorce and was granted sole custody of all my children. I went up to the state where he was and the police there removed the children from his home and gave them to me. He is now claiming that I kidnapped my kids because I violated the visitation temporary custody!