In her complaint, the victim, a 23-year-old engineering student, accused the man of repeatedly raping her and bullying her besides threatening her to change her faith to marry him, they said.
He along with the woman was brought to Gorakhpur from the southern state by a three-member UP police team, police said.
While ordering the couple's release, the high court observed that police had shown "undue fervour" while dealing with this case of "inter-religion marriage".
The accused was stalking the complainant and forcing her to marry him and change her religion.
The apex court earlier this month issued notice to both the state governments on petitions filed by advocate Vishal Thakre and others as well as an NGO, 'Citizen for Justice and Peace'.
The complainant alleged that the accused sexually exploited her after concealing his faith.
Shah, who is married to theatre-film actor Ratna Pathak Shah, said he always believed that his marriage to a Hindu woman would set a "healthy precedent".
The court also directed the state government counsel to file a response in connection with the petition filed by wife Chandani and her husband.
A case was lodged against the man on January 11, following which a three-member police team was sent to Karnataka to trace the man and the kidnapped woman, Rai said.
The CK Acchukattu police have arrested a 28-year-old man on charges of raping a 19-year-old woman by promising to marry her.
The ordinance entails a punishment of one to 10 years in cases of forced conversion, which includes forced or fraudulent marriage by hiding one’s original religious identity.
An FIR was earlier registered against brothers Nadeem and Salman for allegedly trying to unlawfully convert a woman to another religion but no evidence has been found against them.
Muslim body moves Supreme Court, seeks to be party in pleas against state laws on religious conversion
The top court earlier in the day, issued notice to the two states, while agreeing to examine the validity of their laws.
A bench headed by Chief Justice SA Bobde refused, however, to stay the controversial provisions of the laws and issued notices to both state governments on two different petitions.
Write a letter to rebuff last week’s open communication by another group of ex-bureaucrats, term it “visibly biased with an anti-establishment attitude despite overtly posing as non-political.”