Bharatiya Janata Party won just 12 seats reserved for Scheduled Caste (SC) candidates this time, as against 32 in 2013 polls.
Saleh Mohammad of Congress in Pokhran defeated his rival Mahant Pratap Puri by 872 votes. NOTA got 1,121 votes.
Raje is also said to have held several meetings in Jaipur over this past weekend to review the scenario.
Yadav clarified later saying it was a mere 'joke' and that his intentions were not to hurt the Chief Minister while Raje insisted that such language will set a bad example for youngsters.
Mayawati dumps 'Grand alliance': Pact with Congress in Madhya Pradesh, Rajasthan merely a Maya, BSP to go it alone
BSP chief says her party will contest assembly elections in Rajasthan and Madhya Pradesh either on its own or in alliance with regional parties.
Sources said that the BJP leaders had brought to the notice of the party high command simmering anger among the upper castes in a number of states.