A senior Bharatiya Janata Party functionary admitted that some party leaders were in talks with the disgruntled SBSP legislators.
Governor Ram Naik accepted the recommendation and relieved Rajbhar from his post of Backward Class Welfare and Divyangjan Empowerment Minister, an official spokesperson said in Lucknow.
The party is fighting alone in 39 constituencies for the Lok Sabha election after talks with the saffron party fell through.
Om Prakash Rajbhar has been making sharp statements against the BJP and had recently threatened to walk out of the National Democratic Alliance.
Rajbhar, a minister in the Yogi Adityanath-led government in the state, has been vocal about implementing an expert group recommendation on sub-categorisation of the 27 per cent OBC quota.
The Suheldev Bhartiya Samaj Party, one of the alliance partners in the Yogi Adityanath government in Uttar Pradesh, has convened an emergency meeting in Lucknow on July 4.