The alleged TMC workers also carried banners with slogans like 'Shame shame Governor' which they waved at Dhankkhar's convoy when it was entering the college.
'CM sd (should) not be incommunicado to Guv. Am sure there wd (would) b +ve (positive) response,' he added.
The governor visited the state Assembly along with his wife and paid floral tributes at the statue of B R Ambedkar.
The Trinamool Congress, was quick to react, slamming Governor for overstepping his brief and 'aspiring to be the administrative head of the state'.
A scheduled Business Advisory committee meeting on Thursday for discussing the businesses of the House the next day has also been postponed, Assembly sources said.
The CU authorities, however, said the governor was informed beforehand that the meeting of the Senate, the highest decision-making body, will not take place on Wednesday.
His comments through his social media posts came a day after Assembly Speaker Biman Banerjee adjourned the House for two days saying bills to be placed were yet to get green signal from him.
The governor said on Wednesday that he has written to Speaker, he will be going to the assembly to look into its facilities and also visit the library.
West Bengal Governor Jagdeep Dhankhar is at loggerheads with the TMC government on a number of issues.
Dhankhar also said that a 'black hole' exists in the West Bengal's higher education ministry in terms of communication with him.
Dhankar and Banerjee shared the dias for the first time at the special session of the House on Constitution Day but did not exchange greetings and instead preferred to hit out at each other.
Uncertainty over Dhakhar's participation arose after assembly sources indicated on Thursday that the state government was yet to take a call on inviting the governor.
The names of former Governors Gopal Krishna Gandhi and M K Narayanan feature in the invitee list for the November 26-27 session.
The governor was shown black flags allegedly by some Trinamool Congress (TMC) workers on his way to Domkal in Murshidabad district to attend an event on Wednesday.
The governor also alleged that the state government wants to control his movement by not allowing him to use a chopper.