He has been summoned multiple times by the Central Bureau of Investigation in recent weeks but failed to appear as he said he was on leave.
Justice Pratik Prakash Banerjee ruled that the petition will appear before a regular bench on June 12 after the court reopens following summer vacation.
The officer reached the CBI office at the CGO complex in Salt Lake at 10.10 a.m on Thursday and left at around 5 p.m.
Kumar, a former Kolkata police commissioner, had skipped a meeting with CBI officials on Monday despite being summoned by the agency for questioning in connection with the scam.
The agency wants custodial interrogation of Kumar in connection with the chit fund scam as he was heading the police's special investigation team to probe the case before the CBI took over.
All airports and immigration authorities have been alerted by the CBI this week to prevent the former Kolkata top cop from leaving the country and intimate the agency on any possible move, they said.
A vacation bench headed by Justice Arun Mishra said Kumar can approach the Calcutta High Court or the trial court there for seeking relief.
Saradha scam: SC withdraws protection to ex-Kolkata top cop Rajeev Kumar, gives him week's time to appeal
CBI has accused Kumar of tampering with evidence in the multi-crore chit fund scam to shield powerful politicians in Bengal.
Supreme Court on Tuesday observed that the CBI’s findings from his recent interrogation were serious. It also allowed the CBI to file its application against Kumar within 10 days.
Supreme Court said that as the CBI's status report was filed in a sealed cover, it cannot pass any order at the moment without hearing the other side.
A three-judge bench comprising Chief Justice Ranjan Gogoi and Justices Rao and Sanjiv Khanna adjourned the hearing on pleas of the CBI.
Directing Chidambaram to cooperate with the investigation, a division bench headed by Justice Joymalya Bagchi kept her application for anticipatory bail pending.
A Bench headed by Chief Justice Ranjan Gogoi had said that after perusing the affidavits, a decision will be taken whether they would required to make personal appearance before it on February 20.
In a Facebook post on Monday morning, Ghosh also said the CBI should have questioned Kolkata Police Commissioner Rajeev Kumar long ago.
The former Trinamool Congress MP was arrested in 2013 in the Saradha ponzi scam and has been out on bail since 2016.