This bot invented by two IIT Delhi students can be controlled with music and voice commands

In order to introduce the puppet to the world, the duo staged a play centred around an animal named Jamoora.

Published: 18th November 2018 03:41 PM  |   Last Updated: 18th November 2018 03:42 PM   |  A+A-


Jamoora, the bot can be used by story tellers to make their performances more effective.

By Online Desk

If you love the age-old Indian tradition of story-telling with puppets and music, you're going to love this new robot, designed by two IIT Delhi students. Varnith Jain and Anant Sharma have designed a bot that can be controlled using music and voice commands, instead of the usual manual command.  

"Our problem statement was to use robots that can be controlled without using hands. In the context of Indian puppetry, something very unique to our culture, there's usually one guy controlling the puppet and two or three others playing the music. But what if there's just one person? With the help of this puppet, what happens is, we play live music and tell a story, and the robot reacts accordingly," says Varnith. 

Expressive bot: The innovation is based on the concept of Animatronics

The puppet has a head and a beak and can move around, pick up objects and drop it off. "The innovation is not the object itself, but the way it is controlled," says Varnith, and adds, "For example, when we tell it to walk forward, it can either walk briskly with its head raised or in a slow and gloomy manner. That is determined by the music that is being played."

In order to introduce the puppet to the world, the duo staged a play centred around an animal named Jamoora. Jamoora belonged to the great Indian desert in Rajasthan. One summer, all the oases in the desert dried up, and Jamoora was searching for water everywhere. As the story unfolded, the music in the background was that of a slow Indian classical raga. Jamoora, the puppet instantly moved according to the mood. 

"This can be a great story-telling tool. Children can write their own stories and even learn to play an instrument and then use the puppet to make their story more effective," says Varnith.  

Talking about the process behind this unique innovation, Varnith says, "We had to do a lot of research on animatronics, which is essentially the art of depicting emotions using a robot. We don't have complex robots that proper facial features like Sofia, so we had to make do with limb movements. We also had to separate audio and music signals, which was quite a task."

(This story originally appeared on

Stay up to date on all the latest Delhi news with The New Indian Express App. Download now
(Get the news that matters from New Indian Express on WhatsApp. Click this link and hit 'Click to Subscribe'. Follow the instructions after that.)


Disclaimer : We respect your thoughts and views! But we need to be judicious while moderating your comments. All the comments will be moderated by the editorial. Abstain from posting comments that are obscene, defamatory or inflammatory, and do not indulge in personal attacks. Try to avoid outside hyperlinks inside the comment. Help us delete comments that do not follow these guidelines.

The views expressed in comments published on are those of the comment writers alone. They do not represent the views or opinions of or its staff, nor do they represent the views or opinions of The New Indian Express Group, or any entity of, or affiliated with, The New Indian Express Group. reserves the right to take any or all comments down at any time.

flipboard facebook twitter whatsapp