Telepresence robot gets motion enhancement in just eight weeks

Upgrading a telepresence robot during a pandemic

_{Pace Port™ Tokyo, in a mere matter of weeks, developed a prototype for a telepresence robot with semi-autonomous driving and path finding functions, despite hurdles presented by the pandemic and related restrictions at various levels.}

_{The recently created proof of concept (PoC) has been a step toward Pace Port Tokyo’s efforts to introduce a fully automated robotic guide to conduct tours at the facility and interact with customers and clients via video conversations, and eventually replace the manually controlled robot currently used. The development was completed in about eight weeks in collaboration with the Rapid Development Team at Tokyo and TCS’ Cognitive Robotics research team.}

_{A telepresence robot enables a human to be virtually present in a remote location through a tablet, smartphone, or a computer screen. The operator can interact with humans with the help of video camera, speakers, and other accessories.}

Achieving semi-autonomous functions

The robot was previously operated only manually, where a human remotely controlled its movements and carried out video conversations with customers through the robot. The latest prototype allows the robot to move by itself, with a goal point specified on the map, paving the way for both parties to focus on the conversation.

Some of TCS’ Cognitive Robotics’ research team’s assets that made it possible to develop the semi-autonomous telepresence robot were edge-centric communication protocol, autonomous navigation using simultaneous localization and mapping (SLAM)—a technology that simultaneously estimates own location and maps its surroundings—and human-robot interaction using speech for dialogue exchanges and speaker localizations.

Not short of obstacles

But the quick development of the PoC was not short of obstacles. Besides the pandemic, one of the two major technical challenges faced by the teams involved was incorporating the semi-autonomous capabilities into a sandbox environment, due to the lack of common development and production environments.

Another challenge was achieving a sync between a low latency communication protocol that transmits messages and the video conference feature, due to differences in hardware infrastructure of the research lab and Pace Port Tokyo, and internet network compatibility.

Pace Port Tokyo plans to enhance the robot by incorporating voice-based navigation and advanced obstacle detection functions into this framework. The features implemented by the Tokyo team are promising in terms of what robotics and artificial intelligence can achieve for an enterprise in its journey toward digital transformation.