FollowMe without a GPS tracker.

Using our real-time deep learning technology, we demonstrate the ability to follow any object using only the input from a camera. The video shows the real-time camera feed that the drone processes (bottom left) to follow targets of interest, including two different people and a car.

FollowMe: GoPro Footage

Using the same deep learning algorithms, we demonstrate 'follow-me' for people doing different activities. The drone is able to follow a soccer player as he makes quick movements and track a target even as he is occluded behind another person.

Real-time Distance Estimation from Webcam

Using Pilot AI Labs proprietary deep learning algorithms, we demonstrate depth estimation of an object using only a single USB webcam. No additional depth sensors or other devices were used.

Real-time Localization from Webcam

Using Pilot AI Labs proprietary deep learning algorithms, we demonstrate localization of the camera relative to another object using only a single USB webcam. No additional depth sensors or other devices were used.

GPS-Tracker Free FollowMe using Off-Drone Computation

Using a 5.8 Ghz analog video link, we stream video from the GoPro attached to the drone down to a small computation device (Odroid XU4, equivalent to a Samsung Exynos), apply our state-of-the-art deep learning algorithm to detect and track the target, and transmit controls back to the drone using the wireless telemetry transmitter.

GPS-Tracker Free FollowMe in the dark with the Intel RealSense

Using the Intel RealSense, our algorithms are able to robustly detect and track objects even at night, with extremely little light. Our deep-learning based approach intelligently combines all the information provided by the RealSense, enabling computer-vision in this scenario where a traditional camera would fail. Combined with our computer-vision based drone control, our follow-me technology works in both daytime and nighttime, without a GPS tracker.

Real-time Finger Tracking and Gesture Recognition

Using Pilot AI Labs proprietary deep learning algorithms, we demonstrate robust finger tracking and gesture recognition using the camera from a standard Nexus 6. No additional depth sensors or other devices were used.