Pilot AI Labs

A deep-learning based computer vision platform to solve real problems directly on compute-constrained embedded devices.

Our technology highlight reel

The videos below demonstrate just some of the capabilities of our deep learning-based visual perception algorithms.

FollowMe without a GPS tracker.


Using our real-time deep learning technology, we demonstrate the ability to follow any object using only the input from a camera. The video shows the real-time camera feed that the drone processes (bottom left) to follow targets of interest, including two different people and a car.
FollowMe: GoPro Footage


Using the same deep learning algorithms, we demonstrate 'follow-me' for people doing different activities. The drone is able to follow a soccer player as he makes quick movements and track a target even as he is occluded behind another person.

Real-time Distance Estimation from Webcam


Using Pilot AI Labs proprietary deep learning algorithms, we demonstrate depth estimation of an object using only a single USB webcam. No additional depth sensors or other devices were used.
Real-time Localization from Webcam


Using Pilot AI Labs proprietary deep learning algorithms, we demonstrate localization of the camera relative to another object using only a single USB webcam. No additional depth sensors or other devices were used.

GPS-Tracker Free FollowMe using Off-Drone Computation


Using a 5.8 Ghz analog video link, we stream video from the GoPro attached to the drone down to a small computation device (Odroid XU4, equivalent to a Samsung Exynos), apply our state-of-the-art deep learning algorithm to detect and track the target, and transmit controls back to the drone using the wireless telemetry transmitter.
GPS-Tracker Free FollowMe in the dark with the Intel RealSense


Using the Intel RealSense, our algorithms are able to robustly detect and track objects even at night, with extremely little light. Our deep-learning based approach intelligently combines all the information provided by the RealSense, enabling computer-vision in this scenario where a traditional camera would fail. Combined with our computer-vision based drone control, our follow-me technology works in both daytime and nighttime, without a GPS tracker.

Real-time Finger Tracking and Gesture Recognition


Using Pilot AI Labs proprietary deep learning algorithms, we demonstrate robust finger tracking and gesture recognition using the camera from a standard Nexus 6. No additional depth sensors or other devices were used.

The rock star team

Love working on hard problems and applying the solutions to real-world applications? We're hiring, reach out!

...

Jonathan Su

CEO & Founder

PhD '11, Stanford CS
Microsoft, Intel, eBay, Metamind.
CEO & Founder of Phisix Fashion Labs (sold to eBay in 2014).

...

Elliot English

CTO & Founder

PhD '13, Stanford CS
Numerical sim & high perf computing.
Post-doc at LBNL. Senior Data Scientist at Metamind.

...

Brian Pierce

CRO & Founder

PhD, Stanford ME (on leave)
Thesis on high perf computing.
Senior Data Scientist at Metamind.

...

Ankit Kumar

CSO & Founder

MS, Stanford CS/Math (on leave)
Deep Learning Researcher at Metamind.
Worked at Splunk.

...

Ray Gao

Senior Data Scientist

PhD '14, University of Toronto
Applied physics.
Yelp Data Science.

...

Wen Zheng

Senior Data Scientist

PhD '13, Stanford CS
Numerical sim & high perf computing.
Rocketfuel, eBay, Nvidia.

...

Ed Quigley

Data Science Intern

PhD Candidate, Stanford CS

...

Seth Hildick-Smith

Data Science Intern

MS, Stanford CS
Twitter.

...

Ron Fedkiw

Advisor

Professor, Stanford CS
Computer Graphics & AI Lab.
Computational math, computer vision, computational physics, computational biomechanics. Two time Oscar winner.

...

Kunle Olukotun

Advisor

Professor, Stanford CS & EE
Chip & multi-threaded processor design, FPGAs.
Founder, Afara Websystems (acquired by Sun).

Contact Us

Drop us a line at contact@pilot.ai.