iVxR-cDCosEPAXCiDOw9oFAw6FqNJv_8sQQrQlbobsJn_aY5nFgD8rQRoiduizkHW54GfBpyIpG_ffqIddnxt810ObRIxNA72epluQSWeAi8SpY1tgxdNDU78ikeQxMRXw

Hi,

 

As promised, more details are now available. NVIDIA is our technological partner and Percepto is powered by the Tegra K1 SoC.

Thanks a lot for your feedback and interest in Percepto.

After getting many repeated questions I have decided to answer some of them here to clarify some things.

 

What exactly is Percepto?

Percepto is a drone add-on. Meaning it’s a device (about the size of a deck of cards) and a small camera that you connect to your existing drone. Percepto enables new features you didn’t have before. It enables your drone to use the power of computer vision in real time. With computer vision drones can “see” and understand the environment better than with todays sensors.

 

What exactly can I do with it?

You can develop and use computer vision based applications for your drone. By using our drone control API and pre-accelerated computer vision primitives, you can focus on your application, and get results a lot faster.

For example, let’s say you want to control your drone using hand gestures. With Percepto, you already got the hardware ready, so you can either write your own code or use Percepto’s core hand recognition primitive, as well as our APIs to easily direct the drone’s movement. Now all you need to do is decide what the drone should do after each gesture, and write a simple code that describes just that. After connecting Percepto, you’ll have a hand gestured controlled drone.

 

I am not a developer, is Percepto for me too?

Absolutely. Developers will only be motivated to create new applications if users will be there to appreciate and enjoy them.

Also, we will ship Percepto with a few applications of our own, like: .

Our filming app (Name ideas are welcomed)

Using your smartphone, mark any object and have the drone follow it, circle it or create any filming maneuver you desire with a click of a button. Since Percepto works onboard and in high rates it is very responsive and can create filming maneuvers in higher speeds and smoothness than todays GPS based features. We are constantly working with professional aerial photographers to improve Percepto’s filming capabilities.There is also a mode where Percepto controls the gimbal alone, leaving the drone control in your hands.

OSD (On Screen Dispaly) app (Again name ideas are welcomed)

A customizable heads up display, driven by our computer vision algorithms which can produce smart alerts such as obstacle advisory, object searching or even locations of additional Percepto powered drones flying nearby (We use it like a radar when we drone “dogfight” ;).

Percepto will constantly update with applications developed by us, as well as applications developed by our community. So, if you’ll own a Percepto, you will be able to experience any new exciting application released.

 

Does Percepto include a flight controller?

No, it integrates with existing flight controllers like 3DR Pixhawk and DJI Naza. After considering safety issues, ease of development, processing resources and the commercial drones ecosystem benefits, we came to the conclusion that the computer vision unit should be set apart from the flight controller.

 

How do I physically connect it to my drone?

Percepto connects to your drone the same way a camera gimbal, an FPV transmitter or DJI Lightbridge connects to your drone. It needs power from the drone battery, and a connection to the drone’s flight controller. All cables will be included.

Percepto Platform.png

 

Which drones can I connect it to?

We’ve already tested Percepto with 3DR Pixhawk and DJI Naza controllers, so, every drone that uses one of these controllers is compatible, but basically, you can connect it to every drone that has a PPM input in its flight controller.  Also, the drone can’t be too small, as it has to carry Percepto, which will weigh around 5 ounces (140 grams).

 

How is Percepto different from other development platforms?

Percepto is a state of the art processing platform tailored specifically for drones. The connectivity is designed for this specific use. The camera we’re shipping with Percepto is focused on frame rate and minimal distortion. Above all, our computer vision primitives are accelerated on Percepto’s CPU/GPU (NVIDIA Tegra K1) and our APIs make it easy to translate software decisions to drone flight maneuvers.

 

How will Percepto control the drone?

Depending on the application and the flight controller in use, Percepto can control the drone through PPM (just like an R/C receiver), or it can communicate with the flight controller through a digital connection (MAVLink, for example). Percepto can also be set to control only part of the control channels, leaving the others for manual control.

Percepto itself can be controlled either by your RC remote, or with your smart device through WiFi.

For some features, “follow me” for example, Percepto might fly the drone completely autonomously. In other cases, such as obstacle avoidance, Percepto might only intervene partly with the drones flight route or manual control.

Another option is to use Percepto for completely different tasks like augmented reality FPV or performance monitoring.

 

When will it be available?

We will start shipping Percepto to selected beta testers in July 2015. It will become publicly available by September.

 

How much will it cost?

We are now finalizing mass production costs with our different suppliers. This is why we have decided to launch our product in a crowdfunding campaign soon. I know it’s already became a cliche but it’s true, the more products we will have pre-booked and the more demand we will see for the product the lower we can make the cost.

Again thanks a lot for your interest!

We would really like to hear any thoughts, questions, remarks or expectations you have from Percepto

Please don't hesitate to contact us with any issue.

If you are interested in learning more please subscribe on www.percepto.co.

All the best

Raviv

 

E-mail me when people leave their comments –

You need to be a member of diydrones to add comments!

Join diydrones

Comments

  • A smaller version that could be carried by a 250 quad racer would be pretty nice... I can imagine having an assisted fly controller for obstacle avoidance... How much weight would the unit have ?

  • Thanks for the comments.

    We are editing some of our test  flight video's, we will post them soon

  • Developer

    I know it's been a couple of weeks since this was posted but I just wanted to add that this could potentially be used for precision landing and maybe object avoidance.  I'm very much looking forward to it's release and hopefully we can get some integration with arducopter working.

  • At last, some proper CV kit for drones.

  • Moderator

    Without Ethernet port I not connect any network device. :)))

  • @Vladimir  - there are a couple of ways to transfer video with Percepto. You may chose to use an API and transmit h.264 over wifi, or use the micro HDMI port. 

  • @Randy - thanks for commenting. We're communicating with Pixhawk via MAVLink, and currently are working with Ardupilot. However, we do intend to explore communicating with PX4 among other flight controller software.

    @Jamie we do support mip-csi and also usb3 if needed, but no ethernet port. Percepto has usb2 and micro-hdmi for desktop use.

  • Moderator

    No Ethernet? How to translate video to ground?

  • @Robin and @Raviz

    Cool thanks, the board does look really promising. I've been looking for a small embedded board to do stereo vision with mipi-csi cameras.

    I can't see an ethernet port - is there one on the other side?

  • @Raviv: I have been a huge fan of Tk1 and been a strong contender for its use in drones. I implemented accelerated version of OpenTLD on a Tk1 to create a "Follow me" drone based on computer vision. Is percepto working on a similar techonology or a completely new tracking software will introduced by Percepto.

    I am really excited about the hardware customisation that Precepto has managed to accomplish (shrinking Jetson TK1 ) into a card side hardware. 

    The possibilities are endless, Percepto is inching towards creating iphone for drones which will allow developers a hardware platform to build endless variety apps on top of it. 

This reply was deleted.