Today we were having a discussion about aircraft control via different flight modes. Personally would prefer to change the way input happened when controlling the UAV directly, so that the input is more intuitive in nature. I have seen allot of really well designed controllers recently however little that changes much of the traditional levers and dials, and nothing a single puck. Maybe there is something to that Star Trek control. Above is just a quick conceptual collage. The base was squished as you can see the original here, and was quickly modified to stimulate thought on how a typical RC twin 2 axis stick design could be evolved so that a more intuitive control can be developed. The center puck above is a true integrated 6 axis control, all that can have coordinated intuitive movements for the UAV.
Here is some of the verbiage from the 3dconnexion.com:
"Superior 3D Navigation
SpacePilot Pro’s patented 6-Degrees-of-Freedom (6DoF) sensor is specifically designed to manipulate digital content or camera positions.
Simply push, pull, twist or tilt the 3Dconnexion controller cap to intuitively pan, zoom and rotate, while your other hand simultaneously uses..."
Ordered one today to take it apart, and see how I can hack together a solution, possibly integrating a board computer and a small wifi-bridge/ap so that it can be used as a integrated base station.
It seemed obvious since the object we are controlling actually operate in a 3D environment that the controller especially when operating FPV or "First-Person-View" should be able to translate that intended movement as turn left right, up down, and with a few that could be atypical due to the way and coordinated function of the device and its ability to tilt or go sideways, possibly to engage linear thruster type dives.
The Myo and the 6-Axis mouse will be a fun combination, it will be interesting to integrate tactile and and virtual gesture based movements.
Dev Team
Comments
Hi Scott,
i am not sure i understand very well what you are talking about when you mention to be more " open" ? If you mean to open the software code, it is unfortunately for the moment not possible for a simple reason : we use the genuine keyboard of the 3d connexion mouse( buttons) and this hardware is a closed source. Also, just to explain, many companies in France are willing to get their hands on the controller, and some try to get some government funds to so called " develop" new controllers based on our work. I made the luxury gimbal,and gave informations, our motors with small PCB connector have become generalized in china for the gimbals, then our designs have been taken and we lost our investor because of this, and believe me we have been running ( and still are) through pretty rough times, so now i protect a little what i do. Execution of the idea has been done already, meaning the system is 100% operational and now we would like to industrialize it. This takes time enduring that time we must rein a little careful ( past lessons learned). But one thing i can say is, that the platform will be " opened" in some ways i know that we will need to offer something " open minded" at a " friendly price" for the open source community if we want it to be successful.Open source is something i highly respect but behind the open source there is, unfortunately, a reality of product production and banks are everything but open source ( lol ). In a few words, i do not want to share some work we did since over 2 years now to see it thrown on a crowdfunding platform by some people claiming they had the idea of the century because this is what we see everyday on the crowdfunding sites for many " ideas" unfortunately. I hope i expressed myself in the right way, i do not mean to hurt anybody, i'm just a small company, i know how vibrant the scene can be by nice actors helping things to move forward, but i know also that this scene is so vibrant that we see some guys building mikrokopter hexacopters and selling them 25 000 euro ( yeah !) and they would do anything including rip off other people's ideas and try to get money over it. So things are not that easy, sure thing is, we try to make it right and faire but not only for others, for ourselves a little also for once... :)
Nils, looking forward to your contribution. In the next few months we should have the developer units availible of our base layer smart shirt. This is position and vibration sensing without the need for optics or camera may make it a bit more mobile. If you want to get on the developer list for these pm us your info, info@digi-dna.net
Fabien: I do have a Multiplex that has twist on the right stick, - this 3d puck affords much more movement, as I am sure you can attest
Jake: form to this point is following function, ascetics will be considered later, up to this point I think the beauty is in the collaborative and inspiring nature of this thread, the solutions presented and the progress that is now realized, for me at least the education was very helpful to my efforts and can only assume it is to other as well.
Received a very encouraging email from Paul # 3dconnexion.com, looking forward to the continued development.
What is the controller could be mounted to a forearm? Somewhere I have some crutches I will scab together for a POC, this mad solve a few things for me...
POC setup
Thinking a board computer as a host, then USB to a space mouse. BBB Board comp running digi-mint (really just a personal port of the Linux mint line) with Bluetooth on-board. I have several Edimax usb modules. Once I get it working I will post the solution. Use the MP and set the ip pass through for the joystick inputs.
Integrate the myo armband so that with VR goggles a virtual reality arm is projected in the field of vision, using a few leds for optical positioning of a texture mapped open gl model. Not quite sure how to track all the movement without a few secondary vision systems, I will have to cross that bridge later.
The interface in this movie was also intriguing, and quite possible if the 360 virtual screen is replaced with VR goggles and positional tracking it should be quite possible. I do think I will add a few additional accelerators for vibromyographic input positions. I do not think this movie was very popular, kinda glad I caught it even though Anthony Micheal Hall, the nerdy kid as I remember of movies growing up snaked the girl I thought I chance with in College. Then again at least I can say I dated her before and not after.
Hi, this is simply Curtis Youngblood who uses a JR transmitter ( standard) modified by himself, this is the way he flies :).
Reminds me of the controller used in FliteTest's review of the Stingray 500.
http://www.flitetest.com/articles/stingray-500-review
At about 3 minutes into the video they go outside and discus the controller a little bit before putting the craft through its paces.
Sam, very interested, also in replicating your setups here...
Alex,
We are shortly getting a small patch of products put together for field trials. If you are interested, we could probably send you a Wing to test?
Sam
Hi Alex,
expo, dual rate and °/Second or meter / second are exactly the same as on a standard transmitter.
The feeling is a bit different, we have a tweak on the system, but in fact is very intuitive as if you release the sensor, well it's like all controls on a standard transmitter are back to neutral.
For example, it is much nicer to fly a Phantom with the joystick that with the original transmitter. reason being, you setup attitude gain in the DJI assistant software which is the same as setting up dual rates on a transmitter, which you can not do of course on the stock DJI transmitter. Then, you can modify the deadband and the exponential.
I have seen so many people buying " expensive" rigs such as S1000, S900, and when they come at the workshop to ask for help because they can not " feel" the machine in flight, we discover that except the Attitude gain there is nothing setup on the machine or the Zenmuse gimbal on the transmitters. 5 minutes of simple dialing ( Expo / dual rate , for each flight mode, throttle curve for changing from attitude to manual without having the machine jumping or dropping on throttle, and End points / dual rate / expo on gimbal Tx and the customers feel like they have a brand new system in their hands, much more comfortable to fly..
This is exactly the same with the 3d Sensor : you have to adapt each axis sensibility to make it natural. It has always been a kind of " compromise" between mechanics and electronics for any Rc model or UAV ( a UAV is a Rc model called Drone or UAV, must be better for marketing lol...) . If the mechanics feeling on the input does not reflect or transmit the behavior you would like the machine to have, then you can have the best system in the world, it will simply not be matching our expectation.
So what we do is that we setup a "base" setup on which most people feel confortable, but then we modify it for each pilot needs and feelings.
If you need to twist the sensor like crazy to get the machine flying the way you want of follow the trajectory you wish, it will be the same that if you have to move your 2 Tx sticks like crazy to manage the 4 channels (Ail, Elev, Throttle, yaw) : your fingers coordination and extensions in the movements will become.. erratic and not accurate. Have you ever tried to make a vertical climbing followed by a spiral ( elevator / yaw / roll input) at perfect constant rate ? That is not that easy and results will change depending on your flying skills but also on the TX settings.
Finding the right match on the electronics settings ( sensitivity, dual rate, expo...) is exactly like seeing up your seat on your car to feel confortable with the pedals and the steering wheel. Once you get this solved, everything else is much easier to handle and more " natural".
What we found out is hat most " beta testers" do not use the yaw so much except to change the orientation for the camera once they find the right spot to look at, or will use the yaw but alone for some time and then go back to cyclic and throttle ( altitude should we say..) control. But what was very " educational" was to see how people simply natural " decompose" the action they want to perform. As the 3D sensor is just intuitive, they move from an action to another ( for example climb, stop, turn left, move ( roll) right, move forward, descent a little, turn right, backward..) in a decomposed pattern and do it very naturally. Then , after some practice, they start to mix the different inputs by themselve without making major mistakes very quickly. If you give them a transmitter, they mix inputs not by willing but by the lack of coordination and assignment of each control on 2 separate sticks. They wanted to move forward but climbed instead. They wanted to turn left but rolled left instead.. and so on. This is confusing for them and they finally spent more time focusing on how to give the right input rather than checking how to control the machine. This is what we could observe, but maybe i'm wrong, i'm not a cognitive or psycholmotrician specialist, but i asked a psychomotrician doctor and he liked the intuitive feeling of the 3D sensor, because simply no particular coordination learning is necessary at all to handle it. It's as easy as rubbing an object and moving it, like the cube demo software for the ones who know it :)
To answer your question fully, the throttle / altitude is very easy to handle, since DJI and Mikrokopter ( for 3DR i need to test) now do not take off in Barometer (MK) Attitude or ATTI/GPS mode (DJI) as long as you do not move the throttle over 50% ( neutral). So in a few words, you launch the motors with press of a button ( simple 4 channels instant sequencing), and as soon as you will pull the sensor up, machine will take off, at a height of 50 cm or 1 meter already barometer is working fine enough to control perfectly the altitude. It would be much harder if we did not use the barometer / altitude control, this is a fact. But flight controllers give us that " ease" and using it is just so perfect i have to admit. So once you are hovering, except small corrections or altitude changes needs, there is not a lot you need to do, and playing with cyclic or rudder does not affect throttle with the right settings and after one or 2 flights to get used with the system.
In short, when you leave the controller at it's neutral well altitude changes are very small with a well setup and well balanced machine, so you can sue line of sight or onboard FPV or simply the telemetry to check that altitude. Same as on a standard multirotor i would say, when using altitude control of the flight controller.
Once important thing we found out is that for " nose in" flight, unexperienced pilots were more confortable with the 3D sensor than with regular transmitter ( inverted inputs). I would guess that it's because there is only one input so inverting is easier to handle ( you rotate something for the yaw, you do not give a " stick side input", and it seems they "ink" roll and yaw kind of easier with he 3D sensor for nose in.
In fact, if you look at the " mass" customers market all using something like a DJI Phantom do NOT know how to fly without the GPS and IOC... So many people fly multirotors only because of these features. This is also the main reason why Drones / Multirotors now come more and more to government / civilian security / army usage, as they are much easier to fly than Rc helicopters. Self leveling was the first real " revolution" in multirotors. Remember the Intellicopter, back in 2004, and check who they have become since. It was my first contact with a multirotor in paris, and i performed the demos for the french distributor. It was soon easy to fly compared to our Rc helicopters or the large coaxial UAV's we were flight testing at that time.. GPs and Intelligent orientation control then arrived with DJI ( but the first true autopilot allowing to fly a RC helicopter in such an easy way was the Carvec System from John Cunningham, the most safe and reliable system i have ever seen).
Add lipo batteries ( flight time), brushless motors ( power and constant efficiency), field oriented control ESC's ( we work on such things but that's another story. and someone on this forum works already on a very interesting concept....) , simple mechanics ( multirotors) and you get a simple, efficient, and cheap platform that can be flown by virtually anybody.
The 2 most solid systems i have ever flown so far ( but i have not had the time yet to fly the 3DR, i will take that time over the week end) are the Carvec system and the " Box" from Steve Webb (check my vimeo channel with the small F550 and the black box on it) which has become then the Movi controller and that will be the Synapse i guess later on...
Now my guess is that beyond the input controller, the most important thing is the GPS and positioning system safety, actually i think that industry is pretty far away from something totally reliable , but many progresses have been done and coupling accelerometers datas to GPS datas, if done correctly, will allow in the future to get an extra positioning or return to home greater safety. Spectral analysis ( stars) for night flight, sonars, lasers, cognitive systems ( TESC in France by captain Gigean from Army, the greatest anti collision system in the world, truly..) will lead to more and more safety and input controls will need to be as simple as possible.
This is on a ethical point of view a good thing for a bad thing, as if anybody can fly anything with almost no training, risks are exponential in case of electronics failure or simply wrong intentions. This is why FAA is trying to ban UAV usages ( a lot of fear from bad intentions with such easy " tools") and it would not be surprising that in a close future, Google and major actors of real aircraft transponders work jointly in order to have kind of " serial number" and traceability of each machine in the air ( will require users acceptance to transparence and registering, will not be easy.....) for better skies management and improved safety.
At our level, we focus on the input control, it's a small step compared to all the things that are evolving very fast now, but i think it's in the right "' loop" direction ( well, i hope lol).
I do not say we invented the wheel, some other people might have had these ideas since a while ( well the initial post here showed we were not the only ones working on an alternative control system) , we just try to keep the last year evolutions in term of flight controllers moving on with the way to control them. But there is so much to do :)))
-
1
-
2
-
3
-
4
of 4 Next