After swapping ESCs with an other arm it seems that it is motor related. The 'problem' stayed with the motor when two ESCs were swapped around. One again I also moved the signal connectors back and forth. All situations resulted in the same motor demonstrating this 'twitching' behavior.
This is a terribly boring problem... I want to get onto the 'good stuff'. ;-)
Any more ideas?