Nope... mine is whiining like a pig :O) and it doesent stop again. Even when landed.
Have a look at what voltage your buzzer warning is set. Then test your Lipo when it's flat and see if the Lipo voltage is not above your warning voltage. If the warning voltage is not hit, the buzzer wont sound when the Lipo is flat.
Hope this helps... :)