The duck as a bird is said to be a symbol of superficiality, presumably because it floats on the water rather than in it.

In former times religious belief was tested by the ducking stool.