Their bones are solid, not hollow, which helps them float lower in the water, but reduces their ability to fly.
Also their wings are shorter and covered in small densely packed feathers, which aids in heat conservation and swimming ability, but again inhibits flight.
Not the mention the high amount of fat they have to keep warm often makes them too heavy as well.