My grandmother called this 'the part that goes over the fence last'

The vertebral column is completed in the tail region by a flat plate known as the pygostyle, which forms a support for the rectrices, or steering tailfeathers.

Also in this area in some birds there are the glands that produce oil to condition the feathers.