As an old archy student I seem to remember the idea was that the atlatl weight slid along the shaft of the atlatl. This would have the effect of increasing the angular momentum as the spear was thrown. In case there's any confusion brewing here, the atlatl stayed with the thrower and did not follow the spear in its flight.

I've always thought of them as purely functional. Never used one myself, though.