I believe the Whigs' colour was buff (tan or yellowish). I think you find this in Dickens' description of an election in Pickwick Papers.