otherwise there would be but despair among the majority of us

Or, as is so often said:

the majority is the despair of us.