To have no (or very few) friends

is no big deal.
But to have enemies can be fatal. 
Poor old Joe
(failed-poet and lapsed-seminarian)
Vissarionovich Djugashvili had thousands.