I do both as well.
PvE can be really enjoyable as a social thing with your friends. It gives you and your crew a reason to hang out, some goals to achieve, and some memories to create.
PvP, on the other hand, can be a little brutal and unforgiving. Although, with Warlords, they have really...