I don't mind getting ganked, because like you said, it's just part of the game. Gank and move on. When they sit there and camp you forever, ganking you over and over and try to keep you from playing, yeah, then I get a bit annoyed.
Oh man, I would love to play TBC again. I wish Blizzard would...