It's definitely not an insult to be called a drummer (I've been one since I came into this world). This whole concept of titles is quite interesting to me. See, I'm also classically trained to play all percussion instruments. So when I'm in a classical setting I'm a percussionist. Where I'm from, ina classical setting anyone who plays any percussion instrument whether it's marimbas, chimes, timpani or even the set is called a percussionist.
Now, outside of classical settings, the titles split and there people typically call you what they see you play. I play the sax, the keys, and the set in church, so I've been strictly associated with each individual instrument on different occasions. Thats when the all encompassing term musician comes into play. I had a conversation one day with a guy who said that I'm a musician and he's just a piano player, because he wasn't trained in to play the piano. But I was only trained in percussion, and I was playin' the set loooong before I learned to read for it.
So that goes to show that the terms are all relative. Either way drummers AND/+ percussionists are the coolest cats there are...PERIOD. (ok...actually ALL musicians in the building of the Kingdom of Christ are the coolest)