Almost every webmaster deals with a server.
Well yes but so do users. It's not a matter of whether they "deal" with servers or not, it's really about the degree. The problem I see is that we don't have even a vague definition of "webmaster".
I believe that most people see a webmaster as someone who maintains the web site itself. i.e. The actual content that's seen when you visit the site. They should not be allowed to fiddle with anything lower down the filesystem tree than the documents directory.
Unfortunately (in more than one sense), many of us on SF suffer from the problem that we are also involved in other roles, including that of webmaster, which gives us a very tilted view.
I think the definition quoted by sysadmin1138 is a very good one, as it draws some pretty neat lines that I think reflect realty for most people.