Archive for the ‘peer review’ Category

Who’s Afraid of Joe Tennis?

All of us in this business know how bruising it can be to get referee reports on our research papers. Even when the referees are gentle and helpful it still is embarrassing to discover the errors we’ve made in our texts. On the other hand, it’s a good thing they were found before publication. Of course, in double-blind peer review we are relying on the system for gate-keeping to make certain publications are original and rigorous and also that the research is replicable. That’s really the role of the referee.

Unfortunately, often referees produce really unpleasant reports. I know many of us have experienced this because we talk about it all the time at conferences and in the hallways at school. I really don’t know why referees find it necessary to be so rude, but it happens for sure. When I can, as editor, I edit the referee reports making healthy use of ellipses to leave out vitriol and just give the authors the critical commentary needed to revise the paper.

All of this is prelude, of course, for the most outrageous peer review I’ve ever received. Of course, I do not know who the referee was, although I suspect when I get done here, whoever it was, will recognize the points I’m going to make. Oh well, that’s why this is a blog ….

Clearly, whoever it was either knew who I was to begin with or sussed it out from the methodology and context. Let’s face it, in a small field like knowledge organization we all know each other well enough to recognize each other’s writing. And often we have the situation of being one of only two or three authors in an area, which leads to a lot of self-citation in order to cite the most relevant prior research. Be that as it may, whoever it was reads my editorials in Knowledge Organization–the ones that are simple bibliometric analyses. I have limited space of course, and I try to focus the editorial as commentary on the evolution of the domain. But I also deliberately state that I am just giving a few simple metrics. I always post my data files here, and encourage others to download those files and take the research further. So far as I know, nobody has ever done that.

But, please–here is what this anonymous blind reviewer wrote: “Two or three observations and we move on … or maybe there is really nothing more that can be said? … Are we supposed to do the analysis ourselves?”

Umm, yes, that would be the idea!

Okay, I took the point and extended the analysis into excruciating detail in the final version of the manuscript. But, yes, the idea of science is that we all work on the same problem sets to try to advance understanding! Please!

But, the title of this post comes from the best, which I’ve saved for last. I had quoted a paper that I believe will be seen as seminal by Joe Tennis (you know, author on subject ontogeny, knowledge organization domain analysis, ethics, etc., and current president of ISKO?). Not wanting to copy wholesale (because, that’s not what we do in science, is it?) I made reference to the article and cited one or two points. Here is how this referee indicated more detail would be useful: “but most of us … will
not necessarily have time to read Tennis.”

!!!

Well, I want to reply, “you’d better find the time!” For goodness sakes, people, this is why we have text referencing. If you haven’t read the paper being referred to, you are supposed to go do that!

Sigh.

Posted January 6, 2015 by lazykoblog in peer review, writing

Tagged with , , ,