Saturday, 15 February 2014

Opening Black Boxes

Those of us that have been lucky enough to see presentations from Tim Cahill will have been quietly pleased to hear that the ARC has plans to improve the feedback institutions get from the peer review process. Apparently we can expect to see some nifty metrics showing how each reviewer characterized our peer review selections.

This is a great start towards opening the impenetrable black boxes that are peer review disciplines. 

Realistically it may be the best we can get from this part of the process.  It's never been clear in any case that the panels give much weight to the opinions of the peer reviewers - why would they - they can and do read the peer review material themselves and no doubt form their own opinions.  Regardless we will start to understand how the material we nominate is regarded.

Now what do the panels think? 

And do context statements make any difference?  I'm sure we have all heard wildly varying views on that.

Oh and how many minutes did they spend discussing your institution.  That can't be secret can it?


No comments:

Post a Comment