A review of South Africa’s National Research Foundation’s ratings methodology from a social science perspective
One of South Africa’s National Research Foundation’s (NRF) activities is to award ratings to academics who apply according to predefined categories. Explicitly or not, these ratings are part of submissions academics make for promotions and for employment in South African universities. As such, metho...
| Main Author: | |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Academy of Science of South Africa
2018-03-01
|
| Series: | South African Journal of Science |
| Subjects: | |
| Online Access: | https://www.sajs.co.za/article/view/4817 |
| id |
doaj-1e3b8f56d3b84278851a0f59e036a26e |
|---|---|
| record_format |
Article |
| spelling |
doaj-1e3b8f56d3b84278851a0f59e036a26e2020-11-24T23:11:36ZengAcademy of Science of South AfricaSouth African Journal of Science1996-74892018-03-011143/47710.17159/sajs.2018/201703444817A review of South Africa’s National Research Foundation’s ratings methodology from a social science perspectiveChris Callaghan0Economic and Business Sciences, University of the Witwatersrand, Johannesburg, South AfricaOne of South Africa’s National Research Foundation’s (NRF) activities is to award ratings to academics who apply according to predefined categories. Explicitly or not, these ratings are part of submissions academics make for promotions and for employment in South African universities. As such, methodological assessment of the validity of this system is important. This paper seeks to conceptually evaluate certain characteristics of this system against certain general principles of reliability and validity. On the basis of the results of this evaluation, it is argued that assumptions that the NRF rating system is always valid or reliable as a differentiator of individual academics cannot be made unconditionally. Using Management Science as an example of a social science field that draws from multidisciplinary theoretical and methodological frameworks, this paper identifies certain validity issues associated with the current NRF rating system, and makes recommendations for improvements. Significance: • Certain validity issues are highlighted and arguments are made to improve the methodology used by the NRF to rate researchers. • Issues related to multidisciplinarity and mode two knowledge production are considered. • Technological advances that have made it possible for scientific measurement of research productivity and impact are discussed. • Problems with subjective methodologies are identified, together with their ethical consequences.https://www.sajs.co.za/article/view/4817scientific methodologyNRFrating methodologySouth Africasubjectivity bias |
| collection |
DOAJ |
| language |
English |
| format |
Article |
| sources |
DOAJ |
| author |
Chris Callaghan |
| spellingShingle |
Chris Callaghan A review of South Africa’s National Research Foundation’s ratings methodology from a social science perspective South African Journal of Science scientific methodology NRF rating methodology South Africa subjectivity bias |
| author_facet |
Chris Callaghan |
| author_sort |
Chris Callaghan |
| title |
A review of South Africa’s National Research Foundation’s ratings methodology from a social science perspective |
| title_short |
A review of South Africa’s National Research Foundation’s ratings methodology from a social science perspective |
| title_full |
A review of South Africa’s National Research Foundation’s ratings methodology from a social science perspective |
| title_fullStr |
A review of South Africa’s National Research Foundation’s ratings methodology from a social science perspective |
| title_full_unstemmed |
A review of South Africa’s National Research Foundation’s ratings methodology from a social science perspective |
| title_sort |
review of south africa’s national research foundation’s ratings methodology from a social science perspective |
| publisher |
Academy of Science of South Africa |
| series |
South African Journal of Science |
| issn |
1996-7489 |
| publishDate |
2018-03-01 |
| description |
One of South Africa’s National Research Foundation’s (NRF) activities is to award ratings to academics who apply according to predefined categories. Explicitly or not, these ratings are part of submissions academics make for promotions and for employment in South African universities. As such, methodological assessment of the validity of this system is important. This paper seeks to conceptually evaluate certain characteristics of this system against certain general principles of reliability and validity. On the basis of the results of this evaluation, it is argued that assumptions that the NRF rating system is always valid or reliable as a differentiator of individual academics cannot be made unconditionally. Using Management Science as an example of a social science field that draws from multidisciplinary theoretical and methodological frameworks, this paper identifies certain validity issues associated with the current NRF rating system, and makes recommendations for improvements.
Significance:
• Certain validity issues are highlighted and arguments are made to improve the methodology used by the NRF to rate researchers.
• Issues related to multidisciplinarity and mode two knowledge production are considered.
• Technological advances that have made it possible for scientific measurement of research productivity and impact are discussed.
• Problems with subjective methodologies are identified, together with their ethical consequences. |
| topic |
scientific methodology NRF rating methodology South Africa subjectivity bias |
| url |
https://www.sajs.co.za/article/view/4817 |
| work_keys_str_mv |
AT chriscallaghan areviewofsouthafricasnationalresearchfoundationsratingsmethodologyfromasocialscienceperspective AT chriscallaghan reviewofsouthafricasnationalresearchfoundationsratingsmethodologyfromasocialscienceperspective |
| _version_ |
1725603724105089024 |