By Teresa Marques, Centro de Filosofia da Universidade de Lisboa
Every five years, the Portuguese Science and Technology Foundation (FCT) reviews its research institutes from Astronomy to Zoology. But this year, for the first time, the FCT contracted the European Science Foundation (ESF) for the job. FCT’s resulting reallocation of funding will impact upon the career of more than 5,000 researchers – a third of the total in the country.
The methods of the review and revelations about the contract signed between the two foundations have mired the process in controversy. And the results might affect science funding policies across Europe.
It is not the first time that the ESF has been brought in for an evaluation. For instance, it was involved in a 2009 evaluation of the Bulgarian Academy of Sciences, which led to the decision to review all Bulgarian universities. According to Research Europe, following the evaluation, the academy felt it needed an “honest picture of where it stood in global research performance”.
Miguel Seabra, president of FCT, gave a similar reason for bringing in ESF. He argues the official reason was that an experienced and independent assessment from ESF would help find research units that are productive at an internationally competitive level.
However, there is a case to be made that some times global competitiveness is not the best metric. Some countries, even in Europe, need to focus on capacity building which would lead to excellence in the long term. For instance, FCT’s investment in the past 30 years brought the number of PhDs in Portugal closer to the European average. In that period, the level of productivity in research and science has grown exponentially. All this progress might be undone by the new review.
Two steps to disaster
The purpose of the ongoing review in Portugal is to identify the research units which meet these standards and redistribute funding until 2020. It is set up in two stages, the first of which is a knockout round. ESF set up seven review panels composed of international experts.
Results of this first phase, published in June this year, were devastating. About a fifth (22%) of all research units – institutes and university departments – were graded “fair” or “poor”. These units will receive no funds until 2020. About a quarter (26%) of such units were graded “good”, and they will get limited funding depending on their size. The remaining (52%) move to the second stage of the evaluation and stand to gain greater funding, based on money that will be taken away from the rest.
Even if the “good” units receive some funding, they will die out in the long run, because the allocated funds are insufficient to pay the most basic expenses. These units will also be disadvantaged in competition for other funds, because of this grade. That means, a total of 154 research units cannot continue their research, hire new people or train new graduate students until 2020. These units make up a third (5187) of the researchers. Naturally, this has caused much criticism among the research community.
According to the FCT and Nuno Crato, the minister for education and science, the money for research in Portugal has not decreased. This raises questions about the justification of the cuts to half the research units in the country.
Unusual review process
There are various objections to the first stage of the review. One major criticism is the lack of specialisation of the review panels. In contrast to previous evaluations for example, there are no longer separate panels for Materials Science, Physics, Mathematics or Chemistry, but only one “Exact Sciences Panel” consisting of 11 members. In comparison, the 2007 FCT review of research units had 25 different subject panels, some of which had more than 11 review members.
Nicolas Walter, who supervised the evaluation at the ESF, argues that specialist reviewers made up for the shortcoming: “While the seven panels each covered a broader spectrum of science, their members were assisted by two external referees for each application.”
Many research units, however, complain about review panels lowering the grades given by external reviewers, according to a blog founded by a physics professor. There are cases of huge differences in how external referees and panel members give grades, with external experts approving a unit and panel members failing to take on the advice, or vice-versa. For instance, this happened to the Philosophy Centre of the University of Lisbon, where I work, and with the Centre for Applied Statistics at the University of Lisbon.
The Portuguese Physics Society (SPF) and the Portuguese Chemistry Society (SPQ) have released official statements of concern with the process and its effect on Portuguese science. The Portuguese Philosophy Society intends to make a similar statement, as its president, João Cardoso Rosas, confirmed.
Consequences beyond Portuguese science
The first stage of the review was officially aimed at weeding out underperforming research units. FCT’s president Miguel Seabra denied that a 50% approval rate was recommended to the panel – “neither ESF nor FCT would have agreed to anything of the sort”. Beyond allegations of bias and factual errors, it has now emerged, after FCT finally disclosed the contract signed with ESF, that there was a quota stipulated from the very beginning.
The redistribution in funding will cut resources from many research units based in public universities, and concentrate resources in fewer institutions (including private foundations). There is no good financial or scientific reason to take away funds from already productive centres. FCT’s scientific councils, not involved in the ongoing review, publicly condemned the process, too.
The ESF’s review conveniently agrees with the recent shift in research funding policy in Portugal, which previously resulted in drastic cuts to PhD and postdoctoral grants. Other European countries in the same situation as Portugal, particularly those in the eastern part, should pay attention if they are considering an ESF review.
Teresa Marques is a senior researcher at the Philosophy Centre of the University of Lisbon until September 2014, and Marie Curie Fellow at the Philosophy of Law Group at University Pompeu Fabra from October 2014.
Teresa Marques is funded by FCT with a Ciência 2008 Fellowship, as PI of research project EuroUnders/0001/2010 within the EUROCORES EuroUnderstanding programme of ESF, and also as member of research project PTDC/FIL-FIL/121209/2010. She is also funded by the Spanish Government as a member of project FFI2010-16049 and of Consolider-Ingenio project CSD2009-00056.
This article was originally published on The Conversation.
Read the original article.
4 comentários:
In Portugal, everybody, every company and everyone is used to think that is (its) case is particular. This is perhaps, one of the reasons for such a low quality of law production.
I really do not want to take off, any of the good grounded reasons for the portuguese scientific community delusion and protest. They are sound, yes, but unfair and lack of ethic equity.
Teresa Marques is worried about one third of the portuguese researchers that are at risk of loosing their FCT's grants, due to government budgetary policy. However, same (or equivalent) worries are not evidenced about the two million unemployed portuguese (statistics of my own), or about another one million portuguese that will become insolvent next August 30th, after they have paid the 2013 IRS tax.
When will everybody realize that the government is cutting expenditure, just because it does not have the money to spend, or invest? The problem are not the policies, but the absence of political philosophy, ideology or a sustainable growth model(s), grounded on public debate and scrutiny.
Let's for once, be smart and use the knowledge to achieve some really important social and economic goals? Instead of spending precious time and resources "channeling the frog's leg?"
The comment above doesn't make sense, since the government itself claims not to be saving money with this process. One would understand if that would be the case. This so-called evaluation process is just the enforcement of a political decision to concentrate the funds available in a few selected research teams. This is a very questionable decision, since it effectively means that 50% of the research units will loose their funding.
with the all do respect, sure you believe still, in Santa Claus?
I do believe that against facts there is no argument and against valid argument there are persistent fallacies.
Enviar um comentário