Evaluating Grant Proposals for the European Commission

This past Sunday night, I hopped on the Eurostar from London St. Pancreas–and in just over two hours I disembarked at Midi station in Brussels. I love that Chunnel!

I’ve spent the week working alongside other experts from around Europe to evaluate projects proposed for funding. This is an activity I am doing to develop more skills with regard to grant writing and program design.

img_2058

Aongus took the underground over to St. Pancreas Sunday night, to see me off as I boarded the Eurostar.

This is a job that requires a great deal of concentration. We’ve each been working for weeks–studying 30-page proposals, 7-8 of them per expert,  and then creating very detailed individual reports, comparing and compiling these into group reports, and then meeting face-to-face on-site in Brussels to discuss each proposal in depth. The scores we assign will be used to determine which organizations will receive funds to support doctoral and post-doctoral researchers.

 

Through this process, the European Commission and its Research Executive Agency (REA) provide detailed, specific feedback to applicants as well as numeric scores.

Many applicants succeed and receive financial support, but I’ll admit that with the sums provided, competition is fierce.

I believe this funding is well spent. It builds the capacity of researchers to do great work and learn important new skills. It yields results that make life and systems better at the individual, organizational, national, regional, and international levels. It produces valuable research results in a vast array of fields and disciplines.

The evaluation process is extremely important. It has to be done with extreme care. It is a huge amount of work, and the experts involved take the job very seriously.

img_2069

The evaluation itself is confidential, but pictures of Brussels I can share. 🙂

Many dozen experts have been involved this week, as reviewers and quality control officers. Our purpose is to deliver accurate and reliable results.

 

As a scholar from the States, I particularly value the feedback given to applicants in this process. Great care is taken to keep the scoring open, transparent, and fair, and to yield consistency from year to year as well as between proposals.

It’s a tight-knit process with a demanding timetable. And we’ve done remarkably well at staying focused and on track.

Why do I see the results of this process as valuable? In the U.S., fellowship and grant applicants rarely get feedback. I suspect it’s a result of the litigious nature of “American” society that funding agencies don’t want to open themselves up to questioning, and they won’t let applicants know what was seen as weak about the proposal. They will provide only very general feedback if any at all. I’ve had this experience with at least three different funding agencies in the USA. It was exceedingly frustrating and turned me off from wanting to keep bashing my head against a rock (even though I had a relatively high level of success winning grants for educational/learning sciences!).

img_2132

The plaza next to the building where evaluations are conducted.

Working here at REA, our primary focus is on achieving accurate scores that can hold water. There’s much less paranoia on the part of the funders, in my opinion. In fact, there doesn’t seem to be the same fear of redress–in the case of any mistake, the program managers actually do want to address it in a way that is fair to the applicant. Transparency and proper channels for redress/appeal are foundational principles of the programs that REA funds.

 

Because REA’s process provides reliable feedback, I myself was able to improve one past proposal that wasn’t successful on its first submission. I was able to learn and to re-submit. By addressing the points raised in the first evaluation, I was able to secure funding the second time around!

In the United States, I’d have been left in the dark, making the same mistakes over and over again. In my experience (having submitted 3 unsuccessful proposals, 2 successful proposals, and one pending proposal to various  MSCA programs evaluated via REA), the European evaluation system is FAR better than the US system. A knowledgable colleague told me yesterday that the overhead costs for evaluating and managing/overseeing the quality of these MSCA programs is lower than typical of other similar programs worldwide.

img_2111

Dinner at Lyon!

I can’t say this work is pleasurable, but I do enjoy being here, working hard, and feeling satisfaction by week’s end. It’s sometimes bittersweet, though, as it is Thanskgiving and, also, yesterday would have been Dad’s 74th birthday. He died five weeks ago, right after my assignments for this job arrived. Therefore, I didn’t get to talk with him yesterday. And, since this particular review always falls on Thanksgiving week, I’m spending my fourth Thanksgiving Day in Brussels, missing turkey in the States with family yet again.

 

In the evenings of this evaluation week, however, I do enjoy dinner out with other experts and my walks through the city to the Grand Place and the Royal Arcade. Hopefully tonight, the Christmas Market will be up and running! It’s 6:40PM so I need to get going and pack up my things for the night.

On Monday night I went out and I got to enjoy Moules et Frites at Lyon.

If you are capable and interested in serving as an expert evaluator, you can set up a personal profile in the Participant Portal (see instructions at https://ec.europa.eu/research/participants/docs/h2020-funding-guide/experts/experts_en.htm). When REA needs your expertise, they may well send you an invitation to serve.

 

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s

This site uses Akismet to reduce spam. Learn how your comment data is processed.