Please note: You are using an outdated version of Internet Explorer. Please update to IE10 here to properly experience the ATI website.

17.

DG Enlargement

Fair

ATI_Donor Graph-17

OVERVIEW

DG Enlargement is responsible for managing and assisting the process whereby countries join the EU. It manages the bulk of the EU’s financial assistance to candidate countries and potential candidates, as well as to new member countries during a transition period following accession. See EC-wide commitments and recommendations.

DG Enlargement should be congratulated for beginning publication to the IATI standard and for producing an ambitious implementation schedule in July 2013. DG Enlargement’s first publication marks a good start, covering 18 IATI fields. As per its implementation schedule, it plans to publish to 72% of IATI fields by the end of 2015.

ANALYSIS

DG Enlargement scores 48.1%, placing it in the fair category. It is among the biggest improvers in the 2013 Index. Although DG Enlargement ranks lowest amongst the EC departments, it performs better than many big bilateral donors such as Germany, Japan and USAID. It performs best on organisation planning but work remains to be done on activity-level financial information and on performance data (for which it does not score any points). Of the indicators measured by format, over two thirds are published in machine-readable formats. It does not score on some important indicators such as activity overall cost, actual dates, sub-national location, results and conditions. Overall, it does not score on 13 of the 39 indicators included in the Index.

RECOMMENDATIONS

  • DG Enlargement should improve its publication to IATI so it is comprehensive and uses all fields – including structured performance data, information on activity costs and location and links to project documents. It should also produce a more complete organisation file, including forward budgets and country strategy papers. Its IATI files should be refreshed on at least a quarterly basis.
  • DG Enlargement should actively support the publication to IATI by other EC departments managing Instrument for Pre-accession Assistance (IPA) and promote aid transparency and open data among EU pre-accession countries.
  • The EC should actively use its IATI data in its programming and coordination processes and promote the use of this information by others via an open data portal.

Close

DONOR PROFILE

First published to IATI:

Jul-13

Data was found in the following formats where relevant:

59% IATI

0% CSV/Excel

5% PDF

5% Website

32% Not Published

SCORING

48.08%

COMMITMENT TO
AID TRANSPARENCY:

5.73/10

PUBLICATION
ORGANISATION LEVEL:

14.49/25

PUBLICATION
ACTIVITY LEVEL:

27.86/65

Commitment

1. FOIA

2. Implementation Schedules

3. Accessibility

Publication Status
Source

http://www.rti-rating.org/international.php

Comments

Total Global RTI rating score of 101. Score conversion from total score on Global RTI rating to Index points done using the following scale: 1 - 60: 33 61- 90: 66 91 - 150: 100.

Click here for indicator definition
Click here to view history

1. FOIA

Stage

Status

Format

Source

Comments

Researcher
Document
http://www.rti-rating.org/international.php
Total Global RTI rating score of 101. Score conversion from total score on Global RTI rating to Index points done using Expand...the following scale: 1 - 60: 33 61- 90: 66 91 - 150: 100

Donor Review
Document
http://www.rti-rating.org/international.php

PWYF Review

Independent Reviewer
Disagree

PWYF Final Assessment
Document
http://www.rti-rating.org/international.php
Total Global RTI rating score of 101. Score conversion from total score on Global RTI rating to Index points done using Expand...the following scale: 1 - 60: 33 61- 90: 66 91 - 150: 100.

Donor Comments

Publication Status
Source

http://tracker.publishwhatyoufund.org/plan/organisations/

Comments

Based on Publish What You Fund's analysis of IATI/Common Standard implementation schedules.

Click here for indicator definition
Click here to view history

2. Implementation schedules

Stage

Status

Format

Source

Comments

Researcher
Document
N/A
No implementation schedule found. If a schedule is published before 31st July, it will be taken into consideration.

Donor Review
Document
Implementation Schedule has been published on DG Enlargement website and sent to OECD and IATI

PWYF Review
http://tracker.publishwhatyoufund.org/plan/organisations/
The score for the recently published implementation schedule has been updated.

Independent Reviewer
Disagree

PWYF Final Assessment
Document
http://tracker.publishwhatyoufund.org/plan/organisations/
Based on Publish What You Fund's analysis of IATI/Common Standard implementation schedules.

Donor Comments

Publication Status
Source

No data available.

Comments

The sources cited by the reviewer do not meet the criteria for an organisation portal or project database.

Click here for indicator definition
Click here to view history

3. Accessibility

Stage

Status

Format

Source

Comments

Researcher
Document
N/A
No project database or data portal found. The only link available is: http://ec.europa.eu/enlargement/instruments/projects-in-focus/index_en.htm?theme=0801262488184a89 This does not meet any of the criteria required Expand...to score on this indicator.

Donor Review
Document
Information at disaggregate level presented in country pages with publication of all project fiches (bottom of page, click and find list Expand...of PFs http://ec.europa.eu/enlargement/instruments/funding-by-country/serbia/index_en.htm )

PWYF Review
A project database or data portal is required to score on this indicator

Independent Reviewer
Disagree
A Map of IPA funded projects in Serbia exists, but it does not include all projects/activities implemented in Serbia for IPA Expand...2012: http://mapa.euinfo.rs/. Excell export database with contracts awarded which include name of the contact per activity/contract for are available, but it is out of date (by August 2011): http://www.europa.rs/en/kakoDoFondova/dodeljeni-ugovori.html

PWYF Final Assessment
Document
The sources cited by the reviewer do not meet the criteria for an organisation portal or project database.

Donor Comments

Planning

Financial

4. Organisation Strategy

5. Annual Report

6. Allocation Policy

7. Procurement Policy

8. Country Strategy

9. Total Budget

10. Disaggregated Budgets

11. Audit

Publication Status

IATI

Data quality: 100%

Click here for indicator definition

Publication Status

IATI

Data quality: 100%

Click here for indicator definition

Publication Status

IATI

Data quality: 100%

Click here for indicator definition

Publication Status

IATI

Data quality: 100%

Click here for indicator definition

Publication Status

Always

Format: Document

Source

http://ec.europa.eu/enlargement/instruments/funding-by-country/serbia/index_en.htm

Comments

Published in the forms of 'Instrument for Pre-accession Assistance (IPA) Multi-annual Indicative Planning Document MIPD 2011-2013.' This information could not be found in ELARG's IATI files in the final pull of IATI data for the Index.

Click here for indicator definition
Click here to view history

8. Country strategy

Stage

Status

Format

Source

Comments

Researcher
Always
Document
http://ec.europa.eu/enlargement/instruments/funding-by-country/serbia/index_en.htm
Published in the forms of 'Instrument for Pre-accession Assistance (IPA) Multi-annual Indicative Planning Document MIPD 2011-2013'

Donor Review
Always
Document
Documents included in XML organisation file: one webpage with links to all MIPDs.

PWYF Review
Always
Document
This indicator will be assessed automatically if found in Enlargement's IATI data files in the final pull of IATI data for Expand...the Index, subject to the files meeting the test conditions. If not, the researcher's original response will apply.

Independent Reviewer
Disagree
Additional to MIPD, Annual programmes further detailing use of IPA assistance by the country is published. the 2012 IPA National Programme Expand...is available here: http://ec.europa.eu/enlargement/pdf/serbia/ipa/2012/071212_annex_financing_proposal_annexe_acte_autonome.pdf

PWYF Final Assessment
Always
Document
http://ec.europa.eu/enlargement/instruments/funding-by-country/serbia/index_en.htm
Published in the forms of 'Instrument for Pre-accession Assistance (IPA) Multi-annual Indicative Planning Document MIPD 2011-2013.' This information could not be Expand...found in ELARG's IATI files in the final pull of IATI data for the Index.

Donor Comments

Publication Status
Source

http://ec.europa.eu/enlargement/pdf/highlight/20111207_ipa_final_en.pdf

Comments

Indicative budgets for IPA are provided for 2014-2020. This meets the criteria outlined in the scoring guidelines.

Click here for indicator definition
Click here to view history

9. Total budget

Stage

Status

Format

Source

Comments

Researcher
Pdf
http://ec.europa.eu/enlargement/pdf/highlight/20111207_ipa_final_en.pdf
Indicative budgets for IPA are provided for 2014-2020

Donor Review
Pdf
Relevant documents on current and next financial frameworks included in XML organisation file; budget currently not available beyond 2014 due to Expand...financial framework constraints.

PWYF Review
Pdf
This indicator will be assessed automatically if found in Enlargement's IATI data files in the final pull of IATI data for Expand...the Index, subject to the files meeting the test conditions. If not, the researcher's original response will apply.

Independent Reviewer
Disagree
Do note that IPA 2014-2020 is currently being programmed alongside all other EU programmes/budget lines and it is therefore not yet Expand...available for Serbia or any other country.

PWYF Final Assessment
Pdf
http://ec.europa.eu/enlargement/pdf/highlight/20111207_ipa_final_en.pdf
Indicative budgets for IPA are provided for 2014-2020. This meets the criteria outlined in the scoring guidelines.

Donor Comments

Publication Status
Source

http://ec.europa.eu/enlargement/instruments/funding-by-country/serbia/index_en.htm

Comments

Recipient country budgets for 2013 available.

Click here for indicator definition
Click here to view history

10. Disaggregated budgets

Stage

Status

Format

Source

Comments

Researcher
Not published
http://ec.europa.eu/enlargement/instruments/funding-by-country/serbia/index_en.htm
The link alongside has total financial assistance to Serbia only until 2013.

Donor Review
Not published
Relevant documents on current and next financial frameworks included in XML organisation file; disaggregated budget currently not available beyond 2013 due Expand...to financial framework constraints.

PWYF Review
Not published
This indicator will be assessed automatically if found in Enlargement's IATI data files in the final pull of IATI data for Expand...the Index, subject to the files meeting the test conditions. If not, the researcher's original response will apply.

Independent Reviewer
Disagree
The EC is in the midst of adopting of the new 7-year budget, including budget for new IPA instrument, so save Expand...of overall budget projects for the whole instrument, no web-based data is available on country and sector allocations. Link to the proposal for a new IPA regulation: http://ec.europa.eu/enlargement/pdf/highlight/20111207_ipa_final_en.pdf

PWYF Final Assessment
Website
http://ec.europa.eu/enlargement/instruments/funding-by-country/serbia/index_en.htm
Recipient country budgets for 2013 available.

Donor Comments

Publication Status

Always

Format: Document

Source

No data available.

Comments

No data available.

Click here for indicator definition
Click here to view history

11. Audit

Stage

Status

Format

Source

Comments

PWYF Final Assessment
Always
Document

Basic

Classifications

Financial

Performance

12. Implementer

13. Unique ID

14. Title

15. Description

16. Planned Dates

17. Actual Dates

18. Current Status

19. Contact Details

20. Collaboration Type

21. Flow Type

22. Aid Type

23. Finance Type

24. Sector

25. Sub-national Location

26. Tied Aid Status

33. Overall Cost

34. Planned Expenditure

35. Actual Expenditure

36. Budget Identifier

37. Results

38. Impact Appraisals

39. Conditions

Publication Status

IATI

Data quality: 100%

Click here for indicator definition

Publication Status

IATI

Data quality: 100%

Click here for indicator definition

Publication Status

IATI

Data quality: 98.5%

Click here for indicator definition

Publication Status

IATI

Data quality: 87%

Click here for indicator definition

Publication Status

IATI

Data quality: 78.02%

Click here for indicator definition

Publication Status

Not Published

Source

No data available.

Comments

This information could not be found.

Click here for indicator definition
Click here to view history

17. Actual dates

Stage

Status

Format

Source

Comments

Researcher
Not published
Not published
N/A
Planned dates are published in the project profiles in the funded projects' database. There is however no information available on actual Expand...dates.

Donor Review
Not published
Not published

PWYF Review
Not published
Not published

Independent Reviewer
Disagree
This is one of the main bottlenecks steaming from the fact that no information is usually published once the IPA assistance/project Expand...has been awarded/selected.

PWYF Final Assessment
Not published
Not published
This information could not be found.

Donor Comments

Publication Status

IATI

Data quality: 100%

Click here for indicator definition

Publication Status

Sometimes

Format: Website

Source

http://mapa.euinfo.rs/

Comments

Based on the reviewer's feedback, PWYF conducted a review of all IPA activities in Serbia published on the mapa.euinfo.rs website. No activities were found which started during 2012 or 2013, so the database is not considered to be a comprehensive listing of all current activities. Response changed to 'sometimes published' to reflect this.

Click here for indicator definition
Click here to view history

19. Contact details

Stage

Status

Format

Source

Comments

Researcher
Always
Website
http://mapa.euinfo.rs/map/projectdetail/78?project_id=134

Donor Review
Always
Website

PWYF Review
Always
Website

Independent Reviewer
Disagree
A Map of IPA funded projects in Serbia exists, but it does not include all IPA projects funded in Serbia Expand...for 2012: http://mapa.euinfo.rs/. EUD has available Excell export database with contracts awarded which include name of the contact per activity/contract for all not just IPA funds, but it is out of date (August 2011): http://www.europa.rs/en/kakoDoFondova/dodeljeni-ugovori.html. This means that contacts details per project/activity are available. but not all.

PWYF Final Assessment
Sometimes
Website
http://mapa.euinfo.rs/
Based on the reviewer's feedback, PWYF conducted a review of all IPA activities in Serbia published on the mapa.euinfo.rs website. No Expand...activities were found which started during 2012 or 2013, so the database is not considered to be a comprehensive listing of all current activities. Response changed to 'sometimes published' to reflect this.

Donor Comments

Publication Status

IATI

Data quality: 100%

Click here for indicator definition

Publication Status

IATI

Data quality: 100%

Click here for indicator definition

Publication Status

IATI

Data quality: 100%

Click here for indicator definition

Publication Status

IATI

Data quality: 100%

Click here for indicator definition

Publication Status

IATI

Data quality: 100%

Click here for indicator definition

Publication Status

Sometimes

Format: Website

Source

http://mapa.euinfo.rs

Comments

Based on the reviewer's feedback, PWYF conducted a review of all IPA activities in Serbia published on the mapa.euinfo.rs website. No activities were found which started during 2012 or 2013, so the database is not considered to be a comprehensive listing of all current activities. Response changed to 'sometimes published' to reflect this.

Click here for indicator definition
Click here to view history

25. Sub-national location

Stage

Status

Format

Source

Comments

Researcher
Always
Website
http://mapa.euinfo.rs/map/projectdetail/77?project_id=128

Donor Review
Always
Website

PWYF Review
Always
Website

Independent Reviewer
Disagree
Both websites with information with projects/activities (http://mapa.euinfo.rs/, http://www.europa.rs/en/kakoDoFondova/dodeljeni-ugovori.html) are out of date or do not include all projects funded under IPA Expand...2012.

PWYF Final Assessment
Sometimes
Website
http://mapa.euinfo.rs
Based on the reviewer's feedback, PWYF conducted a review of all IPA activities in Serbia published on the mapa.euinfo.rs website. No Expand...activities were found which started during 2012 or 2013, so the database is not considered to be a comprehensive listing of all current activities. Response changed to 'sometimes published' to reflect this.

Donor Comments

Publication Status

Not Published

Source

No data available.

Comments

This information could not be found in ELARG's IATI files in the final pull of IATI data for the Index.

Click here for indicator definition
Click here to view history

26. Tied Aid Status

Stage

Status

Format

Source

Comments

Researcher
Not published
Not published
N/A
Did not find a clear policy stated anywhere on the website.

Donor Review
Not published
Machine readable
Info in XML files
Info in XML files

PWYF Review
Not published
Not published
This indicator will be assessed automatically if found in Enlargement's IATI data files in the final pull of IATI data for Expand...the Index, subject to the files meeting the test conditions. If not, the researcher's original response will apply.

Independent Reviewer
Disagree

PWYF Final Assessment
Not published
Not published
This information could not be found in ELARG's IATI files in the final pull of IATI data for the Index.

Donor Comments

Publication Status

Not Published

Source

No data available.

Comments

Based on the feedback provided by the independent reviewer, the score has been changed to 'not published'. The Stabilization and Association Agreement outlines EU-wide engagement between the EU and the Republic of Serbia.The document does not specifically refer to the provision of aid flows from the European Commission to Serbia so it does not meet the criteria used to score this indicator.

Click here for indicator definition
Click here to view history

27. MoU

Stage

Status

Format

Source

Comments

Researcher
Always
Document
http://www.europa.rs/upload/documents/key_documents/2008/SAA.pdf
The EU Member States and Serbia signed the Stabilization and Association Agreement in Luxembourg on 29 April 2008. Meanwhile, after Expand...a two-year postponement of the ratification caused by insufficient cooperation with the Hague Tribunal, the agreement was ratified by 26 EU Member States. Spain was the first to ratify the Agreement with Serbia on 19 January 2010, and Romania was the last to do it on 21 May 2012. This suggests that the agreement is valid for the 'current' period.

Donor Review
Always
Document

PWYF Review
Always
Document

Independent Reviewer
Disagree
SAA is the overall agreement on relations between the EU and Serbia. Actually, when it comes to EC financial assistance-IPA, the Expand...MoU is called IPA financing agreement between the EC and Republic of Serbia for a given year. I could find that the one for 2012 was signed in December 2912 (it is normal to be late), but the document itself is not publicly available (I could not find it on-line). What is available is the IPA National Programme 2012 for Serbia which includes list of projects/activities to be finance, but it might not include support such as direct budgetary support to the country. I would urge you to consider, since one of the main problems of IPA assistance is the unavailability of data on the level of MoU and once the activity/project is launched (e.g. projects reports).

PWYF Final Assessment
Not published
Document
Based on the feedback provided by the independent reviewer, the score has been changed to 'not published'. The Stabilization and Association Expand...Agreement outlines EU-wide engagement between the EU and the Republic of Serbia.The document does not specifically refer to the provision of aid flows from the European Commission to Serbia so it does not meet the criteria used to score this indicator.

Donor Comments

Publication Status

Always

Format: Document

Source

http://ec.europa.eu/enlargement/news_corner/key-documents/index_en.htm?key_document=08012624887bedda

Comments

The independent reviewer raises an important point about the timeliness of the release of evaluation reports. However, as per the scoring guidelines, evaluations are considered to be 'always published' if they are published within their regular cycles. If information on on-going evaluations is not published when completed, this will be reflected in future years' scores.

Click here for indicator definition
Click here to view history

28. Evaluations

Stage

Status

Format

Source

Comments

Researcher
Not published
Document
N/A
No evaluations published for financial assistance provided to Serbia. The annual progress report document does not appear to include evaluative information Expand...on activities. See here: http://ec.europa.eu/enlargement/pdf/key_documents/2012/package/sr_rapport_2012_en.pdf

Donor Review
Sometimes
Document
http://ec.europa.eu/enlargement/news_corner/key-documents/index_en.htm?key_document=08012624887bedda
all evaluations for DG Enlargement collected on ELARG website, and they can be selected per country.

PWYF Review
Always
Document
Response changed to 'always published' since the last evaluation for Serbia was published in 2011 which we assume is within their Expand...normal evaluation cycle given the range of evaluation documents available for other countries.

Independent Reviewer
Disagree
The strategic evaluation for Serbia was indeed published in January 2011, which means it took place in the course of 2010 Expand...and it assesses intervention logic of the assistance for period 2008-2011 and touches in assessing project/activity level for period 2007-2009, which means that the assessment is limited and not related to the given year. The EU has regular both thematic and country eveluations, but this become publicly available very late and since they are usually conducted at the level of several years or sectors, the evaluation covers only a sample of activities/project indicating situation at the sector or country level and never all projects. EUD and Government of Serbia have in 2012 within SWAP approach launched 5-year (2007-2011) evaluations per all sectors as a basis for planning use of IPA 2014-2020 funds for Serbia, but some of the evaluations are still ongoing and I believe are not intended to be made publicly available (this is from personal account as I acted as an expert for the civil society sector evaluation).

PWYF Final Assessment
Always
Document
http://ec.europa.eu/enlargement/news_corner/key-documents/index_en.htm?key_document=08012624887bedda
The independent reviewer raises an important point about the timeliness of the release of evaluation reports. However, as per the scoring Expand...guidelines, evaluations are considered to be 'always published' if they are published within their regular cycles. If information on on-going evaluations is not published when completed, this will be reflected in future years' scores.

Donor Comments

Publication Status

Sometimes

Format: Document

Source

http://mapa.euinfo.rs

Comments

Based on the reviewer's feedback, PWYF conducted a review of all IPA activities in Serbia published on the mapa.euinfo.rs website. No activities were found which started during 2012 or 2013, so the database is not considered to be a comprehensive listing of all current activities. Response changed to 'sometimes published' to reflect this.

Click here for indicator definition
Click here to view history

29. Objectives

Stage

Status

Format

Source

Comments

Researcher
Always
Document
http://mapa.euinfo.rs/map/projectdetail/61?project_id=135

Donor Review
Always
Document
http://ec.europa.eu/enlargement/instruments/funding-by-country/serbia/index_en.htm
info is present on individual project fiches published on Enlargement website.

PWYF Review
Always
Document

Independent Reviewer
Disagree
Again, at the level of projects/activities this is always published, but since not all projects are published not all objectives of Expand...assistance at the project level are available (see Map of projects and contract database mentioned before).

PWYF Final Assessment
Sometimes
Document
http://mapa.euinfo.rs
Based on the reviewer's feedback, PWYF conducted a review of all IPA activities in Serbia published on the mapa.euinfo.rs website. No Expand...activities were found which started during 2012 or 2013, so the database is not considered to be a comprehensive listing of all current activities. Response changed to 'sometimes published' to reflect this.

Donor Comments

Publication Status

Sometimes

Format: Document

Source

http://ec.europa.eu/enlargement/instruments/funding-by-country/serbia/index_en.htm; e.g. http://ec.europa.eu/enlargement/pdf/serbia/ipa/2012/pf_6_social_development.pdf

Comments

For this indicator, indicative or planned budget documents can be accepted as long as the information provided is broken down by different spending lines. In line with comments on the comprehensiveness of activity level information for other indicators, the response has been changed to 'sometimes published.'

Click here for indicator definition
Click here to view history

30. Budget Docs

Stage

Status

Format

Source

Comments

Researcher
Not published
Document
N/A
Overall cost of activities published but no budget documents appear to be available.

Donor Review
Always
Document
.http://ec.europa.eu/enlargement/instruments/funding-by-country/serbia/index_en.htm; e.g. http://ec.europa.eu/enlargement/pdf/serbia/ipa/2012/pf_6_social_development.pdf Expand...
info is present on individual project fiches published on Enlargement website,

PWYF Review
Always
Document
http://ec.europa.eu/enlargement/instruments/funding-by-country/serbia/index_en.htm; e.g. http://ec.europa.eu/enlargement/pdf/serbia/ipa/2012/pf_6_social_development.pdf Expand...
Response changed to 'always published' based on evidence provided by the donor.

Independent Reviewer
Disagree
It is correct that budget information are available for all countries covered by IPA in country fishes, but bear in mind Expand...that they are presented at the level of tender or call for proposals which ultimately result in projects/activities. Detailed project budgets (except for overall cost and EC-contribution) are not publicly available.

PWYF Final Assessment
Sometimes
Document
http://ec.europa.eu/enlargement/instruments/funding-by-country/serbia/index_en.htm; e.g. http://ec.europa.eu/enlargement/pdf/serbia/ipa/2012/pf_6_social_development.pdf Expand...
For this indicator, indicative or planned budget documents can be accepted as long as the information provided is broken down by Expand...different spending lines. In line with comments on the comprehensiveness of activity level information for other indicators, the response has been changed to 'sometimes published.'

Donor Comments

Publication Status

Always

Format: Document

Source

http://ec.europa.eu/budget/fts

Comments

New evidence found in the final review stage on the FTS website of the EC.

Click here for indicator definition
Click here to view history

31. Contracts

Stage

Status

Format

Source

Comments

Researcher
Sometimes
Document
http://ec.europa.eu/enlargement/pdf/how_does_it_work/grants_tenders/list_of_contractors/20120410_anual_list_of_contractors.pdf
Publishes an annual list of contractors, but this list is not currently available for 2012.

Donor Review
Sometimes
Document
http://ec.europa.eu/europeaid/work/funding/beneficiaries/index.cfm?lang=en
info on contracts published on DG DEVCO website up to year 2011

PWYF Review
Sometimes
Document

Independent Reviewer
Disagree
Additional to annual list of contracts (grants, services etc.), usually the EU Delegation in country (Serbia) publishes a list of Expand...contracts awarded. The EUD Serbia has such list published, but again only up until 1st August, 2011: http://www.europa.rs/en/kakoDoFondova/dodeljeni-ugovori.html. Do note that contracts as such are not published, just basic data about the activity (project). At the level of IPA civil society support, where we do ongoing monitoring, we have encountered problems by some EUDs (not Serbia though, but Bosnia and Herzegovina especially), where the award notices have in some cases never been made public!

PWYF Final Assessment
Always
Document
http://ec.europa.eu/budget/fts
New evidence found in the final review stage on the FTS website of the EC.

Donor Comments

Publication Status

Always

Format: Document

Source

http://ted.europa.eu/TED/main/HomePage.do and https://webgate.ec.europa.eu/europeaid/online-services/index.cfm?ADSSChck=1284977262222&do=publi.welcome&userlanguage=en

Comments

Published on the Europa and DEVCO websites.

Click here for indicator definition
Click here to view history

32. Tenders

Stage

Status

Format

Source

Comments

Researcher
Sometimes
Document
http://ec.europa.eu/enlargement/tenders/tenders/index_en.htm
The Enlargement website has a section on tenders. There are no current open calls for tenders available. Clicking on previous calls Expand...for tenders shows details for only one tender. Need clarification whether tenders are always published and if so how they can be accessed.

Donor Review
Always
Document
http://ted.europa.eu/TED/main/HomePage.do and https://webgate.ec.europa.eu/europeaid/online-services/index.cfm?ADSSChck=1284977262222&do=publi.welcome&userlanguage=en Expand...
info on current and forthcoming tenders on Europa and DEVCO websites

PWYF Review
Always
Document
http://ted.europa.eu/TED/main/HomePage.do and https://webgate.ec.europa.eu/europeaid/online-services/index.cfm?ADSSChck=1284977262222&do=publi.welcome&userlanguage=en Expand...
Response changed to 'always published' based on evidence provided by the donor.

Independent Reviewer
Disagree
Note that the same website as per DG DEVCO publishes all tenders centrally: https://webgate.ec.europa.eu/europeaid/online-services/index.cfm?ADSSChck=1284977262222&do=publi.welcome&userlanguage=en Expand...

PWYF Final Assessment
Always
Document
http://ted.europa.eu/TED/main/HomePage.do and https://webgate.ec.europa.eu/europeaid/online-services/index.cfm?ADSSChck=1284977262222&do=publi.welcome&userlanguage=en Expand...
Published on the Europa and DEVCO websites.

Donor Comments

Publication Status

Sometimes

Format: Website

Source

http://mapa.euinfo.rs/

Comments

Based on the reviewer's feedback, PWYF conducted a review of all IPA activities in Serbia published on the mapa.euinfo.rs website. No activities were found which started during 2012 or 2013, so the database is not considered to be a comprehensive listing of all current activities. Response changed to 'sometimes published' to reflect this.

Click here for indicator definition
Click here to view history

33. Overall cost

Stage

Status

Format

Source

Comments

Researcher
Always
Website
http://mapa.euinfo.rs/map/projectdetail/77?project_id=128

Donor Review
Always
Machine readable
Info in XML files
Info in XML files: overall cost of the activity is the total commitment for each activity.

PWYF Review
Always
Website
This indicator will be assessed automatically if found in Enlargement's IATI data files in the final pull of IATI data for Expand...the Index, subject to the files meeting the test conditions. If not, the researcher's original response will apply.

Independent Reviewer
Disagree
Both websites with information with projects/activities (http://mapa.euinfo.rs/, http://www.europa.rs/en/kakoDoFondova/dodeljeni-ugovori.html) are out of date-information on projects or do not include all projects funded Expand...under IPA Serbia 2012. The issue is that overall costs are usually available, but since not all projects are updated, this is not available for all IPA support (projects) in Serbia for 2012. I can confirm this for certain for civil society support as we developed a list of all awarded projects for all countries including Serbia (http://www.balkancsd.net/images/77-1_IPA_CSF_2007-2011_grant_list_FINAL.pdf). It might be also that the donor is referring to IPA 2012 for the year the assistance was programmed and not when the award was made/contract signed.

PWYF Final Assessment
Sometimes
Website
http://mapa.euinfo.rs/
Based on the reviewer's feedback, PWYF conducted a review of all IPA activities in Serbia published on the mapa.euinfo.rs website. No Expand...activities were found which started during 2012 or 2013, so the database is not considered to be a comprehensive listing of all current activities. Response changed to 'sometimes published' to reflect this.

Donor Comments

Publication Status

IATI

Data quality: 100%

Click here for indicator definition

Publication Status

IATI

Data quality: 58%

Click here for indicator definition

Publication Status

Not Published

Source

No data available.

Comments

This information could not be found.

Click here for indicator definition
Click here to view history

36. Budget Identifier

Stage

Status

Format

Source

Comments

Researcher
Not published
Not published
N/A
This information does not appear to be published

Donor Review
Not published
Not published

PWYF Review
Not published
Not published

Independent Reviewer
Disagree

PWYF Final Assessment
Not published
Not published
This information could not be found.

Donor Comments

Publication Status

Sometimes

Format: Pdf

Source

http://ec.europa.eu/enlargement/news_corner/key-documents/index_en.htm

Comments

The CSO reviewer highlights problems with accessing detailed results information. However, as some examples of results information were found the score for this indicator will remain as 'sometimes published' although the issues are noted. This information is not consistently published hence it cannot be scored as 'always published'.

Click here for indicator definition
Click here to view history

37. Results

Stage

Status

Format

Source

Comments

Researcher
Not published
Not published
N/A
Expected results are published in the project files but no actual results for completed projects. See here: http://mapa.euinfo.rs/map/projectdetail/70 Expand...

Donor Review
Sometimes
Pdf
http://ec.europa.eu/enlargement/news_corner/key-documents/index_en.htm
Collection of results/evaluation reports for DG Enlargement on website. Documents can be searched per country. Expected results always published in project Expand...fiches on the website.

PWYF Review
Sometimes
Pdf
Changed to 'sometimes published' based on evidence provided by the donor.

Independent Reviewer
Disagree
I would not take evaluation as a real evidence of publishing results. Sometimes EC/EUD publishes a fact sheet or a booklet Expand...of project results, but this is for visibility/demonstration processes (e.g. http://www.civilnodrustvo.rs/ with results and activities information per projects funded under the Support to Civil Society call for proposals). Evaluations are usually a technical exercise (I have acted as evaluator for EUD Serbia so this is a first hand account) and look at projects from a multi-year or sector perspective. Publishing project/activity results is a real bottleneck for the EU/EC as it is the ultimate link providing for reflection on achieving policy objectives set in Enlargement policy driving IPA funding and strategic and effective use of IPA funding. The project fiches mentioned by the donor do include expected results, but it is a planning document, thus expressing what the donor wants to achieve and not evaluation/report showing what has actually been achieved.

PWYF Final Assessment
Sometimes
Pdf
http://ec.europa.eu/enlargement/news_corner/key-documents/index_en.htm
The CSO reviewer highlights problems with accessing detailed results information. However, as some examples of results information were found the score Expand...for this indicator will remain as 'sometimes published' although the issues are noted. This information is not consistently published hence it cannot be scored as 'always published'.

Donor Comments

Publication Status

Sometimes

Format: Document

Source

http://ec.europa.eu/enlargement/instruments/funding-by-country/serbia/index_en.htm , e.g. http://ec.europa.eu/enlargement/pdf/serbia/ipa/2012/pf_9_energy_efficiency.pdf

Comments

It is not possible to use ‘project’ fiches to score this indicator as ‘always published’ as these documents do not contain the necessary information for each individual activity within a sector of operation or programme component. This is consistent with the scoring approach which has been applied to all other EC departments.

Click here for indicator definition
Click here to view history

38. Impact Appraisals

Stage

Status

Format

Source

Comments

Researcher
Not published
Document
N/A
No impact appraisals found.

Donor Review
Always
Document
http://ec.europa.eu/enlargement/instruments/funding-by-country/serbia/index_en.htm , e.g. http://ec.europa.eu/enlargement/pdf/serbia/ipa/2012/pf_9_energy_efficiency.pdf Expand...
Relevant information is included into project fiches

PWYF Review
Always
Document
http://ec.europa.eu/enlargement/instruments/funding-by-country/serbia/index_en.htm , e.g. http://ec.europa.eu/enlargement/pdf/serbia/ipa/2012/pf_9_energy_efficiency.pdf Expand...
Response changed to 'always published' based on evidence provided by the donor.

Independent Reviewer
Disagree
At the level of activity/project, impact appraisal (assessment) is part of project proposal and this as part of the contract signed Expand...with the EC, but the problem is that this documents are never publicly available. What the donor and PWFY assessment is reporting is an impact appraisal available at the level of project fiche, which is at the level of planning and not the lowest level at which the activity/support is actually being implemented.

PWYF Final Assessment
Sometimes
Document
http://ec.europa.eu/enlargement/instruments/funding-by-country/serbia/index_en.htm , e.g. http://ec.europa.eu/enlargement/pdf/serbia/ipa/2012/pf_9_energy_efficiency.pdf Expand...
It is not possible to use ‘project’ fiches to score this indicator as ‘always published’ as these documents do not contain Expand...the necessary information for each individual activity within a sector of operation or programme component. This is consistent with the scoring approach which has been applied to all other EC departments.

Donor Comments

Publication Status

Not Published

Source

No data available.

Comments

Based on PWYF original findings and as a result of the reasons outlined by the reviewer, the response has been changed to 'not published'. In order to score on this indicator conditions need to be explicitly stated per activity or made clear that they cover all activities and no additional conditions apply to specific activities.

Click here for indicator definition
Click here to view history

39. Conditions

Stage

Status

Format

Source

Comments

Researcher
Not published
Document
N/A
Conditions not specified for each activity or project.

Donor Review
Always
Document
general webpage for project fiches http://ec.europa.eu/enlargement/instruments/funding-by-country/serbia/index_en.htm; example: http://ec.europa.eu/enlargement/pdf/serbia/ipa/2012/pf_6_social_development.pdf Expand...
Information included in Project fiches published on DG Enlargement website, country pages

PWYF Review
Always
Document
http://ec.europa.eu/enlargement/instruments/funding-by-country/serbia/index_en.htm; example: http://ec.europa.eu/enlargement/pdf/serbia/ipa/2012/pf_6_social_development.pdf Expand...
Response changed to 'always published' based on evidence provided by the donor.

Independent Reviewer
Disagree
On project level this is stipulated at the level of contract (service, grant etc.), which is based on standard EC documents Expand...for external support. So templates of contracts, including conditions are available (http://ec.europa.eu/europeaid/prag/document.do;jsessionid=1yGDR4QM2fTnwDhBvdxXzrGM0tMp1T58Sgn8QGYykQ2FyhtHh9gk!-963858406). The issue is that contracts as such are not publicly available at the level of activity, while they are at the level of organization.

PWYF Final Assessment
Not published
Document
Based on PWYF original findings and as a result of the reasons outlined by the reviewer, the response has been changed Expand...to 'not published'. In order to score on this indicator conditions need to be explicitly stated per activity or made clear that they cover all activities and no additional conditions apply to specific activities.

Donor Comments