: ADRA Thailand
: Nonprofits / องค์กรไม่แสวงหาผลกำไร
: 168
: 11 July 2025
7 August 2025
Terms of Reference
for a project end-evaluation
“Vocational Training and Skills Development (VTSD)”
The “Vocational Training and Skills Development” (VTSD) project is a three-year EU-funded initiative (2023–2025) implemented under NDICI Lot 3 to strengthen the self-reliance and resilience of Myanmar refugees in nine temporary shelters along the Thai-Myanmar border. The project targets displaced populations who remain unable to return to Myanmar due to protracted conflict and instability and aims to support them in building dignified livelihoods and preparing for durable solutions.
The project is implemented by a consortium led by ADRA Germany. With extensive experience in livelihood and education programming, ADRA Germany manages a portfolio of EU- and BMZ-funded projects focused on resilience-building, vocational training, and protection in fragile contexts. ADRA Thailand, as the main implementing partner, oversees project delivery in seven of the nine refugee camps—namely Mae La, Umpiem Mai, Nu Po, Mae Ra Ma Luang, Mae La Oon, Ban Don Yang, and Tham Hin. ADRA Thailand has a longstanding presence along the Thai-Myanmar border and brings substantial technical expertise in vocational education, life skills training, and community engagement. ACTED Thailand is responsible for implementation in the remaining two camps—Ban Mae Nai Soi and Ban Mae Surin. ACTED has a well-established operational footprint in Thailand and works to support displaced populations through multisectoral interventions, including education, livelihoods, and humanitarian assistance.
The VTSD project is implemented through a decentralized, camp-based approach in close coordination with refugee camp governance structures, vocational training committees, and local education authorities. The project portfolio encompasses certified vocational skills training, entrepreneurship development, job placement support, and life skills modules.
The overall objective of the action is to enhance the self-reliance and resilience of refugees through improved access to income-generating opportunities and employment. To achieve this, the action is structured under one specific objective: Increased income-generating opportunities and employment of camp residents.
This is supported by the following outputs:
Direct beneficiaries consisted of refugees aged 18 to 59 years residing in the nine temporary shelters, who made up approximately 56.4% of the total refugee population of 91,275 individuals. Within this group, the project aimed to ensure gender balance, with approximately 26,652 women and 24,827 men eligible for vocational training and related interventions.
Key project stakeholders include:
2. Objectives of the evaluation
The main purpose of this end-of-project evaluation is to provide an independent assessment of the Vocational Training and Skills Development (VTSD) project’s performance, with a view to informing decision-making around future programming or other similar interventions in protracted refugee contexts. The evaluation serves both accountability and learning purposes for the project consortium and the European Union (EU) as donor.
It will assess the project’s achievements in relation to its stated objectives and intended results following the OECD DAC criteria as outlined below, while also examining the appropriateness of its design and implementation approaches given the evolving context along the Thai–Myanmar border. Particular attention will be paid to the sustainability of project outcomes and the potential for long-term impact on refugee self-reliance and resilience.
The evaluation will also take into consideration cross-cutting issues such as gender, inclusion, and participation of marginalized groups, and whether the project ensured equitable access to vocational training and employment support services. The evaluation aims to generate actionable insights that will inform policy dialogue, programming strategies, and future design of vocational and livelihood interventions in displacement settings.
The main objective of this final evaluation is to assess the overall performance and quality of the VTSD project in line with the OECD/DAC evaluation criteria. This includes an assessment of the project’s relevance, coherence, effectiveness, efficiency, impact, and sustainability, as well as the identification of key lessons learned that can inform future interventions in protracted displacement contexts.
In addition, the evaluation will pursue the following specific objectives:
The evaluation will focus on the following scope dimensions:
The evaluation will not cover activities outside the defined project scope (e.g. projects funded by other donors or unrelated support services in the camps). It will also not assess the individual performance of specific partner organisations beyond their role in implementing the VTSD project.
Although the project officially ends on December 31st 2025, all field activities implemented by ACTED are scheduled to conclude by August 2025, and those implemented by ADRA Thailand will be completed by October 2025. To ensure timely data collection and stakeholder availability, the data collection process will be conducted in two stages between September (BMS and BMN) and mid-December 2025 (Mae La, Umpiem Mai, Nu Po, Mae Ra Ma Luang, Mae La Oon, Ban Don Yang, Tham Hin).
The evaluation will pay particular attention to the inclusion of:
The evaluation will be guided by OECD/DAC evaluation criteria, including Relevance, Effectiveness, Efficiency, Impact, Sustainability, and Coherence as outlined above. Specific questions to be answered by the evaluation (not limited to):
1) Relevance
a. Have the specific project activities remained relevant to the objectives?
b. To what extent have the project’s interventions met the needs of the project beneficiaries such as the need for livelihood skills development and income-generating opportunities to reduce dependency on humanitarian assistance and enhance self-reliance?
c. Based on the evaluation findings, what specific recommendations can be provided for each temporary shelter to ensure that future vocational training and livelihood activities are better aligned with local market demands and employment opportunities? In particular, how can these recommendations take into account the differences in infrastructure, available resources, and the evolving legal and policy environment, including the possibility for refugees to work outside the temporary shelters?
2) Coherence
a. To what extent is the project consistent with the strategies and policies of the Royal Thai Government, particularly the Ministry of Interior and the Office of Vocational Education Commission (OVEC)?
b. How well does the project complement other livelihood and vocational training initiatives in the refugee camps, including those implemented by CCSDPT members, UNHCR, TBC and INGOs such as COERR, WEAVE, IRC, and JRS?
c. Were efforts made to avoid duplication of services and ensure synergy with parallel projects and actors in the camps?
3) Effectiveness
a. To what extent has the project achieved its intended outcomes/outputs? Where the output objectives were not achieved, what were the hindrances?
b. What weaknesses or shortcomings have there been in the project with regard to achieving the objectives, and which measures have been adopted to address them?
c. Which factors have contributed to successful achievements of project objectives?
4) Efficiency
a. Were resources (financial, human, material) used in an efficient and timely manner to deliver the intended results?
b. Were project management structures, coordination mechanisms, and implementation arrangements cost-effective?
5) Sustainability
a. To what extent are the outcomes of the vocational training and livelihood support likely to be sustained after the end of the project?
b. Have the capacities of the local actors (e.g. KRC-VT, KnED-VTNFE, camp-based trainers, livelihood groups) been strengthened to continue activities independently?
c. Are the skills and income-generating activities of beneficiaries likely to remain relevant and viable under evolving policy or return scenarios?
6) Impact
a. What broader changes (intended or unintended, positive and negative) can be experienced by the project beneficiaries, camp communities and other stakeholders as a result of the intervention?
b. How has the project contributed to improving the long-term resilience and self-reliance of refugees, including marginalized groups (e.g. women, youth, persons with disabilities)?
c. Are there any observable contributions of the project to systemic or policy-level changes (e.g. recognition of VT certificates, stakeholder collaboration)
The evaluation will employ a mixed-method approach, combining quantitative and qualitative methods to measure the project’s performance and results. The data will be collected through primary and secondary data sources.
Quantitative methods will primarily draw on the structured endline household survey conducted by the external evaluator with the support of the implementing partners (ADRA Thailand and ACTED). This survey includes key outcome indicators related to skills development, income generation, and perceived self-reliance. The evaluator will propose the survey instruments and sampling strategy to ensure compatibility with the evaluation matrix. If necessary, additional structured questionnaires may be developed to address specific gaps. To ensure alignment, the evaluator will participate in a consortium briefing in August 2025.
Qualitative methods will include Key Informant Interviews (KIIs) and Focus Group Discussions (FGDs) with project staff, institutional partners (e.g. KRC-VT, KnED-VTNFE, OVEC, Thai vocational colleges), camp governance structures, and other stakeholders. FGDs will be conducted with various beneficiary groups (e.g. men, women, vulnerable persons) across the nine camps to explore diverse perspectives and lived experiences. The evaluation will include a comprehensive desk review of project documents (proposals, monitoring and assessment reports, MEAL data, periodic reports) as well as relevant secondary sources to contextualise findings. A consultative, triangulated approach will enhance the credibility of results.
The methodology must ensure gender sensitivity, cultural appropriateness, and ethical compliance, collecting disaggregated data by gender, age, disability, and geography. It should be participatory and inclusive, ensuring that the voices of women, persons with disabilities, and marginalized groups are reflected. Ethical standards—including informed consent, voluntary participation, and confidentiality—must be upheld.
Sampling methodology will be determined during the inception phase. The evaluator will propose appropriate sampling strategies and sample sizes to ensure balanced representation across camps, genders, age groups, and implementing partners. The inception phase will include validation of the evaluation matrix, data collection tools, and sampling methods in consultation with the consortium partners.
Stakeholder groups to be interviewed include:
Each interview will be tailored to the stakeholder group and explore implementation, sustainability, and coordination aspects. Special attention will be given to the roles of KRC-VT, KnED-VTNFE, OVEC, and the Thai vocational colleges regarding long-term training certification and curricular alignment.
6. Tasks and responsibilities
To ensure quality, accountability, and coordination throughout the evaluation process, a Steering Committee will be established to oversee the evaluation. The Steering Committee will consist of:
The Steering Committee will be responsible for:
The Steering Committee will meet at key points in the evaluation: after the evaluator briefing, upon submission of the inception report, and during the validation phase. The evaluator is expected to keep the Steering Committee regularly informed through formal meetings and written updates (email, shared documents), and to proactively raise any delays or constraints that may affect deliverables or timelines.
ADRA Thailand and ACTED Thailand will support local logistics, including coordination of access to camps, scheduling of interviews and focus groups, and any required permissions or transportation within their respective areas of operation.
Roles and Responsibilities
|
Task |
Responsible |
Contact person(s) |
|
Overall coordination and administrative oversight |
ADRA Germany |
Tanja Schilling (Project Coordinator), tanja.schilling@adra.de |
|
Quality assurance and MEAL guidance |
ADRA Germany |
Utsab Kandel (MEAL Advisor) Utsab.kandel@adra.de) |
|
Field access, logistics, and stakeholder mobilization (7 camps: Mae La, Umpiem, Nu Po, Ban Don Yang, Tham Hin, Mae La Oon, Mae Ra Ma Luang) |
ADRA Thailand |
Elvis Walemba (Program Director); elvis@adrathailand.org
|
|
Field access and support in 2 camps (Ban Mai Nai Soi, Ban Mae Surin) |
ACTED Thailand |
Otto Van Krugten (Country Director; Otto Van Krugten otto.vankrugten@acted.org |
|
Day-to-day communication, contractual and technical coordination |
ADRA Thailand |
Elvis Walemba (Program Director); elvis@adrathailand.org |
The evaluator is expected to:
All relevant contacts will be confirmed and shared prior to the evaluator’s onboarding.
7. Deliverables and timeline
The final Evaluation deliverables and tentative timeline are outlined below. The reporting in line with milestones achieved will be agreed upon between the evaluator and the consortium.
The evaluation report must be written in English and the expected structure is as follows (mandatory):
All collected documents and data must be treated confidentially and, in the case of personal data, in accordance with data protection laws (particularly the EU General Data Protection Regulation). These documents and data are to be used exclusively for the evaluation, and interviews must always be anonymized. No later than one year after the completion of the evaluation, the contractor shall permanently destroy the data and documents in accordance with data protection laws.
The evaluation will be conducted under the joint management of ADRA Thailand and ACTED, with the support of ADRA Germany to ensure consistency, quality assurance, and compliance with EU INTPA standard.
|
Deliverable |
Deadline |
|
Evaluator contracted and participates in briefing (virtual) |
August 15th 2025 |
|
Evaluator submits written questions to consortium |
By August 29th 2025 |
|
Evaluator conducts endline survey (BMN and BMS camps) |
September 2025 |
|
Evaluator conducts endline survey (7 remaining camps) |
November–December 2025 |
|
Inception Report (4–6 pages) incl. feedback on endline data |
By February 2nd 2026 |
|
Feedback by consortium |
February 28th 2026 |
|
Validation workshop (virtual) |
March 31st 2026 |
|
Submission of Draft Evaluation Report (Version 1) |
April 10th 2026 |
|
Feedback by consortium |
April 30th 2026 |
|
Revised report |
May 7th 2026 |
|
Feedback by consortium |
May 15th 2026 |
|
Final report and poster |
May 31st 2026 |
Applicants are required to submit two separate documents: a technical proposal and a financial proposal.
Both proposals should be submitted in English and must be clearly labeled as “Technical Proposal” and “Financial Proposal,” respectively.
Applications should be submitted no later than August 7th 2025 midnight.
Applications in English should be submitted by email to tanja.schilling@adra.de and hr@adrathailand.org and must include the following documents:
i) A résumé (max. 3 pages) of the lead evaluator or team members;
ii) A cover letter outlining the evaluator’s interest, understanding of the assignment, and relevant experience;
iii) Three references of similar evaluations conducted;
iv) A description of the proposed team composition (if applicable), including specific roles and responsibilities;
v) A detailed budget outlining the evaluator’s fee structure, number of working days, and all associated costs. Quotations must be all-inclusive, covering costs such as international and local travel (airfare), visa fees, accommodation, vehicle hire, enumerator/staff per diems and incentives, communication, translation, training, and costs related to data collection (e.g. for FGDs, KIIs, and survey administration). Applicable taxes (e.g. VAT) must be included. Please also note that ground transportation within the field sites will be covered separately by ADRA and ACTED.
vi) Contact details of two professional references.
Applicants are expected to provide proof of professional registration and taxation (e.g. valid tax number). The evaluator or firm will be responsible for arranging their own health, travel, and liability insurance for the full duration of the assignment.
Only shortlisted candidates will be contacted.
The evaluator will be paid the full amount on completion of the assignment. However, delays caused by the evaluator will result in financial penalties.
