17/07/2024
CALL FOR EXPRESSION OF INTEREST
End line Evaluation
Monitoring & Evaluation and Teacher Training Project
Term of Reference
Background
The Lutheran Church in Liberia has a rich history of providing education in rural areas for more than a century and a half, with a strong commitment to developing the country's future through quality schooling. Education is a core component of the church's mission and vision, with the Lutheran Church in Liberia School System (LCLSS) playing a key role as the education Secretariat. With 29 schools, predominantly located in rural regions and serving over 8,400 students, the church's focus on inclusive education is evident.
The six-year project (2017-2023) titled Monitoring & Evaluation and Teacher Training underscores the church's dedication to enhancing teaching standards and accountability. This project aims to empower lower elementary teachers with the necessary skills to deliver quality education transparently and accountably in the classroom. Additionally, the project focuses on monitoring instructional practices, administrative procedures, and financial management, while also developing educational materials to support the curriculum.
Recognizing the importance of foundational education in preparing students for higher grades, the project emphasizes quality instruction, administrative oversight, and monitoring & evaluation. To further enhance the project's impact, key considerations include conducting impact assessments to gauge the effectiveness of teacher training, students’ performance, engaging stakeholders for active participation and sustainability, developing long-term plans for continuity beyond 2023, and fostering knowledge sharing with educational partners locally and globally.
By incorporating these strategic elements into the project framework, the Lutheran Church in Liberia can continue to strengthen its educational initiatives, empower teachers, and foster a culture of quality education in the communities it serves.
Project Goal
The primary goal of the project, with a focus on ecumenical and developmental aspects, is to ensure inclusivity by providing high-quality education to all, irrespective of faith, ability, gender, or nationality, especially for young children. Additionally, the project aims to elevate teaching standards across all LCL schools to enhance the fulfillment of the teaching ministry beyond previous levels.
Anticipated Project Outcomes
1. Enhanced classroom instruction quality through teachers delivering standardized and improved professional teaching methods.
2. Increased transparency and accountability displayed by school leaders, aligning with LCLSS and Ministry of Education (MoE) policies, thereby reducing administrative inconsistencies.
3. Improved academic performance among lower-grade (1-3) students in literacy, numeracy, and social competency.
4. Active engagement and participation of school boards in oversight and educational endeavors, fostering collaborative decision-making processes for educational enhancement.
Evaluation Target Audiences
The end-of-project evaluation aims to benefit multiple stakeholders who have been directly or indirectly involved in the project implementation. The key stakeholders that will participate in the evaluation process include:
Direct Beneficiaries
• Lower grade students, lower and teachers who have directly benefited from the project's outcomes and interventions.
• Those involved in the management and oversight of the schools participating in the project, including principals, school boards, and education officials.
Strategic Stakeholders
• Mission Eine Welt Church Development Committee WEW/KED Plays a crucial role in church development initiatives and partnerships, providing support and guidance for projects aimed at improving education and community development.
• Lutheran Church in Liberia: As the central entity overseeing Lutheran schools and educational programs in Liberia through its secretariat, the church has a significant impact on the project's implementation, sustainability, and alignment with its mission and values.
• Parishes Hosting Lutheran Schools: The local parishes hosting Lutheran schools are integral stakeholders as they provide the physical infrastructure, support, and community relationships necessary for the success of the project. Their active involvement is essential for the project's sustainability and impact at the grassroots level.
Evaluation, Purpose, and Objectives
The end-line evaluation aims to assess the impact, appropriateness, relevance, effectiveness, and sustainability of the six-year intervention carried out by the Lutheran Church in Liberia School System (LCLSS). It will draw key lessons learnt and the best practices that will be shared with relevant stakeholders including project participants. Specific objectives of the evaluation include:
Effectiveness
• Achievement of Objectives: Evaluate the extent to which the intervention's stated objectives were met and the impact of these achievements on the target schools and communities.
• Positive and Negative Impacts: Assess both the intended and unintended positive and negative effects of the intervention at the individual and school levels, considering factors such as academic performance, teacher morale, student well-being, and school governance.
• Capacity Building: Determine the extent to which the project has enabled participants, including teachers and administrators, to improve their capacity to deliver quality instruction and sound administration at the school level. Evaluate the effectiveness of training programs, mentoring, support systems, and other capacity-building initiatives in enhancing skills and professional development.
Management Effectiveness/Efficiency
• Organizational Support: Evaluate the degree to which the organizational structure provided sufficient, effective, and timely support for project implementation, including coordination, communication, decision-making processes, and leadership.
• Resource Utilization: Assess the adequacy of available resources (equipment, facilities, funding, etc.) in achieving project objectives and evaluate the efficiency of resource allocation and utilization. Determine if resources were effectively managed to support project activities and outcomes.
• Resource Utilization Impact: Evaluate whether all project resources were utilized in a manner that contributed to project success and outcomes. Assess the effectiveness of resource allocation in achieving project goals and delivering intended results.
• Efficiency Improvement: Identify opportunities to improve project efficiency without compromising outputs, including streamlining processes, optimizing resource allocation, enhancing coordination, and implementing cost-effective strategies.
• Timeliness of Activities: Assess the timeliness of project activity implementation, including adherence to timelines, milestones, and deadlines. Evaluate the efficiency of project planning and ex*****on in meeting project objectives within specified timeframes.
• Reporting and Monitoring Systems: Evaluate the adequacy and effectiveness of reporting and monitoring systems within the project, including data collection, analysis, feedback mechanisms, and reporting protocols. Assess the quality and timeliness of project monitoring and reporting practices to ensure accountability and informed decision-making.
Appropriateness/relevance
• Project Design Relevancy: Evaluate the relevancy and appropriateness of the project design to the identified needs and challenges of the schools and communities served by the intervention. Assess how well the project's objectives, activities, and strategies align with the specific context and priorities of the target schools.
• Information Sharing: Examine the type and quality of information provided to project participants by the Project Management Team and assess how this information contributed to the effectiveness of the intervention. Evaluate communication channels, feedback mechanisms, and transparency in sharing project updates and expectations with stakeholders.
• Alignment with Schools' Priority Needs: Identify the priority needs of the schools and communities involved in the project and assess how well the intervention aligned with these needs. Evaluate the extent to which the project addressed critical challenges, issues, and aspirations identified by the school stakeholders.
• Alignment with Secondary Sources: Consider external sources such as research findings, reports, and expert opinions on the key issues facing schools and communities in the project area. Assess how the project aligned with recommendations and insights from secondary sources to ensure relevance and responsiveness to broader education sector challenges.
Connectedness/Sustainability Evaluation Criteria
• Sustainability Plans and Structures: Assess the existence and adequacy of sustainability plans, structures, and skills to ensure the continuation of project benefits beyond the intervention period. Evaluate strategies for institutionalizing project outcomes, building local capacity, securing funding, and sustaining project impact in the long term.
• School Preparedness: Determine how well schools are prepared to continue with the project outcomes once external support is withdrawn. Evaluate school leadership, teacher readiness, institutional capacity, and community engagement in sustaining and replicating successful project interventions.
• Teacher and School Leader Support: Assess the level of knowledge, skills, and support among teachers and school leaders for the project objectives and activities. Evaluate professional development opportunities, training programs, mentorship initiatives, and other capacity-building efforts that enhance teacher and leader engagement and commitment to project goals.
• School Contribution and Ownership: Identify evidence demonstrating school contribution and ownership of project interventions, including active involvement in project planning, implementation, and evaluation. Evaluate the extent to which schools have embraced and internalized project initiatives, showing autonomy, commitment, and a sense of responsibility for sustaining project outcomes.
Coordination/Collaboration Criteria
• Government and Administrative Authorities: Evaluate the collaboration and coordination with government and administrative authorities at various levels (local, regional, national) in support of project implementation. Assess how engagement with government entities contributed to project success, sustainability, and scalability.
• Church Leadership Engagement: Assess the extent to which the project collaborated and coordinated with host parishes to achieve project objectives. Rate the level of collaboration and coordination with church leadership in guiding and supporting project activities. Assess the role of church leaders in advocating for the project, mobilizing community participation, providing spiritual guidance, and promoting project values and objectives within the parish community.
• Project Sponsor and Partners: Evaluate the effectiveness of collaboration and coordination among project sponsors, implementing partners, donors, and other stakeholders involved in project delivery. Assess the strength of partnerships, alignment of interests, communication channels, and shared responsibilities in achieving project goals and ensuring holistic support for project beneficiaries.
The Task
LCLSS is seeking the services of a consultancy firm to conduct end line evaluation for the Monitoring & Evaluation and Teacher Training Project in 29 LCL schools across 9 counties in Liberia.
Purpose and Rationale of the end line evaluation
1. Purpose:
• To evaluate the effectiveness and impact of the Monitoring & Evaluation and Teacher Training Project in 29 LCL schools across 9 counties in Liberia.
• To assess the achievement of the project's intended outcomes related to teacher training, school management, monitoring and evaluation systems, and collaboration with church leaders.
• To provide actionable insights and recommendations for improving the quality, sustainability, and scalability of the project's interventions.
2. Rationale:
LCLSS is commissioning this end line evaluation to assess the Outcomes of the project as follow:
• OUTCOME 1: Enhance the teaching skills of lower grade teachers (1-3) to enable them to deliver high-quality education using hands-on teaching aids and materials.
• OUTCOME 2: Strengthen the school leadership skills of LCL leaders to improve school management practices, including reporting, instructional supervision, and financial management.
• OUTCOME 3: Establish a robust system for monitoring, evaluation, and supervision of LCL schools to ensure effectiveness and accountability.
• OUTCOME 4: Foster enhanced collaboration and coordination with church leaders in the management and supervision of LCL schools.
Scope of the Evaluation
The consultant, supported by the project management team of LCLSS, will oversee the evaluation process in Montserrado, Margibi, B**g, Lofa, Nimba, Grand Gedeh, River Gee, Maryland, and Grand Kru Counties.
The consultant's responsibilities will include:
• Conduct an inception meeting with LCLSS and relevant stakeholders along with a desk review of the project's contextual framework.
• Develop an inception report and share it with LCL/LCLSS management.
• Create tools/questionnaires and establish methodologies for collecting qualitative and quantitative data, ensuring the evaluation tools can capture data at both county and school levels.
• Assess the current instructional and administrative practices in the 29 schools, analyze interventions, challenges, and provide recommendations for improvement.
• Analyze the level of stakeholder involvement in the supervision of schools.
• Evaluate the capacity and impact of lower grade teachers and school leaders (Principals, VPIs, Registrars/Accountants).
• Conduct field visits to test the evaluation assessment tools.
• Supervise field data collection and data entry.
• Analyze and synthesize data to prepare a comprehensive report.
• Submit data analysis and a draft report for feedback.
• Incorporate findings, compile, and submit the final report.
Deliverables:
• A comprehensive inception report detailing the finalized methodology, sampling approach, ethical considerations, data collection tools, and work plan. This report should be submitted within ten (10) business days of contract signing and include sub-sections outlining methodologies and draft tools for the end-line evaluation.
• Raw data files comprising quantitative outputs, syntax files, qualitative transcripts, and other relevant data.
• A draft evaluation report for feedback and review by LCLSS/LCL senior management team.
• Facilitation of a validation workshop to present the end-line evaluation findings to key participants and stakeholders (participants to be determined by LCLSS and the consultant).
• Submission of a final detailed report on the evaluation findings, incorporating indicators reflecting changes observed in the schools, feedback from internal review, and validation workshop, along with recommendations. All reports should be in the Times New Roman font, size 12.
• Compilation of stories of change from project beneficiaries highlighting key interventions in teacher training and school management components.
Methodology
The methodology developed for the evaluation must encompass a sampling procedure and determine a representative sample size. It should facilitate a comparative analysis between the before and after intervention periods, evaluating key indicators at baseline and review points. The study should utilize both quantitative and qualitative participatory methods to gather project data, employing appropriate data collection instruments and analysis methods. All collected data, whether qualitative or quantitative, should be disaggregated based on indicators.
Coordination, Roles, and Responsibilities:
• The selected consultancy firm will be contracted by and report to the Lutheran Church in Liberia (LCL) through the Bishop, General Secretary, and Treasurer, who will be responsible for making key decisions.
• LCLSS will closely collaborate with the consultant, providing continuous feedback throughout the evaluation process to ensure quality.
• Support provided by LCL/LCLSS to the consultant/consultancy firm will include:
o Introductory briefings
o Provision of key project documents
o Sharing contact details and introductions to key stakeholders, as well as offering
o Comments on draft tools and reports.
• LCLSS will provide technical advice on the evaluation approach and ensure that the deliverables meet the agreed quality standards and grant requirements.
Standards and Safeguarding
LCLSS requires all assessments, reviews, and studies to align with a Human Rights-Based Approach (HRBA). The consultancy firm must consider the following Standards and Safeguarding for the Endline Evaluation involving School Teachers and School Leaders:
1. Adherence to Ethical Guidelines: The evaluation process must comply with ethical guidelines to protect the safety, privacy, and rights of all participants, including students, schoolteachers and leaders.
2. Informed Consent: Prior to participating in the evaluation process, all participants must give informed consent. They should be fully informed about the evaluation's purpose, procedures, and their rights as participants.
3. Participant Confidentiality: Participants' confidentiality must be strictly maintained throughout the evaluation. Any information shared by participants should be kept confidential and used solely for evaluation purposes.
4. Data Protection and Security: All data collected during the evaluation must be securely stored and protected to prevent unauthorized access or disclosure.
5. Impartiality and Objectivity: The evaluation should be conducted in an impartial and objective manner to ensure unbiased and accurate findings. Evaluators must avoid conflicts of interest that could compromise the evaluation's integrity.
6. Standardized Evaluation Tools: Using standardized evaluation tools and methods can ensure consistency and reliability in the evaluation process. These tools should be suitable for the evaluation's context and objectives.
7. Feedback Mechanism: Participants should have the opportunity to provide feedback on the evaluation process, sharing their experiences and perspectives. This feedback can help enhance future evaluations and ensure an inclusive and respectful process.
8. Safeguarding Procedures: Proper procedures should be in place to address any safeguarding concerns that may arise during the evaluation. This includes protecting participants from harm or abuse and providing necessary support.
Requirements and Experience of the Lead consultant
The lead consultant for the firm must possess the following qualifications and expertise to be considered for the position:
• An advanced degree in education, preferably a PhD.
• A minimum of 10 years' experience in teaching and conducting research related to education and other relevant fields.
• Experience working with young children.
• Proficiency in understanding teaching methodologies and pedagogical approaches.
• Demonstrated application of participatory methodologies in reviews and related processes.
• Background in organizational learning and development reviews, as well as evaluation.
• Excellent written and oral communication skills, evidenced by the ability to produce comprehensive reports with in-depth analysis.
• Ability to work effectively in multicultural, multi-religious, and rural communities.
• Profound qualitative and quantitative research skills.
Duration of Assignment
Duration of the evaluation shall be from September 15 – October 31, 2024.
Key Timelines
Action/Output Timeline Responsibility
Selection of Consultant and Contracting Sep 1-15, 2024, LCL/Consultants
Submission of inception report by consultant Sep 25, 2024 Consultants
Carry out field Data Collection
Sep 26 -Oct 10, 2024 Consultant
Data Analysis and
Report Writing on the baseline study Oct 11 – 12, 2024 Consultant
Submission of first draft report of the baseline study Oct 14, 2024 Consultant
Review and give technical feedback on the draft baseline report Oct 18, 2024 LCL/LCLSS
Facilitate validation Workshop with LCL/LCLSS and Church leaders Oct 25, 2024 LCL/Consultant
Submission of final report Oct 31, 2024 Consultant
Application Process
All interested parties should submit the following:
• Technical proposal demonstrating their understanding of the assignment and detailed timeline.
• Financial proposal outlining the cost elements.
• CVs of the core team members to carry out the assignment.
Candidates should submit an Expression of Interest before the close of business Wednesday, July 20,
2024 to [email protected]/[email protected] and present hardcopy to the General Secretary at the Lutheran Compound on Payne Avenue, 13th Street, Sinkor.
22/04/2026
21/03/2024
04/12/2023
29/11/2023
25/05/2022
14/06/2021