Formative Evaluation Using OECD-DAC Framework: Sustainable Coffee Agriculture and Value-Added Creation (SAVA)

Abstract

Corporate Social Responsibility (CSR) programs targeting community empowerment are commonly evaluated only at program completion, limiting opportunities for timely program adjustment. This study presents a formative evaluation of the Sustainable Coffee Agriculture and Value Added Creation (SAVA) program a CSR initiative by PT Supreme Energy Rantau Dedap (SERD) implemented in collaboration with Anwar Muhammad Foundation (AMF) in Segamit, South Sumatra, Indonesia conducted at month six of a twelve-month implementation period. Using the OECD-DAC evaluation framework (relevance, coherence, 
effectiveness, efficiency, impact, and sustainability), data were collected through structured interviews, surveys, and program document reviews involving 13 respondents comprising 10 coffee farmers from Kelompok Tani Gunung Patah (KTGP) and 3 program organizers. Quantitative data were analyzed using descriptive statistics, while qualitative data were examined through thematic analysis. While program Key Performance Indicators (KPIs) showed near-complete achievement across all objectives, the OECD-DAC evaluation detected two critical hidden barriers: schedule misalignment with farmers’ socio-religious activities (affecting 30% of respondents) and literacy gaps in training module language (reported by 30% of respondents). These findings prompted two evidence-based program adjustments schedule restructuring and training material simplification prior to program completion. This study demonstrates that early-stage formative evaluation using the OECD-DAC framework can reveal implementation barriers not visible through KPI monitoring alone and supports its systematic integration into CSR program management cycles.