Impact Evaluation of PNPM Generasi Program 2007, First Wave, Baseline Survey - Indonesia

Abstract
---------------------------

PNPM Generasi known as the National Community Empowerment Program - Healthy and Smart Generation (Program National Pemberdayaan Masyarakat-Generasi Sehat dan Cerdas) began in mid-2007 in rural areas of five Indonesian provinces selected by the government: West Java, East Java, North Sulawesi, Gorontalo, and Nusa Tenggara Timur. The Generasi project is implemented by Indonesia’s Ministry of Home Affairs, and is funded through government of Indonesia resources, loans from the World Bank and grants from several bilateral donors.

In Generasi, all participating villages receive a block grant each year to improve education, and maternal and child health in their villages. The village block grants ranged from an average of $8,500 in 2007 up to an average of $18,200 in 2009.

In order to evaluate the overall impact of Generasi, as well as to separately identify the impact of Generasi's performance incentives, program locations were selected by lottery to form a randomized, controlled field experiment. Each location was randomly allocated to one of two versions of the program: an "incentivized" treatment with the pay-for-performance component (treatment A) and an otherwise identical "non-incentivized" treatment without the pay-for-performance incentives (treatment B).

The impact evaluation project was conducted from 2007 until 2010, in three waves. Documented here is the baseline round, carried out from June to August 2007, prior to Generasi implementation.

The sample for the research covered each of the 300 subdistricts that were included in the original Generasi randomization. In each subdistrict, eight villages were randomly selected (unless the subdistrict had fewer than eight villages, in which case all were selected). Overall, 2,313 villages were sampled in each of the three survey waves.

The data for the impact analysis was gathered from surveys of households, mothers, health service providers, and school and village officials.

Geographic coverage
---------------------------

West Java, East Java, North Sulawesi, Gorontalo, and Nusa Tenggara Timur provinces

Analysis unit
---------------------------

- Households,
- Married women, age 16-49,
- Children age 6-15, respondent: mother of the child,
- Children age < 3, respondent: mother of the child,
- Villages,
- Community health centers (Puskesmas),
- Village midwives,
- Village health posts,
- Junior secondary schools.

Kind of data
---------------------------

Sample survey data [ssd]

Sampling procedure
---------------------------

In order to evaluate the overall impact of Generasi, as well as to separately identify the impact of Generasi's performance incentives, Generasi locations were selected by lottery to form a randomized, controlled field experiment.

The Generasi randomization was conducted at the subdistrict (kecamatan) level, so that all villages within the subdistrict either received the same treatment of Generasi (treatment A or treatment B) or were in the control group. Randomizing at the subdistrict level is important since many health and education services, such as community health centers (puskesmas) and junior secondary schools, provide services to multiple villages within a subdistrict.

The Generasi locations were selected through the following procedure. First, 300 target subdistricts were identified, targeting poor, rural areas that had an existing community-driven development infrastructure.

Each subdistrict was then randomly assigned by computer into one of three equal-sized groups: treatment A, incentivized (100 subdistricts); treatment B, non-incentivized (100 subdistricts); or control (100 subdistricts). Within a subdistrict, all villages received the same treatment. The randomization was stratified by district (kabupaten), to ensure a balanced randomization across the 20 different districts in the study.

The sampling design for the household component of the Generasi surveys was chosen to ensure adequate coverage in the key Generasi demographic groups: mothers who recently were pregnant or gave birth, children under age three, and children of school age. Within each village, one hamlet (dusun) was randomly selected, and a list of all households was obtained from the head of the hamlet. Five households were randomly sampled from that list to be interviewed. These households were stratified so that two selected households had at least one child under age two, two selected households had a child under age 15 but no children under age two, and one household had no children under age 15.

Mode of data collection
---------------------------

Face-to-face [f2f]

摘要
---------------------------
PNPM Generasi，即国家社区赋能计划——健康与智慧一代（Program National Pemberdayaan Masyarakat-Generasi Sehat dan Cerdas），于2007年中期在印尼五个由政府选定的农村省份启动：西爪哇、东爪哇、北苏拉威西、戈朗岛和努沙登加拉省。Generasi项目由印尼内政部实施，资金来源包括印尼政府资源、世界银行贷款以及数个双边捐助者的赠款。

在Generasi项目中，所有参与村庄每年均获得一笔专项资金，以改善其村庄的教育和母婴健康。村庄专项资金从2007年的平均8500美元增至2009年的平均18200美元。

为评估Generasi的整体影响，并单独识别Generasi绩效激励的影响，通过抽签方式选取项目地点，形成随机对照的现场实验。每个地点随机分配到项目两个版本之一：带有绩效支付成分的激励性治疗（处理A）以及没有绩效支付激励的否则相同的不激励性治疗（处理B）。

影响评估项目从2007年开始至2010年结束，分三个阶段进行。此处记录的是实施Generasi之前进行的基线轮次，时间为2007年6月至8月。

研究样本覆盖了原始Generasi随机化中的300个次级行政区。在每个次级行政区，随机选取8个村庄（除非次级行政区村庄少于8个，此时选取所有村庄）。总体而言，在每个调查轮次中，共有2313个村庄被抽样。

影响分析的数据收集来自家庭、母亲、医疗服务提供者、学校和村庄官员的调查。

地理覆盖范围
---------------------------
西爪哇、东爪哇、北苏拉威西、戈朗岛和努沙登加拉省
分析单元
---------------------------
- 家庭，
- 16-49岁的已婚妇女，
- 6-15岁的儿童，受访者：儿童的母亲，
- 3岁以下的儿童，受访者：儿童的母亲，
- 村庄，
- 社区卫生中心（Puskesmas），
- 村庄助产士，
- 村庄卫生站，
- 初中。
数据类型
---------------------------
样本调查数据 [ssd]
抽样程序
---------------------------
为了评估Generasi的整体影响，以及单独识别Generasi绩效激励的影响，通过抽签方式选取Generasi地点，形成随机对照的现场实验。

Generasi的随机化是在次级行政区（kecamatan）层面进行的，以确保次级行政区内的所有村庄要么接受相同的Generasi治疗（处理A或处理B），要么处于对照组。在次级行政区层面的随机化非常重要，因为许多健康和教育服务，如社区卫生中心（puskesmas）和初中，为次级行政区内的多个村庄提供服务。

Generasi地点的选取通过以下程序进行。首先，确定了300个目标次级行政区，目标是贫困农村地区，这些地区已经存在社区主导的发展基础设施。

然后，每个次级行政区通过计算机随机分配到三个相等大小的组之一：处理A，激励性（100个次级行政区）；处理B，非激励性（100个次级行政区）；或对照组（100个次级行政区）。在次级行政区内，所有村庄接受相同的治疗。随机化按照行政区（kabupaten）分层，以确保在研究的20个不同行政区之间实现平衡的随机化。

Generasi调查的家庭成分抽样设计旨在确保在Generasi的关键人口群体中获得足够的覆盖率：近期怀孕或分娩的母亲、3岁以下的儿童以及学龄儿童。在每一个村庄内，随机选取一个自然村（dusun），并从村长那里获取所有家庭的名单。从该名单中随机选取5个家庭进行访谈。这些家庭被分层，以确保选出的两个家庭至少有一个2岁以下的儿童，两个家庭有一个15岁以下的儿童但没有2岁以下的儿童，以及一个家庭没有15岁以下的儿童。

数据收集方式
---------------------------
面对面 [f2f]