Multiple Indicator Cluster Survey 2016, Nalaikh district - Mongolia

Abstract
---------------------------

This Child Development Survey (Multiple Indicator Cluster Survey) provides valuable information on assessing the implication of children and women rights in Nalaikh district and gives statistically sound and internationally comparable data essential for developing evidence-based policies and programmes, and for monitoring progress towards local government goals and commitments.

OBJECTIVES

The CDS 2016 in Nalaikh district has following primary objectives:

- To provide up-to-date information for assessing the situation of children, women and men in Nalaikh district;

- To collect disaggregated data for the identification of disparities, to allow for evidence based policy-making aimed at social inclusion of the most vulnerable;

- To furnish data needed for monitoring progress toward goals established in the Millennium Declaration and other internationally agreed upon goals, as a basis for future action in the provincial level;

- To generate data for assessment of the progress made within the UNICEF Country Program 2012-2016 and to put additional efforts in those areas that needs requires attention

- To contribute to the generation of baseline data for the post-2016 agenda;

- To validate data from other sources and the results of focused interventions.

Geographic coverage
---------------------------

District level.

Analysis unit
---------------------------

- Individuals

- Households

Universe
---------------------------

The survey covered all de jure household members (usual residents), all women age 15-49 years, all men age 15-49 years and all children under 5.

Kind of data
---------------------------

Sample survey data [ssd]

Sampling procedure
---------------------------

The sample for the CDS was designed to provide estimates for a large number of indicators on the situation of children, women and men in Nalaikh district, and its seven khoroos (first to seven khoroos).

A total of 1000 households were selected and selection probabilities and corresponding weights vary by khoroos. The two-stage sampling method was used for household selection. At the first stage of sampling, the primary sampling units (PSUs-khesegs) were selected systematically with probability proportional to size (PPS). In the second stage, a systematic sample of 25 households were drawn from each sample kheseg’s household listing.

The official statistics report of the population and household registration as of end of 2015 was used as a sampling frame. Kheseg is the lowest administrative unit and is defined as primary sampling units (PSUs). 52 khesegs of 7 khoroos were covered and the household listing was updated in September and October of 2016.

The survey data collection was carried out during November and December of 2016 when the internal migration of households was stable. Thus, all 52 selected sampling units were entirely covered in the survey. A more detailed description of the ample design can be found in the Final Report (Appendix A) attached as a Related Material.

Mode of data collection
---------------------------

Face-to-face [f2f]

Research instrument
---------------------------

Questions and indicators for the survey were identified based on the survey objectives and covering the main indicators of the 5th round of the MICS1 model questionnaire recommended by UNICEF. Moreover, the principle of comparability internationally and with previous surveys was considered.

Five sets of questionnaires were used in the survey:

1. A household questionnaire which was used to collect basic demographic information on all de jure household members (usual residents), the household, and the dwelling;

2. A questionnaire for individual women administered in each household to all women age 15-49 years;

3. A questionnaire for individual men administered in every second household to all men age 15-49 years;

4. An under-5 questionnaire, administered to mothers (or caretakers) for all children under

5 living in the household;

5. A questionnaire for evaluating water quality2 administered in every third household.

In addition to the administration of the questionnaires, fieldwork teams tested the salt used for cooking in the households for iodine content, observed the place for hand washing and measured the weights and heights of children age under 5 years. Data from these measurements and observations are recorded in the respective place in the questionnaires.

The Questionnaire for Child under 55 was administered to mothers or caretakers of all children under 5 years of age living in the households. Normally, the questionnaire was administered to mothers of under-5 children; in cases when the mother was not listed in the household roster, a primary caretaker for the child was identified and interviewed.

Water Quality questionnaire was administered in every third household which included question on drinking-water quality, questioning water source of the household and testing residential water quality.

The questionnaires were pre-tested in July 2016 in 3 baghs of Kherlen and Tsenkhermandal soums of Khentii aimag and in 2 khesegs of 8th khoroo of Bayanzurkh district, Ulaanbaatar, in total 5 PSUs.

Based on the results of the pre-test, modifications were made to the wording of the questionnaires. A copy of the questionnaires is provided as Related Materials.

Cleaning operations
---------------------------

The CDS utilized tablet PCs for data collection. This environmental friendly solution offered many advantages including, sending the data collected from the field immediately to the central office, ensuring data quality and safety and saving time, manpower and cost.

The data collected by the interviewers was aggregated at the team supervisors level and after required clarification and editing, it was sent to the central network of the NSO. The data received at the central office were monitored and checked. Where additional clarifications were needed on a particular data, the team supervisors were made to contact the particular household.

The data collected from the selected households were entered on computers using the CSPro 5.03 software program. Procedures and standard programs developed under the global MICS4 programme and adapted to the CDS questionnaires with additional module and questions were used throughout. The data were analyzed using the standard SPSS 21.0 (Statistical Package for Social Sciences) software program and the model syntax and tabulation plans developed by UNICEF were customized for this purpose.

Response rate
---------------------------

Of the 1000 households selected for the sample 995 households were found to be occupied. Of these 975 households were successfully interviewed yielding a response rate of 98.0 percent . The total 831 women age 15-49 years were listed within the interviewed households, of which 758 were successfully interviewed indicating a response rate of 91.2 percent.

The survey also sampled men age 15-49, but required only a subsample of all men in every second household. In total 343 men, aged between 15-49 years were listed in the household questionnaires. Questionnaires were completed for 296 eligible men, which corresponds to a response rate of 86.3 percent within eligible interviewed households. In addition, 379 children under 5 listed in the household questionnaires. Questionnaires were completed for 374 of these children, which corresponds to a response rate of 98.7 percent within interviewed households.

Overall response rates in Nalaikh district stands at 84.6 percent of men age 15-49 years, 89.4 percent of women and 96.7 percent calculated for mothers/ caretakers of children under 5.

Sampling error estimates
---------------------------

The sample of respondents selected in the Nalaikh district’s CDS-2016 is only one of the samples that could have been selected from the same population, using the same design and size. Each of these samples would yield results that differ somewhat from the results of the actual sample selected. Sampling errors are a measure of the variability between the estimates from all possible samples. The extent of variability is not known exactly, but can be estimated statistically from the survey data.

The following sampling error measures are presented in this appendix for each of the selected indicators:

- Standard error (se): Standard error is the square root of the variance of the estimate. For survey indicators that are means, proportions or ratios, the Taylor series linearization method is used for the estimation of standard errors. For more complex statistics, such as fertility and mortality rates, the Jackknife repeated replication method is used for standard error estimation.

- Coefficient of variation (se/r) is the ratio of the standard error to the value (r) of the indicator, and is a measure of the relative sampling error.

- Design effect (deff) is the ratio of the actual variance of an indicator, under the sampling method used in the survey, to the variance calculated under the assumption of simple random sampling based on the same sample size. The square root of the design effect (deft) is used to show the efficiency of the sample design in relation to the precision. A deft value of 1.0 indicates that the sample design of the survey is as efficient as a simple random sample for a particular indicator, while a deft value above 1.0 indicates an increase in the standard error due to the use of a more complex sample design.

- Confidence limits are calculated to show the interval which contains the true value of the indicator for the population, with a specified level of confidence. For CDS results 95% confidence intervals are used, which is the standard for this type of survey. The concept of the 95% confidence interval can be understood in this way: if many repeated samples of identical size and design were taken and the confidence interval computed for each sample, then 95% of these intervals would contain the true value of the indicator.

For the calculation of sampling errors from CDS data, programs developed in CSPro Version 5.0, SPSS Version 21 Complex Samples module and CMRJack1 have been used.

Given the use of normalized weights, by comparing the weighted and unweighted counts it is possible to determine whether a particular domain has been undersampled or over-sampled compared to the average sampling rate. If the weighted count is smaller than the unweighted count, this means that the particular domain had been oversampled.

Sampling errors are calculated for indicators of primary interest, for the province level, for urban and rural areas, and for all regions. Three of the selected indicators are based on households, 8 are households members, 39 are based on women, 24 are based on men, and 39 are based on children under 5.

摘要
---------------------------
本儿童发展调查（多指标聚类调查）提供了关于评估纳莱赫地区儿童和妇女权利影响的宝贵信息，并提供了制定基于证据的政策和计划、监测向地方政府目标和承诺迈进进程所必需的、统计上可靠且国际上可比的数据。
目标
---------------------------
纳莱赫地区2016年儿童发展调查的主要目标如下：
- 提供最新信息，以评估纳莱赫地区儿童、妇女和男性的状况；
- 收集细分数据，以识别差异，允许基于证据的政策制定，旨在促进最脆弱群体的社会融入；
- 提供数据，用于监测实现千年宣言和其他国际达成目标所设定的目标，作为省级未来行动的基础；
- 生成数据，以评估2012-2016年联合国儿童基金会国家计划取得的进展，并在需要关注的领域投入更多努力；
- 为2016年后的议程生成基线数据；
- 验证其他来源的数据和针对性干预措施的结果。
地理覆盖范围
---------------------------
地区级别。
分析单元
---------------------------
- 个人
- 家庭
总体
---------------------------
调查覆盖了所有法定家庭成员（常住居民），所有15-49岁的妇女，所有15-49岁的男子以及所有5岁以下的儿童。
数据类型
---------------------------
样本调查数据 [ssd]
抽样程序
---------------------------
CDS的样本设计旨在为纳莱赫地区儿童、妇女和男性的状况以及其七个部落（第一至七个部落）的大量指标提供估计。总共选择了1000个家庭，部落的选择概率及其相应的权重不同。家庭选择采用了两阶段抽样方法。在第一阶段抽样中，一级抽样单位（PSU-khesegs）按照规模比例（PPS）系统地选择。在第二阶段，从每个样本kheseg的家庭名单中抽取了25个家庭的系统性样本。
抽样框架
---------------------------
使用截至2015年底的人口和户籍官方统计数据报告作为抽样框架。Kheseg是最低的行政单位，定义为一级抽样单位（PSU）。覆盖了7个部落的52个kheseg，家庭名单在2016年9月和10月进行了更新。
数据收集方式
---------------------------
面对面 [f2f]
研究工具
---------------------------
调查的问题和指标是根据调查目标和涵盖联合国儿童基金会推荐的MICS1模型问卷第五轮的主要指标确定的。此外，还考虑了与国际和先前调查的可比性原则。
调查中使用了五套问卷：
1. 家庭问卷，用于收集所有法定家庭成员（常住居民）、家庭和住所的基本人口统计信息；
2. 个体女性问卷，在每个家庭中对所有15-49岁的妇女进行管理；
3. 个体男性问卷，每两个家庭中管理所有15-49岁的男子；
4. 5岁以下儿童问卷，由母亲（或照顾者）为所有居住在家庭中的5岁以下儿童进行管理；
5. 水质评估问卷，每三个家庭中进行管理。
除了问卷管理外，现场工作人员还测试了家庭中用于烹饪的盐的碘含量，观察了洗手的地方，并测量了5岁以下儿童的体重和身高。这些测量和观察的数据记录在问卷的相应位置。
5岁以下儿童的问卷由母亲或照顾者填写，所有居住在家庭中的5岁以下儿童的母亲；在母亲未列入家庭名单的情况下，确定了孩子的首要照顾者并进行访谈。
水质问卷每三个家庭进行一次，包括关于饮用水质量、询问家庭水源和测试住宅水质量的问题。
问卷在2016年7月在肯特伊省的赫尔伦和岑克赫尔曼达尔苏木的3个baghs以及乌兰巴托市巴彦珠尔赫区第8个部落的2个kheseg进行了预测试，总共5个PSU。
根据预测试的结果，对问卷的文字进行了修改。问卷的副本作为相关材料提供。
数据清理操作
---------------------------
CDS使用平板电脑进行数据收集。这种环保的解决方案提供了许多优势，包括将收集到的数据立即发送到中央办公室，确保数据质量和安全，并节省时间和人力成本。
调查员收集的数据在团队主管级别进行了汇总，并在必要的澄清和编辑后，发送到国家统计局的中央网络。中央办公室接收到的数据得到了监控和检查。如果对特定数据需要进一步的澄清，团队主管将被要求与特定家庭联系。
从选定的家庭收集的数据使用CSPro 5.03软件程序在计算机上输入。在整个过程中使用了全球MICS4计划下开发的程序和标准程序，并根据CDS问卷进行了调整，增加了模块和问题。数据使用SPSS 21.0（社会科学统计软件包）软件程序进行分析，并为此定制了联合国儿童基金会开发的模型语法和表格计划。
响应率
---------------------------
在选定的1000个家庭样本中，发现995个家庭有人居住。其中975个家庭成功接受了访谈，响应率为98.0%。在访谈的家庭中，共列出了831名15-49岁的妇女，其中758名成功接受了访谈，表明响应率为91.2%。
调查还抽样了15-49岁的男子，但只需要每两个家庭中所有男子的子样本。在家庭问卷中，共列出了343名15-49岁的男子。完成了296份符合条件的男子的问卷，相当于符合条件的访谈家庭中的86.3%的响应率。此外，家庭问卷中列出了379名5岁以下的儿童。完成了374名儿童的问卷，相当于访谈家庭中的98.7%的响应率。
纳莱赫地区的总体响应率为84.6%的15-49岁男子，89.4%的妇女，以及96.7%的计算值，为5岁以下儿童的母亲/照顾者。
抽样误差估计
---------------------------
纳莱赫地区CDS-2016中选定的受访者样本只是从同一人口中，使用相同的设计和规模可能选出的多个样本之一。每个这样的样本都会产生与实际选定的样本结果略有不同的结果。抽样误差是衡量所有可能样本估计之间差异的指标。差异的范围无法确切知道，但可以从调查数据中统计估计。
本附录中为每个选定的指标提供了以下抽样误差指标：
- 标准误差（se）：标准误差是估计方差的平方根。对于调查指标，如均值、比例或比率，使用泰勒级数线性化方法估计标准误差。对于更复杂的统计数据，如生育率和死亡率，使用Jackknife重复复制方法估计标准误差。
- 变异系数（se/r）是标准误差与指标值（r）的比率，是相对抽样误差的衡量指标。
- 设计效应（deff）是使用调查中使用的抽样方法的实际指标方差与假设简单随机抽样基于相同样本大小计算出的方差的比率。设计效应的平方根（deft）用于表示样本设计相对于精度的效率。deft值为1.0表示调查的样本设计对于特定指标与简单随机样本一样有效，而deft值高于1.0表示由于使用了更复杂的样本设计而导致标准误差的增加。
- 置信区间是根据特定水平的置信度计算出来，以显示包含指标在总体中真实值的区间。对于CDS结果，使用95%置信区间，这是此类调查的标准。95%置信区间的概念可以这样理解：如果多次重复抽取相同大小和设计的样本，并计算每个样本的置信区间，那么95%的这些区间将包含指标的真实值。
从CDS数据计算抽样误差时，使用了CSPro版本5.0、SPSS版本21复杂样本模块和CMRJack1中开发的程序。
由于使用了标准化权重，通过比较加权计数和无权计数，可以确定与平均抽样率相比，特定领域是否被过度抽样或不足抽样。如果加权计数小于无权计数，这意味着特定领域已被过度抽样。
为一级感兴趣指标、省级、城市和农村地区以及所有地区计算了抽样误差。
选定的三个指标基于家庭，八个基于家庭成员，三十九个基于妇女，二十四基于男子，三十九个基于5岁以下儿童。