eVIN assessment

Electronic Vaccine Intelligence Network (eVIN) assessment was conducted in 12 states (Assam, Chhattisgarh, Gujarat, Jharkhand, Manipur, Nagaland, Odisha, Bihar Himachal Pradesh, Madhya Pradesh, Rajasthan and Uttar Pradesh) where eVIN was launched initially. A pre-post comparison was used on key performance indicators for programmatic assessment. As obtaining data for one-year prior to implementation of eVIN was challenging, therefore, six months period was chosen as the reference period for pre-eVIN phase. The pre-eVIN reference period was of six months for all CCPs, however it varied for different states and districts due to different timeframe of eVIN rollout. The specific duration of pre-eVIN phase are as mentioned: most of the CCPs in a district were covered either in between the period of April 2015 to September 2015 (13 districts), April 2016 to September 2016 (12 districts), October 2015-March 2016 (11 districts) and October 2011- March 2012 (1 district). The post eVIN reference period was from October 2017 to March 2018 for the assessment.
Minimum number of CCPs required for the study was calculated to be 502 considering 43% of PHCs reported instances of stock-out, 10% non-response rate and 1.2 design effect. It was further increased to 617 CCPs in order to draw valid conclusions at the state levels.
Selection of CCPs in the eVIN states were done using two-stage sampling design. In the first stage, districts were selected followed by selection of CCPs in the second stage. In each eVIN state, number of sampled districts was decided based on Probability Proportion to Size of CCPs. In total 37 districts were selected using systematic random sampling technique after arranging the districts in ascending order based on the proportionate share of cold chain point in the total cold chain point in state. Further, CCPs were randomly selected in each of the selected district. A detailed methodology is available in the larger study document.
Quantitative data was obtained using structured questionnaire from CCPs pertaining to stock management, temperature monitoring, cold chain equipment, and documentation aspects of vaccine supply chain. The primary data for pre-eVIN phase was done from stock registers, vaccine distribution registers, temperature log books and other important registers. Completeness and accuracy were analyzed in the assessment. Completeness was seen of Indent form, vaccine stock register, and temperature log book. Accuracy was assessed through stock register and eVIN record, eVIN record and physical count. Computer Assisted Personal Interviewing (CAPI) technique was employed using tablets/mobiles for real-time data collection and data entry.

电子疫苗智能网络（eVIN）评估在最初启动eVIN的12个州（阿萨姆邦、恰蒂斯加尔邦、古吉拉特邦、达拉特南德邦、曼尼普尔邦、纳加尔邦、奥里萨邦、比哈尔邦、喜马偕尔邦、马哈拉施特拉邦、拉贾斯坦邦和 Uttar Pradesh）进行。本研究采用前后对比的方法，对关键绩效指标进行项目评估。由于获取eVIN实施前一年的数据具有挑战性，因此，选取了六个月作为eVIN前期阶段的参考期限。对于所有冷链配送中心（CCPs），eVIN前期阶段的参考期限均为六个月，但由于eVIN推广的时间框架不同，各州和地区的具体期限有所不同。eVIN前期阶段的具体期限如下：多数地区CCPs的覆盖范围在2015年4月至2015年9月（13个地区）、2016年4月至2016年9月（12个地区）、2015年10月至2016年3月（11个地区）以及2012年10月至2013年3月（1个地区）。eVIN后期阶段的参考期限为2017年10月至2018年3月，用于评估。研究计算出的所需CCPs的最小数量为502个，考虑到43%的初级卫生保健中心（PHCs）报告了库存短缺的情况，10%的非响应率和1.2的设计效应。为了在州级别得出有效结论，这一数字进一步增加至617个。在eVIN州内，CCPs的选择采用了两阶段抽样设计。在第一阶段，选择了地区，第二阶段则选择了CCPs。在每个eVIN州内，抽样地区的数量根据CCPs的规模概率比例确定。总共选择了37个地区，采用系统随机抽样技术，在根据各州冷链配送中心的总比例份额对地区进行升序排列后进行选择。进一步地，在每个选定地区内随机选择了CCPs。更详细的方法可以在更大规模的研究文档中找到。通过结构化问卷从CCPs获取了关于库存管理、温度监控、冷链设备和疫苗供应链文档方面的定量数据。eVIN前期阶段的主要数据来源于库存登记册、疫苗分发登记册、温度记录簿以及其他重要登记册。在评估中分析了完整性和准确性。完整性的分析包括订单表、疫苗库存登记册和温度记录簿。准确性则通过库存登记册和eVIN记录、eVIN记录和实物盘点进行评估。采用计算机辅助个人访谈（CAPI）技术，使用平板电脑/手机进行实时数据收集和录入。