SISAB municipal primary care production and CID/CIAP attendance data, Brazil, 2020

Description This deposit contains annual, municipality-level datasets derived from the Brazilian Primary Health Care Information System (SISAB). The files combine two complementary data sources: Public SISAB Saúde report downloads from the Atendimento/Visita production report.CID-10 and CIAP-2 attendance data obtained from SISAB through requests under the Brazilian Access to Information Law (Lei de Acesso à Informação, LAI). The datasets are organized as tidy annual files in CSV (Zipped) and Parquet format. They are intended to support reproducible analysis of primary care production, procedures, evaluated problems/conditions, and CID/CIAP-coded attendances across Brazilian municipalities. The public SISAB report datasets are stratified by competence month, state, municipality, DataSUS age group, SISAB sex category, and the selected report category. For each competence month and report type, the extraction combines 36 stratified SISAB downloads: 18 age groups by 2 sex values. Monthly files are merged into yearly files, completing missing combinations of observed competence, municipality, age group, sex, and category with valor = 0. The LAI dataset contains yearly CID-10 and CIAP-2 attendance counts by competence month, municipality, code type, and code. When multiple valid LAI files cover the same competence, the processing pipeline selects the file with the largest number of data rows, using file size and request folder order as tie-breakers. Provenance columns identify the selected LAI request and source file. Variables SISAB Saúde Produção Columns: competencia: competence month in YYYYMM format. uf: Brazilian state abbreviation. ibge: municipality IBGE code. municipio: municipality name. faixa_etaria: Age group. sexo: SISAB sex category, Masculino or Feminino. tipo_producao: production type from the SISAB report. valor: count reported by SISAB. SISAB Saúde Procedimento Columns: competencia: competence month in YYYYMM format. uf: Brazilian state abbreviation. ibge: municipality IBGE code. municipio: municipality name. faixa_etaria: age group. sexo: SISAB sex category, Masculino or Feminino. procedimento: procedure from the SISAB report. valor: count reported by SISAB SISAB Saúde Condição Avaliada Columns: competencia: competence month in YYYYMM format. uf: Brazilian state abbreviation. ibge: municipality IBGE code. municipio: municipality name. faixa_etaria: age group. sexo: SISAB sex category, Masculino or Feminino. condicao_avaliada: evaluated problem or condition from the SISAB report. valor: count reported by SISAB. SISAB LAI CID/CIAP Columns: ano_competencia: competence year. competencia: competence month in YYYYMM format. competencia_date: first day of the competence month. co_municipio_ibge: municipality IBGE code. tp_codigo: code type, CID or CIAP. codigo: CID-10 or CIAP-2 code. qt_atendimentos: number of attendances. source_request: selected LAI request folder. source_file: selected source CSV file. Methods The public SISAB report files were generated with the sisab_scrapper processing pipeline. For each month, report type, age group, and sex value, the pipeline downloads the all-Brazil municipality report from SISAB, validates the returned CSV, preserves raw cache files for resumable runs, and writes a sorted monthly tidy dataset. The yearly merge validates required columns, expected age groups, expected sex values, category values, and month gaps unless explicitly allowed. The CID/CIAP files were generated with the sisab_lai processing pipeline. The pipeline imports CSV files received through LAI requests, detects the real CSV header after any SQL*Plus preamble, validates candidate files, resolves overlapping requests by competence, standardizes old and new schemas into one tidy table, and exports annual CSV and Parquet files together with audit reports. Sources - SISAB public reports, Ministry of Health, Brazil: https://sisab.saude.gov.br/- SISAB LAI files obtained through Brazilian Access to Information Law requests.- Processing code for public SISAB report data: https://github.com/rfsaldanha/sisab_scrapper- Processing code for LAI CID/CIAP data: https://github.com/rfsaldanha/sisab_lai Notes - Counts are aggregated administrative records and should be interpreted in light of SISAB reporting practices, data quality, and changes in municipal reporting coverage.- Municipality boundaries, names, and coding practices may vary over time.- Public SISAB report datasets are completed with zero values only for combinations defined by observed municipalities, observed competencies, all expected age groups, both expected sex values, and observed report categories within the yearly merge.- LAI CID/CIAP data preserves selected source-file provenance through source_request and source_file.- This deposit corresponds to an individual year. Deposits for other years are published separately.数据集说明 本存档包含源自巴西初级卫生保健信息系统（SISAB）的年度市级层面数据集。本数据集整合了两个互补的数据源： 1. 从Atendimento/Visita生产报告中下载的公开SISAB Saúde报告数据； 2. 通过巴西信息获取法（Lei de Acesso à Informação, LAI）向SISAB申请获取的CID-10与CIAP-2就诊数据。 本数据集以整洁格式的年度文件形式组织，支持CSV（压缩）与Parquet两种存储格式，旨在支持对巴西各市级层面的初级卫生保健服务产出、诊疗操作、评估病症以及经CID/CIAP编码的就诊情况开展可复现分析。 公开SISAB报告数据集按核算月份、州份、市级行政区、DataSUS年龄分组、SISAB性别分类以及所选报告类别进行分层。针对每个核算月份与报告类型，数据提取流程会合并36组分层后的SISAB下载文件：即18个年龄分组与2个性别分组的全部组合。月度文件将被合并为年度文件，并将观测到的核算期、市级行政区、年龄组、性别及报告类别中缺失的组合补全，补全后对应计数值设为0。 LAI数据集包含按核算月份、市级行政区、编码类型及编码分组的年度CID-10与CIAP-2就诊人次统计。当多个有效LAI文件覆盖同一核算期时，处理流水线将选取数据行数最多的文件，以文件大小与申请文件夹顺序作为决胜规则。来源标识列用于标识所选的LAI申请文件与源文件。 ## 变量说明 ### SISAB Saúde Produção（SISAB卫生服务产出表） 字段说明： - competencia：核算月份，格式为YYYYMM。 - uf：巴西州份缩写。 - ibge：市级行政区IBGE编码。 - municipio：市级行政区名称。 - faixa_etaria：年龄分组。 - sexo：SISAB性别分类，包括Masculino（男性）与Feminino（女性）。 - tipo_producao：SISAB报告中的服务产出类型。 - valor：SISAB上报的计数值。 ### SISAB Saúde Procedimento（SISAB卫生诊疗操作表） 字段说明： - competencia：核算月份，格式为YYYYMM。 - uf：巴西州份缩写。 - ibge：市级行政区IBGE编码。 - municipio：市级行政区名称。 - faixa_etaria：年龄分组。 - sexo：SISAB性别分类，包括Masculino（男性）与Feminino（女性）。 - procedimento：SISAB报告中的诊疗操作名称。 - valor：SISAB上报的计数值。 ### SISAB Saúde Condição Avaliada（SISAB评估病症表） 字段说明： - competencia：核算月份，格式为YYYYMM。 - uf：巴西州份缩写。 - ibge：市级行政区IBGE编码。 - municipio：市级行政区名称。 - faixa_etaria：年龄分组。 - sexo：SISAB性别分类，包括Masculino（男性）与Feminino（女性）。 - condicao_avaliada：SISAB报告中的评估病症/健康问题。 - valor：SISAB上报的计数值。 ### SISAB LAI CID/CIAP（SISAB LAI CID/CIAP表） 字段说明： - ano_competencia：核算年份。 - competencia：核算月份，格式为YYYYMM。 - competencia_date：核算月份的首日。 - co_municipio_ibge：市级行政区IBGE编码。 - tp_codigo：编码类型，分为CID与CIAP。 - codigo：CID-10或CIAP-2编码。 - qt_atendimentos：就诊人次。 - source_request：选中的LAI申请文件夹。 - source_file：选中的源CSV文件。 ## 处理方法 公开SISAB报告文件通过`sisab_scrapper`处理流水线生成。针对每个月份、报告类型、年龄组及性别分组，该流水线从SISAB下载全巴西市级行政区报告，对返回的CSV文件进行格式校验，保留原始缓存文件以支持断点续跑，并输出排序后的月度整洁数据集。年度合并流程会校验必填字段、预期年龄分组、预期性别分组、类别取值以及月份间隔（除非明确允许存在间隔）。 CID/CIAP文件通过`sisab_lai`处理流水线生成。该流水线导入通过LAI申请获取的CSV文件，识别SQL*Plus前置内容后的真实CSV表头，对候选文件进行合法性校验，按核算期处理重叠的申请文件，将新旧两种数据表结构统一为单一整洁数据表，并导出年度CSV与Parquet文件，同时附带审计报告。 ## 数据来源 - 巴西卫生部SISAB公开报告：https://sisab.saude.gov.br/ - 通过巴西信息获取法申请获取的SISAB LAI文件。 - SISAB公开报告数据处理代码：https://github.com/rfsaldanha/sisab_scrapper - LAI CID/CIAP数据处理代码：https://github.com/rfsaldanha/sisab_lai ## 备注 - 本数据集的计数值为聚合后的行政记录，解读时需结合SISAB的报告规范、数据质量以及市级报告覆盖范围的变化情况。 - 市级行政区的边界、名称及编码规范可能随时间发生变化。 - 在年度合并流程中，仅针对已观测到的市级行政区、核算期、所有预期年龄分组、两类预期性别分组以及已观测到的报告类别所构成的组合，才会将缺失值补全为0。 - LAI CID/CIAP数据通过`source_request`与`source_file`列保留所选源文件的来源信息。 - 本存档仅对应单个年度，其他年度的存档将单独发布。