SISAB municipal primary care production and CID/CIAP attendance data, Brazil, 2024

Description This deposit contains annual, municipality-level datasets derived from the Brazilian Primary Health Care Information System (SISAB). The files combine two complementary data sources: Public SISAB Saúde report downloads from the Atendimento/Visita production report.CID-10 and CIAP-2 attendance data obtained from SISAB through requests under the Brazilian Access to Information Law (Lei de Acesso à Informação, LAI). The datasets are organized as tidy annual files in CSV (Zipped) and Parquet format. They are intended to support reproducible analysis of primary care production, procedures, evaluated problems/conditions, and CID/CIAP-coded attendances across Brazilian municipalities. The public SISAB report datasets are stratified by competence month, state, municipality, DataSUS age group, SISAB sex category, and the selected report category. For each competence month and report type, the extraction combines 36 stratified SISAB downloads: 18 age groups by 2 sex values. Monthly files are merged into yearly files, completing missing combinations of observed competence, municipality, age group, sex, and category with valor = 0. The LAI dataset contains yearly CID-10 and CIAP-2 attendance counts by competence month, municipality, code type, and code. When multiple valid LAI files cover the same competence, the processing pipeline selects the file with the largest number of data rows, using file size and request folder order as tie-breakers. Provenance columns identify the selected LAI request and source file. Variables SISAB Saúde Produção Columns: competencia: competence month in YYYYMM format. uf: Brazilian state abbreviation. ibge: municipality IBGE code. municipio: municipality name. faixa_etaria: Age group. sexo: SISAB sex category, Masculino or Feminino. tipo_producao: production type from the SISAB report. valor: count reported by SISAB. SISAB Saúde Procedimento Columns: competencia: competence month in YYYYMM format. uf: Brazilian state abbreviation. ibge: municipality IBGE code. municipio: municipality name. faixa_etaria: age group. sexo: SISAB sex category, Masculino or Feminino. procedimento: procedure from the SISAB report. valor: count reported by SISAB SISAB Saúde Condição Avaliada Columns: competencia: competence month in YYYYMM format. uf: Brazilian state abbreviation. ibge: municipality IBGE code. municipio: municipality name. faixa_etaria: age group. sexo: SISAB sex category, Masculino or Feminino. condicao_avaliada: evaluated problem or condition from the SISAB report. valor: count reported by SISAB. SISAB LAI CID/CIAP Columns: ano_competencia: competence year. competencia: competence month in YYYYMM format. competencia_date: first day of the competence month. co_municipio_ibge: municipality IBGE code. tp_codigo: code type, CID or CIAP. codigo: CID-10 or CIAP-2 code. qt_atendimentos: number of attendances. source_request: selected LAI request folder. source_file: selected source CSV file. Methods The public SISAB report files were generated with the sisab_scrapper processing pipeline. For each month, report type, age group, and sex value, the pipeline downloads the all-Brazil municipality report from SISAB, validates the returned CSV, preserves raw cache files for resumable runs, and writes a sorted monthly tidy dataset. The yearly merge validates required columns, expected age groups, expected sex values, category values, and month gaps unless explicitly allowed. The CID/CIAP files were generated with the sisab_lai processing pipeline. The pipeline imports CSV files received through LAI requests, detects the real CSV header after any SQL*Plus preamble, validates candidate files, resolves overlapping requests by competence, standardizes old and new schemas into one tidy table, and exports annual CSV and Parquet files together with audit reports. Sources - SISAB public reports, Ministry of Health, Brazil: https://sisab.saude.gov.br/- SISAB LAI files obtained through Brazilian Access to Information Law requests.- Processing code for public SISAB report data: https://github.com/rfsaldanha/sisab_scrapper- Processing code for LAI CID/CIAP data: https://github.com/rfsaldanha/sisab_lai Notes - Counts are aggregated administrative records and should be interpreted in light of SISAB reporting practices, data quality, and changes in municipal reporting coverage.- Municipality boundaries, names, and coding practices may vary over time.- Public SISAB report datasets are completed with zero values only for combinations defined by observed municipalities, observed competencies, all expected age groups, both expected sex values, and observed report categories within the yearly merge.- LAI CID/CIAP data preserves selected source-file provenance through source_request and source_file.- This deposit corresponds to an individual year. Deposits for other years are published separately.## 数据集描述 本数据集存档包含源自巴西初级卫生保健信息系统（SISAB）的年度市级层级数据集。本数据集整合了两类互补数据源： 1. 从就诊/访视生产报告下载的公开SISAB卫生报告数据； 2. 通过巴西信息获取法（Lei de Acesso à Informação，LAI）申请从SISAB获取的CID-10与CIAP-2就诊数据。 数据集以整洁的年度文件形式组织，格式为压缩CSV与Parquet，旨在支持巴西全市域范围内初级卫生保健服务产出、操作流程、评估病症以及经CID/CIAP编码的就诊情况的可复现分析。 公开SISAB报告数据集按统计周期月份、州、市级、DataSUS年龄组别、SISAB性别分类以及选定的报告类别进行分层。针对每个统计周期月份与报告类型，数据提取整合了36份分层SISAB下载文件：按2个性别分类覆盖18个年龄组别。月度文件将被合并为年度文件，对已观测到的统计周期、市级、年龄组别、性别及类别中缺失的组合补全`valor=0`的记录。 LAI数据集包含按统计周期月份、市级、编码类型及编码分组的年度CID-10与CIAP-2就诊人次统计。当多个有效LAI文件覆盖同一统计周期时，处理流程将选取数据行数最多的文件，以文件大小与申请文件夹顺序作为并列排序依据。溯源列用于标识选定的LAI申请与源文件。 ## 变量 ### SISAB卫生服务产出表（SISAB Saúde Produção） 列字段说明： - `competencia`：统计周期月份，格式为YYYYMM - `uf`：巴西州级缩写 - `ibge`：市级IBGE编码 - `municipio`：市级名称 - `faixa_etaria`：年龄组别 - `sexo`：SISAB性别分类，分为`Masculino`（男性）与`Feminino`（女性） - `tipo_producao`：SISAB报告中的服务产出类型 - `valor`：SISAB上报的统计数值 ### SISAB卫生操作表（SISAB Saúde Procedimento） 列字段说明： - `competencia`：统计周期月份，格式为YYYYMM - `uf`：巴西州级缩写 - `ibge`：市级IBGE编码 - `municipio`：市级名称 - `faixa_etaria`：年龄组别 - `sexo`：SISAB性别分类，分为`Masculino`（男性）与`Feminino`（女性） - `procedimento`：SISAB报告中的操作项目 - `valor`：SISAB上报的统计数值 ### SISAB评估病症表（SISAB Saúde Condição Avaliada） 列字段说明： - `competencia`：统计周期月份，格式为YYYYMM - `uf`：巴西州级缩写 - `ibge`：市级IBGE编码 - `municipio`：市级名称 - `faixa_etaria`：年龄组别 - `sexo`：SISAB性别分类，分为`Masculino`（男性）与`Feminino`（女性） - `condicao_avaliada`：SISAB报告中的评估病症或健康问题 - `valor`：SISAB上报的统计数值 ### SISAB LAI CID/CIAP表 列字段说明： - `ano_competencia`：统计周期年份 - `competencia`：统计周期月份，格式为YYYYMM - `competencia_date`：统计周期月份的首日 - `co_municipio_ibge`：市级IBGE编码 - `tp_codigo`：编码类型，分为`CID`或`CIAP` - `codigo`：CID-10或CIAP-2编码 - `qt_atendimentos`：就诊人次 - `source_request`：选定的LAI申请文件夹 - `source_file`：选定的源CSV文件 ## 处理方法 公开SISAB报告文件通过`sisab_scrapper`处理流程生成。针对每个月份、报告类型、年龄组别与性别分类，该流程从SISAB下载覆盖全巴西市级的报告，对返回的CSV文件进行校验，保留原始缓存文件以支持断点续跑，并生成已排序的月度整洁数据集。年度合并流程将校验必填列、预期年龄组别、预期性别分类、类别值以及月份间隔，除非已明确允许缺失。 CID/CIAP文件通过`sisab_lai`处理流程生成。该流程导入通过LAI申请获取的CSV文件，识别SQL*Plus前置内容后的真实CSV表头，对候选文件进行校验，按统计周期解决重复申请的冲突，将新旧数据模式统一为单一整洁数据表，并导出年度CSV与Parquet文件及审计报告。 ## 数据来源 1. SISAB公开报告，巴西卫生部：https://sisab.saude.gov.br/ 2. 通过巴西信息获取法申请获取的SISAB LAI文件 3. 公开SISAB报告数据的处理代码：https://github.com/rfsaldanha/sisab_scrapper 4. LAI CID/CIAP数据的处理代码：https://github.com/rfsaldanha/sisab_lai ## 备注 1. 统计数值为聚合后的行政记录，解读时需结合SISAB的报告规范、数据质量以及市级报告覆盖范围的变化。 2. 市级行政边界、名称及编码规范可能随时间发生变化。 3. 在年度合并流程中，公开SISAB报告数据集仅针对已观测到的市级、统计周期、所有预期年龄组别、两类预期性别分类以及已观测到的报告类别所构成的组合补全零值。 4. LAI CID/CIAP数据通过`source_request`与`source_file`列保留选定源文件的溯源信息。 5. 本数据集存档对应单一自然年度，其他年度的存档将单独发布。