Data QA with Data Contracts and SQL

**Overview**
HWDataContracts is a comprehensive data contract management system designed for Databricks environments. It provides a robust framework for managing, validating, and executing data contracts between data producers and consumers. The system leverages Databricks' capabilities to ensure data quality, consistency, and reliability across your data ecosystem.

**Use cases**
- Dynamic Contract Management: Create and manage data contracts with customizable parameters and validation rules
- Schema Validation: Automatic validation of data against JSON schema definitions
- Data Quality Rules: Define and enforce data quality -
- Execution Tracking: Comprehensive logging of contract executions and validation results
- LLM Integration: Leverages Databricks-hosted LLMs for contract generation and validation rule creation

**Product details**
Add a maximum of 10 sample datasets and field names that represent your dataset.

- Datasets represented include patients table, the data is created using faker and its used for demo purposes.
- Sample data contract contract_bitol_01.yml with rules for the patient table.

For more details, refer to the embedded notebook.

**Additional Insights**
Learn more about us on our website [HatchworksAI](https://hatchworks.com/)
Keep up to date with the latest AI news on our [Podcast](https://hatchworks.com/talking-ai/).