Witboost is a Data Produt Management Platform capable of managing the end to end lifeycle of data products with the highest standards of data governance. Want to know more about Witboost? Check it out here or contact us!.

Witboost Policies Gallery

This repository contains a collection of Computational Policies that can be imported in Witboost. Here the official documentation around governance policies

LLM Policies

Name	Goal	Entity	Policy Type
AI Act	AI Act - Model desriptor definition	Model Descriptor	Metadata Correctness
Business Descriptions	Meaningful Business Descriptions	Data Contract	Metadata Meaningfulness
PII Detection	PII Tagging Execution	Data Contract	Metadata Correctness
DORA	Verify if DataProduct has been classified according to DORA	Data Product	Metadata Correctness
Agent Descriptor	Verify if Agent has been described properly	AI Agent	Metadata Correctness
Lifeycle	Apply Constrains to the DataProduct Lifecycle	Data Product	Change Management

Script Policies

Name	Goal	Entity	Policy Type	Tech
Data Product Spec Validation	Validate the Data Product specification	Data Product	Metadata Completeness
Open Data Contract Standard	Validate the ODCS specification	Data Contract	Metadata Completeness
Breaking Change	Detect breaking changes in Data Contracts before they happen	Data Contract	Change Management
Data Quality	Verify that Data Contracts are including DQ expectations	Data Contract	Data Quality
GDPR PII	Check consistency of PII tagging on sensitive entities	Data Contract	Security
Sample Data	Verify the presence of a sample dataset for data preview	Data Contract	Metadata Completeness
Airbyte Policy	Ingestion pipeline configured properly	Airbyte Workload	Architecture Consistency
Airflow Policy	Scheduling respects standard configuration	Airflow Workload	Architecture Consistency
DBT Policy	DBT Project configuration check	DBT Workload	Architecture Consistency
Snowflake Storage Area Policy	Storage configuration check	Snowflake Storage Area	Architecture Consistency
Snowflake Output Port Policy	Snowflake Output Port definition check	Snowflake Output Port	Metadata Completeness
Power BI	Power BI Semantic Model validation	BI Report	Metadata Completeness
GraphQL Output Port	Assess that Data Product expose GraphQL Output Port	Data Product	Architecture Consistency
Observability API	Verify that the Observability API component is present	Data Product	Architecture Consistency

Usage

Note

This is an example of how create a deployment time policy

• Clone the project locally to have all the governance policies available to you locally.
• Go to Witboost UI and open Governance > Registry.
• For each policy, click on the Create Policy button located in the upper right corner of the policy list and follow the appropriate steps depending on the policy type:
• Global policy:
  1. Fill out the menu with "Name" and "Description" as General Policy, on the "Environment" drop down choose the environment, in this case it's development.
  2. Select "Resource Type" as Data Product, "Context" as global, "Trigger" as Active, "Timing" as Deployment, "Engine" as Cue, "Resource Preprocessing" as Default, "Severity" as error.
  3. Leave Infrastructure Template empty.
  4. Select "Interaction Type" as User to Platform.
  5. Click on "Next Step" and on the Engine Metadata click on the "Upload CUE" button in the upper right corner and upload the global_policy.cue file.
  6. Click on "Next Step" and if all the information is correct, hit save. The policy should appear in the list in the "Draft" status.
  7. Click on the contextual menu (three buttons to the right) and change the status to "Grace" and then to "Enabled".
• Components policies:
  1. Fill out the menu with "Name" and "Description" appropriate with the component policy, on the "Environment" drop down choose the environment, in this case it's development.
  2. Select the same fields as step 2 in Global Policy.
  3. Select Infrastructure Template and Use Case Template based on the Component Policy you're registering. This means choosing the infrastructure template you used for Snowflake for Snowflake components, with the specific component use case template Storage Area or Output Port, etc.
  4. Select the same as step 4 in Global Policy.
  5. Repeat steps 5-7 as for the Global Policy but with the appropriate CUE file.

License

This project is available under the Apache License, Version 2.0; see LICENSE for full details.

About Witboost

Witboost is a cutting-edge Data Experience platform, that streamlines complex data projects across various platforms, enabling seamless data production and consumption. This unified approach empowers you to fully utilize your data without platform-specific hurdles, fostering smoother collaboration across teams.

It seamlessly blends business-relevant information, data governance processes, and IT delivery, ensuring technically sound data projects aligned with strategic objectives. Witboost facilitates data-driven decision-making while maintaining data security, ethics, and regulatory compliance.

Moreover, Witboost maximizes data potential through automation, freeing resources for strategic initiatives. Apply your data for growth, innovation and competitive advantage.

Contact us or follow us on:

• LinkedIn
• YouTube