Dataform | Manage data in Snowflake, BigQuery, Redshift

Build reliable, timely data pipelines. Without help from engineering.

Dataform is where your data team works together to build a single source of truth for your company’s data. Collaborate on SQL pipelines in your warehouse without writing code or managing infrastructure.

Kaleva
Livup
Echo
Charlotte Tilbury
Curology
Big Tree
Teatime Games
Slite
Tasman Analytics
Butternut Box
Outshine
Dreamdata
Mittelbayerische
SME Capital
Mixcloud

A delightful development experience

</>

Autosave and instant compilation feedback on compiled queries

Dataform saves your queries as you develop, ensuring users never lose work. Get feedback on errors and inferred dependencies as you type.

</>

Real time query validation

Dataform validates compiled queries against the data warehouse in real time, helping users identify issues before running queries.

</>

Develop and test changes in isolation

Work in an isolated development environment, run queries, tests and inspect results before committing, without overriding production data.

Scale your data team through effective collaboration

</>

Version control made easy

Inspect changes before committing, add messages and revert files without touching a command line.

</>

Adopt modern code review processes

When your changes are tested and ready to go, create a pull request so your team can review it.

</>

Git modal for changes and merges

Dataform makes it easy to review all changes made before pushing to master or to a Git branch.

Ensure data is accurate and up to date

</>

Scheduling and environments

Configure schedules across multiple environments such as staging and production. Running your scripts on a repeating schedule ensures output data is always kept up to date.

</>

Test data quality with assertions

Assertions enable you to check that the datasets you create are correct. Quickly add data quality checks for uniqueness or null values, or write a custom assertion in SQL to check any property of your data.

</>

Get alerts via Email and Slack

Quickly react if your pipeline or data quality tests fail through email and slack notifications.

Make data discoverable across your organisation

</>

Turn your code into a shareable catalog

Give business users and other analysts visibility into your data model, enabling them to answer data questions quickly by making it easy to search across tables, columns and other table metadata.

</>

Live dependency tree

Dataform updates the entire dependency tree of your project with every save so you can get a quick visual overview of how your tables, views, and other actions depend on each other while developing.

</>

Documenting datasets

Document your datasets in the same file where you define you transformations and push that metadata back to your warehouse where it can be consumed by other tools.

Where Dataform fits in your stack

Dataform enables analysts to manage all data processes in your warehouse, turning raw data into the clean datasets you need for analytics.

What our customers say

Benoit Photo
Benoit Machefer

Director of Data

If your business is scaling fast and you want to ensure data quality, make your life easier, leverage engineering best practices and remain BI tool agnostic then don’t hesitate to use Dataform for a second!

Echo Logo
speech marks
Saadat Photo
Saadat Qadri

Analytics Practice Lead

Having modeled data using other tools in the past, this is much simpler and an easier environment to code in. The code compiles in real time and lets you know if there are errors in the syntax. It also helps generate a dependency graph for the data pipeline which is insanely useful.

Outshine Logo
speech marks
Will Photo
Will Misslin

Data Engineer

After using Dataform for a while I really discovered the power of integrating an IDE with an ETL tool. The web based IDE completely eliminates the hassle of maintaining local dev environments.

Curology Logo
speech marks

Getting started is easy

Connect to your warehouse and publish your first data model in 5 minutes.